Nov 14 09:39:41 user nova-compute[75229]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_linux_bridge.linux_bridge.LinuxBridgePlugin'>' with name 'linux_bridge' {{(pid=75229) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 14 09:39:41 user nova-compute[75229]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_noop.noop.NoOpPlugin'>' with name 'noop' {{(pid=75229) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 14 09:39:41 user nova-compute[75229]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_ovs.ovs.OvsPlugin'>' with name 'ovs' {{(pid=75229) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 14 09:39:41 user nova-compute[75229]: INFO os_vif [-] Loaded VIF plugins: linux_bridge, noop, ovs
Nov 14 09:39:41 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): grep -F node.session.scan /sbin/iscsiadm {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:39:41 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "grep -F node.session.scan /sbin/iscsiadm" returned: 0 in 0.018s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:39:41 user nova-compute[75229]: INFO nova.virt.driver [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] Loading compute driver 'libvirt.LibvirtDriver'
Nov 14 09:39:41 user nova-compute[75229]: INFO nova.compute.provider_config [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access.
Nov 14 09:39:41 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] Acquiring lock "singleton_lock" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 09:39:41 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] Acquired lock "singleton_lock" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] Releasing lock "singleton_lock" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] Full set of CONF: {{(pid=75229) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/service.py:362}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] ******************************************************************************** {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2589}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] Configuration options gathered from: {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2590}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] command line args: ['--config-file', '/etc/nova/nova-cpu.conf'] {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2591}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] config files: ['/etc/nova/nova-cpu.conf'] {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2592}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] ================================================================================ {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2594}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] allow_resize_to_same_host      = True {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] arq_binding_timeout            = 300 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] backdoor_port                  = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] backdoor_socket                = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] block_device_allocate_retries  = 300 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] block_device_allocate_retries_interval = 5 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] cert                           = self.pem {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] compute_driver                 = libvirt.LibvirtDriver {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] compute_monitors               = [] {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] config_dir                     = [] {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] config_drive_format            = iso9660 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] config_file                    = ['/etc/nova/nova-cpu.conf'] {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] config_source                  = [] {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] console_host                   = user {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] control_exchange               = nova {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] cpu_allocation_ratio           = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] daemon                         = False {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] debug                          = True {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] default_access_ip_network_name = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] default_availability_zone      = nova {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] default_ephemeral_format       = ext4 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] default_green_pool_size        = 1000 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] default_schedule_zone          = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] disk_allocation_ratio          = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] enable_new_services            = True {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] enabled_apis                   = ['osapi_compute'] {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] enabled_ssl_apis               = [] {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] flat_injected                  = False {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] force_config_drive             = False {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] force_raw_images               = True {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] graceful_shutdown_timeout      = 5 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] heal_instance_info_cache_interval = 60 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] host                           = user {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] initial_cpu_allocation_ratio   = 4.0 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] initial_disk_allocation_ratio  = 1.0 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] initial_ram_allocation_ratio   = 1.0 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] injected_network_template      = /opt/stack/nova/nova/virt/interfaces.template {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] instance_build_timeout         = 0 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] instance_delete_interval       = 300 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] instance_format                = [instance: %(uuid)s]  {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] instance_name_template         = instance-%08x {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] instance_usage_audit           = False {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] instance_usage_audit_period    = month {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] instances_path                 = /opt/stack/data/nova/instances {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] internal_service_availability_zone = internal {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] key                            = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] live_migration_retry_count     = 30 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] log_config_append              = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] log_dir                        = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] log_file                       = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] log_options                    = True {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] log_rotate_interval            = 1 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] log_rotate_interval_type       = days {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] log_rotation_type              = none {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] long_rpc_timeout               = 1800 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] max_concurrent_builds          = 10 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] max_concurrent_live_migrations = 1 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] max_concurrent_snapshots       = 5 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] max_local_block_devices        = 3 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] max_logfile_count              = 30 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] max_logfile_size_mb            = 200 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] maximum_instance_delete_attempts = 5 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] metadata_listen                = 0.0.0.0 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] metadata_listen_port           = 8775 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] metadata_workers               = 3 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] migrate_max_retries            = -1 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] mkisofs_cmd                    = genisoimage {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] my_block_storage_ip            = 10.0.0.210 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] my_ip                          = 10.0.0.210 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] network_allocate_retries       = 0 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] osapi_compute_listen           = 0.0.0.0 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] osapi_compute_listen_port      = 8774 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] osapi_compute_unique_server_name_scope =  {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] osapi_compute_workers          = 3 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] password_length                = 12 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] periodic_enable                = True {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] periodic_fuzzy_delay           = 60 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] pointer_model                  = ps2mouse {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] preallocate_images             = none {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] publish_errors                 = False {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] pybasedir                      = /opt/stack/nova {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] ram_allocation_ratio           = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] rate_limit_burst               = 0 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] rate_limit_except_level        = CRITICAL {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] rate_limit_interval            = 0 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] reboot_timeout                 = 0 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] reclaim_instance_interval      = 0 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] record                         = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] reimage_timeout_per_gb         = 60 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] report_interval                = 120 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] rescue_timeout                 = 0 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] reserved_host_cpus             = 0 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] reserved_host_disk_mb          = 0 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] reserved_host_memory_mb        = 512 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] reserved_huge_pages            = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] resize_confirm_window          = 0 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] resize_fs_using_block_device   = False {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] resume_guests_state_on_host_boot = False {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] rootwrap_config                = /etc/nova/rootwrap.conf {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] rpc_response_timeout           = 60 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] run_external_periodic_tasks    = True {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] running_deleted_instance_action = reap {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] running_deleted_instance_poll_interval = 1800 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] running_deleted_instance_timeout = 0 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] scheduler_instance_sync_interval = 120 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] service_down_time              = 720 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] servicegroup_driver            = db {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] shelved_offload_time           = 0 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] shelved_poll_interval          = 3600 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] shutdown_timeout               = 0 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] source_is_ipv6                 = False {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] ssl_only                       = False {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] state_path                     = /opt/stack/data/nova {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] sync_power_state_interval      = 600 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] sync_power_state_pool_size     = 1000 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] syslog_log_facility            = LOG_USER {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] tempdir                        = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] timeout_nbd                    = 10 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] transport_url                  = **** {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] update_resources_interval      = 0 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] use_cow_images                 = True {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] use_eventlog                   = False {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] use_journal                    = False {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] use_json                       = False {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] use_rootwrap_daemon            = False {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] use_stderr                     = False {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] use_syslog                     = False {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] vcpu_pin_set                   = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] vif_plugging_is_fatal          = False {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] vif_plugging_timeout           = 0 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] virt_mkfs                      = [] {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] volume_usage_poll_interval     = 0 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] watch_log_file                 = False {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] web                            = /usr/share/spice-html5 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] oslo_concurrency.disable_process_locking = False {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] oslo_concurrency.lock_path     = /opt/stack/data/nova {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] api.auth_strategy              = keystone {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] api.compute_link_prefix        = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] api.dhcp_domain                = novalocal {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] api.enable_instance_password   = True {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] api.glance_link_prefix         = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] api.instance_list_cells_batch_fixed_size = 100 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] api.instance_list_cells_batch_strategy = distributed {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] api.instance_list_per_project_cells = False {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] api.list_records_by_skipping_down_cells = True {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] api.local_metadata_per_cell    = False {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] api.max_limit                  = 1000 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] api.metadata_cache_expiration  = 15 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] api.neutron_default_tenant_id  = default {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] api.use_forwarded_for          = False {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] api.use_neutron_default_nets   = False {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] api.vendordata_dynamic_connect_timeout = 5 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] api.vendordata_dynamic_failure_fatal = False {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] api.vendordata_dynamic_read_timeout = 5 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] api.vendordata_dynamic_ssl_certfile =  {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] api.vendordata_dynamic_targets = [] {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] api.vendordata_jsonfile_path   = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] api.vendordata_providers       = ['StaticJSON'] {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] cache.backend                  = dogpile.cache.memcached {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] cache.backend_argument         = **** {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] cache.config_prefix            = cache.oslo {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] cache.dead_timeout             = 60.0 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] cache.debug_cache_backend      = False {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] cache.enable_retry_client      = False {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] cache.enable_socket_keepalive  = False {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] cache.enabled                  = True {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] cache.expiration_time          = 600 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] cache.hashclient_retry_attempts = 2 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] cache.hashclient_retry_delay   = 1.0 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] cache.memcache_dead_retry      = 300 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] cache.memcache_password        =  {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] cache.memcache_pool_maxsize    = 10 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] cache.memcache_sasl_enabled    = False {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] cache.memcache_socket_timeout  = 1.0 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] cache.memcache_username        =  {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] cache.proxies                  = [] {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] cache.retry_attempts           = 2 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] cache.retry_delay              = 0.0 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] cache.socket_keepalive_count   = 1 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] cache.socket_keepalive_idle    = 1 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] cache.socket_keepalive_interval = 1 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] cache.tls_allowed_ciphers      = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] cache.tls_cafile               = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] cache.tls_certfile             = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] cache.tls_enabled              = False {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] cache.tls_keyfile              = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] cinder.auth_section            = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] cinder.auth_type               = password {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] cinder.cafile                  = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] cinder.catalog_info            = volumev3::publicURL {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] cinder.certfile                = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] cinder.collect_timing          = False {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] cinder.cross_az_attach         = True {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] cinder.debug                   = False {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] cinder.endpoint_template       = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] cinder.http_retries            = 3 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] cinder.insecure                = False {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] cinder.keyfile                 = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] cinder.os_region_name          = RegionOne {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] cinder.split_loggers           = False {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] cinder.timeout                 = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] compute.consecutive_build_service_disable_threshold = 10 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] compute.cpu_dedicated_set      = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] compute.cpu_shared_set         = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] compute.image_type_exclude_list = [] {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] compute.live_migration_wait_for_vif_plug = True {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] compute.max_concurrent_disk_ops = 0 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] compute.max_disk_devices_to_attach = -1 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] compute.resource_provider_association_refresh = 300 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] compute.shutdown_retry_interval = 10 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] compute.vmdk_allowed_types     = ['streamOptimized', 'monolithicSparse'] {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] conductor.workers              = 3 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] console.allowed_origins        = [] {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] console.ssl_ciphers            = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] console.ssl_minimum_version    = default {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] consoleauth.token_ttl          = 600 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] cyborg.cafile                  = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] cyborg.certfile                = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] cyborg.collect_timing          = False {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] cyborg.connect_retries         = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] cyborg.connect_retry_delay     = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] cyborg.endpoint_override       = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] cyborg.insecure                = False {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] cyborg.keyfile                 = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] cyborg.max_version             = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] cyborg.min_version             = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] cyborg.region_name             = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] cyborg.service_name            = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] cyborg.service_type            = accelerator {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] cyborg.split_loggers           = False {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] cyborg.status_code_retries     = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] cyborg.status_code_retry_delay = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] cyborg.timeout                 = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] cyborg.valid_interfaces        = ['internal', 'public'] {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] cyborg.version                 = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] database.backend               = sqlalchemy {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] database.connection            = **** {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] database.connection_debug      = 0 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] database.connection_parameters =  {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] database.connection_recycle_time = 3600 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] database.connection_trace      = False {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] database.db_inc_retry_interval = True {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] database.db_max_retries        = 20 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] database.db_max_retry_interval = 10 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] database.db_retry_interval     = 1 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] database.max_overflow          = 50 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] database.max_pool_size         = 5 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] database.max_retries           = 10 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] database.mysql_wsrep_sync_wait = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] database.pool_timeout          = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] database.retry_interval        = 10 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] database.slave_connection      = **** {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] database.sqlite_synchronous    = True {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] api_database.backend           = sqlalchemy {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] api_database.connection        = **** {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] api_database.connection_debug  = 0 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] api_database.connection_parameters =  {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] api_database.connection_recycle_time = 3600 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] api_database.connection_trace  = False {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] api_database.db_inc_retry_interval = True {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] api_database.db_max_retries    = 20 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] api_database.db_max_retry_interval = 10 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] api_database.db_retry_interval = 1 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] api_database.max_overflow      = 50 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] api_database.max_pool_size     = 5 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] api_database.max_retries       = 10 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] api_database.mysql_sql_mode    = TRADITIONAL {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] api_database.mysql_wsrep_sync_wait = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] api_database.pool_timeout      = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] api_database.retry_interval    = 10 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] api_database.slave_connection  = **** {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] api_database.sqlite_synchronous = True {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] devices.enabled_mdev_types     = [] {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] ephemeral_storage_encryption.enabled = False {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] ephemeral_storage_encryption.key_size = 512 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] glance.api_servers             = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] glance.cafile                  = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] glance.certfile                = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] glance.collect_timing          = False {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] glance.connect_retries         = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] glance.connect_retry_delay     = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] glance.debug                   = False {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] glance.default_trusted_certificate_ids = [] {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] glance.enable_certificate_validation = False {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] glance.enable_rbd_download     = False {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] glance.endpoint_override       = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] glance.insecure                = False {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] glance.keyfile                 = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] glance.max_version             = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] glance.min_version             = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] glance.num_retries             = 3 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] glance.rbd_ceph_conf           =  {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] glance.rbd_connect_timeout     = 5 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] glance.rbd_pool                =  {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] glance.rbd_user                =  {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] glance.region_name             = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] glance.service_name            = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] glance.service_type            = image {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] glance.split_loggers           = False {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] glance.status_code_retries     = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] glance.status_code_retry_delay = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] glance.timeout                 = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] glance.valid_interfaces        = ['internal', 'public'] {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] glance.verify_glance_signatures = False {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] glance.version                 = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] guestfs.debug                  = False {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] hyperv.config_drive_cdrom      = False {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] hyperv.config_drive_inject_password = False {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] hyperv.dynamic_memory_ratio    = 1.0 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] hyperv.enable_instance_metrics_collection = False {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] hyperv.enable_remotefx         = False {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] hyperv.instances_path_share    =  {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] hyperv.iscsi_initiator_list    = [] {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] hyperv.limit_cpu_features      = False {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] hyperv.mounted_disk_query_retry_count = 10 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] hyperv.power_state_check_timeframe = 60 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] hyperv.power_state_event_polling_interval = 2 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] hyperv.qemu_img_cmd            = qemu-img.exe {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] hyperv.use_multipath_io        = False {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] hyperv.volume_attach_retry_count = 10 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] hyperv.volume_attach_retry_interval = 5 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] hyperv.vswitch_name            = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] hyperv.wait_soft_reboot_seconds = 60 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] mks.enabled                    = False {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] mks.mksproxy_base_url          = http://127.0.0.1:6090/ {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] image_cache.manager_interval   = 2400 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] image_cache.precache_concurrency = 1 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] image_cache.remove_unused_base_images = True {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] image_cache.subdirectory_name  = _base {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] ironic.api_max_retries         = 60 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] ironic.api_retry_interval      = 2 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] ironic.auth_section            = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] ironic.auth_type               = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] ironic.cafile                  = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] ironic.certfile                = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] ironic.collect_timing          = False {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] ironic.conductor_group         = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] ironic.connect_retries         = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] ironic.connect_retry_delay     = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] ironic.endpoint_override       = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] ironic.insecure                = False {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] ironic.keyfile                 = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] ironic.max_version             = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] ironic.min_version             = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] ironic.peer_list               = [] {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] ironic.region_name             = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] ironic.serial_console_state_timeout = 10 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] ironic.service_name            = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] ironic.service_type            = baremetal {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] ironic.split_loggers           = False {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] ironic.status_code_retries     = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] ironic.status_code_retry_delay = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] ironic.timeout                 = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] ironic.valid_interfaces        = ['internal', 'public'] {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] ironic.version                 = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] key_manager.backend            = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] key_manager.fixed_key          = **** {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] barbican.barbican_api_version  = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] barbican.barbican_endpoint     = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] barbican.barbican_endpoint_type = public {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] barbican.barbican_region_name  = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] barbican.cafile                = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] barbican.certfile              = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] barbican.collect_timing        = False {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] barbican.insecure              = False {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] barbican.keyfile               = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] barbican.number_of_retries     = 60 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] barbican.retry_delay           = 1 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] barbican.send_service_user_token = False {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] barbican.split_loggers         = False {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] barbican.timeout               = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] barbican.verify_ssl            = True {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] barbican.verify_ssl_path       = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] barbican_service_user.auth_section = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] barbican_service_user.auth_type = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] barbican_service_user.cafile   = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] barbican_service_user.certfile = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] barbican_service_user.collect_timing = False {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] barbican_service_user.insecure = False {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] barbican_service_user.keyfile  = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] barbican_service_user.split_loggers = False {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] barbican_service_user.timeout  = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] vault.approle_role_id          = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] vault.approle_secret_id        = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] vault.cafile                   = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] vault.certfile                 = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] vault.collect_timing           = False {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] vault.insecure                 = False {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] vault.keyfile                  = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] vault.kv_mountpoint            = secret {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] vault.kv_path                  = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] vault.kv_version               = 2 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] vault.namespace                = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] vault.root_token_id            = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] vault.split_loggers            = False {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] vault.ssl_ca_crt_file          = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] vault.timeout                  = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] vault.use_ssl                  = False {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] keystone.auth_section          = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] keystone.auth_type             = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] keystone.cafile                = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] keystone.certfile              = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] keystone.collect_timing        = False {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] keystone.connect_retries       = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] keystone.connect_retry_delay   = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] keystone.endpoint_override     = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] keystone.insecure              = False {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] keystone.keyfile               = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] keystone.max_version           = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] keystone.min_version           = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] keystone.region_name           = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] keystone.service_name          = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] keystone.service_type          = identity {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] keystone.split_loggers         = False {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] keystone.status_code_retries   = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] keystone.status_code_retry_delay = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] keystone.timeout               = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] keystone.valid_interfaces      = ['internal', 'public'] {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] keystone.version               = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] libvirt.connection_uri         =  {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] libvirt.cpu_mode               = custom {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] libvirt.cpu_model_extra_flags  = [] {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: WARNING oslo_config.cfg [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt".
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] libvirt.cpu_models             = ['Nehalem'] {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] libvirt.cpu_power_governor_high = performance {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] libvirt.cpu_power_governor_low = powersave {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] libvirt.cpu_power_management   = False {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] libvirt.cpu_power_management_strategy = cpu_state {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] libvirt.device_detach_attempts = 8 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] libvirt.device_detach_timeout  = 20 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] libvirt.disk_cachemodes        = [] {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] libvirt.disk_prefix            = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] libvirt.enabled_perf_events    = [] {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] libvirt.file_backed_memory     = 0 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] libvirt.gid_maps               = [] {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] libvirt.hw_disk_discard        = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] libvirt.hw_machine_type        = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] libvirt.images_rbd_ceph_conf   =  {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] libvirt.images_rbd_glance_store_name =  {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] libvirt.images_rbd_pool        = rbd {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] libvirt.images_type            = default {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] libvirt.images_volume_group    = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] libvirt.inject_key             = False {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] libvirt.inject_partition       = -2 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] libvirt.inject_password        = False {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] libvirt.iscsi_iface            = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] libvirt.iser_use_multipath     = False {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] libvirt.live_migration_bandwidth = 0 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] libvirt.live_migration_completion_timeout = 800 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] libvirt.live_migration_downtime = 500 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] libvirt.live_migration_downtime_delay = 75 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] libvirt.live_migration_downtime_steps = 10 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] libvirt.live_migration_inbound_addr = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] libvirt.live_migration_permit_auto_converge = False {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] libvirt.live_migration_permit_post_copy = False {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] libvirt.live_migration_scheme  = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] libvirt.live_migration_timeout_action = abort {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] libvirt.live_migration_tunnelled = False {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: WARNING oslo_config.cfg [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal (
Nov 14 09:39:42 user nova-compute[75229]: live_migration_uri is deprecated for removal in favor of two other options that
Nov 14 09:39:42 user nova-compute[75229]: allow to change live migration scheme and target URI: ``live_migration_scheme``
Nov 14 09:39:42 user nova-compute[75229]: and ``live_migration_inbound_addr`` respectively.
Nov 14 09:39:42 user nova-compute[75229]: ).  Its value may be silently ignored in the future.
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] libvirt.live_migration_uri     = qemu+ssh://stack@%s/system {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] libvirt.live_migration_with_native_tls = False {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] libvirt.max_queues             = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] libvirt.mem_stats_period_seconds = 10 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] libvirt.nfs_mount_options      = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] libvirt.nfs_mount_point_base   = /opt/stack/data/nova/mnt {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] libvirt.num_aoe_discover_tries = 3 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] libvirt.num_iser_scan_tries    = 5 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] libvirt.num_memory_encrypted_guests = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] libvirt.num_nvme_discover_tries = 5 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] libvirt.num_pcie_ports         = 0 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] libvirt.num_volume_scan_tries  = 5 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] libvirt.pmem_namespaces        = [] {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] libvirt.quobyte_client_cfg     = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] libvirt.rbd_connect_timeout    = 5 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] libvirt.rbd_destroy_volume_retries = 12 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] libvirt.rbd_secret_uuid        = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] libvirt.rbd_user               = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] libvirt.realtime_scheduler_priority = 1 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] libvirt.remote_filesystem_transport = ssh {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] libvirt.rescue_image_id        = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] libvirt.rescue_kernel_id       = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] libvirt.rescue_ramdisk_id      = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] libvirt.rng_dev_path           = /dev/urandom {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] libvirt.rx_queue_size          = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] libvirt.smbfs_mount_options    =  {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] libvirt.snapshot_compression   = False {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] libvirt.snapshot_image_format  = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] libvirt.snapshots_directory    = /opt/stack/data/nova/instances/snapshots {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] libvirt.sparse_logical_volumes = False {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] libvirt.swtpm_enabled          = False {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] libvirt.swtpm_group            = tss {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] libvirt.swtpm_user             = tss {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] libvirt.sysinfo_serial         = unique {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] libvirt.tb_cache_size          = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] libvirt.tx_queue_size          = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] libvirt.uid_maps               = [] {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] libvirt.use_virtio_for_bridges = True {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] libvirt.virt_type              = kvm {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] libvirt.volume_clear           = zero {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] libvirt.volume_clear_size      = 0 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] libvirt.volume_use_multipath   = False {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] libvirt.vzstorage_cache_path   = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] libvirt.vzstorage_log_path     = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] libvirt.vzstorage_mount_group  = qemu {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] libvirt.vzstorage_mount_opts   = [] {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] libvirt.vzstorage_mount_perms  = 0770 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] libvirt.vzstorage_mount_user   = stack {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] libvirt.wait_soft_reboot_seconds = 120 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] neutron.auth_section           = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] neutron.auth_type              = password {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] neutron.cafile                 = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] neutron.certfile               = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] neutron.collect_timing         = False {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] neutron.connect_retries        = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] neutron.connect_retry_delay    = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] neutron.default_floating_pool  = public {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] neutron.endpoint_override      = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] neutron.extension_sync_interval = 600 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] neutron.http_retries           = 3 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] neutron.insecure               = False {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] neutron.keyfile                = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] neutron.max_version            = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] neutron.metadata_proxy_shared_secret = **** {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] neutron.min_version            = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] neutron.ovs_bridge             = br-int {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] neutron.physnets               = [] {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] neutron.region_name            = RegionOne {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] neutron.service_metadata_proxy = True {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] neutron.service_name           = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] neutron.service_type           = network {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] neutron.split_loggers          = False {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] neutron.status_code_retries    = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] neutron.status_code_retry_delay = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] neutron.timeout                = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] neutron.valid_interfaces       = ['internal', 'public'] {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] neutron.version                = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] notifications.bdms_in_notifications = False {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] notifications.default_level    = INFO {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] notifications.notification_format = unversioned {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] notifications.notify_on_state_change = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] pci.alias                      = [] {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] pci.device_spec                = [] {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] pci.report_in_placement        = False {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] placement.auth_section         = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] placement.auth_type            = password {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] placement.auth_url             = http://10.0.0.210/identity {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] placement.cafile               = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] placement.certfile             = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] placement.collect_timing       = False {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] placement.connect_retries      = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] placement.connect_retry_delay  = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] placement.default_domain_id    = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] placement.default_domain_name  = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] placement.domain_id            = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] placement.domain_name          = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] placement.endpoint_override    = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] placement.insecure             = False {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] placement.keyfile              = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] placement.max_version          = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] placement.min_version          = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] placement.password             = **** {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] placement.project_domain_id    = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] placement.project_domain_name  = Default {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] placement.project_id           = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] placement.project_name         = service {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] placement.region_name          = RegionOne {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] placement.service_name         = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] placement.service_type         = placement {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] placement.split_loggers        = False {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] placement.status_code_retries  = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] placement.status_code_retry_delay = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] placement.system_scope         = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] placement.timeout              = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] placement.trust_id             = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] placement.user_domain_id       = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] placement.user_domain_name     = Default {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] placement.user_id              = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] placement.username             = placement {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] placement.valid_interfaces     = ['internal', 'public'] {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] placement.version              = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] quota.cores                    = 20 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] quota.count_usage_from_placement = False {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] quota.driver                   = nova.quota.DbQuotaDriver {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] quota.injected_file_content_bytes = 10240 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] quota.injected_file_path_length = 255 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] quota.injected_files           = 5 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] quota.instances                = 10 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] quota.key_pairs                = 100 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] quota.metadata_items           = 128 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] quota.ram                      = 51200 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] quota.recheck_quota            = True {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] quota.server_group_members     = 10 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] quota.server_groups            = 10 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] rdp.enabled                    = False {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] rdp.html5_proxy_base_url       = http://127.0.0.1:6083/ {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] scheduler.enable_isolated_aggregate_filtering = False {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] scheduler.image_metadata_prefilter = False {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] scheduler.max_attempts         = 3 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] scheduler.max_placement_results = 1000 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] scheduler.placement_aggregate_required_for_tenants = False {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] scheduler.query_placement_for_image_type_support = False {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] scheduler.workers              = 3 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] filter_scheduler.enabled_filters = ['ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] filter_scheduler.host_subset_size = 1 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] filter_scheduler.hypervisor_version_weight_multiplier = 1.0 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] filter_scheduler.image_properties_default_architecture = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] filter_scheduler.isolated_hosts = [] {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] filter_scheduler.isolated_images = [] {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] filter_scheduler.max_instances_per_host = 50 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] filter_scheduler.max_io_ops_per_host = 8 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] filter_scheduler.num_instances_weight_multiplier = 0.0 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] filter_scheduler.pci_in_placement = False {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] filter_scheduler.track_instance_changes = False {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] metrics.required               = True {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] metrics.weight_multiplier      = 1.0 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] metrics.weight_of_unavailable  = -10000.0 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] metrics.weight_setting         = [] {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] serial_console.base_url        = ws://127.0.0.1:6083/ {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] serial_console.enabled         = False {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] serial_console.port_range      = 10000:20000 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] serial_console.proxyclient_address = 127.0.0.1 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] serial_console.serialproxy_host = 0.0.0.0 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] serial_console.serialproxy_port = 6083 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] service_user.auth_section      = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] service_user.auth_type         = password {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] service_user.cafile            = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] service_user.certfile          = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] service_user.collect_timing    = False {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] service_user.insecure          = False {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] service_user.keyfile           = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] service_user.send_service_user_token = True {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] service_user.split_loggers     = False {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] service_user.timeout           = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] spice.agent_enabled            = True {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] spice.enabled                  = False {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] spice.html5proxy_base_url      = http://10.0.0.210:6081/spice_auto.html {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] spice.html5proxy_host          = 0.0.0.0 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] spice.html5proxy_port          = 6082 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] spice.image_compression        = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] spice.jpeg_compression         = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] spice.playback_compression     = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] spice.server_listen            = 127.0.0.1 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] spice.server_proxyclient_address = 127.0.0.1 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] spice.streaming_mode           = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] spice.zlib_compression         = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] upgrade_levels.baseapi         = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] upgrade_levels.cert            = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] upgrade_levels.compute         = auto {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] upgrade_levels.conductor       = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] upgrade_levels.scheduler       = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] vendordata_dynamic_auth.auth_section = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] vendordata_dynamic_auth.auth_type = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] vendordata_dynamic_auth.cafile = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] vendordata_dynamic_auth.certfile = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] vendordata_dynamic_auth.collect_timing = False {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] vendordata_dynamic_auth.insecure = False {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] vendordata_dynamic_auth.keyfile = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] vendordata_dynamic_auth.split_loggers = False {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] vendordata_dynamic_auth.timeout = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] vmware.api_retry_count         = 10 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] vmware.ca_file                 = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] vmware.cache_prefix            = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] vmware.cluster_name            = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] vmware.connection_pool_size    = 10 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] vmware.console_delay_seconds   = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] vmware.datastore_regex         = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] vmware.host_ip                 = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] vmware.host_password           = **** {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] vmware.host_port               = 443 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] vmware.host_username           = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] vmware.insecure                = False {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] vmware.integration_bridge      = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] vmware.maximum_objects         = 100 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] vmware.pbm_default_policy      = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] vmware.pbm_enabled             = False {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] vmware.pbm_wsdl_location       = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] vmware.serial_log_dir          = /opt/vmware/vspc {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] vmware.serial_port_proxy_uri   = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] vmware.serial_port_service_uri = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] vmware.task_poll_interval      = 0.5 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] vmware.use_linked_clone        = True {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] vmware.vnc_keymap              = en-us {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] vmware.vnc_port                = 5900 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] vmware.vnc_port_total          = 10000 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] vnc.auth_schemes               = ['none'] {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] vnc.enabled                    = True {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] vnc.novncproxy_base_url        = http://10.0.0.210:6080/vnc_lite.html {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] vnc.novncproxy_host            = 0.0.0.0 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] vnc.novncproxy_port            = 6080 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] vnc.server_listen              = 0.0.0.0 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] vnc.server_proxyclient_address = 10.0.0.210 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] vnc.vencrypt_ca_certs          = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] vnc.vencrypt_client_cert       = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] vnc.vencrypt_client_key        = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] workarounds.disable_compute_service_check_for_ffu = False {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] workarounds.disable_fallback_pcpu_query = False {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] workarounds.disable_group_policy_check_upcall = True {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] workarounds.disable_libvirt_livesnapshot = False {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] workarounds.disable_rootwrap   = False {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] workarounds.enable_numa_live_migration = False {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] workarounds.enable_qemu_monitor_announce_self = False {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] workarounds.handle_virt_lifecycle_events = True {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] workarounds.libvirt_disable_apic = False {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] workarounds.never_download_image_if_on_rbd = False {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] workarounds.skip_cpu_compare_at_startup = False {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] workarounds.skip_cpu_compare_on_dest = False {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] wsgi.api_paste_config          = /etc/nova/api-paste.ini {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] wsgi.client_socket_timeout     = 900 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] wsgi.default_pool_size         = 1000 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] wsgi.keep_alive                = True {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] wsgi.max_header_line           = 16384 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] wsgi.secure_proxy_ssl_header   = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] wsgi.ssl_ca_file               = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] wsgi.ssl_cert_file             = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] wsgi.ssl_key_file              = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] wsgi.tcp_keepidle              = 600 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] wsgi.wsgi_log_format           = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] zvm.ca_file                    = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] zvm.cloud_connector_url        = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] zvm.image_tmp_path             = /opt/stack/data/nova/images {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] zvm.reachable_timeout          = 300 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] oslo_policy.enforce_new_defaults = True {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] oslo_policy.enforce_scope      = True {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] oslo_policy.policy_default_rule = default {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] oslo_policy.policy_file        = policy.yaml {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] profiler.connection_string     = messaging:// {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] profiler.enabled               = False {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] profiler.es_doc_type           = notification {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] profiler.es_scroll_size        = 10000 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] profiler.es_scroll_time        = 2m {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] profiler.filter_error_trace    = False {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] profiler.hmac_keys             = **** {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] profiler.sentinel_service_name = mymaster {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] profiler.socket_timeout        = 0.1 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] profiler.trace_requests        = False {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] profiler.trace_sqlalchemy      = False {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] profiler_jaeger.process_tags   = {} {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] profiler_jaeger.service_name_prefix = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] profiler_otlp.service_name_prefix = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] remote_debug.host              = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] remote_debug.port              = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] oslo_messaging_rabbit.ssl      = False {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] oslo_messaging_notifications.retry = -1 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] oslo_messaging_notifications.transport_url = **** {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] oslo_limit.auth_section        = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] oslo_limit.auth_type           = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] oslo_limit.cafile              = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] oslo_limit.certfile            = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] oslo_limit.collect_timing      = False {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] oslo_limit.connect_retries     = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] oslo_limit.connect_retry_delay = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] oslo_limit.endpoint_id         = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] oslo_limit.endpoint_override   = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] oslo_limit.insecure            = False {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] oslo_limit.keyfile             = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] oslo_limit.max_version         = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] oslo_limit.min_version         = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] oslo_limit.region_name         = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] oslo_limit.service_name        = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] oslo_limit.service_type        = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] oslo_limit.split_loggers       = False {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] oslo_limit.status_code_retries = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] oslo_limit.status_code_retry_delay = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] oslo_limit.timeout             = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] oslo_limit.valid_interfaces    = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] oslo_limit.version             = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] oslo_reports.file_event_handler = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] oslo_reports.log_dir           = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] vif_plug_linux_bridge_privileged.capabilities = [12] {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] vif_plug_linux_bridge_privileged.group = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] vif_plug_linux_bridge_privileged.helper_command = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] vif_plug_linux_bridge_privileged.logger_name = oslo_privsep.daemon {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] vif_plug_linux_bridge_privileged.thread_pool_size = 12 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] vif_plug_linux_bridge_privileged.user = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] vif_plug_ovs_privileged.capabilities = [12, 1] {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] vif_plug_ovs_privileged.group  = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] vif_plug_ovs_privileged.helper_command = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] vif_plug_ovs_privileged.logger_name = oslo_privsep.daemon {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] vif_plug_ovs_privileged.thread_pool_size = 12 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] vif_plug_ovs_privileged.user   = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] os_vif_linux_bridge.flat_interface = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] os_vif_linux_bridge.forward_bridge_interface = ['all'] {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] os_vif_linux_bridge.iptables_bottom_regex =  {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] os_vif_linux_bridge.iptables_drop_action = DROP {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] os_vif_linux_bridge.iptables_top_regex =  {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] os_vif_linux_bridge.network_device_mtu = 1500 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] os_vif_linux_bridge.use_ipv6   = False {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] os_vif_linux_bridge.vlan_interface = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] os_vif_ovs.default_qos_type    = linux-noop {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] os_vif_ovs.isolate_vif         = False {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] os_vif_ovs.network_device_mtu  = 1500 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] os_vif_ovs.ovs_vsctl_timeout   = 120 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] os_vif_ovs.ovsdb_connection    = tcp:127.0.0.1:6640 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] os_vif_ovs.ovsdb_interface     = native {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] os_vif_ovs.per_port_bridge     = False {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] os_brick.lock_path             = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] privsep_osbrick.capabilities   = [21] {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] privsep_osbrick.group          = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] privsep_osbrick.helper_command = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] privsep_osbrick.thread_pool_size = 12 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] privsep_osbrick.user           = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] nova_sys_admin.capabilities    = [0, 1, 2, 3, 12, 21] {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] nova_sys_admin.group           = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] nova_sys_admin.helper_command  = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] nova_sys_admin.logger_name     = oslo_privsep.daemon {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] nova_sys_admin.thread_pool_size = 12 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] nova_sys_admin.user            = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG oslo_service.service [None req-b35db41c-356f-4416-9ec2-9789f498a641 None None] ******************************************************************************** {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}}
Nov 14 09:39:42 user nova-compute[75229]: INFO nova.service [-] Starting compute node (version 0.0.0)
Nov 14 09:39:42 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-dc17613f-ef03-4a04-abcf-4df8bf8dcec5 None None] Connecting to libvirt: qemu:///system {{(pid=75229) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:506}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-dc17613f-ef03-4a04-abcf-4df8bf8dcec5 None None] Registering for lifecycle events <nova.virt.libvirt.host.Host object at 0x7f741c476fe0> {{(pid=75229) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:512}}
Nov 14 09:39:42 user nova-compute[75229]: libvirt:  error : internal error: could not initialize domain event timer
Nov 14 09:39:42 user nova-compute[75229]: WARNING nova.virt.libvirt.host [None req-dc17613f-ef03-4a04-abcf-4df8bf8dcec5 None None] URI qemu:///system does not support events: internal error: could not initialize domain event timer: libvirt.libvirtError: internal error: could not initialize domain event timer
Nov 14 09:39:42 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-dc17613f-ef03-4a04-abcf-4df8bf8dcec5 None None] Registering for connection events: <nova.virt.libvirt.host.Host object at 0x7f741c476fe0> {{(pid=75229) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:533}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-dc17613f-ef03-4a04-abcf-4df8bf8dcec5 None None] Starting native event thread {{(pid=75229) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:492}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-dc17613f-ef03-4a04-abcf-4df8bf8dcec5 None None] Starting green dispatch thread {{(pid=75229) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:498}}
Nov 14 09:39:42 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-dc17613f-ef03-4a04-abcf-4df8bf8dcec5 None None] Starting connection event dispatch thread {{(pid=75229) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:501}}
Nov 14 09:39:42 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-dc17613f-ef03-4a04-abcf-4df8bf8dcec5 None None] Connection event '1' reason 'None'
Nov 14 09:39:42 user nova-compute[75229]: WARNING nova.virt.libvirt.driver [None req-dc17613f-ef03-4a04-abcf-4df8bf8dcec5 None None] Cannot update service status on host "user" since it is not registered.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Nov 14 09:39:42 user nova-compute[75229]: DEBUG nova.virt.libvirt.volume.mount [None req-dc17613f-ef03-4a04-abcf-4df8bf8dcec5 None None] Initialising _HostMountState generation 0 {{(pid=75229) host_up /opt/stack/nova/nova/virt/libvirt/volume/mount.py:130}}
Nov 14 09:39:49 user nova-compute[75229]: INFO nova.virt.libvirt.host [None req-dc17613f-ef03-4a04-abcf-4df8bf8dcec5 None None] Libvirt host capabilities <capabilities>
Nov 14 09:39:49 user nova-compute[75229]:   <host>
Nov 14 09:39:49 user nova-compute[75229]:     <uuid>e20c3142-5af9-7467-ecd8-70b2e4a210d6</uuid>
Nov 14 09:39:49 user nova-compute[75229]:     <cpu>
Nov 14 09:39:49 user nova-compute[75229]:       <arch>x86_64</arch>
Nov 14 09:39:49 user nova-compute[75229]:       <model>IvyBridge-IBRS</model>
Nov 14 09:39:49 user nova-compute[75229]:       <vendor>Intel</vendor>
Nov 14 09:39:49 user nova-compute[75229]:       <microcode version='1070'/>
Nov 14 09:39:49 user nova-compute[75229]:       <counter name='tsc' frequency='2094952000' scaling='no'/>
Nov 14 09:39:49 user nova-compute[75229]:       <topology sockets='6' dies='1' cores='1' threads='1'/>
Nov 14 09:39:49 user nova-compute[75229]:       <feature name='ss'/>
Nov 14 09:39:49 user nova-compute[75229]:       <feature name='vmx'/>
Nov 14 09:39:49 user nova-compute[75229]:       <feature name='pcid'/>
Nov 14 09:39:49 user nova-compute[75229]:       <feature name='osxsave'/>
Nov 14 09:39:49 user nova-compute[75229]:       <feature name='hypervisor'/>
Nov 14 09:39:49 user nova-compute[75229]:       <feature name='arat'/>
Nov 14 09:39:49 user nova-compute[75229]:       <feature name='tsc_adjust'/>
Nov 14 09:39:49 user nova-compute[75229]:       <feature name='md-clear'/>
Nov 14 09:39:49 user nova-compute[75229]:       <feature name='stibp'/>
Nov 14 09:39:49 user nova-compute[75229]:       <feature name='arch-capabilities'/>
Nov 14 09:39:49 user nova-compute[75229]:       <feature name='ssbd'/>
Nov 14 09:39:49 user nova-compute[75229]:       <feature name='invtsc'/>
Nov 14 09:39:49 user nova-compute[75229]:       <feature name='rsba'/>
Nov 14 09:39:49 user nova-compute[75229]:       <feature name='skip-l1dfl-vmentry'/>
Nov 14 09:39:49 user nova-compute[75229]:       <pages unit='KiB' size='4'/>
Nov 14 09:39:49 user nova-compute[75229]:       <pages unit='KiB' size='2048'/>
Nov 14 09:39:49 user nova-compute[75229]:     </cpu>
Nov 14 09:39:49 user nova-compute[75229]:     <power_management>
Nov 14 09:39:49 user nova-compute[75229]:       <suspend_mem/>
Nov 14 09:39:49 user nova-compute[75229]:       <suspend_disk/>
Nov 14 09:39:49 user nova-compute[75229]:       <suspend_hybrid/>
Nov 14 09:39:49 user nova-compute[75229]:     </power_management>
Nov 14 09:39:49 user nova-compute[75229]:     <iommu support='no'/>
Nov 14 09:39:49 user nova-compute[75229]:     <migration_features>
Nov 14 09:39:49 user nova-compute[75229]:       <live/>
Nov 14 09:39:49 user nova-compute[75229]:       <uri_transports>
Nov 14 09:39:49 user nova-compute[75229]:         <uri_transport>tcp</uri_transport>
Nov 14 09:39:49 user nova-compute[75229]:         <uri_transport>rdma</uri_transport>
Nov 14 09:39:49 user nova-compute[75229]:       </uri_transports>
Nov 14 09:39:49 user nova-compute[75229]:     </migration_features>
Nov 14 09:39:49 user nova-compute[75229]:     <topology>
Nov 14 09:39:49 user nova-compute[75229]:       <cells num='2'>
Nov 14 09:39:49 user nova-compute[75229]:         <cell id='0'>
Nov 14 09:39:49 user nova-compute[75229]:           <memory unit='KiB'>8140616</memory>
Nov 14 09:39:49 user nova-compute[75229]:           <pages unit='KiB' size='4'>2035154</pages>
Nov 14 09:39:49 user nova-compute[75229]:           <pages unit='KiB' size='2048'>0</pages>
Nov 14 09:39:49 user nova-compute[75229]:           <distances>
Nov 14 09:39:49 user nova-compute[75229]:             <sibling id='0' value='10'/>
Nov 14 09:39:49 user nova-compute[75229]:             <sibling id='1' value='20'/>
Nov 14 09:39:49 user nova-compute[75229]:           </distances>
Nov 14 09:39:49 user nova-compute[75229]:           <cpus num='6'>
Nov 14 09:39:49 user nova-compute[75229]:             <cpu id='0' socket_id='0' die_id='0' core_id='0' siblings='0'/>
Nov 14 09:39:49 user nova-compute[75229]:             <cpu id='1' socket_id='2' die_id='0' core_id='0' siblings='1'/>
Nov 14 09:39:49 user nova-compute[75229]:             <cpu id='2' socket_id='4' die_id='0' core_id='0' siblings='2'/>
Nov 14 09:39:49 user nova-compute[75229]:             <cpu id='3' socket_id='6' die_id='0' core_id='0' siblings='3'/>
Nov 14 09:39:49 user nova-compute[75229]:             <cpu id='4' socket_id='8' die_id='0' core_id='0' siblings='4'/>
Nov 14 09:39:49 user nova-compute[75229]:             <cpu id='5' socket_id='10' die_id='0' core_id='0' siblings='5'/>
Nov 14 09:39:49 user nova-compute[75229]:           </cpus>
Nov 14 09:39:49 user nova-compute[75229]:         </cell>
Nov 14 09:39:49 user nova-compute[75229]:         <cell id='1'>
Nov 14 09:39:49 user nova-compute[75229]:           <memory unit='KiB'>8255068</memory>
Nov 14 09:39:49 user nova-compute[75229]:           <pages unit='KiB' size='4'>2063767</pages>
Nov 14 09:39:49 user nova-compute[75229]:           <pages unit='KiB' size='2048'>0</pages>
Nov 14 09:39:49 user nova-compute[75229]:           <distances>
Nov 14 09:39:49 user nova-compute[75229]:             <sibling id='0' value='20'/>
Nov 14 09:39:49 user nova-compute[75229]:             <sibling id='1' value='10'/>
Nov 14 09:39:49 user nova-compute[75229]:           </distances>
Nov 14 09:39:49 user nova-compute[75229]:           <cpus num='6'>
Nov 14 09:39:49 user nova-compute[75229]:             <cpu id='6' socket_id='12' die_id='0' core_id='0' siblings='6'/>
Nov 14 09:39:49 user nova-compute[75229]:             <cpu id='7' socket_id='14' die_id='0' core_id='0' siblings='7'/>
Nov 14 09:39:49 user nova-compute[75229]:             <cpu id='8' socket_id='16' die_id='0' core_id='0' siblings='8'/>
Nov 14 09:39:49 user nova-compute[75229]:             <cpu id='9' socket_id='18' die_id='0' core_id='0' siblings='9'/>
Nov 14 09:39:49 user nova-compute[75229]:             <cpu id='10' socket_id='20' die_id='0' core_id='0' siblings='10'/>
Nov 14 09:39:49 user nova-compute[75229]:             <cpu id='11' socket_id='22' die_id='0' core_id='0' siblings='11'/>
Nov 14 09:39:49 user nova-compute[75229]:           </cpus>
Nov 14 09:39:49 user nova-compute[75229]:         </cell>
Nov 14 09:39:49 user nova-compute[75229]:       </cells>
Nov 14 09:39:49 user nova-compute[75229]:     </topology>
Nov 14 09:39:49 user nova-compute[75229]:     <cache>
Nov 14 09:39:49 user nova-compute[75229]:       <bank id='0' level='3' type='both' size='15' unit='MiB' cpus='0'/>
Nov 14 09:39:49 user nova-compute[75229]:       <bank id='2' level='3' type='both' size='15' unit='MiB' cpus='1'/>
Nov 14 09:39:49 user nova-compute[75229]:       <bank id='4' level='3' type='both' size='15' unit='MiB' cpus='2'/>
Nov 14 09:39:49 user nova-compute[75229]:       <bank id='6' level='3' type='both' size='15' unit='MiB' cpus='3'/>
Nov 14 09:39:49 user nova-compute[75229]:       <bank id='8' level='3' type='both' size='15' unit='MiB' cpus='4'/>
Nov 14 09:39:49 user nova-compute[75229]:       <bank id='10' level='3' type='both' size='15' unit='MiB' cpus='5'/>
Nov 14 09:39:49 user nova-compute[75229]:       <bank id='12' level='3' type='both' size='15' unit='MiB' cpus='6'/>
Nov 14 09:39:49 user nova-compute[75229]:       <bank id='14' level='3' type='both' size='15' unit='MiB' cpus='7'/>
Nov 14 09:39:49 user nova-compute[75229]:       <bank id='16' level='3' type='both' size='15' unit='MiB' cpus='8'/>
Nov 14 09:39:49 user nova-compute[75229]:       <bank id='18' level='3' type='both' size='15' unit='MiB' cpus='9'/>
Nov 14 09:39:49 user nova-compute[75229]:       <bank id='20' level='3' type='both' size='15' unit='MiB' cpus='10'/>
Nov 14 09:39:49 user nova-compute[75229]:       <bank id='22' level='3' type='both' size='15' unit='MiB' cpus='11'/>
Nov 14 09:39:49 user nova-compute[75229]:     </cache>
Nov 14 09:39:49 user nova-compute[75229]:     <secmodel>
Nov 14 09:39:49 user nova-compute[75229]:       <model>apparmor</model>
Nov 14 09:39:49 user nova-compute[75229]:       <doi>0</doi>
Nov 14 09:39:49 user nova-compute[75229]:     </secmodel>
Nov 14 09:39:49 user nova-compute[75229]:     <secmodel>
Nov 14 09:39:49 user nova-compute[75229]:       <model>dac</model>
Nov 14 09:39:49 user nova-compute[75229]:       <doi>0</doi>
Nov 14 09:39:49 user nova-compute[75229]:       <baselabel type='kvm'>+64055:+108</baselabel>
Nov 14 09:39:49 user nova-compute[75229]:       <baselabel type='qemu'>+64055:+108</baselabel>
Nov 14 09:39:49 user nova-compute[75229]:     </secmodel>
Nov 14 09:39:49 user nova-compute[75229]:   </host>
Nov 14 09:39:49 user nova-compute[75229]:   <guest>
Nov 14 09:39:49 user nova-compute[75229]:     <os_type>hvm</os_type>
Nov 14 09:39:49 user nova-compute[75229]:     <arch name='alpha'>
Nov 14 09:39:49 user nova-compute[75229]:       <wordsize>64</wordsize>
Nov 14 09:39:49 user nova-compute[75229]:       <emulator>/usr/bin/qemu-system-alpha</emulator>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='4'>clipper</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <domain type='qemu'/>
Nov 14 09:39:49 user nova-compute[75229]:     </arch>
Nov 14 09:39:49 user nova-compute[75229]:     <features>
Nov 14 09:39:49 user nova-compute[75229]:       <cpuselection/>
Nov 14 09:39:49 user nova-compute[75229]:       <deviceboot/>
Nov 14 09:39:49 user nova-compute[75229]:       <disksnapshot default='on' toggle='no'/>
Nov 14 09:39:49 user nova-compute[75229]:     </features>
Nov 14 09:39:49 user nova-compute[75229]:   </guest>
Nov 14 09:39:49 user nova-compute[75229]:   <guest>
Nov 14 09:39:49 user nova-compute[75229]:     <os_type>hvm</os_type>
Nov 14 09:39:49 user nova-compute[75229]:     <arch name='armv6l'>
Nov 14 09:39:49 user nova-compute[75229]:       <wordsize>32</wordsize>
Nov 14 09:39:49 user nova-compute[75229]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='1'>integratorcp</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='1'>borzoi</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='1'>spitz</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='2'>nuri</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='2'>musca-b1</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='1'>versatileab</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='1'>kzm</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='2'>musca-a</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='2'>smdkc210</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='1'>sx1</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='1'>z2</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='1'>tosa</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='4'>sabrelite</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='1'>realview-eb</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='1'>n810</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='1'>n800</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='1'>versatilepb</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='1'>terrier</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='1'>mainstone</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='4'>midway</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='1'>musicpal</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='1'>microbit</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='1'>cubieboard</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='1'>verdex</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='1'>netduino2</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='4'>raspi2b</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='1'>cheetah</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='4'>highbank</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='1'>akita</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='1'>connex</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='1'>collie</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='1'>raspi0</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <domain type='qemu'/>
Nov 14 09:39:49 user nova-compute[75229]:     </arch>
Nov 14 09:39:49 user nova-compute[75229]:     <features>
Nov 14 09:39:49 user nova-compute[75229]:       <cpuselection/>
Nov 14 09:39:49 user nova-compute[75229]:       <deviceboot/>
Nov 14 09:39:49 user nova-compute[75229]:       <disksnapshot default='on' toggle='no'/>
Nov 14 09:39:49 user nova-compute[75229]:     </features>
Nov 14 09:39:49 user nova-compute[75229]:   </guest>
Nov 14 09:39:49 user nova-compute[75229]:   <guest>
Nov 14 09:39:49 user nova-compute[75229]:     <os_type>hvm</os_type>
Nov 14 09:39:49 user nova-compute[75229]:     <arch name='armv7l'>
Nov 14 09:39:49 user nova-compute[75229]:       <wordsize>32</wordsize>
Nov 14 09:39:49 user nova-compute[75229]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='1'>integratorcp</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='1'>borzoi</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='1'>spitz</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='2'>nuri</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='2'>musca-b1</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='1'>versatileab</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='1'>kzm</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='2'>musca-a</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='2'>smdkc210</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='1'>sx1</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='1'>z2</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='1'>tosa</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='4'>sabrelite</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='1'>realview-eb</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='1'>n810</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='1'>n800</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='1'>versatilepb</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='1'>terrier</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='1'>mainstone</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='4'>midway</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='1'>musicpal</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='1'>microbit</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='1'>cubieboard</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='1'>verdex</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='1'>netduino2</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='4'>raspi2b</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='1'>cheetah</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='4'>highbank</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='1'>akita</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='1'>connex</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='1'>collie</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='1'>raspi0</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <domain type='qemu'/>
Nov 14 09:39:49 user nova-compute[75229]:     </arch>
Nov 14 09:39:49 user nova-compute[75229]:     <features>
Nov 14 09:39:49 user nova-compute[75229]:       <cpuselection/>
Nov 14 09:39:49 user nova-compute[75229]:       <deviceboot/>
Nov 14 09:39:49 user nova-compute[75229]:       <disksnapshot default='on' toggle='no'/>
Nov 14 09:39:49 user nova-compute[75229]:     </features>
Nov 14 09:39:49 user nova-compute[75229]:   </guest>
Nov 14 09:39:49 user nova-compute[75229]:   <guest>
Nov 14 09:39:49 user nova-compute[75229]:     <os_type>hvm</os_type>
Nov 14 09:39:49 user nova-compute[75229]:     <arch name='aarch64'>
Nov 14 09:39:49 user nova-compute[75229]:       <wordsize>64</wordsize>
Nov 14 09:39:49 user nova-compute[75229]:       <emulator>/usr/bin/qemu-system-aarch64</emulator>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='1'>integratorcp</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='1'>borzoi</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='1'>spitz</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='2'>nuri</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='2'>musca-b1</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='1'>versatileab</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='1'>kzm</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='2'>musca-a</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='2'>smdkc210</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='1'>sx1</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='1'>z2</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='6'>xlnx-zcu102</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='1'>tosa</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='4'>sabrelite</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='1'>realview-eb</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='512'>sbsa-ref</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='1'>n810</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='1'>n800</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='1'>versatilepb</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='1'>terrier</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='1'>mainstone</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='4'>midway</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='1'>musicpal</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='1'>microbit</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='4'>raspi3ap</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='1'>cubieboard</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='1'>verdex</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='1'>netduino2</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='2'>xlnx-versal-virt</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='4'>raspi3b</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='4'>raspi2b</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='1'>cheetah</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='4'>highbank</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='1'>akita</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='1'>connex</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='1'>collie</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='1'>raspi0</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <domain type='qemu'/>
Nov 14 09:39:49 user nova-compute[75229]:     </arch>
Nov 14 09:39:49 user nova-compute[75229]:     <features>
Nov 14 09:39:49 user nova-compute[75229]:       <acpi default='on' toggle='yes'/>
Nov 14 09:39:49 user nova-compute[75229]:       <cpuselection/>
Nov 14 09:39:49 user nova-compute[75229]:       <deviceboot/>
Nov 14 09:39:49 user nova-compute[75229]:       <disksnapshot default='on' toggle='no'/>
Nov 14 09:39:49 user nova-compute[75229]:     </features>
Nov 14 09:39:49 user nova-compute[75229]:   </guest>
Nov 14 09:39:49 user nova-compute[75229]:   <guest>
Nov 14 09:39:49 user nova-compute[75229]:     <os_type>hvm</os_type>
Nov 14 09:39:49 user nova-compute[75229]:     <arch name='cris'>
Nov 14 09:39:49 user nova-compute[75229]:       <wordsize>32</wordsize>
Nov 14 09:39:49 user nova-compute[75229]:       <emulator>/usr/bin/qemu-system-cris</emulator>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='1'>axis-dev88</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <domain type='qemu'/>
Nov 14 09:39:49 user nova-compute[75229]:     </arch>
Nov 14 09:39:49 user nova-compute[75229]:     <features>
Nov 14 09:39:49 user nova-compute[75229]:       <cpuselection/>
Nov 14 09:39:49 user nova-compute[75229]:       <deviceboot/>
Nov 14 09:39:49 user nova-compute[75229]:       <disksnapshot default='on' toggle='no'/>
Nov 14 09:39:49 user nova-compute[75229]:     </features>
Nov 14 09:39:49 user nova-compute[75229]:   </guest>
Nov 14 09:39:49 user nova-compute[75229]:   <guest>
Nov 14 09:39:49 user nova-compute[75229]:     <os_type>hvm</os_type>
Nov 14 09:39:49 user nova-compute[75229]:     <arch name='i686'>
Nov 14 09:39:49 user nova-compute[75229]:       <wordsize>32</wordsize>
Nov 14 09:39:49 user nova-compute[75229]:       <emulator>/usr/bin/qemu-system-i386</emulator>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='288'>pc-q35-artful</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='1'>x-remote</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='1'>isapc</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='288'>pc-q35-disco</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='288'>pc-q35-impish</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='288'>pc-q35-focal</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='288'>microvm</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <domain type='qemu'/>
Nov 14 09:39:49 user nova-compute[75229]:       <domain type='kvm'/>
Nov 14 09:39:49 user nova-compute[75229]:     </arch>
Nov 14 09:39:49 user nova-compute[75229]:     <features>
Nov 14 09:39:49 user nova-compute[75229]:       <pae/>
Nov 14 09:39:49 user nova-compute[75229]:       <nonpae/>
Nov 14 09:39:49 user nova-compute[75229]:       <acpi default='on' toggle='yes'/>
Nov 14 09:39:49 user nova-compute[75229]:       <apic default='on' toggle='no'/>
Nov 14 09:39:49 user nova-compute[75229]:       <cpuselection/>
Nov 14 09:39:49 user nova-compute[75229]:       <deviceboot/>
Nov 14 09:39:49 user nova-compute[75229]:       <disksnapshot default='on' toggle='no'/>
Nov 14 09:39:49 user nova-compute[75229]:     </features>
Nov 14 09:39:49 user nova-compute[75229]:   </guest>
Nov 14 09:39:49 user nova-compute[75229]:   <guest>
Nov 14 09:39:49 user nova-compute[75229]:     <os_type>hvm</os_type>
Nov 14 09:39:49 user nova-compute[75229]:     <arch name='m68k'>
Nov 14 09:39:49 user nova-compute[75229]:       <wordsize>32</wordsize>
Nov 14 09:39:49 user nova-compute[75229]:       <emulator>/usr/bin/qemu-system-m68k</emulator>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='1'>mcf5208evb</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='1'>an5206</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='1'>virt-6.0</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='1'>q800</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='1'>virt-6.2</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine canonical='virt-6.2' maxCpus='1'>virt</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='1'>next-cube</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='1'>virt-6.1</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <domain type='qemu'/>
Nov 14 09:39:49 user nova-compute[75229]:     </arch>
Nov 14 09:39:49 user nova-compute[75229]:     <features>
Nov 14 09:39:49 user nova-compute[75229]:       <cpuselection/>
Nov 14 09:39:49 user nova-compute[75229]:       <deviceboot/>
Nov 14 09:39:49 user nova-compute[75229]:       <disksnapshot default='on' toggle='no'/>
Nov 14 09:39:49 user nova-compute[75229]:     </features>
Nov 14 09:39:49 user nova-compute[75229]:   </guest>
Nov 14 09:39:49 user nova-compute[75229]:   <guest>
Nov 14 09:39:49 user nova-compute[75229]:     <os_type>hvm</os_type>
Nov 14 09:39:49 user nova-compute[75229]:     <arch name='microblaze'>
Nov 14 09:39:49 user nova-compute[75229]:       <wordsize>32</wordsize>
Nov 14 09:39:49 user nova-compute[75229]:       <emulator>/usr/bin/qemu-system-microblaze</emulator>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='1'>petalogix-ml605</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <domain type='qemu'/>
Nov 14 09:39:49 user nova-compute[75229]:     </arch>
Nov 14 09:39:49 user nova-compute[75229]:     <features>
Nov 14 09:39:49 user nova-compute[75229]:       <cpuselection/>
Nov 14 09:39:49 user nova-compute[75229]:       <deviceboot/>
Nov 14 09:39:49 user nova-compute[75229]:       <disksnapshot default='on' toggle='no'/>
Nov 14 09:39:49 user nova-compute[75229]:     </features>
Nov 14 09:39:49 user nova-compute[75229]:   </guest>
Nov 14 09:39:49 user nova-compute[75229]:   <guest>
Nov 14 09:39:49 user nova-compute[75229]:     <os_type>hvm</os_type>
Nov 14 09:39:49 user nova-compute[75229]:     <arch name='microblazeel'>
Nov 14 09:39:49 user nova-compute[75229]:       <wordsize>32</wordsize>
Nov 14 09:39:49 user nova-compute[75229]:       <emulator>/usr/bin/qemu-system-microblazeel</emulator>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='1'>petalogix-ml605</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <domain type='qemu'/>
Nov 14 09:39:49 user nova-compute[75229]:     </arch>
Nov 14 09:39:49 user nova-compute[75229]:     <features>
Nov 14 09:39:49 user nova-compute[75229]:       <cpuselection/>
Nov 14 09:39:49 user nova-compute[75229]:       <deviceboot/>
Nov 14 09:39:49 user nova-compute[75229]:       <disksnapshot default='on' toggle='no'/>
Nov 14 09:39:49 user nova-compute[75229]:     </features>
Nov 14 09:39:49 user nova-compute[75229]:   </guest>
Nov 14 09:39:49 user nova-compute[75229]:   <guest>
Nov 14 09:39:49 user nova-compute[75229]:     <os_type>hvm</os_type>
Nov 14 09:39:49 user nova-compute[75229]:     <arch name='mips'>
Nov 14 09:39:49 user nova-compute[75229]:       <wordsize>32</wordsize>
Nov 14 09:39:49 user nova-compute[75229]:       <emulator>/usr/bin/qemu-system-mips</emulator>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='16'>malta</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='1'>mipssim</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <domain type='qemu'/>
Nov 14 09:39:49 user nova-compute[75229]:     </arch>
Nov 14 09:39:49 user nova-compute[75229]:     <features>
Nov 14 09:39:49 user nova-compute[75229]:       <cpuselection/>
Nov 14 09:39:49 user nova-compute[75229]:       <deviceboot/>
Nov 14 09:39:49 user nova-compute[75229]:       <disksnapshot default='on' toggle='no'/>
Nov 14 09:39:49 user nova-compute[75229]:     </features>
Nov 14 09:39:49 user nova-compute[75229]:   </guest>
Nov 14 09:39:49 user nova-compute[75229]:   <guest>
Nov 14 09:39:49 user nova-compute[75229]:     <os_type>hvm</os_type>
Nov 14 09:39:49 user nova-compute[75229]:     <arch name='mipsel'>
Nov 14 09:39:49 user nova-compute[75229]:       <wordsize>32</wordsize>
Nov 14 09:39:49 user nova-compute[75229]:       <emulator>/usr/bin/qemu-system-mipsel</emulator>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='16'>malta</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='1'>mipssim</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <domain type='qemu'/>
Nov 14 09:39:49 user nova-compute[75229]:     </arch>
Nov 14 09:39:49 user nova-compute[75229]:     <features>
Nov 14 09:39:49 user nova-compute[75229]:       <cpuselection/>
Nov 14 09:39:49 user nova-compute[75229]:       <deviceboot/>
Nov 14 09:39:49 user nova-compute[75229]:       <disksnapshot default='on' toggle='no'/>
Nov 14 09:39:49 user nova-compute[75229]:     </features>
Nov 14 09:39:49 user nova-compute[75229]:   </guest>
Nov 14 09:39:49 user nova-compute[75229]:   <guest>
Nov 14 09:39:49 user nova-compute[75229]:     <os_type>hvm</os_type>
Nov 14 09:39:49 user nova-compute[75229]:     <arch name='mips64'>
Nov 14 09:39:49 user nova-compute[75229]:       <wordsize>64</wordsize>
Nov 14 09:39:49 user nova-compute[75229]:       <emulator>/usr/bin/qemu-system-mips64</emulator>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='16'>malta</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='1'>mipssim</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='1'>pica61</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='1'>magnum</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <domain type='qemu'/>
Nov 14 09:39:49 user nova-compute[75229]:     </arch>
Nov 14 09:39:49 user nova-compute[75229]:     <features>
Nov 14 09:39:49 user nova-compute[75229]:       <cpuselection/>
Nov 14 09:39:49 user nova-compute[75229]:       <deviceboot/>
Nov 14 09:39:49 user nova-compute[75229]:       <disksnapshot default='on' toggle='no'/>
Nov 14 09:39:49 user nova-compute[75229]:     </features>
Nov 14 09:39:49 user nova-compute[75229]:   </guest>
Nov 14 09:39:49 user nova-compute[75229]:   <guest>
Nov 14 09:39:49 user nova-compute[75229]:     <os_type>hvm</os_type>
Nov 14 09:39:49 user nova-compute[75229]:     <arch name='mips64el'>
Nov 14 09:39:49 user nova-compute[75229]:       <wordsize>64</wordsize>
Nov 14 09:39:49 user nova-compute[75229]:       <emulator>/usr/bin/qemu-system-mips64el</emulator>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='16'>malta</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='16'>loongson3-virt</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='1'>mipssim</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='1'>pica61</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='1'>magnum</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='16'>boston</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='1'>fuloong2e</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <domain type='qemu'/>
Nov 14 09:39:49 user nova-compute[75229]:     </arch>
Nov 14 09:39:49 user nova-compute[75229]:     <features>
Nov 14 09:39:49 user nova-compute[75229]:       <cpuselection/>
Nov 14 09:39:49 user nova-compute[75229]:       <deviceboot/>
Nov 14 09:39:49 user nova-compute[75229]:       <disksnapshot default='on' toggle='no'/>
Nov 14 09:39:49 user nova-compute[75229]:     </features>
Nov 14 09:39:49 user nova-compute[75229]:   </guest>
Nov 14 09:39:49 user nova-compute[75229]:   <guest>
Nov 14 09:39:49 user nova-compute[75229]:     <os_type>hvm</os_type>
Nov 14 09:39:49 user nova-compute[75229]:     <arch name='ppc'>
Nov 14 09:39:49 user nova-compute[75229]:       <wordsize>32</wordsize>
Nov 14 09:39:49 user nova-compute[75229]:       <emulator>/usr/bin/qemu-system-ppc</emulator>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='1'>g3beige</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='1'>mac99</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='32'>ppce500</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='1'>pegasos2</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='1'>sam460ex</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='1'>bamboo</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='1'>40p</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='1'>ref405ep</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='1'>taihu</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <domain type='qemu'/>
Nov 14 09:39:49 user nova-compute[75229]:     </arch>
Nov 14 09:39:49 user nova-compute[75229]:     <features>
Nov 14 09:39:49 user nova-compute[75229]:       <cpuselection/>
Nov 14 09:39:49 user nova-compute[75229]:       <deviceboot/>
Nov 14 09:39:49 user nova-compute[75229]:       <disksnapshot default='on' toggle='no'/>
Nov 14 09:39:49 user nova-compute[75229]:     </features>
Nov 14 09:39:49 user nova-compute[75229]:   </guest>
Nov 14 09:39:49 user nova-compute[75229]:   <guest>
Nov 14 09:39:49 user nova-compute[75229]:     <os_type>hvm</os_type>
Nov 14 09:39:49 user nova-compute[75229]:     <arch name='ppc64'>
Nov 14 09:39:49 user nova-compute[75229]:       <wordsize>64</wordsize>
Nov 14 09:39:49 user nova-compute[75229]:       <emulator>/usr/bin/qemu-system-ppc64</emulator>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='2048'>powernv9</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='1'>taihu</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='2048'>powernv10</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='32'>ppce500</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='1'>40p</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='1'>pegasos2</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='1'>bamboo</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='1'>g3beige</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='1'>mac99</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='1'>sam460ex</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='1'>ref405ep</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='2048'>powernv8</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <domain type='qemu'/>
Nov 14 09:39:49 user nova-compute[75229]:     </arch>
Nov 14 09:39:49 user nova-compute[75229]:     <features>
Nov 14 09:39:49 user nova-compute[75229]:       <cpuselection/>
Nov 14 09:39:49 user nova-compute[75229]:       <deviceboot/>
Nov 14 09:39:49 user nova-compute[75229]:       <disksnapshot default='on' toggle='no'/>
Nov 14 09:39:49 user nova-compute[75229]:     </features>
Nov 14 09:39:49 user nova-compute[75229]:   </guest>
Nov 14 09:39:49 user nova-compute[75229]:   <guest>
Nov 14 09:39:49 user nova-compute[75229]:     <os_type>hvm</os_type>
Nov 14 09:39:49 user nova-compute[75229]:     <arch name='ppc64le'>
Nov 14 09:39:49 user nova-compute[75229]:       <wordsize>64</wordsize>
Nov 14 09:39:49 user nova-compute[75229]:       <emulator>/usr/bin/qemu-system-ppc64le</emulator>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='2048'>powernv9</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='1'>taihu</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='2048'>powernv10</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='32'>ppce500</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='1'>40p</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='1'>pegasos2</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='1'>bamboo</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='1'>g3beige</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='1'>mac99</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='1'>sam460ex</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='1'>ref405ep</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='2048'>powernv8</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <domain type='qemu'/>
Nov 14 09:39:49 user nova-compute[75229]:     </arch>
Nov 14 09:39:49 user nova-compute[75229]:     <features>
Nov 14 09:39:49 user nova-compute[75229]:       <cpuselection/>
Nov 14 09:39:49 user nova-compute[75229]:       <deviceboot/>
Nov 14 09:39:49 user nova-compute[75229]:       <disksnapshot default='on' toggle='no'/>
Nov 14 09:39:49 user nova-compute[75229]:     </features>
Nov 14 09:39:49 user nova-compute[75229]:   </guest>
Nov 14 09:39:49 user nova-compute[75229]:   <guest>
Nov 14 09:39:49 user nova-compute[75229]:     <os_type>hvm</os_type>
Nov 14 09:39:49 user nova-compute[75229]:     <arch name='riscv32'>
Nov 14 09:39:49 user nova-compute[75229]:       <wordsize>32</wordsize>
Nov 14 09:39:49 user nova-compute[75229]:       <emulator>/usr/bin/qemu-system-riscv32</emulator>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='8'>spike</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='1'>opentitan</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='5'>sifive_u</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='1'>sifive_e</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='8'>virt</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <domain type='qemu'/>
Nov 14 09:39:49 user nova-compute[75229]:     </arch>
Nov 14 09:39:49 user nova-compute[75229]:     <features>
Nov 14 09:39:49 user nova-compute[75229]:       <cpuselection/>
Nov 14 09:39:49 user nova-compute[75229]:       <deviceboot/>
Nov 14 09:39:49 user nova-compute[75229]:       <disksnapshot default='on' toggle='no'/>
Nov 14 09:39:49 user nova-compute[75229]:     </features>
Nov 14 09:39:49 user nova-compute[75229]:   </guest>
Nov 14 09:39:49 user nova-compute[75229]:   <guest>
Nov 14 09:39:49 user nova-compute[75229]:     <os_type>hvm</os_type>
Nov 14 09:39:49 user nova-compute[75229]:     <arch name='riscv64'>
Nov 14 09:39:49 user nova-compute[75229]:       <wordsize>64</wordsize>
Nov 14 09:39:49 user nova-compute[75229]:       <emulator>/usr/bin/qemu-system-riscv64</emulator>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='8'>spike</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='5'>microchip-icicle-kit</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='5'>sifive_u</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='1'>shakti_c</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='1'>sifive_e</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='8'>virt</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <domain type='qemu'/>
Nov 14 09:39:49 user nova-compute[75229]:     </arch>
Nov 14 09:39:49 user nova-compute[75229]:     <features>
Nov 14 09:39:49 user nova-compute[75229]:       <cpuselection/>
Nov 14 09:39:49 user nova-compute[75229]:       <deviceboot/>
Nov 14 09:39:49 user nova-compute[75229]:       <disksnapshot default='on' toggle='no'/>
Nov 14 09:39:49 user nova-compute[75229]:     </features>
Nov 14 09:39:49 user nova-compute[75229]:   </guest>
Nov 14 09:39:49 user nova-compute[75229]:   <guest>
Nov 14 09:39:49 user nova-compute[75229]:     <os_type>hvm</os_type>
Nov 14 09:39:49 user nova-compute[75229]:     <arch name='s390x'>
Nov 14 09:39:49 user nova-compute[75229]:       <wordsize>64</wordsize>
Nov 14 09:39:49 user nova-compute[75229]:       <emulator>/usr/bin/qemu-system-s390x</emulator>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='248'>s390-ccw-virtio-jammy</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine canonical='s390-ccw-virtio-jammy' maxCpus='248'>s390-ccw-virtio</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='248'>s390-ccw-virtio-4.0</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='248'>s390-ccw-virtio-5.2</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='248'>s390-ccw-virtio-artful</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='248'>s390-ccw-virtio-3.1</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='248'>s390-ccw-virtio-groovy</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='248'>s390-ccw-virtio-hirsute</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='248'>s390-ccw-virtio-disco</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='248'>s390-ccw-virtio-2.12</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='248'>s390-ccw-virtio-2.6</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='248'>s390-ccw-virtio-yakkety</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='248'>s390-ccw-virtio-eoan</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='248'>s390-ccw-virtio-2.9</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='248'>s390-ccw-virtio-6.0</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='248'>s390-ccw-virtio-5.1</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='248'>s390-ccw-virtio-3.0</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='248'>s390-ccw-virtio-4.2</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='248'>s390-ccw-virtio-2.5</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='248'>s390-ccw-virtio-2.11</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='248'>s390-ccw-virtio-xenial</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='248'>s390-ccw-virtio-focal</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='248'>s390-ccw-virtio-2.8</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='248'>s390-ccw-virtio-impish</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='248'>s390-ccw-virtio-bionic</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='248'>s390-ccw-virtio-5.0</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='248'>s390-ccw-virtio-6.2</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='248'>s390-ccw-virtio-zesty</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='248'>s390-ccw-virtio-4.1</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='248'>s390-ccw-virtio-cosmic</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='248'>s390-ccw-virtio-2.4</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='248'>s390-ccw-virtio-2.10</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='248'>s390-ccw-virtio-2.7</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='248'>s390-ccw-virtio-6.1</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <domain type='qemu'/>
Nov 14 09:39:49 user nova-compute[75229]:     </arch>
Nov 14 09:39:49 user nova-compute[75229]:     <features>
Nov 14 09:39:49 user nova-compute[75229]:       <cpuselection/>
Nov 14 09:39:49 user nova-compute[75229]:       <deviceboot/>
Nov 14 09:39:49 user nova-compute[75229]:       <disksnapshot default='on' toggle='no'/>
Nov 14 09:39:49 user nova-compute[75229]:     </features>
Nov 14 09:39:49 user nova-compute[75229]:   </guest>
Nov 14 09:39:49 user nova-compute[75229]:   <guest>
Nov 14 09:39:49 user nova-compute[75229]:     <os_type>hvm</os_type>
Nov 14 09:39:49 user nova-compute[75229]:     <arch name='sh4'>
Nov 14 09:39:49 user nova-compute[75229]:       <wordsize>32</wordsize>
Nov 14 09:39:49 user nova-compute[75229]:       <emulator>/usr/bin/qemu-system-sh4</emulator>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='1'>shix</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='1'>r2d</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <domain type='qemu'/>
Nov 14 09:39:49 user nova-compute[75229]:     </arch>
Nov 14 09:39:49 user nova-compute[75229]:     <features>
Nov 14 09:39:49 user nova-compute[75229]:       <cpuselection/>
Nov 14 09:39:49 user nova-compute[75229]:       <deviceboot/>
Nov 14 09:39:49 user nova-compute[75229]:       <disksnapshot default='on' toggle='no'/>
Nov 14 09:39:49 user nova-compute[75229]:     </features>
Nov 14 09:39:49 user nova-compute[75229]:   </guest>
Nov 14 09:39:49 user nova-compute[75229]:   <guest>
Nov 14 09:39:49 user nova-compute[75229]:     <os_type>hvm</os_type>
Nov 14 09:39:49 user nova-compute[75229]:     <arch name='sh4eb'>
Nov 14 09:39:49 user nova-compute[75229]:       <wordsize>64</wordsize>
Nov 14 09:39:49 user nova-compute[75229]:       <emulator>/usr/bin/qemu-system-sh4eb</emulator>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='1'>shix</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='1'>r2d</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <domain type='qemu'/>
Nov 14 09:39:49 user nova-compute[75229]:     </arch>
Nov 14 09:39:49 user nova-compute[75229]:     <features>
Nov 14 09:39:49 user nova-compute[75229]:       <cpuselection/>
Nov 14 09:39:49 user nova-compute[75229]:       <deviceboot/>
Nov 14 09:39:49 user nova-compute[75229]:       <disksnapshot default='on' toggle='no'/>
Nov 14 09:39:49 user nova-compute[75229]:     </features>
Nov 14 09:39:49 user nova-compute[75229]:   </guest>
Nov 14 09:39:49 user nova-compute[75229]:   <guest>
Nov 14 09:39:49 user nova-compute[75229]:     <os_type>hvm</os_type>
Nov 14 09:39:49 user nova-compute[75229]:     <arch name='sparc'>
Nov 14 09:39:49 user nova-compute[75229]:       <wordsize>32</wordsize>
Nov 14 09:39:49 user nova-compute[75229]:       <emulator>/usr/bin/qemu-system-sparc</emulator>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='1'>SS-5</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='4'>SS-20</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='1'>LX</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='1'>SPARCClassic</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='1'>leon3_generic</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='1'>SPARCbook</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='1'>SS-4</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='4'>SS-600MP</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='4'>SS-10</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='1'>Voyager</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <domain type='qemu'/>
Nov 14 09:39:49 user nova-compute[75229]:     </arch>
Nov 14 09:39:49 user nova-compute[75229]:     <features>
Nov 14 09:39:49 user nova-compute[75229]:       <cpuselection/>
Nov 14 09:39:49 user nova-compute[75229]:       <deviceboot/>
Nov 14 09:39:49 user nova-compute[75229]:       <disksnapshot default='on' toggle='no'/>
Nov 14 09:39:49 user nova-compute[75229]:     </features>
Nov 14 09:39:49 user nova-compute[75229]:   </guest>
Nov 14 09:39:49 user nova-compute[75229]:   <guest>
Nov 14 09:39:49 user nova-compute[75229]:     <os_type>hvm</os_type>
Nov 14 09:39:49 user nova-compute[75229]:     <arch name='sparc64'>
Nov 14 09:39:49 user nova-compute[75229]:       <wordsize>64</wordsize>
Nov 14 09:39:49 user nova-compute[75229]:       <emulator>/usr/bin/qemu-system-sparc64</emulator>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='1'>sun4u</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='1'>niagara</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='1'>sun4v</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <domain type='qemu'/>
Nov 14 09:39:49 user nova-compute[75229]:     </arch>
Nov 14 09:39:49 user nova-compute[75229]:     <features>
Nov 14 09:39:49 user nova-compute[75229]:       <cpuselection/>
Nov 14 09:39:49 user nova-compute[75229]:       <deviceboot/>
Nov 14 09:39:49 user nova-compute[75229]:       <disksnapshot default='on' toggle='no'/>
Nov 14 09:39:49 user nova-compute[75229]:     </features>
Nov 14 09:39:49 user nova-compute[75229]:   </guest>
Nov 14 09:39:49 user nova-compute[75229]:   <guest>
Nov 14 09:39:49 user nova-compute[75229]:     <os_type>hvm</os_type>
Nov 14 09:39:49 user nova-compute[75229]:     <arch name='x86_64'>
Nov 14 09:39:49 user nova-compute[75229]:       <wordsize>64</wordsize>
Nov 14 09:39:49 user nova-compute[75229]:       <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='288'>pc-q35-artful</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='1'>x-remote</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='1'>isapc</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='288'>pc-q35-disco</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='288'>pc-q35-impish</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='288'>pc-q35-focal</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='288'>microvm</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <domain type='qemu'/>
Nov 14 09:39:49 user nova-compute[75229]:       <domain type='kvm'/>
Nov 14 09:39:49 user nova-compute[75229]:     </arch>
Nov 14 09:39:49 user nova-compute[75229]:     <features>
Nov 14 09:39:49 user nova-compute[75229]:       <acpi default='on' toggle='yes'/>
Nov 14 09:39:49 user nova-compute[75229]:       <apic default='on' toggle='no'/>
Nov 14 09:39:49 user nova-compute[75229]:       <cpuselection/>
Nov 14 09:39:49 user nova-compute[75229]:       <deviceboot/>
Nov 14 09:39:49 user nova-compute[75229]:       <disksnapshot default='on' toggle='no'/>
Nov 14 09:39:49 user nova-compute[75229]:     </features>
Nov 14 09:39:49 user nova-compute[75229]:   </guest>
Nov 14 09:39:49 user nova-compute[75229]:   <guest>
Nov 14 09:39:49 user nova-compute[75229]:     <os_type>hvm</os_type>
Nov 14 09:39:49 user nova-compute[75229]:     <arch name='xtensa'>
Nov 14 09:39:49 user nova-compute[75229]:       <wordsize>32</wordsize>
Nov 14 09:39:49 user nova-compute[75229]:       <emulator>/usr/bin/qemu-system-xtensa</emulator>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='4'>sim</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='32'>kc705</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='32'>ml605</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='32'>ml605-nommu</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='32'>virt</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='32'>lx60-nommu</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='32'>lx200</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='32'>lx200-nommu</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='32'>lx60</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='32'>kc705-nommu</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <domain type='qemu'/>
Nov 14 09:39:49 user nova-compute[75229]:     </arch>
Nov 14 09:39:49 user nova-compute[75229]:     <features>
Nov 14 09:39:49 user nova-compute[75229]:       <cpuselection/>
Nov 14 09:39:49 user nova-compute[75229]:       <deviceboot/>
Nov 14 09:39:49 user nova-compute[75229]:       <disksnapshot default='on' toggle='no'/>
Nov 14 09:39:49 user nova-compute[75229]:     </features>
Nov 14 09:39:49 user nova-compute[75229]:   </guest>
Nov 14 09:39:49 user nova-compute[75229]:   <guest>
Nov 14 09:39:49 user nova-compute[75229]:     <os_type>hvm</os_type>
Nov 14 09:39:49 user nova-compute[75229]:     <arch name='xtensaeb'>
Nov 14 09:39:49 user nova-compute[75229]:       <wordsize>32</wordsize>
Nov 14 09:39:49 user nova-compute[75229]:       <emulator>/usr/bin/qemu-system-xtensaeb</emulator>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='4'>sim</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='32'>kc705</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='32'>ml605</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='32'>ml605-nommu</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='32'>virt</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='32'>lx60-nommu</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='32'>lx200</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='32'>lx200-nommu</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='32'>lx60</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <machine maxCpus='32'>kc705-nommu</machine>
Nov 14 09:39:49 user nova-compute[75229]:       <domain type='qemu'/>
Nov 14 09:39:49 user nova-compute[75229]:     </arch>
Nov 14 09:39:49 user nova-compute[75229]:     <features>
Nov 14 09:39:49 user nova-compute[75229]:       <cpuselection/>
Nov 14 09:39:49 user nova-compute[75229]:       <deviceboot/>
Nov 14 09:39:49 user nova-compute[75229]:       <disksnapshot default='on' toggle='no'/>
Nov 14 09:39:49 user nova-compute[75229]:     </features>
Nov 14 09:39:49 user nova-compute[75229]:   </guest>
Nov 14 09:39:49 user nova-compute[75229]: </capabilities>
Nov 14 09:39:49 user nova-compute[75229]: 
Nov 14 09:39:49 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-dc17613f-ef03-4a04-abcf-4df8bf8dcec5 None None] Getting domain capabilities for alpha via machine types: {None} {{(pid=75229) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 09:39:49 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-dc17613f-ef03-4a04-abcf-4df8bf8dcec5 None None] Error from libvirt when retrieving domain capabilities for arch alpha / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-alpha' on this host {{(pid=75229) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 09:39:49 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-dc17613f-ef03-4a04-abcf-4df8bf8dcec5 None None] Getting domain capabilities for armv6l via machine types: {None, 'virt'} {{(pid=75229) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 09:39:49 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-dc17613f-ef03-4a04-abcf-4df8bf8dcec5 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=75229) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 09:39:49 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-dc17613f-ef03-4a04-abcf-4df8bf8dcec5 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=75229) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 09:39:49 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-dc17613f-ef03-4a04-abcf-4df8bf8dcec5 None None] Getting domain capabilities for armv7l via machine types: {'virt'} {{(pid=75229) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 09:39:49 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-dc17613f-ef03-4a04-abcf-4df8bf8dcec5 None None] Error from libvirt when retrieving domain capabilities for arch armv7l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=75229) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 09:39:49 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-dc17613f-ef03-4a04-abcf-4df8bf8dcec5 None None] Getting domain capabilities for aarch64 via machine types: {'virt'} {{(pid=75229) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 09:39:49 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-dc17613f-ef03-4a04-abcf-4df8bf8dcec5 None None] Error from libvirt when retrieving domain capabilities for arch aarch64 / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-aarch64' on this host {{(pid=75229) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 09:39:49 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-dc17613f-ef03-4a04-abcf-4df8bf8dcec5 None None] Getting domain capabilities for cris via machine types: {None} {{(pid=75229) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 09:39:49 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-dc17613f-ef03-4a04-abcf-4df8bf8dcec5 None None] Error from libvirt when retrieving domain capabilities for arch cris / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-cris' on this host {{(pid=75229) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 09:39:49 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-dc17613f-ef03-4a04-abcf-4df8bf8dcec5 None None] Getting domain capabilities for i686 via machine types: {'ubuntu-q35', 'pc', 'ubuntu', 'q35'} {{(pid=75229) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 09:39:49 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-dc17613f-ef03-4a04-abcf-4df8bf8dcec5 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu-q35:
Nov 14 09:39:49 user nova-compute[75229]: <domainCapabilities>
Nov 14 09:39:49 user nova-compute[75229]:   <path>/usr/bin/qemu-system-i386</path>
Nov 14 09:39:49 user nova-compute[75229]:   <domain>kvm</domain>
Nov 14 09:39:49 user nova-compute[75229]:   <machine>pc-q35-jammy</machine>
Nov 14 09:39:49 user nova-compute[75229]:   <arch>i686</arch>
Nov 14 09:39:49 user nova-compute[75229]:   <vcpu max='288'/>
Nov 14 09:39:49 user nova-compute[75229]:   <iothreads supported='yes'/>
Nov 14 09:39:49 user nova-compute[75229]:   <os supported='yes'>
Nov 14 09:39:49 user nova-compute[75229]:     <enum name='firmware'/>
Nov 14 09:39:49 user nova-compute[75229]:     <loader supported='yes'>
Nov 14 09:39:49 user nova-compute[75229]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 14 09:39:49 user nova-compute[75229]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 14 09:39:49 user nova-compute[75229]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 14 09:39:49 user nova-compute[75229]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 14 09:39:49 user nova-compute[75229]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 14 09:39:49 user nova-compute[75229]:       <enum name='type'>
Nov 14 09:39:49 user nova-compute[75229]:         <value>rom</value>
Nov 14 09:39:49 user nova-compute[75229]:         <value>pflash</value>
Nov 14 09:39:49 user nova-compute[75229]:       </enum>
Nov 14 09:39:49 user nova-compute[75229]:       <enum name='readonly'>
Nov 14 09:39:49 user nova-compute[75229]:         <value>yes</value>
Nov 14 09:39:49 user nova-compute[75229]:         <value>no</value>
Nov 14 09:39:49 user nova-compute[75229]:       </enum>
Nov 14 09:39:49 user nova-compute[75229]:       <enum name='secure'>
Nov 14 09:39:49 user nova-compute[75229]:         <value>no</value>
Nov 14 09:39:49 user nova-compute[75229]:       </enum>
Nov 14 09:39:49 user nova-compute[75229]:     </loader>
Nov 14 09:39:49 user nova-compute[75229]:   </os>
Nov 14 09:39:49 user nova-compute[75229]:   <cpu>
Nov 14 09:39:49 user nova-compute[75229]:     <mode name='host-passthrough' supported='yes'>
Nov 14 09:39:49 user nova-compute[75229]:       <enum name='hostPassthroughMigratable'>
Nov 14 09:39:49 user nova-compute[75229]:         <value>off</value>
Nov 14 09:39:49 user nova-compute[75229]:       </enum>
Nov 14 09:39:49 user nova-compute[75229]:     </mode>
Nov 14 09:39:49 user nova-compute[75229]:     <mode name='maximum' supported='yes'>
Nov 14 09:39:49 user nova-compute[75229]:       <enum name='maximumMigratable'>
Nov 14 09:39:49 user nova-compute[75229]:         <value>on</value>
Nov 14 09:39:49 user nova-compute[75229]:         <value>off</value>
Nov 14 09:39:49 user nova-compute[75229]:       </enum>
Nov 14 09:39:49 user nova-compute[75229]:     </mode>
Nov 14 09:39:49 user nova-compute[75229]:     <mode name='host-model' supported='yes'>
Nov 14 09:39:49 user nova-compute[75229]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 14 09:39:49 user nova-compute[75229]:       <vendor>Intel</vendor>
Nov 14 09:39:49 user nova-compute[75229]:       <feature policy='require' name='ss'/>
Nov 14 09:39:49 user nova-compute[75229]:       <feature policy='require' name='vmx'/>
Nov 14 09:39:49 user nova-compute[75229]:       <feature policy='require' name='pcid'/>
Nov 14 09:39:49 user nova-compute[75229]:       <feature policy='require' name='hypervisor'/>
Nov 14 09:39:49 user nova-compute[75229]:       <feature policy='require' name='arat'/>
Nov 14 09:39:49 user nova-compute[75229]:       <feature policy='require' name='tsc_adjust'/>
Nov 14 09:39:49 user nova-compute[75229]:       <feature policy='require' name='umip'/>
Nov 14 09:39:49 user nova-compute[75229]:       <feature policy='require' name='md-clear'/>
Nov 14 09:39:49 user nova-compute[75229]:       <feature policy='require' name='stibp'/>
Nov 14 09:39:49 user nova-compute[75229]:       <feature policy='require' name='arch-capabilities'/>
Nov 14 09:39:49 user nova-compute[75229]:       <feature policy='require' name='ssbd'/>
Nov 14 09:39:49 user nova-compute[75229]:       <feature policy='require' name='ibpb'/>
Nov 14 09:39:49 user nova-compute[75229]:       <feature policy='require' name='ibrs'/>
Nov 14 09:39:49 user nova-compute[75229]:       <feature policy='require' name='amd-stibp'/>
Nov 14 09:39:49 user nova-compute[75229]:       <feature policy='require' name='amd-ssbd'/>
Nov 14 09:39:49 user nova-compute[75229]:       <feature policy='disable' name='erms'/>
Nov 14 09:39:49 user nova-compute[75229]:       <feature policy='disable' name='xsaveopt'/>
Nov 14 09:39:49 user nova-compute[75229]:       <feature policy='disable' name='lm'/>
Nov 14 09:39:49 user nova-compute[75229]:     </mode>
Nov 14 09:39:49 user nova-compute[75229]:     <mode name='custom' supported='yes'>
Nov 14 09:39:49 user nova-compute[75229]:       <model usable='no'>qemu64</model>
Nov 14 09:39:49 user nova-compute[75229]:       <model usable='yes'>qemu32</model>
Nov 14 09:39:49 user nova-compute[75229]:       <model usable='no'>phenom</model>
Nov 14 09:39:49 user nova-compute[75229]:       <model usable='yes'>pentium3</model>
Nov 14 09:39:49 user nova-compute[75229]:       <model usable='yes'>pentium2</model>
Nov 14 09:39:49 user nova-compute[75229]:       <model usable='yes'>pentium</model>
Nov 14 09:39:49 user nova-compute[75229]:       <model usable='no'>n270</model>
Nov 14 09:39:49 user nova-compute[75229]:       <model usable='no'>kvm64</model>
Nov 14 09:39:49 user nova-compute[75229]:       <model usable='yes'>kvm32</model>
Nov 14 09:39:49 user nova-compute[75229]:       <model usable='yes'>coreduo</model>
Nov 14 09:39:49 user nova-compute[75229]:       <model usable='no'>core2duo</model>
Nov 14 09:39:49 user nova-compute[75229]:       <model usable='no'>athlon</model>
Nov 14 09:39:49 user nova-compute[75229]:       <model usable='no'>Westmere-IBRS</model>
Nov 14 09:39:49 user nova-compute[75229]:       <model usable='no'>Westmere</model>
Nov 14 09:39:49 user nova-compute[75229]:       <model usable='no'>Snowridge</model>
Nov 14 09:39:49 user nova-compute[75229]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 14 09:39:49 user nova-compute[75229]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 14 09:39:49 user nova-compute[75229]:       <model usable='no'>Skylake-Server</model>
Nov 14 09:39:49 user nova-compute[75229]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 14 09:39:49 user nova-compute[75229]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 14 09:39:49 user nova-compute[75229]:       <model usable='no'>Skylake-Client</model>
Nov 14 09:39:49 user nova-compute[75229]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 14 09:39:49 user nova-compute[75229]:       <model usable='no'>SandyBridge</model>
Nov 14 09:39:49 user nova-compute[75229]:       <model usable='no'>Penryn</model>
Nov 14 09:39:49 user nova-compute[75229]:       <model usable='no'>Opteron_G5</model>
Nov 14 09:39:49 user nova-compute[75229]:       <model usable='no'>Opteron_G4</model>
Nov 14 09:39:49 user nova-compute[75229]:       <model usable='no'>Opteron_G3</model>
Nov 14 09:39:49 user nova-compute[75229]:       <model usable='no'>Opteron_G2</model>
Nov 14 09:39:49 user nova-compute[75229]:       <model usable='no'>Opteron_G1</model>
Nov 14 09:39:49 user nova-compute[75229]:       <model usable='no'>Nehalem-IBRS</model>
Nov 14 09:39:49 user nova-compute[75229]:       <model usable='no'>Nehalem</model>
Nov 14 09:39:49 user nova-compute[75229]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 14 09:39:49 user nova-compute[75229]:       <model usable='no'>IvyBridge</model>
Nov 14 09:39:49 user nova-compute[75229]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 14 09:39:49 user nova-compute[75229]:       <model usable='no'>Icelake-Server</model>
Nov 14 09:39:49 user nova-compute[75229]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 14 09:39:49 user nova-compute[75229]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 14 09:39:49 user nova-compute[75229]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 14 09:39:49 user nova-compute[75229]:       <model usable='no'>Haswell-noTSX</model>
Nov 14 09:39:49 user nova-compute[75229]:       <model usable='no'>Haswell-IBRS</model>
Nov 14 09:39:49 user nova-compute[75229]:       <model usable='no'>Haswell</model>
Nov 14 09:39:49 user nova-compute[75229]:       <model usable='no'>EPYC-Rome</model>
Nov 14 09:39:49 user nova-compute[75229]:       <model usable='no'>EPYC-Milan</model>
Nov 14 09:39:49 user nova-compute[75229]:       <model usable='no'>EPYC-IBPB</model>
Nov 14 09:39:49 user nova-compute[75229]:       <model usable='no'>EPYC</model>
Nov 14 09:39:49 user nova-compute[75229]:       <model usable='no'>Dhyana</model>
Nov 14 09:39:49 user nova-compute[75229]:       <model usable='no'>Cooperlake</model>
Nov 14 09:39:49 user nova-compute[75229]:       <model usable='no'>Conroe</model>
Nov 14 09:39:49 user nova-compute[75229]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 14 09:39:49 user nova-compute[75229]:       <model usable='no'>Cascadelake-Server</model>
Nov 14 09:39:49 user nova-compute[75229]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 14 09:39:49 user nova-compute[75229]:       <model usable='no'>Broadwell-noTSX</model>
Nov 14 09:39:49 user nova-compute[75229]:       <model usable='no'>Broadwell-IBRS</model>
Nov 14 09:39:49 user nova-compute[75229]:       <model usable='no'>Broadwell</model>
Nov 14 09:39:49 user nova-compute[75229]:       <model usable='yes'>486</model>
Nov 14 09:39:49 user nova-compute[75229]:     </mode>
Nov 14 09:39:49 user nova-compute[75229]:   </cpu>
Nov 14 09:39:49 user nova-compute[75229]:   <memoryBacking supported='yes'>
Nov 14 09:39:49 user nova-compute[75229]:     <enum name='sourceType'>
Nov 14 09:39:49 user nova-compute[75229]:       <value>file</value>
Nov 14 09:39:49 user nova-compute[75229]:       <value>anonymous</value>
Nov 14 09:39:49 user nova-compute[75229]:       <value>memfd</value>
Nov 14 09:39:49 user nova-compute[75229]:     </enum>
Nov 14 09:39:49 user nova-compute[75229]:   </memoryBacking>
Nov 14 09:39:49 user nova-compute[75229]:   <devices>
Nov 14 09:39:49 user nova-compute[75229]:     <disk supported='yes'>
Nov 14 09:39:49 user nova-compute[75229]:       <enum name='diskDevice'>
Nov 14 09:39:49 user nova-compute[75229]:         <value>disk</value>
Nov 14 09:39:49 user nova-compute[75229]:         <value>cdrom</value>
Nov 14 09:39:49 user nova-compute[75229]:         <value>floppy</value>
Nov 14 09:39:49 user nova-compute[75229]:         <value>lun</value>
Nov 14 09:39:49 user nova-compute[75229]:       </enum>
Nov 14 09:39:49 user nova-compute[75229]:       <enum name='bus'>
Nov 14 09:39:49 user nova-compute[75229]:         <value>fdc</value>
Nov 14 09:39:49 user nova-compute[75229]:         <value>scsi</value>
Nov 14 09:39:49 user nova-compute[75229]:         <value>virtio</value>
Nov 14 09:39:49 user nova-compute[75229]:         <value>usb</value>
Nov 14 09:39:49 user nova-compute[75229]:         <value>sata</value>
Nov 14 09:39:49 user nova-compute[75229]:       </enum>
Nov 14 09:39:49 user nova-compute[75229]:       <enum name='model'>
Nov 14 09:39:49 user nova-compute[75229]:         <value>virtio</value>
Nov 14 09:39:49 user nova-compute[75229]:         <value>virtio-transitional</value>
Nov 14 09:39:49 user nova-compute[75229]:         <value>virtio-non-transitional</value>
Nov 14 09:39:49 user nova-compute[75229]:       </enum>
Nov 14 09:39:49 user nova-compute[75229]:     </disk>
Nov 14 09:39:49 user nova-compute[75229]:     <graphics supported='yes'>
Nov 14 09:39:49 user nova-compute[75229]:       <enum name='type'>
Nov 14 09:39:49 user nova-compute[75229]:         <value>sdl</value>
Nov 14 09:39:49 user nova-compute[75229]:         <value>vnc</value>
Nov 14 09:39:49 user nova-compute[75229]:         <value>spice</value>
Nov 14 09:39:49 user nova-compute[75229]:         <value>egl-headless</value>
Nov 14 09:39:49 user nova-compute[75229]:       </enum>
Nov 14 09:39:49 user nova-compute[75229]:     </graphics>
Nov 14 09:39:49 user nova-compute[75229]:     <video supported='yes'>
Nov 14 09:39:49 user nova-compute[75229]:       <enum name='modelType'>
Nov 14 09:39:49 user nova-compute[75229]:         <value>vga</value>
Nov 14 09:39:49 user nova-compute[75229]:         <value>cirrus</value>
Nov 14 09:39:49 user nova-compute[75229]:         <value>vmvga</value>
Nov 14 09:39:49 user nova-compute[75229]:         <value>qxl</value>
Nov 14 09:39:49 user nova-compute[75229]:         <value>virtio</value>
Nov 14 09:39:49 user nova-compute[75229]:         <value>none</value>
Nov 14 09:39:49 user nova-compute[75229]:         <value>bochs</value>
Nov 14 09:39:49 user nova-compute[75229]:         <value>ramfb</value>
Nov 14 09:39:49 user nova-compute[75229]:       </enum>
Nov 14 09:39:49 user nova-compute[75229]:     </video>
Nov 14 09:39:49 user nova-compute[75229]:     <hostdev supported='yes'>
Nov 14 09:39:49 user nova-compute[75229]:       <enum name='mode'>
Nov 14 09:39:49 user nova-compute[75229]:         <value>subsystem</value>
Nov 14 09:39:49 user nova-compute[75229]:       </enum>
Nov 14 09:39:49 user nova-compute[75229]:       <enum name='startupPolicy'>
Nov 14 09:39:49 user nova-compute[75229]:         <value>default</value>
Nov 14 09:39:49 user nova-compute[75229]:         <value>mandatory</value>
Nov 14 09:39:49 user nova-compute[75229]:         <value>requisite</value>
Nov 14 09:39:49 user nova-compute[75229]:         <value>optional</value>
Nov 14 09:39:49 user nova-compute[75229]:       </enum>
Nov 14 09:39:49 user nova-compute[75229]:       <enum name='subsysType'>
Nov 14 09:39:49 user nova-compute[75229]:         <value>usb</value>
Nov 14 09:39:49 user nova-compute[75229]:         <value>pci</value>
Nov 14 09:39:49 user nova-compute[75229]:         <value>scsi</value>
Nov 14 09:39:49 user nova-compute[75229]:       </enum>
Nov 14 09:39:49 user nova-compute[75229]:       <enum name='capsType'/>
Nov 14 09:39:49 user nova-compute[75229]:       <enum name='pciBackend'/>
Nov 14 09:39:49 user nova-compute[75229]:     </hostdev>
Nov 14 09:39:49 user nova-compute[75229]:     <rng supported='yes'>
Nov 14 09:39:49 user nova-compute[75229]:       <enum name='model'>
Nov 14 09:39:49 user nova-compute[75229]:         <value>virtio</value>
Nov 14 09:39:49 user nova-compute[75229]:         <value>virtio-transitional</value>
Nov 14 09:39:49 user nova-compute[75229]:         <value>virtio-non-transitional</value>
Nov 14 09:39:49 user nova-compute[75229]:       </enum>
Nov 14 09:39:49 user nova-compute[75229]:       <enum name='backendModel'>
Nov 14 09:39:49 user nova-compute[75229]:         <value>random</value>
Nov 14 09:39:49 user nova-compute[75229]:         <value>egd</value>
Nov 14 09:39:49 user nova-compute[75229]:         <value>builtin</value>
Nov 14 09:39:49 user nova-compute[75229]:       </enum>
Nov 14 09:39:49 user nova-compute[75229]:     </rng>
Nov 14 09:39:49 user nova-compute[75229]:     <filesystem supported='yes'>
Nov 14 09:39:49 user nova-compute[75229]:       <enum name='driverType'>
Nov 14 09:39:49 user nova-compute[75229]:         <value>path</value>
Nov 14 09:39:49 user nova-compute[75229]:         <value>handle</value>
Nov 14 09:39:49 user nova-compute[75229]:         <value>virtiofs</value>
Nov 14 09:39:49 user nova-compute[75229]:       </enum>
Nov 14 09:39:49 user nova-compute[75229]:     </filesystem>
Nov 14 09:39:49 user nova-compute[75229]:     <tpm supported='yes'>
Nov 14 09:39:49 user nova-compute[75229]:       <enum name='model'>
Nov 14 09:39:49 user nova-compute[75229]:         <value>tpm-tis</value>
Nov 14 09:39:49 user nova-compute[75229]:         <value>tpm-crb</value>
Nov 14 09:39:49 user nova-compute[75229]:       </enum>
Nov 14 09:39:49 user nova-compute[75229]:       <enum name='backendModel'>
Nov 14 09:39:49 user nova-compute[75229]:         <value>passthrough</value>
Nov 14 09:39:49 user nova-compute[75229]:         <value>emulator</value>
Nov 14 09:39:49 user nova-compute[75229]:       </enum>
Nov 14 09:39:49 user nova-compute[75229]:     </tpm>
Nov 14 09:39:49 user nova-compute[75229]:   </devices>
Nov 14 09:39:49 user nova-compute[75229]:   <features>
Nov 14 09:39:49 user nova-compute[75229]:     <gic supported='no'/>
Nov 14 09:39:49 user nova-compute[75229]:     <vmcoreinfo supported='yes'/>
Nov 14 09:39:49 user nova-compute[75229]:     <genid supported='yes'/>
Nov 14 09:39:49 user nova-compute[75229]:     <backingStoreInput supported='yes'/>
Nov 14 09:39:49 user nova-compute[75229]:     <backup supported='yes'/>
Nov 14 09:39:49 user nova-compute[75229]:     <sev supported='no'/>
Nov 14 09:39:49 user nova-compute[75229]:   </features>
Nov 14 09:39:49 user nova-compute[75229]: </domainCapabilities>
Nov 14 09:39:49 user nova-compute[75229]:  {{(pid=75229) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 14 09:39:49 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-dc17613f-ef03-4a04-abcf-4df8bf8dcec5 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=pc:
Nov 14 09:39:49 user nova-compute[75229]: <domainCapabilities>
Nov 14 09:39:49 user nova-compute[75229]:   <path>/usr/bin/qemu-system-i386</path>
Nov 14 09:39:49 user nova-compute[75229]:   <domain>kvm</domain>
Nov 14 09:39:49 user nova-compute[75229]:   <machine>pc-i440fx-6.2</machine>
Nov 14 09:39:49 user nova-compute[75229]:   <arch>i686</arch>
Nov 14 09:39:49 user nova-compute[75229]:   <vcpu max='255'/>
Nov 14 09:39:49 user nova-compute[75229]:   <iothreads supported='yes'/>
Nov 14 09:39:49 user nova-compute[75229]:   <os supported='yes'>
Nov 14 09:39:49 user nova-compute[75229]:     <enum name='firmware'/>
Nov 14 09:39:49 user nova-compute[75229]:     <loader supported='yes'>
Nov 14 09:39:49 user nova-compute[75229]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 14 09:39:49 user nova-compute[75229]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 14 09:39:49 user nova-compute[75229]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 14 09:39:49 user nova-compute[75229]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 14 09:39:49 user nova-compute[75229]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 14 09:39:49 user nova-compute[75229]:       <enum name='type'>
Nov 14 09:39:49 user nova-compute[75229]:         <value>rom</value>
Nov 14 09:39:49 user nova-compute[75229]:         <value>pflash</value>
Nov 14 09:39:49 user nova-compute[75229]:       </enum>
Nov 14 09:39:49 user nova-compute[75229]:       <enum name='readonly'>
Nov 14 09:39:49 user nova-compute[75229]:         <value>yes</value>
Nov 14 09:39:49 user nova-compute[75229]:         <value>no</value>
Nov 14 09:39:49 user nova-compute[75229]:       </enum>
Nov 14 09:39:49 user nova-compute[75229]:       <enum name='secure'>
Nov 14 09:39:49 user nova-compute[75229]:         <value>no</value>
Nov 14 09:39:49 user nova-compute[75229]:       </enum>
Nov 14 09:39:49 user nova-compute[75229]:     </loader>
Nov 14 09:39:49 user nova-compute[75229]:   </os>
Nov 14 09:39:49 user nova-compute[75229]:   <cpu>
Nov 14 09:39:49 user nova-compute[75229]:     <mode name='host-passthrough' supported='yes'>
Nov 14 09:39:49 user nova-compute[75229]:       <enum name='hostPassthroughMigratable'>
Nov 14 09:39:49 user nova-compute[75229]:         <value>off</value>
Nov 14 09:39:49 user nova-compute[75229]:       </enum>
Nov 14 09:39:49 user nova-compute[75229]:     </mode>
Nov 14 09:39:49 user nova-compute[75229]:     <mode name='maximum' supported='yes'>
Nov 14 09:39:49 user nova-compute[75229]:       <enum name='maximumMigratable'>
Nov 14 09:39:49 user nova-compute[75229]:         <value>on</value>
Nov 14 09:39:49 user nova-compute[75229]:         <value>off</value>
Nov 14 09:39:49 user nova-compute[75229]:       </enum>
Nov 14 09:39:49 user nova-compute[75229]:     </mode>
Nov 14 09:39:49 user nova-compute[75229]:     <mode name='host-model' supported='yes'>
Nov 14 09:39:49 user nova-compute[75229]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 14 09:39:49 user nova-compute[75229]:       <vendor>Intel</vendor>
Nov 14 09:39:49 user nova-compute[75229]:       <feature policy='require' name='ss'/>
Nov 14 09:39:49 user nova-compute[75229]:       <feature policy='require' name='vmx'/>
Nov 14 09:39:49 user nova-compute[75229]:       <feature policy='require' name='pcid'/>
Nov 14 09:39:49 user nova-compute[75229]:       <feature policy='require' name='hypervisor'/>
Nov 14 09:39:49 user nova-compute[75229]:       <feature policy='require' name='arat'/>
Nov 14 09:39:49 user nova-compute[75229]:       <feature policy='require' name='tsc_adjust'/>
Nov 14 09:39:49 user nova-compute[75229]:       <feature policy='require' name='umip'/>
Nov 14 09:39:49 user nova-compute[75229]:       <feature policy='require' name='md-clear'/>
Nov 14 09:39:49 user nova-compute[75229]:       <feature policy='require' name='stibp'/>
Nov 14 09:39:49 user nova-compute[75229]:       <feature policy='require' name='arch-capabilities'/>
Nov 14 09:39:49 user nova-compute[75229]:       <feature policy='require' name='ssbd'/>
Nov 14 09:39:49 user nova-compute[75229]:       <feature policy='require' name='ibpb'/>
Nov 14 09:39:49 user nova-compute[75229]:       <feature policy='require' name='ibrs'/>
Nov 14 09:39:49 user nova-compute[75229]:       <feature policy='require' name='amd-stibp'/>
Nov 14 09:39:49 user nova-compute[75229]:       <feature policy='require' name='amd-ssbd'/>
Nov 14 09:39:49 user nova-compute[75229]:       <feature policy='disable' name='erms'/>
Nov 14 09:39:49 user nova-compute[75229]:       <feature policy='disable' name='xsaveopt'/>
Nov 14 09:39:49 user nova-compute[75229]:       <feature policy='disable' name='lm'/>
Nov 14 09:39:49 user nova-compute[75229]:     </mode>
Nov 14 09:39:49 user nova-compute[75229]:     <mode name='custom' supported='yes'>
Nov 14 09:39:49 user nova-compute[75229]:       <model usable='no'>qemu64</model>
Nov 14 09:39:49 user nova-compute[75229]:       <model usable='yes'>qemu32</model>
Nov 14 09:39:49 user nova-compute[75229]:       <model usable='no'>phenom</model>
Nov 14 09:39:49 user nova-compute[75229]:       <model usable='yes'>pentium3</model>
Nov 14 09:39:49 user nova-compute[75229]:       <model usable='yes'>pentium2</model>
Nov 14 09:39:49 user nova-compute[75229]:       <model usable='yes'>pentium</model>
Nov 14 09:39:49 user nova-compute[75229]:       <model usable='no'>n270</model>
Nov 14 09:39:49 user nova-compute[75229]:       <model usable='no'>kvm64</model>
Nov 14 09:39:49 user nova-compute[75229]:       <model usable='yes'>kvm32</model>
Nov 14 09:39:49 user nova-compute[75229]:       <model usable='yes'>coreduo</model>
Nov 14 09:39:49 user nova-compute[75229]:       <model usable='no'>core2duo</model>
Nov 14 09:39:49 user nova-compute[75229]:       <model usable='no'>athlon</model>
Nov 14 09:39:49 user nova-compute[75229]:       <model usable='no'>Westmere-IBRS</model>
Nov 14 09:39:49 user nova-compute[75229]:       <model usable='no'>Westmere</model>
Nov 14 09:39:49 user nova-compute[75229]:       <model usable='no'>Snowridge</model>
Nov 14 09:39:49 user nova-compute[75229]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 14 09:39:49 user nova-compute[75229]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 14 09:39:49 user nova-compute[75229]:       <model usable='no'>Skylake-Server</model>
Nov 14 09:39:49 user nova-compute[75229]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 14 09:39:49 user nova-compute[75229]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 14 09:39:49 user nova-compute[75229]:       <model usable='no'>Skylake-Client</model>
Nov 14 09:39:49 user nova-compute[75229]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 14 09:39:49 user nova-compute[75229]:       <model usable='no'>SandyBridge</model>
Nov 14 09:39:49 user nova-compute[75229]:       <model usable='no'>Penryn</model>
Nov 14 09:39:49 user nova-compute[75229]:       <model usable='no'>Opteron_G5</model>
Nov 14 09:39:49 user nova-compute[75229]:       <model usable='no'>Opteron_G4</model>
Nov 14 09:39:49 user nova-compute[75229]:       <model usable='no'>Opteron_G3</model>
Nov 14 09:39:49 user nova-compute[75229]:       <model usable='no'>Opteron_G2</model>
Nov 14 09:39:49 user nova-compute[75229]:       <model usable='no'>Opteron_G1</model>
Nov 14 09:39:49 user nova-compute[75229]:       <model usable='no'>Nehalem-IBRS</model>
Nov 14 09:39:49 user nova-compute[75229]:       <model usable='no'>Nehalem</model>
Nov 14 09:39:49 user nova-compute[75229]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 14 09:39:49 user nova-compute[75229]:       <model usable='no'>IvyBridge</model>
Nov 14 09:39:49 user nova-compute[75229]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 14 09:39:49 user nova-compute[75229]:       <model usable='no'>Icelake-Server</model>
Nov 14 09:39:49 user nova-compute[75229]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 14 09:39:49 user nova-compute[75229]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 14 09:39:49 user nova-compute[75229]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 14 09:39:49 user nova-compute[75229]:       <model usable='no'>Haswell-noTSX</model>
Nov 14 09:39:49 user nova-compute[75229]:       <model usable='no'>Haswell-IBRS</model>
Nov 14 09:39:49 user nova-compute[75229]:       <model usable='no'>Haswell</model>
Nov 14 09:39:49 user nova-compute[75229]:       <model usable='no'>EPYC-Rome</model>
Nov 14 09:39:49 user nova-compute[75229]:       <model usable='no'>EPYC-Milan</model>
Nov 14 09:39:49 user nova-compute[75229]:       <model usable='no'>EPYC-IBPB</model>
Nov 14 09:39:49 user nova-compute[75229]:       <model usable='no'>EPYC</model>
Nov 14 09:39:49 user nova-compute[75229]:       <model usable='no'>Dhyana</model>
Nov 14 09:39:49 user nova-compute[75229]:       <model usable='no'>Cooperlake</model>
Nov 14 09:39:49 user nova-compute[75229]:       <model usable='no'>Conroe</model>
Nov 14 09:39:49 user nova-compute[75229]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 14 09:39:49 user nova-compute[75229]:       <model usable='no'>Cascadelake-Server</model>
Nov 14 09:39:49 user nova-compute[75229]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 14 09:39:49 user nova-compute[75229]:       <model usable='no'>Broadwell-noTSX</model>
Nov 14 09:39:49 user nova-compute[75229]:       <model usable='no'>Broadwell-IBRS</model>
Nov 14 09:39:49 user nova-compute[75229]:       <model usable='no'>Broadwell</model>
Nov 14 09:39:49 user nova-compute[75229]:       <model usable='yes'>486</model>
Nov 14 09:39:49 user nova-compute[75229]:     </mode>
Nov 14 09:39:49 user nova-compute[75229]:   </cpu>
Nov 14 09:39:49 user nova-compute[75229]:   <memoryBacking supported='yes'>
Nov 14 09:39:49 user nova-compute[75229]:     <enum name='sourceType'>
Nov 14 09:39:49 user nova-compute[75229]:       <value>file</value>
Nov 14 09:39:49 user nova-compute[75229]:       <value>anonymous</value>
Nov 14 09:39:49 user nova-compute[75229]:       <value>memfd</value>
Nov 14 09:39:49 user nova-compute[75229]:     </enum>
Nov 14 09:39:49 user nova-compute[75229]:   </memoryBacking>
Nov 14 09:39:49 user nova-compute[75229]:   <devices>
Nov 14 09:39:49 user nova-compute[75229]:     <disk supported='yes'>
Nov 14 09:39:49 user nova-compute[75229]:       <enum name='diskDevice'>
Nov 14 09:39:49 user nova-compute[75229]:         <value>disk</value>
Nov 14 09:39:49 user nova-compute[75229]:         <value>cdrom</value>
Nov 14 09:39:49 user nova-compute[75229]:         <value>floppy</value>
Nov 14 09:39:49 user nova-compute[75229]:         <value>lun</value>
Nov 14 09:39:49 user nova-compute[75229]:       </enum>
Nov 14 09:39:49 user nova-compute[75229]:       <enum name='bus'>
Nov 14 09:39:49 user nova-compute[75229]:         <value>ide</value>
Nov 14 09:39:49 user nova-compute[75229]:         <value>fdc</value>
Nov 14 09:39:49 user nova-compute[75229]:         <value>scsi</value>
Nov 14 09:39:49 user nova-compute[75229]:         <value>virtio</value>
Nov 14 09:39:49 user nova-compute[75229]:         <value>usb</value>
Nov 14 09:39:49 user nova-compute[75229]:         <value>sata</value>
Nov 14 09:39:49 user nova-compute[75229]:       </enum>
Nov 14 09:39:49 user nova-compute[75229]:       <enum name='model'>
Nov 14 09:39:49 user nova-compute[75229]:         <value>virtio</value>
Nov 14 09:39:49 user nova-compute[75229]:         <value>virtio-transitional</value>
Nov 14 09:39:49 user nova-compute[75229]:         <value>virtio-non-transitional</value>
Nov 14 09:39:49 user nova-compute[75229]:       </enum>
Nov 14 09:39:49 user nova-compute[75229]:     </disk>
Nov 14 09:39:49 user nova-compute[75229]:     <graphics supported='yes'>
Nov 14 09:39:49 user nova-compute[75229]:       <enum name='type'>
Nov 14 09:39:49 user nova-compute[75229]:         <value>sdl</value>
Nov 14 09:39:49 user nova-compute[75229]:         <value>vnc</value>
Nov 14 09:39:49 user nova-compute[75229]:         <value>spice</value>
Nov 14 09:39:49 user nova-compute[75229]:         <value>egl-headless</value>
Nov 14 09:39:49 user nova-compute[75229]:       </enum>
Nov 14 09:39:49 user nova-compute[75229]:     </graphics>
Nov 14 09:39:49 user nova-compute[75229]:     <video supported='yes'>
Nov 14 09:39:49 user nova-compute[75229]:       <enum name='modelType'>
Nov 14 09:39:49 user nova-compute[75229]:         <value>vga</value>
Nov 14 09:39:49 user nova-compute[75229]:         <value>cirrus</value>
Nov 14 09:39:49 user nova-compute[75229]:         <value>vmvga</value>
Nov 14 09:39:49 user nova-compute[75229]:         <value>qxl</value>
Nov 14 09:39:49 user nova-compute[75229]:         <value>virtio</value>
Nov 14 09:39:49 user nova-compute[75229]:         <value>none</value>
Nov 14 09:39:49 user nova-compute[75229]:         <value>bochs</value>
Nov 14 09:39:49 user nova-compute[75229]:         <value>ramfb</value>
Nov 14 09:39:49 user nova-compute[75229]:       </enum>
Nov 14 09:39:49 user nova-compute[75229]:     </video>
Nov 14 09:39:49 user nova-compute[75229]:     <hostdev supported='yes'>
Nov 14 09:39:49 user nova-compute[75229]:       <enum name='mode'>
Nov 14 09:39:49 user nova-compute[75229]:         <value>subsystem</value>
Nov 14 09:39:49 user nova-compute[75229]:       </enum>
Nov 14 09:39:49 user nova-compute[75229]:       <enum name='startupPolicy'>
Nov 14 09:39:49 user nova-compute[75229]:         <value>default</value>
Nov 14 09:39:49 user nova-compute[75229]:         <value>mandatory</value>
Nov 14 09:39:49 user nova-compute[75229]:         <value>requisite</value>
Nov 14 09:39:49 user nova-compute[75229]:         <value>optional</value>
Nov 14 09:39:49 user nova-compute[75229]:       </enum>
Nov 14 09:39:49 user nova-compute[75229]:       <enum name='subsysType'>
Nov 14 09:39:49 user nova-compute[75229]:         <value>usb</value>
Nov 14 09:39:49 user nova-compute[75229]:         <value>pci</value>
Nov 14 09:39:49 user nova-compute[75229]:         <value>scsi</value>
Nov 14 09:39:49 user nova-compute[75229]:       </enum>
Nov 14 09:39:49 user nova-compute[75229]:       <enum name='capsType'/>
Nov 14 09:39:49 user nova-compute[75229]:       <enum name='pciBackend'/>
Nov 14 09:39:49 user nova-compute[75229]:     </hostdev>
Nov 14 09:39:49 user nova-compute[75229]:     <rng supported='yes'>
Nov 14 09:39:49 user nova-compute[75229]:       <enum name='model'>
Nov 14 09:39:49 user nova-compute[75229]:         <value>virtio</value>
Nov 14 09:39:49 user nova-compute[75229]:         <value>virtio-transitional</value>
Nov 14 09:39:49 user nova-compute[75229]:         <value>virtio-non-transitional</value>
Nov 14 09:39:49 user nova-compute[75229]:       </enum>
Nov 14 09:39:49 user nova-compute[75229]:       <enum name='backendModel'>
Nov 14 09:39:49 user nova-compute[75229]:         <value>random</value>
Nov 14 09:39:49 user nova-compute[75229]:         <value>egd</value>
Nov 14 09:39:49 user nova-compute[75229]:         <value>builtin</value>
Nov 14 09:39:49 user nova-compute[75229]:       </enum>
Nov 14 09:39:49 user nova-compute[75229]:     </rng>
Nov 14 09:39:49 user nova-compute[75229]:     <filesystem supported='yes'>
Nov 14 09:39:49 user nova-compute[75229]:       <enum name='driverType'>
Nov 14 09:39:49 user nova-compute[75229]:         <value>path</value>
Nov 14 09:39:49 user nova-compute[75229]:         <value>handle</value>
Nov 14 09:39:49 user nova-compute[75229]:         <value>virtiofs</value>
Nov 14 09:39:49 user nova-compute[75229]:       </enum>
Nov 14 09:39:49 user nova-compute[75229]:     </filesystem>
Nov 14 09:39:49 user nova-compute[75229]:     <tpm supported='yes'>
Nov 14 09:39:49 user nova-compute[75229]:       <enum name='model'>
Nov 14 09:39:49 user nova-compute[75229]:         <value>tpm-tis</value>
Nov 14 09:39:49 user nova-compute[75229]:         <value>tpm-crb</value>
Nov 14 09:39:49 user nova-compute[75229]:       </enum>
Nov 14 09:39:49 user nova-compute[75229]:       <enum name='backendModel'>
Nov 14 09:39:49 user nova-compute[75229]:         <value>passthrough</value>
Nov 14 09:39:49 user nova-compute[75229]:         <value>emulator</value>
Nov 14 09:39:49 user nova-compute[75229]:       </enum>
Nov 14 09:39:49 user nova-compute[75229]:     </tpm>
Nov 14 09:39:49 user nova-compute[75229]:   </devices>
Nov 14 09:39:49 user nova-compute[75229]:   <features>
Nov 14 09:39:49 user nova-compute[75229]:     <gic supported='no'/>
Nov 14 09:39:49 user nova-compute[75229]:     <vmcoreinfo supported='yes'/>
Nov 14 09:39:49 user nova-compute[75229]:     <genid supported='yes'/>
Nov 14 09:39:49 user nova-compute[75229]:     <backingStoreInput supported='yes'/>
Nov 14 09:39:49 user nova-compute[75229]:     <backup supported='yes'/>
Nov 14 09:39:49 user nova-compute[75229]:     <sev supported='no'/>
Nov 14 09:39:49 user nova-compute[75229]:   </features>
Nov 14 09:39:49 user nova-compute[75229]: </domainCapabilities>
Nov 14 09:39:49 user nova-compute[75229]:  {{(pid=75229) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 14 09:39:49 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-dc17613f-ef03-4a04-abcf-4df8bf8dcec5 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu:
Nov 14 09:39:49 user nova-compute[75229]: <domainCapabilities>
Nov 14 09:39:49 user nova-compute[75229]:   <path>/usr/bin/qemu-system-i386</path>
Nov 14 09:39:49 user nova-compute[75229]:   <domain>kvm</domain>
Nov 14 09:39:49 user nova-compute[75229]:   <machine>pc-i440fx-jammy</machine>
Nov 14 09:39:49 user nova-compute[75229]:   <arch>i686</arch>
Nov 14 09:39:49 user nova-compute[75229]:   <vcpu max='255'/>
Nov 14 09:39:49 user nova-compute[75229]:   <iothreads supported='yes'/>
Nov 14 09:39:49 user nova-compute[75229]:   <os supported='yes'>
Nov 14 09:39:49 user nova-compute[75229]:     <enum name='firmware'/>
Nov 14 09:39:49 user nova-compute[75229]:     <loader supported='yes'>
Nov 14 09:39:49 user nova-compute[75229]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 14 09:39:49 user nova-compute[75229]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 14 09:39:49 user nova-compute[75229]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 14 09:39:49 user nova-compute[75229]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 14 09:39:49 user nova-compute[75229]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 14 09:39:49 user nova-compute[75229]:       <enum name='type'>
Nov 14 09:39:49 user nova-compute[75229]:         <value>rom</value>
Nov 14 09:39:49 user nova-compute[75229]:         <value>pflash</value>
Nov 14 09:39:49 user nova-compute[75229]:       </enum>
Nov 14 09:39:49 user nova-compute[75229]:       <enum name='readonly'>
Nov 14 09:39:49 user nova-compute[75229]:         <value>yes</value>
Nov 14 09:39:49 user nova-compute[75229]:         <value>no</value>
Nov 14 09:39:49 user nova-compute[75229]:       </enum>
Nov 14 09:39:49 user nova-compute[75229]:       <enum name='secure'>
Nov 14 09:39:49 user nova-compute[75229]:         <value>no</value>
Nov 14 09:39:49 user nova-compute[75229]:       </enum>
Nov 14 09:39:49 user nova-compute[75229]:     </loader>
Nov 14 09:39:49 user nova-compute[75229]:   </os>
Nov 14 09:39:49 user nova-compute[75229]:   <cpu>
Nov 14 09:39:49 user nova-compute[75229]:     <mode name='host-passthrough' supported='yes'>
Nov 14 09:39:49 user nova-compute[75229]:       <enum name='hostPassthroughMigratable'>
Nov 14 09:39:49 user nova-compute[75229]:         <value>off</value>
Nov 14 09:39:49 user nova-compute[75229]:       </enum>
Nov 14 09:39:49 user nova-compute[75229]:     </mode>
Nov 14 09:39:49 user nova-compute[75229]:     <mode name='maximum' supported='yes'>
Nov 14 09:39:49 user nova-compute[75229]:       <enum name='maximumMigratable'>
Nov 14 09:39:49 user nova-compute[75229]:         <value>on</value>
Nov 14 09:39:49 user nova-compute[75229]:         <value>off</value>
Nov 14 09:39:49 user nova-compute[75229]:       </enum>
Nov 14 09:39:49 user nova-compute[75229]:     </mode>
Nov 14 09:39:49 user nova-compute[75229]:     <mode name='host-model' supported='yes'>
Nov 14 09:39:49 user nova-compute[75229]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 14 09:39:49 user nova-compute[75229]:       <vendor>Intel</vendor>
Nov 14 09:39:49 user nova-compute[75229]:       <feature policy='require' name='ss'/>
Nov 14 09:39:49 user nova-compute[75229]:       <feature policy='require' name='vmx'/>
Nov 14 09:39:49 user nova-compute[75229]:       <feature policy='require' name='pcid'/>
Nov 14 09:39:49 user nova-compute[75229]:       <feature policy='require' name='hypervisor'/>
Nov 14 09:39:49 user nova-compute[75229]:       <feature policy='require' name='arat'/>
Nov 14 09:39:49 user nova-compute[75229]:       <feature policy='require' name='tsc_adjust'/>
Nov 14 09:39:49 user nova-compute[75229]:       <feature policy='require' name='umip'/>
Nov 14 09:39:49 user nova-compute[75229]:       <feature policy='require' name='md-clear'/>
Nov 14 09:39:49 user nova-compute[75229]:       <feature policy='require' name='stibp'/>
Nov 14 09:39:49 user nova-compute[75229]:       <feature policy='require' name='arch-capabilities'/>
Nov 14 09:39:49 user nova-compute[75229]:       <feature policy='require' name='ssbd'/>
Nov 14 09:39:49 user nova-compute[75229]:       <feature policy='require' name='ibpb'/>
Nov 14 09:39:49 user nova-compute[75229]:       <feature policy='require' name='ibrs'/>
Nov 14 09:39:49 user nova-compute[75229]:       <feature policy='require' name='amd-stibp'/>
Nov 14 09:39:49 user nova-compute[75229]:       <feature policy='require' name='amd-ssbd'/>
Nov 14 09:39:49 user nova-compute[75229]:       <feature policy='disable' name='erms'/>
Nov 14 09:39:49 user nova-compute[75229]:       <feature policy='disable' name='xsaveopt'/>
Nov 14 09:39:49 user nova-compute[75229]:       <feature policy='disable' name='lm'/>
Nov 14 09:39:49 user nova-compute[75229]:     </mode>
Nov 14 09:39:49 user nova-compute[75229]:     <mode name='custom' supported='yes'>
Nov 14 09:39:49 user nova-compute[75229]:       <model usable='no'>qemu64</model>
Nov 14 09:39:49 user nova-compute[75229]:       <model usable='yes'>qemu32</model>
Nov 14 09:39:49 user nova-compute[75229]:       <model usable='no'>phenom</model>
Nov 14 09:39:49 user nova-compute[75229]:       <model usable='yes'>pentium3</model>
Nov 14 09:39:49 user nova-compute[75229]:       <model usable='yes'>pentium2</model>
Nov 14 09:39:49 user nova-compute[75229]:       <model usable='yes'>pentium</model>
Nov 14 09:39:49 user nova-compute[75229]:       <model usable='no'>n270</model>
Nov 14 09:39:49 user nova-compute[75229]:       <model usable='no'>kvm64</model>
Nov 14 09:39:49 user nova-compute[75229]:       <model usable='yes'>kvm32</model>
Nov 14 09:39:49 user nova-compute[75229]:       <model usable='yes'>coreduo</model>
Nov 14 09:39:49 user nova-compute[75229]:       <model usable='no'>core2duo</model>
Nov 14 09:39:49 user nova-compute[75229]:       <model usable='no'>athlon</model>
Nov 14 09:39:49 user nova-compute[75229]:       <model usable='no'>Westmere-IBRS</model>
Nov 14 09:39:49 user nova-compute[75229]:       <model usable='no'>Westmere</model>
Nov 14 09:39:49 user nova-compute[75229]:       <model usable='no'>Snowridge</model>
Nov 14 09:39:49 user nova-compute[75229]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 14 09:39:49 user nova-compute[75229]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 14 09:39:49 user nova-compute[75229]:       <model usable='no'>Skylake-Server</model>
Nov 14 09:39:49 user nova-compute[75229]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 14 09:39:49 user nova-compute[75229]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 14 09:39:49 user nova-compute[75229]:       <model usable='no'>Skylake-Client</model>
Nov 14 09:39:49 user nova-compute[75229]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 14 09:39:49 user nova-compute[75229]:       <model usable='no'>SandyBridge</model>
Nov 14 09:39:49 user nova-compute[75229]:       <model usable='no'>Penryn</model>
Nov 14 09:39:49 user nova-compute[75229]:       <model usable='no'>Opteron_G5</model>
Nov 14 09:39:49 user nova-compute[75229]:       <model usable='no'>Opteron_G4</model>
Nov 14 09:39:49 user nova-compute[75229]:       <model usable='no'>Opteron_G3</model>
Nov 14 09:39:49 user nova-compute[75229]:       <model usable='no'>Opteron_G2</model>
Nov 14 09:39:49 user nova-compute[75229]:       <model usable='no'>Opteron_G1</model>
Nov 14 09:39:49 user nova-compute[75229]:       <model usable='no'>Nehalem-IBRS</model>
Nov 14 09:39:49 user nova-compute[75229]:       <model usable='no'>Nehalem</model>
Nov 14 09:39:49 user nova-compute[75229]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 14 09:39:49 user nova-compute[75229]:       <model usable='no'>IvyBridge</model>
Nov 14 09:39:49 user nova-compute[75229]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 14 09:39:49 user nova-compute[75229]:       <model usable='no'>Icelake-Server</model>
Nov 14 09:39:49 user nova-compute[75229]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 14 09:39:49 user nova-compute[75229]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 14 09:39:49 user nova-compute[75229]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 14 09:39:49 user nova-compute[75229]:       <model usable='no'>Haswell-noTSX</model>
Nov 14 09:39:49 user nova-compute[75229]:       <model usable='no'>Haswell-IBRS</model>
Nov 14 09:39:49 user nova-compute[75229]:       <model usable='no'>Haswell</model>
Nov 14 09:39:49 user nova-compute[75229]:       <model usable='no'>EPYC-Rome</model>
Nov 14 09:39:49 user nova-compute[75229]:       <model usable='no'>EPYC-Milan</model>
Nov 14 09:39:49 user nova-compute[75229]:       <model usable='no'>EPYC-IBPB</model>
Nov 14 09:39:49 user nova-compute[75229]:       <model usable='no'>EPYC</model>
Nov 14 09:39:49 user nova-compute[75229]:       <model usable='no'>Dhyana</model>
Nov 14 09:39:49 user nova-compute[75229]:       <model usable='no'>Cooperlake</model>
Nov 14 09:39:49 user nova-compute[75229]:       <model usable='no'>Conroe</model>
Nov 14 09:39:49 user nova-compute[75229]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 14 09:39:49 user nova-compute[75229]:       <model usable='no'>Cascadelake-Server</model>
Nov 14 09:39:49 user nova-compute[75229]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 14 09:39:49 user nova-compute[75229]:       <model usable='no'>Broadwell-noTSX</model>
Nov 14 09:39:49 user nova-compute[75229]:       <model usable='no'>Broadwell-IBRS</model>
Nov 14 09:39:49 user nova-compute[75229]:       <model usable='no'>Broadwell</model>
Nov 14 09:39:49 user nova-compute[75229]:       <model usable='yes'>486</model>
Nov 14 09:39:49 user nova-compute[75229]:     </mode>
Nov 14 09:39:49 user nova-compute[75229]:   </cpu>
Nov 14 09:39:49 user nova-compute[75229]:   <memoryBacking supported='yes'>
Nov 14 09:39:49 user nova-compute[75229]:     <enum name='sourceType'>
Nov 14 09:39:49 user nova-compute[75229]:       <value>file</value>
Nov 14 09:39:49 user nova-compute[75229]:       <value>anonymous</value>
Nov 14 09:39:49 user nova-compute[75229]:       <value>memfd</value>
Nov 14 09:39:49 user nova-compute[75229]:     </enum>
Nov 14 09:39:49 user nova-compute[75229]:   </memoryBacking>
Nov 14 09:39:49 user nova-compute[75229]:   <devices>
Nov 14 09:39:49 user nova-compute[75229]:     <disk supported='yes'>
Nov 14 09:39:49 user nova-compute[75229]:       <enum name='diskDevice'>
Nov 14 09:39:49 user nova-compute[75229]:         <value>disk</value>
Nov 14 09:39:49 user nova-compute[75229]:         <value>cdrom</value>
Nov 14 09:39:49 user nova-compute[75229]:         <value>floppy</value>
Nov 14 09:39:49 user nova-compute[75229]:         <value>lun</value>
Nov 14 09:39:49 user nova-compute[75229]:       </enum>
Nov 14 09:39:49 user nova-compute[75229]:       <enum name='bus'>
Nov 14 09:39:49 user nova-compute[75229]:         <value>ide</value>
Nov 14 09:39:49 user nova-compute[75229]:         <value>fdc</value>
Nov 14 09:39:49 user nova-compute[75229]:         <value>scsi</value>
Nov 14 09:39:49 user nova-compute[75229]:         <value>virtio</value>
Nov 14 09:39:49 user nova-compute[75229]:         <value>usb</value>
Nov 14 09:39:49 user nova-compute[75229]:         <value>sata</value>
Nov 14 09:39:49 user nova-compute[75229]:       </enum>
Nov 14 09:39:49 user nova-compute[75229]:       <enum name='model'>
Nov 14 09:39:49 user nova-compute[75229]:         <value>virtio</value>
Nov 14 09:39:49 user nova-compute[75229]:         <value>virtio-transitional</value>
Nov 14 09:39:49 user nova-compute[75229]:         <value>virtio-non-transitional</value>
Nov 14 09:39:49 user nova-compute[75229]:       </enum>
Nov 14 09:39:49 user nova-compute[75229]:     </disk>
Nov 14 09:39:49 user nova-compute[75229]:     <graphics supported='yes'>
Nov 14 09:39:49 user nova-compute[75229]:       <enum name='type'>
Nov 14 09:39:49 user nova-compute[75229]:         <value>sdl</value>
Nov 14 09:39:49 user nova-compute[75229]:         <value>vnc</value>
Nov 14 09:39:49 user nova-compute[75229]:         <value>spice</value>
Nov 14 09:39:49 user nova-compute[75229]:         <value>egl-headless</value>
Nov 14 09:39:49 user nova-compute[75229]:       </enum>
Nov 14 09:39:49 user nova-compute[75229]:     </graphics>
Nov 14 09:39:49 user nova-compute[75229]:     <video supported='yes'>
Nov 14 09:39:49 user nova-compute[75229]:       <enum name='modelType'>
Nov 14 09:39:49 user nova-compute[75229]:         <value>vga</value>
Nov 14 09:39:49 user nova-compute[75229]:         <value>cirrus</value>
Nov 14 09:39:49 user nova-compute[75229]:         <value>vmvga</value>
Nov 14 09:39:49 user nova-compute[75229]:         <value>qxl</value>
Nov 14 09:39:49 user nova-compute[75229]:         <value>virtio</value>
Nov 14 09:39:49 user nova-compute[75229]:         <value>none</value>
Nov 14 09:39:49 user nova-compute[75229]:         <value>bochs</value>
Nov 14 09:39:49 user nova-compute[75229]:         <value>ramfb</value>
Nov 14 09:39:49 user nova-compute[75229]:       </enum>
Nov 14 09:39:49 user nova-compute[75229]:     </video>
Nov 14 09:39:49 user nova-compute[75229]:     <hostdev supported='yes'>
Nov 14 09:39:49 user nova-compute[75229]:       <enum name='mode'>
Nov 14 09:39:49 user nova-compute[75229]:         <value>subsystem</value>
Nov 14 09:39:49 user nova-compute[75229]:       </enum>
Nov 14 09:39:49 user nova-compute[75229]:       <enum name='startupPolicy'>
Nov 14 09:39:49 user nova-compute[75229]:         <value>default</value>
Nov 14 09:39:49 user nova-compute[75229]:         <value>mandatory</value>
Nov 14 09:39:49 user nova-compute[75229]:         <value>requisite</value>
Nov 14 09:39:49 user nova-compute[75229]:         <value>optional</value>
Nov 14 09:39:49 user nova-compute[75229]:       </enum>
Nov 14 09:39:49 user nova-compute[75229]:       <enum name='subsysType'>
Nov 14 09:39:49 user nova-compute[75229]:         <value>usb</value>
Nov 14 09:39:49 user nova-compute[75229]:         <value>pci</value>
Nov 14 09:39:49 user nova-compute[75229]:         <value>scsi</value>
Nov 14 09:39:49 user nova-compute[75229]:       </enum>
Nov 14 09:39:49 user nova-compute[75229]:       <enum name='capsType'/>
Nov 14 09:39:49 user nova-compute[75229]:       <enum name='pciBackend'/>
Nov 14 09:39:49 user nova-compute[75229]:     </hostdev>
Nov 14 09:39:49 user nova-compute[75229]:     <rng supported='yes'>
Nov 14 09:39:49 user nova-compute[75229]:       <enum name='model'>
Nov 14 09:39:49 user nova-compute[75229]:         <value>virtio</value>
Nov 14 09:39:49 user nova-compute[75229]:         <value>virtio-transitional</value>
Nov 14 09:39:49 user nova-compute[75229]:         <value>virtio-non-transitional</value>
Nov 14 09:39:49 user nova-compute[75229]:       </enum>
Nov 14 09:39:49 user nova-compute[75229]:       <enum name='backendModel'>
Nov 14 09:39:49 user nova-compute[75229]:         <value>random</value>
Nov 14 09:39:49 user nova-compute[75229]:         <value>egd</value>
Nov 14 09:39:49 user nova-compute[75229]:         <value>builtin</value>
Nov 14 09:39:49 user nova-compute[75229]:       </enum>
Nov 14 09:39:49 user nova-compute[75229]:     </rng>
Nov 14 09:39:49 user nova-compute[75229]:     <filesystem supported='yes'>
Nov 14 09:39:49 user nova-compute[75229]:       <enum name='driverType'>
Nov 14 09:39:49 user nova-compute[75229]:         <value>path</value>
Nov 14 09:39:49 user nova-compute[75229]:         <value>handle</value>
Nov 14 09:39:49 user nova-compute[75229]:         <value>virtiofs</value>
Nov 14 09:39:49 user nova-compute[75229]:       </enum>
Nov 14 09:39:49 user nova-compute[75229]:     </filesystem>
Nov 14 09:39:49 user nova-compute[75229]:     <tpm supported='yes'>
Nov 14 09:39:49 user nova-compute[75229]:       <enum name='model'>
Nov 14 09:39:49 user nova-compute[75229]:         <value>tpm-tis</value>
Nov 14 09:39:49 user nova-compute[75229]:         <value>tpm-crb</value>
Nov 14 09:39:49 user nova-compute[75229]:       </enum>
Nov 14 09:39:49 user nova-compute[75229]:       <enum name='backendModel'>
Nov 14 09:39:49 user nova-compute[75229]:         <value>passthrough</value>
Nov 14 09:39:49 user nova-compute[75229]:         <value>emulator</value>
Nov 14 09:39:49 user nova-compute[75229]:       </enum>
Nov 14 09:39:49 user nova-compute[75229]:     </tpm>
Nov 14 09:39:49 user nova-compute[75229]:   </devices>
Nov 14 09:39:49 user nova-compute[75229]:   <features>
Nov 14 09:39:49 user nova-compute[75229]:     <gic supported='no'/>
Nov 14 09:39:49 user nova-compute[75229]:     <vmcoreinfo supported='yes'/>
Nov 14 09:39:49 user nova-compute[75229]:     <genid supported='yes'/>
Nov 14 09:39:49 user nova-compute[75229]:     <backingStoreInput supported='yes'/>
Nov 14 09:39:49 user nova-compute[75229]:     <backup supported='yes'/>
Nov 14 09:39:49 user nova-compute[75229]:     <sev supported='no'/>
Nov 14 09:39:49 user nova-compute[75229]:   </features>
Nov 14 09:39:49 user nova-compute[75229]: </domainCapabilities>
Nov 14 09:39:49 user nova-compute[75229]:  {{(pid=75229) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 14 09:39:49 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-dc17613f-ef03-4a04-abcf-4df8bf8dcec5 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=q35:
Nov 14 09:39:49 user nova-compute[75229]: <domainCapabilities>
Nov 14 09:39:49 user nova-compute[75229]:   <path>/usr/bin/qemu-system-i386</path>
Nov 14 09:39:49 user nova-compute[75229]:   <domain>kvm</domain>
Nov 14 09:39:49 user nova-compute[75229]:   <machine>pc-q35-6.2</machine>
Nov 14 09:39:49 user nova-compute[75229]:   <arch>i686</arch>
Nov 14 09:39:49 user nova-compute[75229]:   <vcpu max='288'/>
Nov 14 09:39:49 user nova-compute[75229]:   <iothreads supported='yes'/>
Nov 14 09:39:49 user nova-compute[75229]:   <os supported='yes'>
Nov 14 09:39:49 user nova-compute[75229]:     <enum name='firmware'/>
Nov 14 09:39:49 user nova-compute[75229]:     <loader supported='yes'>
Nov 14 09:39:49 user nova-compute[75229]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 14 09:39:49 user nova-compute[75229]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 14 09:39:49 user nova-compute[75229]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 14 09:39:49 user nova-compute[75229]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 14 09:39:49 user nova-compute[75229]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 14 09:39:49 user nova-compute[75229]:       <enum name='type'>
Nov 14 09:39:49 user nova-compute[75229]:         <value>rom</value>
Nov 14 09:39:49 user nova-compute[75229]:         <value>pflash</value>
Nov 14 09:39:49 user nova-compute[75229]:       </enum>
Nov 14 09:39:49 user nova-compute[75229]:       <enum name='readonly'>
Nov 14 09:39:49 user nova-compute[75229]:         <value>yes</value>
Nov 14 09:39:49 user nova-compute[75229]:         <value>no</value>
Nov 14 09:39:49 user nova-compute[75229]:       </enum>
Nov 14 09:39:49 user nova-compute[75229]:       <enum name='secure'>
Nov 14 09:39:49 user nova-compute[75229]:         <value>no</value>
Nov 14 09:39:49 user nova-compute[75229]:       </enum>
Nov 14 09:39:49 user nova-compute[75229]:     </loader>
Nov 14 09:39:49 user nova-compute[75229]:   </os>
Nov 14 09:39:49 user nova-compute[75229]:   <cpu>
Nov 14 09:39:49 user nova-compute[75229]:     <mode name='host-passthrough' supported='yes'>
Nov 14 09:39:49 user nova-compute[75229]:       <enum name='hostPassthroughMigratable'>
Nov 14 09:39:49 user nova-compute[75229]:         <value>off</value>
Nov 14 09:39:49 user nova-compute[75229]:       </enum>
Nov 14 09:39:49 user nova-compute[75229]:     </mode>
Nov 14 09:39:49 user nova-compute[75229]:     <mode name='maximum' supported='yes'>
Nov 14 09:39:49 user nova-compute[75229]:       <enum name='maximumMigratable'>
Nov 14 09:39:49 user nova-compute[75229]:         <value>on</value>
Nov 14 09:39:49 user nova-compute[75229]:         <value>off</value>
Nov 14 09:39:49 user nova-compute[75229]:       </enum>
Nov 14 09:39:49 user nova-compute[75229]:     </mode>
Nov 14 09:39:49 user nova-compute[75229]:     <mode name='host-model' supported='yes'>
Nov 14 09:39:49 user nova-compute[75229]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 14 09:39:49 user nova-compute[75229]:       <vendor>Intel</vendor>
Nov 14 09:39:49 user nova-compute[75229]:       <feature policy='require' name='ss'/>
Nov 14 09:39:49 user nova-compute[75229]:       <feature policy='require' name='vmx'/>
Nov 14 09:39:49 user nova-compute[75229]:       <feature policy='require' name='pcid'/>
Nov 14 09:39:49 user nova-compute[75229]:       <feature policy='require' name='hypervisor'/>
Nov 14 09:39:49 user nova-compute[75229]:       <feature policy='require' name='arat'/>
Nov 14 09:39:49 user nova-compute[75229]:       <feature policy='require' name='tsc_adjust'/>
Nov 14 09:39:49 user nova-compute[75229]:       <feature policy='require' name='umip'/>
Nov 14 09:39:49 user nova-compute[75229]:       <feature policy='require' name='md-clear'/>
Nov 14 09:39:49 user nova-compute[75229]:       <feature policy='require' name='stibp'/>
Nov 14 09:39:49 user nova-compute[75229]:       <feature policy='require' name='arch-capabilities'/>
Nov 14 09:39:49 user nova-compute[75229]:       <feature policy='require' name='ssbd'/>
Nov 14 09:39:49 user nova-compute[75229]:       <feature policy='require' name='ibpb'/>
Nov 14 09:39:49 user nova-compute[75229]:       <feature policy='require' name='ibrs'/>
Nov 14 09:39:49 user nova-compute[75229]:       <feature policy='require' name='amd-stibp'/>
Nov 14 09:39:49 user nova-compute[75229]:       <feature policy='require' name='amd-ssbd'/>
Nov 14 09:39:49 user nova-compute[75229]:       <feature policy='disable' name='erms'/>
Nov 14 09:39:49 user nova-compute[75229]:       <feature policy='disable' name='xsaveopt'/>
Nov 14 09:39:49 user nova-compute[75229]:       <feature policy='disable' name='lm'/>
Nov 14 09:39:49 user nova-compute[75229]:     </mode>
Nov 14 09:39:49 user nova-compute[75229]:     <mode name='custom' supported='yes'>
Nov 14 09:39:49 user nova-compute[75229]:       <model usable='no'>qemu64</model>
Nov 14 09:39:49 user nova-compute[75229]:       <model usable='yes'>qemu32</model>
Nov 14 09:39:49 user nova-compute[75229]:       <model usable='no'>phenom</model>
Nov 14 09:39:49 user nova-compute[75229]:       <model usable='yes'>pentium3</model>
Nov 14 09:39:49 user nova-compute[75229]:       <model usable='yes'>pentium2</model>
Nov 14 09:39:49 user nova-compute[75229]:       <model usable='yes'>pentium</model>
Nov 14 09:39:49 user nova-compute[75229]:       <model usable='no'>n270</model>
Nov 14 09:39:49 user nova-compute[75229]:       <model usable='no'>kvm64</model>
Nov 14 09:39:49 user nova-compute[75229]:       <model usable='yes'>kvm32</model>
Nov 14 09:39:49 user nova-compute[75229]:       <model usable='yes'>coreduo</model>
Nov 14 09:39:49 user nova-compute[75229]:       <model usable='no'>core2duo</model>
Nov 14 09:39:49 user nova-compute[75229]:       <model usable='no'>athlon</model>
Nov 14 09:39:49 user nova-compute[75229]:       <model usable='no'>Westmere-IBRS</model>
Nov 14 09:39:49 user nova-compute[75229]:       <model usable='no'>Westmere</model>
Nov 14 09:39:49 user nova-compute[75229]:       <model usable='no'>Snowridge</model>
Nov 14 09:39:49 user nova-compute[75229]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 14 09:39:49 user nova-compute[75229]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 14 09:39:49 user nova-compute[75229]:       <model usable='no'>Skylake-Server</model>
Nov 14 09:39:49 user nova-compute[75229]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 14 09:39:49 user nova-compute[75229]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 14 09:39:49 user nova-compute[75229]:       <model usable='no'>Skylake-Client</model>
Nov 14 09:39:49 user nova-compute[75229]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 14 09:39:49 user nova-compute[75229]:       <model usable='no'>SandyBridge</model>
Nov 14 09:39:49 user nova-compute[75229]:       <model usable='no'>Penryn</model>
Nov 14 09:39:49 user nova-compute[75229]:       <model usable='no'>Opteron_G5</model>
Nov 14 09:39:49 user nova-compute[75229]:       <model usable='no'>Opteron_G4</model>
Nov 14 09:39:49 user nova-compute[75229]:       <model usable='no'>Opteron_G3</model>
Nov 14 09:39:49 user nova-compute[75229]:       <model usable='no'>Opteron_G2</model>
Nov 14 09:39:49 user nova-compute[75229]:       <model usable='no'>Opteron_G1</model>
Nov 14 09:39:49 user nova-compute[75229]:       <model usable='no'>Nehalem-IBRS</model>
Nov 14 09:39:49 user nova-compute[75229]:       <model usable='no'>Nehalem</model>
Nov 14 09:39:49 user nova-compute[75229]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 14 09:39:49 user nova-compute[75229]:       <model usable='no'>IvyBridge</model>
Nov 14 09:39:49 user nova-compute[75229]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 14 09:39:49 user nova-compute[75229]:       <model usable='no'>Icelake-Server</model>
Nov 14 09:39:49 user nova-compute[75229]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 14 09:39:49 user nova-compute[75229]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 14 09:39:49 user nova-compute[75229]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 14 09:39:49 user nova-compute[75229]:       <model usable='no'>Haswell-noTSX</model>
Nov 14 09:39:49 user nova-compute[75229]:       <model usable='no'>Haswell-IBRS</model>
Nov 14 09:39:49 user nova-compute[75229]:       <model usable='no'>Haswell</model>
Nov 14 09:39:49 user nova-compute[75229]:       <model usable='no'>EPYC-Rome</model>
Nov 14 09:39:49 user nova-compute[75229]:       <model usable='no'>EPYC-Milan</model>
Nov 14 09:39:49 user nova-compute[75229]:       <model usable='no'>EPYC-IBPB</model>
Nov 14 09:39:49 user nova-compute[75229]:       <model usable='no'>EPYC</model>
Nov 14 09:39:49 user nova-compute[75229]:       <model usable='no'>Dhyana</model>
Nov 14 09:39:49 user nova-compute[75229]:       <model usable='no'>Cooperlake</model>
Nov 14 09:39:49 user nova-compute[75229]:       <model usable='no'>Conroe</model>
Nov 14 09:39:49 user nova-compute[75229]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 14 09:39:49 user nova-compute[75229]:       <model usable='no'>Cascadelake-Server</model>
Nov 14 09:39:50 user nova-compute[75229]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 14 09:39:50 user nova-compute[75229]:       <model usable='no'>Broadwell-noTSX</model>
Nov 14 09:39:50 user nova-compute[75229]:       <model usable='no'>Broadwell-IBRS</model>
Nov 14 09:39:50 user nova-compute[75229]:       <model usable='no'>Broadwell</model>
Nov 14 09:39:50 user nova-compute[75229]:       <model usable='yes'>486</model>
Nov 14 09:39:50 user nova-compute[75229]:     </mode>
Nov 14 09:39:50 user nova-compute[75229]:   </cpu>
Nov 14 09:39:50 user nova-compute[75229]:   <memoryBacking supported='yes'>
Nov 14 09:39:50 user nova-compute[75229]:     <enum name='sourceType'>
Nov 14 09:39:50 user nova-compute[75229]:       <value>file</value>
Nov 14 09:39:50 user nova-compute[75229]:       <value>anonymous</value>
Nov 14 09:39:50 user nova-compute[75229]:       <value>memfd</value>
Nov 14 09:39:50 user nova-compute[75229]:     </enum>
Nov 14 09:39:50 user nova-compute[75229]:   </memoryBacking>
Nov 14 09:39:50 user nova-compute[75229]:   <devices>
Nov 14 09:39:50 user nova-compute[75229]:     <disk supported='yes'>
Nov 14 09:39:50 user nova-compute[75229]:       <enum name='diskDevice'>
Nov 14 09:39:50 user nova-compute[75229]:         <value>disk</value>
Nov 14 09:39:50 user nova-compute[75229]:         <value>cdrom</value>
Nov 14 09:39:50 user nova-compute[75229]:         <value>floppy</value>
Nov 14 09:39:50 user nova-compute[75229]:         <value>lun</value>
Nov 14 09:39:50 user nova-compute[75229]:       </enum>
Nov 14 09:39:50 user nova-compute[75229]:       <enum name='bus'>
Nov 14 09:39:50 user nova-compute[75229]:         <value>fdc</value>
Nov 14 09:39:50 user nova-compute[75229]:         <value>scsi</value>
Nov 14 09:39:50 user nova-compute[75229]:         <value>virtio</value>
Nov 14 09:39:50 user nova-compute[75229]:         <value>usb</value>
Nov 14 09:39:50 user nova-compute[75229]:         <value>sata</value>
Nov 14 09:39:50 user nova-compute[75229]:       </enum>
Nov 14 09:39:50 user nova-compute[75229]:       <enum name='model'>
Nov 14 09:39:50 user nova-compute[75229]:         <value>virtio</value>
Nov 14 09:39:50 user nova-compute[75229]:         <value>virtio-transitional</value>
Nov 14 09:39:50 user nova-compute[75229]:         <value>virtio-non-transitional</value>
Nov 14 09:39:50 user nova-compute[75229]:       </enum>
Nov 14 09:39:50 user nova-compute[75229]:     </disk>
Nov 14 09:39:50 user nova-compute[75229]:     <graphics supported='yes'>
Nov 14 09:39:50 user nova-compute[75229]:       <enum name='type'>
Nov 14 09:39:50 user nova-compute[75229]:         <value>sdl</value>
Nov 14 09:39:50 user nova-compute[75229]:         <value>vnc</value>
Nov 14 09:39:50 user nova-compute[75229]:         <value>spice</value>
Nov 14 09:39:50 user nova-compute[75229]:         <value>egl-headless</value>
Nov 14 09:39:50 user nova-compute[75229]:       </enum>
Nov 14 09:39:50 user nova-compute[75229]:     </graphics>
Nov 14 09:39:50 user nova-compute[75229]:     <video supported='yes'>
Nov 14 09:39:50 user nova-compute[75229]:       <enum name='modelType'>
Nov 14 09:39:50 user nova-compute[75229]:         <value>vga</value>
Nov 14 09:39:50 user nova-compute[75229]:         <value>cirrus</value>
Nov 14 09:39:50 user nova-compute[75229]:         <value>vmvga</value>
Nov 14 09:39:50 user nova-compute[75229]:         <value>qxl</value>
Nov 14 09:39:50 user nova-compute[75229]:         <value>virtio</value>
Nov 14 09:39:50 user nova-compute[75229]:         <value>none</value>
Nov 14 09:39:50 user nova-compute[75229]:         <value>bochs</value>
Nov 14 09:39:50 user nova-compute[75229]:         <value>ramfb</value>
Nov 14 09:39:50 user nova-compute[75229]:       </enum>
Nov 14 09:39:50 user nova-compute[75229]:     </video>
Nov 14 09:39:50 user nova-compute[75229]:     <hostdev supported='yes'>
Nov 14 09:39:50 user nova-compute[75229]:       <enum name='mode'>
Nov 14 09:39:50 user nova-compute[75229]:         <value>subsystem</value>
Nov 14 09:39:50 user nova-compute[75229]:       </enum>
Nov 14 09:39:50 user nova-compute[75229]:       <enum name='startupPolicy'>
Nov 14 09:39:50 user nova-compute[75229]:         <value>default</value>
Nov 14 09:39:50 user nova-compute[75229]:         <value>mandatory</value>
Nov 14 09:39:50 user nova-compute[75229]:         <value>requisite</value>
Nov 14 09:39:50 user nova-compute[75229]:         <value>optional</value>
Nov 14 09:39:50 user nova-compute[75229]:       </enum>
Nov 14 09:39:50 user nova-compute[75229]:       <enum name='subsysType'>
Nov 14 09:39:50 user nova-compute[75229]:         <value>usb</value>
Nov 14 09:39:50 user nova-compute[75229]:         <value>pci</value>
Nov 14 09:39:50 user nova-compute[75229]:         <value>scsi</value>
Nov 14 09:39:50 user nova-compute[75229]:       </enum>
Nov 14 09:39:50 user nova-compute[75229]:       <enum name='capsType'/>
Nov 14 09:39:50 user nova-compute[75229]:       <enum name='pciBackend'/>
Nov 14 09:39:50 user nova-compute[75229]:     </hostdev>
Nov 14 09:39:50 user nova-compute[75229]:     <rng supported='yes'>
Nov 14 09:39:50 user nova-compute[75229]:       <enum name='model'>
Nov 14 09:39:50 user nova-compute[75229]:         <value>virtio</value>
Nov 14 09:39:50 user nova-compute[75229]:         <value>virtio-transitional</value>
Nov 14 09:39:50 user nova-compute[75229]:         <value>virtio-non-transitional</value>
Nov 14 09:39:50 user nova-compute[75229]:       </enum>
Nov 14 09:39:50 user nova-compute[75229]:       <enum name='backendModel'>
Nov 14 09:39:50 user nova-compute[75229]:         <value>random</value>
Nov 14 09:39:50 user nova-compute[75229]:         <value>egd</value>
Nov 14 09:39:50 user nova-compute[75229]:         <value>builtin</value>
Nov 14 09:39:50 user nova-compute[75229]:       </enum>
Nov 14 09:39:50 user nova-compute[75229]:     </rng>
Nov 14 09:39:50 user nova-compute[75229]:     <filesystem supported='yes'>
Nov 14 09:39:50 user nova-compute[75229]:       <enum name='driverType'>
Nov 14 09:39:50 user nova-compute[75229]:         <value>path</value>
Nov 14 09:39:50 user nova-compute[75229]:         <value>handle</value>
Nov 14 09:39:50 user nova-compute[75229]:         <value>virtiofs</value>
Nov 14 09:39:50 user nova-compute[75229]:       </enum>
Nov 14 09:39:50 user nova-compute[75229]:     </filesystem>
Nov 14 09:39:50 user nova-compute[75229]:     <tpm supported='yes'>
Nov 14 09:39:50 user nova-compute[75229]:       <enum name='model'>
Nov 14 09:39:50 user nova-compute[75229]:         <value>tpm-tis</value>
Nov 14 09:39:50 user nova-compute[75229]:         <value>tpm-crb</value>
Nov 14 09:39:50 user nova-compute[75229]:       </enum>
Nov 14 09:39:50 user nova-compute[75229]:       <enum name='backendModel'>
Nov 14 09:39:50 user nova-compute[75229]:         <value>passthrough</value>
Nov 14 09:39:50 user nova-compute[75229]:         <value>emulator</value>
Nov 14 09:39:50 user nova-compute[75229]:       </enum>
Nov 14 09:39:50 user nova-compute[75229]:     </tpm>
Nov 14 09:39:50 user nova-compute[75229]:   </devices>
Nov 14 09:39:50 user nova-compute[75229]:   <features>
Nov 14 09:39:50 user nova-compute[75229]:     <gic supported='no'/>
Nov 14 09:39:50 user nova-compute[75229]:     <vmcoreinfo supported='yes'/>
Nov 14 09:39:50 user nova-compute[75229]:     <genid supported='yes'/>
Nov 14 09:39:50 user nova-compute[75229]:     <backingStoreInput supported='yes'/>
Nov 14 09:39:50 user nova-compute[75229]:     <backup supported='yes'/>
Nov 14 09:39:50 user nova-compute[75229]:     <sev supported='no'/>
Nov 14 09:39:50 user nova-compute[75229]:   </features>
Nov 14 09:39:50 user nova-compute[75229]: </domainCapabilities>
Nov 14 09:39:50 user nova-compute[75229]:  {{(pid=75229) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 14 09:39:50 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-dc17613f-ef03-4a04-abcf-4df8bf8dcec5 None None] Getting domain capabilities for m68k via machine types: {None, 'virt'} {{(pid=75229) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 09:39:50 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-dc17613f-ef03-4a04-abcf-4df8bf8dcec5 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=75229) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 09:39:50 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-dc17613f-ef03-4a04-abcf-4df8bf8dcec5 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=75229) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 09:39:50 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-dc17613f-ef03-4a04-abcf-4df8bf8dcec5 None None] Getting domain capabilities for microblaze via machine types: {None} {{(pid=75229) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 09:39:50 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-dc17613f-ef03-4a04-abcf-4df8bf8dcec5 None None] Error from libvirt when retrieving domain capabilities for arch microblaze / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblaze' on this host {{(pid=75229) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 09:39:50 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-dc17613f-ef03-4a04-abcf-4df8bf8dcec5 None None] Getting domain capabilities for microblazeel via machine types: {None} {{(pid=75229) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 09:39:50 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-dc17613f-ef03-4a04-abcf-4df8bf8dcec5 None None] Error from libvirt when retrieving domain capabilities for arch microblazeel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblazeel' on this host {{(pid=75229) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 09:39:50 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-dc17613f-ef03-4a04-abcf-4df8bf8dcec5 None None] Getting domain capabilities for mips via machine types: {None} {{(pid=75229) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 09:39:50 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-dc17613f-ef03-4a04-abcf-4df8bf8dcec5 None None] Error from libvirt when retrieving domain capabilities for arch mips / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips' on this host {{(pid=75229) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 09:39:50 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-dc17613f-ef03-4a04-abcf-4df8bf8dcec5 None None] Getting domain capabilities for mipsel via machine types: {None} {{(pid=75229) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 09:39:50 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-dc17613f-ef03-4a04-abcf-4df8bf8dcec5 None None] Error from libvirt when retrieving domain capabilities for arch mipsel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mipsel' on this host {{(pid=75229) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 09:39:50 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-dc17613f-ef03-4a04-abcf-4df8bf8dcec5 None None] Getting domain capabilities for mips64 via machine types: {None} {{(pid=75229) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 09:39:50 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-dc17613f-ef03-4a04-abcf-4df8bf8dcec5 None None] Error from libvirt when retrieving domain capabilities for arch mips64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64' on this host {{(pid=75229) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 09:39:50 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-dc17613f-ef03-4a04-abcf-4df8bf8dcec5 None None] Getting domain capabilities for mips64el via machine types: {None} {{(pid=75229) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 09:39:50 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-dc17613f-ef03-4a04-abcf-4df8bf8dcec5 None None] Error from libvirt when retrieving domain capabilities for arch mips64el / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64el' on this host {{(pid=75229) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 09:39:50 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-dc17613f-ef03-4a04-abcf-4df8bf8dcec5 None None] Getting domain capabilities for ppc via machine types: {None} {{(pid=75229) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 09:39:50 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-dc17613f-ef03-4a04-abcf-4df8bf8dcec5 None None] Error from libvirt when retrieving domain capabilities for arch ppc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc' on this host {{(pid=75229) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 09:39:50 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-dc17613f-ef03-4a04-abcf-4df8bf8dcec5 None None] Getting domain capabilities for ppc64 via machine types: {'powernv', None, 'pseries'} {{(pid=75229) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 09:39:50 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-dc17613f-ef03-4a04-abcf-4df8bf8dcec5 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=75229) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 09:39:50 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-dc17613f-ef03-4a04-abcf-4df8bf8dcec5 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=75229) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 09:39:50 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-dc17613f-ef03-4a04-abcf-4df8bf8dcec5 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=75229) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 09:39:50 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-dc17613f-ef03-4a04-abcf-4df8bf8dcec5 None None] Getting domain capabilities for ppc64le via machine types: {'powernv', 'pseries'} {{(pid=75229) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 09:39:50 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-dc17613f-ef03-4a04-abcf-4df8bf8dcec5 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=75229) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 09:39:50 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-dc17613f-ef03-4a04-abcf-4df8bf8dcec5 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=75229) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 09:39:50 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-dc17613f-ef03-4a04-abcf-4df8bf8dcec5 None None] Getting domain capabilities for riscv32 via machine types: {None} {{(pid=75229) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 09:39:50 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-dc17613f-ef03-4a04-abcf-4df8bf8dcec5 None None] Error from libvirt when retrieving domain capabilities for arch riscv32 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv32' on this host {{(pid=75229) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 09:39:50 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-dc17613f-ef03-4a04-abcf-4df8bf8dcec5 None None] Getting domain capabilities for riscv64 via machine types: {None} {{(pid=75229) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 09:39:50 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-dc17613f-ef03-4a04-abcf-4df8bf8dcec5 None None] Error from libvirt when retrieving domain capabilities for arch riscv64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv64' on this host {{(pid=75229) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 09:39:50 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-dc17613f-ef03-4a04-abcf-4df8bf8dcec5 None None] Getting domain capabilities for s390x via machine types: {'s390-ccw-virtio'} {{(pid=75229) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 09:39:50 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-dc17613f-ef03-4a04-abcf-4df8bf8dcec5 None None] Error from libvirt when retrieving domain capabilities for arch s390x / virt_type kvm / machine_type s390-ccw-virtio: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-s390x' on this host {{(pid=75229) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 09:39:50 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-dc17613f-ef03-4a04-abcf-4df8bf8dcec5 None None] Getting domain capabilities for sh4 via machine types: {None} {{(pid=75229) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 09:39:50 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-dc17613f-ef03-4a04-abcf-4df8bf8dcec5 None None] Error from libvirt when retrieving domain capabilities for arch sh4 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4' on this host {{(pid=75229) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 09:39:50 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-dc17613f-ef03-4a04-abcf-4df8bf8dcec5 None None] Getting domain capabilities for sh4eb via machine types: {None} {{(pid=75229) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 09:39:50 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-dc17613f-ef03-4a04-abcf-4df8bf8dcec5 None None] Error from libvirt when retrieving domain capabilities for arch sh4eb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4eb' on this host {{(pid=75229) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 09:39:50 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-dc17613f-ef03-4a04-abcf-4df8bf8dcec5 None None] Getting domain capabilities for sparc via machine types: {None} {{(pid=75229) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 09:39:50 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-dc17613f-ef03-4a04-abcf-4df8bf8dcec5 None None] Error from libvirt when retrieving domain capabilities for arch sparc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc' on this host {{(pid=75229) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 09:39:50 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-dc17613f-ef03-4a04-abcf-4df8bf8dcec5 None None] Getting domain capabilities for sparc64 via machine types: {None} {{(pid=75229) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 09:39:50 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-dc17613f-ef03-4a04-abcf-4df8bf8dcec5 None None] Error from libvirt when retrieving domain capabilities for arch sparc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc64' on this host {{(pid=75229) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 09:39:50 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-dc17613f-ef03-4a04-abcf-4df8bf8dcec5 None None] Getting domain capabilities for x86_64 via machine types: {'ubuntu-q35', 'pc', 'ubuntu', 'q35'} {{(pid=75229) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 09:39:50 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-dc17613f-ef03-4a04-abcf-4df8bf8dcec5 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu-q35:
Nov 14 09:39:50 user nova-compute[75229]: <domainCapabilities>
Nov 14 09:39:50 user nova-compute[75229]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 14 09:39:50 user nova-compute[75229]:   <domain>kvm</domain>
Nov 14 09:39:50 user nova-compute[75229]:   <machine>pc-q35-jammy</machine>
Nov 14 09:39:50 user nova-compute[75229]:   <arch>x86_64</arch>
Nov 14 09:39:50 user nova-compute[75229]:   <vcpu max='288'/>
Nov 14 09:39:50 user nova-compute[75229]:   <iothreads supported='yes'/>
Nov 14 09:39:50 user nova-compute[75229]:   <os supported='yes'>
Nov 14 09:39:50 user nova-compute[75229]:     <enum name='firmware'>
Nov 14 09:39:50 user nova-compute[75229]:       <value>efi</value>
Nov 14 09:39:50 user nova-compute[75229]:     </enum>
Nov 14 09:39:50 user nova-compute[75229]:     <loader supported='yes'>
Nov 14 09:39:50 user nova-compute[75229]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Nov 14 09:39:50 user nova-compute[75229]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Nov 14 09:39:50 user nova-compute[75229]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 14 09:39:50 user nova-compute[75229]:       <enum name='type'>
Nov 14 09:39:50 user nova-compute[75229]:         <value>rom</value>
Nov 14 09:39:50 user nova-compute[75229]:         <value>pflash</value>
Nov 14 09:39:50 user nova-compute[75229]:       </enum>
Nov 14 09:39:50 user nova-compute[75229]:       <enum name='readonly'>
Nov 14 09:39:50 user nova-compute[75229]:         <value>yes</value>
Nov 14 09:39:50 user nova-compute[75229]:         <value>no</value>
Nov 14 09:39:50 user nova-compute[75229]:       </enum>
Nov 14 09:39:50 user nova-compute[75229]:       <enum name='secure'>
Nov 14 09:39:50 user nova-compute[75229]:         <value>yes</value>
Nov 14 09:39:50 user nova-compute[75229]:         <value>no</value>
Nov 14 09:39:50 user nova-compute[75229]:       </enum>
Nov 14 09:39:50 user nova-compute[75229]:     </loader>
Nov 14 09:39:50 user nova-compute[75229]:   </os>
Nov 14 09:39:50 user nova-compute[75229]:   <cpu>
Nov 14 09:39:50 user nova-compute[75229]:     <mode name='host-passthrough' supported='yes'>
Nov 14 09:39:50 user nova-compute[75229]:       <enum name='hostPassthroughMigratable'>
Nov 14 09:39:50 user nova-compute[75229]:         <value>on</value>
Nov 14 09:39:50 user nova-compute[75229]:         <value>off</value>
Nov 14 09:39:50 user nova-compute[75229]:       </enum>
Nov 14 09:39:50 user nova-compute[75229]:     </mode>
Nov 14 09:39:50 user nova-compute[75229]:     <mode name='maximum' supported='yes'>
Nov 14 09:39:50 user nova-compute[75229]:       <enum name='maximumMigratable'>
Nov 14 09:39:50 user nova-compute[75229]:         <value>on</value>
Nov 14 09:39:50 user nova-compute[75229]:         <value>off</value>
Nov 14 09:39:50 user nova-compute[75229]:       </enum>
Nov 14 09:39:50 user nova-compute[75229]:     </mode>
Nov 14 09:39:50 user nova-compute[75229]:     <mode name='host-model' supported='yes'>
Nov 14 09:39:50 user nova-compute[75229]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 14 09:39:50 user nova-compute[75229]:       <vendor>Intel</vendor>
Nov 14 09:39:50 user nova-compute[75229]:       <feature policy='require' name='ss'/>
Nov 14 09:39:50 user nova-compute[75229]:       <feature policy='require' name='vmx'/>
Nov 14 09:39:50 user nova-compute[75229]:       <feature policy='require' name='pcid'/>
Nov 14 09:39:50 user nova-compute[75229]:       <feature policy='require' name='hypervisor'/>
Nov 14 09:39:50 user nova-compute[75229]:       <feature policy='require' name='arat'/>
Nov 14 09:39:50 user nova-compute[75229]:       <feature policy='require' name='tsc_adjust'/>
Nov 14 09:39:50 user nova-compute[75229]:       <feature policy='require' name='umip'/>
Nov 14 09:39:50 user nova-compute[75229]:       <feature policy='require' name='md-clear'/>
Nov 14 09:39:50 user nova-compute[75229]:       <feature policy='require' name='stibp'/>
Nov 14 09:39:50 user nova-compute[75229]:       <feature policy='require' name='arch-capabilities'/>
Nov 14 09:39:50 user nova-compute[75229]:       <feature policy='require' name='ssbd'/>
Nov 14 09:39:50 user nova-compute[75229]:       <feature policy='require' name='invtsc'/>
Nov 14 09:39:50 user nova-compute[75229]:       <feature policy='require' name='ibpb'/>
Nov 14 09:39:50 user nova-compute[75229]:       <feature policy='require' name='ibrs'/>
Nov 14 09:39:50 user nova-compute[75229]:       <feature policy='require' name='amd-stibp'/>
Nov 14 09:39:50 user nova-compute[75229]:       <feature policy='require' name='amd-ssbd'/>
Nov 14 09:39:50 user nova-compute[75229]:       <feature policy='require' name='rsba'/>
Nov 14 09:39:50 user nova-compute[75229]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 14 09:39:50 user nova-compute[75229]:       <feature policy='require' name='pschange-mc-no'/>
Nov 14 09:39:50 user nova-compute[75229]:       <feature policy='disable' name='erms'/>
Nov 14 09:39:50 user nova-compute[75229]:       <feature policy='disable' name='xsaveopt'/>
Nov 14 09:39:50 user nova-compute[75229]:     </mode>
Nov 14 09:39:50 user nova-compute[75229]:     <mode name='custom' supported='yes'>
Nov 14 09:39:50 user nova-compute[75229]:       <model usable='no'>qemu64</model>
Nov 14 09:39:50 user nova-compute[75229]:       <model usable='yes'>qemu32</model>
Nov 14 09:39:50 user nova-compute[75229]:       <model usable='no'>phenom</model>
Nov 14 09:39:50 user nova-compute[75229]:       <model usable='yes'>pentium3</model>
Nov 14 09:39:50 user nova-compute[75229]:       <model usable='yes'>pentium2</model>
Nov 14 09:39:50 user nova-compute[75229]:       <model usable='yes'>pentium</model>
Nov 14 09:39:50 user nova-compute[75229]:       <model usable='no'>n270</model>
Nov 14 09:39:50 user nova-compute[75229]:       <model usable='yes'>kvm64</model>
Nov 14 09:39:50 user nova-compute[75229]:       <model usable='yes'>kvm32</model>
Nov 14 09:39:50 user nova-compute[75229]:       <model usable='yes'>coreduo</model>
Nov 14 09:39:50 user nova-compute[75229]:       <model usable='yes'>core2duo</model>
Nov 14 09:39:50 user nova-compute[75229]:       <model usable='no'>athlon</model>
Nov 14 09:39:50 user nova-compute[75229]:       <model usable='yes'>Westmere-IBRS</model>
Nov 14 09:39:50 user nova-compute[75229]:       <model usable='yes'>Westmere</model>
Nov 14 09:39:50 user nova-compute[75229]:       <model usable='no'>Snowridge</model>
Nov 14 09:39:50 user nova-compute[75229]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 14 09:39:50 user nova-compute[75229]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 14 09:39:50 user nova-compute[75229]:       <model usable='no'>Skylake-Server</model>
Nov 14 09:39:50 user nova-compute[75229]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 14 09:39:50 user nova-compute[75229]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 14 09:39:50 user nova-compute[75229]:       <model usable='no'>Skylake-Client</model>
Nov 14 09:39:50 user nova-compute[75229]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 14 09:39:50 user nova-compute[75229]:       <model usable='no'>SandyBridge</model>
Nov 14 09:39:50 user nova-compute[75229]:       <model usable='yes'>Penryn</model>
Nov 14 09:39:50 user nova-compute[75229]:       <model usable='no'>Opteron_G5</model>
Nov 14 09:39:50 user nova-compute[75229]:       <model usable='no'>Opteron_G4</model>
Nov 14 09:39:50 user nova-compute[75229]:       <model usable='no'>Opteron_G3</model>
Nov 14 09:39:50 user nova-compute[75229]:       <model usable='no'>Opteron_G2</model>
Nov 14 09:39:50 user nova-compute[75229]:       <model usable='yes'>Opteron_G1</model>
Nov 14 09:39:50 user nova-compute[75229]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 14 09:39:50 user nova-compute[75229]:       <model usable='yes'>Nehalem</model>
Nov 14 09:39:50 user nova-compute[75229]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 14 09:39:50 user nova-compute[75229]:       <model usable='no'>IvyBridge</model>
Nov 14 09:39:50 user nova-compute[75229]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 14 09:39:50 user nova-compute[75229]:       <model usable='no'>Icelake-Server</model>
Nov 14 09:39:50 user nova-compute[75229]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 14 09:39:50 user nova-compute[75229]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 14 09:39:50 user nova-compute[75229]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 14 09:39:50 user nova-compute[75229]:       <model usable='no'>Haswell-noTSX</model>
Nov 14 09:39:50 user nova-compute[75229]:       <model usable='no'>Haswell-IBRS</model>
Nov 14 09:39:50 user nova-compute[75229]:       <model usable='no'>Haswell</model>
Nov 14 09:39:50 user nova-compute[75229]:       <model usable='no'>EPYC-Rome</model>
Nov 14 09:39:50 user nova-compute[75229]:       <model usable='no'>EPYC-Milan</model>
Nov 14 09:39:50 user nova-compute[75229]:       <model usable='no'>EPYC-IBPB</model>
Nov 14 09:39:50 user nova-compute[75229]:       <model usable='no'>EPYC</model>
Nov 14 09:39:50 user nova-compute[75229]:       <model usable='no'>Dhyana</model>
Nov 14 09:39:50 user nova-compute[75229]:       <model usable='no'>Cooperlake</model>
Nov 14 09:39:50 user nova-compute[75229]:       <model usable='yes'>Conroe</model>
Nov 14 09:39:50 user nova-compute[75229]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 14 09:39:50 user nova-compute[75229]:       <model usable='no'>Cascadelake-Server</model>
Nov 14 09:39:50 user nova-compute[75229]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 14 09:39:50 user nova-compute[75229]:       <model usable='no'>Broadwell-noTSX</model>
Nov 14 09:39:50 user nova-compute[75229]:       <model usable='no'>Broadwell-IBRS</model>
Nov 14 09:39:50 user nova-compute[75229]:       <model usable='no'>Broadwell</model>
Nov 14 09:39:50 user nova-compute[75229]:       <model usable='yes'>486</model>
Nov 14 09:39:50 user nova-compute[75229]:     </mode>
Nov 14 09:39:50 user nova-compute[75229]:   </cpu>
Nov 14 09:39:50 user nova-compute[75229]:   <memoryBacking supported='yes'>
Nov 14 09:39:50 user nova-compute[75229]:     <enum name='sourceType'>
Nov 14 09:39:50 user nova-compute[75229]:       <value>file</value>
Nov 14 09:39:50 user nova-compute[75229]:       <value>anonymous</value>
Nov 14 09:39:50 user nova-compute[75229]:       <value>memfd</value>
Nov 14 09:39:50 user nova-compute[75229]:     </enum>
Nov 14 09:39:50 user nova-compute[75229]:   </memoryBacking>
Nov 14 09:39:50 user nova-compute[75229]:   <devices>
Nov 14 09:39:50 user nova-compute[75229]:     <disk supported='yes'>
Nov 14 09:39:50 user nova-compute[75229]:       <enum name='diskDevice'>
Nov 14 09:39:50 user nova-compute[75229]:         <value>disk</value>
Nov 14 09:39:50 user nova-compute[75229]:         <value>cdrom</value>
Nov 14 09:39:50 user nova-compute[75229]:         <value>floppy</value>
Nov 14 09:39:50 user nova-compute[75229]:         <value>lun</value>
Nov 14 09:39:50 user nova-compute[75229]:       </enum>
Nov 14 09:39:50 user nova-compute[75229]:       <enum name='bus'>
Nov 14 09:39:50 user nova-compute[75229]:         <value>fdc</value>
Nov 14 09:39:50 user nova-compute[75229]:         <value>scsi</value>
Nov 14 09:39:50 user nova-compute[75229]:         <value>virtio</value>
Nov 14 09:39:50 user nova-compute[75229]:         <value>usb</value>
Nov 14 09:39:50 user nova-compute[75229]:         <value>sata</value>
Nov 14 09:39:50 user nova-compute[75229]:       </enum>
Nov 14 09:39:50 user nova-compute[75229]:       <enum name='model'>
Nov 14 09:39:50 user nova-compute[75229]:         <value>virtio</value>
Nov 14 09:39:50 user nova-compute[75229]:         <value>virtio-transitional</value>
Nov 14 09:39:50 user nova-compute[75229]:         <value>virtio-non-transitional</value>
Nov 14 09:39:50 user nova-compute[75229]:       </enum>
Nov 14 09:39:50 user nova-compute[75229]:     </disk>
Nov 14 09:39:50 user nova-compute[75229]:     <graphics supported='yes'>
Nov 14 09:39:50 user nova-compute[75229]:       <enum name='type'>
Nov 14 09:39:50 user nova-compute[75229]:         <value>sdl</value>
Nov 14 09:39:50 user nova-compute[75229]:         <value>vnc</value>
Nov 14 09:39:50 user nova-compute[75229]:         <value>spice</value>
Nov 14 09:39:50 user nova-compute[75229]:         <value>egl-headless</value>
Nov 14 09:39:50 user nova-compute[75229]:       </enum>
Nov 14 09:39:50 user nova-compute[75229]:     </graphics>
Nov 14 09:39:50 user nova-compute[75229]:     <video supported='yes'>
Nov 14 09:39:50 user nova-compute[75229]:       <enum name='modelType'>
Nov 14 09:39:50 user nova-compute[75229]:         <value>vga</value>
Nov 14 09:39:50 user nova-compute[75229]:         <value>cirrus</value>
Nov 14 09:39:50 user nova-compute[75229]:         <value>vmvga</value>
Nov 14 09:39:50 user nova-compute[75229]:         <value>qxl</value>
Nov 14 09:39:50 user nova-compute[75229]:         <value>virtio</value>
Nov 14 09:39:50 user nova-compute[75229]:         <value>none</value>
Nov 14 09:39:50 user nova-compute[75229]:         <value>bochs</value>
Nov 14 09:39:50 user nova-compute[75229]:         <value>ramfb</value>
Nov 14 09:39:50 user nova-compute[75229]:       </enum>
Nov 14 09:39:50 user nova-compute[75229]:     </video>
Nov 14 09:39:50 user nova-compute[75229]:     <hostdev supported='yes'>
Nov 14 09:39:50 user nova-compute[75229]:       <enum name='mode'>
Nov 14 09:39:50 user nova-compute[75229]:         <value>subsystem</value>
Nov 14 09:39:50 user nova-compute[75229]:       </enum>
Nov 14 09:39:50 user nova-compute[75229]:       <enum name='startupPolicy'>
Nov 14 09:39:50 user nova-compute[75229]:         <value>default</value>
Nov 14 09:39:50 user nova-compute[75229]:         <value>mandatory</value>
Nov 14 09:39:50 user nova-compute[75229]:         <value>requisite</value>
Nov 14 09:39:50 user nova-compute[75229]:         <value>optional</value>
Nov 14 09:39:50 user nova-compute[75229]:       </enum>
Nov 14 09:39:50 user nova-compute[75229]:       <enum name='subsysType'>
Nov 14 09:39:50 user nova-compute[75229]:         <value>usb</value>
Nov 14 09:39:50 user nova-compute[75229]:         <value>pci</value>
Nov 14 09:39:50 user nova-compute[75229]:         <value>scsi</value>
Nov 14 09:39:50 user nova-compute[75229]:       </enum>
Nov 14 09:39:50 user nova-compute[75229]:       <enum name='capsType'/>
Nov 14 09:39:50 user nova-compute[75229]:       <enum name='pciBackend'/>
Nov 14 09:39:50 user nova-compute[75229]:     </hostdev>
Nov 14 09:39:50 user nova-compute[75229]:     <rng supported='yes'>
Nov 14 09:39:50 user nova-compute[75229]:       <enum name='model'>
Nov 14 09:39:50 user nova-compute[75229]:         <value>virtio</value>
Nov 14 09:39:50 user nova-compute[75229]:         <value>virtio-transitional</value>
Nov 14 09:39:50 user nova-compute[75229]:         <value>virtio-non-transitional</value>
Nov 14 09:39:50 user nova-compute[75229]:       </enum>
Nov 14 09:39:50 user nova-compute[75229]:       <enum name='backendModel'>
Nov 14 09:39:50 user nova-compute[75229]:         <value>random</value>
Nov 14 09:39:50 user nova-compute[75229]:         <value>egd</value>
Nov 14 09:39:50 user nova-compute[75229]:         <value>builtin</value>
Nov 14 09:39:50 user nova-compute[75229]:       </enum>
Nov 14 09:39:50 user nova-compute[75229]:     </rng>
Nov 14 09:39:50 user nova-compute[75229]:     <filesystem supported='yes'>
Nov 14 09:39:50 user nova-compute[75229]:       <enum name='driverType'>
Nov 14 09:39:50 user nova-compute[75229]:         <value>path</value>
Nov 14 09:39:50 user nova-compute[75229]:         <value>handle</value>
Nov 14 09:39:50 user nova-compute[75229]:         <value>virtiofs</value>
Nov 14 09:39:50 user nova-compute[75229]:       </enum>
Nov 14 09:39:50 user nova-compute[75229]:     </filesystem>
Nov 14 09:39:50 user nova-compute[75229]:     <tpm supported='yes'>
Nov 14 09:39:50 user nova-compute[75229]:       <enum name='model'>
Nov 14 09:39:50 user nova-compute[75229]:         <value>tpm-tis</value>
Nov 14 09:39:50 user nova-compute[75229]:         <value>tpm-crb</value>
Nov 14 09:39:50 user nova-compute[75229]:       </enum>
Nov 14 09:39:50 user nova-compute[75229]:       <enum name='backendModel'>
Nov 14 09:39:50 user nova-compute[75229]:         <value>passthrough</value>
Nov 14 09:39:50 user nova-compute[75229]:         <value>emulator</value>
Nov 14 09:39:50 user nova-compute[75229]:       </enum>
Nov 14 09:39:50 user nova-compute[75229]:     </tpm>
Nov 14 09:39:50 user nova-compute[75229]:   </devices>
Nov 14 09:39:50 user nova-compute[75229]:   <features>
Nov 14 09:39:50 user nova-compute[75229]:     <gic supported='no'/>
Nov 14 09:39:50 user nova-compute[75229]:     <vmcoreinfo supported='yes'/>
Nov 14 09:39:50 user nova-compute[75229]:     <genid supported='yes'/>
Nov 14 09:39:50 user nova-compute[75229]:     <backingStoreInput supported='yes'/>
Nov 14 09:39:50 user nova-compute[75229]:     <backup supported='yes'/>
Nov 14 09:39:50 user nova-compute[75229]:     <sev supported='no'/>
Nov 14 09:39:50 user nova-compute[75229]:   </features>
Nov 14 09:39:50 user nova-compute[75229]: </domainCapabilities>
Nov 14 09:39:50 user nova-compute[75229]:  {{(pid=75229) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 14 09:39:50 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-dc17613f-ef03-4a04-abcf-4df8bf8dcec5 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=pc:
Nov 14 09:39:50 user nova-compute[75229]: <domainCapabilities>
Nov 14 09:39:50 user nova-compute[75229]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 14 09:39:50 user nova-compute[75229]:   <domain>kvm</domain>
Nov 14 09:39:50 user nova-compute[75229]:   <machine>pc-i440fx-6.2</machine>
Nov 14 09:39:50 user nova-compute[75229]:   <arch>x86_64</arch>
Nov 14 09:39:50 user nova-compute[75229]:   <vcpu max='255'/>
Nov 14 09:39:50 user nova-compute[75229]:   <iothreads supported='yes'/>
Nov 14 09:39:50 user nova-compute[75229]:   <os supported='yes'>
Nov 14 09:39:50 user nova-compute[75229]:     <enum name='firmware'>
Nov 14 09:39:50 user nova-compute[75229]:       <value>efi</value>
Nov 14 09:39:50 user nova-compute[75229]:     </enum>
Nov 14 09:39:50 user nova-compute[75229]:     <loader supported='yes'>
Nov 14 09:39:50 user nova-compute[75229]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 14 09:39:50 user nova-compute[75229]:       <enum name='type'>
Nov 14 09:39:50 user nova-compute[75229]:         <value>rom</value>
Nov 14 09:39:50 user nova-compute[75229]:         <value>pflash</value>
Nov 14 09:39:50 user nova-compute[75229]:       </enum>
Nov 14 09:39:50 user nova-compute[75229]:       <enum name='readonly'>
Nov 14 09:39:50 user nova-compute[75229]:         <value>yes</value>
Nov 14 09:39:50 user nova-compute[75229]:         <value>no</value>
Nov 14 09:39:50 user nova-compute[75229]:       </enum>
Nov 14 09:39:50 user nova-compute[75229]:       <enum name='secure'>
Nov 14 09:39:50 user nova-compute[75229]:         <value>no</value>
Nov 14 09:39:50 user nova-compute[75229]:       </enum>
Nov 14 09:39:50 user nova-compute[75229]:     </loader>
Nov 14 09:39:50 user nova-compute[75229]:   </os>
Nov 14 09:39:50 user nova-compute[75229]:   <cpu>
Nov 14 09:39:50 user nova-compute[75229]:     <mode name='host-passthrough' supported='yes'>
Nov 14 09:39:50 user nova-compute[75229]:       <enum name='hostPassthroughMigratable'>
Nov 14 09:39:50 user nova-compute[75229]:         <value>on</value>
Nov 14 09:39:50 user nova-compute[75229]:         <value>off</value>
Nov 14 09:39:50 user nova-compute[75229]:       </enum>
Nov 14 09:39:50 user nova-compute[75229]:     </mode>
Nov 14 09:39:50 user nova-compute[75229]:     <mode name='maximum' supported='yes'>
Nov 14 09:39:50 user nova-compute[75229]:       <enum name='maximumMigratable'>
Nov 14 09:39:50 user nova-compute[75229]:         <value>on</value>
Nov 14 09:39:50 user nova-compute[75229]:         <value>off</value>
Nov 14 09:39:50 user nova-compute[75229]:       </enum>
Nov 14 09:39:50 user nova-compute[75229]:     </mode>
Nov 14 09:39:50 user nova-compute[75229]:     <mode name='host-model' supported='yes'>
Nov 14 09:39:50 user nova-compute[75229]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 14 09:39:50 user nova-compute[75229]:       <vendor>Intel</vendor>
Nov 14 09:39:50 user nova-compute[75229]:       <feature policy='require' name='ss'/>
Nov 14 09:39:50 user nova-compute[75229]:       <feature policy='require' name='vmx'/>
Nov 14 09:39:50 user nova-compute[75229]:       <feature policy='require' name='pcid'/>
Nov 14 09:39:50 user nova-compute[75229]:       <feature policy='require' name='hypervisor'/>
Nov 14 09:39:50 user nova-compute[75229]:       <feature policy='require' name='arat'/>
Nov 14 09:39:50 user nova-compute[75229]:       <feature policy='require' name='tsc_adjust'/>
Nov 14 09:39:50 user nova-compute[75229]:       <feature policy='require' name='umip'/>
Nov 14 09:39:50 user nova-compute[75229]:       <feature policy='require' name='md-clear'/>
Nov 14 09:39:50 user nova-compute[75229]:       <feature policy='require' name='stibp'/>
Nov 14 09:39:50 user nova-compute[75229]:       <feature policy='require' name='arch-capabilities'/>
Nov 14 09:39:50 user nova-compute[75229]:       <feature policy='require' name='ssbd'/>
Nov 14 09:39:50 user nova-compute[75229]:       <feature policy='require' name='invtsc'/>
Nov 14 09:39:50 user nova-compute[75229]:       <feature policy='require' name='ibpb'/>
Nov 14 09:39:50 user nova-compute[75229]:       <feature policy='require' name='ibrs'/>
Nov 14 09:39:50 user nova-compute[75229]:       <feature policy='require' name='amd-stibp'/>
Nov 14 09:39:50 user nova-compute[75229]:       <feature policy='require' name='amd-ssbd'/>
Nov 14 09:39:50 user nova-compute[75229]:       <feature policy='require' name='rsba'/>
Nov 14 09:39:50 user nova-compute[75229]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 14 09:39:50 user nova-compute[75229]:       <feature policy='require' name='pschange-mc-no'/>
Nov 14 09:39:50 user nova-compute[75229]:       <feature policy='disable' name='erms'/>
Nov 14 09:39:50 user nova-compute[75229]:       <feature policy='disable' name='xsaveopt'/>
Nov 14 09:39:50 user nova-compute[75229]:     </mode>
Nov 14 09:39:50 user nova-compute[75229]:     <mode name='custom' supported='yes'>
Nov 14 09:39:50 user nova-compute[75229]:       <model usable='no'>qemu64</model>
Nov 14 09:39:50 user nova-compute[75229]:       <model usable='yes'>qemu32</model>
Nov 14 09:39:50 user nova-compute[75229]:       <model usable='no'>phenom</model>
Nov 14 09:39:50 user nova-compute[75229]:       <model usable='yes'>pentium3</model>
Nov 14 09:39:50 user nova-compute[75229]:       <model usable='yes'>pentium2</model>
Nov 14 09:39:50 user nova-compute[75229]:       <model usable='yes'>pentium</model>
Nov 14 09:39:50 user nova-compute[75229]:       <model usable='no'>n270</model>
Nov 14 09:39:50 user nova-compute[75229]:       <model usable='yes'>kvm64</model>
Nov 14 09:39:50 user nova-compute[75229]:       <model usable='yes'>kvm32</model>
Nov 14 09:39:50 user nova-compute[75229]:       <model usable='yes'>coreduo</model>
Nov 14 09:39:50 user nova-compute[75229]:       <model usable='yes'>core2duo</model>
Nov 14 09:39:50 user nova-compute[75229]:       <model usable='no'>athlon</model>
Nov 14 09:39:50 user nova-compute[75229]:       <model usable='yes'>Westmere-IBRS</model>
Nov 14 09:39:50 user nova-compute[75229]:       <model usable='yes'>Westmere</model>
Nov 14 09:39:50 user nova-compute[75229]:       <model usable='no'>Snowridge</model>
Nov 14 09:39:50 user nova-compute[75229]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 14 09:39:50 user nova-compute[75229]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 14 09:39:50 user nova-compute[75229]:       <model usable='no'>Skylake-Server</model>
Nov 14 09:39:50 user nova-compute[75229]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 14 09:39:50 user nova-compute[75229]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 14 09:39:50 user nova-compute[75229]:       <model usable='no'>Skylake-Client</model>
Nov 14 09:39:50 user nova-compute[75229]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 14 09:39:50 user nova-compute[75229]:       <model usable='no'>SandyBridge</model>
Nov 14 09:39:50 user nova-compute[75229]:       <model usable='yes'>Penryn</model>
Nov 14 09:39:50 user nova-compute[75229]:       <model usable='no'>Opteron_G5</model>
Nov 14 09:39:50 user nova-compute[75229]:       <model usable='no'>Opteron_G4</model>
Nov 14 09:39:50 user nova-compute[75229]:       <model usable='no'>Opteron_G3</model>
Nov 14 09:39:50 user nova-compute[75229]:       <model usable='no'>Opteron_G2</model>
Nov 14 09:39:50 user nova-compute[75229]:       <model usable='yes'>Opteron_G1</model>
Nov 14 09:39:50 user nova-compute[75229]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 14 09:39:50 user nova-compute[75229]:       <model usable='yes'>Nehalem</model>
Nov 14 09:39:50 user nova-compute[75229]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 14 09:39:50 user nova-compute[75229]:       <model usable='no'>IvyBridge</model>
Nov 14 09:39:50 user nova-compute[75229]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 14 09:39:50 user nova-compute[75229]:       <model usable='no'>Icelake-Server</model>
Nov 14 09:39:50 user nova-compute[75229]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 14 09:39:50 user nova-compute[75229]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 14 09:39:50 user nova-compute[75229]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 14 09:39:50 user nova-compute[75229]:       <model usable='no'>Haswell-noTSX</model>
Nov 14 09:39:50 user nova-compute[75229]:       <model usable='no'>Haswell-IBRS</model>
Nov 14 09:39:50 user nova-compute[75229]:       <model usable='no'>Haswell</model>
Nov 14 09:39:50 user nova-compute[75229]:       <model usable='no'>EPYC-Rome</model>
Nov 14 09:39:50 user nova-compute[75229]:       <model usable='no'>EPYC-Milan</model>
Nov 14 09:39:50 user nova-compute[75229]:       <model usable='no'>EPYC-IBPB</model>
Nov 14 09:39:50 user nova-compute[75229]:       <model usable='no'>EPYC</model>
Nov 14 09:39:50 user nova-compute[75229]:       <model usable='no'>Dhyana</model>
Nov 14 09:39:50 user nova-compute[75229]:       <model usable='no'>Cooperlake</model>
Nov 14 09:39:50 user nova-compute[75229]:       <model usable='yes'>Conroe</model>
Nov 14 09:39:50 user nova-compute[75229]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 14 09:39:50 user nova-compute[75229]:       <model usable='no'>Cascadelake-Server</model>
Nov 14 09:39:50 user nova-compute[75229]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 14 09:39:50 user nova-compute[75229]:       <model usable='no'>Broadwell-noTSX</model>
Nov 14 09:39:50 user nova-compute[75229]:       <model usable='no'>Broadwell-IBRS</model>
Nov 14 09:39:50 user nova-compute[75229]:       <model usable='no'>Broadwell</model>
Nov 14 09:39:50 user nova-compute[75229]:       <model usable='yes'>486</model>
Nov 14 09:39:50 user nova-compute[75229]:     </mode>
Nov 14 09:39:50 user nova-compute[75229]:   </cpu>
Nov 14 09:39:50 user nova-compute[75229]:   <memoryBacking supported='yes'>
Nov 14 09:39:50 user nova-compute[75229]:     <enum name='sourceType'>
Nov 14 09:39:50 user nova-compute[75229]:       <value>file</value>
Nov 14 09:39:50 user nova-compute[75229]:       <value>anonymous</value>
Nov 14 09:39:50 user nova-compute[75229]:       <value>memfd</value>
Nov 14 09:39:50 user nova-compute[75229]:     </enum>
Nov 14 09:39:50 user nova-compute[75229]:   </memoryBacking>
Nov 14 09:39:50 user nova-compute[75229]:   <devices>
Nov 14 09:39:50 user nova-compute[75229]:     <disk supported='yes'>
Nov 14 09:39:50 user nova-compute[75229]:       <enum name='diskDevice'>
Nov 14 09:39:50 user nova-compute[75229]:         <value>disk</value>
Nov 14 09:39:50 user nova-compute[75229]:         <value>cdrom</value>
Nov 14 09:39:50 user nova-compute[75229]:         <value>floppy</value>
Nov 14 09:39:50 user nova-compute[75229]:         <value>lun</value>
Nov 14 09:39:50 user nova-compute[75229]:       </enum>
Nov 14 09:39:50 user nova-compute[75229]:       <enum name='bus'>
Nov 14 09:39:50 user nova-compute[75229]:         <value>ide</value>
Nov 14 09:39:50 user nova-compute[75229]:         <value>fdc</value>
Nov 14 09:39:50 user nova-compute[75229]:         <value>scsi</value>
Nov 14 09:39:50 user nova-compute[75229]:         <value>virtio</value>
Nov 14 09:39:50 user nova-compute[75229]:         <value>usb</value>
Nov 14 09:39:50 user nova-compute[75229]:         <value>sata</value>
Nov 14 09:39:50 user nova-compute[75229]:       </enum>
Nov 14 09:39:50 user nova-compute[75229]:       <enum name='model'>
Nov 14 09:39:50 user nova-compute[75229]:         <value>virtio</value>
Nov 14 09:39:50 user nova-compute[75229]:         <value>virtio-transitional</value>
Nov 14 09:39:50 user nova-compute[75229]:         <value>virtio-non-transitional</value>
Nov 14 09:39:50 user nova-compute[75229]:       </enum>
Nov 14 09:39:50 user nova-compute[75229]:     </disk>
Nov 14 09:39:50 user nova-compute[75229]:     <graphics supported='yes'>
Nov 14 09:39:50 user nova-compute[75229]:       <enum name='type'>
Nov 14 09:39:50 user nova-compute[75229]:         <value>sdl</value>
Nov 14 09:39:50 user nova-compute[75229]:         <value>vnc</value>
Nov 14 09:39:50 user nova-compute[75229]:         <value>spice</value>
Nov 14 09:39:50 user nova-compute[75229]:         <value>egl-headless</value>
Nov 14 09:39:50 user nova-compute[75229]:       </enum>
Nov 14 09:39:50 user nova-compute[75229]:     </graphics>
Nov 14 09:39:50 user nova-compute[75229]:     <video supported='yes'>
Nov 14 09:39:50 user nova-compute[75229]:       <enum name='modelType'>
Nov 14 09:39:50 user nova-compute[75229]:         <value>vga</value>
Nov 14 09:39:50 user nova-compute[75229]:         <value>cirrus</value>
Nov 14 09:39:50 user nova-compute[75229]:         <value>vmvga</value>
Nov 14 09:39:50 user nova-compute[75229]:         <value>qxl</value>
Nov 14 09:39:50 user nova-compute[75229]:         <value>virtio</value>
Nov 14 09:39:50 user nova-compute[75229]:         <value>none</value>
Nov 14 09:39:50 user nova-compute[75229]:         <value>bochs</value>
Nov 14 09:39:50 user nova-compute[75229]:         <value>ramfb</value>
Nov 14 09:39:50 user nova-compute[75229]:       </enum>
Nov 14 09:39:50 user nova-compute[75229]:     </video>
Nov 14 09:39:50 user nova-compute[75229]:     <hostdev supported='yes'>
Nov 14 09:39:50 user nova-compute[75229]:       <enum name='mode'>
Nov 14 09:39:50 user nova-compute[75229]:         <value>subsystem</value>
Nov 14 09:39:50 user nova-compute[75229]:       </enum>
Nov 14 09:39:50 user nova-compute[75229]:       <enum name='startupPolicy'>
Nov 14 09:39:50 user nova-compute[75229]:         <value>default</value>
Nov 14 09:39:50 user nova-compute[75229]:         <value>mandatory</value>
Nov 14 09:39:50 user nova-compute[75229]:         <value>requisite</value>
Nov 14 09:39:50 user nova-compute[75229]:         <value>optional</value>
Nov 14 09:39:50 user nova-compute[75229]:       </enum>
Nov 14 09:39:50 user nova-compute[75229]:       <enum name='subsysType'>
Nov 14 09:39:50 user nova-compute[75229]:         <value>usb</value>
Nov 14 09:39:50 user nova-compute[75229]:         <value>pci</value>
Nov 14 09:39:50 user nova-compute[75229]:         <value>scsi</value>
Nov 14 09:39:50 user nova-compute[75229]:       </enum>
Nov 14 09:39:50 user nova-compute[75229]:       <enum name='capsType'/>
Nov 14 09:39:50 user nova-compute[75229]:       <enum name='pciBackend'/>
Nov 14 09:39:50 user nova-compute[75229]:     </hostdev>
Nov 14 09:39:50 user nova-compute[75229]:     <rng supported='yes'>
Nov 14 09:39:50 user nova-compute[75229]:       <enum name='model'>
Nov 14 09:39:50 user nova-compute[75229]:         <value>virtio</value>
Nov 14 09:39:50 user nova-compute[75229]:         <value>virtio-transitional</value>
Nov 14 09:39:50 user nova-compute[75229]:         <value>virtio-non-transitional</value>
Nov 14 09:39:50 user nova-compute[75229]:       </enum>
Nov 14 09:39:50 user nova-compute[75229]:       <enum name='backendModel'>
Nov 14 09:39:50 user nova-compute[75229]:         <value>random</value>
Nov 14 09:39:50 user nova-compute[75229]:         <value>egd</value>
Nov 14 09:39:50 user nova-compute[75229]:         <value>builtin</value>
Nov 14 09:39:50 user nova-compute[75229]:       </enum>
Nov 14 09:39:50 user nova-compute[75229]:     </rng>
Nov 14 09:39:50 user nova-compute[75229]:     <filesystem supported='yes'>
Nov 14 09:39:50 user nova-compute[75229]:       <enum name='driverType'>
Nov 14 09:39:50 user nova-compute[75229]:         <value>path</value>
Nov 14 09:39:50 user nova-compute[75229]:         <value>handle</value>
Nov 14 09:39:50 user nova-compute[75229]:         <value>virtiofs</value>
Nov 14 09:39:50 user nova-compute[75229]:       </enum>
Nov 14 09:39:50 user nova-compute[75229]:     </filesystem>
Nov 14 09:39:50 user nova-compute[75229]:     <tpm supported='yes'>
Nov 14 09:39:50 user nova-compute[75229]:       <enum name='model'>
Nov 14 09:39:50 user nova-compute[75229]:         <value>tpm-tis</value>
Nov 14 09:39:50 user nova-compute[75229]:         <value>tpm-crb</value>
Nov 14 09:39:50 user nova-compute[75229]:       </enum>
Nov 14 09:39:50 user nova-compute[75229]:       <enum name='backendModel'>
Nov 14 09:39:50 user nova-compute[75229]:         <value>passthrough</value>
Nov 14 09:39:50 user nova-compute[75229]:         <value>emulator</value>
Nov 14 09:39:50 user nova-compute[75229]:       </enum>
Nov 14 09:39:50 user nova-compute[75229]:     </tpm>
Nov 14 09:39:50 user nova-compute[75229]:   </devices>
Nov 14 09:39:50 user nova-compute[75229]:   <features>
Nov 14 09:39:50 user nova-compute[75229]:     <gic supported='no'/>
Nov 14 09:39:50 user nova-compute[75229]:     <vmcoreinfo supported='yes'/>
Nov 14 09:39:50 user nova-compute[75229]:     <genid supported='yes'/>
Nov 14 09:39:50 user nova-compute[75229]:     <backingStoreInput supported='yes'/>
Nov 14 09:39:50 user nova-compute[75229]:     <backup supported='yes'/>
Nov 14 09:39:50 user nova-compute[75229]:     <sev supported='no'/>
Nov 14 09:39:50 user nova-compute[75229]:   </features>
Nov 14 09:39:50 user nova-compute[75229]: </domainCapabilities>
Nov 14 09:39:50 user nova-compute[75229]:  {{(pid=75229) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 14 09:39:50 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-dc17613f-ef03-4a04-abcf-4df8bf8dcec5 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu:
Nov 14 09:39:50 user nova-compute[75229]: <domainCapabilities>
Nov 14 09:39:50 user nova-compute[75229]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 14 09:39:50 user nova-compute[75229]:   <domain>kvm</domain>
Nov 14 09:39:50 user nova-compute[75229]:   <machine>pc-i440fx-jammy</machine>
Nov 14 09:39:50 user nova-compute[75229]:   <arch>x86_64</arch>
Nov 14 09:39:50 user nova-compute[75229]:   <vcpu max='255'/>
Nov 14 09:39:50 user nova-compute[75229]:   <iothreads supported='yes'/>
Nov 14 09:39:50 user nova-compute[75229]:   <os supported='yes'>
Nov 14 09:39:50 user nova-compute[75229]:     <enum name='firmware'>
Nov 14 09:39:50 user nova-compute[75229]:       <value>efi</value>
Nov 14 09:39:50 user nova-compute[75229]:     </enum>
Nov 14 09:39:50 user nova-compute[75229]:     <loader supported='yes'>
Nov 14 09:39:50 user nova-compute[75229]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 14 09:39:50 user nova-compute[75229]:       <enum name='type'>
Nov 14 09:39:50 user nova-compute[75229]:         <value>rom</value>
Nov 14 09:39:50 user nova-compute[75229]:         <value>pflash</value>
Nov 14 09:39:50 user nova-compute[75229]:       </enum>
Nov 14 09:39:50 user nova-compute[75229]:       <enum name='readonly'>
Nov 14 09:39:50 user nova-compute[75229]:         <value>yes</value>
Nov 14 09:39:50 user nova-compute[75229]:         <value>no</value>
Nov 14 09:39:50 user nova-compute[75229]:       </enum>
Nov 14 09:39:50 user nova-compute[75229]:       <enum name='secure'>
Nov 14 09:39:50 user nova-compute[75229]:         <value>no</value>
Nov 14 09:39:50 user nova-compute[75229]:       </enum>
Nov 14 09:39:50 user nova-compute[75229]:     </loader>
Nov 14 09:39:50 user nova-compute[75229]:   </os>
Nov 14 09:39:50 user nova-compute[75229]:   <cpu>
Nov 14 09:39:50 user nova-compute[75229]:     <mode name='host-passthrough' supported='yes'>
Nov 14 09:39:50 user nova-compute[75229]:       <enum name='hostPassthroughMigratable'>
Nov 14 09:39:50 user nova-compute[75229]:         <value>on</value>
Nov 14 09:39:50 user nova-compute[75229]:         <value>off</value>
Nov 14 09:39:50 user nova-compute[75229]:       </enum>
Nov 14 09:39:50 user nova-compute[75229]:     </mode>
Nov 14 09:39:50 user nova-compute[75229]:     <mode name='maximum' supported='yes'>
Nov 14 09:39:50 user nova-compute[75229]:       <enum name='maximumMigratable'>
Nov 14 09:39:50 user nova-compute[75229]:         <value>on</value>
Nov 14 09:39:50 user nova-compute[75229]:         <value>off</value>
Nov 14 09:39:50 user nova-compute[75229]:       </enum>
Nov 14 09:39:50 user nova-compute[75229]:     </mode>
Nov 14 09:39:50 user nova-compute[75229]:     <mode name='host-model' supported='yes'>
Nov 14 09:39:50 user nova-compute[75229]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 14 09:39:50 user nova-compute[75229]:       <vendor>Intel</vendor>
Nov 14 09:39:50 user nova-compute[75229]:       <feature policy='require' name='ss'/>
Nov 14 09:39:50 user nova-compute[75229]:       <feature policy='require' name='vmx'/>
Nov 14 09:39:50 user nova-compute[75229]:       <feature policy='require' name='pcid'/>
Nov 14 09:39:50 user nova-compute[75229]:       <feature policy='require' name='hypervisor'/>
Nov 14 09:39:50 user nova-compute[75229]:       <feature policy='require' name='arat'/>
Nov 14 09:39:50 user nova-compute[75229]:       <feature policy='require' name='tsc_adjust'/>
Nov 14 09:39:50 user nova-compute[75229]:       <feature policy='require' name='umip'/>
Nov 14 09:39:50 user nova-compute[75229]:       <feature policy='require' name='md-clear'/>
Nov 14 09:39:50 user nova-compute[75229]:       <feature policy='require' name='stibp'/>
Nov 14 09:39:50 user nova-compute[75229]:       <feature policy='require' name='arch-capabilities'/>
Nov 14 09:39:50 user nova-compute[75229]:       <feature policy='require' name='ssbd'/>
Nov 14 09:39:50 user nova-compute[75229]:       <feature policy='require' name='invtsc'/>
Nov 14 09:39:50 user nova-compute[75229]:       <feature policy='require' name='ibpb'/>
Nov 14 09:39:50 user nova-compute[75229]:       <feature policy='require' name='ibrs'/>
Nov 14 09:39:50 user nova-compute[75229]:       <feature policy='require' name='amd-stibp'/>
Nov 14 09:39:50 user nova-compute[75229]:       <feature policy='require' name='amd-ssbd'/>
Nov 14 09:39:50 user nova-compute[75229]:       <feature policy='require' name='rsba'/>
Nov 14 09:39:50 user nova-compute[75229]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 14 09:39:50 user nova-compute[75229]:       <feature policy='require' name='pschange-mc-no'/>
Nov 14 09:39:50 user nova-compute[75229]:       <feature policy='disable' name='erms'/>
Nov 14 09:39:50 user nova-compute[75229]:       <feature policy='disable' name='xsaveopt'/>
Nov 14 09:39:50 user nova-compute[75229]:     </mode>
Nov 14 09:39:50 user nova-compute[75229]:     <mode name='custom' supported='yes'>
Nov 14 09:39:50 user nova-compute[75229]:       <model usable='no'>qemu64</model>
Nov 14 09:39:50 user nova-compute[75229]:       <model usable='yes'>qemu32</model>
Nov 14 09:39:50 user nova-compute[75229]:       <model usable='no'>phenom</model>
Nov 14 09:39:50 user nova-compute[75229]:       <model usable='yes'>pentium3</model>
Nov 14 09:39:50 user nova-compute[75229]:       <model usable='yes'>pentium2</model>
Nov 14 09:39:50 user nova-compute[75229]:       <model usable='yes'>pentium</model>
Nov 14 09:39:50 user nova-compute[75229]:       <model usable='no'>n270</model>
Nov 14 09:39:50 user nova-compute[75229]:       <model usable='yes'>kvm64</model>
Nov 14 09:39:50 user nova-compute[75229]:       <model usable='yes'>kvm32</model>
Nov 14 09:39:50 user nova-compute[75229]:       <model usable='yes'>coreduo</model>
Nov 14 09:39:50 user nova-compute[75229]:       <model usable='yes'>core2duo</model>
Nov 14 09:39:50 user nova-compute[75229]:       <model usable='no'>athlon</model>
Nov 14 09:39:50 user nova-compute[75229]:       <model usable='yes'>Westmere-IBRS</model>
Nov 14 09:39:50 user nova-compute[75229]:       <model usable='yes'>Westmere</model>
Nov 14 09:39:50 user nova-compute[75229]:       <model usable='no'>Snowridge</model>
Nov 14 09:39:50 user nova-compute[75229]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 14 09:39:50 user nova-compute[75229]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 14 09:39:50 user nova-compute[75229]:       <model usable='no'>Skylake-Server</model>
Nov 14 09:39:50 user nova-compute[75229]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 14 09:39:50 user nova-compute[75229]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 14 09:39:50 user nova-compute[75229]:       <model usable='no'>Skylake-Client</model>
Nov 14 09:39:50 user nova-compute[75229]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 14 09:39:50 user nova-compute[75229]:       <model usable='no'>SandyBridge</model>
Nov 14 09:39:50 user nova-compute[75229]:       <model usable='yes'>Penryn</model>
Nov 14 09:39:50 user nova-compute[75229]:       <model usable='no'>Opteron_G5</model>
Nov 14 09:39:50 user nova-compute[75229]:       <model usable='no'>Opteron_G4</model>
Nov 14 09:39:50 user nova-compute[75229]:       <model usable='no'>Opteron_G3</model>
Nov 14 09:39:50 user nova-compute[75229]:       <model usable='no'>Opteron_G2</model>
Nov 14 09:39:50 user nova-compute[75229]:       <model usable='yes'>Opteron_G1</model>
Nov 14 09:39:50 user nova-compute[75229]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 14 09:39:50 user nova-compute[75229]:       <model usable='yes'>Nehalem</model>
Nov 14 09:39:50 user nova-compute[75229]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 14 09:39:50 user nova-compute[75229]:       <model usable='no'>IvyBridge</model>
Nov 14 09:39:50 user nova-compute[75229]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 14 09:39:50 user nova-compute[75229]:       <model usable='no'>Icelake-Server</model>
Nov 14 09:39:50 user nova-compute[75229]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 14 09:39:50 user nova-compute[75229]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 14 09:39:50 user nova-compute[75229]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 14 09:39:50 user nova-compute[75229]:       <model usable='no'>Haswell-noTSX</model>
Nov 14 09:39:50 user nova-compute[75229]:       <model usable='no'>Haswell-IBRS</model>
Nov 14 09:39:50 user nova-compute[75229]:       <model usable='no'>Haswell</model>
Nov 14 09:39:50 user nova-compute[75229]:       <model usable='no'>EPYC-Rome</model>
Nov 14 09:39:50 user nova-compute[75229]:       <model usable='no'>EPYC-Milan</model>
Nov 14 09:39:50 user nova-compute[75229]:       <model usable='no'>EPYC-IBPB</model>
Nov 14 09:39:50 user nova-compute[75229]:       <model usable='no'>EPYC</model>
Nov 14 09:39:50 user nova-compute[75229]:       <model usable='no'>Dhyana</model>
Nov 14 09:39:50 user nova-compute[75229]:       <model usable='no'>Cooperlake</model>
Nov 14 09:39:50 user nova-compute[75229]:       <model usable='yes'>Conroe</model>
Nov 14 09:39:50 user nova-compute[75229]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 14 09:39:50 user nova-compute[75229]:       <model usable='no'>Cascadelake-Server</model>
Nov 14 09:39:50 user nova-compute[75229]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 14 09:39:50 user nova-compute[75229]:       <model usable='no'>Broadwell-noTSX</model>
Nov 14 09:39:50 user nova-compute[75229]:       <model usable='no'>Broadwell-IBRS</model>
Nov 14 09:39:50 user nova-compute[75229]:       <model usable='no'>Broadwell</model>
Nov 14 09:39:50 user nova-compute[75229]:       <model usable='yes'>486</model>
Nov 14 09:39:50 user nova-compute[75229]:     </mode>
Nov 14 09:39:50 user nova-compute[75229]:   </cpu>
Nov 14 09:39:50 user nova-compute[75229]:   <memoryBacking supported='yes'>
Nov 14 09:39:50 user nova-compute[75229]:     <enum name='sourceType'>
Nov 14 09:39:50 user nova-compute[75229]:       <value>file</value>
Nov 14 09:39:50 user nova-compute[75229]:       <value>anonymous</value>
Nov 14 09:39:50 user nova-compute[75229]:       <value>memfd</value>
Nov 14 09:39:50 user nova-compute[75229]:     </enum>
Nov 14 09:39:50 user nova-compute[75229]:   </memoryBacking>
Nov 14 09:39:50 user nova-compute[75229]:   <devices>
Nov 14 09:39:50 user nova-compute[75229]:     <disk supported='yes'>
Nov 14 09:39:50 user nova-compute[75229]:       <enum name='diskDevice'>
Nov 14 09:39:50 user nova-compute[75229]:         <value>disk</value>
Nov 14 09:39:50 user nova-compute[75229]:         <value>cdrom</value>
Nov 14 09:39:50 user nova-compute[75229]:         <value>floppy</value>
Nov 14 09:39:50 user nova-compute[75229]:         <value>lun</value>
Nov 14 09:39:50 user nova-compute[75229]:       </enum>
Nov 14 09:39:50 user nova-compute[75229]:       <enum name='bus'>
Nov 14 09:39:50 user nova-compute[75229]:         <value>ide</value>
Nov 14 09:39:50 user nova-compute[75229]:         <value>fdc</value>
Nov 14 09:39:50 user nova-compute[75229]:         <value>scsi</value>
Nov 14 09:39:50 user nova-compute[75229]:         <value>virtio</value>
Nov 14 09:39:50 user nova-compute[75229]:         <value>usb</value>
Nov 14 09:39:50 user nova-compute[75229]:         <value>sata</value>
Nov 14 09:39:50 user nova-compute[75229]:       </enum>
Nov 14 09:39:50 user nova-compute[75229]:       <enum name='model'>
Nov 14 09:39:50 user nova-compute[75229]:         <value>virtio</value>
Nov 14 09:39:50 user nova-compute[75229]:         <value>virtio-transitional</value>
Nov 14 09:39:50 user nova-compute[75229]:         <value>virtio-non-transitional</value>
Nov 14 09:39:50 user nova-compute[75229]:       </enum>
Nov 14 09:39:50 user nova-compute[75229]:     </disk>
Nov 14 09:39:50 user nova-compute[75229]:     <graphics supported='yes'>
Nov 14 09:39:50 user nova-compute[75229]:       <enum name='type'>
Nov 14 09:39:50 user nova-compute[75229]:         <value>sdl</value>
Nov 14 09:39:50 user nova-compute[75229]:         <value>vnc</value>
Nov 14 09:39:50 user nova-compute[75229]:         <value>spice</value>
Nov 14 09:39:50 user nova-compute[75229]:         <value>egl-headless</value>
Nov 14 09:39:50 user nova-compute[75229]:       </enum>
Nov 14 09:39:50 user nova-compute[75229]:     </graphics>
Nov 14 09:39:50 user nova-compute[75229]:     <video supported='yes'>
Nov 14 09:39:50 user nova-compute[75229]:       <enum name='modelType'>
Nov 14 09:39:50 user nova-compute[75229]:         <value>vga</value>
Nov 14 09:39:50 user nova-compute[75229]:         <value>cirrus</value>
Nov 14 09:39:50 user nova-compute[75229]:         <value>vmvga</value>
Nov 14 09:39:50 user nova-compute[75229]:         <value>qxl</value>
Nov 14 09:39:50 user nova-compute[75229]:         <value>virtio</value>
Nov 14 09:39:50 user nova-compute[75229]:         <value>none</value>
Nov 14 09:39:50 user nova-compute[75229]:         <value>bochs</value>
Nov 14 09:39:50 user nova-compute[75229]:         <value>ramfb</value>
Nov 14 09:39:50 user nova-compute[75229]:       </enum>
Nov 14 09:39:50 user nova-compute[75229]:     </video>
Nov 14 09:39:50 user nova-compute[75229]:     <hostdev supported='yes'>
Nov 14 09:39:50 user nova-compute[75229]:       <enum name='mode'>
Nov 14 09:39:50 user nova-compute[75229]:         <value>subsystem</value>
Nov 14 09:39:50 user nova-compute[75229]:       </enum>
Nov 14 09:39:50 user nova-compute[75229]:       <enum name='startupPolicy'>
Nov 14 09:39:50 user nova-compute[75229]:         <value>default</value>
Nov 14 09:39:50 user nova-compute[75229]:         <value>mandatory</value>
Nov 14 09:39:50 user nova-compute[75229]:         <value>requisite</value>
Nov 14 09:39:50 user nova-compute[75229]:         <value>optional</value>
Nov 14 09:39:50 user nova-compute[75229]:       </enum>
Nov 14 09:39:50 user nova-compute[75229]:       <enum name='subsysType'>
Nov 14 09:39:50 user nova-compute[75229]:         <value>usb</value>
Nov 14 09:39:50 user nova-compute[75229]:         <value>pci</value>
Nov 14 09:39:50 user nova-compute[75229]:         <value>scsi</value>
Nov 14 09:39:50 user nova-compute[75229]:       </enum>
Nov 14 09:39:50 user nova-compute[75229]:       <enum name='capsType'/>
Nov 14 09:39:50 user nova-compute[75229]:       <enum name='pciBackend'/>
Nov 14 09:39:50 user nova-compute[75229]:     </hostdev>
Nov 14 09:39:50 user nova-compute[75229]:     <rng supported='yes'>
Nov 14 09:39:50 user nova-compute[75229]:       <enum name='model'>
Nov 14 09:39:50 user nova-compute[75229]:         <value>virtio</value>
Nov 14 09:39:50 user nova-compute[75229]:         <value>virtio-transitional</value>
Nov 14 09:39:50 user nova-compute[75229]:         <value>virtio-non-transitional</value>
Nov 14 09:39:50 user nova-compute[75229]:       </enum>
Nov 14 09:39:50 user nova-compute[75229]:       <enum name='backendModel'>
Nov 14 09:39:50 user nova-compute[75229]:         <value>random</value>
Nov 14 09:39:50 user nova-compute[75229]:         <value>egd</value>
Nov 14 09:39:50 user nova-compute[75229]:         <value>builtin</value>
Nov 14 09:39:50 user nova-compute[75229]:       </enum>
Nov 14 09:39:50 user nova-compute[75229]:     </rng>
Nov 14 09:39:50 user nova-compute[75229]:     <filesystem supported='yes'>
Nov 14 09:39:50 user nova-compute[75229]:       <enum name='driverType'>
Nov 14 09:39:50 user nova-compute[75229]:         <value>path</value>
Nov 14 09:39:50 user nova-compute[75229]:         <value>handle</value>
Nov 14 09:39:50 user nova-compute[75229]:         <value>virtiofs</value>
Nov 14 09:39:50 user nova-compute[75229]:       </enum>
Nov 14 09:39:50 user nova-compute[75229]:     </filesystem>
Nov 14 09:39:50 user nova-compute[75229]:     <tpm supported='yes'>
Nov 14 09:39:50 user nova-compute[75229]:       <enum name='model'>
Nov 14 09:39:50 user nova-compute[75229]:         <value>tpm-tis</value>
Nov 14 09:39:50 user nova-compute[75229]:         <value>tpm-crb</value>
Nov 14 09:39:50 user nova-compute[75229]:       </enum>
Nov 14 09:39:50 user nova-compute[75229]:       <enum name='backendModel'>
Nov 14 09:39:50 user nova-compute[75229]:         <value>passthrough</value>
Nov 14 09:39:50 user nova-compute[75229]:         <value>emulator</value>
Nov 14 09:39:50 user nova-compute[75229]:       </enum>
Nov 14 09:39:50 user nova-compute[75229]:     </tpm>
Nov 14 09:39:50 user nova-compute[75229]:   </devices>
Nov 14 09:39:50 user nova-compute[75229]:   <features>
Nov 14 09:39:50 user nova-compute[75229]:     <gic supported='no'/>
Nov 14 09:39:50 user nova-compute[75229]:     <vmcoreinfo supported='yes'/>
Nov 14 09:39:50 user nova-compute[75229]:     <genid supported='yes'/>
Nov 14 09:39:50 user nova-compute[75229]:     <backingStoreInput supported='yes'/>
Nov 14 09:39:50 user nova-compute[75229]:     <backup supported='yes'/>
Nov 14 09:39:50 user nova-compute[75229]:     <sev supported='no'/>
Nov 14 09:39:50 user nova-compute[75229]:   </features>
Nov 14 09:39:50 user nova-compute[75229]: </domainCapabilities>
Nov 14 09:39:50 user nova-compute[75229]:  {{(pid=75229) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 14 09:39:50 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-dc17613f-ef03-4a04-abcf-4df8bf8dcec5 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=q35:
Nov 14 09:39:50 user nova-compute[75229]: <domainCapabilities>
Nov 14 09:39:50 user nova-compute[75229]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 14 09:39:50 user nova-compute[75229]:   <domain>kvm</domain>
Nov 14 09:39:50 user nova-compute[75229]:   <machine>pc-q35-6.2</machine>
Nov 14 09:39:50 user nova-compute[75229]:   <arch>x86_64</arch>
Nov 14 09:39:50 user nova-compute[75229]:   <vcpu max='288'/>
Nov 14 09:39:50 user nova-compute[75229]:   <iothreads supported='yes'/>
Nov 14 09:39:50 user nova-compute[75229]:   <os supported='yes'>
Nov 14 09:39:50 user nova-compute[75229]:     <enum name='firmware'>
Nov 14 09:39:50 user nova-compute[75229]:       <value>efi</value>
Nov 14 09:39:50 user nova-compute[75229]:     </enum>
Nov 14 09:39:50 user nova-compute[75229]:     <loader supported='yes'>
Nov 14 09:39:50 user nova-compute[75229]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Nov 14 09:39:50 user nova-compute[75229]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Nov 14 09:39:50 user nova-compute[75229]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 14 09:39:50 user nova-compute[75229]:       <enum name='type'>
Nov 14 09:39:50 user nova-compute[75229]:         <value>rom</value>
Nov 14 09:39:50 user nova-compute[75229]:         <value>pflash</value>
Nov 14 09:39:50 user nova-compute[75229]:       </enum>
Nov 14 09:39:50 user nova-compute[75229]:       <enum name='readonly'>
Nov 14 09:39:50 user nova-compute[75229]:         <value>yes</value>
Nov 14 09:39:50 user nova-compute[75229]:         <value>no</value>
Nov 14 09:39:50 user nova-compute[75229]:       </enum>
Nov 14 09:39:50 user nova-compute[75229]:       <enum name='secure'>
Nov 14 09:39:50 user nova-compute[75229]:         <value>yes</value>
Nov 14 09:39:50 user nova-compute[75229]:         <value>no</value>
Nov 14 09:39:50 user nova-compute[75229]:       </enum>
Nov 14 09:39:50 user nova-compute[75229]:     </loader>
Nov 14 09:39:50 user nova-compute[75229]:   </os>
Nov 14 09:39:50 user nova-compute[75229]:   <cpu>
Nov 14 09:39:50 user nova-compute[75229]:     <mode name='host-passthrough' supported='yes'>
Nov 14 09:39:50 user nova-compute[75229]:       <enum name='hostPassthroughMigratable'>
Nov 14 09:39:50 user nova-compute[75229]:         <value>on</value>
Nov 14 09:39:50 user nova-compute[75229]:         <value>off</value>
Nov 14 09:39:50 user nova-compute[75229]:       </enum>
Nov 14 09:39:50 user nova-compute[75229]:     </mode>
Nov 14 09:39:50 user nova-compute[75229]:     <mode name='maximum' supported='yes'>
Nov 14 09:39:50 user nova-compute[75229]:       <enum name='maximumMigratable'>
Nov 14 09:39:50 user nova-compute[75229]:         <value>on</value>
Nov 14 09:39:50 user nova-compute[75229]:         <value>off</value>
Nov 14 09:39:50 user nova-compute[75229]:       </enum>
Nov 14 09:39:50 user nova-compute[75229]:     </mode>
Nov 14 09:39:50 user nova-compute[75229]:     <mode name='host-model' supported='yes'>
Nov 14 09:39:50 user nova-compute[75229]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 14 09:39:50 user nova-compute[75229]:       <vendor>Intel</vendor>
Nov 14 09:39:50 user nova-compute[75229]:       <feature policy='require' name='ss'/>
Nov 14 09:39:50 user nova-compute[75229]:       <feature policy='require' name='vmx'/>
Nov 14 09:39:50 user nova-compute[75229]:       <feature policy='require' name='pcid'/>
Nov 14 09:39:50 user nova-compute[75229]:       <feature policy='require' name='hypervisor'/>
Nov 14 09:39:50 user nova-compute[75229]:       <feature policy='require' name='arat'/>
Nov 14 09:39:50 user nova-compute[75229]:       <feature policy='require' name='tsc_adjust'/>
Nov 14 09:39:50 user nova-compute[75229]:       <feature policy='require' name='umip'/>
Nov 14 09:39:50 user nova-compute[75229]:       <feature policy='require' name='md-clear'/>
Nov 14 09:39:50 user nova-compute[75229]:       <feature policy='require' name='stibp'/>
Nov 14 09:39:50 user nova-compute[75229]:       <feature policy='require' name='arch-capabilities'/>
Nov 14 09:39:50 user nova-compute[75229]:       <feature policy='require' name='ssbd'/>
Nov 14 09:39:50 user nova-compute[75229]:       <feature policy='require' name='invtsc'/>
Nov 14 09:39:50 user nova-compute[75229]:       <feature policy='require' name='ibpb'/>
Nov 14 09:39:50 user nova-compute[75229]:       <feature policy='require' name='ibrs'/>
Nov 14 09:39:50 user nova-compute[75229]:       <feature policy='require' name='amd-stibp'/>
Nov 14 09:39:50 user nova-compute[75229]:       <feature policy='require' name='amd-ssbd'/>
Nov 14 09:39:50 user nova-compute[75229]:       <feature policy='require' name='rsba'/>
Nov 14 09:39:50 user nova-compute[75229]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 14 09:39:50 user nova-compute[75229]:       <feature policy='require' name='pschange-mc-no'/>
Nov 14 09:39:50 user nova-compute[75229]:       <feature policy='disable' name='erms'/>
Nov 14 09:39:50 user nova-compute[75229]:       <feature policy='disable' name='xsaveopt'/>
Nov 14 09:39:50 user nova-compute[75229]:     </mode>
Nov 14 09:39:50 user nova-compute[75229]:     <mode name='custom' supported='yes'>
Nov 14 09:39:50 user nova-compute[75229]:       <model usable='no'>qemu64</model>
Nov 14 09:39:50 user nova-compute[75229]:       <model usable='yes'>qemu32</model>
Nov 14 09:39:50 user nova-compute[75229]:       <model usable='no'>phenom</model>
Nov 14 09:39:50 user nova-compute[75229]:       <model usable='yes'>pentium3</model>
Nov 14 09:39:50 user nova-compute[75229]:       <model usable='yes'>pentium2</model>
Nov 14 09:39:50 user nova-compute[75229]:       <model usable='yes'>pentium</model>
Nov 14 09:39:50 user nova-compute[75229]:       <model usable='no'>n270</model>
Nov 14 09:39:50 user nova-compute[75229]:       <model usable='yes'>kvm64</model>
Nov 14 09:39:50 user nova-compute[75229]:       <model usable='yes'>kvm32</model>
Nov 14 09:39:50 user nova-compute[75229]:       <model usable='yes'>coreduo</model>
Nov 14 09:39:50 user nova-compute[75229]:       <model usable='yes'>core2duo</model>
Nov 14 09:39:50 user nova-compute[75229]:       <model usable='no'>athlon</model>
Nov 14 09:39:50 user nova-compute[75229]:       <model usable='yes'>Westmere-IBRS</model>
Nov 14 09:39:50 user nova-compute[75229]:       <model usable='yes'>Westmere</model>
Nov 14 09:39:50 user nova-compute[75229]:       <model usable='no'>Snowridge</model>
Nov 14 09:39:50 user nova-compute[75229]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 14 09:39:50 user nova-compute[75229]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 14 09:39:50 user nova-compute[75229]:       <model usable='no'>Skylake-Server</model>
Nov 14 09:39:50 user nova-compute[75229]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 14 09:39:50 user nova-compute[75229]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 14 09:39:50 user nova-compute[75229]:       <model usable='no'>Skylake-Client</model>
Nov 14 09:39:50 user nova-compute[75229]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 14 09:39:50 user nova-compute[75229]:       <model usable='no'>SandyBridge</model>
Nov 14 09:39:50 user nova-compute[75229]:       <model usable='yes'>Penryn</model>
Nov 14 09:39:50 user nova-compute[75229]:       <model usable='no'>Opteron_G5</model>
Nov 14 09:39:50 user nova-compute[75229]:       <model usable='no'>Opteron_G4</model>
Nov 14 09:39:50 user nova-compute[75229]:       <model usable='no'>Opteron_G3</model>
Nov 14 09:39:50 user nova-compute[75229]:       <model usable='no'>Opteron_G2</model>
Nov 14 09:39:50 user nova-compute[75229]:       <model usable='yes'>Opteron_G1</model>
Nov 14 09:39:50 user nova-compute[75229]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 14 09:39:50 user nova-compute[75229]:       <model usable='yes'>Nehalem</model>
Nov 14 09:39:50 user nova-compute[75229]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 14 09:39:50 user nova-compute[75229]:       <model usable='no'>IvyBridge</model>
Nov 14 09:39:50 user nova-compute[75229]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 14 09:39:50 user nova-compute[75229]:       <model usable='no'>Icelake-Server</model>
Nov 14 09:39:50 user nova-compute[75229]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 14 09:39:50 user nova-compute[75229]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 14 09:39:50 user nova-compute[75229]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 14 09:39:50 user nova-compute[75229]:       <model usable='no'>Haswell-noTSX</model>
Nov 14 09:39:50 user nova-compute[75229]:       <model usable='no'>Haswell-IBRS</model>
Nov 14 09:39:50 user nova-compute[75229]:       <model usable='no'>Haswell</model>
Nov 14 09:39:50 user nova-compute[75229]:       <model usable='no'>EPYC-Rome</model>
Nov 14 09:39:50 user nova-compute[75229]:       <model usable='no'>EPYC-Milan</model>
Nov 14 09:39:50 user nova-compute[75229]:       <model usable='no'>EPYC-IBPB</model>
Nov 14 09:39:50 user nova-compute[75229]:       <model usable='no'>EPYC</model>
Nov 14 09:39:50 user nova-compute[75229]:       <model usable='no'>Dhyana</model>
Nov 14 09:39:50 user nova-compute[75229]:       <model usable='no'>Cooperlake</model>
Nov 14 09:39:50 user nova-compute[75229]:       <model usable='yes'>Conroe</model>
Nov 14 09:39:50 user nova-compute[75229]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 14 09:39:50 user nova-compute[75229]:       <model usable='no'>Cascadelake-Server</model>
Nov 14 09:39:50 user nova-compute[75229]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 14 09:39:50 user nova-compute[75229]:       <model usable='no'>Broadwell-noTSX</model>
Nov 14 09:39:50 user nova-compute[75229]:       <model usable='no'>Broadwell-IBRS</model>
Nov 14 09:39:50 user nova-compute[75229]:       <model usable='no'>Broadwell</model>
Nov 14 09:39:50 user nova-compute[75229]:       <model usable='yes'>486</model>
Nov 14 09:39:50 user nova-compute[75229]:     </mode>
Nov 14 09:39:50 user nova-compute[75229]:   </cpu>
Nov 14 09:39:50 user nova-compute[75229]:   <memoryBacking supported='yes'>
Nov 14 09:39:50 user nova-compute[75229]:     <enum name='sourceType'>
Nov 14 09:39:50 user nova-compute[75229]:       <value>file</value>
Nov 14 09:39:50 user nova-compute[75229]:       <value>anonymous</value>
Nov 14 09:39:50 user nova-compute[75229]:       <value>memfd</value>
Nov 14 09:39:50 user nova-compute[75229]:     </enum>
Nov 14 09:39:50 user nova-compute[75229]:   </memoryBacking>
Nov 14 09:39:50 user nova-compute[75229]:   <devices>
Nov 14 09:39:50 user nova-compute[75229]:     <disk supported='yes'>
Nov 14 09:39:50 user nova-compute[75229]:       <enum name='diskDevice'>
Nov 14 09:39:50 user nova-compute[75229]:         <value>disk</value>
Nov 14 09:39:50 user nova-compute[75229]:         <value>cdrom</value>
Nov 14 09:39:50 user nova-compute[75229]:         <value>floppy</value>
Nov 14 09:39:50 user nova-compute[75229]:         <value>lun</value>
Nov 14 09:39:50 user nova-compute[75229]:       </enum>
Nov 14 09:39:50 user nova-compute[75229]:       <enum name='bus'>
Nov 14 09:39:50 user nova-compute[75229]:         <value>fdc</value>
Nov 14 09:39:50 user nova-compute[75229]:         <value>scsi</value>
Nov 14 09:39:50 user nova-compute[75229]:         <value>virtio</value>
Nov 14 09:39:50 user nova-compute[75229]:         <value>usb</value>
Nov 14 09:39:50 user nova-compute[75229]:         <value>sata</value>
Nov 14 09:39:50 user nova-compute[75229]:       </enum>
Nov 14 09:39:50 user nova-compute[75229]:       <enum name='model'>
Nov 14 09:39:50 user nova-compute[75229]:         <value>virtio</value>
Nov 14 09:39:50 user nova-compute[75229]:         <value>virtio-transitional</value>
Nov 14 09:39:50 user nova-compute[75229]:         <value>virtio-non-transitional</value>
Nov 14 09:39:50 user nova-compute[75229]:       </enum>
Nov 14 09:39:50 user nova-compute[75229]:     </disk>
Nov 14 09:39:50 user nova-compute[75229]:     <graphics supported='yes'>
Nov 14 09:39:50 user nova-compute[75229]:       <enum name='type'>
Nov 14 09:39:50 user nova-compute[75229]:         <value>sdl</value>
Nov 14 09:39:50 user nova-compute[75229]:         <value>vnc</value>
Nov 14 09:39:50 user nova-compute[75229]:         <value>spice</value>
Nov 14 09:39:50 user nova-compute[75229]:         <value>egl-headless</value>
Nov 14 09:39:50 user nova-compute[75229]:       </enum>
Nov 14 09:39:50 user nova-compute[75229]:     </graphics>
Nov 14 09:39:50 user nova-compute[75229]:     <video supported='yes'>
Nov 14 09:39:50 user nova-compute[75229]:       <enum name='modelType'>
Nov 14 09:39:50 user nova-compute[75229]:         <value>vga</value>
Nov 14 09:39:50 user nova-compute[75229]:         <value>cirrus</value>
Nov 14 09:39:50 user nova-compute[75229]:         <value>vmvga</value>
Nov 14 09:39:50 user nova-compute[75229]:         <value>qxl</value>
Nov 14 09:39:50 user nova-compute[75229]:         <value>virtio</value>
Nov 14 09:39:50 user nova-compute[75229]:         <value>none</value>
Nov 14 09:39:50 user nova-compute[75229]:         <value>bochs</value>
Nov 14 09:39:50 user nova-compute[75229]:         <value>ramfb</value>
Nov 14 09:39:50 user nova-compute[75229]:       </enum>
Nov 14 09:39:50 user nova-compute[75229]:     </video>
Nov 14 09:39:50 user nova-compute[75229]:     <hostdev supported='yes'>
Nov 14 09:39:50 user nova-compute[75229]:       <enum name='mode'>
Nov 14 09:39:50 user nova-compute[75229]:         <value>subsystem</value>
Nov 14 09:39:50 user nova-compute[75229]:       </enum>
Nov 14 09:39:50 user nova-compute[75229]:       <enum name='startupPolicy'>
Nov 14 09:39:50 user nova-compute[75229]:         <value>default</value>
Nov 14 09:39:50 user nova-compute[75229]:         <value>mandatory</value>
Nov 14 09:39:50 user nova-compute[75229]:         <value>requisite</value>
Nov 14 09:39:50 user nova-compute[75229]:         <value>optional</value>
Nov 14 09:39:50 user nova-compute[75229]:       </enum>
Nov 14 09:39:50 user nova-compute[75229]:       <enum name='subsysType'>
Nov 14 09:39:50 user nova-compute[75229]:         <value>usb</value>
Nov 14 09:39:50 user nova-compute[75229]:         <value>pci</value>
Nov 14 09:39:50 user nova-compute[75229]:         <value>scsi</value>
Nov 14 09:39:50 user nova-compute[75229]:       </enum>
Nov 14 09:39:50 user nova-compute[75229]:       <enum name='capsType'/>
Nov 14 09:39:50 user nova-compute[75229]:       <enum name='pciBackend'/>
Nov 14 09:39:50 user nova-compute[75229]:     </hostdev>
Nov 14 09:39:50 user nova-compute[75229]:     <rng supported='yes'>
Nov 14 09:39:50 user nova-compute[75229]:       <enum name='model'>
Nov 14 09:39:50 user nova-compute[75229]:         <value>virtio</value>
Nov 14 09:39:50 user nova-compute[75229]:         <value>virtio-transitional</value>
Nov 14 09:39:50 user nova-compute[75229]:         <value>virtio-non-transitional</value>
Nov 14 09:39:50 user nova-compute[75229]:       </enum>
Nov 14 09:39:50 user nova-compute[75229]:       <enum name='backendModel'>
Nov 14 09:39:50 user nova-compute[75229]:         <value>random</value>
Nov 14 09:39:50 user nova-compute[75229]:         <value>egd</value>
Nov 14 09:39:50 user nova-compute[75229]:         <value>builtin</value>
Nov 14 09:39:50 user nova-compute[75229]:       </enum>
Nov 14 09:39:50 user nova-compute[75229]:     </rng>
Nov 14 09:39:50 user nova-compute[75229]:     <filesystem supported='yes'>
Nov 14 09:39:50 user nova-compute[75229]:       <enum name='driverType'>
Nov 14 09:39:50 user nova-compute[75229]:         <value>path</value>
Nov 14 09:39:50 user nova-compute[75229]:         <value>handle</value>
Nov 14 09:39:50 user nova-compute[75229]:         <value>virtiofs</value>
Nov 14 09:39:50 user nova-compute[75229]:       </enum>
Nov 14 09:39:50 user nova-compute[75229]:     </filesystem>
Nov 14 09:39:50 user nova-compute[75229]:     <tpm supported='yes'>
Nov 14 09:39:50 user nova-compute[75229]:       <enum name='model'>
Nov 14 09:39:50 user nova-compute[75229]:         <value>tpm-tis</value>
Nov 14 09:39:50 user nova-compute[75229]:         <value>tpm-crb</value>
Nov 14 09:39:50 user nova-compute[75229]:       </enum>
Nov 14 09:39:50 user nova-compute[75229]:       <enum name='backendModel'>
Nov 14 09:39:50 user nova-compute[75229]:         <value>passthrough</value>
Nov 14 09:39:50 user nova-compute[75229]:         <value>emulator</value>
Nov 14 09:39:50 user nova-compute[75229]:       </enum>
Nov 14 09:39:50 user nova-compute[75229]:     </tpm>
Nov 14 09:39:50 user nova-compute[75229]:   </devices>
Nov 14 09:39:50 user nova-compute[75229]:   <features>
Nov 14 09:39:50 user nova-compute[75229]:     <gic supported='no'/>
Nov 14 09:39:50 user nova-compute[75229]:     <vmcoreinfo supported='yes'/>
Nov 14 09:39:50 user nova-compute[75229]:     <genid supported='yes'/>
Nov 14 09:39:50 user nova-compute[75229]:     <backingStoreInput supported='yes'/>
Nov 14 09:39:50 user nova-compute[75229]:     <backup supported='yes'/>
Nov 14 09:39:50 user nova-compute[75229]:     <sev supported='no'/>
Nov 14 09:39:50 user nova-compute[75229]:   </features>
Nov 14 09:39:50 user nova-compute[75229]: </domainCapabilities>
Nov 14 09:39:50 user nova-compute[75229]:  {{(pid=75229) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 14 09:39:50 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-dc17613f-ef03-4a04-abcf-4df8bf8dcec5 None None] Getting domain capabilities for xtensa via machine types: {None} {{(pid=75229) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 09:39:50 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-dc17613f-ef03-4a04-abcf-4df8bf8dcec5 None None] Error from libvirt when retrieving domain capabilities for arch xtensa / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensa' on this host {{(pid=75229) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 09:39:50 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-dc17613f-ef03-4a04-abcf-4df8bf8dcec5 None None] Getting domain capabilities for xtensaeb via machine types: {None} {{(pid=75229) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 09:39:50 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-dc17613f-ef03-4a04-abcf-4df8bf8dcec5 None None] Error from libvirt when retrieving domain capabilities for arch xtensaeb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensaeb' on this host {{(pid=75229) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 09:39:50 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-dc17613f-ef03-4a04-abcf-4df8bf8dcec5 None None] Checking secure boot support for host arch (x86_64) {{(pid=75229) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Nov 14 09:39:50 user nova-compute[75229]: INFO nova.virt.libvirt.host [None req-dc17613f-ef03-4a04-abcf-4df8bf8dcec5 None None] Secure Boot support detected
Nov 14 09:39:50 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-dc17613f-ef03-4a04-abcf-4df8bf8dcec5 None None] cpu compare xml: <cpu match="exact">
Nov 14 09:39:50 user nova-compute[75229]:   <model>Nehalem</model>
Nov 14 09:39:50 user nova-compute[75229]: </cpu>
Nov 14 09:39:50 user nova-compute[75229]:  {{(pid=75229) _compare_cpu /opt/stack/nova/nova/virt/libvirt/driver.py:10023}}
Nov 14 09:39:50 user nova-compute[75229]: INFO nova.virt.node [None req-dc17613f-ef03-4a04-abcf-4df8bf8dcec5 None None] Generated node identity d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3
Nov 14 09:39:50 user nova-compute[75229]: INFO nova.virt.node [None req-dc17613f-ef03-4a04-abcf-4df8bf8dcec5 None None] Wrote node identity d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 to /opt/stack/data/nova/compute_id
Nov 14 09:39:50 user nova-compute[75229]: WARNING nova.compute.manager [None req-dc17613f-ef03-4a04-abcf-4df8bf8dcec5 None None] Compute nodes ['d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3'] for host user were not found in the database. If this is the first time this service is starting on this host, then you can ignore this warning.
Nov 14 09:39:50 user nova-compute[75229]: INFO nova.compute.manager [None req-dc17613f-ef03-4a04-abcf-4df8bf8dcec5 None None] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host
Nov 14 09:39:50 user nova-compute[75229]: WARNING nova.compute.manager [None req-dc17613f-ef03-4a04-abcf-4df8bf8dcec5 None None] No compute node record found for host user. If this is the first time this service is starting on this host, then you can ignore this warning.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Nov 14 09:39:50 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-dc17613f-ef03-4a04-abcf-4df8bf8dcec5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:39:50 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-dc17613f-ef03-4a04-abcf-4df8bf8dcec5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:39:50 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-dc17613f-ef03-4a04-abcf-4df8bf8dcec5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:39:50 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-dc17613f-ef03-4a04-abcf-4df8bf8dcec5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75229) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 09:39:50 user nova-compute[75229]: WARNING nova.virt.libvirt.driver [None req-dc17613f-ef03-4a04-abcf-4df8bf8dcec5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 09:39:50 user nova-compute[75229]: WARNING nova.virt.libvirt.driver [None req-dc17613f-ef03-4a04-abcf-4df8bf8dcec5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 09:39:50 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-dc17613f-ef03-4a04-abcf-4df8bf8dcec5 None None] Hypervisor/Node resource view: name=user free_ram=10965MB free_disk=26.250953674316406GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75229) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 09:39:50 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-dc17613f-ef03-4a04-abcf-4df8bf8dcec5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:39:50 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-dc17613f-ef03-4a04-abcf-4df8bf8dcec5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:39:50 user nova-compute[75229]: WARNING nova.compute.resource_tracker [None req-dc17613f-ef03-4a04-abcf-4df8bf8dcec5 None None] No compute node record for user:d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 could not be found.
Nov 14 09:39:50 user nova-compute[75229]: INFO nova.compute.resource_tracker [None req-dc17613f-ef03-4a04-abcf-4df8bf8dcec5 None None] Compute node record created for user:user with uuid: d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3
Nov 14 09:39:50 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-dc17613f-ef03-4a04-abcf-4df8bf8dcec5 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75229) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 09:39:50 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-dc17613f-ef03-4a04-abcf-4df8bf8dcec5 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75229) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 09:39:50 user nova-compute[75229]: INFO nova.scheduler.client.report [None req-dc17613f-ef03-4a04-abcf-4df8bf8dcec5 None None] [req-fbdf7dee-04eb-4394-b07a-6aad3bdc4557] Created resource provider record via placement API for resource provider with UUID d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 and name user.
Nov 14 09:39:50 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-dc17613f-ef03-4a04-abcf-4df8bf8dcec5 None None] /sys/module/kvm_amd/parameters/sev does not exist {{(pid=75229) _kernel_supports_amd_sev /opt/stack/nova/nova/virt/libvirt/host.py:1795}}
Nov 14 09:39:50 user nova-compute[75229]: INFO nova.virt.libvirt.host [None req-dc17613f-ef03-4a04-abcf-4df8bf8dcec5 None None] kernel doesn't support AMD SEV
Nov 14 09:39:50 user nova-compute[75229]: DEBUG nova.compute.provider_tree [None req-dc17613f-ef03-4a04-abcf-4df8bf8dcec5 None None] Updating inventory in ProviderTree for provider d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 with inventory: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=75229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 14 09:39:50 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-dc17613f-ef03-4a04-abcf-4df8bf8dcec5 None None] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75229) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 09:39:50 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-dc17613f-ef03-4a04-abcf-4df8bf8dcec5 None None] Libvirt baseline CPU <cpu>
Nov 14 09:39:50 user nova-compute[75229]:   <arch>x86_64</arch>
Nov 14 09:39:50 user nova-compute[75229]:   <model>Nehalem</model>
Nov 14 09:39:50 user nova-compute[75229]:   <vendor>Intel</vendor>
Nov 14 09:39:50 user nova-compute[75229]:   <topology sockets="6" cores="1" threads="1"/>
Nov 14 09:39:50 user nova-compute[75229]: </cpu>
Nov 14 09:39:50 user nova-compute[75229]:  {{(pid=75229) _get_guest_baseline_cpu_features /opt/stack/nova/nova/virt/libvirt/driver.py:12513}}
Nov 14 09:39:51 user nova-compute[75229]: DEBUG nova.scheduler.client.report [None req-dc17613f-ef03-4a04-abcf-4df8bf8dcec5 None None] Updated inventory for provider d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 with generation 0 in Placement from set_inventory_for_provider using data: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=75229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}}
Nov 14 09:39:51 user nova-compute[75229]: DEBUG nova.compute.provider_tree [None req-dc17613f-ef03-4a04-abcf-4df8bf8dcec5 None None] Updating resource provider d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 generation from 0 to 1 during operation: update_inventory {{(pid=75229) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Nov 14 09:39:51 user nova-compute[75229]: DEBUG nova.compute.provider_tree [None req-dc17613f-ef03-4a04-abcf-4df8bf8dcec5 None None] Updating inventory in ProviderTree for provider d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 with inventory: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 14 09:39:51 user nova-compute[75229]: DEBUG nova.compute.provider_tree [None req-dc17613f-ef03-4a04-abcf-4df8bf8dcec5 None None] Updating resource provider d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 generation from 1 to 2 during operation: update_traits {{(pid=75229) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Nov 14 09:39:51 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-dc17613f-ef03-4a04-abcf-4df8bf8dcec5 None None] Compute_service record updated for user:user {{(pid=75229) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 09:39:51 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-dc17613f-ef03-4a04-abcf-4df8bf8dcec5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.684s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:39:51 user nova-compute[75229]: DEBUG nova.service [None req-dc17613f-ef03-4a04-abcf-4df8bf8dcec5 None None] Creating RPC server for service compute {{(pid=75229) start /opt/stack/nova/nova/service.py:182}}
Nov 14 09:39:51 user nova-compute[75229]: DEBUG nova.service [None req-dc17613f-ef03-4a04-abcf-4df8bf8dcec5 None None] Join ServiceGroup membership for this service compute {{(pid=75229) start /opt/stack/nova/nova/service.py:199}}
Nov 14 09:39:51 user nova-compute[75229]: DEBUG nova.servicegroup.drivers.db [None req-dc17613f-ef03-4a04-abcf-4df8bf8dcec5 None None] DB_Driver: join new ServiceGroup member user to the compute group, service = <Service: host=user, binary=nova-compute, manager_class_name=nova.compute.manager.ComputeManager> {{(pid=75229) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}}
Nov 14 09:40:10 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 09:40:10 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 09:40:41 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 09:40:41 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 09:40:41 user nova-compute[75229]: DEBUG nova.compute.manager [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Starting heal instance info cache {{(pid=75229) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 09:40:41 user nova-compute[75229]: DEBUG nova.compute.manager [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Rebuilding the list of instances to heal {{(pid=75229) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 09:40:41 user nova-compute[75229]: DEBUG nova.compute.manager [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Didn't find any instances for network info cache update. {{(pid=75229) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 14 09:40:41 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 09:40:41 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 09:40:41 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 09:40:41 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 09:40:41 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 09:40:41 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 09:40:41 user nova-compute[75229]: DEBUG nova.compute.manager [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75229) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 09:40:41 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 09:40:41 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:40:41 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:40:41 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:40:41 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Auditing locally available compute resources for user (node: user) {{(pid=75229) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 09:40:42 user nova-compute[75229]: WARNING nova.virt.libvirt.driver [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 09:40:42 user nova-compute[75229]: WARNING nova.virt.libvirt.driver [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 09:40:42 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Hypervisor/Node resource view: name=user free_ram=10427MB free_disk=26.15478515625GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75229) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 09:40:42 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:40:42 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:40:42 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75229) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 09:40:42 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75229) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 09:40:42 user nova-compute[75229]: DEBUG nova.compute.provider_tree [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Inventory has not changed in ProviderTree for provider: d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 {{(pid=75229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 09:40:42 user nova-compute[75229]: DEBUG nova.scheduler.client.report [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Inventory has not changed for provider d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 09:40:42 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Compute_service record updated for user:user {{(pid=75229) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 09:40:42 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.194s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:41:42 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 09:41:42 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 09:41:42 user nova-compute[75229]: DEBUG nova.compute.manager [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Starting heal instance info cache {{(pid=75229) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 09:41:42 user nova-compute[75229]: DEBUG nova.compute.manager [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Rebuilding the list of instances to heal {{(pid=75229) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 09:41:42 user nova-compute[75229]: DEBUG nova.compute.manager [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Didn't find any instances for network info cache update. {{(pid=75229) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 14 09:41:42 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 09:41:42 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 09:41:42 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 09:41:42 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 09:41:42 user nova-compute[75229]: DEBUG nova.compute.manager [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75229) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 09:41:42 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 09:41:42 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 09:41:42 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 09:41:42 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:41:42 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:41:42 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:41:42 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Auditing locally available compute resources for user (node: user) {{(pid=75229) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 09:41:43 user nova-compute[75229]: WARNING nova.virt.libvirt.driver [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 09:41:43 user nova-compute[75229]: WARNING nova.virt.libvirt.driver [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 09:41:43 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Hypervisor/Node resource view: name=user free_ram=10327MB free_disk=26.212215423583984GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75229) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 09:41:43 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:41:43 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:41:43 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75229) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 09:41:43 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75229) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 09:41:43 user nova-compute[75229]: DEBUG nova.compute.provider_tree [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Inventory has not changed in ProviderTree for provider: d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 {{(pid=75229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 09:41:43 user nova-compute[75229]: DEBUG nova.scheduler.client.report [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Inventory has not changed for provider d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 09:41:43 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Compute_service record updated for user:user {{(pid=75229) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 09:41:43 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.115s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:41:44 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 09:42:41 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 09:42:41 user nova-compute[75229]: DEBUG nova.compute.manager [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Starting heal instance info cache {{(pid=75229) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 09:42:41 user nova-compute[75229]: DEBUG nova.compute.manager [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Rebuilding the list of instances to heal {{(pid=75229) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 09:42:41 user nova-compute[75229]: DEBUG nova.compute.manager [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Didn't find any instances for network info cache update. {{(pid=75229) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 14 09:42:41 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 09:42:42 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 09:42:42 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 09:42:42 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:42:42 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:42:42 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:42:42 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Auditing locally available compute resources for user (node: user) {{(pid=75229) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 09:42:43 user nova-compute[75229]: WARNING nova.virt.libvirt.driver [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 09:42:43 user nova-compute[75229]: WARNING nova.virt.libvirt.driver [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 09:42:43 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Hypervisor/Node resource view: name=user free_ram=10369MB free_disk=25.9715576171875GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75229) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 09:42:43 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:42:43 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:42:43 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75229) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 09:42:43 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75229) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 09:42:43 user nova-compute[75229]: DEBUG nova.compute.provider_tree [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Inventory has not changed in ProviderTree for provider: d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 {{(pid=75229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 09:42:43 user nova-compute[75229]: DEBUG nova.scheduler.client.report [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Inventory has not changed for provider d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 09:42:43 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Compute_service record updated for user:user {{(pid=75229) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 09:42:43 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.149s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:42:44 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 09:42:44 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 09:42:44 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 09:42:44 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 09:42:44 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 09:42:44 user nova-compute[75229]: DEBUG nova.compute.manager [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75229) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 09:43:41 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 09:43:41 user nova-compute[75229]: DEBUG nova.compute.manager [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Starting heal instance info cache {{(pid=75229) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 09:43:41 user nova-compute[75229]: DEBUG nova.compute.manager [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Rebuilding the list of instances to heal {{(pid=75229) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 09:43:41 user nova-compute[75229]: DEBUG nova.compute.manager [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Didn't find any instances for network info cache update. {{(pid=75229) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 14 09:43:42 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 09:43:42 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 09:43:43 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 09:43:43 user nova-compute[75229]: DEBUG nova.compute.manager [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75229) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 09:43:43 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 09:43:43 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:43:43 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:43:43 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:43:43 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Auditing locally available compute resources for user (node: user) {{(pid=75229) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 09:43:44 user nova-compute[75229]: WARNING nova.virt.libvirt.driver [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 09:43:44 user nova-compute[75229]: WARNING nova.virt.libvirt.driver [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 09:43:44 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Hypervisor/Node resource view: name=user free_ram=9653MB free_disk=25.99962615966797GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75229) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 09:43:44 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:43:44 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:43:44 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75229) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 09:43:44 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75229) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 09:43:44 user nova-compute[75229]: DEBUG nova.compute.provider_tree [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Inventory has not changed in ProviderTree for provider: d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 {{(pid=75229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 09:43:44 user nova-compute[75229]: DEBUG nova.scheduler.client.report [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Inventory has not changed for provider d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 09:43:44 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Compute_service record updated for user:user {{(pid=75229) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 09:43:44 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.147s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:43:45 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 09:43:45 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 09:43:45 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 09:43:45 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 09:43:45 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 09:43:50 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-6fb168db-88e3-470e-a460-f02dcd74cc8e tempest-DeleteServersTestJSON-1002799117 tempest-DeleteServersTestJSON-1002799117-project-member] Acquiring lock "359ff85c-c332-4059-8db4-689a0483d068" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:43:50 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-6fb168db-88e3-470e-a460-f02dcd74cc8e tempest-DeleteServersTestJSON-1002799117 tempest-DeleteServersTestJSON-1002799117-project-member] Lock "359ff85c-c332-4059-8db4-689a0483d068" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:43:50 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-3b6c1bc3-20bd-4c38-907a-c3586f51b9bc tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Acquiring lock "90bd76df-96cb-4bec-9862-853d94cdbaab" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:43:50 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-3b6c1bc3-20bd-4c38-907a-c3586f51b9bc tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Lock "90bd76df-96cb-4bec-9862-853d94cdbaab" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:43:50 user nova-compute[75229]: DEBUG nova.compute.manager [None req-6fb168db-88e3-470e-a460-f02dcd74cc8e tempest-DeleteServersTestJSON-1002799117 tempest-DeleteServersTestJSON-1002799117-project-member] [instance: 359ff85c-c332-4059-8db4-689a0483d068] Starting instance... {{(pid=75229) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 09:43:50 user nova-compute[75229]: DEBUG nova.compute.manager [None req-3b6c1bc3-20bd-4c38-907a-c3586f51b9bc tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] [instance: 90bd76df-96cb-4bec-9862-853d94cdbaab] Starting instance... {{(pid=75229) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 09:43:51 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-6fb168db-88e3-470e-a460-f02dcd74cc8e tempest-DeleteServersTestJSON-1002799117 tempest-DeleteServersTestJSON-1002799117-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:43:51 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-6fb168db-88e3-470e-a460-f02dcd74cc8e tempest-DeleteServersTestJSON-1002799117 tempest-DeleteServersTestJSON-1002799117-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:43:51 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-3b6c1bc3-20bd-4c38-907a-c3586f51b9bc tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:43:51 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-6fb168db-88e3-470e-a460-f02dcd74cc8e tempest-DeleteServersTestJSON-1002799117 tempest-DeleteServersTestJSON-1002799117-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75229) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 09:43:51 user nova-compute[75229]: INFO nova.compute.claims [None req-6fb168db-88e3-470e-a460-f02dcd74cc8e tempest-DeleteServersTestJSON-1002799117 tempest-DeleteServersTestJSON-1002799117-project-member] [instance: 359ff85c-c332-4059-8db4-689a0483d068] Claim successful on node user
Nov 14 09:43:51 user nova-compute[75229]: DEBUG nova.compute.provider_tree [None req-6fb168db-88e3-470e-a460-f02dcd74cc8e tempest-DeleteServersTestJSON-1002799117 tempest-DeleteServersTestJSON-1002799117-project-member] Inventory has not changed in ProviderTree for provider: d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 {{(pid=75229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 09:43:51 user nova-compute[75229]: DEBUG nova.scheduler.client.report [None req-6fb168db-88e3-470e-a460-f02dcd74cc8e tempest-DeleteServersTestJSON-1002799117 tempest-DeleteServersTestJSON-1002799117-project-member] Inventory has not changed for provider d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 09:43:51 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-6fb168db-88e3-470e-a460-f02dcd74cc8e tempest-DeleteServersTestJSON-1002799117 tempest-DeleteServersTestJSON-1002799117-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.346s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:43:51 user nova-compute[75229]: DEBUG nova.compute.manager [None req-6fb168db-88e3-470e-a460-f02dcd74cc8e tempest-DeleteServersTestJSON-1002799117 tempest-DeleteServersTestJSON-1002799117-project-member] [instance: 359ff85c-c332-4059-8db4-689a0483d068] Start building networks asynchronously for instance. {{(pid=75229) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 09:43:51 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-3b6c1bc3-20bd-4c38-907a-c3586f51b9bc tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.350s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:43:51 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-3b6c1bc3-20bd-4c38-907a-c3586f51b9bc tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75229) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 09:43:51 user nova-compute[75229]: INFO nova.compute.claims [None req-3b6c1bc3-20bd-4c38-907a-c3586f51b9bc tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] [instance: 90bd76df-96cb-4bec-9862-853d94cdbaab] Claim successful on node user
Nov 14 09:43:51 user nova-compute[75229]: DEBUG nova.compute.manager [None req-6fb168db-88e3-470e-a460-f02dcd74cc8e tempest-DeleteServersTestJSON-1002799117 tempest-DeleteServersTestJSON-1002799117-project-member] [instance: 359ff85c-c332-4059-8db4-689a0483d068] Allocating IP information in the background. {{(pid=75229) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 09:43:51 user nova-compute[75229]: DEBUG nova.network.neutron [None req-6fb168db-88e3-470e-a460-f02dcd74cc8e tempest-DeleteServersTestJSON-1002799117 tempest-DeleteServersTestJSON-1002799117-project-member] [instance: 359ff85c-c332-4059-8db4-689a0483d068] allocate_for_instance() {{(pid=75229) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 09:43:51 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-6fb168db-88e3-470e-a460-f02dcd74cc8e tempest-DeleteServersTestJSON-1002799117 tempest-DeleteServersTestJSON-1002799117-project-member] [instance: 359ff85c-c332-4059-8db4-689a0483d068] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 09:43:51 user nova-compute[75229]: DEBUG nova.compute.manager [None req-6fb168db-88e3-470e-a460-f02dcd74cc8e tempest-DeleteServersTestJSON-1002799117 tempest-DeleteServersTestJSON-1002799117-project-member] [instance: 359ff85c-c332-4059-8db4-689a0483d068] Start building block device mappings for instance. {{(pid=75229) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 09:43:51 user nova-compute[75229]: DEBUG nova.compute.manager [None req-6fb168db-88e3-470e-a460-f02dcd74cc8e tempest-DeleteServersTestJSON-1002799117 tempest-DeleteServersTestJSON-1002799117-project-member] [instance: 359ff85c-c332-4059-8db4-689a0483d068] Start spawning the instance on the hypervisor. {{(pid=75229) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 09:43:51 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-6fb168db-88e3-470e-a460-f02dcd74cc8e tempest-DeleteServersTestJSON-1002799117 tempest-DeleteServersTestJSON-1002799117-project-member] [instance: 359ff85c-c332-4059-8db4-689a0483d068] Creating instance directory {{(pid=75229) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 09:43:51 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-6fb168db-88e3-470e-a460-f02dcd74cc8e tempest-DeleteServersTestJSON-1002799117 tempest-DeleteServersTestJSON-1002799117-project-member] [instance: 359ff85c-c332-4059-8db4-689a0483d068] Creating image(s)
Nov 14 09:43:51 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-6fb168db-88e3-470e-a460-f02dcd74cc8e tempest-DeleteServersTestJSON-1002799117 tempest-DeleteServersTestJSON-1002799117-project-member] Acquiring lock "/opt/stack/data/nova/instances/359ff85c-c332-4059-8db4-689a0483d068/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:43:51 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-6fb168db-88e3-470e-a460-f02dcd74cc8e tempest-DeleteServersTestJSON-1002799117 tempest-DeleteServersTestJSON-1002799117-project-member] Lock "/opt/stack/data/nova/instances/359ff85c-c332-4059-8db4-689a0483d068/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:43:51 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-6fb168db-88e3-470e-a460-f02dcd74cc8e tempest-DeleteServersTestJSON-1002799117 tempest-DeleteServersTestJSON-1002799117-project-member] Lock "/opt/stack/data/nova/instances/359ff85c-c332-4059-8db4-689a0483d068/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:43:51 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-6fb168db-88e3-470e-a460-f02dcd74cc8e tempest-DeleteServersTestJSON-1002799117 tempest-DeleteServersTestJSON-1002799117-project-member] Acquiring lock "4f30e3fe703d2381679612a57b1fb80a467f60b6" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:43:51 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-6fb168db-88e3-470e-a460-f02dcd74cc8e tempest-DeleteServersTestJSON-1002799117 tempest-DeleteServersTestJSON-1002799117-project-member] Lock "4f30e3fe703d2381679612a57b1fb80a467f60b6" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:43:51 user nova-compute[75229]: DEBUG nova.compute.provider_tree [None req-3b6c1bc3-20bd-4c38-907a-c3586f51b9bc tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Inventory has not changed in ProviderTree for provider: d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 {{(pid=75229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 09:43:51 user nova-compute[75229]: DEBUG nova.scheduler.client.report [None req-3b6c1bc3-20bd-4c38-907a-c3586f51b9bc tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Inventory has not changed for provider d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 09:43:52 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-3b6c1bc3-20bd-4c38-907a-c3586f51b9bc tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.518s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:43:52 user nova-compute[75229]: DEBUG nova.compute.manager [None req-3b6c1bc3-20bd-4c38-907a-c3586f51b9bc tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] [instance: 90bd76df-96cb-4bec-9862-853d94cdbaab] Start building networks asynchronously for instance. {{(pid=75229) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 09:43:52 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-6fb168db-88e3-470e-a460-f02dcd74cc8e tempest-DeleteServersTestJSON-1002799117 tempest-DeleteServersTestJSON-1002799117-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6.part --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:43:52 user nova-compute[75229]: DEBUG nova.policy [None req-6fb168db-88e3-470e-a460-f02dcd74cc8e tempest-DeleteServersTestJSON-1002799117 tempest-DeleteServersTestJSON-1002799117-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '17e39818cb9344ca80bda511052e08aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac677c251f874551947d944c52d1d7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75229) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 09:43:52 user nova-compute[75229]: DEBUG nova.compute.manager [None req-3b6c1bc3-20bd-4c38-907a-c3586f51b9bc tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] [instance: 90bd76df-96cb-4bec-9862-853d94cdbaab] Allocating IP information in the background. {{(pid=75229) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 09:43:52 user nova-compute[75229]: DEBUG nova.network.neutron [None req-3b6c1bc3-20bd-4c38-907a-c3586f51b9bc tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] [instance: 90bd76df-96cb-4bec-9862-853d94cdbaab] allocate_for_instance() {{(pid=75229) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 09:43:52 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-3b6c1bc3-20bd-4c38-907a-c3586f51b9bc tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] [instance: 90bd76df-96cb-4bec-9862-853d94cdbaab] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 09:43:52 user nova-compute[75229]: DEBUG nova.compute.manager [None req-3b6c1bc3-20bd-4c38-907a-c3586f51b9bc tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] [instance: 90bd76df-96cb-4bec-9862-853d94cdbaab] Start building block device mappings for instance. {{(pid=75229) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 09:43:52 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-6fb168db-88e3-470e-a460-f02dcd74cc8e tempest-DeleteServersTestJSON-1002799117 tempest-DeleteServersTestJSON-1002799117-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6.part --force-share --output=json" returned: 0 in 0.267s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:43:52 user nova-compute[75229]: DEBUG nova.virt.images [None req-6fb168db-88e3-470e-a460-f02dcd74cc8e tempest-DeleteServersTestJSON-1002799117 tempest-DeleteServersTestJSON-1002799117-project-member] 3bef8470-ecc7-40e3-95d4-9254348ea72d was qcow2, converting to raw {{(pid=75229) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 14 09:43:52 user nova-compute[75229]: DEBUG nova.privsep.utils [None req-6fb168db-88e3-470e-a460-f02dcd74cc8e tempest-DeleteServersTestJSON-1002799117 tempest-DeleteServersTestJSON-1002799117-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75229) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 14 09:43:52 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-6fb168db-88e3-470e-a460-f02dcd74cc8e tempest-DeleteServersTestJSON-1002799117 tempest-DeleteServersTestJSON-1002799117-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6.part /opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6.converted {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:43:52 user nova-compute[75229]: DEBUG nova.policy [None req-3b6c1bc3-20bd-4c38-907a-c3586f51b9bc tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '319a0a5ee47a426799d40e0ebb62a3b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9447f169de43829fe3ed51592752e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75229) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 09:43:52 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-6fb168db-88e3-470e-a460-f02dcd74cc8e tempest-DeleteServersTestJSON-1002799117 tempest-DeleteServersTestJSON-1002799117-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6.part /opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6.converted" returned: 0 in 0.166s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:43:52 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-6fb168db-88e3-470e-a460-f02dcd74cc8e tempest-DeleteServersTestJSON-1002799117 tempest-DeleteServersTestJSON-1002799117-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6.converted --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:43:52 user nova-compute[75229]: DEBUG nova.compute.manager [None req-3b6c1bc3-20bd-4c38-907a-c3586f51b9bc tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] [instance: 90bd76df-96cb-4bec-9862-853d94cdbaab] Start spawning the instance on the hypervisor. {{(pid=75229) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 09:43:52 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-3b6c1bc3-20bd-4c38-907a-c3586f51b9bc tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] [instance: 90bd76df-96cb-4bec-9862-853d94cdbaab] Creating instance directory {{(pid=75229) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 09:43:52 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-3b6c1bc3-20bd-4c38-907a-c3586f51b9bc tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] [instance: 90bd76df-96cb-4bec-9862-853d94cdbaab] Creating image(s)
Nov 14 09:43:52 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-3b6c1bc3-20bd-4c38-907a-c3586f51b9bc tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Acquiring lock "/opt/stack/data/nova/instances/90bd76df-96cb-4bec-9862-853d94cdbaab/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:43:52 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-3b6c1bc3-20bd-4c38-907a-c3586f51b9bc tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Lock "/opt/stack/data/nova/instances/90bd76df-96cb-4bec-9862-853d94cdbaab/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:43:52 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-3b6c1bc3-20bd-4c38-907a-c3586f51b9bc tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Lock "/opt/stack/data/nova/instances/90bd76df-96cb-4bec-9862-853d94cdbaab/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:43:52 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-3b6c1bc3-20bd-4c38-907a-c3586f51b9bc tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Acquiring lock "4f30e3fe703d2381679612a57b1fb80a467f60b6" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:43:53 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-6fb168db-88e3-470e-a460-f02dcd74cc8e tempest-DeleteServersTestJSON-1002799117 tempest-DeleteServersTestJSON-1002799117-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6.converted --force-share --output=json" returned: 0 in 0.190s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:43:53 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-6fb168db-88e3-470e-a460-f02dcd74cc8e tempest-DeleteServersTestJSON-1002799117 tempest-DeleteServersTestJSON-1002799117-project-member] Lock "4f30e3fe703d2381679612a57b1fb80a467f60b6" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.283s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:43:53 user nova-compute[75229]: INFO oslo.privsep.daemon [None req-6fb168db-88e3-470e-a460-f02dcd74cc8e tempest-DeleteServersTestJSON-1002799117 tempest-DeleteServersTestJSON-1002799117-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'nova.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmph81id1z6/privsep.sock']
Nov 14 09:43:53 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-3b6c1bc3-20bd-4c38-907a-c3586f51b9bc tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Lock "4f30e3fe703d2381679612a57b1fb80a467f60b6" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.152s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:43:53 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-3b6c1bc3-20bd-4c38-907a-c3586f51b9bc tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Lock "4f30e3fe703d2381679612a57b1fb80a467f60b6" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:43:53 user sudo[84480]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context nova.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmph81id1z6/privsep.sock
Nov 14 09:43:53 user sudo[84480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 14 09:43:54 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-0263f621-3230-4ce3-bd4e-7446204bb0ce tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Acquiring lock "a7750cbc-b3d0-44aa-8b88-c291ba007a8a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:43:54 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-0263f621-3230-4ce3-bd4e-7446204bb0ce tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Lock "a7750cbc-b3d0-44aa-8b88-c291ba007a8a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:43:54 user nova-compute[75229]: DEBUG nova.compute.manager [None req-0263f621-3230-4ce3-bd4e-7446204bb0ce tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] [instance: a7750cbc-b3d0-44aa-8b88-c291ba007a8a] Starting instance... {{(pid=75229) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 09:43:54 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-0263f621-3230-4ce3-bd4e-7446204bb0ce tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:43:54 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-0263f621-3230-4ce3-bd4e-7446204bb0ce tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:43:54 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-0263f621-3230-4ce3-bd4e-7446204bb0ce tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75229) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 09:43:54 user nova-compute[75229]: INFO nova.compute.claims [None req-0263f621-3230-4ce3-bd4e-7446204bb0ce tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] [instance: a7750cbc-b3d0-44aa-8b88-c291ba007a8a] Claim successful on node user
Nov 14 09:43:54 user sudo[84480]: pam_unix(sudo:session): session closed for user root
Nov 14 09:43:54 user nova-compute[75229]: INFO oslo.privsep.daemon [None req-6fb168db-88e3-470e-a460-f02dcd74cc8e tempest-DeleteServersTestJSON-1002799117 tempest-DeleteServersTestJSON-1002799117-project-member] Spawned new privsep daemon via rootwrap
Nov 14 09:43:54 user nova-compute[75229]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 14 09:43:54 user nova-compute[75229]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 14 09:43:54 user nova-compute[75229]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Nov 14 09:43:54 user nova-compute[75229]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 84489
Nov 14 09:43:54 user nova-compute[75229]: WARNING oslo_privsep.priv_context [None req-3b6c1bc3-20bd-4c38-907a-c3586f51b9bc tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] privsep daemon already running
Nov 14 09:43:54 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-3b6c1bc3-20bd-4c38-907a-c3586f51b9bc tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6 --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:43:54 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-6fb168db-88e3-470e-a460-f02dcd74cc8e tempest-DeleteServersTestJSON-1002799117 tempest-DeleteServersTestJSON-1002799117-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6 --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:43:54 user nova-compute[75229]: DEBUG nova.compute.provider_tree [None req-0263f621-3230-4ce3-bd4e-7446204bb0ce tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Inventory has not changed in ProviderTree for provider: d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 {{(pid=75229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 09:43:54 user nova-compute[75229]: DEBUG nova.scheduler.client.report [None req-0263f621-3230-4ce3-bd4e-7446204bb0ce tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Inventory has not changed for provider d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 09:43:54 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-0263f621-3230-4ce3-bd4e-7446204bb0ce tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.423s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:43:54 user nova-compute[75229]: DEBUG nova.compute.manager [None req-0263f621-3230-4ce3-bd4e-7446204bb0ce tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] [instance: a7750cbc-b3d0-44aa-8b88-c291ba007a8a] Start building networks asynchronously for instance. {{(pid=75229) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 09:43:54 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-3b6c1bc3-20bd-4c38-907a-c3586f51b9bc tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6 --force-share --output=json" returned: 0 in 0.167s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:43:54 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-3b6c1bc3-20bd-4c38-907a-c3586f51b9bc tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Acquiring lock "4f30e3fe703d2381679612a57b1fb80a467f60b6" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:43:54 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-3b6c1bc3-20bd-4c38-907a-c3586f51b9bc tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Lock "4f30e3fe703d2381679612a57b1fb80a467f60b6" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:43:54 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-3b6c1bc3-20bd-4c38-907a-c3586f51b9bc tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6 --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:43:54 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-6fb168db-88e3-470e-a460-f02dcd74cc8e tempest-DeleteServersTestJSON-1002799117 tempest-DeleteServersTestJSON-1002799117-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6 --force-share --output=json" returned: 0 in 0.172s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:43:54 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-6fb168db-88e3-470e-a460-f02dcd74cc8e tempest-DeleteServersTestJSON-1002799117 tempest-DeleteServersTestJSON-1002799117-project-member] Acquiring lock "4f30e3fe703d2381679612a57b1fb80a467f60b6" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:43:54 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-5d922a01-a874-465d-8f1e-51377ec600a2 tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] Acquiring lock "e09b3809-2e23-401c-9a72-88feb2bb657c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:43:54 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-5d922a01-a874-465d-8f1e-51377ec600a2 tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] Lock "e09b3809-2e23-401c-9a72-88feb2bb657c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:43:54 user nova-compute[75229]: DEBUG nova.compute.manager [None req-5d922a01-a874-465d-8f1e-51377ec600a2 tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] [instance: e09b3809-2e23-401c-9a72-88feb2bb657c] Starting instance... {{(pid=75229) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 09:43:55 user nova-compute[75229]: DEBUG nova.compute.manager [None req-0263f621-3230-4ce3-bd4e-7446204bb0ce tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] [instance: a7750cbc-b3d0-44aa-8b88-c291ba007a8a] Allocating IP information in the background. {{(pid=75229) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 09:43:55 user nova-compute[75229]: DEBUG nova.network.neutron [None req-0263f621-3230-4ce3-bd4e-7446204bb0ce tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] [instance: a7750cbc-b3d0-44aa-8b88-c291ba007a8a] allocate_for_instance() {{(pid=75229) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 09:43:55 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-0263f621-3230-4ce3-bd4e-7446204bb0ce tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] [instance: a7750cbc-b3d0-44aa-8b88-c291ba007a8a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 09:43:55 user nova-compute[75229]: DEBUG nova.compute.manager [None req-0263f621-3230-4ce3-bd4e-7446204bb0ce tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] [instance: a7750cbc-b3d0-44aa-8b88-c291ba007a8a] Start building block device mappings for instance. {{(pid=75229) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 09:43:55 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-3b6c1bc3-20bd-4c38-907a-c3586f51b9bc tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6 --force-share --output=json" returned: 0 in 0.177s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:43:55 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-3b6c1bc3-20bd-4c38-907a-c3586f51b9bc tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6,backing_fmt=raw /opt/stack/data/nova/instances/90bd76df-96cb-4bec-9862-853d94cdbaab/disk 1073741824 {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:43:55 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-5d922a01-a874-465d-8f1e-51377ec600a2 tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:43:55 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-5d922a01-a874-465d-8f1e-51377ec600a2 tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:43:55 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-3b6c1bc3-20bd-4c38-907a-c3586f51b9bc tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6,backing_fmt=raw /opt/stack/data/nova/instances/90bd76df-96cb-4bec-9862-853d94cdbaab/disk 1073741824" returned: 0 in 0.048s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:43:55 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-3b6c1bc3-20bd-4c38-907a-c3586f51b9bc tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Lock "4f30e3fe703d2381679612a57b1fb80a467f60b6" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.228s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:43:55 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-3b6c1bc3-20bd-4c38-907a-c3586f51b9bc tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6 --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:43:55 user nova-compute[75229]: DEBUG nova.policy [None req-0263f621-3230-4ce3-bd4e-7446204bb0ce tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c0c381a0f6124f1ca6ce85c057b9143a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46e65cdd021f4a3db7c9254bb6d98b46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75229) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 09:43:55 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-6fb168db-88e3-470e-a460-f02dcd74cc8e tempest-DeleteServersTestJSON-1002799117 tempest-DeleteServersTestJSON-1002799117-project-member] Lock "4f30e3fe703d2381679612a57b1fb80a467f60b6" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.229s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:43:55 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-6fb168db-88e3-470e-a460-f02dcd74cc8e tempest-DeleteServersTestJSON-1002799117 tempest-DeleteServersTestJSON-1002799117-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6 --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:43:55 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-5d922a01-a874-465d-8f1e-51377ec600a2 tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75229) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 09:43:55 user nova-compute[75229]: INFO nova.compute.claims [None req-5d922a01-a874-465d-8f1e-51377ec600a2 tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] [instance: e09b3809-2e23-401c-9a72-88feb2bb657c] Claim successful on node user
Nov 14 09:43:55 user nova-compute[75229]: DEBUG nova.compute.manager [None req-0263f621-3230-4ce3-bd4e-7446204bb0ce tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] [instance: a7750cbc-b3d0-44aa-8b88-c291ba007a8a] Start spawning the instance on the hypervisor. {{(pid=75229) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 09:43:55 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-0263f621-3230-4ce3-bd4e-7446204bb0ce tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] [instance: a7750cbc-b3d0-44aa-8b88-c291ba007a8a] Creating instance directory {{(pid=75229) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 09:43:55 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-0263f621-3230-4ce3-bd4e-7446204bb0ce tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] [instance: a7750cbc-b3d0-44aa-8b88-c291ba007a8a] Creating image(s)
Nov 14 09:43:55 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-0263f621-3230-4ce3-bd4e-7446204bb0ce tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Acquiring lock "/opt/stack/data/nova/instances/a7750cbc-b3d0-44aa-8b88-c291ba007a8a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:43:55 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-0263f621-3230-4ce3-bd4e-7446204bb0ce tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Lock "/opt/stack/data/nova/instances/a7750cbc-b3d0-44aa-8b88-c291ba007a8a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:43:55 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-0263f621-3230-4ce3-bd4e-7446204bb0ce tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Lock "/opt/stack/data/nova/instances/a7750cbc-b3d0-44aa-8b88-c291ba007a8a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:43:55 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-0263f621-3230-4ce3-bd4e-7446204bb0ce tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6 --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:43:55 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-3b6c1bc3-20bd-4c38-907a-c3586f51b9bc tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6 --force-share --output=json" returned: 0 in 0.183s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:43:55 user nova-compute[75229]: DEBUG nova.virt.disk.api [None req-3b6c1bc3-20bd-4c38-907a-c3586f51b9bc tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Checking if we can resize image /opt/stack/data/nova/instances/90bd76df-96cb-4bec-9862-853d94cdbaab/disk. size=1073741824 {{(pid=75229) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 09:43:55 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-3b6c1bc3-20bd-4c38-907a-c3586f51b9bc tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90bd76df-96cb-4bec-9862-853d94cdbaab/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:43:55 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-6fb168db-88e3-470e-a460-f02dcd74cc8e tempest-DeleteServersTestJSON-1002799117 tempest-DeleteServersTestJSON-1002799117-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6 --force-share --output=json" returned: 0 in 0.178s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:43:55 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-6fb168db-88e3-470e-a460-f02dcd74cc8e tempest-DeleteServersTestJSON-1002799117 tempest-DeleteServersTestJSON-1002799117-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6,backing_fmt=raw /opt/stack/data/nova/instances/359ff85c-c332-4059-8db4-689a0483d068/disk 1073741824 {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:43:55 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-0263f621-3230-4ce3-bd4e-7446204bb0ce tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6 --force-share --output=json" returned: 0 in 0.169s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:43:55 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-0263f621-3230-4ce3-bd4e-7446204bb0ce tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Acquiring lock "4f30e3fe703d2381679612a57b1fb80a467f60b6" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:43:55 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-6fb168db-88e3-470e-a460-f02dcd74cc8e tempest-DeleteServersTestJSON-1002799117 tempest-DeleteServersTestJSON-1002799117-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6,backing_fmt=raw /opt/stack/data/nova/instances/359ff85c-c332-4059-8db4-689a0483d068/disk 1073741824" returned: 0 in 0.095s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:43:55 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-6fb168db-88e3-470e-a460-f02dcd74cc8e tempest-DeleteServersTestJSON-1002799117 tempest-DeleteServersTestJSON-1002799117-project-member] Lock "4f30e3fe703d2381679612a57b1fb80a467f60b6" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.278s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:43:55 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-6fb168db-88e3-470e-a460-f02dcd74cc8e tempest-DeleteServersTestJSON-1002799117 tempest-DeleteServersTestJSON-1002799117-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6 --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:43:55 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-0263f621-3230-4ce3-bd4e-7446204bb0ce tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Lock "4f30e3fe703d2381679612a57b1fb80a467f60b6" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.093s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:43:55 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-0263f621-3230-4ce3-bd4e-7446204bb0ce tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6 --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:43:55 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-3b6c1bc3-20bd-4c38-907a-c3586f51b9bc tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90bd76df-96cb-4bec-9862-853d94cdbaab/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:43:55 user nova-compute[75229]: DEBUG nova.virt.disk.api [None req-3b6c1bc3-20bd-4c38-907a-c3586f51b9bc tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Cannot resize image /opt/stack/data/nova/instances/90bd76df-96cb-4bec-9862-853d94cdbaab/disk to a smaller size. {{(pid=75229) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 09:43:55 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-3b6c1bc3-20bd-4c38-907a-c3586f51b9bc tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] [instance: 90bd76df-96cb-4bec-9862-853d94cdbaab] Created local disks {{(pid=75229) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 09:43:55 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-3b6c1bc3-20bd-4c38-907a-c3586f51b9bc tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] [instance: 90bd76df-96cb-4bec-9862-853d94cdbaab] Ensure instance console log exists: /opt/stack/data/nova/instances/90bd76df-96cb-4bec-9862-853d94cdbaab/console.log {{(pid=75229) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 09:43:55 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-3b6c1bc3-20bd-4c38-907a-c3586f51b9bc tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:43:55 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-3b6c1bc3-20bd-4c38-907a-c3586f51b9bc tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:43:55 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-3b6c1bc3-20bd-4c38-907a-c3586f51b9bc tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:43:55 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-6fb168db-88e3-470e-a460-f02dcd74cc8e tempest-DeleteServersTestJSON-1002799117 tempest-DeleteServersTestJSON-1002799117-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6 --force-share --output=json" returned: 0 in 0.184s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:43:55 user nova-compute[75229]: DEBUG nova.virt.disk.api [None req-6fb168db-88e3-470e-a460-f02dcd74cc8e tempest-DeleteServersTestJSON-1002799117 tempest-DeleteServersTestJSON-1002799117-project-member] Checking if we can resize image /opt/stack/data/nova/instances/359ff85c-c332-4059-8db4-689a0483d068/disk. size=1073741824 {{(pid=75229) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 09:43:55 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-6fb168db-88e3-470e-a460-f02dcd74cc8e tempest-DeleteServersTestJSON-1002799117 tempest-DeleteServersTestJSON-1002799117-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/359ff85c-c332-4059-8db4-689a0483d068/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:43:55 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-0263f621-3230-4ce3-bd4e-7446204bb0ce tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6 --force-share --output=json" returned: 0 in 0.189s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:43:55 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-0263f621-3230-4ce3-bd4e-7446204bb0ce tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6,backing_fmt=raw /opt/stack/data/nova/instances/a7750cbc-b3d0-44aa-8b88-c291ba007a8a/disk 1073741824 {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:43:55 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-0263f621-3230-4ce3-bd4e-7446204bb0ce tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6,backing_fmt=raw /opt/stack/data/nova/instances/a7750cbc-b3d0-44aa-8b88-c291ba007a8a/disk 1073741824" returned: 0 in 0.043s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:43:55 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-0263f621-3230-4ce3-bd4e-7446204bb0ce tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Lock "4f30e3fe703d2381679612a57b1fb80a467f60b6" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.237s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:43:55 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-0263f621-3230-4ce3-bd4e-7446204bb0ce tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6 --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:43:55 user nova-compute[75229]: DEBUG nova.compute.provider_tree [None req-5d922a01-a874-465d-8f1e-51377ec600a2 tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] Inventory has not changed in ProviderTree for provider: d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 {{(pid=75229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 09:43:55 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-6fb168db-88e3-470e-a460-f02dcd74cc8e tempest-DeleteServersTestJSON-1002799117 tempest-DeleteServersTestJSON-1002799117-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/359ff85c-c332-4059-8db4-689a0483d068/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:43:55 user nova-compute[75229]: DEBUG nova.virt.disk.api [None req-6fb168db-88e3-470e-a460-f02dcd74cc8e tempest-DeleteServersTestJSON-1002799117 tempest-DeleteServersTestJSON-1002799117-project-member] Cannot resize image /opt/stack/data/nova/instances/359ff85c-c332-4059-8db4-689a0483d068/disk to a smaller size. {{(pid=75229) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 09:43:55 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-6fb168db-88e3-470e-a460-f02dcd74cc8e tempest-DeleteServersTestJSON-1002799117 tempest-DeleteServersTestJSON-1002799117-project-member] [instance: 359ff85c-c332-4059-8db4-689a0483d068] Created local disks {{(pid=75229) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 09:43:55 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-6fb168db-88e3-470e-a460-f02dcd74cc8e tempest-DeleteServersTestJSON-1002799117 tempest-DeleteServersTestJSON-1002799117-project-member] [instance: 359ff85c-c332-4059-8db4-689a0483d068] Ensure instance console log exists: /opt/stack/data/nova/instances/359ff85c-c332-4059-8db4-689a0483d068/console.log {{(pid=75229) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 09:43:55 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-6fb168db-88e3-470e-a460-f02dcd74cc8e tempest-DeleteServersTestJSON-1002799117 tempest-DeleteServersTestJSON-1002799117-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:43:55 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-6fb168db-88e3-470e-a460-f02dcd74cc8e tempest-DeleteServersTestJSON-1002799117 tempest-DeleteServersTestJSON-1002799117-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:43:55 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-6fb168db-88e3-470e-a460-f02dcd74cc8e tempest-DeleteServersTestJSON-1002799117 tempest-DeleteServersTestJSON-1002799117-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:43:55 user nova-compute[75229]: DEBUG nova.scheduler.client.report [None req-5d922a01-a874-465d-8f1e-51377ec600a2 tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] Inventory has not changed for provider d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 09:43:55 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-5d922a01-a874-465d-8f1e-51377ec600a2 tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.761s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:43:55 user nova-compute[75229]: DEBUG nova.compute.manager [None req-5d922a01-a874-465d-8f1e-51377ec600a2 tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] [instance: e09b3809-2e23-401c-9a72-88feb2bb657c] Start building networks asynchronously for instance. {{(pid=75229) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 09:43:55 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-0263f621-3230-4ce3-bd4e-7446204bb0ce tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6 --force-share --output=json" returned: 0 in 0.175s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:43:55 user nova-compute[75229]: DEBUG nova.virt.disk.api [None req-0263f621-3230-4ce3-bd4e-7446204bb0ce tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a7750cbc-b3d0-44aa-8b88-c291ba007a8a/disk. size=1073741824 {{(pid=75229) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 09:43:55 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-0263f621-3230-4ce3-bd4e-7446204bb0ce tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7750cbc-b3d0-44aa-8b88-c291ba007a8a/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:43:55 user nova-compute[75229]: DEBUG nova.network.neutron [None req-3b6c1bc3-20bd-4c38-907a-c3586f51b9bc tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] [instance: 90bd76df-96cb-4bec-9862-853d94cdbaab] Successfully created port: 3b9b5b2a-5b1b-4ec6-900d-c27e7c4a625e {{(pid=75229) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 09:43:55 user nova-compute[75229]: DEBUG nova.compute.manager [None req-5d922a01-a874-465d-8f1e-51377ec600a2 tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] [instance: e09b3809-2e23-401c-9a72-88feb2bb657c] Allocating IP information in the background. {{(pid=75229) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 09:43:55 user nova-compute[75229]: DEBUG nova.network.neutron [None req-5d922a01-a874-465d-8f1e-51377ec600a2 tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] [instance: e09b3809-2e23-401c-9a72-88feb2bb657c] allocate_for_instance() {{(pid=75229) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 09:43:55 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-5d922a01-a874-465d-8f1e-51377ec600a2 tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] [instance: e09b3809-2e23-401c-9a72-88feb2bb657c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 09:43:56 user nova-compute[75229]: DEBUG nova.compute.manager [None req-5d922a01-a874-465d-8f1e-51377ec600a2 tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] [instance: e09b3809-2e23-401c-9a72-88feb2bb657c] Start building block device mappings for instance. {{(pid=75229) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 09:43:56 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-0263f621-3230-4ce3-bd4e-7446204bb0ce tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7750cbc-b3d0-44aa-8b88-c291ba007a8a/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:43:56 user nova-compute[75229]: DEBUG nova.virt.disk.api [None req-0263f621-3230-4ce3-bd4e-7446204bb0ce tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Cannot resize image /opt/stack/data/nova/instances/a7750cbc-b3d0-44aa-8b88-c291ba007a8a/disk to a smaller size. {{(pid=75229) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 09:43:56 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-0263f621-3230-4ce3-bd4e-7446204bb0ce tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] [instance: a7750cbc-b3d0-44aa-8b88-c291ba007a8a] Created local disks {{(pid=75229) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 09:43:56 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-0263f621-3230-4ce3-bd4e-7446204bb0ce tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] [instance: a7750cbc-b3d0-44aa-8b88-c291ba007a8a] Ensure instance console log exists: /opt/stack/data/nova/instances/a7750cbc-b3d0-44aa-8b88-c291ba007a8a/console.log {{(pid=75229) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 09:43:56 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-0263f621-3230-4ce3-bd4e-7446204bb0ce tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:43:56 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-0263f621-3230-4ce3-bd4e-7446204bb0ce tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:43:56 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-0263f621-3230-4ce3-bd4e-7446204bb0ce tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.002s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:43:56 user nova-compute[75229]: DEBUG nova.compute.manager [None req-5d922a01-a874-465d-8f1e-51377ec600a2 tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] [instance: e09b3809-2e23-401c-9a72-88feb2bb657c] Start spawning the instance on the hypervisor. {{(pid=75229) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 09:43:56 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-5d922a01-a874-465d-8f1e-51377ec600a2 tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] [instance: e09b3809-2e23-401c-9a72-88feb2bb657c] Creating instance directory {{(pid=75229) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 09:43:56 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-5d922a01-a874-465d-8f1e-51377ec600a2 tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] [instance: e09b3809-2e23-401c-9a72-88feb2bb657c] Creating image(s)
Nov 14 09:43:56 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-5d922a01-a874-465d-8f1e-51377ec600a2 tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] Acquiring lock "/opt/stack/data/nova/instances/e09b3809-2e23-401c-9a72-88feb2bb657c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:43:56 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-5d922a01-a874-465d-8f1e-51377ec600a2 tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] Lock "/opt/stack/data/nova/instances/e09b3809-2e23-401c-9a72-88feb2bb657c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:43:56 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-5d922a01-a874-465d-8f1e-51377ec600a2 tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] Lock "/opt/stack/data/nova/instances/e09b3809-2e23-401c-9a72-88feb2bb657c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:43:56 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-5d922a01-a874-465d-8f1e-51377ec600a2 tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6 --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:43:56 user nova-compute[75229]: DEBUG nova.network.neutron [None req-6fb168db-88e3-470e-a460-f02dcd74cc8e tempest-DeleteServersTestJSON-1002799117 tempest-DeleteServersTestJSON-1002799117-project-member] [instance: 359ff85c-c332-4059-8db4-689a0483d068] Successfully created port: a799c237-ea4a-472d-b149-904fabda7414 {{(pid=75229) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 09:43:56 user nova-compute[75229]: DEBUG nova.policy [None req-5d922a01-a874-465d-8f1e-51377ec600a2 tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fbe8d49b2c9e43cf98f14f49fa8de80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dca06fda8b43d5bc92fa7c97a872a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75229) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 09:43:56 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-5d922a01-a874-465d-8f1e-51377ec600a2 tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6 --force-share --output=json" returned: 0 in 0.183s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:43:56 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-5d922a01-a874-465d-8f1e-51377ec600a2 tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] Acquiring lock "4f30e3fe703d2381679612a57b1fb80a467f60b6" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:43:56 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-5d922a01-a874-465d-8f1e-51377ec600a2 tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] Lock "4f30e3fe703d2381679612a57b1fb80a467f60b6" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:43:56 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-5d922a01-a874-465d-8f1e-51377ec600a2 tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6 --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:43:56 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-5d922a01-a874-465d-8f1e-51377ec600a2 tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6 --force-share --output=json" returned: 0 in 0.205s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:43:56 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-5d922a01-a874-465d-8f1e-51377ec600a2 tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6,backing_fmt=raw /opt/stack/data/nova/instances/e09b3809-2e23-401c-9a72-88feb2bb657c/disk 1073741824 {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:43:56 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-5d922a01-a874-465d-8f1e-51377ec600a2 tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6,backing_fmt=raw /opt/stack/data/nova/instances/e09b3809-2e23-401c-9a72-88feb2bb657c/disk 1073741824" returned: 0 in 0.042s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:43:56 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-5d922a01-a874-465d-8f1e-51377ec600a2 tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] Lock "4f30e3fe703d2381679612a57b1fb80a467f60b6" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.251s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:43:56 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-5d922a01-a874-465d-8f1e-51377ec600a2 tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6 --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:43:56 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-5d922a01-a874-465d-8f1e-51377ec600a2 tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6 --force-share --output=json" returned: 0 in 0.155s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:43:56 user nova-compute[75229]: DEBUG nova.virt.disk.api [None req-5d922a01-a874-465d-8f1e-51377ec600a2 tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e09b3809-2e23-401c-9a72-88feb2bb657c/disk. size=1073741824 {{(pid=75229) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 09:43:56 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-5d922a01-a874-465d-8f1e-51377ec600a2 tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e09b3809-2e23-401c-9a72-88feb2bb657c/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:43:56 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-5d922a01-a874-465d-8f1e-51377ec600a2 tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e09b3809-2e23-401c-9a72-88feb2bb657c/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:43:56 user nova-compute[75229]: DEBUG nova.virt.disk.api [None req-5d922a01-a874-465d-8f1e-51377ec600a2 tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] Cannot resize image /opt/stack/data/nova/instances/e09b3809-2e23-401c-9a72-88feb2bb657c/disk to a smaller size. {{(pid=75229) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 09:43:56 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-5d922a01-a874-465d-8f1e-51377ec600a2 tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] [instance: e09b3809-2e23-401c-9a72-88feb2bb657c] Created local disks {{(pid=75229) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 09:43:56 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-5d922a01-a874-465d-8f1e-51377ec600a2 tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] [instance: e09b3809-2e23-401c-9a72-88feb2bb657c] Ensure instance console log exists: /opt/stack/data/nova/instances/e09b3809-2e23-401c-9a72-88feb2bb657c/console.log {{(pid=75229) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 09:43:56 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-5d922a01-a874-465d-8f1e-51377ec600a2 tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:43:56 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-5d922a01-a874-465d-8f1e-51377ec600a2 tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:43:56 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-5d922a01-a874-465d-8f1e-51377ec600a2 tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:43:57 user nova-compute[75229]: DEBUG nova.network.neutron [None req-0263f621-3230-4ce3-bd4e-7446204bb0ce tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] [instance: a7750cbc-b3d0-44aa-8b88-c291ba007a8a] Successfully created port: e5b20e94-618c-4c51-b20f-1d3f1fb921b6 {{(pid=75229) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 09:43:57 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-296d9af7-abae-42fe-8ef6-92010ee7dd1b tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] Acquiring lock "a60d339f-e134-477c-8505-bf8c79d2a21c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:43:57 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-296d9af7-abae-42fe-8ef6-92010ee7dd1b tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] Lock "a60d339f-e134-477c-8505-bf8c79d2a21c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:43:57 user nova-compute[75229]: DEBUG nova.compute.manager [None req-296d9af7-abae-42fe-8ef6-92010ee7dd1b tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] [instance: a60d339f-e134-477c-8505-bf8c79d2a21c] Starting instance... {{(pid=75229) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 09:43:57 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-296d9af7-abae-42fe-8ef6-92010ee7dd1b tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:43:57 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-296d9af7-abae-42fe-8ef6-92010ee7dd1b tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:43:57 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-296d9af7-abae-42fe-8ef6-92010ee7dd1b tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75229) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 09:43:57 user nova-compute[75229]: INFO nova.compute.claims [None req-296d9af7-abae-42fe-8ef6-92010ee7dd1b tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] [instance: a60d339f-e134-477c-8505-bf8c79d2a21c] Claim successful on node user
Nov 14 09:43:58 user nova-compute[75229]: DEBUG nova.network.neutron [None req-5d922a01-a874-465d-8f1e-51377ec600a2 tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] [instance: e09b3809-2e23-401c-9a72-88feb2bb657c] Successfully created port: 472488d2-9453-4d74-a6b1-6966b835572d {{(pid=75229) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 09:43:58 user nova-compute[75229]: DEBUG nova.compute.provider_tree [None req-296d9af7-abae-42fe-8ef6-92010ee7dd1b tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] Inventory has not changed in ProviderTree for provider: d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 {{(pid=75229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 09:43:58 user nova-compute[75229]: DEBUG nova.scheduler.client.report [None req-296d9af7-abae-42fe-8ef6-92010ee7dd1b tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] Inventory has not changed for provider d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 09:43:58 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-296d9af7-abae-42fe-8ef6-92010ee7dd1b tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.324s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:43:58 user nova-compute[75229]: DEBUG nova.compute.manager [None req-296d9af7-abae-42fe-8ef6-92010ee7dd1b tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] [instance: a60d339f-e134-477c-8505-bf8c79d2a21c] Start building networks asynchronously for instance. {{(pid=75229) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 09:43:58 user nova-compute[75229]: DEBUG nova.network.neutron [None req-3b6c1bc3-20bd-4c38-907a-c3586f51b9bc tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] [instance: 90bd76df-96cb-4bec-9862-853d94cdbaab] Successfully updated port: 3b9b5b2a-5b1b-4ec6-900d-c27e7c4a625e {{(pid=75229) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 09:43:58 user nova-compute[75229]: DEBUG nova.compute.manager [None req-296d9af7-abae-42fe-8ef6-92010ee7dd1b tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] [instance: a60d339f-e134-477c-8505-bf8c79d2a21c] Allocating IP information in the background. {{(pid=75229) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 09:43:58 user nova-compute[75229]: DEBUG nova.network.neutron [None req-296d9af7-abae-42fe-8ef6-92010ee7dd1b tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] [instance: a60d339f-e134-477c-8505-bf8c79d2a21c] allocate_for_instance() {{(pid=75229) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 09:43:58 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-296d9af7-abae-42fe-8ef6-92010ee7dd1b tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] [instance: a60d339f-e134-477c-8505-bf8c79d2a21c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 09:43:58 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-3b6c1bc3-20bd-4c38-907a-c3586f51b9bc tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Acquiring lock "refresh_cache-90bd76df-96cb-4bec-9862-853d94cdbaab" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 09:43:58 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-3b6c1bc3-20bd-4c38-907a-c3586f51b9bc tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Acquired lock "refresh_cache-90bd76df-96cb-4bec-9862-853d94cdbaab" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 09:43:58 user nova-compute[75229]: DEBUG nova.network.neutron [None req-3b6c1bc3-20bd-4c38-907a-c3586f51b9bc tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] [instance: 90bd76df-96cb-4bec-9862-853d94cdbaab] Building network info cache for instance {{(pid=75229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 09:43:58 user nova-compute[75229]: DEBUG nova.compute.manager [None req-296d9af7-abae-42fe-8ef6-92010ee7dd1b tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] [instance: a60d339f-e134-477c-8505-bf8c79d2a21c] Start building block device mappings for instance. {{(pid=75229) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 09:43:58 user nova-compute[75229]: DEBUG nova.compute.manager [None req-296d9af7-abae-42fe-8ef6-92010ee7dd1b tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] [instance: a60d339f-e134-477c-8505-bf8c79d2a21c] Start spawning the instance on the hypervisor. {{(pid=75229) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 09:43:58 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-296d9af7-abae-42fe-8ef6-92010ee7dd1b tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] [instance: a60d339f-e134-477c-8505-bf8c79d2a21c] Creating instance directory {{(pid=75229) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 09:43:58 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-296d9af7-abae-42fe-8ef6-92010ee7dd1b tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] [instance: a60d339f-e134-477c-8505-bf8c79d2a21c] Creating image(s)
Nov 14 09:43:58 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-296d9af7-abae-42fe-8ef6-92010ee7dd1b tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] Acquiring lock "/opt/stack/data/nova/instances/a60d339f-e134-477c-8505-bf8c79d2a21c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:43:58 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-296d9af7-abae-42fe-8ef6-92010ee7dd1b tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] Lock "/opt/stack/data/nova/instances/a60d339f-e134-477c-8505-bf8c79d2a21c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:43:58 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-296d9af7-abae-42fe-8ef6-92010ee7dd1b tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] Lock "/opt/stack/data/nova/instances/a60d339f-e134-477c-8505-bf8c79d2a21c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:43:58 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-296d9af7-abae-42fe-8ef6-92010ee7dd1b tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6 --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:43:58 user nova-compute[75229]: DEBUG nova.network.neutron [None req-3b6c1bc3-20bd-4c38-907a-c3586f51b9bc tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] [instance: 90bd76df-96cb-4bec-9862-853d94cdbaab] Instance cache missing network info. {{(pid=75229) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 09:43:58 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-296d9af7-abae-42fe-8ef6-92010ee7dd1b tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6 --force-share --output=json" returned: 0 in 0.165s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:43:58 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-296d9af7-abae-42fe-8ef6-92010ee7dd1b tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] Acquiring lock "4f30e3fe703d2381679612a57b1fb80a467f60b6" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:43:58 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-296d9af7-abae-42fe-8ef6-92010ee7dd1b tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] Lock "4f30e3fe703d2381679612a57b1fb80a467f60b6" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:43:58 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-296d9af7-abae-42fe-8ef6-92010ee7dd1b tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6 --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:43:58 user nova-compute[75229]: DEBUG nova.policy [None req-296d9af7-abae-42fe-8ef6-92010ee7dd1b tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '39c6903e2d154e838835eb5265776521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32e17c7c586542139cdbc5bfda57e075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75229) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 09:43:58 user nova-compute[75229]: DEBUG nova.network.neutron [None req-6fb168db-88e3-470e-a460-f02dcd74cc8e tempest-DeleteServersTestJSON-1002799117 tempest-DeleteServersTestJSON-1002799117-project-member] [instance: 359ff85c-c332-4059-8db4-689a0483d068] Successfully updated port: a799c237-ea4a-472d-b149-904fabda7414 {{(pid=75229) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 09:43:58 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-6fb168db-88e3-470e-a460-f02dcd74cc8e tempest-DeleteServersTestJSON-1002799117 tempest-DeleteServersTestJSON-1002799117-project-member] Acquiring lock "refresh_cache-359ff85c-c332-4059-8db4-689a0483d068" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 09:43:58 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-6fb168db-88e3-470e-a460-f02dcd74cc8e tempest-DeleteServersTestJSON-1002799117 tempest-DeleteServersTestJSON-1002799117-project-member] Acquired lock "refresh_cache-359ff85c-c332-4059-8db4-689a0483d068" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 09:43:58 user nova-compute[75229]: DEBUG nova.network.neutron [None req-6fb168db-88e3-470e-a460-f02dcd74cc8e tempest-DeleteServersTestJSON-1002799117 tempest-DeleteServersTestJSON-1002799117-project-member] [instance: 359ff85c-c332-4059-8db4-689a0483d068] Building network info cache for instance {{(pid=75229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 09:43:58 user nova-compute[75229]: DEBUG nova.compute.manager [req-a266505b-7f42-4fa5-8e9e-5075d9bfd06e req-bfdd3e1d-9e35-4285-b0c4-881271fae8b6 service nova] [instance: 90bd76df-96cb-4bec-9862-853d94cdbaab] Received event network-changed-3b9b5b2a-5b1b-4ec6-900d-c27e7c4a625e {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:43:58 user nova-compute[75229]: DEBUG nova.compute.manager [req-a266505b-7f42-4fa5-8e9e-5075d9bfd06e req-bfdd3e1d-9e35-4285-b0c4-881271fae8b6 service nova] [instance: 90bd76df-96cb-4bec-9862-853d94cdbaab] Refreshing instance network info cache due to event network-changed-3b9b5b2a-5b1b-4ec6-900d-c27e7c4a625e. {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 09:43:58 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-a266505b-7f42-4fa5-8e9e-5075d9bfd06e req-bfdd3e1d-9e35-4285-b0c4-881271fae8b6 service nova] Acquiring lock "refresh_cache-90bd76df-96cb-4bec-9862-853d94cdbaab" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 09:43:58 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-296d9af7-abae-42fe-8ef6-92010ee7dd1b tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6 --force-share --output=json" returned: 0 in 0.167s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:43:58 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-296d9af7-abae-42fe-8ef6-92010ee7dd1b tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6,backing_fmt=raw /opt/stack/data/nova/instances/a60d339f-e134-477c-8505-bf8c79d2a21c/disk 1073741824 {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:43:58 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-296d9af7-abae-42fe-8ef6-92010ee7dd1b tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6,backing_fmt=raw /opt/stack/data/nova/instances/a60d339f-e134-477c-8505-bf8c79d2a21c/disk 1073741824" returned: 0 in 0.040s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:43:58 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-296d9af7-abae-42fe-8ef6-92010ee7dd1b tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] Lock "4f30e3fe703d2381679612a57b1fb80a467f60b6" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.211s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:43:58 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-296d9af7-abae-42fe-8ef6-92010ee7dd1b tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6 --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:43:58 user nova-compute[75229]: DEBUG nova.network.neutron [None req-6fb168db-88e3-470e-a460-f02dcd74cc8e tempest-DeleteServersTestJSON-1002799117 tempest-DeleteServersTestJSON-1002799117-project-member] [instance: 359ff85c-c332-4059-8db4-689a0483d068] Instance cache missing network info. {{(pid=75229) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 09:43:59 user nova-compute[75229]: DEBUG nova.compute.manager [req-1ddf9a7c-29aa-4f11-9ec9-704dc3ec9dbf req-48512f9a-fd23-4cff-88f2-cde334a5e98c service nova] [instance: 359ff85c-c332-4059-8db4-689a0483d068] Received event network-changed-a799c237-ea4a-472d-b149-904fabda7414 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:43:59 user nova-compute[75229]: DEBUG nova.compute.manager [req-1ddf9a7c-29aa-4f11-9ec9-704dc3ec9dbf req-48512f9a-fd23-4cff-88f2-cde334a5e98c service nova] [instance: 359ff85c-c332-4059-8db4-689a0483d068] Refreshing instance network info cache due to event network-changed-a799c237-ea4a-472d-b149-904fabda7414. {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 09:43:59 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-1ddf9a7c-29aa-4f11-9ec9-704dc3ec9dbf req-48512f9a-fd23-4cff-88f2-cde334a5e98c service nova] Acquiring lock "refresh_cache-359ff85c-c332-4059-8db4-689a0483d068" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 09:43:59 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-296d9af7-abae-42fe-8ef6-92010ee7dd1b tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6 --force-share --output=json" returned: 0 in 0.192s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:43:59 user nova-compute[75229]: DEBUG nova.virt.disk.api [None req-296d9af7-abae-42fe-8ef6-92010ee7dd1b tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a60d339f-e134-477c-8505-bf8c79d2a21c/disk. size=1073741824 {{(pid=75229) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 09:43:59 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-296d9af7-abae-42fe-8ef6-92010ee7dd1b tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a60d339f-e134-477c-8505-bf8c79d2a21c/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:43:59 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-296d9af7-abae-42fe-8ef6-92010ee7dd1b tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a60d339f-e134-477c-8505-bf8c79d2a21c/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:43:59 user nova-compute[75229]: DEBUG nova.virt.disk.api [None req-296d9af7-abae-42fe-8ef6-92010ee7dd1b tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] Cannot resize image /opt/stack/data/nova/instances/a60d339f-e134-477c-8505-bf8c79d2a21c/disk to a smaller size. {{(pid=75229) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 09:43:59 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-296d9af7-abae-42fe-8ef6-92010ee7dd1b tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] [instance: a60d339f-e134-477c-8505-bf8c79d2a21c] Created local disks {{(pid=75229) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 09:43:59 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-296d9af7-abae-42fe-8ef6-92010ee7dd1b tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] [instance: a60d339f-e134-477c-8505-bf8c79d2a21c] Ensure instance console log exists: /opt/stack/data/nova/instances/a60d339f-e134-477c-8505-bf8c79d2a21c/console.log {{(pid=75229) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 09:43:59 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-296d9af7-abae-42fe-8ef6-92010ee7dd1b tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:43:59 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-296d9af7-abae-42fe-8ef6-92010ee7dd1b tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:43:59 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-296d9af7-abae-42fe-8ef6-92010ee7dd1b tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:43:59 user nova-compute[75229]: DEBUG nova.network.neutron [None req-3b6c1bc3-20bd-4c38-907a-c3586f51b9bc tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] [instance: 90bd76df-96cb-4bec-9862-853d94cdbaab] Updating instance_info_cache with network_info: [{"id": "3b9b5b2a-5b1b-4ec6-900d-c27e7c4a625e", "address": "fa:16:3e:6e:aa:df", "network": {"id": "589aea41-545f-4875-ab56-b7aa273dad6f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-785276916-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee9447f169de43829fe3ed51592752e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b9b5b2a-5b", "ovs_interfaceid": "3b9b5b2a-5b1b-4ec6-900d-c27e7c4a625e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 09:43:59 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-3b6c1bc3-20bd-4c38-907a-c3586f51b9bc tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Releasing lock "refresh_cache-90bd76df-96cb-4bec-9862-853d94cdbaab" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 09:43:59 user nova-compute[75229]: DEBUG nova.compute.manager [None req-3b6c1bc3-20bd-4c38-907a-c3586f51b9bc tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] [instance: 90bd76df-96cb-4bec-9862-853d94cdbaab] Instance network_info: |[{"id": "3b9b5b2a-5b1b-4ec6-900d-c27e7c4a625e", "address": "fa:16:3e:6e:aa:df", "network": {"id": "589aea41-545f-4875-ab56-b7aa273dad6f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-785276916-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee9447f169de43829fe3ed51592752e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b9b5b2a-5b", "ovs_interfaceid": "3b9b5b2a-5b1b-4ec6-900d-c27e7c4a625e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75229) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 09:43:59 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-a266505b-7f42-4fa5-8e9e-5075d9bfd06e req-bfdd3e1d-9e35-4285-b0c4-881271fae8b6 service nova] Acquired lock "refresh_cache-90bd76df-96cb-4bec-9862-853d94cdbaab" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 09:43:59 user nova-compute[75229]: DEBUG nova.network.neutron [req-a266505b-7f42-4fa5-8e9e-5075d9bfd06e req-bfdd3e1d-9e35-4285-b0c4-881271fae8b6 service nova] [instance: 90bd76df-96cb-4bec-9862-853d94cdbaab] Refreshing network info cache for port 3b9b5b2a-5b1b-4ec6-900d-c27e7c4a625e {{(pid=75229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 09:43:59 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-3b6c1bc3-20bd-4c38-907a-c3586f51b9bc tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] [instance: 90bd76df-96cb-4bec-9862-853d94cdbaab] Start _get_guest_xml network_info=[{"id": "3b9b5b2a-5b1b-4ec6-900d-c27e7c4a625e", "address": "fa:16:3e:6e:aa:df", "network": {"id": "589aea41-545f-4875-ab56-b7aa273dad6f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-785276916-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee9447f169de43829fe3ed51592752e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b9b5b2a-5b", "ovs_interfaceid": "3b9b5b2a-5b1b-4ec6-900d-c27e7c4a625e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T09:40:10Z,direct_url=<?>,disk_format='qcow2',id=3bef8470-ecc7-40e3-95d4-9254348ea72d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='de5a91106b6948ed937a7178ff9464c4',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T09:40:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'disk_bus': 'virtio', 'guest_format': None, 'encryption_secret_uuid': None, 'size': 0, 'device_type': 'disk', 'image_id': '3bef8470-ecc7-40e3-95d4-9254348ea72d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75229) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 09:43:59 user nova-compute[75229]: WARNING nova.virt.libvirt.driver [None req-3b6c1bc3-20bd-4c38-907a-c3586f51b9bc tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 09:43:59 user nova-compute[75229]: WARNING nova.virt.libvirt.driver [None req-3b6c1bc3-20bd-4c38-907a-c3586f51b9bc tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 09:43:59 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-3b6c1bc3-20bd-4c38-907a-c3586f51b9bc tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75229) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 09:43:59 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-3b6c1bc3-20bd-4c38-907a-c3586f51b9bc tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] CPU controller missing on host. {{(pid=75229) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 09:43:59 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-3b6c1bc3-20bd-4c38-907a-c3586f51b9bc tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75229) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 09:43:59 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-3b6c1bc3-20bd-4c38-907a-c3586f51b9bc tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] CPU controller found on host. {{(pid=75229) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 09:43:59 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-3b6c1bc3-20bd-4c38-907a-c3586f51b9bc tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75229) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 09:43:59 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-3b6c1bc3-20bd-4c38-907a-c3586f51b9bc tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T09:39:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T09:40:10Z,direct_url=<?>,disk_format='qcow2',id=3bef8470-ecc7-40e3-95d4-9254348ea72d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='de5a91106b6948ed937a7178ff9464c4',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T09:40:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 09:43:59 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-3b6c1bc3-20bd-4c38-907a-c3586f51b9bc tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Flavor limits 0:0:0 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 09:43:59 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-3b6c1bc3-20bd-4c38-907a-c3586f51b9bc tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Image limits 0:0:0 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 09:43:59 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-3b6c1bc3-20bd-4c38-907a-c3586f51b9bc tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Flavor pref 0:0:0 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 09:43:59 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-3b6c1bc3-20bd-4c38-907a-c3586f51b9bc tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Image pref 0:0:0 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 09:43:59 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-3b6c1bc3-20bd-4c38-907a-c3586f51b9bc tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 09:43:59 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-3b6c1bc3-20bd-4c38-907a-c3586f51b9bc tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 09:43:59 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-3b6c1bc3-20bd-4c38-907a-c3586f51b9bc tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75229) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 09:43:59 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-3b6c1bc3-20bd-4c38-907a-c3586f51b9bc tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Got 1 possible topologies {{(pid=75229) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 09:43:59 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-3b6c1bc3-20bd-4c38-907a-c3586f51b9bc tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 09:43:59 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-3b6c1bc3-20bd-4c38-907a-c3586f51b9bc tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 09:43:59 user nova-compute[75229]: DEBUG nova.privsep.utils [None req-3b6c1bc3-20bd-4c38-907a-c3586f51b9bc tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75229) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 14 09:43:59 user nova-compute[75229]: DEBUG nova.virt.libvirt.vif [None req-3b6c1bc3-20bd-4c38-907a-c3586f51b9bc tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T09:43:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-87180804',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-87180804',id=1,image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBONBC1lBOnKk20p2/o3g2DEYV4S0MmOiqL/3y6SgEGtYnRMtY9LagRV/BjgoGYzS5kUwcO+hOCn5LYUUXOZHlgFkRWsPnsSDpaRCWI7qP5isDTcuxzANHv5hb9uWPGI5Xw==',key_name='tempest-keypair-454270943',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ee9447f169de43829fe3ed51592752e9',ramdisk_id='',reservation_id='r-p5469a2c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-730167895',owner_user_name='tempest-AttachVolumeShelveTestJSON-730167895-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T09:43:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='319a0a5ee47a426799d40e0ebb62a3b0',uuid=90bd76df-96cb-4bec-9862-853d94cdbaab,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3b9b5b2a-5b1b-4ec6-900d-c27e7c4a625e", "address": "fa:16:3e:6e:aa:df", "network": {"id": "589aea41-545f-4875-ab56-b7aa273dad6f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-785276916-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee9447f169de43829fe3ed51592752e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b9b5b2a-5b", "ovs_interfaceid": "3b9b5b2a-5b1b-4ec6-900d-c27e7c4a625e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75229) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 09:43:59 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-3b6c1bc3-20bd-4c38-907a-c3586f51b9bc tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Converting VIF {"id": "3b9b5b2a-5b1b-4ec6-900d-c27e7c4a625e", "address": "fa:16:3e:6e:aa:df", "network": {"id": "589aea41-545f-4875-ab56-b7aa273dad6f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-785276916-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee9447f169de43829fe3ed51592752e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b9b5b2a-5b", "ovs_interfaceid": "3b9b5b2a-5b1b-4ec6-900d-c27e7c4a625e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 09:43:59 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-3b6c1bc3-20bd-4c38-907a-c3586f51b9bc tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6e:aa:df,bridge_name='br-int',has_traffic_filtering=True,id=3b9b5b2a-5b1b-4ec6-900d-c27e7c4a625e,network=Network(589aea41-545f-4875-ab56-b7aa273dad6f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b9b5b2a-5b') {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 09:43:59 user nova-compute[75229]: DEBUG nova.objects.instance [None req-3b6c1bc3-20bd-4c38-907a-c3586f51b9bc tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Lazy-loading 'pci_devices' on Instance uuid 90bd76df-96cb-4bec-9862-853d94cdbaab {{(pid=75229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 09:43:59 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-3b6c1bc3-20bd-4c38-907a-c3586f51b9bc tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] [instance: 90bd76df-96cb-4bec-9862-853d94cdbaab] End _get_guest_xml xml=<domain type="kvm">
Nov 14 09:43:59 user nova-compute[75229]:   <uuid>90bd76df-96cb-4bec-9862-853d94cdbaab</uuid>
Nov 14 09:43:59 user nova-compute[75229]:   <name>instance-00000001</name>
Nov 14 09:43:59 user nova-compute[75229]:   <memory>524288</memory>
Nov 14 09:43:59 user nova-compute[75229]:   <vcpu>1</vcpu>
Nov 14 09:43:59 user nova-compute[75229]:   <metadata>
Nov 14 09:43:59 user nova-compute[75229]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 09:43:59 user nova-compute[75229]:       <nova:package version="0.0.0"/>
Nov 14 09:43:59 user nova-compute[75229]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-87180804</nova:name>
Nov 14 09:43:59 user nova-compute[75229]:       <nova:creationTime>2023-11-14 09:43:59</nova:creationTime>
Nov 14 09:43:59 user nova-compute[75229]:       <nova:flavor name="m1.tiny">
Nov 14 09:43:59 user nova-compute[75229]:         <nova:memory>512</nova:memory>
Nov 14 09:43:59 user nova-compute[75229]:         <nova:disk>1</nova:disk>
Nov 14 09:43:59 user nova-compute[75229]:         <nova:swap>0</nova:swap>
Nov 14 09:43:59 user nova-compute[75229]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 09:43:59 user nova-compute[75229]:         <nova:vcpus>1</nova:vcpus>
Nov 14 09:43:59 user nova-compute[75229]:       </nova:flavor>
Nov 14 09:43:59 user nova-compute[75229]:       <nova:owner>
Nov 14 09:43:59 user nova-compute[75229]:         <nova:user uuid="319a0a5ee47a426799d40e0ebb62a3b0">tempest-AttachVolumeShelveTestJSON-730167895-project-member</nova:user>
Nov 14 09:43:59 user nova-compute[75229]:         <nova:project uuid="ee9447f169de43829fe3ed51592752e9">tempest-AttachVolumeShelveTestJSON-730167895</nova:project>
Nov 14 09:43:59 user nova-compute[75229]:       </nova:owner>
Nov 14 09:43:59 user nova-compute[75229]:       <nova:root type="image" uuid="3bef8470-ecc7-40e3-95d4-9254348ea72d"/>
Nov 14 09:43:59 user nova-compute[75229]:       <nova:ports>
Nov 14 09:43:59 user nova-compute[75229]:         <nova:port uuid="3b9b5b2a-5b1b-4ec6-900d-c27e7c4a625e">
Nov 14 09:43:59 user nova-compute[75229]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 14 09:43:59 user nova-compute[75229]:         </nova:port>
Nov 14 09:43:59 user nova-compute[75229]:       </nova:ports>
Nov 14 09:43:59 user nova-compute[75229]:     </nova:instance>
Nov 14 09:43:59 user nova-compute[75229]:   </metadata>
Nov 14 09:43:59 user nova-compute[75229]:   <sysinfo type="smbios">
Nov 14 09:43:59 user nova-compute[75229]:     <system>
Nov 14 09:43:59 user nova-compute[75229]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 09:43:59 user nova-compute[75229]:       <entry name="product">OpenStack Nova</entry>
Nov 14 09:43:59 user nova-compute[75229]:       <entry name="version">0.0.0</entry>
Nov 14 09:43:59 user nova-compute[75229]:       <entry name="serial">90bd76df-96cb-4bec-9862-853d94cdbaab</entry>
Nov 14 09:43:59 user nova-compute[75229]:       <entry name="uuid">90bd76df-96cb-4bec-9862-853d94cdbaab</entry>
Nov 14 09:43:59 user nova-compute[75229]:       <entry name="family">Virtual Machine</entry>
Nov 14 09:43:59 user nova-compute[75229]:     </system>
Nov 14 09:43:59 user nova-compute[75229]:   </sysinfo>
Nov 14 09:43:59 user nova-compute[75229]:   <os>
Nov 14 09:43:59 user nova-compute[75229]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 09:43:59 user nova-compute[75229]:     <boot dev="hd"/>
Nov 14 09:43:59 user nova-compute[75229]:     <smbios mode="sysinfo"/>
Nov 14 09:43:59 user nova-compute[75229]:   </os>
Nov 14 09:43:59 user nova-compute[75229]:   <features>
Nov 14 09:43:59 user nova-compute[75229]:     <acpi/>
Nov 14 09:43:59 user nova-compute[75229]:     <apic/>
Nov 14 09:43:59 user nova-compute[75229]:     <vmcoreinfo/>
Nov 14 09:43:59 user nova-compute[75229]:   </features>
Nov 14 09:43:59 user nova-compute[75229]:   <clock offset="utc">
Nov 14 09:43:59 user nova-compute[75229]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 09:43:59 user nova-compute[75229]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 09:43:59 user nova-compute[75229]:     <timer name="hpet" present="no"/>
Nov 14 09:43:59 user nova-compute[75229]:   </clock>
Nov 14 09:43:59 user nova-compute[75229]:   <cpu mode="custom" match="exact">
Nov 14 09:43:59 user nova-compute[75229]:     <model>Nehalem</model>
Nov 14 09:43:59 user nova-compute[75229]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 09:43:59 user nova-compute[75229]:   </cpu>
Nov 14 09:43:59 user nova-compute[75229]:   <devices>
Nov 14 09:43:59 user nova-compute[75229]:     <disk type="file" device="disk">
Nov 14 09:43:59 user nova-compute[75229]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 09:43:59 user nova-compute[75229]:       <source file="/opt/stack/data/nova/instances/90bd76df-96cb-4bec-9862-853d94cdbaab/disk"/>
Nov 14 09:43:59 user nova-compute[75229]:       <target dev="vda" bus="virtio"/>
Nov 14 09:43:59 user nova-compute[75229]:     </disk>
Nov 14 09:43:59 user nova-compute[75229]:     <interface type="ethernet">
Nov 14 09:43:59 user nova-compute[75229]:       <mac address="fa:16:3e:6e:aa:df"/>
Nov 14 09:43:59 user nova-compute[75229]:       <model type="virtio"/>
Nov 14 09:43:59 user nova-compute[75229]:       <mtu size="1442"/>
Nov 14 09:43:59 user nova-compute[75229]:       <target dev="tap3b9b5b2a-5b"/>
Nov 14 09:43:59 user nova-compute[75229]:     </interface>
Nov 14 09:43:59 user nova-compute[75229]:     <serial type="pty">
Nov 14 09:43:59 user nova-compute[75229]:       <log file="/opt/stack/data/nova/instances/90bd76df-96cb-4bec-9862-853d94cdbaab/console.log" append="off"/>
Nov 14 09:43:59 user nova-compute[75229]:     </serial>
Nov 14 09:43:59 user nova-compute[75229]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 09:43:59 user nova-compute[75229]:     <video>
Nov 14 09:43:59 user nova-compute[75229]:       <model type="virtio"/>
Nov 14 09:43:59 user nova-compute[75229]:     </video>
Nov 14 09:43:59 user nova-compute[75229]:     <rng model="virtio">
Nov 14 09:43:59 user nova-compute[75229]:       <backend model="random">/dev/urandom</backend>
Nov 14 09:43:59 user nova-compute[75229]:     </rng>
Nov 14 09:43:59 user nova-compute[75229]:     <controller type="usb" index="0" model="none"/>
Nov 14 09:43:59 user nova-compute[75229]:     <memballoon model="virtio">
Nov 14 09:43:59 user nova-compute[75229]:       <stats period="10"/>
Nov 14 09:43:59 user nova-compute[75229]:     </memballoon>
Nov 14 09:43:59 user nova-compute[75229]:   </devices>
Nov 14 09:43:59 user nova-compute[75229]: </domain>
Nov 14 09:43:59 user nova-compute[75229]:  {{(pid=75229) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 09:43:59 user nova-compute[75229]: DEBUG nova.virt.libvirt.vif [None req-3b6c1bc3-20bd-4c38-907a-c3586f51b9bc tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T09:43:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-87180804',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-87180804',id=1,image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBONBC1lBOnKk20p2/o3g2DEYV4S0MmOiqL/3y6SgEGtYnRMtY9LagRV/BjgoGYzS5kUwcO+hOCn5LYUUXOZHlgFkRWsPnsSDpaRCWI7qP5isDTcuxzANHv5hb9uWPGI5Xw==',key_name='tempest-keypair-454270943',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ee9447f169de43829fe3ed51592752e9',ramdisk_id='',reservation_id='r-p5469a2c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-730167895',owner_user_name='tempest-AttachVolumeShelveTestJSON-730167895-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T09:43:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='319a0a5ee47a426799d40e0ebb62a3b0',uuid=90bd76df-96cb-4bec-9862-853d94cdbaab,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3b9b5b2a-5b1b-4ec6-900d-c27e7c4a625e", "address": "fa:16:3e:6e:aa:df", "network": {"id": "589aea41-545f-4875-ab56-b7aa273dad6f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-785276916-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee9447f169de43829fe3ed51592752e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b9b5b2a-5b", "ovs_interfaceid": "3b9b5b2a-5b1b-4ec6-900d-c27e7c4a625e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 09:43:59 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-3b6c1bc3-20bd-4c38-907a-c3586f51b9bc tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Converting VIF {"id": "3b9b5b2a-5b1b-4ec6-900d-c27e7c4a625e", "address": "fa:16:3e:6e:aa:df", "network": {"id": "589aea41-545f-4875-ab56-b7aa273dad6f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-785276916-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee9447f169de43829fe3ed51592752e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b9b5b2a-5b", "ovs_interfaceid": "3b9b5b2a-5b1b-4ec6-900d-c27e7c4a625e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 09:43:59 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-3b6c1bc3-20bd-4c38-907a-c3586f51b9bc tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6e:aa:df,bridge_name='br-int',has_traffic_filtering=True,id=3b9b5b2a-5b1b-4ec6-900d-c27e7c4a625e,network=Network(589aea41-545f-4875-ab56-b7aa273dad6f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b9b5b2a-5b') {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 09:43:59 user nova-compute[75229]: DEBUG os_vif [None req-3b6c1bc3-20bd-4c38-907a-c3586f51b9bc tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6e:aa:df,bridge_name='br-int',has_traffic_filtering=True,id=3b9b5b2a-5b1b-4ec6-900d-c27e7c4a625e,network=Network(589aea41-545f-4875-ab56-b7aa273dad6f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b9b5b2a-5b') {{(pid=75229) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 09:43:59 user nova-compute[75229]: DEBUG nova.network.neutron [None req-6fb168db-88e3-470e-a460-f02dcd74cc8e tempest-DeleteServersTestJSON-1002799117 tempest-DeleteServersTestJSON-1002799117-project-member] [instance: 359ff85c-c332-4059-8db4-689a0483d068] Updating instance_info_cache with network_info: [{"id": "a799c237-ea4a-472d-b149-904fabda7414", "address": "fa:16:3e:80:1f:b3", "network": {"id": "60446365-aa09-4526-8746-a7069b8083c7", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1696625928-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac677c251f874551947d944c52d1d7b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa799c237-ea", "ovs_interfaceid": "a799c237-ea4a-472d-b149-904fabda7414", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 09:43:59 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl [None req-3b6c1bc3-20bd-4c38-907a-c3586f51b9bc tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Created schema index Interface.name {{(pid=75229) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 14 09:43:59 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl [None req-3b6c1bc3-20bd-4c38-907a-c3586f51b9bc tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Created schema index Port.name {{(pid=75229) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 14 09:43:59 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl [None req-3b6c1bc3-20bd-4c38-907a-c3586f51b9bc tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Created schema index Bridge.name {{(pid=75229) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 14 09:43:59 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-3b6c1bc3-20bd-4c38-907a-c3586f51b9bc tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] tcp:127.0.0.1:6640: entering CONNECTING {{(pid=75229) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 09:43:59 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-3b6c1bc3-20bd-4c38-907a-c3586f51b9bc tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] [POLLOUT] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:43:59 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-3b6c1bc3-20bd-4c38-907a-c3586f51b9bc tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75229) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 09:43:59 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-6fb168db-88e3-470e-a460-f02dcd74cc8e tempest-DeleteServersTestJSON-1002799117 tempest-DeleteServersTestJSON-1002799117-project-member] Releasing lock "refresh_cache-359ff85c-c332-4059-8db4-689a0483d068" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 09:43:59 user nova-compute[75229]: DEBUG nova.compute.manager [None req-6fb168db-88e3-470e-a460-f02dcd74cc8e tempest-DeleteServersTestJSON-1002799117 tempest-DeleteServersTestJSON-1002799117-project-member] [instance: 359ff85c-c332-4059-8db4-689a0483d068] Instance network_info: |[{"id": "a799c237-ea4a-472d-b149-904fabda7414", "address": "fa:16:3e:80:1f:b3", "network": {"id": "60446365-aa09-4526-8746-a7069b8083c7", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1696625928-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac677c251f874551947d944c52d1d7b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa799c237-ea", "ovs_interfaceid": "a799c237-ea4a-472d-b149-904fabda7414", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75229) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 09:43:59 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-3b6c1bc3-20bd-4c38-907a-c3586f51b9bc tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:43:59 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-1ddf9a7c-29aa-4f11-9ec9-704dc3ec9dbf req-48512f9a-fd23-4cff-88f2-cde334a5e98c service nova] Acquired lock "refresh_cache-359ff85c-c332-4059-8db4-689a0483d068" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 09:43:59 user nova-compute[75229]: DEBUG nova.network.neutron [req-1ddf9a7c-29aa-4f11-9ec9-704dc3ec9dbf req-48512f9a-fd23-4cff-88f2-cde334a5e98c service nova] [instance: 359ff85c-c332-4059-8db4-689a0483d068] Refreshing network info cache for port a799c237-ea4a-472d-b149-904fabda7414 {{(pid=75229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 09:43:59 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-6fb168db-88e3-470e-a460-f02dcd74cc8e tempest-DeleteServersTestJSON-1002799117 tempest-DeleteServersTestJSON-1002799117-project-member] [instance: 359ff85c-c332-4059-8db4-689a0483d068] Start _get_guest_xml network_info=[{"id": "a799c237-ea4a-472d-b149-904fabda7414", "address": "fa:16:3e:80:1f:b3", "network": {"id": "60446365-aa09-4526-8746-a7069b8083c7", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1696625928-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac677c251f874551947d944c52d1d7b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa799c237-ea", "ovs_interfaceid": "a799c237-ea4a-472d-b149-904fabda7414", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T09:40:10Z,direct_url=<?>,disk_format='qcow2',id=3bef8470-ecc7-40e3-95d4-9254348ea72d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='de5a91106b6948ed937a7178ff9464c4',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T09:40:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'disk_bus': 'virtio', 'guest_format': None, 'encryption_secret_uuid': None, 'size': 0, 'device_type': 'disk', 'image_id': '3bef8470-ecc7-40e3-95d4-9254348ea72d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75229) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 09:43:59 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-3b6c1bc3-20bd-4c38-907a-c3586f51b9bc tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:43:59 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-3b6c1bc3-20bd-4c38-907a-c3586f51b9bc tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:43:59 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:43:59 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:43:59 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 09:43:59 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:43:59 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '13b1311f-7462-5b00-8a0c-0f75f47a2f65', '_type': 'linux-noop'}}, row=False) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:43:59 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:43:59 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 09:43:59 user nova-compute[75229]: INFO oslo.privsep.daemon [None req-3b6c1bc3-20bd-4c38-907a-c3586f51b9bc tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'vif_plug_ovs.privsep.vif_plug', '--privsep_sock_path', '/tmp/tmpkq_ui8v8/privsep.sock']
Nov 14 09:43:59 user nova-compute[75229]: WARNING nova.virt.libvirt.driver [None req-6fb168db-88e3-470e-a460-f02dcd74cc8e tempest-DeleteServersTestJSON-1002799117 tempest-DeleteServersTestJSON-1002799117-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 09:43:59 user nova-compute[75229]: WARNING nova.virt.libvirt.driver [None req-6fb168db-88e3-470e-a460-f02dcd74cc8e tempest-DeleteServersTestJSON-1002799117 tempest-DeleteServersTestJSON-1002799117-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 09:43:59 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-6fb168db-88e3-470e-a460-f02dcd74cc8e tempest-DeleteServersTestJSON-1002799117 tempest-DeleteServersTestJSON-1002799117-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75229) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 09:43:59 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-6fb168db-88e3-470e-a460-f02dcd74cc8e tempest-DeleteServersTestJSON-1002799117 tempest-DeleteServersTestJSON-1002799117-project-member] CPU controller missing on host. {{(pid=75229) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 09:43:59 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-6fb168db-88e3-470e-a460-f02dcd74cc8e tempest-DeleteServersTestJSON-1002799117 tempest-DeleteServersTestJSON-1002799117-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75229) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 09:43:59 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-6fb168db-88e3-470e-a460-f02dcd74cc8e tempest-DeleteServersTestJSON-1002799117 tempest-DeleteServersTestJSON-1002799117-project-member] CPU controller found on host. {{(pid=75229) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 09:43:59 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-6fb168db-88e3-470e-a460-f02dcd74cc8e tempest-DeleteServersTestJSON-1002799117 tempest-DeleteServersTestJSON-1002799117-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75229) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 09:43:59 user sudo[84574]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context vif_plug_ovs.privsep.vif_plug --privsep_sock_path /tmp/tmpkq_ui8v8/privsep.sock
Nov 14 09:43:59 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-6fb168db-88e3-470e-a460-f02dcd74cc8e tempest-DeleteServersTestJSON-1002799117 tempest-DeleteServersTestJSON-1002799117-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T09:39:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T09:40:10Z,direct_url=<?>,disk_format='qcow2',id=3bef8470-ecc7-40e3-95d4-9254348ea72d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='de5a91106b6948ed937a7178ff9464c4',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T09:40:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 09:43:59 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-6fb168db-88e3-470e-a460-f02dcd74cc8e tempest-DeleteServersTestJSON-1002799117 tempest-DeleteServersTestJSON-1002799117-project-member] Flavor limits 0:0:0 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 09:43:59 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-6fb168db-88e3-470e-a460-f02dcd74cc8e tempest-DeleteServersTestJSON-1002799117 tempest-DeleteServersTestJSON-1002799117-project-member] Image limits 0:0:0 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 09:43:59 user sudo[84574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 14 09:43:59 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-6fb168db-88e3-470e-a460-f02dcd74cc8e tempest-DeleteServersTestJSON-1002799117 tempest-DeleteServersTestJSON-1002799117-project-member] Flavor pref 0:0:0 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 09:43:59 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-6fb168db-88e3-470e-a460-f02dcd74cc8e tempest-DeleteServersTestJSON-1002799117 tempest-DeleteServersTestJSON-1002799117-project-member] Image pref 0:0:0 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 09:43:59 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-6fb168db-88e3-470e-a460-f02dcd74cc8e tempest-DeleteServersTestJSON-1002799117 tempest-DeleteServersTestJSON-1002799117-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 09:43:59 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-6fb168db-88e3-470e-a460-f02dcd74cc8e tempest-DeleteServersTestJSON-1002799117 tempest-DeleteServersTestJSON-1002799117-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 09:43:59 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-6fb168db-88e3-470e-a460-f02dcd74cc8e tempest-DeleteServersTestJSON-1002799117 tempest-DeleteServersTestJSON-1002799117-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75229) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 09:43:59 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-6fb168db-88e3-470e-a460-f02dcd74cc8e tempest-DeleteServersTestJSON-1002799117 tempest-DeleteServersTestJSON-1002799117-project-member] Got 1 possible topologies {{(pid=75229) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 09:43:59 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-6fb168db-88e3-470e-a460-f02dcd74cc8e tempest-DeleteServersTestJSON-1002799117 tempest-DeleteServersTestJSON-1002799117-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 09:43:59 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-6fb168db-88e3-470e-a460-f02dcd74cc8e tempest-DeleteServersTestJSON-1002799117 tempest-DeleteServersTestJSON-1002799117-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 09:43:59 user nova-compute[75229]: DEBUG nova.virt.libvirt.vif [None req-6fb168db-88e3-470e-a460-f02dcd74cc8e tempest-DeleteServersTestJSON-1002799117 tempest-DeleteServersTestJSON-1002799117-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T09:43:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1980018315',display_name='tempest-DeleteServersTestJSON-server-1980018315',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1980018315',id=2,image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ac677c251f874551947d944c52d1d7b3',ramdisk_id='',reservation_id='r-wbmjkc23',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-1002799117',owner_user_name='tempest-DeleteServersTestJSON-1002799117-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T09:43:52Z,user_data=None,user_id='17e39818cb9344ca80bda511052e08aa',uuid=359ff85c-c332-4059-8db4-689a0483d068,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a799c237-ea4a-472d-b149-904fabda7414", "address": "fa:16:3e:80:1f:b3", "network": {"id": "60446365-aa09-4526-8746-a7069b8083c7", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1696625928-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac677c251f874551947d944c52d1d7b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa799c237-ea", "ovs_interfaceid": "a799c237-ea4a-472d-b149-904fabda7414", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75229) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 09:43:59 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-6fb168db-88e3-470e-a460-f02dcd74cc8e tempest-DeleteServersTestJSON-1002799117 tempest-DeleteServersTestJSON-1002799117-project-member] Converting VIF {"id": "a799c237-ea4a-472d-b149-904fabda7414", "address": "fa:16:3e:80:1f:b3", "network": {"id": "60446365-aa09-4526-8746-a7069b8083c7", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1696625928-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac677c251f874551947d944c52d1d7b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa799c237-ea", "ovs_interfaceid": "a799c237-ea4a-472d-b149-904fabda7414", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 09:43:59 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-6fb168db-88e3-470e-a460-f02dcd74cc8e tempest-DeleteServersTestJSON-1002799117 tempest-DeleteServersTestJSON-1002799117-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:80:1f:b3,bridge_name='br-int',has_traffic_filtering=True,id=a799c237-ea4a-472d-b149-904fabda7414,network=Network(60446365-aa09-4526-8746-a7069b8083c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa799c237-ea') {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 09:43:59 user nova-compute[75229]: DEBUG nova.objects.instance [None req-6fb168db-88e3-470e-a460-f02dcd74cc8e tempest-DeleteServersTestJSON-1002799117 tempest-DeleteServersTestJSON-1002799117-project-member] Lazy-loading 'pci_devices' on Instance uuid 359ff85c-c332-4059-8db4-689a0483d068 {{(pid=75229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 09:43:59 user nova-compute[75229]: DEBUG nova.network.neutron [None req-0263f621-3230-4ce3-bd4e-7446204bb0ce tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] [instance: a7750cbc-b3d0-44aa-8b88-c291ba007a8a] Successfully updated port: e5b20e94-618c-4c51-b20f-1d3f1fb921b6 {{(pid=75229) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 09:43:59 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-6fb168db-88e3-470e-a460-f02dcd74cc8e tempest-DeleteServersTestJSON-1002799117 tempest-DeleteServersTestJSON-1002799117-project-member] [instance: 359ff85c-c332-4059-8db4-689a0483d068] End _get_guest_xml xml=<domain type="kvm">
Nov 14 09:43:59 user nova-compute[75229]:   <uuid>359ff85c-c332-4059-8db4-689a0483d068</uuid>
Nov 14 09:43:59 user nova-compute[75229]:   <name>instance-00000002</name>
Nov 14 09:43:59 user nova-compute[75229]:   <memory>524288</memory>
Nov 14 09:43:59 user nova-compute[75229]:   <vcpu>1</vcpu>
Nov 14 09:43:59 user nova-compute[75229]:   <metadata>
Nov 14 09:43:59 user nova-compute[75229]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 09:43:59 user nova-compute[75229]:       <nova:package version="0.0.0"/>
Nov 14 09:43:59 user nova-compute[75229]:       <nova:name>tempest-DeleteServersTestJSON-server-1980018315</nova:name>
Nov 14 09:43:59 user nova-compute[75229]:       <nova:creationTime>2023-11-14 09:43:59</nova:creationTime>
Nov 14 09:43:59 user nova-compute[75229]:       <nova:flavor name="m1.tiny">
Nov 14 09:43:59 user nova-compute[75229]:         <nova:memory>512</nova:memory>
Nov 14 09:43:59 user nova-compute[75229]:         <nova:disk>1</nova:disk>
Nov 14 09:43:59 user nova-compute[75229]:         <nova:swap>0</nova:swap>
Nov 14 09:43:59 user nova-compute[75229]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 09:43:59 user nova-compute[75229]:         <nova:vcpus>1</nova:vcpus>
Nov 14 09:43:59 user nova-compute[75229]:       </nova:flavor>
Nov 14 09:43:59 user nova-compute[75229]:       <nova:owner>
Nov 14 09:43:59 user nova-compute[75229]:         <nova:user uuid="17e39818cb9344ca80bda511052e08aa">tempest-DeleteServersTestJSON-1002799117-project-member</nova:user>
Nov 14 09:43:59 user nova-compute[75229]:         <nova:project uuid="ac677c251f874551947d944c52d1d7b3">tempest-DeleteServersTestJSON-1002799117</nova:project>
Nov 14 09:43:59 user nova-compute[75229]:       </nova:owner>
Nov 14 09:43:59 user nova-compute[75229]:       <nova:root type="image" uuid="3bef8470-ecc7-40e3-95d4-9254348ea72d"/>
Nov 14 09:43:59 user nova-compute[75229]:       <nova:ports>
Nov 14 09:43:59 user nova-compute[75229]:         <nova:port uuid="a799c237-ea4a-472d-b149-904fabda7414">
Nov 14 09:43:59 user nova-compute[75229]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 14 09:43:59 user nova-compute[75229]:         </nova:port>
Nov 14 09:43:59 user nova-compute[75229]:       </nova:ports>
Nov 14 09:43:59 user nova-compute[75229]:     </nova:instance>
Nov 14 09:43:59 user nova-compute[75229]:   </metadata>
Nov 14 09:43:59 user nova-compute[75229]:   <sysinfo type="smbios">
Nov 14 09:43:59 user nova-compute[75229]:     <system>
Nov 14 09:43:59 user nova-compute[75229]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 09:43:59 user nova-compute[75229]:       <entry name="product">OpenStack Nova</entry>
Nov 14 09:43:59 user nova-compute[75229]:       <entry name="version">0.0.0</entry>
Nov 14 09:43:59 user nova-compute[75229]:       <entry name="serial">359ff85c-c332-4059-8db4-689a0483d068</entry>
Nov 14 09:43:59 user nova-compute[75229]:       <entry name="uuid">359ff85c-c332-4059-8db4-689a0483d068</entry>
Nov 14 09:43:59 user nova-compute[75229]:       <entry name="family">Virtual Machine</entry>
Nov 14 09:43:59 user nova-compute[75229]:     </system>
Nov 14 09:43:59 user nova-compute[75229]:   </sysinfo>
Nov 14 09:43:59 user nova-compute[75229]:   <os>
Nov 14 09:43:59 user nova-compute[75229]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 09:43:59 user nova-compute[75229]:     <boot dev="hd"/>
Nov 14 09:43:59 user nova-compute[75229]:     <smbios mode="sysinfo"/>
Nov 14 09:43:59 user nova-compute[75229]:   </os>
Nov 14 09:43:59 user nova-compute[75229]:   <features>
Nov 14 09:43:59 user nova-compute[75229]:     <acpi/>
Nov 14 09:43:59 user nova-compute[75229]:     <apic/>
Nov 14 09:43:59 user nova-compute[75229]:     <vmcoreinfo/>
Nov 14 09:43:59 user nova-compute[75229]:   </features>
Nov 14 09:43:59 user nova-compute[75229]:   <clock offset="utc">
Nov 14 09:43:59 user nova-compute[75229]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 09:43:59 user nova-compute[75229]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 09:43:59 user nova-compute[75229]:     <timer name="hpet" present="no"/>
Nov 14 09:43:59 user nova-compute[75229]:   </clock>
Nov 14 09:43:59 user nova-compute[75229]:   <cpu mode="custom" match="exact">
Nov 14 09:43:59 user nova-compute[75229]:     <model>Nehalem</model>
Nov 14 09:43:59 user nova-compute[75229]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 09:43:59 user nova-compute[75229]:   </cpu>
Nov 14 09:43:59 user nova-compute[75229]:   <devices>
Nov 14 09:43:59 user nova-compute[75229]:     <disk type="file" device="disk">
Nov 14 09:43:59 user nova-compute[75229]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 09:43:59 user nova-compute[75229]:       <source file="/opt/stack/data/nova/instances/359ff85c-c332-4059-8db4-689a0483d068/disk"/>
Nov 14 09:43:59 user nova-compute[75229]:       <target dev="vda" bus="virtio"/>
Nov 14 09:43:59 user nova-compute[75229]:     </disk>
Nov 14 09:43:59 user nova-compute[75229]:     <interface type="ethernet">
Nov 14 09:43:59 user nova-compute[75229]:       <mac address="fa:16:3e:80:1f:b3"/>
Nov 14 09:43:59 user nova-compute[75229]:       <model type="virtio"/>
Nov 14 09:43:59 user nova-compute[75229]:       <mtu size="1442"/>
Nov 14 09:43:59 user nova-compute[75229]:       <target dev="tapa799c237-ea"/>
Nov 14 09:43:59 user nova-compute[75229]:     </interface>
Nov 14 09:43:59 user nova-compute[75229]:     <serial type="pty">
Nov 14 09:43:59 user nova-compute[75229]:       <log file="/opt/stack/data/nova/instances/359ff85c-c332-4059-8db4-689a0483d068/console.log" append="off"/>
Nov 14 09:43:59 user nova-compute[75229]:     </serial>
Nov 14 09:43:59 user nova-compute[75229]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 09:43:59 user nova-compute[75229]:     <video>
Nov 14 09:43:59 user nova-compute[75229]:       <model type="virtio"/>
Nov 14 09:43:59 user nova-compute[75229]:     </video>
Nov 14 09:43:59 user nova-compute[75229]:     <rng model="virtio">
Nov 14 09:43:59 user nova-compute[75229]:       <backend model="random">/dev/urandom</backend>
Nov 14 09:43:59 user nova-compute[75229]:     </rng>
Nov 14 09:43:59 user nova-compute[75229]:     <controller type="usb" index="0" model="none"/>
Nov 14 09:43:59 user nova-compute[75229]:     <memballoon model="virtio">
Nov 14 09:43:59 user nova-compute[75229]:       <stats period="10"/>
Nov 14 09:43:59 user nova-compute[75229]:     </memballoon>
Nov 14 09:43:59 user nova-compute[75229]:   </devices>
Nov 14 09:43:59 user nova-compute[75229]: </domain>
Nov 14 09:43:59 user nova-compute[75229]:  {{(pid=75229) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 09:43:59 user nova-compute[75229]: DEBUG nova.virt.libvirt.vif [None req-6fb168db-88e3-470e-a460-f02dcd74cc8e tempest-DeleteServersTestJSON-1002799117 tempest-DeleteServersTestJSON-1002799117-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T09:43:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1980018315',display_name='tempest-DeleteServersTestJSON-server-1980018315',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1980018315',id=2,image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ac677c251f874551947d944c52d1d7b3',ramdisk_id='',reservation_id='r-wbmjkc23',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-1002799117',owner_user_name='tempest-DeleteServersTestJSON-1002799117-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T09:43:52Z,user_data=None,user_id='17e39818cb9344ca80bda511052e08aa',uuid=359ff85c-c332-4059-8db4-689a0483d068,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a799c237-ea4a-472d-b149-904fabda7414", "address": "fa:16:3e:80:1f:b3", "network": {"id": "60446365-aa09-4526-8746-a7069b8083c7", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1696625928-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac677c251f874551947d944c52d1d7b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa799c237-ea", "ovs_interfaceid": "a799c237-ea4a-472d-b149-904fabda7414", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 09:43:59 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-6fb168db-88e3-470e-a460-f02dcd74cc8e tempest-DeleteServersTestJSON-1002799117 tempest-DeleteServersTestJSON-1002799117-project-member] Converting VIF {"id": "a799c237-ea4a-472d-b149-904fabda7414", "address": "fa:16:3e:80:1f:b3", "network": {"id": "60446365-aa09-4526-8746-a7069b8083c7", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1696625928-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac677c251f874551947d944c52d1d7b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa799c237-ea", "ovs_interfaceid": "a799c237-ea4a-472d-b149-904fabda7414", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 09:43:59 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-6fb168db-88e3-470e-a460-f02dcd74cc8e tempest-DeleteServersTestJSON-1002799117 tempest-DeleteServersTestJSON-1002799117-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:80:1f:b3,bridge_name='br-int',has_traffic_filtering=True,id=a799c237-ea4a-472d-b149-904fabda7414,network=Network(60446365-aa09-4526-8746-a7069b8083c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa799c237-ea') {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 09:43:59 user nova-compute[75229]: DEBUG os_vif [None req-6fb168db-88e3-470e-a460-f02dcd74cc8e tempest-DeleteServersTestJSON-1002799117 tempest-DeleteServersTestJSON-1002799117-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:80:1f:b3,bridge_name='br-int',has_traffic_filtering=True,id=a799c237-ea4a-472d-b149-904fabda7414,network=Network(60446365-aa09-4526-8746-a7069b8083c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa799c237-ea') {{(pid=75229) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 09:43:59 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:43:59 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:43:59 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 09:43:59 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:43:59 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '83ae3475-3d8b-585c-aeeb-c618ca46baf0', '_type': 'linux-noop'}}, row=False) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:43:59 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-0263f621-3230-4ce3-bd4e-7446204bb0ce tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Acquiring lock "refresh_cache-a7750cbc-b3d0-44aa-8b88-c291ba007a8a" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 09:43:59 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-0263f621-3230-4ce3-bd4e-7446204bb0ce tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Acquired lock "refresh_cache-a7750cbc-b3d0-44aa-8b88-c291ba007a8a" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 09:43:59 user nova-compute[75229]: DEBUG nova.network.neutron [None req-0263f621-3230-4ce3-bd4e-7446204bb0ce tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] [instance: a7750cbc-b3d0-44aa-8b88-c291ba007a8a] Building network info cache for instance {{(pid=75229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 09:43:59 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:43:59 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 09:44:00 user nova-compute[75229]: DEBUG nova.network.neutron [None req-0263f621-3230-4ce3-bd4e-7446204bb0ce tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] [instance: a7750cbc-b3d0-44aa-8b88-c291ba007a8a] Instance cache missing network info. {{(pid=75229) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 09:44:00 user nova-compute[75229]: DEBUG nova.network.neutron [req-a266505b-7f42-4fa5-8e9e-5075d9bfd06e req-bfdd3e1d-9e35-4285-b0c4-881271fae8b6 service nova] [instance: 90bd76df-96cb-4bec-9862-853d94cdbaab] Updated VIF entry in instance network info cache for port 3b9b5b2a-5b1b-4ec6-900d-c27e7c4a625e. {{(pid=75229) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 09:44:00 user nova-compute[75229]: DEBUG nova.network.neutron [req-a266505b-7f42-4fa5-8e9e-5075d9bfd06e req-bfdd3e1d-9e35-4285-b0c4-881271fae8b6 service nova] [instance: 90bd76df-96cb-4bec-9862-853d94cdbaab] Updating instance_info_cache with network_info: [{"id": "3b9b5b2a-5b1b-4ec6-900d-c27e7c4a625e", "address": "fa:16:3e:6e:aa:df", "network": {"id": "589aea41-545f-4875-ab56-b7aa273dad6f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-785276916-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee9447f169de43829fe3ed51592752e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b9b5b2a-5b", "ovs_interfaceid": "3b9b5b2a-5b1b-4ec6-900d-c27e7c4a625e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 09:44:00 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-a266505b-7f42-4fa5-8e9e-5075d9bfd06e req-bfdd3e1d-9e35-4285-b0c4-881271fae8b6 service nova] Releasing lock "refresh_cache-90bd76df-96cb-4bec-9862-853d94cdbaab" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 09:44:00 user nova-compute[75229]: DEBUG nova.network.neutron [req-1ddf9a7c-29aa-4f11-9ec9-704dc3ec9dbf req-48512f9a-fd23-4cff-88f2-cde334a5e98c service nova] [instance: 359ff85c-c332-4059-8db4-689a0483d068] Updated VIF entry in instance network info cache for port a799c237-ea4a-472d-b149-904fabda7414. {{(pid=75229) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 09:44:00 user nova-compute[75229]: DEBUG nova.network.neutron [req-1ddf9a7c-29aa-4f11-9ec9-704dc3ec9dbf req-48512f9a-fd23-4cff-88f2-cde334a5e98c service nova] [instance: 359ff85c-c332-4059-8db4-689a0483d068] Updating instance_info_cache with network_info: [{"id": "a799c237-ea4a-472d-b149-904fabda7414", "address": "fa:16:3e:80:1f:b3", "network": {"id": "60446365-aa09-4526-8746-a7069b8083c7", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1696625928-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac677c251f874551947d944c52d1d7b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa799c237-ea", "ovs_interfaceid": "a799c237-ea4a-472d-b149-904fabda7414", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 09:44:00 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-1ddf9a7c-29aa-4f11-9ec9-704dc3ec9dbf req-48512f9a-fd23-4cff-88f2-cde334a5e98c service nova] Releasing lock "refresh_cache-359ff85c-c332-4059-8db4-689a0483d068" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 09:44:00 user nova-compute[75229]: DEBUG nova.compute.manager [req-de3e327d-7690-4270-b2fd-1d5557b4e229 req-7dc44ca1-88d3-4a7d-ba4d-cd8aea0a9004 service nova] [instance: a7750cbc-b3d0-44aa-8b88-c291ba007a8a] Received event network-changed-e5b20e94-618c-4c51-b20f-1d3f1fb921b6 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:44:00 user nova-compute[75229]: DEBUG nova.compute.manager [req-de3e327d-7690-4270-b2fd-1d5557b4e229 req-7dc44ca1-88d3-4a7d-ba4d-cd8aea0a9004 service nova] [instance: a7750cbc-b3d0-44aa-8b88-c291ba007a8a] Refreshing instance network info cache due to event network-changed-e5b20e94-618c-4c51-b20f-1d3f1fb921b6. {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 09:44:00 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-de3e327d-7690-4270-b2fd-1d5557b4e229 req-7dc44ca1-88d3-4a7d-ba4d-cd8aea0a9004 service nova] Acquiring lock "refresh_cache-a7750cbc-b3d0-44aa-8b88-c291ba007a8a" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 09:44:00 user nova-compute[75229]: DEBUG nova.network.neutron [None req-296d9af7-abae-42fe-8ef6-92010ee7dd1b tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] [instance: a60d339f-e134-477c-8505-bf8c79d2a21c] Successfully created port: cb98fc47-7b69-4bde-9a4c-717cd44ba908 {{(pid=75229) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 09:44:00 user nova-compute[75229]: DEBUG nova.network.neutron [None req-0263f621-3230-4ce3-bd4e-7446204bb0ce tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] [instance: a7750cbc-b3d0-44aa-8b88-c291ba007a8a] Updating instance_info_cache with network_info: [{"id": "e5b20e94-618c-4c51-b20f-1d3f1fb921b6", "address": "fa:16:3e:e5:e8:ed", "network": {"id": "5dfc532f-3d5d-4342-b7f1-12c9c3992a54", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1457278473-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46e65cdd021f4a3db7c9254bb6d98b46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5b20e94-61", "ovs_interfaceid": "e5b20e94-618c-4c51-b20f-1d3f1fb921b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 09:44:00 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-0263f621-3230-4ce3-bd4e-7446204bb0ce tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Releasing lock "refresh_cache-a7750cbc-b3d0-44aa-8b88-c291ba007a8a" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 09:44:00 user nova-compute[75229]: DEBUG nova.compute.manager [None req-0263f621-3230-4ce3-bd4e-7446204bb0ce tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] [instance: a7750cbc-b3d0-44aa-8b88-c291ba007a8a] Instance network_info: |[{"id": "e5b20e94-618c-4c51-b20f-1d3f1fb921b6", "address": "fa:16:3e:e5:e8:ed", "network": {"id": "5dfc532f-3d5d-4342-b7f1-12c9c3992a54", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1457278473-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46e65cdd021f4a3db7c9254bb6d98b46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5b20e94-61", "ovs_interfaceid": "e5b20e94-618c-4c51-b20f-1d3f1fb921b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75229) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 09:44:00 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-de3e327d-7690-4270-b2fd-1d5557b4e229 req-7dc44ca1-88d3-4a7d-ba4d-cd8aea0a9004 service nova] Acquired lock "refresh_cache-a7750cbc-b3d0-44aa-8b88-c291ba007a8a" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 09:44:00 user nova-compute[75229]: DEBUG nova.network.neutron [req-de3e327d-7690-4270-b2fd-1d5557b4e229 req-7dc44ca1-88d3-4a7d-ba4d-cd8aea0a9004 service nova] [instance: a7750cbc-b3d0-44aa-8b88-c291ba007a8a] Refreshing network info cache for port e5b20e94-618c-4c51-b20f-1d3f1fb921b6 {{(pid=75229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 09:44:01 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-0263f621-3230-4ce3-bd4e-7446204bb0ce tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] [instance: a7750cbc-b3d0-44aa-8b88-c291ba007a8a] Start _get_guest_xml network_info=[{"id": "e5b20e94-618c-4c51-b20f-1d3f1fb921b6", "address": "fa:16:3e:e5:e8:ed", "network": {"id": "5dfc532f-3d5d-4342-b7f1-12c9c3992a54", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1457278473-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46e65cdd021f4a3db7c9254bb6d98b46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5b20e94-61", "ovs_interfaceid": "e5b20e94-618c-4c51-b20f-1d3f1fb921b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T09:40:10Z,direct_url=<?>,disk_format='qcow2',id=3bef8470-ecc7-40e3-95d4-9254348ea72d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='de5a91106b6948ed937a7178ff9464c4',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T09:40:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'disk_bus': 'virtio', 'guest_format': None, 'encryption_secret_uuid': None, 'size': 0, 'device_type': 'disk', 'image_id': '3bef8470-ecc7-40e3-95d4-9254348ea72d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75229) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 09:44:01 user nova-compute[75229]: WARNING nova.virt.libvirt.driver [None req-0263f621-3230-4ce3-bd4e-7446204bb0ce tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 09:44:01 user nova-compute[75229]: WARNING nova.virt.libvirt.driver [None req-0263f621-3230-4ce3-bd4e-7446204bb0ce tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 09:44:01 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-0263f621-3230-4ce3-bd4e-7446204bb0ce tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75229) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 09:44:01 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-0263f621-3230-4ce3-bd4e-7446204bb0ce tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] CPU controller missing on host. {{(pid=75229) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 09:44:01 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-0263f621-3230-4ce3-bd4e-7446204bb0ce tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75229) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 09:44:01 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-0263f621-3230-4ce3-bd4e-7446204bb0ce tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] CPU controller found on host. {{(pid=75229) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 09:44:01 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-0263f621-3230-4ce3-bd4e-7446204bb0ce tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75229) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 09:44:01 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-0263f621-3230-4ce3-bd4e-7446204bb0ce tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T09:39:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T09:40:10Z,direct_url=<?>,disk_format='qcow2',id=3bef8470-ecc7-40e3-95d4-9254348ea72d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='de5a91106b6948ed937a7178ff9464c4',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T09:40:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 09:44:01 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-0263f621-3230-4ce3-bd4e-7446204bb0ce tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Flavor limits 0:0:0 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 09:44:01 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-0263f621-3230-4ce3-bd4e-7446204bb0ce tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Image limits 0:0:0 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 09:44:01 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-0263f621-3230-4ce3-bd4e-7446204bb0ce tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Flavor pref 0:0:0 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 09:44:01 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-0263f621-3230-4ce3-bd4e-7446204bb0ce tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Image pref 0:0:0 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 09:44:01 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-0263f621-3230-4ce3-bd4e-7446204bb0ce tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 09:44:01 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-0263f621-3230-4ce3-bd4e-7446204bb0ce tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 09:44:01 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-0263f621-3230-4ce3-bd4e-7446204bb0ce tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75229) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 09:44:01 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-0263f621-3230-4ce3-bd4e-7446204bb0ce tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Got 1 possible topologies {{(pid=75229) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 09:44:01 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-0263f621-3230-4ce3-bd4e-7446204bb0ce tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 09:44:01 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-0263f621-3230-4ce3-bd4e-7446204bb0ce tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 09:44:01 user nova-compute[75229]: DEBUG nova.virt.libvirt.vif [None req-0263f621-3230-4ce3-bd4e-7446204bb0ce tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T09:43:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1269545577',display_name='tempest-ServerActionsTestOtherA-server-1269545577',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1269545577',id=3,image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGYpQZFb1U6nMdMA0U7Y/y+mR6NDiU0zUt1gWS7fx0RnGUEMiKL0fCtTR70lVN1zodlPi6pkSulrGMUx3iNoziRzj8cN92z29zHcNE44hvJVgwbBcM00kPn071ndMRlk4g==',key_name='tempest-keypair-397181797',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='46e65cdd021f4a3db7c9254bb6d98b46',ramdisk_id='',reservation_id='r-q0n9455h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-280196295',owner_user_name='tempest-ServerActionsTestOtherA-280196295-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T09:43:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c0c381a0f6124f1ca6ce85c057b9143a',uuid=a7750cbc-b3d0-44aa-8b88-c291ba007a8a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e5b20e94-618c-4c51-b20f-1d3f1fb921b6", "address": "fa:16:3e:e5:e8:ed", "network": {"id": "5dfc532f-3d5d-4342-b7f1-12c9c3992a54", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1457278473-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46e65cdd021f4a3db7c9254bb6d98b46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5b20e94-61", "ovs_interfaceid": "e5b20e94-618c-4c51-b20f-1d3f1fb921b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75229) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 09:44:01 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-0263f621-3230-4ce3-bd4e-7446204bb0ce tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Converting VIF {"id": "e5b20e94-618c-4c51-b20f-1d3f1fb921b6", "address": "fa:16:3e:e5:e8:ed", "network": {"id": "5dfc532f-3d5d-4342-b7f1-12c9c3992a54", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1457278473-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46e65cdd021f4a3db7c9254bb6d98b46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5b20e94-61", "ovs_interfaceid": "e5b20e94-618c-4c51-b20f-1d3f1fb921b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 09:44:01 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-0263f621-3230-4ce3-bd4e-7446204bb0ce tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e5:e8:ed,bridge_name='br-int',has_traffic_filtering=True,id=e5b20e94-618c-4c51-b20f-1d3f1fb921b6,network=Network(5dfc532f-3d5d-4342-b7f1-12c9c3992a54),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape5b20e94-61') {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 09:44:01 user nova-compute[75229]: DEBUG nova.objects.instance [None req-0263f621-3230-4ce3-bd4e-7446204bb0ce tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Lazy-loading 'pci_devices' on Instance uuid a7750cbc-b3d0-44aa-8b88-c291ba007a8a {{(pid=75229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 09:44:01 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-0263f621-3230-4ce3-bd4e-7446204bb0ce tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] [instance: a7750cbc-b3d0-44aa-8b88-c291ba007a8a] End _get_guest_xml xml=<domain type="kvm">
Nov 14 09:44:01 user nova-compute[75229]:   <uuid>a7750cbc-b3d0-44aa-8b88-c291ba007a8a</uuid>
Nov 14 09:44:01 user nova-compute[75229]:   <name>instance-00000003</name>
Nov 14 09:44:01 user nova-compute[75229]:   <memory>524288</memory>
Nov 14 09:44:01 user nova-compute[75229]:   <vcpu>1</vcpu>
Nov 14 09:44:01 user nova-compute[75229]:   <metadata>
Nov 14 09:44:01 user nova-compute[75229]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 09:44:01 user nova-compute[75229]:       <nova:package version="0.0.0"/>
Nov 14 09:44:01 user nova-compute[75229]:       <nova:name>tempest-ServerActionsTestOtherA-server-1269545577</nova:name>
Nov 14 09:44:01 user nova-compute[75229]:       <nova:creationTime>2023-11-14 09:44:01</nova:creationTime>
Nov 14 09:44:01 user nova-compute[75229]:       <nova:flavor name="m1.tiny">
Nov 14 09:44:01 user nova-compute[75229]:         <nova:memory>512</nova:memory>
Nov 14 09:44:01 user nova-compute[75229]:         <nova:disk>1</nova:disk>
Nov 14 09:44:01 user nova-compute[75229]:         <nova:swap>0</nova:swap>
Nov 14 09:44:01 user nova-compute[75229]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 09:44:01 user nova-compute[75229]:         <nova:vcpus>1</nova:vcpus>
Nov 14 09:44:01 user nova-compute[75229]:       </nova:flavor>
Nov 14 09:44:01 user nova-compute[75229]:       <nova:owner>
Nov 14 09:44:01 user nova-compute[75229]:         <nova:user uuid="c0c381a0f6124f1ca6ce85c057b9143a">tempest-ServerActionsTestOtherA-280196295-project-member</nova:user>
Nov 14 09:44:01 user nova-compute[75229]:         <nova:project uuid="46e65cdd021f4a3db7c9254bb6d98b46">tempest-ServerActionsTestOtherA-280196295</nova:project>
Nov 14 09:44:01 user nova-compute[75229]:       </nova:owner>
Nov 14 09:44:01 user nova-compute[75229]:       <nova:root type="image" uuid="3bef8470-ecc7-40e3-95d4-9254348ea72d"/>
Nov 14 09:44:01 user nova-compute[75229]:       <nova:ports>
Nov 14 09:44:01 user nova-compute[75229]:         <nova:port uuid="e5b20e94-618c-4c51-b20f-1d3f1fb921b6">
Nov 14 09:44:01 user nova-compute[75229]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 14 09:44:01 user nova-compute[75229]:         </nova:port>
Nov 14 09:44:01 user nova-compute[75229]:       </nova:ports>
Nov 14 09:44:01 user nova-compute[75229]:     </nova:instance>
Nov 14 09:44:01 user nova-compute[75229]:   </metadata>
Nov 14 09:44:01 user nova-compute[75229]:   <sysinfo type="smbios">
Nov 14 09:44:01 user nova-compute[75229]:     <system>
Nov 14 09:44:01 user nova-compute[75229]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 09:44:01 user nova-compute[75229]:       <entry name="product">OpenStack Nova</entry>
Nov 14 09:44:01 user nova-compute[75229]:       <entry name="version">0.0.0</entry>
Nov 14 09:44:01 user nova-compute[75229]:       <entry name="serial">a7750cbc-b3d0-44aa-8b88-c291ba007a8a</entry>
Nov 14 09:44:01 user nova-compute[75229]:       <entry name="uuid">a7750cbc-b3d0-44aa-8b88-c291ba007a8a</entry>
Nov 14 09:44:01 user nova-compute[75229]:       <entry name="family">Virtual Machine</entry>
Nov 14 09:44:01 user nova-compute[75229]:     </system>
Nov 14 09:44:01 user nova-compute[75229]:   </sysinfo>
Nov 14 09:44:01 user nova-compute[75229]:   <os>
Nov 14 09:44:01 user nova-compute[75229]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 09:44:01 user nova-compute[75229]:     <boot dev="hd"/>
Nov 14 09:44:01 user nova-compute[75229]:     <smbios mode="sysinfo"/>
Nov 14 09:44:01 user nova-compute[75229]:   </os>
Nov 14 09:44:01 user nova-compute[75229]:   <features>
Nov 14 09:44:01 user nova-compute[75229]:     <acpi/>
Nov 14 09:44:01 user nova-compute[75229]:     <apic/>
Nov 14 09:44:01 user nova-compute[75229]:     <vmcoreinfo/>
Nov 14 09:44:01 user nova-compute[75229]:   </features>
Nov 14 09:44:01 user nova-compute[75229]:   <clock offset="utc">
Nov 14 09:44:01 user nova-compute[75229]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 09:44:01 user nova-compute[75229]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 09:44:01 user nova-compute[75229]:     <timer name="hpet" present="no"/>
Nov 14 09:44:01 user nova-compute[75229]:   </clock>
Nov 14 09:44:01 user nova-compute[75229]:   <cpu mode="custom" match="exact">
Nov 14 09:44:01 user nova-compute[75229]:     <model>Nehalem</model>
Nov 14 09:44:01 user nova-compute[75229]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 09:44:01 user nova-compute[75229]:   </cpu>
Nov 14 09:44:01 user nova-compute[75229]:   <devices>
Nov 14 09:44:01 user nova-compute[75229]:     <disk type="file" device="disk">
Nov 14 09:44:01 user nova-compute[75229]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 09:44:01 user nova-compute[75229]:       <source file="/opt/stack/data/nova/instances/a7750cbc-b3d0-44aa-8b88-c291ba007a8a/disk"/>
Nov 14 09:44:01 user nova-compute[75229]:       <target dev="vda" bus="virtio"/>
Nov 14 09:44:01 user nova-compute[75229]:     </disk>
Nov 14 09:44:01 user nova-compute[75229]:     <interface type="ethernet">
Nov 14 09:44:01 user nova-compute[75229]:       <mac address="fa:16:3e:e5:e8:ed"/>
Nov 14 09:44:01 user nova-compute[75229]:       <model type="virtio"/>
Nov 14 09:44:01 user nova-compute[75229]:       <mtu size="1442"/>
Nov 14 09:44:01 user nova-compute[75229]:       <target dev="tape5b20e94-61"/>
Nov 14 09:44:01 user nova-compute[75229]:     </interface>
Nov 14 09:44:01 user nova-compute[75229]:     <serial type="pty">
Nov 14 09:44:01 user nova-compute[75229]:       <log file="/opt/stack/data/nova/instances/a7750cbc-b3d0-44aa-8b88-c291ba007a8a/console.log" append="off"/>
Nov 14 09:44:01 user nova-compute[75229]:     </serial>
Nov 14 09:44:01 user nova-compute[75229]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 09:44:01 user nova-compute[75229]:     <video>
Nov 14 09:44:01 user nova-compute[75229]:       <model type="virtio"/>
Nov 14 09:44:01 user nova-compute[75229]:     </video>
Nov 14 09:44:01 user nova-compute[75229]:     <rng model="virtio">
Nov 14 09:44:01 user nova-compute[75229]:       <backend model="random">/dev/urandom</backend>
Nov 14 09:44:01 user nova-compute[75229]:     </rng>
Nov 14 09:44:01 user nova-compute[75229]:     <controller type="usb" index="0" model="none"/>
Nov 14 09:44:01 user nova-compute[75229]:     <memballoon model="virtio">
Nov 14 09:44:01 user nova-compute[75229]:       <stats period="10"/>
Nov 14 09:44:01 user nova-compute[75229]:     </memballoon>
Nov 14 09:44:01 user nova-compute[75229]:   </devices>
Nov 14 09:44:01 user nova-compute[75229]: </domain>
Nov 14 09:44:01 user nova-compute[75229]:  {{(pid=75229) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 09:44:01 user nova-compute[75229]: DEBUG nova.virt.libvirt.vif [None req-0263f621-3230-4ce3-bd4e-7446204bb0ce tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T09:43:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1269545577',display_name='tempest-ServerActionsTestOtherA-server-1269545577',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1269545577',id=3,image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGYpQZFb1U6nMdMA0U7Y/y+mR6NDiU0zUt1gWS7fx0RnGUEMiKL0fCtTR70lVN1zodlPi6pkSulrGMUx3iNoziRzj8cN92z29zHcNE44hvJVgwbBcM00kPn071ndMRlk4g==',key_name='tempest-keypair-397181797',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='46e65cdd021f4a3db7c9254bb6d98b46',ramdisk_id='',reservation_id='r-q0n9455h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-280196295',owner_user_name='tempest-ServerActionsTestOtherA-280196295-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T09:43:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c0c381a0f6124f1ca6ce85c057b9143a',uuid=a7750cbc-b3d0-44aa-8b88-c291ba007a8a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e5b20e94-618c-4c51-b20f-1d3f1fb921b6", "address": "fa:16:3e:e5:e8:ed", "network": {"id": "5dfc532f-3d5d-4342-b7f1-12c9c3992a54", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1457278473-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46e65cdd021f4a3db7c9254bb6d98b46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5b20e94-61", "ovs_interfaceid": "e5b20e94-618c-4c51-b20f-1d3f1fb921b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 09:44:01 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-0263f621-3230-4ce3-bd4e-7446204bb0ce tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Converting VIF {"id": "e5b20e94-618c-4c51-b20f-1d3f1fb921b6", "address": "fa:16:3e:e5:e8:ed", "network": {"id": "5dfc532f-3d5d-4342-b7f1-12c9c3992a54", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1457278473-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46e65cdd021f4a3db7c9254bb6d98b46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5b20e94-61", "ovs_interfaceid": "e5b20e94-618c-4c51-b20f-1d3f1fb921b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 09:44:01 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-0263f621-3230-4ce3-bd4e-7446204bb0ce tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e5:e8:ed,bridge_name='br-int',has_traffic_filtering=True,id=e5b20e94-618c-4c51-b20f-1d3f1fb921b6,network=Network(5dfc532f-3d5d-4342-b7f1-12c9c3992a54),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape5b20e94-61') {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 09:44:01 user nova-compute[75229]: DEBUG os_vif [None req-0263f621-3230-4ce3-bd4e-7446204bb0ce tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:e8:ed,bridge_name='br-int',has_traffic_filtering=True,id=e5b20e94-618c-4c51-b20f-1d3f1fb921b6,network=Network(5dfc532f-3d5d-4342-b7f1-12c9c3992a54),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape5b20e94-61') {{(pid=75229) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 09:44:01 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:44:01 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:44:01 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 09:44:01 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:44:01 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ac13fedc-9eb8-5f2a-8456-3d9812ad08e4', '_type': 'linux-noop'}}, row=False) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:44:01 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:44:01 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 09:44:01 user sudo[84574]: pam_unix(sudo:session): session closed for user root
Nov 14 09:44:01 user nova-compute[75229]: INFO oslo.privsep.daemon [None req-3b6c1bc3-20bd-4c38-907a-c3586f51b9bc tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Spawned new privsep daemon via rootwrap
Nov 14 09:44:01 user nova-compute[75229]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 14 09:44:01 user nova-compute[75229]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 14 09:44:01 user nova-compute[75229]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_NET_ADMIN/CAP_DAC_OVERRIDE|CAP_NET_ADMIN/none
Nov 14 09:44:01 user nova-compute[75229]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 84579
Nov 14 09:44:01 user nova-compute[75229]: WARNING oslo_privsep.priv_context [None req-6fb168db-88e3-470e-a460-f02dcd74cc8e tempest-DeleteServersTestJSON-1002799117 tempest-DeleteServersTestJSON-1002799117-project-member] privsep daemon already running
Nov 14 09:44:01 user nova-compute[75229]: WARNING oslo_privsep.priv_context [None req-0263f621-3230-4ce3-bd4e-7446204bb0ce tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] privsep daemon already running
Nov 14 09:44:01 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:44:01 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3b9b5b2a-5b, may_exist=True, interface_attrs={}) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:44:01 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3b9b5b2a-5b, col_values=(('qos', UUID('00615bbf-810c-468f-afea-d22001288f24')),), if_exists=True) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:44:01 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3b9b5b2a-5b, col_values=(('external_ids', {'iface-id': '3b9b5b2a-5b1b-4ec6-900d-c27e7c4a625e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6e:aa:df', 'vm-uuid': '90bd76df-96cb-4bec-9862-853d94cdbaab'}),), if_exists=True) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:44:01 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:44:01 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 09:44:01 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:44:01 user nova-compute[75229]: INFO os_vif [None req-3b6c1bc3-20bd-4c38-907a-c3586f51b9bc tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6e:aa:df,bridge_name='br-int',has_traffic_filtering=True,id=3b9b5b2a-5b1b-4ec6-900d-c27e7c4a625e,network=Network(589aea41-545f-4875-ab56-b7aa273dad6f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b9b5b2a-5b')
Nov 14 09:44:01 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:44:01 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa799c237-ea, may_exist=True, interface_attrs={}) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:44:01 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa799c237-ea, col_values=(('qos', UUID('679f95b9-efdd-45a0-ab6f-b1342459c297')),), if_exists=True) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:44:01 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa799c237-ea, col_values=(('external_ids', {'iface-id': 'a799c237-ea4a-472d-b149-904fabda7414', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:80:1f:b3', 'vm-uuid': '359ff85c-c332-4059-8db4-689a0483d068'}),), if_exists=True) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:44:01 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:44:01 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 09:44:01 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:44:01 user nova-compute[75229]: INFO os_vif [None req-6fb168db-88e3-470e-a460-f02dcd74cc8e tempest-DeleteServersTestJSON-1002799117 tempest-DeleteServersTestJSON-1002799117-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:80:1f:b3,bridge_name='br-int',has_traffic_filtering=True,id=a799c237-ea4a-472d-b149-904fabda7414,network=Network(60446365-aa09-4526-8746-a7069b8083c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa799c237-ea')
Nov 14 09:44:01 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:44:01 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape5b20e94-61, may_exist=True, interface_attrs={}) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:44:01 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape5b20e94-61, col_values=(('qos', UUID('1abcb6a6-cdc8-4d08-a569-33e230f83adc')),), if_exists=True) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:44:01 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape5b20e94-61, col_values=(('external_ids', {'iface-id': 'e5b20e94-618c-4c51-b20f-1d3f1fb921b6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e5:e8:ed', 'vm-uuid': 'a7750cbc-b3d0-44aa-8b88-c291ba007a8a'}),), if_exists=True) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:44:01 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:44:01 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 09:44:01 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:44:01 user nova-compute[75229]: INFO os_vif [None req-0263f621-3230-4ce3-bd4e-7446204bb0ce tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:e8:ed,bridge_name='br-int',has_traffic_filtering=True,id=e5b20e94-618c-4c51-b20f-1d3f1fb921b6,network=Network(5dfc532f-3d5d-4342-b7f1-12c9c3992a54),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape5b20e94-61')
Nov 14 09:44:01 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-3b6c1bc3-20bd-4c38-907a-c3586f51b9bc tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] No BDM found with device name vda, not building metadata. {{(pid=75229) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 09:44:01 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-3b6c1bc3-20bd-4c38-907a-c3586f51b9bc tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] No VIF found with MAC fa:16:3e:6e:aa:df, not building metadata {{(pid=75229) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 09:44:01 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-6fb168db-88e3-470e-a460-f02dcd74cc8e tempest-DeleteServersTestJSON-1002799117 tempest-DeleteServersTestJSON-1002799117-project-member] No BDM found with device name vda, not building metadata. {{(pid=75229) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 09:44:01 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-6fb168db-88e3-470e-a460-f02dcd74cc8e tempest-DeleteServersTestJSON-1002799117 tempest-DeleteServersTestJSON-1002799117-project-member] No VIF found with MAC fa:16:3e:80:1f:b3, not building metadata {{(pid=75229) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 09:44:01 user nova-compute[75229]: DEBUG nova.network.neutron [None req-5d922a01-a874-465d-8f1e-51377ec600a2 tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] [instance: e09b3809-2e23-401c-9a72-88feb2bb657c] Successfully updated port: 472488d2-9453-4d74-a6b1-6966b835572d {{(pid=75229) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 09:44:01 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-0263f621-3230-4ce3-bd4e-7446204bb0ce tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] No BDM found with device name vda, not building metadata. {{(pid=75229) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 09:44:01 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-0263f621-3230-4ce3-bd4e-7446204bb0ce tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] No VIF found with MAC fa:16:3e:e5:e8:ed, not building metadata {{(pid=75229) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 09:44:01 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-5d922a01-a874-465d-8f1e-51377ec600a2 tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] Acquiring lock "refresh_cache-e09b3809-2e23-401c-9a72-88feb2bb657c" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 09:44:01 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-5d922a01-a874-465d-8f1e-51377ec600a2 tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] Acquired lock "refresh_cache-e09b3809-2e23-401c-9a72-88feb2bb657c" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 09:44:01 user nova-compute[75229]: DEBUG nova.network.neutron [None req-5d922a01-a874-465d-8f1e-51377ec600a2 tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] [instance: e09b3809-2e23-401c-9a72-88feb2bb657c] Building network info cache for instance {{(pid=75229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 09:44:02 user nova-compute[75229]: DEBUG nova.network.neutron [None req-5d922a01-a874-465d-8f1e-51377ec600a2 tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] [instance: e09b3809-2e23-401c-9a72-88feb2bb657c] Instance cache missing network info. {{(pid=75229) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 09:44:02 user nova-compute[75229]: DEBUG nova.compute.manager [req-d7e89dcd-51de-4886-a759-7ddf2abff143 req-e61dfb5f-7294-430b-b36c-59ca4efcf11d service nova] [instance: e09b3809-2e23-401c-9a72-88feb2bb657c] Received event network-changed-472488d2-9453-4d74-a6b1-6966b835572d {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:44:02 user nova-compute[75229]: DEBUG nova.compute.manager [req-d7e89dcd-51de-4886-a759-7ddf2abff143 req-e61dfb5f-7294-430b-b36c-59ca4efcf11d service nova] [instance: e09b3809-2e23-401c-9a72-88feb2bb657c] Refreshing instance network info cache due to event network-changed-472488d2-9453-4d74-a6b1-6966b835572d. {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 09:44:02 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-d7e89dcd-51de-4886-a759-7ddf2abff143 req-e61dfb5f-7294-430b-b36c-59ca4efcf11d service nova] Acquiring lock "refresh_cache-e09b3809-2e23-401c-9a72-88feb2bb657c" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 09:44:02 user nova-compute[75229]: DEBUG nova.network.neutron [req-de3e327d-7690-4270-b2fd-1d5557b4e229 req-7dc44ca1-88d3-4a7d-ba4d-cd8aea0a9004 service nova] [instance: a7750cbc-b3d0-44aa-8b88-c291ba007a8a] Updated VIF entry in instance network info cache for port e5b20e94-618c-4c51-b20f-1d3f1fb921b6. {{(pid=75229) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 09:44:02 user nova-compute[75229]: DEBUG nova.network.neutron [req-de3e327d-7690-4270-b2fd-1d5557b4e229 req-7dc44ca1-88d3-4a7d-ba4d-cd8aea0a9004 service nova] [instance: a7750cbc-b3d0-44aa-8b88-c291ba007a8a] Updating instance_info_cache with network_info: [{"id": "e5b20e94-618c-4c51-b20f-1d3f1fb921b6", "address": "fa:16:3e:e5:e8:ed", "network": {"id": "5dfc532f-3d5d-4342-b7f1-12c9c3992a54", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1457278473-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46e65cdd021f4a3db7c9254bb6d98b46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5b20e94-61", "ovs_interfaceid": "e5b20e94-618c-4c51-b20f-1d3f1fb921b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 09:44:02 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-de3e327d-7690-4270-b2fd-1d5557b4e229 req-7dc44ca1-88d3-4a7d-ba4d-cd8aea0a9004 service nova] Releasing lock "refresh_cache-a7750cbc-b3d0-44aa-8b88-c291ba007a8a" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 09:44:02 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:44:02 user nova-compute[75229]: DEBUG nova.network.neutron [None req-296d9af7-abae-42fe-8ef6-92010ee7dd1b tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] [instance: a60d339f-e134-477c-8505-bf8c79d2a21c] Successfully updated port: cb98fc47-7b69-4bde-9a4c-717cd44ba908 {{(pid=75229) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 09:44:02 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-296d9af7-abae-42fe-8ef6-92010ee7dd1b tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] Acquiring lock "refresh_cache-a60d339f-e134-477c-8505-bf8c79d2a21c" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 09:44:02 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-296d9af7-abae-42fe-8ef6-92010ee7dd1b tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] Acquired lock "refresh_cache-a60d339f-e134-477c-8505-bf8c79d2a21c" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 09:44:02 user nova-compute[75229]: DEBUG nova.network.neutron [None req-296d9af7-abae-42fe-8ef6-92010ee7dd1b tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] [instance: a60d339f-e134-477c-8505-bf8c79d2a21c] Building network info cache for instance {{(pid=75229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 09:44:02 user nova-compute[75229]: DEBUG nova.network.neutron [None req-296d9af7-abae-42fe-8ef6-92010ee7dd1b tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] [instance: a60d339f-e134-477c-8505-bf8c79d2a21c] Instance cache missing network info. {{(pid=75229) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 09:44:02 user nova-compute[75229]: DEBUG nova.compute.manager [req-bc4a6af8-e568-4ae8-a3d3-60fb55409bd9 req-6fcc582d-77f2-4bd8-b564-ff94078da853 service nova] [instance: a60d339f-e134-477c-8505-bf8c79d2a21c] Received event network-changed-cb98fc47-7b69-4bde-9a4c-717cd44ba908 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:44:02 user nova-compute[75229]: DEBUG nova.compute.manager [req-bc4a6af8-e568-4ae8-a3d3-60fb55409bd9 req-6fcc582d-77f2-4bd8-b564-ff94078da853 service nova] [instance: a60d339f-e134-477c-8505-bf8c79d2a21c] Refreshing instance network info cache due to event network-changed-cb98fc47-7b69-4bde-9a4c-717cd44ba908. {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 09:44:02 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-bc4a6af8-e568-4ae8-a3d3-60fb55409bd9 req-6fcc582d-77f2-4bd8-b564-ff94078da853 service nova] Acquiring lock "refresh_cache-a60d339f-e134-477c-8505-bf8c79d2a21c" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 09:44:03 user nova-compute[75229]: DEBUG nova.network.neutron [None req-296d9af7-abae-42fe-8ef6-92010ee7dd1b tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] [instance: a60d339f-e134-477c-8505-bf8c79d2a21c] Updating instance_info_cache with network_info: [{"id": "cb98fc47-7b69-4bde-9a4c-717cd44ba908", "address": "fa:16:3e:6c:f4:6d", "network": {"id": "2b667d50-4579-4453-b4d3-a818a0d2c6fc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1719812180-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32e17c7c586542139cdbc5bfda57e075", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb98fc47-7b", "ovs_interfaceid": "cb98fc47-7b69-4bde-9a4c-717cd44ba908", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 09:44:03 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-296d9af7-abae-42fe-8ef6-92010ee7dd1b tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] Releasing lock "refresh_cache-a60d339f-e134-477c-8505-bf8c79d2a21c" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 09:44:03 user nova-compute[75229]: DEBUG nova.compute.manager [None req-296d9af7-abae-42fe-8ef6-92010ee7dd1b tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] [instance: a60d339f-e134-477c-8505-bf8c79d2a21c] Instance network_info: |[{"id": "cb98fc47-7b69-4bde-9a4c-717cd44ba908", "address": "fa:16:3e:6c:f4:6d", "network": {"id": "2b667d50-4579-4453-b4d3-a818a0d2c6fc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1719812180-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32e17c7c586542139cdbc5bfda57e075", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb98fc47-7b", "ovs_interfaceid": "cb98fc47-7b69-4bde-9a4c-717cd44ba908", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75229) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 09:44:03 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-bc4a6af8-e568-4ae8-a3d3-60fb55409bd9 req-6fcc582d-77f2-4bd8-b564-ff94078da853 service nova] Acquired lock "refresh_cache-a60d339f-e134-477c-8505-bf8c79d2a21c" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 09:44:03 user nova-compute[75229]: DEBUG nova.network.neutron [req-bc4a6af8-e568-4ae8-a3d3-60fb55409bd9 req-6fcc582d-77f2-4bd8-b564-ff94078da853 service nova] [instance: a60d339f-e134-477c-8505-bf8c79d2a21c] Refreshing network info cache for port cb98fc47-7b69-4bde-9a4c-717cd44ba908 {{(pid=75229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 09:44:03 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-296d9af7-abae-42fe-8ef6-92010ee7dd1b tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] [instance: a60d339f-e134-477c-8505-bf8c79d2a21c] Start _get_guest_xml network_info=[{"id": "cb98fc47-7b69-4bde-9a4c-717cd44ba908", "address": "fa:16:3e:6c:f4:6d", "network": {"id": "2b667d50-4579-4453-b4d3-a818a0d2c6fc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1719812180-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32e17c7c586542139cdbc5bfda57e075", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb98fc47-7b", "ovs_interfaceid": "cb98fc47-7b69-4bde-9a4c-717cd44ba908", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T09:40:10Z,direct_url=<?>,disk_format='qcow2',id=3bef8470-ecc7-40e3-95d4-9254348ea72d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='de5a91106b6948ed937a7178ff9464c4',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T09:40:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'disk_bus': 'virtio', 'guest_format': None, 'encryption_secret_uuid': None, 'size': 0, 'device_type': 'disk', 'image_id': '3bef8470-ecc7-40e3-95d4-9254348ea72d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75229) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 09:44:03 user nova-compute[75229]: WARNING nova.virt.libvirt.driver [None req-296d9af7-abae-42fe-8ef6-92010ee7dd1b tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 09:44:03 user nova-compute[75229]: WARNING nova.virt.libvirt.driver [None req-296d9af7-abae-42fe-8ef6-92010ee7dd1b tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 09:44:03 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-296d9af7-abae-42fe-8ef6-92010ee7dd1b tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75229) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 09:44:03 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-296d9af7-abae-42fe-8ef6-92010ee7dd1b tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] CPU controller missing on host. {{(pid=75229) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 09:44:03 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-296d9af7-abae-42fe-8ef6-92010ee7dd1b tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75229) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 09:44:03 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-296d9af7-abae-42fe-8ef6-92010ee7dd1b tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] CPU controller found on host. {{(pid=75229) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 09:44:03 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-296d9af7-abae-42fe-8ef6-92010ee7dd1b tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75229) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 09:44:03 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-296d9af7-abae-42fe-8ef6-92010ee7dd1b tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T09:39:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T09:40:10Z,direct_url=<?>,disk_format='qcow2',id=3bef8470-ecc7-40e3-95d4-9254348ea72d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='de5a91106b6948ed937a7178ff9464c4',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T09:40:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 09:44:03 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-296d9af7-abae-42fe-8ef6-92010ee7dd1b tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] Flavor limits 0:0:0 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 09:44:03 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-296d9af7-abae-42fe-8ef6-92010ee7dd1b tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] Image limits 0:0:0 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 09:44:03 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-296d9af7-abae-42fe-8ef6-92010ee7dd1b tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] Flavor pref 0:0:0 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 09:44:03 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-296d9af7-abae-42fe-8ef6-92010ee7dd1b tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] Image pref 0:0:0 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 09:44:03 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-296d9af7-abae-42fe-8ef6-92010ee7dd1b tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 09:44:03 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-296d9af7-abae-42fe-8ef6-92010ee7dd1b tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 09:44:03 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-296d9af7-abae-42fe-8ef6-92010ee7dd1b tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75229) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 09:44:03 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-296d9af7-abae-42fe-8ef6-92010ee7dd1b tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] Got 1 possible topologies {{(pid=75229) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 09:44:03 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-296d9af7-abae-42fe-8ef6-92010ee7dd1b tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 09:44:03 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-296d9af7-abae-42fe-8ef6-92010ee7dd1b tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 09:44:03 user nova-compute[75229]: DEBUG nova.virt.libvirt.vif [None req-296d9af7-abae-42fe-8ef6-92010ee7dd1b tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T09:43:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-285833760',display_name='tempest-ServerActionsTestOtherB-server-285833760',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-285833760',id=5,image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLBqRiXBmoqcQBqBQflJnJ0Bni+p+JlFtve2BlM0X9wLvjWsKzu7TCQo3Ot5hzNFvzwCz/gEUspFHpyxxEkScMIm/fUvYWhxYR4DsojCDDatjjGg5V63rlfYUre+iymhFw==',key_name='tempest-keypair-1362974744',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='32e17c7c586542139cdbc5bfda57e075',ramdisk_id='',reservation_id='r-vw8kxtrn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-45710955',owner_user_name='tempest-ServerActionsTestOtherB-45710955-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T09:43:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='39c6903e2d154e838835eb5265776521',uuid=a60d339f-e134-477c-8505-bf8c79d2a21c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cb98fc47-7b69-4bde-9a4c-717cd44ba908", "address": "fa:16:3e:6c:f4:6d", "network": {"id": "2b667d50-4579-4453-b4d3-a818a0d2c6fc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1719812180-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32e17c7c586542139cdbc5bfda57e075", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb98fc47-7b", "ovs_interfaceid": "cb98fc47-7b69-4bde-9a4c-717cd44ba908", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75229) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 09:44:03 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-296d9af7-abae-42fe-8ef6-92010ee7dd1b tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] Converting VIF {"id": "cb98fc47-7b69-4bde-9a4c-717cd44ba908", "address": "fa:16:3e:6c:f4:6d", "network": {"id": "2b667d50-4579-4453-b4d3-a818a0d2c6fc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1719812180-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32e17c7c586542139cdbc5bfda57e075", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb98fc47-7b", "ovs_interfaceid": "cb98fc47-7b69-4bde-9a4c-717cd44ba908", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 09:44:03 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-296d9af7-abae-42fe-8ef6-92010ee7dd1b tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6c:f4:6d,bridge_name='br-int',has_traffic_filtering=True,id=cb98fc47-7b69-4bde-9a4c-717cd44ba908,network=Network(2b667d50-4579-4453-b4d3-a818a0d2c6fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb98fc47-7b') {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 09:44:03 user nova-compute[75229]: DEBUG nova.objects.instance [None req-296d9af7-abae-42fe-8ef6-92010ee7dd1b tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] Lazy-loading 'pci_devices' on Instance uuid a60d339f-e134-477c-8505-bf8c79d2a21c {{(pid=75229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 09:44:03 user nova-compute[75229]: DEBUG nova.network.neutron [None req-5d922a01-a874-465d-8f1e-51377ec600a2 tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] [instance: e09b3809-2e23-401c-9a72-88feb2bb657c] Updating instance_info_cache with network_info: [{"id": "472488d2-9453-4d74-a6b1-6966b835572d", "address": "fa:16:3e:9f:3a:e8", "network": {"id": "f5285ef5-fa74-4079-a8cd-f970d97c97c3", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-62550527-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54dca06fda8b43d5bc92fa7c97a872a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap472488d2-94", "ovs_interfaceid": "472488d2-9453-4d74-a6b1-6966b835572d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 09:44:03 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-296d9af7-abae-42fe-8ef6-92010ee7dd1b tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] [instance: a60d339f-e134-477c-8505-bf8c79d2a21c] End _get_guest_xml xml=<domain type="kvm">
Nov 14 09:44:03 user nova-compute[75229]:   <uuid>a60d339f-e134-477c-8505-bf8c79d2a21c</uuid>
Nov 14 09:44:03 user nova-compute[75229]:   <name>instance-00000005</name>
Nov 14 09:44:03 user nova-compute[75229]:   <memory>524288</memory>
Nov 14 09:44:03 user nova-compute[75229]:   <vcpu>1</vcpu>
Nov 14 09:44:03 user nova-compute[75229]:   <metadata>
Nov 14 09:44:03 user nova-compute[75229]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 09:44:03 user nova-compute[75229]:       <nova:package version="0.0.0"/>
Nov 14 09:44:03 user nova-compute[75229]:       <nova:name>tempest-ServerActionsTestOtherB-server-285833760</nova:name>
Nov 14 09:44:03 user nova-compute[75229]:       <nova:creationTime>2023-11-14 09:44:03</nova:creationTime>
Nov 14 09:44:03 user nova-compute[75229]:       <nova:flavor name="m1.tiny">
Nov 14 09:44:03 user nova-compute[75229]:         <nova:memory>512</nova:memory>
Nov 14 09:44:03 user nova-compute[75229]:         <nova:disk>1</nova:disk>
Nov 14 09:44:03 user nova-compute[75229]:         <nova:swap>0</nova:swap>
Nov 14 09:44:03 user nova-compute[75229]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 09:44:03 user nova-compute[75229]:         <nova:vcpus>1</nova:vcpus>
Nov 14 09:44:03 user nova-compute[75229]:       </nova:flavor>
Nov 14 09:44:03 user nova-compute[75229]:       <nova:owner>
Nov 14 09:44:03 user nova-compute[75229]:         <nova:user uuid="39c6903e2d154e838835eb5265776521">tempest-ServerActionsTestOtherB-45710955-project-member</nova:user>
Nov 14 09:44:03 user nova-compute[75229]:         <nova:project uuid="32e17c7c586542139cdbc5bfda57e075">tempest-ServerActionsTestOtherB-45710955</nova:project>
Nov 14 09:44:03 user nova-compute[75229]:       </nova:owner>
Nov 14 09:44:03 user nova-compute[75229]:       <nova:root type="image" uuid="3bef8470-ecc7-40e3-95d4-9254348ea72d"/>
Nov 14 09:44:03 user nova-compute[75229]:       <nova:ports>
Nov 14 09:44:03 user nova-compute[75229]:         <nova:port uuid="cb98fc47-7b69-4bde-9a4c-717cd44ba908">
Nov 14 09:44:03 user nova-compute[75229]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 14 09:44:03 user nova-compute[75229]:         </nova:port>
Nov 14 09:44:03 user nova-compute[75229]:       </nova:ports>
Nov 14 09:44:03 user nova-compute[75229]:     </nova:instance>
Nov 14 09:44:03 user nova-compute[75229]:   </metadata>
Nov 14 09:44:03 user nova-compute[75229]:   <sysinfo type="smbios">
Nov 14 09:44:03 user nova-compute[75229]:     <system>
Nov 14 09:44:03 user nova-compute[75229]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 09:44:03 user nova-compute[75229]:       <entry name="product">OpenStack Nova</entry>
Nov 14 09:44:03 user nova-compute[75229]:       <entry name="version">0.0.0</entry>
Nov 14 09:44:03 user nova-compute[75229]:       <entry name="serial">a60d339f-e134-477c-8505-bf8c79d2a21c</entry>
Nov 14 09:44:03 user nova-compute[75229]:       <entry name="uuid">a60d339f-e134-477c-8505-bf8c79d2a21c</entry>
Nov 14 09:44:03 user nova-compute[75229]:       <entry name="family">Virtual Machine</entry>
Nov 14 09:44:03 user nova-compute[75229]:     </system>
Nov 14 09:44:03 user nova-compute[75229]:   </sysinfo>
Nov 14 09:44:03 user nova-compute[75229]:   <os>
Nov 14 09:44:03 user nova-compute[75229]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 09:44:03 user nova-compute[75229]:     <boot dev="hd"/>
Nov 14 09:44:03 user nova-compute[75229]:     <smbios mode="sysinfo"/>
Nov 14 09:44:03 user nova-compute[75229]:   </os>
Nov 14 09:44:03 user nova-compute[75229]:   <features>
Nov 14 09:44:03 user nova-compute[75229]:     <acpi/>
Nov 14 09:44:03 user nova-compute[75229]:     <apic/>
Nov 14 09:44:03 user nova-compute[75229]:     <vmcoreinfo/>
Nov 14 09:44:03 user nova-compute[75229]:   </features>
Nov 14 09:44:03 user nova-compute[75229]:   <clock offset="utc">
Nov 14 09:44:03 user nova-compute[75229]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 09:44:03 user nova-compute[75229]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 09:44:03 user nova-compute[75229]:     <timer name="hpet" present="no"/>
Nov 14 09:44:03 user nova-compute[75229]:   </clock>
Nov 14 09:44:03 user nova-compute[75229]:   <cpu mode="custom" match="exact">
Nov 14 09:44:03 user nova-compute[75229]:     <model>Nehalem</model>
Nov 14 09:44:03 user nova-compute[75229]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 09:44:03 user nova-compute[75229]:   </cpu>
Nov 14 09:44:03 user nova-compute[75229]:   <devices>
Nov 14 09:44:03 user nova-compute[75229]:     <disk type="file" device="disk">
Nov 14 09:44:03 user nova-compute[75229]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 09:44:03 user nova-compute[75229]:       <source file="/opt/stack/data/nova/instances/a60d339f-e134-477c-8505-bf8c79d2a21c/disk"/>
Nov 14 09:44:03 user nova-compute[75229]:       <target dev="vda" bus="virtio"/>
Nov 14 09:44:03 user nova-compute[75229]:     </disk>
Nov 14 09:44:03 user nova-compute[75229]:     <interface type="ethernet">
Nov 14 09:44:03 user nova-compute[75229]:       <mac address="fa:16:3e:6c:f4:6d"/>
Nov 14 09:44:03 user nova-compute[75229]:       <model type="virtio"/>
Nov 14 09:44:03 user nova-compute[75229]:       <mtu size="1442"/>
Nov 14 09:44:03 user nova-compute[75229]:       <target dev="tapcb98fc47-7b"/>
Nov 14 09:44:03 user nova-compute[75229]:     </interface>
Nov 14 09:44:03 user nova-compute[75229]:     <serial type="pty">
Nov 14 09:44:03 user nova-compute[75229]:       <log file="/opt/stack/data/nova/instances/a60d339f-e134-477c-8505-bf8c79d2a21c/console.log" append="off"/>
Nov 14 09:44:03 user nova-compute[75229]:     </serial>
Nov 14 09:44:03 user nova-compute[75229]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 09:44:03 user nova-compute[75229]:     <video>
Nov 14 09:44:03 user nova-compute[75229]:       <model type="virtio"/>
Nov 14 09:44:03 user nova-compute[75229]:     </video>
Nov 14 09:44:03 user nova-compute[75229]:     <rng model="virtio">
Nov 14 09:44:03 user nova-compute[75229]:       <backend model="random">/dev/urandom</backend>
Nov 14 09:44:03 user nova-compute[75229]:     </rng>
Nov 14 09:44:03 user nova-compute[75229]:     <controller type="usb" index="0" model="none"/>
Nov 14 09:44:03 user nova-compute[75229]:     <memballoon model="virtio">
Nov 14 09:44:03 user nova-compute[75229]:       <stats period="10"/>
Nov 14 09:44:03 user nova-compute[75229]:     </memballoon>
Nov 14 09:44:03 user nova-compute[75229]:   </devices>
Nov 14 09:44:03 user nova-compute[75229]: </domain>
Nov 14 09:44:03 user nova-compute[75229]:  {{(pid=75229) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 09:44:03 user nova-compute[75229]: DEBUG nova.virt.libvirt.vif [None req-296d9af7-abae-42fe-8ef6-92010ee7dd1b tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T09:43:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-285833760',display_name='tempest-ServerActionsTestOtherB-server-285833760',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-285833760',id=5,image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLBqRiXBmoqcQBqBQflJnJ0Bni+p+JlFtve2BlM0X9wLvjWsKzu7TCQo3Ot5hzNFvzwCz/gEUspFHpyxxEkScMIm/fUvYWhxYR4DsojCDDatjjGg5V63rlfYUre+iymhFw==',key_name='tempest-keypair-1362974744',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='32e17c7c586542139cdbc5bfda57e075',ramdisk_id='',reservation_id='r-vw8kxtrn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-45710955',owner_user_name='tempest-ServerActionsTestOtherB-45710955-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T09:43:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='39c6903e2d154e838835eb5265776521',uuid=a60d339f-e134-477c-8505-bf8c79d2a21c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cb98fc47-7b69-4bde-9a4c-717cd44ba908", "address": "fa:16:3e:6c:f4:6d", "network": {"id": "2b667d50-4579-4453-b4d3-a818a0d2c6fc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1719812180-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32e17c7c586542139cdbc5bfda57e075", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb98fc47-7b", "ovs_interfaceid": "cb98fc47-7b69-4bde-9a4c-717cd44ba908", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 09:44:03 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-296d9af7-abae-42fe-8ef6-92010ee7dd1b tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] Converting VIF {"id": "cb98fc47-7b69-4bde-9a4c-717cd44ba908", "address": "fa:16:3e:6c:f4:6d", "network": {"id": "2b667d50-4579-4453-b4d3-a818a0d2c6fc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1719812180-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32e17c7c586542139cdbc5bfda57e075", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb98fc47-7b", "ovs_interfaceid": "cb98fc47-7b69-4bde-9a4c-717cd44ba908", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 09:44:03 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-296d9af7-abae-42fe-8ef6-92010ee7dd1b tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6c:f4:6d,bridge_name='br-int',has_traffic_filtering=True,id=cb98fc47-7b69-4bde-9a4c-717cd44ba908,network=Network(2b667d50-4579-4453-b4d3-a818a0d2c6fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb98fc47-7b') {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 09:44:03 user nova-compute[75229]: DEBUG os_vif [None req-296d9af7-abae-42fe-8ef6-92010ee7dd1b tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6c:f4:6d,bridge_name='br-int',has_traffic_filtering=True,id=cb98fc47-7b69-4bde-9a4c-717cd44ba908,network=Network(2b667d50-4579-4453-b4d3-a818a0d2c6fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb98fc47-7b') {{(pid=75229) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 09:44:03 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:44:03 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:44:03 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 09:44:03 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:44:03 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9749a676-2e86-568f-b7d8-1b9ced9bbfec', '_type': 'linux-noop'}}, row=False) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:44:03 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:44:03 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 09:44:03 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-5d922a01-a874-465d-8f1e-51377ec600a2 tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] Releasing lock "refresh_cache-e09b3809-2e23-401c-9a72-88feb2bb657c" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 09:44:03 user nova-compute[75229]: DEBUG nova.compute.manager [None req-5d922a01-a874-465d-8f1e-51377ec600a2 tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] [instance: e09b3809-2e23-401c-9a72-88feb2bb657c] Instance network_info: |[{"id": "472488d2-9453-4d74-a6b1-6966b835572d", "address": "fa:16:3e:9f:3a:e8", "network": {"id": "f5285ef5-fa74-4079-a8cd-f970d97c97c3", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-62550527-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54dca06fda8b43d5bc92fa7c97a872a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap472488d2-94", "ovs_interfaceid": "472488d2-9453-4d74-a6b1-6966b835572d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75229) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 09:44:03 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-d7e89dcd-51de-4886-a759-7ddf2abff143 req-e61dfb5f-7294-430b-b36c-59ca4efcf11d service nova] Acquired lock "refresh_cache-e09b3809-2e23-401c-9a72-88feb2bb657c" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 09:44:03 user nova-compute[75229]: DEBUG nova.network.neutron [req-d7e89dcd-51de-4886-a759-7ddf2abff143 req-e61dfb5f-7294-430b-b36c-59ca4efcf11d service nova] [instance: e09b3809-2e23-401c-9a72-88feb2bb657c] Refreshing network info cache for port 472488d2-9453-4d74-a6b1-6966b835572d {{(pid=75229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 09:44:03 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-5d922a01-a874-465d-8f1e-51377ec600a2 tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] [instance: e09b3809-2e23-401c-9a72-88feb2bb657c] Start _get_guest_xml network_info=[{"id": "472488d2-9453-4d74-a6b1-6966b835572d", "address": "fa:16:3e:9f:3a:e8", "network": {"id": "f5285ef5-fa74-4079-a8cd-f970d97c97c3", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-62550527-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54dca06fda8b43d5bc92fa7c97a872a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap472488d2-94", "ovs_interfaceid": "472488d2-9453-4d74-a6b1-6966b835572d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T09:40:10Z,direct_url=<?>,disk_format='qcow2',id=3bef8470-ecc7-40e3-95d4-9254348ea72d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='de5a91106b6948ed937a7178ff9464c4',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T09:40:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'disk_bus': 'virtio', 'guest_format': None, 'encryption_secret_uuid': None, 'size': 0, 'device_type': 'disk', 'image_id': '3bef8470-ecc7-40e3-95d4-9254348ea72d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75229) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 09:44:03 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:44:03 user nova-compute[75229]: WARNING nova.virt.libvirt.driver [None req-5d922a01-a874-465d-8f1e-51377ec600a2 tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 09:44:03 user nova-compute[75229]: WARNING nova.virt.libvirt.driver [None req-5d922a01-a874-465d-8f1e-51377ec600a2 tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 09:44:03 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:44:03 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcb98fc47-7b, may_exist=True, interface_attrs={}) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:44:03 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapcb98fc47-7b, col_values=(('qos', UUID('4ef27463-5349-4db0-85bc-39ad82899bfd')),), if_exists=True) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:44:03 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapcb98fc47-7b, col_values=(('external_ids', {'iface-id': 'cb98fc47-7b69-4bde-9a4c-717cd44ba908', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6c:f4:6d', 'vm-uuid': 'a60d339f-e134-477c-8505-bf8c79d2a21c'}),), if_exists=True) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:44:03 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:44:03 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 09:44:03 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-5d922a01-a874-465d-8f1e-51377ec600a2 tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75229) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 09:44:03 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-5d922a01-a874-465d-8f1e-51377ec600a2 tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] CPU controller missing on host. {{(pid=75229) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 09:44:03 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-5d922a01-a874-465d-8f1e-51377ec600a2 tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75229) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 09:44:03 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-5d922a01-a874-465d-8f1e-51377ec600a2 tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] CPU controller found on host. {{(pid=75229) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 09:44:03 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-5d922a01-a874-465d-8f1e-51377ec600a2 tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75229) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 09:44:03 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-5d922a01-a874-465d-8f1e-51377ec600a2 tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T09:39:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T09:40:10Z,direct_url=<?>,disk_format='qcow2',id=3bef8470-ecc7-40e3-95d4-9254348ea72d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='de5a91106b6948ed937a7178ff9464c4',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T09:40:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 09:44:03 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-5d922a01-a874-465d-8f1e-51377ec600a2 tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] Flavor limits 0:0:0 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 09:44:03 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-5d922a01-a874-465d-8f1e-51377ec600a2 tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] Image limits 0:0:0 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 09:44:03 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-5d922a01-a874-465d-8f1e-51377ec600a2 tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] Flavor pref 0:0:0 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 09:44:03 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-5d922a01-a874-465d-8f1e-51377ec600a2 tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] Image pref 0:0:0 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 09:44:03 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-5d922a01-a874-465d-8f1e-51377ec600a2 tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 09:44:03 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-5d922a01-a874-465d-8f1e-51377ec600a2 tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 09:44:03 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-5d922a01-a874-465d-8f1e-51377ec600a2 tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75229) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 09:44:03 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-5d922a01-a874-465d-8f1e-51377ec600a2 tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] Got 1 possible topologies {{(pid=75229) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 09:44:03 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-5d922a01-a874-465d-8f1e-51377ec600a2 tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 09:44:03 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-5d922a01-a874-465d-8f1e-51377ec600a2 tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 09:44:03 user nova-compute[75229]: DEBUG nova.virt.libvirt.vif [None req-5d922a01-a874-465d-8f1e-51377ec600a2 tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T09:43:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1726752268',display_name='tempest-ServerStableDeviceRescueTest-server-1726752268',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1726752268',id=4,image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNm5isUaPy6aeQRy5OrjJxFeGvdR3hP9hNCaGuAFXcrDHTuZbYjZaj7/pLtpuIgJqJ91hnf0ENeQ3ZP5Dwi5b6SQ5W5TR5kgPoLnxRfcQmwE6thKL5eCNtvCvPLZ4XIdRw==',key_name='tempest-keypair-1926094689',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='54dca06fda8b43d5bc92fa7c97a872a7',ramdisk_id='',reservation_id='r-fl9qbxad',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-1482859960',owner_user_name='tempest-ServerStableDeviceRescueTest-1482859960-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T09:43:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fbe8d49b2c9e43cf98f14f49fa8de80c',uuid=e09b3809-2e23-401c-9a72-88feb2bb657c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "472488d2-9453-4d74-a6b1-6966b835572d", "address": "fa:16:3e:9f:3a:e8", "network": {"id": "f5285ef5-fa74-4079-a8cd-f970d97c97c3", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-62550527-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54dca06fda8b43d5bc92fa7c97a872a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap472488d2-94", "ovs_interfaceid": "472488d2-9453-4d74-a6b1-6966b835572d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75229) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 09:44:03 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-5d922a01-a874-465d-8f1e-51377ec600a2 tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] Converting VIF {"id": "472488d2-9453-4d74-a6b1-6966b835572d", "address": "fa:16:3e:9f:3a:e8", "network": {"id": "f5285ef5-fa74-4079-a8cd-f970d97c97c3", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-62550527-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54dca06fda8b43d5bc92fa7c97a872a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap472488d2-94", "ovs_interfaceid": "472488d2-9453-4d74-a6b1-6966b835572d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 09:44:03 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-5d922a01-a874-465d-8f1e-51377ec600a2 tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9f:3a:e8,bridge_name='br-int',has_traffic_filtering=True,id=472488d2-9453-4d74-a6b1-6966b835572d,network=Network(f5285ef5-fa74-4079-a8cd-f970d97c97c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap472488d2-94') {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 09:44:03 user nova-compute[75229]: DEBUG nova.objects.instance [None req-5d922a01-a874-465d-8f1e-51377ec600a2 tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] Lazy-loading 'pci_devices' on Instance uuid e09b3809-2e23-401c-9a72-88feb2bb657c {{(pid=75229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 09:44:03 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:44:03 user nova-compute[75229]: INFO os_vif [None req-296d9af7-abae-42fe-8ef6-92010ee7dd1b tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6c:f4:6d,bridge_name='br-int',has_traffic_filtering=True,id=cb98fc47-7b69-4bde-9a4c-717cd44ba908,network=Network(2b667d50-4579-4453-b4d3-a818a0d2c6fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb98fc47-7b')
Nov 14 09:44:03 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-5d922a01-a874-465d-8f1e-51377ec600a2 tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] [instance: e09b3809-2e23-401c-9a72-88feb2bb657c] End _get_guest_xml xml=<domain type="kvm">
Nov 14 09:44:03 user nova-compute[75229]:   <uuid>e09b3809-2e23-401c-9a72-88feb2bb657c</uuid>
Nov 14 09:44:03 user nova-compute[75229]:   <name>instance-00000004</name>
Nov 14 09:44:03 user nova-compute[75229]:   <memory>524288</memory>
Nov 14 09:44:03 user nova-compute[75229]:   <vcpu>1</vcpu>
Nov 14 09:44:03 user nova-compute[75229]:   <metadata>
Nov 14 09:44:03 user nova-compute[75229]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 09:44:03 user nova-compute[75229]:       <nova:package version="0.0.0"/>
Nov 14 09:44:03 user nova-compute[75229]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-1726752268</nova:name>
Nov 14 09:44:03 user nova-compute[75229]:       <nova:creationTime>2023-11-14 09:44:03</nova:creationTime>
Nov 14 09:44:03 user nova-compute[75229]:       <nova:flavor name="m1.tiny">
Nov 14 09:44:03 user nova-compute[75229]:         <nova:memory>512</nova:memory>
Nov 14 09:44:03 user nova-compute[75229]:         <nova:disk>1</nova:disk>
Nov 14 09:44:03 user nova-compute[75229]:         <nova:swap>0</nova:swap>
Nov 14 09:44:03 user nova-compute[75229]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 09:44:03 user nova-compute[75229]:         <nova:vcpus>1</nova:vcpus>
Nov 14 09:44:03 user nova-compute[75229]:       </nova:flavor>
Nov 14 09:44:03 user nova-compute[75229]:       <nova:owner>
Nov 14 09:44:03 user nova-compute[75229]:         <nova:user uuid="fbe8d49b2c9e43cf98f14f49fa8de80c">tempest-ServerStableDeviceRescueTest-1482859960-project-member</nova:user>
Nov 14 09:44:03 user nova-compute[75229]:         <nova:project uuid="54dca06fda8b43d5bc92fa7c97a872a7">tempest-ServerStableDeviceRescueTest-1482859960</nova:project>
Nov 14 09:44:03 user nova-compute[75229]:       </nova:owner>
Nov 14 09:44:03 user nova-compute[75229]:       <nova:root type="image" uuid="3bef8470-ecc7-40e3-95d4-9254348ea72d"/>
Nov 14 09:44:03 user nova-compute[75229]:       <nova:ports>
Nov 14 09:44:03 user nova-compute[75229]:         <nova:port uuid="472488d2-9453-4d74-a6b1-6966b835572d">
Nov 14 09:44:03 user nova-compute[75229]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 14 09:44:03 user nova-compute[75229]:         </nova:port>
Nov 14 09:44:03 user nova-compute[75229]:       </nova:ports>
Nov 14 09:44:03 user nova-compute[75229]:     </nova:instance>
Nov 14 09:44:03 user nova-compute[75229]:   </metadata>
Nov 14 09:44:03 user nova-compute[75229]:   <sysinfo type="smbios">
Nov 14 09:44:03 user nova-compute[75229]:     <system>
Nov 14 09:44:03 user nova-compute[75229]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 09:44:03 user nova-compute[75229]:       <entry name="product">OpenStack Nova</entry>
Nov 14 09:44:03 user nova-compute[75229]:       <entry name="version">0.0.0</entry>
Nov 14 09:44:03 user nova-compute[75229]:       <entry name="serial">e09b3809-2e23-401c-9a72-88feb2bb657c</entry>
Nov 14 09:44:03 user nova-compute[75229]:       <entry name="uuid">e09b3809-2e23-401c-9a72-88feb2bb657c</entry>
Nov 14 09:44:03 user nova-compute[75229]:       <entry name="family">Virtual Machine</entry>
Nov 14 09:44:03 user nova-compute[75229]:     </system>
Nov 14 09:44:03 user nova-compute[75229]:   </sysinfo>
Nov 14 09:44:03 user nova-compute[75229]:   <os>
Nov 14 09:44:03 user nova-compute[75229]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 09:44:03 user nova-compute[75229]:     <boot dev="hd"/>
Nov 14 09:44:03 user nova-compute[75229]:     <smbios mode="sysinfo"/>
Nov 14 09:44:03 user nova-compute[75229]:   </os>
Nov 14 09:44:03 user nova-compute[75229]:   <features>
Nov 14 09:44:03 user nova-compute[75229]:     <acpi/>
Nov 14 09:44:03 user nova-compute[75229]:     <apic/>
Nov 14 09:44:03 user nova-compute[75229]:     <vmcoreinfo/>
Nov 14 09:44:03 user nova-compute[75229]:   </features>
Nov 14 09:44:03 user nova-compute[75229]:   <clock offset="utc">
Nov 14 09:44:03 user nova-compute[75229]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 09:44:03 user nova-compute[75229]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 09:44:03 user nova-compute[75229]:     <timer name="hpet" present="no"/>
Nov 14 09:44:03 user nova-compute[75229]:   </clock>
Nov 14 09:44:03 user nova-compute[75229]:   <cpu mode="custom" match="exact">
Nov 14 09:44:03 user nova-compute[75229]:     <model>Nehalem</model>
Nov 14 09:44:03 user nova-compute[75229]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 09:44:03 user nova-compute[75229]:   </cpu>
Nov 14 09:44:03 user nova-compute[75229]:   <devices>
Nov 14 09:44:03 user nova-compute[75229]:     <disk type="file" device="disk">
Nov 14 09:44:03 user nova-compute[75229]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 09:44:03 user nova-compute[75229]:       <source file="/opt/stack/data/nova/instances/e09b3809-2e23-401c-9a72-88feb2bb657c/disk"/>
Nov 14 09:44:03 user nova-compute[75229]:       <target dev="vda" bus="virtio"/>
Nov 14 09:44:03 user nova-compute[75229]:     </disk>
Nov 14 09:44:03 user nova-compute[75229]:     <interface type="ethernet">
Nov 14 09:44:03 user nova-compute[75229]:       <mac address="fa:16:3e:9f:3a:e8"/>
Nov 14 09:44:03 user nova-compute[75229]:       <model type="virtio"/>
Nov 14 09:44:03 user nova-compute[75229]:       <mtu size="1442"/>
Nov 14 09:44:03 user nova-compute[75229]:       <target dev="tap472488d2-94"/>
Nov 14 09:44:03 user nova-compute[75229]:     </interface>
Nov 14 09:44:03 user nova-compute[75229]:     <serial type="pty">
Nov 14 09:44:03 user nova-compute[75229]:       <log file="/opt/stack/data/nova/instances/e09b3809-2e23-401c-9a72-88feb2bb657c/console.log" append="off"/>
Nov 14 09:44:03 user nova-compute[75229]:     </serial>
Nov 14 09:44:03 user nova-compute[75229]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 09:44:03 user nova-compute[75229]:     <video>
Nov 14 09:44:03 user nova-compute[75229]:       <model type="virtio"/>
Nov 14 09:44:03 user nova-compute[75229]:     </video>
Nov 14 09:44:03 user nova-compute[75229]:     <rng model="virtio">
Nov 14 09:44:03 user nova-compute[75229]:       <backend model="random">/dev/urandom</backend>
Nov 14 09:44:03 user nova-compute[75229]:     </rng>
Nov 14 09:44:03 user nova-compute[75229]:     <controller type="usb" index="0" model="none"/>
Nov 14 09:44:03 user nova-compute[75229]:     <memballoon model="virtio">
Nov 14 09:44:03 user nova-compute[75229]:       <stats period="10"/>
Nov 14 09:44:03 user nova-compute[75229]:     </memballoon>
Nov 14 09:44:03 user nova-compute[75229]:   </devices>
Nov 14 09:44:03 user nova-compute[75229]: </domain>
Nov 14 09:44:03 user nova-compute[75229]:  {{(pid=75229) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 09:44:03 user nova-compute[75229]: DEBUG nova.virt.libvirt.vif [None req-5d922a01-a874-465d-8f1e-51377ec600a2 tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T09:43:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1726752268',display_name='tempest-ServerStableDeviceRescueTest-server-1726752268',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1726752268',id=4,image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNm5isUaPy6aeQRy5OrjJxFeGvdR3hP9hNCaGuAFXcrDHTuZbYjZaj7/pLtpuIgJqJ91hnf0ENeQ3ZP5Dwi5b6SQ5W5TR5kgPoLnxRfcQmwE6thKL5eCNtvCvPLZ4XIdRw==',key_name='tempest-keypair-1926094689',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='54dca06fda8b43d5bc92fa7c97a872a7',ramdisk_id='',reservation_id='r-fl9qbxad',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-1482859960',owner_user_name='tempest-ServerStableDeviceRescueTest-1482859960-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T09:43:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fbe8d49b2c9e43cf98f14f49fa8de80c',uuid=e09b3809-2e23-401c-9a72-88feb2bb657c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "472488d2-9453-4d74-a6b1-6966b835572d", "address": "fa:16:3e:9f:3a:e8", "network": {"id": "f5285ef5-fa74-4079-a8cd-f970d97c97c3", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-62550527-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54dca06fda8b43d5bc92fa7c97a872a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap472488d2-94", "ovs_interfaceid": "472488d2-9453-4d74-a6b1-6966b835572d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 09:44:03 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-5d922a01-a874-465d-8f1e-51377ec600a2 tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] Converting VIF {"id": "472488d2-9453-4d74-a6b1-6966b835572d", "address": "fa:16:3e:9f:3a:e8", "network": {"id": "f5285ef5-fa74-4079-a8cd-f970d97c97c3", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-62550527-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54dca06fda8b43d5bc92fa7c97a872a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap472488d2-94", "ovs_interfaceid": "472488d2-9453-4d74-a6b1-6966b835572d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 09:44:03 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-5d922a01-a874-465d-8f1e-51377ec600a2 tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9f:3a:e8,bridge_name='br-int',has_traffic_filtering=True,id=472488d2-9453-4d74-a6b1-6966b835572d,network=Network(f5285ef5-fa74-4079-a8cd-f970d97c97c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap472488d2-94') {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 09:44:03 user nova-compute[75229]: DEBUG os_vif [None req-5d922a01-a874-465d-8f1e-51377ec600a2 tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9f:3a:e8,bridge_name='br-int',has_traffic_filtering=True,id=472488d2-9453-4d74-a6b1-6966b835572d,network=Network(f5285ef5-fa74-4079-a8cd-f970d97c97c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap472488d2-94') {{(pid=75229) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 09:44:03 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:44:03 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:44:03 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 09:44:03 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:44:03 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a400c480-7164-54e9-b19b-179731950041', '_type': 'linux-noop'}}, row=False) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:44:03 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:44:03 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 09:44:03 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:44:03 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-296d9af7-abae-42fe-8ef6-92010ee7dd1b tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] No BDM found with device name vda, not building metadata. {{(pid=75229) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 09:44:03 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-296d9af7-abae-42fe-8ef6-92010ee7dd1b tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] No VIF found with MAC fa:16:3e:6c:f4:6d, not building metadata {{(pid=75229) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 09:44:03 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:44:03 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap472488d2-94, may_exist=True, interface_attrs={}) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:44:03 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap472488d2-94, col_values=(('qos', UUID('2920fe2f-809b-4517-829d-cdfa7a0d014e')),), if_exists=True) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:44:03 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap472488d2-94, col_values=(('external_ids', {'iface-id': '472488d2-9453-4d74-a6b1-6966b835572d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9f:3a:e8', 'vm-uuid': 'e09b3809-2e23-401c-9a72-88feb2bb657c'}),), if_exists=True) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:44:03 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:44:03 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 09:44:03 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:44:03 user nova-compute[75229]: INFO os_vif [None req-5d922a01-a874-465d-8f1e-51377ec600a2 tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9f:3a:e8,bridge_name='br-int',has_traffic_filtering=True,id=472488d2-9453-4d74-a6b1-6966b835572d,network=Network(f5285ef5-fa74-4079-a8cd-f970d97c97c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap472488d2-94')
Nov 14 09:44:03 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-5d922a01-a874-465d-8f1e-51377ec600a2 tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] No BDM found with device name vda, not building metadata. {{(pid=75229) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 09:44:03 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-5d922a01-a874-465d-8f1e-51377ec600a2 tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] No VIF found with MAC fa:16:3e:9f:3a:e8, not building metadata {{(pid=75229) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 09:44:03 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:44:03 user nova-compute[75229]: DEBUG nova.network.neutron [req-bc4a6af8-e568-4ae8-a3d3-60fb55409bd9 req-6fcc582d-77f2-4bd8-b564-ff94078da853 service nova] [instance: a60d339f-e134-477c-8505-bf8c79d2a21c] Updated VIF entry in instance network info cache for port cb98fc47-7b69-4bde-9a4c-717cd44ba908. {{(pid=75229) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 09:44:03 user nova-compute[75229]: DEBUG nova.network.neutron [req-bc4a6af8-e568-4ae8-a3d3-60fb55409bd9 req-6fcc582d-77f2-4bd8-b564-ff94078da853 service nova] [instance: a60d339f-e134-477c-8505-bf8c79d2a21c] Updating instance_info_cache with network_info: [{"id": "cb98fc47-7b69-4bde-9a4c-717cd44ba908", "address": "fa:16:3e:6c:f4:6d", "network": {"id": "2b667d50-4579-4453-b4d3-a818a0d2c6fc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1719812180-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32e17c7c586542139cdbc5bfda57e075", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb98fc47-7b", "ovs_interfaceid": "cb98fc47-7b69-4bde-9a4c-717cd44ba908", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 09:44:03 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-bc4a6af8-e568-4ae8-a3d3-60fb55409bd9 req-6fcc582d-77f2-4bd8-b564-ff94078da853 service nova] Releasing lock "refresh_cache-a60d339f-e134-477c-8505-bf8c79d2a21c" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 09:44:04 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:44:04 user nova-compute[75229]: DEBUG nova.network.neutron [req-d7e89dcd-51de-4886-a759-7ddf2abff143 req-e61dfb5f-7294-430b-b36c-59ca4efcf11d service nova] [instance: e09b3809-2e23-401c-9a72-88feb2bb657c] Updated VIF entry in instance network info cache for port 472488d2-9453-4d74-a6b1-6966b835572d. {{(pid=75229) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 09:44:04 user nova-compute[75229]: DEBUG nova.network.neutron [req-d7e89dcd-51de-4886-a759-7ddf2abff143 req-e61dfb5f-7294-430b-b36c-59ca4efcf11d service nova] [instance: e09b3809-2e23-401c-9a72-88feb2bb657c] Updating instance_info_cache with network_info: [{"id": "472488d2-9453-4d74-a6b1-6966b835572d", "address": "fa:16:3e:9f:3a:e8", "network": {"id": "f5285ef5-fa74-4079-a8cd-f970d97c97c3", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-62550527-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54dca06fda8b43d5bc92fa7c97a872a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap472488d2-94", "ovs_interfaceid": "472488d2-9453-4d74-a6b1-6966b835572d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 09:44:04 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:44:04 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-d7e89dcd-51de-4886-a759-7ddf2abff143 req-e61dfb5f-7294-430b-b36c-59ca4efcf11d service nova] Releasing lock "refresh_cache-e09b3809-2e23-401c-9a72-88feb2bb657c" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 09:44:04 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:44:05 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:44:05 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:44:05 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:44:05 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:44:05 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:44:06 user nova-compute[75229]: DEBUG nova.compute.manager [req-a7ec0f6d-9918-4480-9d86-2b5d7f6bfa9b req-fd64128e-21e7-4c06-86e4-e1b74a5b9e10 service nova] [instance: 90bd76df-96cb-4bec-9862-853d94cdbaab] Received event network-vif-plugged-3b9b5b2a-5b1b-4ec6-900d-c27e7c4a625e {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:44:06 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-a7ec0f6d-9918-4480-9d86-2b5d7f6bfa9b req-fd64128e-21e7-4c06-86e4-e1b74a5b9e10 service nova] Acquiring lock "90bd76df-96cb-4bec-9862-853d94cdbaab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:44:06 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-a7ec0f6d-9918-4480-9d86-2b5d7f6bfa9b req-fd64128e-21e7-4c06-86e4-e1b74a5b9e10 service nova] Lock "90bd76df-96cb-4bec-9862-853d94cdbaab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:44:06 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-a7ec0f6d-9918-4480-9d86-2b5d7f6bfa9b req-fd64128e-21e7-4c06-86e4-e1b74a5b9e10 service nova] Lock "90bd76df-96cb-4bec-9862-853d94cdbaab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:44:06 user nova-compute[75229]: DEBUG nova.compute.manager [req-a7ec0f6d-9918-4480-9d86-2b5d7f6bfa9b req-fd64128e-21e7-4c06-86e4-e1b74a5b9e10 service nova] [instance: 90bd76df-96cb-4bec-9862-853d94cdbaab] No waiting events found dispatching network-vif-plugged-3b9b5b2a-5b1b-4ec6-900d-c27e7c4a625e {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 09:44:06 user nova-compute[75229]: WARNING nova.compute.manager [req-a7ec0f6d-9918-4480-9d86-2b5d7f6bfa9b req-fd64128e-21e7-4c06-86e4-e1b74a5b9e10 service nova] [instance: 90bd76df-96cb-4bec-9862-853d94cdbaab] Received unexpected event network-vif-plugged-3b9b5b2a-5b1b-4ec6-900d-c27e7c4a625e for instance with vm_state building and task_state spawning.
Nov 14 09:44:06 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:44:06 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:44:06 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:44:06 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:44:07 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-ac0addae-3b0c-47c5-90bf-df549315b34e tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] Acquiring lock "eb53ba25-d865-41ae-90f3-6e154e2778ba" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:44:07 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-ac0addae-3b0c-47c5-90bf-df549315b34e tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] Lock "eb53ba25-d865-41ae-90f3-6e154e2778ba" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:44:07 user nova-compute[75229]: DEBUG nova.compute.manager [None req-ac0addae-3b0c-47c5-90bf-df549315b34e tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] [instance: eb53ba25-d865-41ae-90f3-6e154e2778ba] Starting instance... {{(pid=75229) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 09:44:07 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-ac0addae-3b0c-47c5-90bf-df549315b34e tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:44:07 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-ac0addae-3b0c-47c5-90bf-df549315b34e tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:44:07 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:44:07 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:44:07 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:44:07 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:44:08 user nova-compute[75229]: DEBUG nova.compute.manager [req-f4dada72-b8e9-4235-845d-76a31582c5ab req-1439a11f-ac81-482e-b8c8-e2bc1e0061e5 service nova] [instance: 90bd76df-96cb-4bec-9862-853d94cdbaab] Received event network-vif-plugged-3b9b5b2a-5b1b-4ec6-900d-c27e7c4a625e {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:44:08 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-f4dada72-b8e9-4235-845d-76a31582c5ab req-1439a11f-ac81-482e-b8c8-e2bc1e0061e5 service nova] Acquiring lock "90bd76df-96cb-4bec-9862-853d94cdbaab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:44:08 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-f4dada72-b8e9-4235-845d-76a31582c5ab req-1439a11f-ac81-482e-b8c8-e2bc1e0061e5 service nova] Lock "90bd76df-96cb-4bec-9862-853d94cdbaab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:44:08 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-f4dada72-b8e9-4235-845d-76a31582c5ab req-1439a11f-ac81-482e-b8c8-e2bc1e0061e5 service nova] Lock "90bd76df-96cb-4bec-9862-853d94cdbaab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:44:08 user nova-compute[75229]: DEBUG nova.compute.manager [req-f4dada72-b8e9-4235-845d-76a31582c5ab req-1439a11f-ac81-482e-b8c8-e2bc1e0061e5 service nova] [instance: 90bd76df-96cb-4bec-9862-853d94cdbaab] No waiting events found dispatching network-vif-plugged-3b9b5b2a-5b1b-4ec6-900d-c27e7c4a625e {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 09:44:08 user nova-compute[75229]: WARNING nova.compute.manager [req-f4dada72-b8e9-4235-845d-76a31582c5ab req-1439a11f-ac81-482e-b8c8-e2bc1e0061e5 service nova] [instance: 90bd76df-96cb-4bec-9862-853d94cdbaab] Received unexpected event network-vif-plugged-3b9b5b2a-5b1b-4ec6-900d-c27e7c4a625e for instance with vm_state building and task_state spawning.
Nov 14 09:44:08 user nova-compute[75229]: DEBUG nova.compute.manager [req-f4dada72-b8e9-4235-845d-76a31582c5ab req-1439a11f-ac81-482e-b8c8-e2bc1e0061e5 service nova] [instance: a7750cbc-b3d0-44aa-8b88-c291ba007a8a] Received event network-vif-plugged-e5b20e94-618c-4c51-b20f-1d3f1fb921b6 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:44:08 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-f4dada72-b8e9-4235-845d-76a31582c5ab req-1439a11f-ac81-482e-b8c8-e2bc1e0061e5 service nova] Acquiring lock "a7750cbc-b3d0-44aa-8b88-c291ba007a8a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:44:08 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-f4dada72-b8e9-4235-845d-76a31582c5ab req-1439a11f-ac81-482e-b8c8-e2bc1e0061e5 service nova] Lock "a7750cbc-b3d0-44aa-8b88-c291ba007a8a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:44:08 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-f4dada72-b8e9-4235-845d-76a31582c5ab req-1439a11f-ac81-482e-b8c8-e2bc1e0061e5 service nova] Lock "a7750cbc-b3d0-44aa-8b88-c291ba007a8a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:44:08 user nova-compute[75229]: DEBUG nova.compute.manager [req-f4dada72-b8e9-4235-845d-76a31582c5ab req-1439a11f-ac81-482e-b8c8-e2bc1e0061e5 service nova] [instance: a7750cbc-b3d0-44aa-8b88-c291ba007a8a] No waiting events found dispatching network-vif-plugged-e5b20e94-618c-4c51-b20f-1d3f1fb921b6 {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 09:44:08 user nova-compute[75229]: WARNING nova.compute.manager [req-f4dada72-b8e9-4235-845d-76a31582c5ab req-1439a11f-ac81-482e-b8c8-e2bc1e0061e5 service nova] [instance: a7750cbc-b3d0-44aa-8b88-c291ba007a8a] Received unexpected event network-vif-plugged-e5b20e94-618c-4c51-b20f-1d3f1fb921b6 for instance with vm_state building and task_state spawning.
Nov 14 09:44:08 user nova-compute[75229]: DEBUG nova.compute.manager [req-f4dada72-b8e9-4235-845d-76a31582c5ab req-1439a11f-ac81-482e-b8c8-e2bc1e0061e5 service nova] [instance: a7750cbc-b3d0-44aa-8b88-c291ba007a8a] Received event network-vif-plugged-e5b20e94-618c-4c51-b20f-1d3f1fb921b6 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:44:08 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-f4dada72-b8e9-4235-845d-76a31582c5ab req-1439a11f-ac81-482e-b8c8-e2bc1e0061e5 service nova] Acquiring lock "a7750cbc-b3d0-44aa-8b88-c291ba007a8a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:44:08 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-f4dada72-b8e9-4235-845d-76a31582c5ab req-1439a11f-ac81-482e-b8c8-e2bc1e0061e5 service nova] Lock "a7750cbc-b3d0-44aa-8b88-c291ba007a8a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:44:08 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-f4dada72-b8e9-4235-845d-76a31582c5ab req-1439a11f-ac81-482e-b8c8-e2bc1e0061e5 service nova] Lock "a7750cbc-b3d0-44aa-8b88-c291ba007a8a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:44:08 user nova-compute[75229]: DEBUG nova.compute.manager [req-f4dada72-b8e9-4235-845d-76a31582c5ab req-1439a11f-ac81-482e-b8c8-e2bc1e0061e5 service nova] [instance: a7750cbc-b3d0-44aa-8b88-c291ba007a8a] No waiting events found dispatching network-vif-plugged-e5b20e94-618c-4c51-b20f-1d3f1fb921b6 {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 09:44:08 user nova-compute[75229]: WARNING nova.compute.manager [req-f4dada72-b8e9-4235-845d-76a31582c5ab req-1439a11f-ac81-482e-b8c8-e2bc1e0061e5 service nova] [instance: a7750cbc-b3d0-44aa-8b88-c291ba007a8a] Received unexpected event network-vif-plugged-e5b20e94-618c-4c51-b20f-1d3f1fb921b6 for instance with vm_state building and task_state spawning.
Nov 14 09:44:08 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:44:08 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:44:08 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:44:08 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:44:08 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:44:08 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:44:08 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:44:08 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:44:08 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:44:09 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:44:10 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:44:10 user nova-compute[75229]: DEBUG nova.compute.manager [req-49ef6e75-867f-470f-804e-15a0f3713f55 req-46da4f3d-953a-4e75-b1bd-94362795f0db service nova] [instance: e09b3809-2e23-401c-9a72-88feb2bb657c] Received event network-vif-plugged-472488d2-9453-4d74-a6b1-6966b835572d {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:44:10 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-49ef6e75-867f-470f-804e-15a0f3713f55 req-46da4f3d-953a-4e75-b1bd-94362795f0db service nova] Acquiring lock "e09b3809-2e23-401c-9a72-88feb2bb657c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:44:10 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-49ef6e75-867f-470f-804e-15a0f3713f55 req-46da4f3d-953a-4e75-b1bd-94362795f0db service nova] Lock "e09b3809-2e23-401c-9a72-88feb2bb657c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:44:10 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-49ef6e75-867f-470f-804e-15a0f3713f55 req-46da4f3d-953a-4e75-b1bd-94362795f0db service nova] Lock "e09b3809-2e23-401c-9a72-88feb2bb657c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:44:10 user nova-compute[75229]: DEBUG nova.compute.manager [req-49ef6e75-867f-470f-804e-15a0f3713f55 req-46da4f3d-953a-4e75-b1bd-94362795f0db service nova] [instance: e09b3809-2e23-401c-9a72-88feb2bb657c] No waiting events found dispatching network-vif-plugged-472488d2-9453-4d74-a6b1-6966b835572d {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 09:44:10 user nova-compute[75229]: WARNING nova.compute.manager [req-49ef6e75-867f-470f-804e-15a0f3713f55 req-46da4f3d-953a-4e75-b1bd-94362795f0db service nova] [instance: e09b3809-2e23-401c-9a72-88feb2bb657c] Received unexpected event network-vif-plugged-472488d2-9453-4d74-a6b1-6966b835572d for instance with vm_state building and task_state spawning.
Nov 14 09:44:10 user nova-compute[75229]: DEBUG nova.compute.manager [req-49ef6e75-867f-470f-804e-15a0f3713f55 req-46da4f3d-953a-4e75-b1bd-94362795f0db service nova] [instance: e09b3809-2e23-401c-9a72-88feb2bb657c] Received event network-vif-plugged-472488d2-9453-4d74-a6b1-6966b835572d {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:44:10 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-49ef6e75-867f-470f-804e-15a0f3713f55 req-46da4f3d-953a-4e75-b1bd-94362795f0db service nova] Acquiring lock "e09b3809-2e23-401c-9a72-88feb2bb657c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:44:10 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-49ef6e75-867f-470f-804e-15a0f3713f55 req-46da4f3d-953a-4e75-b1bd-94362795f0db service nova] Lock "e09b3809-2e23-401c-9a72-88feb2bb657c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:44:10 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-49ef6e75-867f-470f-804e-15a0f3713f55 req-46da4f3d-953a-4e75-b1bd-94362795f0db service nova] Lock "e09b3809-2e23-401c-9a72-88feb2bb657c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:44:10 user nova-compute[75229]: DEBUG nova.compute.manager [req-49ef6e75-867f-470f-804e-15a0f3713f55 req-46da4f3d-953a-4e75-b1bd-94362795f0db service nova] [instance: e09b3809-2e23-401c-9a72-88feb2bb657c] No waiting events found dispatching network-vif-plugged-472488d2-9453-4d74-a6b1-6966b835572d {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 09:44:10 user nova-compute[75229]: WARNING nova.compute.manager [req-49ef6e75-867f-470f-804e-15a0f3713f55 req-46da4f3d-953a-4e75-b1bd-94362795f0db service nova] [instance: e09b3809-2e23-401c-9a72-88feb2bb657c] Received unexpected event network-vif-plugged-472488d2-9453-4d74-a6b1-6966b835572d for instance with vm_state building and task_state spawning.
Nov 14 09:44:10 user nova-compute[75229]: DEBUG nova.compute.manager [None req-3b6c1bc3-20bd-4c38-907a-c3586f51b9bc tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] [instance: 90bd76df-96cb-4bec-9862-853d94cdbaab] Instance event wait completed in 0 seconds for  {{(pid=75229) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 09:44:10 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-3b6c1bc3-20bd-4c38-907a-c3586f51b9bc tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] [instance: 90bd76df-96cb-4bec-9862-853d94cdbaab] Guest created on hypervisor {{(pid=75229) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 09:44:10 user nova-compute[75229]: DEBUG nova.compute.manager [None req-0263f621-3230-4ce3-bd4e-7446204bb0ce tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] [instance: a7750cbc-b3d0-44aa-8b88-c291ba007a8a] Instance event wait completed in 0 seconds for  {{(pid=75229) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 09:44:10 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-0263f621-3230-4ce3-bd4e-7446204bb0ce tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] [instance: a7750cbc-b3d0-44aa-8b88-c291ba007a8a] Guest created on hypervisor {{(pid=75229) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 09:44:10 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-ac0addae-3b0c-47c5-90bf-df549315b34e tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75229) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 09:44:10 user nova-compute[75229]: INFO nova.compute.claims [None req-ac0addae-3b0c-47c5-90bf-df549315b34e tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] [instance: eb53ba25-d865-41ae-90f3-6e154e2778ba] Claim successful on node user
Nov 14 09:44:10 user nova-compute[75229]: DEBUG nova.compute.manager [None req-296d9af7-abae-42fe-8ef6-92010ee7dd1b tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] [instance: a60d339f-e134-477c-8505-bf8c79d2a21c] Instance event wait completed in 0 seconds for  {{(pid=75229) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 09:44:10 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-296d9af7-abae-42fe-8ef6-92010ee7dd1b tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] [instance: a60d339f-e134-477c-8505-bf8c79d2a21c] Guest created on hypervisor {{(pid=75229) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 09:44:10 user nova-compute[75229]: INFO nova.virt.libvirt.driver [-] [instance: 90bd76df-96cb-4bec-9862-853d94cdbaab] Instance spawned successfully.
Nov 14 09:44:10 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-3b6c1bc3-20bd-4c38-907a-c3586f51b9bc tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] [instance: 90bd76df-96cb-4bec-9862-853d94cdbaab] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 09:44:10 user nova-compute[75229]: INFO nova.virt.libvirt.driver [-] [instance: a7750cbc-b3d0-44aa-8b88-c291ba007a8a] Instance spawned successfully.
Nov 14 09:44:10 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-0263f621-3230-4ce3-bd4e-7446204bb0ce tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] [instance: a7750cbc-b3d0-44aa-8b88-c291ba007a8a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 09:44:10 user nova-compute[75229]: INFO nova.virt.libvirt.driver [-] [instance: a60d339f-e134-477c-8505-bf8c79d2a21c] Instance spawned successfully.
Nov 14 09:44:10 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-296d9af7-abae-42fe-8ef6-92010ee7dd1b tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] [instance: a60d339f-e134-477c-8505-bf8c79d2a21c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 09:44:10 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-3b6c1bc3-20bd-4c38-907a-c3586f51b9bc tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] [instance: 90bd76df-96cb-4bec-9862-853d94cdbaab] Found default for hw_cdrom_bus of ide {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 09:44:10 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-3b6c1bc3-20bd-4c38-907a-c3586f51b9bc tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] [instance: 90bd76df-96cb-4bec-9862-853d94cdbaab] Found default for hw_disk_bus of virtio {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 09:44:10 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-3b6c1bc3-20bd-4c38-907a-c3586f51b9bc tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] [instance: 90bd76df-96cb-4bec-9862-853d94cdbaab] Found default for hw_input_bus of None {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 09:44:10 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-3b6c1bc3-20bd-4c38-907a-c3586f51b9bc tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] [instance: 90bd76df-96cb-4bec-9862-853d94cdbaab] Found default for hw_pointer_model of None {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 09:44:10 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-3b6c1bc3-20bd-4c38-907a-c3586f51b9bc tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] [instance: 90bd76df-96cb-4bec-9862-853d94cdbaab] Found default for hw_video_model of virtio {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 09:44:10 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-3b6c1bc3-20bd-4c38-907a-c3586f51b9bc tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] [instance: 90bd76df-96cb-4bec-9862-853d94cdbaab] Found default for hw_vif_model of virtio {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 09:44:10 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-0263f621-3230-4ce3-bd4e-7446204bb0ce tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] [instance: a7750cbc-b3d0-44aa-8b88-c291ba007a8a] Found default for hw_cdrom_bus of ide {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 09:44:10 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-0263f621-3230-4ce3-bd4e-7446204bb0ce tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] [instance: a7750cbc-b3d0-44aa-8b88-c291ba007a8a] Found default for hw_disk_bus of virtio {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 09:44:10 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-0263f621-3230-4ce3-bd4e-7446204bb0ce tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] [instance: a7750cbc-b3d0-44aa-8b88-c291ba007a8a] Found default for hw_input_bus of None {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 09:44:10 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-0263f621-3230-4ce3-bd4e-7446204bb0ce tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] [instance: a7750cbc-b3d0-44aa-8b88-c291ba007a8a] Found default for hw_pointer_model of None {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 09:44:10 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-0263f621-3230-4ce3-bd4e-7446204bb0ce tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] [instance: a7750cbc-b3d0-44aa-8b88-c291ba007a8a] Found default for hw_video_model of virtio {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 09:44:10 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-0263f621-3230-4ce3-bd4e-7446204bb0ce tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] [instance: a7750cbc-b3d0-44aa-8b88-c291ba007a8a] Found default for hw_vif_model of virtio {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 09:44:10 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-296d9af7-abae-42fe-8ef6-92010ee7dd1b tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] [instance: a60d339f-e134-477c-8505-bf8c79d2a21c] Found default for hw_cdrom_bus of ide {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 09:44:10 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-296d9af7-abae-42fe-8ef6-92010ee7dd1b tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] [instance: a60d339f-e134-477c-8505-bf8c79d2a21c] Found default for hw_disk_bus of virtio {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 09:44:10 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-296d9af7-abae-42fe-8ef6-92010ee7dd1b tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] [instance: a60d339f-e134-477c-8505-bf8c79d2a21c] Found default for hw_input_bus of None {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 09:44:10 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-296d9af7-abae-42fe-8ef6-92010ee7dd1b tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] [instance: a60d339f-e134-477c-8505-bf8c79d2a21c] Found default for hw_pointer_model of None {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 09:44:10 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-296d9af7-abae-42fe-8ef6-92010ee7dd1b tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] [instance: a60d339f-e134-477c-8505-bf8c79d2a21c] Found default for hw_video_model of virtio {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 09:44:10 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-296d9af7-abae-42fe-8ef6-92010ee7dd1b tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] [instance: a60d339f-e134-477c-8505-bf8c79d2a21c] Found default for hw_vif_model of virtio {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 09:44:11 user nova-compute[75229]: INFO nova.compute.manager [None req-0263f621-3230-4ce3-bd4e-7446204bb0ce tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] [instance: a7750cbc-b3d0-44aa-8b88-c291ba007a8a] Took 15.87 seconds to spawn the instance on the hypervisor.
Nov 14 09:44:11 user nova-compute[75229]: DEBUG nova.compute.manager [None req-0263f621-3230-4ce3-bd4e-7446204bb0ce tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] [instance: a7750cbc-b3d0-44aa-8b88-c291ba007a8a] Checking state {{(pid=75229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 09:44:11 user nova-compute[75229]: INFO nova.compute.manager [None req-3b6c1bc3-20bd-4c38-907a-c3586f51b9bc tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] [instance: 90bd76df-96cb-4bec-9862-853d94cdbaab] Took 18.20 seconds to spawn the instance on the hypervisor.
Nov 14 09:44:11 user nova-compute[75229]: DEBUG nova.compute.manager [None req-3b6c1bc3-20bd-4c38-907a-c3586f51b9bc tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] [instance: 90bd76df-96cb-4bec-9862-853d94cdbaab] Checking state {{(pid=75229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 09:44:11 user nova-compute[75229]: DEBUG nova.compute.manager [None req-6fb168db-88e3-470e-a460-f02dcd74cc8e tempest-DeleteServersTestJSON-1002799117 tempest-DeleteServersTestJSON-1002799117-project-member] [instance: 359ff85c-c332-4059-8db4-689a0483d068] Instance event wait completed in 0 seconds for  {{(pid=75229) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 09:44:11 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-6fb168db-88e3-470e-a460-f02dcd74cc8e tempest-DeleteServersTestJSON-1002799117 tempest-DeleteServersTestJSON-1002799117-project-member] [instance: 359ff85c-c332-4059-8db4-689a0483d068] Guest created on hypervisor {{(pid=75229) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 09:44:11 user nova-compute[75229]: DEBUG nova.compute.manager [None req-5d922a01-a874-465d-8f1e-51377ec600a2 tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] [instance: e09b3809-2e23-401c-9a72-88feb2bb657c] Instance event wait completed in 0 seconds for  {{(pid=75229) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 09:44:11 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-5d922a01-a874-465d-8f1e-51377ec600a2 tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] [instance: e09b3809-2e23-401c-9a72-88feb2bb657c] Guest created on hypervisor {{(pid=75229) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 09:44:11 user nova-compute[75229]: INFO nova.virt.libvirt.driver [-] [instance: 359ff85c-c332-4059-8db4-689a0483d068] Instance spawned successfully.
Nov 14 09:44:11 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-6fb168db-88e3-470e-a460-f02dcd74cc8e tempest-DeleteServersTestJSON-1002799117 tempest-DeleteServersTestJSON-1002799117-project-member] [instance: 359ff85c-c332-4059-8db4-689a0483d068] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 09:44:11 user nova-compute[75229]: INFO nova.virt.libvirt.driver [-] [instance: e09b3809-2e23-401c-9a72-88feb2bb657c] Instance spawned successfully.
Nov 14 09:44:11 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-5d922a01-a874-465d-8f1e-51377ec600a2 tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] [instance: e09b3809-2e23-401c-9a72-88feb2bb657c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 09:44:11 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-6fb168db-88e3-470e-a460-f02dcd74cc8e tempest-DeleteServersTestJSON-1002799117 tempest-DeleteServersTestJSON-1002799117-project-member] [instance: 359ff85c-c332-4059-8db4-689a0483d068] Found default for hw_cdrom_bus of ide {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 09:44:11 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-6fb168db-88e3-470e-a460-f02dcd74cc8e tempest-DeleteServersTestJSON-1002799117 tempest-DeleteServersTestJSON-1002799117-project-member] [instance: 359ff85c-c332-4059-8db4-689a0483d068] Found default for hw_disk_bus of virtio {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 09:44:11 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-6fb168db-88e3-470e-a460-f02dcd74cc8e tempest-DeleteServersTestJSON-1002799117 tempest-DeleteServersTestJSON-1002799117-project-member] [instance: 359ff85c-c332-4059-8db4-689a0483d068] Found default for hw_input_bus of None {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 09:44:11 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-6fb168db-88e3-470e-a460-f02dcd74cc8e tempest-DeleteServersTestJSON-1002799117 tempest-DeleteServersTestJSON-1002799117-project-member] [instance: 359ff85c-c332-4059-8db4-689a0483d068] Found default for hw_pointer_model of None {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 09:44:11 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-6fb168db-88e3-470e-a460-f02dcd74cc8e tempest-DeleteServersTestJSON-1002799117 tempest-DeleteServersTestJSON-1002799117-project-member] [instance: 359ff85c-c332-4059-8db4-689a0483d068] Found default for hw_video_model of virtio {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 09:44:11 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-6fb168db-88e3-470e-a460-f02dcd74cc8e tempest-DeleteServersTestJSON-1002799117 tempest-DeleteServersTestJSON-1002799117-project-member] [instance: 359ff85c-c332-4059-8db4-689a0483d068] Found default for hw_vif_model of virtio {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 09:44:11 user nova-compute[75229]: INFO nova.compute.manager [None req-0263f621-3230-4ce3-bd4e-7446204bb0ce tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] [instance: a7750cbc-b3d0-44aa-8b88-c291ba007a8a] Took 17.02 seconds to build instance.
Nov 14 09:44:11 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-5d922a01-a874-465d-8f1e-51377ec600a2 tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] [instance: e09b3809-2e23-401c-9a72-88feb2bb657c] Found default for hw_cdrom_bus of ide {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 09:44:11 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-5d922a01-a874-465d-8f1e-51377ec600a2 tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] [instance: e09b3809-2e23-401c-9a72-88feb2bb657c] Found default for hw_disk_bus of virtio {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 09:44:11 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-5d922a01-a874-465d-8f1e-51377ec600a2 tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] [instance: e09b3809-2e23-401c-9a72-88feb2bb657c] Found default for hw_input_bus of None {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 09:44:11 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-5d922a01-a874-465d-8f1e-51377ec600a2 tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] [instance: e09b3809-2e23-401c-9a72-88feb2bb657c] Found default for hw_pointer_model of None {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 09:44:11 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-5d922a01-a874-465d-8f1e-51377ec600a2 tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] [instance: e09b3809-2e23-401c-9a72-88feb2bb657c] Found default for hw_video_model of virtio {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 09:44:11 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-5d922a01-a874-465d-8f1e-51377ec600a2 tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] [instance: e09b3809-2e23-401c-9a72-88feb2bb657c] Found default for hw_vif_model of virtio {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 09:44:11 user nova-compute[75229]: INFO nova.compute.manager [None req-296d9af7-abae-42fe-8ef6-92010ee7dd1b tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] [instance: a60d339f-e134-477c-8505-bf8c79d2a21c] Took 12.93 seconds to spawn the instance on the hypervisor.
Nov 14 09:44:11 user nova-compute[75229]: DEBUG nova.compute.manager [None req-296d9af7-abae-42fe-8ef6-92010ee7dd1b tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] [instance: a60d339f-e134-477c-8505-bf8c79d2a21c] Checking state {{(pid=75229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 09:44:11 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-0263f621-3230-4ce3-bd4e-7446204bb0ce tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Lock "a7750cbc-b3d0-44aa-8b88-c291ba007a8a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.250s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:44:11 user nova-compute[75229]: INFO nova.compute.manager [None req-3b6c1bc3-20bd-4c38-907a-c3586f51b9bc tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] [instance: 90bd76df-96cb-4bec-9862-853d94cdbaab] Took 20.51 seconds to build instance.
Nov 14 09:44:11 user nova-compute[75229]: INFO nova.compute.manager [None req-5d922a01-a874-465d-8f1e-51377ec600a2 tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] [instance: e09b3809-2e23-401c-9a72-88feb2bb657c] Took 15.51 seconds to spawn the instance on the hypervisor.
Nov 14 09:44:11 user nova-compute[75229]: DEBUG nova.compute.manager [None req-5d922a01-a874-465d-8f1e-51377ec600a2 tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] [instance: e09b3809-2e23-401c-9a72-88feb2bb657c] Checking state {{(pid=75229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 09:44:11 user nova-compute[75229]: INFO nova.compute.manager [None req-6fb168db-88e3-470e-a460-f02dcd74cc8e tempest-DeleteServersTestJSON-1002799117 tempest-DeleteServersTestJSON-1002799117-project-member] [instance: 359ff85c-c332-4059-8db4-689a0483d068] Took 19.95 seconds to spawn the instance on the hypervisor.
Nov 14 09:44:11 user nova-compute[75229]: DEBUG nova.compute.manager [None req-6fb168db-88e3-470e-a460-f02dcd74cc8e tempest-DeleteServersTestJSON-1002799117 tempest-DeleteServersTestJSON-1002799117-project-member] [instance: 359ff85c-c332-4059-8db4-689a0483d068] Checking state {{(pid=75229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 09:44:11 user nova-compute[75229]: DEBUG nova.compute.provider_tree [None req-ac0addae-3b0c-47c5-90bf-df549315b34e tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] Inventory has not changed in ProviderTree for provider: d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 {{(pid=75229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 09:44:11 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-3b6c1bc3-20bd-4c38-907a-c3586f51b9bc tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Lock "90bd76df-96cb-4bec-9862-853d94cdbaab" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 21.015s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:44:11 user nova-compute[75229]: INFO nova.compute.manager [None req-296d9af7-abae-42fe-8ef6-92010ee7dd1b tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] [instance: a60d339f-e134-477c-8505-bf8c79d2a21c] Took 14.20 seconds to build instance.
Nov 14 09:44:11 user nova-compute[75229]: DEBUG nova.scheduler.client.report [None req-ac0addae-3b0c-47c5-90bf-df549315b34e tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] Inventory has not changed for provider d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 09:44:11 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-296d9af7-abae-42fe-8ef6-92010ee7dd1b tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] Lock "a60d339f-e134-477c-8505-bf8c79d2a21c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.327s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:44:11 user nova-compute[75229]: INFO nova.compute.manager [None req-5d922a01-a874-465d-8f1e-51377ec600a2 tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] [instance: e09b3809-2e23-401c-9a72-88feb2bb657c] Took 16.84 seconds to build instance.
Nov 14 09:44:11 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-ac0addae-3b0c-47c5-90bf-df549315b34e tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 4.709s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:44:11 user nova-compute[75229]: DEBUG nova.compute.manager [None req-ac0addae-3b0c-47c5-90bf-df549315b34e tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] [instance: eb53ba25-d865-41ae-90f3-6e154e2778ba] Start building networks asynchronously for instance. {{(pid=75229) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 09:44:11 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-5d922a01-a874-465d-8f1e-51377ec600a2 tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] Lock "e09b3809-2e23-401c-9a72-88feb2bb657c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.020s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:44:12 user nova-compute[75229]: INFO nova.compute.manager [None req-6fb168db-88e3-470e-a460-f02dcd74cc8e tempest-DeleteServersTestJSON-1002799117 tempest-DeleteServersTestJSON-1002799117-project-member] [instance: 359ff85c-c332-4059-8db4-689a0483d068] Took 20.88 seconds to build instance.
Nov 14 09:44:12 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:44:12 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:44:12 user nova-compute[75229]: DEBUG nova.compute.manager [None req-ac0addae-3b0c-47c5-90bf-df549315b34e tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] [instance: eb53ba25-d865-41ae-90f3-6e154e2778ba] Allocating IP information in the background. {{(pid=75229) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 09:44:12 user nova-compute[75229]: DEBUG nova.network.neutron [None req-ac0addae-3b0c-47c5-90bf-df549315b34e tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] [instance: eb53ba25-d865-41ae-90f3-6e154e2778ba] allocate_for_instance() {{(pid=75229) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 09:44:12 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-6fb168db-88e3-470e-a460-f02dcd74cc8e tempest-DeleteServersTestJSON-1002799117 tempest-DeleteServersTestJSON-1002799117-project-member] Lock "359ff85c-c332-4059-8db4-689a0483d068" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 21.326s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:44:12 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:44:12 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-ac0addae-3b0c-47c5-90bf-df549315b34e tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] [instance: eb53ba25-d865-41ae-90f3-6e154e2778ba] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 09:44:12 user nova-compute[75229]: DEBUG nova.compute.manager [None req-ac0addae-3b0c-47c5-90bf-df549315b34e tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] [instance: eb53ba25-d865-41ae-90f3-6e154e2778ba] Start building block device mappings for instance. {{(pid=75229) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 09:44:12 user nova-compute[75229]: DEBUG nova.policy [None req-ac0addae-3b0c-47c5-90bf-df549315b34e tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ce091bb40ce04afeb988be064cbe673a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6026f6867f00423283219da921bef367', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75229) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 09:44:12 user nova-compute[75229]: DEBUG nova.compute.manager [None req-ac0addae-3b0c-47c5-90bf-df549315b34e tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] [instance: eb53ba25-d865-41ae-90f3-6e154e2778ba] Start spawning the instance on the hypervisor. {{(pid=75229) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 09:44:12 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-ac0addae-3b0c-47c5-90bf-df549315b34e tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] [instance: eb53ba25-d865-41ae-90f3-6e154e2778ba] Creating instance directory {{(pid=75229) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 09:44:12 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-ac0addae-3b0c-47c5-90bf-df549315b34e tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] [instance: eb53ba25-d865-41ae-90f3-6e154e2778ba] Creating image(s)
Nov 14 09:44:12 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-ac0addae-3b0c-47c5-90bf-df549315b34e tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] Acquiring lock "/opt/stack/data/nova/instances/eb53ba25-d865-41ae-90f3-6e154e2778ba/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:44:12 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-ac0addae-3b0c-47c5-90bf-df549315b34e tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] Lock "/opt/stack/data/nova/instances/eb53ba25-d865-41ae-90f3-6e154e2778ba/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:44:12 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-ac0addae-3b0c-47c5-90bf-df549315b34e tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] Lock "/opt/stack/data/nova/instances/eb53ba25-d865-41ae-90f3-6e154e2778ba/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.009s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:44:12 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-ac0addae-3b0c-47c5-90bf-df549315b34e tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6 --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:44:12 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:44:12 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-ac0addae-3b0c-47c5-90bf-df549315b34e tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6 --force-share --output=json" returned: 0 in 0.243s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:44:12 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-ac0addae-3b0c-47c5-90bf-df549315b34e tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] Acquiring lock "4f30e3fe703d2381679612a57b1fb80a467f60b6" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:44:12 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-ac0addae-3b0c-47c5-90bf-df549315b34e tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] Lock "4f30e3fe703d2381679612a57b1fb80a467f60b6" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:44:12 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-ac0addae-3b0c-47c5-90bf-df549315b34e tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6 --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:44:13 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-93623460-a8e7-4988-9cd4-ee89abad768c tempest-AttachSCSIVolumeTestJSON-982350058 tempest-AttachSCSIVolumeTestJSON-982350058-project-member] Acquiring lock "37e63bd9-44fc-4d07-b31b-570f69d7bc8a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:44:13 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-93623460-a8e7-4988-9cd4-ee89abad768c tempest-AttachSCSIVolumeTestJSON-982350058 tempest-AttachSCSIVolumeTestJSON-982350058-project-member] Lock "37e63bd9-44fc-4d07-b31b-570f69d7bc8a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:44:13 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-ac0addae-3b0c-47c5-90bf-df549315b34e tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6 --force-share --output=json" returned: 0 in 0.310s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:44:13 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-ac0addae-3b0c-47c5-90bf-df549315b34e tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6,backing_fmt=raw /opt/stack/data/nova/instances/eb53ba25-d865-41ae-90f3-6e154e2778ba/disk 1073741824 {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:44:13 user nova-compute[75229]: DEBUG nova.compute.manager [None req-93623460-a8e7-4988-9cd4-ee89abad768c tempest-AttachSCSIVolumeTestJSON-982350058 tempest-AttachSCSIVolumeTestJSON-982350058-project-member] [instance: 37e63bd9-44fc-4d07-b31b-570f69d7bc8a] Starting instance... {{(pid=75229) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 09:44:13 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-ac0addae-3b0c-47c5-90bf-df549315b34e tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6,backing_fmt=raw /opt/stack/data/nova/instances/eb53ba25-d865-41ae-90f3-6e154e2778ba/disk 1073741824" returned: 0 in 0.086s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:44:13 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-ac0addae-3b0c-47c5-90bf-df549315b34e tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] Lock "4f30e3fe703d2381679612a57b1fb80a467f60b6" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.402s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:44:13 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-ac0addae-3b0c-47c5-90bf-df549315b34e tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6 --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:44:13 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-93623460-a8e7-4988-9cd4-ee89abad768c tempest-AttachSCSIVolumeTestJSON-982350058 tempest-AttachSCSIVolumeTestJSON-982350058-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:44:13 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-93623460-a8e7-4988-9cd4-ee89abad768c tempest-AttachSCSIVolumeTestJSON-982350058 tempest-AttachSCSIVolumeTestJSON-982350058-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:44:13 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-93623460-a8e7-4988-9cd4-ee89abad768c tempest-AttachSCSIVolumeTestJSON-982350058 tempest-AttachSCSIVolumeTestJSON-982350058-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75229) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 09:44:13 user nova-compute[75229]: INFO nova.compute.claims [None req-93623460-a8e7-4988-9cd4-ee89abad768c tempest-AttachSCSIVolumeTestJSON-982350058 tempest-AttachSCSIVolumeTestJSON-982350058-project-member] [instance: 37e63bd9-44fc-4d07-b31b-570f69d7bc8a] Claim successful on node user
Nov 14 09:44:13 user nova-compute[75229]: DEBUG nova.network.neutron [None req-ac0addae-3b0c-47c5-90bf-df549315b34e tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] [instance: eb53ba25-d865-41ae-90f3-6e154e2778ba] Successfully created port: 695e538f-be1d-4450-84a0-2a0bb92dd2ac {{(pid=75229) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 09:44:13 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-ac0addae-3b0c-47c5-90bf-df549315b34e tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6 --force-share --output=json" returned: 0 in 0.380s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:44:13 user nova-compute[75229]: DEBUG nova.virt.disk.api [None req-ac0addae-3b0c-47c5-90bf-df549315b34e tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] Checking if we can resize image /opt/stack/data/nova/instances/eb53ba25-d865-41ae-90f3-6e154e2778ba/disk. size=1073741824 {{(pid=75229) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 09:44:13 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-ac0addae-3b0c-47c5-90bf-df549315b34e tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb53ba25-d865-41ae-90f3-6e154e2778ba/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:44:13 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:44:13 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-ac0addae-3b0c-47c5-90bf-df549315b34e tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb53ba25-d865-41ae-90f3-6e154e2778ba/disk --force-share --output=json" returned: 0 in 0.272s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:44:13 user nova-compute[75229]: DEBUG nova.virt.disk.api [None req-ac0addae-3b0c-47c5-90bf-df549315b34e tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] Cannot resize image /opt/stack/data/nova/instances/eb53ba25-d865-41ae-90f3-6e154e2778ba/disk to a smaller size. {{(pid=75229) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 09:44:13 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-ac0addae-3b0c-47c5-90bf-df549315b34e tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] [instance: eb53ba25-d865-41ae-90f3-6e154e2778ba] Created local disks {{(pid=75229) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 09:44:13 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-ac0addae-3b0c-47c5-90bf-df549315b34e tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] [instance: eb53ba25-d865-41ae-90f3-6e154e2778ba] Ensure instance console log exists: /opt/stack/data/nova/instances/eb53ba25-d865-41ae-90f3-6e154e2778ba/console.log {{(pid=75229) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 09:44:13 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-ac0addae-3b0c-47c5-90bf-df549315b34e tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:44:13 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-ac0addae-3b0c-47c5-90bf-df549315b34e tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:44:13 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-ac0addae-3b0c-47c5-90bf-df549315b34e tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:44:13 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:44:13 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:44:13 user nova-compute[75229]: DEBUG nova.compute.provider_tree [None req-93623460-a8e7-4988-9cd4-ee89abad768c tempest-AttachSCSIVolumeTestJSON-982350058 tempest-AttachSCSIVolumeTestJSON-982350058-project-member] Inventory has not changed in ProviderTree for provider: d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 {{(pid=75229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 09:44:13 user nova-compute[75229]: DEBUG nova.scheduler.client.report [None req-93623460-a8e7-4988-9cd4-ee89abad768c tempest-AttachSCSIVolumeTestJSON-982350058 tempest-AttachSCSIVolumeTestJSON-982350058-project-member] Inventory has not changed for provider d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 09:44:14 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-93623460-a8e7-4988-9cd4-ee89abad768c tempest-AttachSCSIVolumeTestJSON-982350058 tempest-AttachSCSIVolumeTestJSON-982350058-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.723s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:44:14 user nova-compute[75229]: DEBUG nova.compute.manager [None req-93623460-a8e7-4988-9cd4-ee89abad768c tempest-AttachSCSIVolumeTestJSON-982350058 tempest-AttachSCSIVolumeTestJSON-982350058-project-member] [instance: 37e63bd9-44fc-4d07-b31b-570f69d7bc8a] Start building networks asynchronously for instance. {{(pid=75229) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 09:44:14 user nova-compute[75229]: DEBUG nova.compute.manager [None req-93623460-a8e7-4988-9cd4-ee89abad768c tempest-AttachSCSIVolumeTestJSON-982350058 tempest-AttachSCSIVolumeTestJSON-982350058-project-member] [instance: 37e63bd9-44fc-4d07-b31b-570f69d7bc8a] Allocating IP information in the background. {{(pid=75229) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 09:44:14 user nova-compute[75229]: DEBUG nova.network.neutron [None req-93623460-a8e7-4988-9cd4-ee89abad768c tempest-AttachSCSIVolumeTestJSON-982350058 tempest-AttachSCSIVolumeTestJSON-982350058-project-member] [instance: 37e63bd9-44fc-4d07-b31b-570f69d7bc8a] allocate_for_instance() {{(pid=75229) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 09:44:14 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-93623460-a8e7-4988-9cd4-ee89abad768c tempest-AttachSCSIVolumeTestJSON-982350058 tempest-AttachSCSIVolumeTestJSON-982350058-project-member] [instance: 37e63bd9-44fc-4d07-b31b-570f69d7bc8a] Ignoring supplied device name: /dev/sda. Libvirt can't honour user-supplied dev names
Nov 14 09:44:14 user nova-compute[75229]: DEBUG nova.compute.manager [None req-93623460-a8e7-4988-9cd4-ee89abad768c tempest-AttachSCSIVolumeTestJSON-982350058 tempest-AttachSCSIVolumeTestJSON-982350058-project-member] [instance: 37e63bd9-44fc-4d07-b31b-570f69d7bc8a] Start building block device mappings for instance. {{(pid=75229) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 09:44:14 user nova-compute[75229]: DEBUG nova.network.neutron [None req-ac0addae-3b0c-47c5-90bf-df549315b34e tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] [instance: eb53ba25-d865-41ae-90f3-6e154e2778ba] Successfully updated port: 695e538f-be1d-4450-84a0-2a0bb92dd2ac {{(pid=75229) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 09:44:14 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-ac0addae-3b0c-47c5-90bf-df549315b34e tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] Acquiring lock "refresh_cache-eb53ba25-d865-41ae-90f3-6e154e2778ba" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 09:44:14 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-ac0addae-3b0c-47c5-90bf-df549315b34e tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] Acquired lock "refresh_cache-eb53ba25-d865-41ae-90f3-6e154e2778ba" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 09:44:14 user nova-compute[75229]: DEBUG nova.network.neutron [None req-ac0addae-3b0c-47c5-90bf-df549315b34e tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] [instance: eb53ba25-d865-41ae-90f3-6e154e2778ba] Building network info cache for instance {{(pid=75229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 09:44:14 user nova-compute[75229]: DEBUG nova.compute.manager [req-4c85004e-29c0-4f96-b5bc-34a6ed16f5c2 req-2beab3e1-84a0-4f5b-83cb-b466adb876a4 service nova] [instance: eb53ba25-d865-41ae-90f3-6e154e2778ba] Received event network-changed-695e538f-be1d-4450-84a0-2a0bb92dd2ac {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:44:14 user nova-compute[75229]: DEBUG nova.compute.manager [req-4c85004e-29c0-4f96-b5bc-34a6ed16f5c2 req-2beab3e1-84a0-4f5b-83cb-b466adb876a4 service nova] [instance: eb53ba25-d865-41ae-90f3-6e154e2778ba] Refreshing instance network info cache due to event network-changed-695e538f-be1d-4450-84a0-2a0bb92dd2ac. {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 09:44:14 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-4c85004e-29c0-4f96-b5bc-34a6ed16f5c2 req-2beab3e1-84a0-4f5b-83cb-b466adb876a4 service nova] Acquiring lock "refresh_cache-eb53ba25-d865-41ae-90f3-6e154e2778ba" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 09:44:14 user nova-compute[75229]: DEBUG nova.compute.manager [None req-93623460-a8e7-4988-9cd4-ee89abad768c tempest-AttachSCSIVolumeTestJSON-982350058 tempest-AttachSCSIVolumeTestJSON-982350058-project-member] [instance: 37e63bd9-44fc-4d07-b31b-570f69d7bc8a] Start spawning the instance on the hypervisor. {{(pid=75229) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 09:44:14 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-93623460-a8e7-4988-9cd4-ee89abad768c tempest-AttachSCSIVolumeTestJSON-982350058 tempest-AttachSCSIVolumeTestJSON-982350058-project-member] [instance: 37e63bd9-44fc-4d07-b31b-570f69d7bc8a] Creating instance directory {{(pid=75229) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 09:44:14 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-93623460-a8e7-4988-9cd4-ee89abad768c tempest-AttachSCSIVolumeTestJSON-982350058 tempest-AttachSCSIVolumeTestJSON-982350058-project-member] [instance: 37e63bd9-44fc-4d07-b31b-570f69d7bc8a] Creating image(s)
Nov 14 09:44:14 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-93623460-a8e7-4988-9cd4-ee89abad768c tempest-AttachSCSIVolumeTestJSON-982350058 tempest-AttachSCSIVolumeTestJSON-982350058-project-member] Acquiring lock "/opt/stack/data/nova/instances/37e63bd9-44fc-4d07-b31b-570f69d7bc8a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:44:14 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-93623460-a8e7-4988-9cd4-ee89abad768c tempest-AttachSCSIVolumeTestJSON-982350058 tempest-AttachSCSIVolumeTestJSON-982350058-project-member] Lock "/opt/stack/data/nova/instances/37e63bd9-44fc-4d07-b31b-570f69d7bc8a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:44:14 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-93623460-a8e7-4988-9cd4-ee89abad768c tempest-AttachSCSIVolumeTestJSON-982350058 tempest-AttachSCSIVolumeTestJSON-982350058-project-member] Lock "/opt/stack/data/nova/instances/37e63bd9-44fc-4d07-b31b-570f69d7bc8a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:44:14 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-93623460-a8e7-4988-9cd4-ee89abad768c tempest-AttachSCSIVolumeTestJSON-982350058 tempest-AttachSCSIVolumeTestJSON-982350058-project-member] Acquiring lock "6d0c965a557e928b0a33b9a198a248850417ca09" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:44:14 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-93623460-a8e7-4988-9cd4-ee89abad768c tempest-AttachSCSIVolumeTestJSON-982350058 tempest-AttachSCSIVolumeTestJSON-982350058-project-member] Lock "6d0c965a557e928b0a33b9a198a248850417ca09" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:44:14 user nova-compute[75229]: DEBUG nova.network.neutron [None req-ac0addae-3b0c-47c5-90bf-df549315b34e tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] [instance: eb53ba25-d865-41ae-90f3-6e154e2778ba] Instance cache missing network info. {{(pid=75229) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 09:44:14 user nova-compute[75229]: DEBUG nova.policy [None req-93623460-a8e7-4988-9cd4-ee89abad768c tempest-AttachSCSIVolumeTestJSON-982350058 tempest-AttachSCSIVolumeTestJSON-982350058-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'baf7fbd1437042dc80b48263e32513d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cef322ee4d4353bf72c6ede953e1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75229) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 09:44:15 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-93623460-a8e7-4988-9cd4-ee89abad768c tempest-AttachSCSIVolumeTestJSON-982350058 tempest-AttachSCSIVolumeTestJSON-982350058-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d0c965a557e928b0a33b9a198a248850417ca09.part --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:44:15 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:44:15 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-93623460-a8e7-4988-9cd4-ee89abad768c tempest-AttachSCSIVolumeTestJSON-982350058 tempest-AttachSCSIVolumeTestJSON-982350058-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d0c965a557e928b0a33b9a198a248850417ca09.part --force-share --output=json" returned: 0 in 0.341s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:44:15 user nova-compute[75229]: DEBUG nova.virt.images [None req-93623460-a8e7-4988-9cd4-ee89abad768c tempest-AttachSCSIVolumeTestJSON-982350058 tempest-AttachSCSIVolumeTestJSON-982350058-project-member] 9baffe73-1dea-4547-b030-c3877c548cb7 was qcow2, converting to raw {{(pid=75229) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 14 09:44:15 user nova-compute[75229]: DEBUG nova.privsep.utils [None req-93623460-a8e7-4988-9cd4-ee89abad768c tempest-AttachSCSIVolumeTestJSON-982350058 tempest-AttachSCSIVolumeTestJSON-982350058-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75229) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 14 09:44:15 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-93623460-a8e7-4988-9cd4-ee89abad768c tempest-AttachSCSIVolumeTestJSON-982350058 tempest-AttachSCSIVolumeTestJSON-982350058-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/6d0c965a557e928b0a33b9a198a248850417ca09.part /opt/stack/data/nova/instances/_base/6d0c965a557e928b0a33b9a198a248850417ca09.converted {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:44:15 user nova-compute[75229]: DEBUG nova.network.neutron [None req-ac0addae-3b0c-47c5-90bf-df549315b34e tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] [instance: eb53ba25-d865-41ae-90f3-6e154e2778ba] Updating instance_info_cache with network_info: [{"id": "695e538f-be1d-4450-84a0-2a0bb92dd2ac", "address": "fa:16:3e:4e:66:82", "network": {"id": "9ace077c-6658-4348-ac9b-f6be125b4f0f", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1010403250-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6026f6867f00423283219da921bef367", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap695e538f-be", "ovs_interfaceid": "695e538f-be1d-4450-84a0-2a0bb92dd2ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 09:44:15 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-ac0addae-3b0c-47c5-90bf-df549315b34e tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] Releasing lock "refresh_cache-eb53ba25-d865-41ae-90f3-6e154e2778ba" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 09:44:15 user nova-compute[75229]: DEBUG nova.compute.manager [None req-ac0addae-3b0c-47c5-90bf-df549315b34e tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] [instance: eb53ba25-d865-41ae-90f3-6e154e2778ba] Instance network_info: |[{"id": "695e538f-be1d-4450-84a0-2a0bb92dd2ac", "address": "fa:16:3e:4e:66:82", "network": {"id": "9ace077c-6658-4348-ac9b-f6be125b4f0f", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1010403250-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6026f6867f00423283219da921bef367", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap695e538f-be", "ovs_interfaceid": "695e538f-be1d-4450-84a0-2a0bb92dd2ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75229) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 09:44:15 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-4c85004e-29c0-4f96-b5bc-34a6ed16f5c2 req-2beab3e1-84a0-4f5b-83cb-b466adb876a4 service nova] Acquired lock "refresh_cache-eb53ba25-d865-41ae-90f3-6e154e2778ba" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 09:44:15 user nova-compute[75229]: DEBUG nova.network.neutron [req-4c85004e-29c0-4f96-b5bc-34a6ed16f5c2 req-2beab3e1-84a0-4f5b-83cb-b466adb876a4 service nova] [instance: eb53ba25-d865-41ae-90f3-6e154e2778ba] Refreshing network info cache for port 695e538f-be1d-4450-84a0-2a0bb92dd2ac {{(pid=75229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 09:44:15 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-ac0addae-3b0c-47c5-90bf-df549315b34e tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] [instance: eb53ba25-d865-41ae-90f3-6e154e2778ba] Start _get_guest_xml network_info=[{"id": "695e538f-be1d-4450-84a0-2a0bb92dd2ac", "address": "fa:16:3e:4e:66:82", "network": {"id": "9ace077c-6658-4348-ac9b-f6be125b4f0f", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1010403250-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6026f6867f00423283219da921bef367", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap695e538f-be", "ovs_interfaceid": "695e538f-be1d-4450-84a0-2a0bb92dd2ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T09:40:10Z,direct_url=<?>,disk_format='qcow2',id=3bef8470-ecc7-40e3-95d4-9254348ea72d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='de5a91106b6948ed937a7178ff9464c4',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T09:40:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'disk_bus': 'virtio', 'guest_format': None, 'encryption_secret_uuid': None, 'size': 0, 'device_type': 'disk', 'image_id': '3bef8470-ecc7-40e3-95d4-9254348ea72d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75229) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 09:44:15 user nova-compute[75229]: WARNING nova.virt.libvirt.driver [None req-ac0addae-3b0c-47c5-90bf-df549315b34e tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 09:44:15 user nova-compute[75229]: WARNING nova.virt.libvirt.driver [None req-ac0addae-3b0c-47c5-90bf-df549315b34e tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 09:44:15 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-ac0addae-3b0c-47c5-90bf-df549315b34e tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75229) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 09:44:15 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-ac0addae-3b0c-47c5-90bf-df549315b34e tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] CPU controller missing on host. {{(pid=75229) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 09:44:15 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-ac0addae-3b0c-47c5-90bf-df549315b34e tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75229) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 09:44:15 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-ac0addae-3b0c-47c5-90bf-df549315b34e tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] CPU controller found on host. {{(pid=75229) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 09:44:15 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-ac0addae-3b0c-47c5-90bf-df549315b34e tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75229) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 09:44:15 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-ac0addae-3b0c-47c5-90bf-df549315b34e tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T09:39:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T09:40:10Z,direct_url=<?>,disk_format='qcow2',id=3bef8470-ecc7-40e3-95d4-9254348ea72d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='de5a91106b6948ed937a7178ff9464c4',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T09:40:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 09:44:15 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-ac0addae-3b0c-47c5-90bf-df549315b34e tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] Flavor limits 0:0:0 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 09:44:15 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-ac0addae-3b0c-47c5-90bf-df549315b34e tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] Image limits 0:0:0 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 09:44:15 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-ac0addae-3b0c-47c5-90bf-df549315b34e tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] Flavor pref 0:0:0 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 09:44:15 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-ac0addae-3b0c-47c5-90bf-df549315b34e tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] Image pref 0:0:0 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 09:44:15 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-ac0addae-3b0c-47c5-90bf-df549315b34e tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 09:44:15 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-ac0addae-3b0c-47c5-90bf-df549315b34e tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 09:44:15 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-ac0addae-3b0c-47c5-90bf-df549315b34e tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75229) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 09:44:15 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-ac0addae-3b0c-47c5-90bf-df549315b34e tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] Got 1 possible topologies {{(pid=75229) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 09:44:15 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-ac0addae-3b0c-47c5-90bf-df549315b34e tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 09:44:15 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-ac0addae-3b0c-47c5-90bf-df549315b34e tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 09:44:15 user nova-compute[75229]: DEBUG nova.virt.libvirt.vif [None req-ac0addae-3b0c-47c5-90bf-df549315b34e tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T09:44:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1925681213',display_name='tempest-VolumesAdminNegativeTest-server-1925681213',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1925681213',id=6,image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF9zy5mgVntJuOJ60ueuS9e/tjoHUFtvBli6Yg4p9s8JC3I9/lHYbJyCSdGrB/l/48+E/nh37qcl/lyRYbiT92OOjUa+0D7sV9dFqsjgy9fjsbhchLmhsHpM8jiCMEvfpA==',key_name='tempest-keypair-1897784256',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6026f6867f00423283219da921bef367',ramdisk_id='',reservation_id='r-kw33neqc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-333811129',owner_user_name='tempest-VolumesAdminNegativeTest-333811129-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T09:44:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ce091bb40ce04afeb988be064cbe673a',uuid=eb53ba25-d865-41ae-90f3-6e154e2778ba,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "695e538f-be1d-4450-84a0-2a0bb92dd2ac", "address": "fa:16:3e:4e:66:82", "network": {"id": "9ace077c-6658-4348-ac9b-f6be125b4f0f", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1010403250-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6026f6867f00423283219da921bef367", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap695e538f-be", "ovs_interfaceid": "695e538f-be1d-4450-84a0-2a0bb92dd2ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75229) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 09:44:15 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-ac0addae-3b0c-47c5-90bf-df549315b34e tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] Converting VIF {"id": "695e538f-be1d-4450-84a0-2a0bb92dd2ac", "address": "fa:16:3e:4e:66:82", "network": {"id": "9ace077c-6658-4348-ac9b-f6be125b4f0f", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1010403250-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6026f6867f00423283219da921bef367", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap695e538f-be", "ovs_interfaceid": "695e538f-be1d-4450-84a0-2a0bb92dd2ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 09:44:15 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-ac0addae-3b0c-47c5-90bf-df549315b34e tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4e:66:82,bridge_name='br-int',has_traffic_filtering=True,id=695e538f-be1d-4450-84a0-2a0bb92dd2ac,network=Network(9ace077c-6658-4348-ac9b-f6be125b4f0f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap695e538f-be') {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 09:44:15 user nova-compute[75229]: DEBUG nova.objects.instance [None req-ac0addae-3b0c-47c5-90bf-df549315b34e tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] Lazy-loading 'pci_devices' on Instance uuid eb53ba25-d865-41ae-90f3-6e154e2778ba {{(pid=75229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 09:44:15 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-93623460-a8e7-4988-9cd4-ee89abad768c tempest-AttachSCSIVolumeTestJSON-982350058 tempest-AttachSCSIVolumeTestJSON-982350058-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/6d0c965a557e928b0a33b9a198a248850417ca09.part /opt/stack/data/nova/instances/_base/6d0c965a557e928b0a33b9a198a248850417ca09.converted" returned: 0 in 0.382s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:44:15 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-93623460-a8e7-4988-9cd4-ee89abad768c tempest-AttachSCSIVolumeTestJSON-982350058 tempest-AttachSCSIVolumeTestJSON-982350058-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d0c965a557e928b0a33b9a198a248850417ca09.converted --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:44:15 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-ac0addae-3b0c-47c5-90bf-df549315b34e tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] [instance: eb53ba25-d865-41ae-90f3-6e154e2778ba] End _get_guest_xml xml=<domain type="kvm">
Nov 14 09:44:15 user nova-compute[75229]:   <uuid>eb53ba25-d865-41ae-90f3-6e154e2778ba</uuid>
Nov 14 09:44:15 user nova-compute[75229]:   <name>instance-00000006</name>
Nov 14 09:44:15 user nova-compute[75229]:   <memory>524288</memory>
Nov 14 09:44:15 user nova-compute[75229]:   <vcpu>1</vcpu>
Nov 14 09:44:15 user nova-compute[75229]:   <metadata>
Nov 14 09:44:15 user nova-compute[75229]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 09:44:15 user nova-compute[75229]:       <nova:package version="0.0.0"/>
Nov 14 09:44:15 user nova-compute[75229]:       <nova:name>tempest-VolumesAdminNegativeTest-server-1925681213</nova:name>
Nov 14 09:44:15 user nova-compute[75229]:       <nova:creationTime>2023-11-14 09:44:15</nova:creationTime>
Nov 14 09:44:15 user nova-compute[75229]:       <nova:flavor name="m1.tiny">
Nov 14 09:44:15 user nova-compute[75229]:         <nova:memory>512</nova:memory>
Nov 14 09:44:15 user nova-compute[75229]:         <nova:disk>1</nova:disk>
Nov 14 09:44:15 user nova-compute[75229]:         <nova:swap>0</nova:swap>
Nov 14 09:44:15 user nova-compute[75229]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 09:44:15 user nova-compute[75229]:         <nova:vcpus>1</nova:vcpus>
Nov 14 09:44:15 user nova-compute[75229]:       </nova:flavor>
Nov 14 09:44:15 user nova-compute[75229]:       <nova:owner>
Nov 14 09:44:15 user nova-compute[75229]:         <nova:user uuid="ce091bb40ce04afeb988be064cbe673a">tempest-VolumesAdminNegativeTest-333811129-project-member</nova:user>
Nov 14 09:44:15 user nova-compute[75229]:         <nova:project uuid="6026f6867f00423283219da921bef367">tempest-VolumesAdminNegativeTest-333811129</nova:project>
Nov 14 09:44:15 user nova-compute[75229]:       </nova:owner>
Nov 14 09:44:15 user nova-compute[75229]:       <nova:root type="image" uuid="3bef8470-ecc7-40e3-95d4-9254348ea72d"/>
Nov 14 09:44:15 user nova-compute[75229]:       <nova:ports>
Nov 14 09:44:15 user nova-compute[75229]:         <nova:port uuid="695e538f-be1d-4450-84a0-2a0bb92dd2ac">
Nov 14 09:44:15 user nova-compute[75229]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 14 09:44:15 user nova-compute[75229]:         </nova:port>
Nov 14 09:44:15 user nova-compute[75229]:       </nova:ports>
Nov 14 09:44:15 user nova-compute[75229]:     </nova:instance>
Nov 14 09:44:15 user nova-compute[75229]:   </metadata>
Nov 14 09:44:15 user nova-compute[75229]:   <sysinfo type="smbios">
Nov 14 09:44:15 user nova-compute[75229]:     <system>
Nov 14 09:44:15 user nova-compute[75229]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 09:44:15 user nova-compute[75229]:       <entry name="product">OpenStack Nova</entry>
Nov 14 09:44:15 user nova-compute[75229]:       <entry name="version">0.0.0</entry>
Nov 14 09:44:15 user nova-compute[75229]:       <entry name="serial">eb53ba25-d865-41ae-90f3-6e154e2778ba</entry>
Nov 14 09:44:15 user nova-compute[75229]:       <entry name="uuid">eb53ba25-d865-41ae-90f3-6e154e2778ba</entry>
Nov 14 09:44:15 user nova-compute[75229]:       <entry name="family">Virtual Machine</entry>
Nov 14 09:44:15 user nova-compute[75229]:     </system>
Nov 14 09:44:15 user nova-compute[75229]:   </sysinfo>
Nov 14 09:44:15 user nova-compute[75229]:   <os>
Nov 14 09:44:15 user nova-compute[75229]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 09:44:15 user nova-compute[75229]:     <boot dev="hd"/>
Nov 14 09:44:15 user nova-compute[75229]:     <smbios mode="sysinfo"/>
Nov 14 09:44:15 user nova-compute[75229]:   </os>
Nov 14 09:44:15 user nova-compute[75229]:   <features>
Nov 14 09:44:15 user nova-compute[75229]:     <acpi/>
Nov 14 09:44:15 user nova-compute[75229]:     <apic/>
Nov 14 09:44:15 user nova-compute[75229]:     <vmcoreinfo/>
Nov 14 09:44:15 user nova-compute[75229]:   </features>
Nov 14 09:44:15 user nova-compute[75229]:   <clock offset="utc">
Nov 14 09:44:15 user nova-compute[75229]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 09:44:15 user nova-compute[75229]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 09:44:15 user nova-compute[75229]:     <timer name="hpet" present="no"/>
Nov 14 09:44:15 user nova-compute[75229]:   </clock>
Nov 14 09:44:15 user nova-compute[75229]:   <cpu mode="custom" match="exact">
Nov 14 09:44:15 user nova-compute[75229]:     <model>Nehalem</model>
Nov 14 09:44:15 user nova-compute[75229]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 09:44:15 user nova-compute[75229]:   </cpu>
Nov 14 09:44:15 user nova-compute[75229]:   <devices>
Nov 14 09:44:15 user nova-compute[75229]:     <disk type="file" device="disk">
Nov 14 09:44:15 user nova-compute[75229]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 09:44:15 user nova-compute[75229]:       <source file="/opt/stack/data/nova/instances/eb53ba25-d865-41ae-90f3-6e154e2778ba/disk"/>
Nov 14 09:44:15 user nova-compute[75229]:       <target dev="vda" bus="virtio"/>
Nov 14 09:44:15 user nova-compute[75229]:     </disk>
Nov 14 09:44:15 user nova-compute[75229]:     <interface type="ethernet">
Nov 14 09:44:15 user nova-compute[75229]:       <mac address="fa:16:3e:4e:66:82"/>
Nov 14 09:44:15 user nova-compute[75229]:       <model type="virtio"/>
Nov 14 09:44:15 user nova-compute[75229]:       <mtu size="1442"/>
Nov 14 09:44:15 user nova-compute[75229]:       <target dev="tap695e538f-be"/>
Nov 14 09:44:15 user nova-compute[75229]:     </interface>
Nov 14 09:44:15 user nova-compute[75229]:     <serial type="pty">
Nov 14 09:44:15 user nova-compute[75229]:       <log file="/opt/stack/data/nova/instances/eb53ba25-d865-41ae-90f3-6e154e2778ba/console.log" append="off"/>
Nov 14 09:44:15 user nova-compute[75229]:     </serial>
Nov 14 09:44:15 user nova-compute[75229]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 09:44:15 user nova-compute[75229]:     <video>
Nov 14 09:44:15 user nova-compute[75229]:       <model type="virtio"/>
Nov 14 09:44:15 user nova-compute[75229]:     </video>
Nov 14 09:44:15 user nova-compute[75229]:     <rng model="virtio">
Nov 14 09:44:15 user nova-compute[75229]:       <backend model="random">/dev/urandom</backend>
Nov 14 09:44:15 user nova-compute[75229]:     </rng>
Nov 14 09:44:15 user nova-compute[75229]:     <controller type="usb" index="0" model="none"/>
Nov 14 09:44:15 user nova-compute[75229]:     <memballoon model="virtio">
Nov 14 09:44:15 user nova-compute[75229]:       <stats period="10"/>
Nov 14 09:44:15 user nova-compute[75229]:     </memballoon>
Nov 14 09:44:15 user nova-compute[75229]:   </devices>
Nov 14 09:44:15 user nova-compute[75229]: </domain>
Nov 14 09:44:15 user nova-compute[75229]:  {{(pid=75229) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 09:44:15 user nova-compute[75229]: DEBUG nova.virt.libvirt.vif [None req-ac0addae-3b0c-47c5-90bf-df549315b34e tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T09:44:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1925681213',display_name='tempest-VolumesAdminNegativeTest-server-1925681213',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1925681213',id=6,image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF9zy5mgVntJuOJ60ueuS9e/tjoHUFtvBli6Yg4p9s8JC3I9/lHYbJyCSdGrB/l/48+E/nh37qcl/lyRYbiT92OOjUa+0D7sV9dFqsjgy9fjsbhchLmhsHpM8jiCMEvfpA==',key_name='tempest-keypair-1897784256',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6026f6867f00423283219da921bef367',ramdisk_id='',reservation_id='r-kw33neqc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-333811129',owner_user_name='tempest-VolumesAdminNegativeTest-333811129-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T09:44:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ce091bb40ce04afeb988be064cbe673a',uuid=eb53ba25-d865-41ae-90f3-6e154e2778ba,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "695e538f-be1d-4450-84a0-2a0bb92dd2ac", "address": "fa:16:3e:4e:66:82", "network": {"id": "9ace077c-6658-4348-ac9b-f6be125b4f0f", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1010403250-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6026f6867f00423283219da921bef367", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap695e538f-be", "ovs_interfaceid": "695e538f-be1d-4450-84a0-2a0bb92dd2ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 09:44:15 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-ac0addae-3b0c-47c5-90bf-df549315b34e tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] Converting VIF {"id": "695e538f-be1d-4450-84a0-2a0bb92dd2ac", "address": "fa:16:3e:4e:66:82", "network": {"id": "9ace077c-6658-4348-ac9b-f6be125b4f0f", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1010403250-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6026f6867f00423283219da921bef367", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap695e538f-be", "ovs_interfaceid": "695e538f-be1d-4450-84a0-2a0bb92dd2ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 09:44:15 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-ac0addae-3b0c-47c5-90bf-df549315b34e tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4e:66:82,bridge_name='br-int',has_traffic_filtering=True,id=695e538f-be1d-4450-84a0-2a0bb92dd2ac,network=Network(9ace077c-6658-4348-ac9b-f6be125b4f0f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap695e538f-be') {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 09:44:15 user nova-compute[75229]: DEBUG os_vif [None req-ac0addae-3b0c-47c5-90bf-df549315b34e tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4e:66:82,bridge_name='br-int',has_traffic_filtering=True,id=695e538f-be1d-4450-84a0-2a0bb92dd2ac,network=Network(9ace077c-6658-4348-ac9b-f6be125b4f0f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap695e538f-be') {{(pid=75229) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 09:44:15 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:44:15 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:44:15 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 09:44:15 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:44:15 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e4b69abb-3a22-5f1f-9d6f-effa9e5ff01b', '_type': 'linux-noop'}}, row=False) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:44:15 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:44:15 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 09:44:15 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:44:16 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:44:16 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap695e538f-be, may_exist=True, interface_attrs={}) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:44:16 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap695e538f-be, col_values=(('qos', UUID('51f8bec4-3a54-41f5-8976-242cc599f898')),), if_exists=True) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:44:16 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap695e538f-be, col_values=(('external_ids', {'iface-id': '695e538f-be1d-4450-84a0-2a0bb92dd2ac', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4e:66:82', 'vm-uuid': 'eb53ba25-d865-41ae-90f3-6e154e2778ba'}),), if_exists=True) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:44:16 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:44:16 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:44:16 user nova-compute[75229]: INFO os_vif [None req-ac0addae-3b0c-47c5-90bf-df549315b34e tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4e:66:82,bridge_name='br-int',has_traffic_filtering=True,id=695e538f-be1d-4450-84a0-2a0bb92dd2ac,network=Network(9ace077c-6658-4348-ac9b-f6be125b4f0f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap695e538f-be')
Nov 14 09:44:16 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-93623460-a8e7-4988-9cd4-ee89abad768c tempest-AttachSCSIVolumeTestJSON-982350058 tempest-AttachSCSIVolumeTestJSON-982350058-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d0c965a557e928b0a33b9a198a248850417ca09.converted --force-share --output=json" returned: 0 in 0.316s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:44:16 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-93623460-a8e7-4988-9cd4-ee89abad768c tempest-AttachSCSIVolumeTestJSON-982350058 tempest-AttachSCSIVolumeTestJSON-982350058-project-member] Lock "6d0c965a557e928b0a33b9a198a248850417ca09" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.670s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:44:16 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-93623460-a8e7-4988-9cd4-ee89abad768c tempest-AttachSCSIVolumeTestJSON-982350058 tempest-AttachSCSIVolumeTestJSON-982350058-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d0c965a557e928b0a33b9a198a248850417ca09 --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:44:16 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-ac0addae-3b0c-47c5-90bf-df549315b34e tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] No BDM found with device name vda, not building metadata. {{(pid=75229) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 09:44:16 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-ac0addae-3b0c-47c5-90bf-df549315b34e tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] No VIF found with MAC fa:16:3e:4e:66:82, not building metadata {{(pid=75229) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 09:44:16 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-93623460-a8e7-4988-9cd4-ee89abad768c tempest-AttachSCSIVolumeTestJSON-982350058 tempest-AttachSCSIVolumeTestJSON-982350058-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d0c965a557e928b0a33b9a198a248850417ca09 --force-share --output=json" returned: 0 in 0.271s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:44:16 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-93623460-a8e7-4988-9cd4-ee89abad768c tempest-AttachSCSIVolumeTestJSON-982350058 tempest-AttachSCSIVolumeTestJSON-982350058-project-member] Acquiring lock "6d0c965a557e928b0a33b9a198a248850417ca09" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:44:16 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-93623460-a8e7-4988-9cd4-ee89abad768c tempest-AttachSCSIVolumeTestJSON-982350058 tempest-AttachSCSIVolumeTestJSON-982350058-project-member] Lock "6d0c965a557e928b0a33b9a198a248850417ca09" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:44:16 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-93623460-a8e7-4988-9cd4-ee89abad768c tempest-AttachSCSIVolumeTestJSON-982350058 tempest-AttachSCSIVolumeTestJSON-982350058-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d0c965a557e928b0a33b9a198a248850417ca09 --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:44:16 user nova-compute[75229]: DEBUG nova.network.neutron [req-4c85004e-29c0-4f96-b5bc-34a6ed16f5c2 req-2beab3e1-84a0-4f5b-83cb-b466adb876a4 service nova] [instance: eb53ba25-d865-41ae-90f3-6e154e2778ba] Updated VIF entry in instance network info cache for port 695e538f-be1d-4450-84a0-2a0bb92dd2ac. {{(pid=75229) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 09:44:16 user nova-compute[75229]: DEBUG nova.network.neutron [req-4c85004e-29c0-4f96-b5bc-34a6ed16f5c2 req-2beab3e1-84a0-4f5b-83cb-b466adb876a4 service nova] [instance: eb53ba25-d865-41ae-90f3-6e154e2778ba] Updating instance_info_cache with network_info: [{"id": "695e538f-be1d-4450-84a0-2a0bb92dd2ac", "address": "fa:16:3e:4e:66:82", "network": {"id": "9ace077c-6658-4348-ac9b-f6be125b4f0f", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1010403250-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6026f6867f00423283219da921bef367", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap695e538f-be", "ovs_interfaceid": "695e538f-be1d-4450-84a0-2a0bb92dd2ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 09:44:16 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-4c85004e-29c0-4f96-b5bc-34a6ed16f5c2 req-2beab3e1-84a0-4f5b-83cb-b466adb876a4 service nova] Releasing lock "refresh_cache-eb53ba25-d865-41ae-90f3-6e154e2778ba" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 09:44:16 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-93623460-a8e7-4988-9cd4-ee89abad768c tempest-AttachSCSIVolumeTestJSON-982350058 tempest-AttachSCSIVolumeTestJSON-982350058-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d0c965a557e928b0a33b9a198a248850417ca09 --force-share --output=json" returned: 0 in 0.286s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:44:16 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-93623460-a8e7-4988-9cd4-ee89abad768c tempest-AttachSCSIVolumeTestJSON-982350058 tempest-AttachSCSIVolumeTestJSON-982350058-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6d0c965a557e928b0a33b9a198a248850417ca09,backing_fmt=raw /opt/stack/data/nova/instances/37e63bd9-44fc-4d07-b31b-570f69d7bc8a/disk 1073741824 {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:44:16 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-93623460-a8e7-4988-9cd4-ee89abad768c tempest-AttachSCSIVolumeTestJSON-982350058 tempest-AttachSCSIVolumeTestJSON-982350058-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6d0c965a557e928b0a33b9a198a248850417ca09,backing_fmt=raw /opt/stack/data/nova/instances/37e63bd9-44fc-4d07-b31b-570f69d7bc8a/disk 1073741824" returned: 0 in 0.065s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:44:16 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-93623460-a8e7-4988-9cd4-ee89abad768c tempest-AttachSCSIVolumeTestJSON-982350058 tempest-AttachSCSIVolumeTestJSON-982350058-project-member] Lock "6d0c965a557e928b0a33b9a198a248850417ca09" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.361s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:44:16 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-93623460-a8e7-4988-9cd4-ee89abad768c tempest-AttachSCSIVolumeTestJSON-982350058 tempest-AttachSCSIVolumeTestJSON-982350058-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d0c965a557e928b0a33b9a198a248850417ca09 --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:44:16 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:44:16 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:44:16 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:44:16 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:44:17 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-93623460-a8e7-4988-9cd4-ee89abad768c tempest-AttachSCSIVolumeTestJSON-982350058 tempest-AttachSCSIVolumeTestJSON-982350058-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d0c965a557e928b0a33b9a198a248850417ca09 --force-share --output=json" returned: 0 in 0.359s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:44:17 user nova-compute[75229]: DEBUG nova.virt.disk.api [None req-93623460-a8e7-4988-9cd4-ee89abad768c tempest-AttachSCSIVolumeTestJSON-982350058 tempest-AttachSCSIVolumeTestJSON-982350058-project-member] Checking if we can resize image /opt/stack/data/nova/instances/37e63bd9-44fc-4d07-b31b-570f69d7bc8a/disk. size=1073741824 {{(pid=75229) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 09:44:17 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-93623460-a8e7-4988-9cd4-ee89abad768c tempest-AttachSCSIVolumeTestJSON-982350058 tempest-AttachSCSIVolumeTestJSON-982350058-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37e63bd9-44fc-4d07-b31b-570f69d7bc8a/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:44:17 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-93623460-a8e7-4988-9cd4-ee89abad768c tempest-AttachSCSIVolumeTestJSON-982350058 tempest-AttachSCSIVolumeTestJSON-982350058-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37e63bd9-44fc-4d07-b31b-570f69d7bc8a/disk --force-share --output=json" returned: 0 in 0.323s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:44:17 user nova-compute[75229]: DEBUG nova.virt.disk.api [None req-93623460-a8e7-4988-9cd4-ee89abad768c tempest-AttachSCSIVolumeTestJSON-982350058 tempest-AttachSCSIVolumeTestJSON-982350058-project-member] Cannot resize image /opt/stack/data/nova/instances/37e63bd9-44fc-4d07-b31b-570f69d7bc8a/disk to a smaller size. {{(pid=75229) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 09:44:17 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-93623460-a8e7-4988-9cd4-ee89abad768c tempest-AttachSCSIVolumeTestJSON-982350058 tempest-AttachSCSIVolumeTestJSON-982350058-project-member] [instance: 37e63bd9-44fc-4d07-b31b-570f69d7bc8a] Created local disks {{(pid=75229) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 09:44:17 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-93623460-a8e7-4988-9cd4-ee89abad768c tempest-AttachSCSIVolumeTestJSON-982350058 tempest-AttachSCSIVolumeTestJSON-982350058-project-member] [instance: 37e63bd9-44fc-4d07-b31b-570f69d7bc8a] Ensure instance console log exists: /opt/stack/data/nova/instances/37e63bd9-44fc-4d07-b31b-570f69d7bc8a/console.log {{(pid=75229) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 09:44:17 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-93623460-a8e7-4988-9cd4-ee89abad768c tempest-AttachSCSIVolumeTestJSON-982350058 tempest-AttachSCSIVolumeTestJSON-982350058-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:44:17 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-93623460-a8e7-4988-9cd4-ee89abad768c tempest-AttachSCSIVolumeTestJSON-982350058 tempest-AttachSCSIVolumeTestJSON-982350058-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:44:17 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-93623460-a8e7-4988-9cd4-ee89abad768c tempest-AttachSCSIVolumeTestJSON-982350058 tempest-AttachSCSIVolumeTestJSON-982350058-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:44:17 user nova-compute[75229]: DEBUG nova.network.neutron [None req-93623460-a8e7-4988-9cd4-ee89abad768c tempest-AttachSCSIVolumeTestJSON-982350058 tempest-AttachSCSIVolumeTestJSON-982350058-project-member] [instance: 37e63bd9-44fc-4d07-b31b-570f69d7bc8a] Successfully created port: 22c0a013-145e-46f8-ab59-f883d51567e6 {{(pid=75229) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 09:44:17 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:44:17 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:44:18 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:44:18 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:44:18 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:44:18 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:44:19 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:44:19 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:44:19 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:44:20 user nova-compute[75229]: DEBUG nova.network.neutron [None req-93623460-a8e7-4988-9cd4-ee89abad768c tempest-AttachSCSIVolumeTestJSON-982350058 tempest-AttachSCSIVolumeTestJSON-982350058-project-member] [instance: 37e63bd9-44fc-4d07-b31b-570f69d7bc8a] Successfully updated port: 22c0a013-145e-46f8-ab59-f883d51567e6 {{(pid=75229) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 09:44:20 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-93623460-a8e7-4988-9cd4-ee89abad768c tempest-AttachSCSIVolumeTestJSON-982350058 tempest-AttachSCSIVolumeTestJSON-982350058-project-member] Acquiring lock "refresh_cache-37e63bd9-44fc-4d07-b31b-570f69d7bc8a" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 09:44:20 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-93623460-a8e7-4988-9cd4-ee89abad768c tempest-AttachSCSIVolumeTestJSON-982350058 tempest-AttachSCSIVolumeTestJSON-982350058-project-member] Acquired lock "refresh_cache-37e63bd9-44fc-4d07-b31b-570f69d7bc8a" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 09:44:20 user nova-compute[75229]: DEBUG nova.network.neutron [None req-93623460-a8e7-4988-9cd4-ee89abad768c tempest-AttachSCSIVolumeTestJSON-982350058 tempest-AttachSCSIVolumeTestJSON-982350058-project-member] [instance: 37e63bd9-44fc-4d07-b31b-570f69d7bc8a] Building network info cache for instance {{(pid=75229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 09:44:20 user nova-compute[75229]: DEBUG nova.compute.manager [req-2be806a6-aa3d-466b-b682-46f24a314630 req-ca535380-1d30-4540-9c51-7b2f001320e7 service nova] [instance: 37e63bd9-44fc-4d07-b31b-570f69d7bc8a] Received event network-changed-22c0a013-145e-46f8-ab59-f883d51567e6 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:44:20 user nova-compute[75229]: DEBUG nova.compute.manager [req-2be806a6-aa3d-466b-b682-46f24a314630 req-ca535380-1d30-4540-9c51-7b2f001320e7 service nova] [instance: 37e63bd9-44fc-4d07-b31b-570f69d7bc8a] Refreshing instance network info cache due to event network-changed-22c0a013-145e-46f8-ab59-f883d51567e6. {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 09:44:20 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-2be806a6-aa3d-466b-b682-46f24a314630 req-ca535380-1d30-4540-9c51-7b2f001320e7 service nova] Acquiring lock "refresh_cache-37e63bd9-44fc-4d07-b31b-570f69d7bc8a" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 09:44:20 user nova-compute[75229]: DEBUG nova.network.neutron [None req-93623460-a8e7-4988-9cd4-ee89abad768c tempest-AttachSCSIVolumeTestJSON-982350058 tempest-AttachSCSIVolumeTestJSON-982350058-project-member] [instance: 37e63bd9-44fc-4d07-b31b-570f69d7bc8a] Instance cache missing network info. {{(pid=75229) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 09:44:20 user nova-compute[75229]: DEBUG nova.compute.manager [None req-ac0addae-3b0c-47c5-90bf-df549315b34e tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] [instance: eb53ba25-d865-41ae-90f3-6e154e2778ba] Instance event wait completed in 0 seconds for  {{(pid=75229) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 09:44:20 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-ac0addae-3b0c-47c5-90bf-df549315b34e tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] [instance: eb53ba25-d865-41ae-90f3-6e154e2778ba] Guest created on hypervisor {{(pid=75229) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 09:44:20 user nova-compute[75229]: INFO nova.virt.libvirt.driver [-] [instance: eb53ba25-d865-41ae-90f3-6e154e2778ba] Instance spawned successfully.
Nov 14 09:44:20 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-ac0addae-3b0c-47c5-90bf-df549315b34e tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] [instance: eb53ba25-d865-41ae-90f3-6e154e2778ba] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 09:44:20 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-5ebcc9ee-2955-4be7-9636-bccac98f0e53 tempest-TaggedAttachmentsTest-294727221 tempest-TaggedAttachmentsTest-294727221-project-member] Acquiring lock "c6fa2298-7111-4660-a162-09269045d5e3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:44:20 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-5ebcc9ee-2955-4be7-9636-bccac98f0e53 tempest-TaggedAttachmentsTest-294727221 tempest-TaggedAttachmentsTest-294727221-project-member] Lock "c6fa2298-7111-4660-a162-09269045d5e3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:44:20 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-ac0addae-3b0c-47c5-90bf-df549315b34e tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] [instance: eb53ba25-d865-41ae-90f3-6e154e2778ba] Found default for hw_cdrom_bus of ide {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 09:44:20 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-ac0addae-3b0c-47c5-90bf-df549315b34e tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] [instance: eb53ba25-d865-41ae-90f3-6e154e2778ba] Found default for hw_disk_bus of virtio {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 09:44:20 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-ac0addae-3b0c-47c5-90bf-df549315b34e tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] [instance: eb53ba25-d865-41ae-90f3-6e154e2778ba] Found default for hw_input_bus of None {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 09:44:20 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-ac0addae-3b0c-47c5-90bf-df549315b34e tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] [instance: eb53ba25-d865-41ae-90f3-6e154e2778ba] Found default for hw_pointer_model of None {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 09:44:20 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-ac0addae-3b0c-47c5-90bf-df549315b34e tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] [instance: eb53ba25-d865-41ae-90f3-6e154e2778ba] Found default for hw_video_model of virtio {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 09:44:20 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-ac0addae-3b0c-47c5-90bf-df549315b34e tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] [instance: eb53ba25-d865-41ae-90f3-6e154e2778ba] Found default for hw_vif_model of virtio {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 09:44:20 user nova-compute[75229]: DEBUG nova.compute.manager [None req-5ebcc9ee-2955-4be7-9636-bccac98f0e53 tempest-TaggedAttachmentsTest-294727221 tempest-TaggedAttachmentsTest-294727221-project-member] [instance: c6fa2298-7111-4660-a162-09269045d5e3] Starting instance... {{(pid=75229) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 09:44:20 user nova-compute[75229]: INFO nova.compute.manager [None req-ac0addae-3b0c-47c5-90bf-df549315b34e tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] [instance: eb53ba25-d865-41ae-90f3-6e154e2778ba] Took 8.42 seconds to spawn the instance on the hypervisor.
Nov 14 09:44:20 user nova-compute[75229]: DEBUG nova.compute.manager [None req-ac0addae-3b0c-47c5-90bf-df549315b34e tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] [instance: eb53ba25-d865-41ae-90f3-6e154e2778ba] Checking state {{(pid=75229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 09:44:20 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-5ebcc9ee-2955-4be7-9636-bccac98f0e53 tempest-TaggedAttachmentsTest-294727221 tempest-TaggedAttachmentsTest-294727221-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:44:20 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-5ebcc9ee-2955-4be7-9636-bccac98f0e53 tempest-TaggedAttachmentsTest-294727221 tempest-TaggedAttachmentsTest-294727221-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:44:20 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-5ebcc9ee-2955-4be7-9636-bccac98f0e53 tempest-TaggedAttachmentsTest-294727221 tempest-TaggedAttachmentsTest-294727221-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75229) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 09:44:20 user nova-compute[75229]: INFO nova.compute.claims [None req-5ebcc9ee-2955-4be7-9636-bccac98f0e53 tempest-TaggedAttachmentsTest-294727221 tempest-TaggedAttachmentsTest-294727221-project-member] [instance: c6fa2298-7111-4660-a162-09269045d5e3] Claim successful on node user
Nov 14 09:44:20 user nova-compute[75229]: INFO nova.compute.manager [None req-ac0addae-3b0c-47c5-90bf-df549315b34e tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] [instance: eb53ba25-d865-41ae-90f3-6e154e2778ba] Took 13.77 seconds to build instance.
Nov 14 09:44:21 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-ac0addae-3b0c-47c5-90bf-df549315b34e tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] Lock "eb53ba25-d865-41ae-90f3-6e154e2778ba" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.897s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:44:21 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:44:21 user nova-compute[75229]: DEBUG nova.network.neutron [None req-93623460-a8e7-4988-9cd4-ee89abad768c tempest-AttachSCSIVolumeTestJSON-982350058 tempest-AttachSCSIVolumeTestJSON-982350058-project-member] [instance: 37e63bd9-44fc-4d07-b31b-570f69d7bc8a] Updating instance_info_cache with network_info: [{"id": "22c0a013-145e-46f8-ab59-f883d51567e6", "address": "fa:16:3e:4f:33:04", "network": {"id": "7141cb71-7f74-4de2-93a0-c94b9c8630fd", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1370522646-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6cef322ee4d4353bf72c6ede953e1bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22c0a013-14", "ovs_interfaceid": "22c0a013-145e-46f8-ab59-f883d51567e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 09:44:21 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-93623460-a8e7-4988-9cd4-ee89abad768c tempest-AttachSCSIVolumeTestJSON-982350058 tempest-AttachSCSIVolumeTestJSON-982350058-project-member] Releasing lock "refresh_cache-37e63bd9-44fc-4d07-b31b-570f69d7bc8a" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 09:44:21 user nova-compute[75229]: DEBUG nova.compute.manager [None req-93623460-a8e7-4988-9cd4-ee89abad768c tempest-AttachSCSIVolumeTestJSON-982350058 tempest-AttachSCSIVolumeTestJSON-982350058-project-member] [instance: 37e63bd9-44fc-4d07-b31b-570f69d7bc8a] Instance network_info: |[{"id": "22c0a013-145e-46f8-ab59-f883d51567e6", "address": "fa:16:3e:4f:33:04", "network": {"id": "7141cb71-7f74-4de2-93a0-c94b9c8630fd", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1370522646-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6cef322ee4d4353bf72c6ede953e1bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22c0a013-14", "ovs_interfaceid": "22c0a013-145e-46f8-ab59-f883d51567e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75229) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 09:44:21 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-2be806a6-aa3d-466b-b682-46f24a314630 req-ca535380-1d30-4540-9c51-7b2f001320e7 service nova] Acquired lock "refresh_cache-37e63bd9-44fc-4d07-b31b-570f69d7bc8a" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 09:44:21 user nova-compute[75229]: DEBUG nova.network.neutron [req-2be806a6-aa3d-466b-b682-46f24a314630 req-ca535380-1d30-4540-9c51-7b2f001320e7 service nova] [instance: 37e63bd9-44fc-4d07-b31b-570f69d7bc8a] Refreshing network info cache for port 22c0a013-145e-46f8-ab59-f883d51567e6 {{(pid=75229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 09:44:21 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-93623460-a8e7-4988-9cd4-ee89abad768c tempest-AttachSCSIVolumeTestJSON-982350058 tempest-AttachSCSIVolumeTestJSON-982350058-project-member] [instance: 37e63bd9-44fc-4d07-b31b-570f69d7bc8a] Start _get_guest_xml network_info=[{"id": "22c0a013-145e-46f8-ab59-f883d51567e6", "address": "fa:16:3e:4f:33:04", "network": {"id": "7141cb71-7f74-4de2-93a0-c94b9c8630fd", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1370522646-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6cef322ee4d4353bf72c6ede953e1bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22c0a013-14", "ovs_interfaceid": "22c0a013-145e-46f8-ab59-f883d51567e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'scsi', 'cdrom_bus': 'scsi', 'mapping': {'root': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'scsi', 'dev': 'sdb', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T09:44:03Z,direct_url=<?>,disk_format='qcow2',id=9baffe73-1dea-4547-b030-c3877c548cb7,min_disk=0,min_ram=0,name='',owner='b8859bdec7584c95b88daf28c040ab15',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T09:44:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/sda', 'image': [{'device_name': '/dev/sda', 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'disk_bus': 'scsi', 'guest_format': None, 'encryption_secret_uuid': None, 'size': 0, 'device_type': 'disk', 'image_id': '9baffe73-1dea-4547-b030-c3877c548cb7'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75229) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 09:44:21 user nova-compute[75229]: WARNING nova.virt.libvirt.driver [None req-93623460-a8e7-4988-9cd4-ee89abad768c tempest-AttachSCSIVolumeTestJSON-982350058 tempest-AttachSCSIVolumeTestJSON-982350058-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 09:44:21 user nova-compute[75229]: WARNING nova.virt.libvirt.driver [None req-93623460-a8e7-4988-9cd4-ee89abad768c tempest-AttachSCSIVolumeTestJSON-982350058 tempest-AttachSCSIVolumeTestJSON-982350058-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 09:44:21 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-93623460-a8e7-4988-9cd4-ee89abad768c tempest-AttachSCSIVolumeTestJSON-982350058 tempest-AttachSCSIVolumeTestJSON-982350058-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75229) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 09:44:21 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-93623460-a8e7-4988-9cd4-ee89abad768c tempest-AttachSCSIVolumeTestJSON-982350058 tempest-AttachSCSIVolumeTestJSON-982350058-project-member] CPU controller missing on host. {{(pid=75229) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 09:44:21 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-93623460-a8e7-4988-9cd4-ee89abad768c tempest-AttachSCSIVolumeTestJSON-982350058 tempest-AttachSCSIVolumeTestJSON-982350058-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75229) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 09:44:21 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-93623460-a8e7-4988-9cd4-ee89abad768c tempest-AttachSCSIVolumeTestJSON-982350058 tempest-AttachSCSIVolumeTestJSON-982350058-project-member] CPU controller found on host. {{(pid=75229) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 09:44:21 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-93623460-a8e7-4988-9cd4-ee89abad768c tempest-AttachSCSIVolumeTestJSON-982350058 tempest-AttachSCSIVolumeTestJSON-982350058-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75229) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 09:44:21 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-93623460-a8e7-4988-9cd4-ee89abad768c tempest-AttachSCSIVolumeTestJSON-982350058 tempest-AttachSCSIVolumeTestJSON-982350058-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T09:39:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T09:44:03Z,direct_url=<?>,disk_format='qcow2',id=9baffe73-1dea-4547-b030-c3877c548cb7,min_disk=0,min_ram=0,name='',owner='b8859bdec7584c95b88daf28c040ab15',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T09:44:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 09:44:21 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-93623460-a8e7-4988-9cd4-ee89abad768c tempest-AttachSCSIVolumeTestJSON-982350058 tempest-AttachSCSIVolumeTestJSON-982350058-project-member] Flavor limits 0:0:0 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 09:44:21 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-93623460-a8e7-4988-9cd4-ee89abad768c tempest-AttachSCSIVolumeTestJSON-982350058 tempest-AttachSCSIVolumeTestJSON-982350058-project-member] Image limits 0:0:0 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 09:44:21 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-93623460-a8e7-4988-9cd4-ee89abad768c tempest-AttachSCSIVolumeTestJSON-982350058 tempest-AttachSCSIVolumeTestJSON-982350058-project-member] Flavor pref 0:0:0 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 09:44:21 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-93623460-a8e7-4988-9cd4-ee89abad768c tempest-AttachSCSIVolumeTestJSON-982350058 tempest-AttachSCSIVolumeTestJSON-982350058-project-member] Image pref 0:0:0 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 09:44:21 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-93623460-a8e7-4988-9cd4-ee89abad768c tempest-AttachSCSIVolumeTestJSON-982350058 tempest-AttachSCSIVolumeTestJSON-982350058-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 09:44:21 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-93623460-a8e7-4988-9cd4-ee89abad768c tempest-AttachSCSIVolumeTestJSON-982350058 tempest-AttachSCSIVolumeTestJSON-982350058-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 09:44:21 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-93623460-a8e7-4988-9cd4-ee89abad768c tempest-AttachSCSIVolumeTestJSON-982350058 tempest-AttachSCSIVolumeTestJSON-982350058-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75229) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 09:44:21 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-93623460-a8e7-4988-9cd4-ee89abad768c tempest-AttachSCSIVolumeTestJSON-982350058 tempest-AttachSCSIVolumeTestJSON-982350058-project-member] Got 1 possible topologies {{(pid=75229) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 09:44:21 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-93623460-a8e7-4988-9cd4-ee89abad768c tempest-AttachSCSIVolumeTestJSON-982350058 tempest-AttachSCSIVolumeTestJSON-982350058-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 09:44:21 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-93623460-a8e7-4988-9cd4-ee89abad768c tempest-AttachSCSIVolumeTestJSON-982350058 tempest-AttachSCSIVolumeTestJSON-982350058-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 09:44:21 user nova-compute[75229]: DEBUG nova.virt.libvirt.vif [None req-93623460-a8e7-4988-9cd4-ee89abad768c tempest-AttachSCSIVolumeTestJSON-982350058 tempest-AttachSCSIVolumeTestJSON-982350058-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T09:44:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1278987485',display_name='tempest-AttachSCSIVolumeTestJSON-server-1278987485',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1278987485',id=7,image_ref='9baffe73-1dea-4547-b030-c3877c548cb7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAvwF3/nF/oHteQ5rKMukokUZtat53J3Dz6NQfXHwPIOFeU1ZhP3BjU/ay7ASLhg/tBOR3mcaesog2ve6fU3jAU4rLQ0DRB/6uvR3LQned4BF77zC6x6KGk60toGket/XQ==',key_name='tempest-keypair-1064628259',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b6cef322ee4d4353bf72c6ede953e1bb',ramdisk_id='',reservation_id='r-oyqi7dpr',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9baffe73-1dea-4547-b030-c3877c548cb7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-982350058',owner_user_name='tempest-AttachSCSIVolumeTestJSON-982350058-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T09:44:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='baf7fbd1437042dc80b48263e32513d0',uuid=37e63bd9-44fc-4d07-b31b-570f69d7bc8a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "22c0a013-145e-46f8-ab59-f883d51567e6", "address": "fa:16:3e:4f:33:04", "network": {"id": "7141cb71-7f74-4de2-93a0-c94b9c8630fd", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1370522646-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6cef322ee4d4353bf72c6ede953e1bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22c0a013-14", "ovs_interfaceid": "22c0a013-145e-46f8-ab59-f883d51567e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75229) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 09:44:21 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-93623460-a8e7-4988-9cd4-ee89abad768c tempest-AttachSCSIVolumeTestJSON-982350058 tempest-AttachSCSIVolumeTestJSON-982350058-project-member] Converting VIF {"id": "22c0a013-145e-46f8-ab59-f883d51567e6", "address": "fa:16:3e:4f:33:04", "network": {"id": "7141cb71-7f74-4de2-93a0-c94b9c8630fd", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1370522646-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6cef322ee4d4353bf72c6ede953e1bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22c0a013-14", "ovs_interfaceid": "22c0a013-145e-46f8-ab59-f883d51567e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 09:44:21 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-93623460-a8e7-4988-9cd4-ee89abad768c tempest-AttachSCSIVolumeTestJSON-982350058 tempest-AttachSCSIVolumeTestJSON-982350058-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4f:33:04,bridge_name='br-int',has_traffic_filtering=True,id=22c0a013-145e-46f8-ab59-f883d51567e6,network=Network(7141cb71-7f74-4de2-93a0-c94b9c8630fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22c0a013-14') {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 09:44:21 user nova-compute[75229]: DEBUG nova.objects.instance [None req-93623460-a8e7-4988-9cd4-ee89abad768c tempest-AttachSCSIVolumeTestJSON-982350058 tempest-AttachSCSIVolumeTestJSON-982350058-project-member] Lazy-loading 'pci_devices' on Instance uuid 37e63bd9-44fc-4d07-b31b-570f69d7bc8a {{(pid=75229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 09:44:21 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-93623460-a8e7-4988-9cd4-ee89abad768c tempest-AttachSCSIVolumeTestJSON-982350058 tempest-AttachSCSIVolumeTestJSON-982350058-project-member] [instance: 37e63bd9-44fc-4d07-b31b-570f69d7bc8a] End _get_guest_xml xml=<domain type="kvm">
Nov 14 09:44:21 user nova-compute[75229]:   <uuid>37e63bd9-44fc-4d07-b31b-570f69d7bc8a</uuid>
Nov 14 09:44:21 user nova-compute[75229]:   <name>instance-00000007</name>
Nov 14 09:44:21 user nova-compute[75229]:   <memory>524288</memory>
Nov 14 09:44:21 user nova-compute[75229]:   <vcpu>1</vcpu>
Nov 14 09:44:21 user nova-compute[75229]:   <metadata>
Nov 14 09:44:21 user nova-compute[75229]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 09:44:21 user nova-compute[75229]:       <nova:package version="0.0.0"/>
Nov 14 09:44:21 user nova-compute[75229]:       <nova:name>tempest-AttachSCSIVolumeTestJSON-server-1278987485</nova:name>
Nov 14 09:44:21 user nova-compute[75229]:       <nova:creationTime>2023-11-14 09:44:21</nova:creationTime>
Nov 14 09:44:21 user nova-compute[75229]:       <nova:flavor name="m1.tiny">
Nov 14 09:44:21 user nova-compute[75229]:         <nova:memory>512</nova:memory>
Nov 14 09:44:21 user nova-compute[75229]:         <nova:disk>1</nova:disk>
Nov 14 09:44:21 user nova-compute[75229]:         <nova:swap>0</nova:swap>
Nov 14 09:44:21 user nova-compute[75229]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 09:44:21 user nova-compute[75229]:         <nova:vcpus>1</nova:vcpus>
Nov 14 09:44:21 user nova-compute[75229]:       </nova:flavor>
Nov 14 09:44:21 user nova-compute[75229]:       <nova:owner>
Nov 14 09:44:21 user nova-compute[75229]:         <nova:user uuid="baf7fbd1437042dc80b48263e32513d0">tempest-AttachSCSIVolumeTestJSON-982350058-project-member</nova:user>
Nov 14 09:44:21 user nova-compute[75229]:         <nova:project uuid="b6cef322ee4d4353bf72c6ede953e1bb">tempest-AttachSCSIVolumeTestJSON-982350058</nova:project>
Nov 14 09:44:21 user nova-compute[75229]:       </nova:owner>
Nov 14 09:44:21 user nova-compute[75229]:       <nova:root type="image" uuid="9baffe73-1dea-4547-b030-c3877c548cb7"/>
Nov 14 09:44:21 user nova-compute[75229]:       <nova:ports>
Nov 14 09:44:21 user nova-compute[75229]:         <nova:port uuid="22c0a013-145e-46f8-ab59-f883d51567e6">
Nov 14 09:44:21 user nova-compute[75229]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 14 09:44:21 user nova-compute[75229]:         </nova:port>
Nov 14 09:44:21 user nova-compute[75229]:       </nova:ports>
Nov 14 09:44:21 user nova-compute[75229]:     </nova:instance>
Nov 14 09:44:21 user nova-compute[75229]:   </metadata>
Nov 14 09:44:21 user nova-compute[75229]:   <sysinfo type="smbios">
Nov 14 09:44:21 user nova-compute[75229]:     <system>
Nov 14 09:44:21 user nova-compute[75229]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 09:44:21 user nova-compute[75229]:       <entry name="product">OpenStack Nova</entry>
Nov 14 09:44:21 user nova-compute[75229]:       <entry name="version">0.0.0</entry>
Nov 14 09:44:21 user nova-compute[75229]:       <entry name="serial">37e63bd9-44fc-4d07-b31b-570f69d7bc8a</entry>
Nov 14 09:44:21 user nova-compute[75229]:       <entry name="uuid">37e63bd9-44fc-4d07-b31b-570f69d7bc8a</entry>
Nov 14 09:44:21 user nova-compute[75229]:       <entry name="family">Virtual Machine</entry>
Nov 14 09:44:21 user nova-compute[75229]:     </system>
Nov 14 09:44:21 user nova-compute[75229]:   </sysinfo>
Nov 14 09:44:21 user nova-compute[75229]:   <os>
Nov 14 09:44:21 user nova-compute[75229]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 09:44:21 user nova-compute[75229]:     <boot dev="hd"/>
Nov 14 09:44:21 user nova-compute[75229]:     <smbios mode="sysinfo"/>
Nov 14 09:44:21 user nova-compute[75229]:   </os>
Nov 14 09:44:21 user nova-compute[75229]:   <features>
Nov 14 09:44:21 user nova-compute[75229]:     <acpi/>
Nov 14 09:44:21 user nova-compute[75229]:     <apic/>
Nov 14 09:44:21 user nova-compute[75229]:     <vmcoreinfo/>
Nov 14 09:44:21 user nova-compute[75229]:   </features>
Nov 14 09:44:21 user nova-compute[75229]:   <clock offset="utc">
Nov 14 09:44:21 user nova-compute[75229]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 09:44:21 user nova-compute[75229]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 09:44:21 user nova-compute[75229]:     <timer name="hpet" present="no"/>
Nov 14 09:44:21 user nova-compute[75229]:   </clock>
Nov 14 09:44:21 user nova-compute[75229]:   <cpu mode="custom" match="exact">
Nov 14 09:44:21 user nova-compute[75229]:     <model>Nehalem</model>
Nov 14 09:44:21 user nova-compute[75229]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 09:44:21 user nova-compute[75229]:   </cpu>
Nov 14 09:44:21 user nova-compute[75229]:   <devices>
Nov 14 09:44:21 user nova-compute[75229]:     <disk type="file" device="disk">
Nov 14 09:44:21 user nova-compute[75229]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 09:44:21 user nova-compute[75229]:       <source file="/opt/stack/data/nova/instances/37e63bd9-44fc-4d07-b31b-570f69d7bc8a/disk"/>
Nov 14 09:44:21 user nova-compute[75229]:       <target dev="sda" bus="scsi"/>
Nov 14 09:44:21 user nova-compute[75229]:       <address type="drive" controller="0" unit="0"/>
Nov 14 09:44:21 user nova-compute[75229]:     </disk>
Nov 14 09:44:21 user nova-compute[75229]:     <disk type="file" device="cdrom">
Nov 14 09:44:21 user nova-compute[75229]:       <driver name="qemu" type="raw" cache="none"/>
Nov 14 09:44:21 user nova-compute[75229]:       <source file="/opt/stack/data/nova/instances/37e63bd9-44fc-4d07-b31b-570f69d7bc8a/disk.config"/>
Nov 14 09:44:21 user nova-compute[75229]:       <target dev="sdb" bus="scsi"/>
Nov 14 09:44:21 user nova-compute[75229]:       <address type="drive" controller="0" unit="1"/>
Nov 14 09:44:21 user nova-compute[75229]:     </disk>
Nov 14 09:44:21 user nova-compute[75229]:     <controller type="scsi" index="0" model="virtio-scsi"/>
Nov 14 09:44:21 user nova-compute[75229]:     <interface type="ethernet">
Nov 14 09:44:21 user nova-compute[75229]:       <mac address="fa:16:3e:4f:33:04"/>
Nov 14 09:44:21 user nova-compute[75229]:       <model type="virtio"/>
Nov 14 09:44:21 user nova-compute[75229]:       <mtu size="1442"/>
Nov 14 09:44:21 user nova-compute[75229]:       <target dev="tap22c0a013-14"/>
Nov 14 09:44:21 user nova-compute[75229]:     </interface>
Nov 14 09:44:21 user nova-compute[75229]:     <serial type="pty">
Nov 14 09:44:21 user nova-compute[75229]:       <log file="/opt/stack/data/nova/instances/37e63bd9-44fc-4d07-b31b-570f69d7bc8a/console.log" append="off"/>
Nov 14 09:44:21 user nova-compute[75229]:     </serial>
Nov 14 09:44:21 user nova-compute[75229]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 09:44:21 user nova-compute[75229]:     <video>
Nov 14 09:44:21 user nova-compute[75229]:       <model type="virtio"/>
Nov 14 09:44:21 user nova-compute[75229]:     </video>
Nov 14 09:44:21 user nova-compute[75229]:     <rng model="virtio">
Nov 14 09:44:21 user nova-compute[75229]:       <backend model="random">/dev/urandom</backend>
Nov 14 09:44:21 user nova-compute[75229]:     </rng>
Nov 14 09:44:21 user nova-compute[75229]:     <controller type="usb" index="0" model="none"/>
Nov 14 09:44:21 user nova-compute[75229]:     <memballoon model="virtio">
Nov 14 09:44:21 user nova-compute[75229]:       <stats period="10"/>
Nov 14 09:44:21 user nova-compute[75229]:     </memballoon>
Nov 14 09:44:21 user nova-compute[75229]:   </devices>
Nov 14 09:44:21 user nova-compute[75229]: </domain>
Nov 14 09:44:21 user nova-compute[75229]:  {{(pid=75229) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 09:44:21 user nova-compute[75229]: DEBUG nova.virt.libvirt.vif [None req-93623460-a8e7-4988-9cd4-ee89abad768c tempest-AttachSCSIVolumeTestJSON-982350058 tempest-AttachSCSIVolumeTestJSON-982350058-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T09:44:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1278987485',display_name='tempest-AttachSCSIVolumeTestJSON-server-1278987485',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1278987485',id=7,image_ref='9baffe73-1dea-4547-b030-c3877c548cb7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAvwF3/nF/oHteQ5rKMukokUZtat53J3Dz6NQfXHwPIOFeU1ZhP3BjU/ay7ASLhg/tBOR3mcaesog2ve6fU3jAU4rLQ0DRB/6uvR3LQned4BF77zC6x6KGk60toGket/XQ==',key_name='tempest-keypair-1064628259',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b6cef322ee4d4353bf72c6ede953e1bb',ramdisk_id='',reservation_id='r-oyqi7dpr',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9baffe73-1dea-4547-b030-c3877c548cb7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-982350058',owner_user_name='tempest-AttachSCSIVolumeTestJSON-982350058-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T09:44:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='baf7fbd1437042dc80b48263e32513d0',uuid=37e63bd9-44fc-4d07-b31b-570f69d7bc8a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "22c0a013-145e-46f8-ab59-f883d51567e6", "address": "fa:16:3e:4f:33:04", "network": {"id": "7141cb71-7f74-4de2-93a0-c94b9c8630fd", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1370522646-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6cef322ee4d4353bf72c6ede953e1bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22c0a013-14", "ovs_interfaceid": "22c0a013-145e-46f8-ab59-f883d51567e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 09:44:21 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-93623460-a8e7-4988-9cd4-ee89abad768c tempest-AttachSCSIVolumeTestJSON-982350058 tempest-AttachSCSIVolumeTestJSON-982350058-project-member] Converting VIF {"id": "22c0a013-145e-46f8-ab59-f883d51567e6", "address": "fa:16:3e:4f:33:04", "network": {"id": "7141cb71-7f74-4de2-93a0-c94b9c8630fd", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1370522646-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6cef322ee4d4353bf72c6ede953e1bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22c0a013-14", "ovs_interfaceid": "22c0a013-145e-46f8-ab59-f883d51567e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 09:44:21 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-93623460-a8e7-4988-9cd4-ee89abad768c tempest-AttachSCSIVolumeTestJSON-982350058 tempest-AttachSCSIVolumeTestJSON-982350058-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4f:33:04,bridge_name='br-int',has_traffic_filtering=True,id=22c0a013-145e-46f8-ab59-f883d51567e6,network=Network(7141cb71-7f74-4de2-93a0-c94b9c8630fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22c0a013-14') {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 09:44:21 user nova-compute[75229]: DEBUG os_vif [None req-93623460-a8e7-4988-9cd4-ee89abad768c tempest-AttachSCSIVolumeTestJSON-982350058 tempest-AttachSCSIVolumeTestJSON-982350058-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4f:33:04,bridge_name='br-int',has_traffic_filtering=True,id=22c0a013-145e-46f8-ab59-f883d51567e6,network=Network(7141cb71-7f74-4de2-93a0-c94b9c8630fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22c0a013-14') {{(pid=75229) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 09:44:21 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:44:21 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:44:21 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 09:44:21 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:44:21 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '18d26779-b7f7-5c65-80ee-2c546de3bf5a', '_type': 'linux-noop'}}, row=False) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:44:21 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:44:21 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 09:44:21 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:44:21 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap22c0a013-14, may_exist=True, interface_attrs={}) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:44:21 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap22c0a013-14, col_values=(('qos', UUID('be74a15e-7b35-4651-a008-1fc0f43279f1')),), if_exists=True) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:44:21 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap22c0a013-14, col_values=(('external_ids', {'iface-id': '22c0a013-145e-46f8-ab59-f883d51567e6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4f:33:04', 'vm-uuid': '37e63bd9-44fc-4d07-b31b-570f69d7bc8a'}),), if_exists=True) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:44:21 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:44:21 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 09:44:21 user nova-compute[75229]: INFO os_vif [None req-93623460-a8e7-4988-9cd4-ee89abad768c tempest-AttachSCSIVolumeTestJSON-982350058 tempest-AttachSCSIVolumeTestJSON-982350058-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4f:33:04,bridge_name='br-int',has_traffic_filtering=True,id=22c0a013-145e-46f8-ab59-f883d51567e6,network=Network(7141cb71-7f74-4de2-93a0-c94b9c8630fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22c0a013-14')
Nov 14 09:44:21 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-93623460-a8e7-4988-9cd4-ee89abad768c tempest-AttachSCSIVolumeTestJSON-982350058 tempest-AttachSCSIVolumeTestJSON-982350058-project-member] No BDM found with device name sda, not building metadata. {{(pid=75229) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 09:44:21 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-93623460-a8e7-4988-9cd4-ee89abad768c tempest-AttachSCSIVolumeTestJSON-982350058 tempest-AttachSCSIVolumeTestJSON-982350058-project-member] No BDM found with device name sdb, not building metadata. {{(pid=75229) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 09:44:21 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-93623460-a8e7-4988-9cd4-ee89abad768c tempest-AttachSCSIVolumeTestJSON-982350058 tempest-AttachSCSIVolumeTestJSON-982350058-project-member] No VIF found with MAC fa:16:3e:4f:33:04, not building metadata {{(pid=75229) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 09:44:21 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-93623460-a8e7-4988-9cd4-ee89abad768c tempest-AttachSCSIVolumeTestJSON-982350058 tempest-AttachSCSIVolumeTestJSON-982350058-project-member] [instance: 37e63bd9-44fc-4d07-b31b-570f69d7bc8a] Using config drive
Nov 14 09:44:21 user nova-compute[75229]: DEBUG nova.compute.provider_tree [None req-5ebcc9ee-2955-4be7-9636-bccac98f0e53 tempest-TaggedAttachmentsTest-294727221 tempest-TaggedAttachmentsTest-294727221-project-member] Inventory has not changed in ProviderTree for provider: d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 {{(pid=75229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 09:44:21 user nova-compute[75229]: DEBUG nova.scheduler.client.report [None req-5ebcc9ee-2955-4be7-9636-bccac98f0e53 tempest-TaggedAttachmentsTest-294727221 tempest-TaggedAttachmentsTest-294727221-project-member] Inventory has not changed for provider d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 09:44:22 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-5ebcc9ee-2955-4be7-9636-bccac98f0e53 tempest-TaggedAttachmentsTest-294727221 tempest-TaggedAttachmentsTest-294727221-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.169s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:44:22 user nova-compute[75229]: DEBUG nova.compute.manager [None req-5ebcc9ee-2955-4be7-9636-bccac98f0e53 tempest-TaggedAttachmentsTest-294727221 tempest-TaggedAttachmentsTest-294727221-project-member] [instance: c6fa2298-7111-4660-a162-09269045d5e3] Start building networks asynchronously for instance. {{(pid=75229) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 09:44:22 user nova-compute[75229]: DEBUG nova.compute.manager [None req-5ebcc9ee-2955-4be7-9636-bccac98f0e53 tempest-TaggedAttachmentsTest-294727221 tempest-TaggedAttachmentsTest-294727221-project-member] [instance: c6fa2298-7111-4660-a162-09269045d5e3] Allocating IP information in the background. {{(pid=75229) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 09:44:22 user nova-compute[75229]: DEBUG nova.network.neutron [None req-5ebcc9ee-2955-4be7-9636-bccac98f0e53 tempest-TaggedAttachmentsTest-294727221 tempest-TaggedAttachmentsTest-294727221-project-member] [instance: c6fa2298-7111-4660-a162-09269045d5e3] allocate_for_instance() {{(pid=75229) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 09:44:22 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-5ebcc9ee-2955-4be7-9636-bccac98f0e53 tempest-TaggedAttachmentsTest-294727221 tempest-TaggedAttachmentsTest-294727221-project-member] [instance: c6fa2298-7111-4660-a162-09269045d5e3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 09:44:22 user nova-compute[75229]: DEBUG nova.compute.manager [None req-5ebcc9ee-2955-4be7-9636-bccac98f0e53 tempest-TaggedAttachmentsTest-294727221 tempest-TaggedAttachmentsTest-294727221-project-member] [instance: c6fa2298-7111-4660-a162-09269045d5e3] Start building block device mappings for instance. {{(pid=75229) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 09:44:22 user nova-compute[75229]: DEBUG nova.network.neutron [req-2be806a6-aa3d-466b-b682-46f24a314630 req-ca535380-1d30-4540-9c51-7b2f001320e7 service nova] [instance: 37e63bd9-44fc-4d07-b31b-570f69d7bc8a] Updated VIF entry in instance network info cache for port 22c0a013-145e-46f8-ab59-f883d51567e6. {{(pid=75229) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 09:44:22 user nova-compute[75229]: DEBUG nova.network.neutron [req-2be806a6-aa3d-466b-b682-46f24a314630 req-ca535380-1d30-4540-9c51-7b2f001320e7 service nova] [instance: 37e63bd9-44fc-4d07-b31b-570f69d7bc8a] Updating instance_info_cache with network_info: [{"id": "22c0a013-145e-46f8-ab59-f883d51567e6", "address": "fa:16:3e:4f:33:04", "network": {"id": "7141cb71-7f74-4de2-93a0-c94b9c8630fd", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1370522646-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6cef322ee4d4353bf72c6ede953e1bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22c0a013-14", "ovs_interfaceid": "22c0a013-145e-46f8-ab59-f883d51567e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 09:44:22 user nova-compute[75229]: DEBUG nova.policy [None req-5ebcc9ee-2955-4be7-9636-bccac98f0e53 tempest-TaggedAttachmentsTest-294727221 tempest-TaggedAttachmentsTest-294727221-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3c818850ce5c41b5b978031cdedfea65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48b5edeee7494b6e94135faaab6afd50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75229) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 09:44:22 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:44:22 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-2be806a6-aa3d-466b-b682-46f24a314630 req-ca535380-1d30-4540-9c51-7b2f001320e7 service nova] Releasing lock "refresh_cache-37e63bd9-44fc-4d07-b31b-570f69d7bc8a" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 09:44:22 user nova-compute[75229]: DEBUG nova.compute.manager [None req-5ebcc9ee-2955-4be7-9636-bccac98f0e53 tempest-TaggedAttachmentsTest-294727221 tempest-TaggedAttachmentsTest-294727221-project-member] [instance: c6fa2298-7111-4660-a162-09269045d5e3] Start spawning the instance on the hypervisor. {{(pid=75229) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 09:44:22 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-5ebcc9ee-2955-4be7-9636-bccac98f0e53 tempest-TaggedAttachmentsTest-294727221 tempest-TaggedAttachmentsTest-294727221-project-member] [instance: c6fa2298-7111-4660-a162-09269045d5e3] Creating instance directory {{(pid=75229) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 09:44:22 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-5ebcc9ee-2955-4be7-9636-bccac98f0e53 tempest-TaggedAttachmentsTest-294727221 tempest-TaggedAttachmentsTest-294727221-project-member] [instance: c6fa2298-7111-4660-a162-09269045d5e3] Creating image(s)
Nov 14 09:44:22 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-5ebcc9ee-2955-4be7-9636-bccac98f0e53 tempest-TaggedAttachmentsTest-294727221 tempest-TaggedAttachmentsTest-294727221-project-member] Acquiring lock "/opt/stack/data/nova/instances/c6fa2298-7111-4660-a162-09269045d5e3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:44:22 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-5ebcc9ee-2955-4be7-9636-bccac98f0e53 tempest-TaggedAttachmentsTest-294727221 tempest-TaggedAttachmentsTest-294727221-project-member] Lock "/opt/stack/data/nova/instances/c6fa2298-7111-4660-a162-09269045d5e3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:44:22 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-5ebcc9ee-2955-4be7-9636-bccac98f0e53 tempest-TaggedAttachmentsTest-294727221 tempest-TaggedAttachmentsTest-294727221-project-member] Lock "/opt/stack/data/nova/instances/c6fa2298-7111-4660-a162-09269045d5e3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:44:22 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-5ebcc9ee-2955-4be7-9636-bccac98f0e53 tempest-TaggedAttachmentsTest-294727221 tempest-TaggedAttachmentsTest-294727221-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6 --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:44:22 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-5ebcc9ee-2955-4be7-9636-bccac98f0e53 tempest-TaggedAttachmentsTest-294727221 tempest-TaggedAttachmentsTest-294727221-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6 --force-share --output=json" returned: 0 in 0.258s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:44:22 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-5ebcc9ee-2955-4be7-9636-bccac98f0e53 tempest-TaggedAttachmentsTest-294727221 tempest-TaggedAttachmentsTest-294727221-project-member] Acquiring lock "4f30e3fe703d2381679612a57b1fb80a467f60b6" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:44:23 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-5ebcc9ee-2955-4be7-9636-bccac98f0e53 tempest-TaggedAttachmentsTest-294727221 tempest-TaggedAttachmentsTest-294727221-project-member] Lock "4f30e3fe703d2381679612a57b1fb80a467f60b6" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.004s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:44:23 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-5ebcc9ee-2955-4be7-9636-bccac98f0e53 tempest-TaggedAttachmentsTest-294727221 tempest-TaggedAttachmentsTest-294727221-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6 --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:44:23 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-93623460-a8e7-4988-9cd4-ee89abad768c tempest-AttachSCSIVolumeTestJSON-982350058 tempest-AttachSCSIVolumeTestJSON-982350058-project-member] [instance: 37e63bd9-44fc-4d07-b31b-570f69d7bc8a] Creating config drive at /opt/stack/data/nova/instances/37e63bd9-44fc-4d07-b31b-570f69d7bc8a/disk.config
Nov 14 09:44:23 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-93623460-a8e7-4988-9cd4-ee89abad768c tempest-AttachSCSIVolumeTestJSON-982350058 tempest-AttachSCSIVolumeTestJSON-982350058-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/37e63bd9-44fc-4d07-b31b-570f69d7bc8a/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp26c9ahpu {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:44:23 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-93623460-a8e7-4988-9cd4-ee89abad768c tempest-AttachSCSIVolumeTestJSON-982350058 tempest-AttachSCSIVolumeTestJSON-982350058-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/37e63bd9-44fc-4d07-b31b-570f69d7bc8a/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp26c9ahpu" returned: 0 in 0.111s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:44:23 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-5ebcc9ee-2955-4be7-9636-bccac98f0e53 tempest-TaggedAttachmentsTest-294727221 tempest-TaggedAttachmentsTest-294727221-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6 --force-share --output=json" returned: 0 in 0.367s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:44:23 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-5ebcc9ee-2955-4be7-9636-bccac98f0e53 tempest-TaggedAttachmentsTest-294727221 tempest-TaggedAttachmentsTest-294727221-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6,backing_fmt=raw /opt/stack/data/nova/instances/c6fa2298-7111-4660-a162-09269045d5e3/disk 1073741824 {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:44:23 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-5ebcc9ee-2955-4be7-9636-bccac98f0e53 tempest-TaggedAttachmentsTest-294727221 tempest-TaggedAttachmentsTest-294727221-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6,backing_fmt=raw /opt/stack/data/nova/instances/c6fa2298-7111-4660-a162-09269045d5e3/disk 1073741824" returned: 0 in 0.270s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:44:23 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-5ebcc9ee-2955-4be7-9636-bccac98f0e53 tempest-TaggedAttachmentsTest-294727221 tempest-TaggedAttachmentsTest-294727221-project-member] Lock "4f30e3fe703d2381679612a57b1fb80a467f60b6" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.644s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:44:23 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-5ebcc9ee-2955-4be7-9636-bccac98f0e53 tempest-TaggedAttachmentsTest-294727221 tempest-TaggedAttachmentsTest-294727221-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6 --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:44:23 user nova-compute[75229]: DEBUG nova.network.neutron [None req-5ebcc9ee-2955-4be7-9636-bccac98f0e53 tempest-TaggedAttachmentsTest-294727221 tempest-TaggedAttachmentsTest-294727221-project-member] [instance: c6fa2298-7111-4660-a162-09269045d5e3] Successfully created port: b310b3f2-f842-4918-8540-f9803e259b31 {{(pid=75229) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 09:44:23 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-5ebcc9ee-2955-4be7-9636-bccac98f0e53 tempest-TaggedAttachmentsTest-294727221 tempest-TaggedAttachmentsTest-294727221-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6 --force-share --output=json" returned: 0 in 0.325s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:44:23 user nova-compute[75229]: DEBUG nova.virt.disk.api [None req-5ebcc9ee-2955-4be7-9636-bccac98f0e53 tempest-TaggedAttachmentsTest-294727221 tempest-TaggedAttachmentsTest-294727221-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c6fa2298-7111-4660-a162-09269045d5e3/disk. size=1073741824 {{(pid=75229) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 09:44:23 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-5ebcc9ee-2955-4be7-9636-bccac98f0e53 tempest-TaggedAttachmentsTest-294727221 tempest-TaggedAttachmentsTest-294727221-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6fa2298-7111-4660-a162-09269045d5e3/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:44:24 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-5ebcc9ee-2955-4be7-9636-bccac98f0e53 tempest-TaggedAttachmentsTest-294727221 tempest-TaggedAttachmentsTest-294727221-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6fa2298-7111-4660-a162-09269045d5e3/disk --force-share --output=json" returned: 0 in 0.591s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:44:24 user nova-compute[75229]: DEBUG nova.virt.disk.api [None req-5ebcc9ee-2955-4be7-9636-bccac98f0e53 tempest-TaggedAttachmentsTest-294727221 tempest-TaggedAttachmentsTest-294727221-project-member] Cannot resize image /opt/stack/data/nova/instances/c6fa2298-7111-4660-a162-09269045d5e3/disk to a smaller size. {{(pid=75229) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 09:44:24 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-5ebcc9ee-2955-4be7-9636-bccac98f0e53 tempest-TaggedAttachmentsTest-294727221 tempest-TaggedAttachmentsTest-294727221-project-member] [instance: c6fa2298-7111-4660-a162-09269045d5e3] Created local disks {{(pid=75229) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 09:44:24 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-5ebcc9ee-2955-4be7-9636-bccac98f0e53 tempest-TaggedAttachmentsTest-294727221 tempest-TaggedAttachmentsTest-294727221-project-member] [instance: c6fa2298-7111-4660-a162-09269045d5e3] Ensure instance console log exists: /opt/stack/data/nova/instances/c6fa2298-7111-4660-a162-09269045d5e3/console.log {{(pid=75229) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 09:44:24 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-5ebcc9ee-2955-4be7-9636-bccac98f0e53 tempest-TaggedAttachmentsTest-294727221 tempest-TaggedAttachmentsTest-294727221-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:44:24 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-5ebcc9ee-2955-4be7-9636-bccac98f0e53 tempest-TaggedAttachmentsTest-294727221 tempest-TaggedAttachmentsTest-294727221-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:44:24 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-5ebcc9ee-2955-4be7-9636-bccac98f0e53 tempest-TaggedAttachmentsTest-294727221 tempest-TaggedAttachmentsTest-294727221-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:44:25 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:44:25 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:44:25 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:44:25 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:44:25 user nova-compute[75229]: DEBUG nova.network.neutron [None req-5ebcc9ee-2955-4be7-9636-bccac98f0e53 tempest-TaggedAttachmentsTest-294727221 tempest-TaggedAttachmentsTest-294727221-project-member] [instance: c6fa2298-7111-4660-a162-09269045d5e3] Successfully updated port: b310b3f2-f842-4918-8540-f9803e259b31 {{(pid=75229) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 09:44:25 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-5ebcc9ee-2955-4be7-9636-bccac98f0e53 tempest-TaggedAttachmentsTest-294727221 tempest-TaggedAttachmentsTest-294727221-project-member] Acquiring lock "refresh_cache-c6fa2298-7111-4660-a162-09269045d5e3" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 09:44:25 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-5ebcc9ee-2955-4be7-9636-bccac98f0e53 tempest-TaggedAttachmentsTest-294727221 tempest-TaggedAttachmentsTest-294727221-project-member] Acquired lock "refresh_cache-c6fa2298-7111-4660-a162-09269045d5e3" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 09:44:25 user nova-compute[75229]: DEBUG nova.network.neutron [None req-5ebcc9ee-2955-4be7-9636-bccac98f0e53 tempest-TaggedAttachmentsTest-294727221 tempest-TaggedAttachmentsTest-294727221-project-member] [instance: c6fa2298-7111-4660-a162-09269045d5e3] Building network info cache for instance {{(pid=75229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 09:44:25 user nova-compute[75229]: DEBUG nova.compute.manager [req-e3a1ac50-f234-4bf1-87c6-0cf673a2f4d2 req-8df56ca3-c2cc-44a7-bb2d-734720437223 service nova] [instance: c6fa2298-7111-4660-a162-09269045d5e3] Received event network-changed-b310b3f2-f842-4918-8540-f9803e259b31 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:44:25 user nova-compute[75229]: DEBUG nova.compute.manager [req-e3a1ac50-f234-4bf1-87c6-0cf673a2f4d2 req-8df56ca3-c2cc-44a7-bb2d-734720437223 service nova] [instance: c6fa2298-7111-4660-a162-09269045d5e3] Refreshing instance network info cache due to event network-changed-b310b3f2-f842-4918-8540-f9803e259b31. {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 09:44:25 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-e3a1ac50-f234-4bf1-87c6-0cf673a2f4d2 req-8df56ca3-c2cc-44a7-bb2d-734720437223 service nova] Acquiring lock "refresh_cache-c6fa2298-7111-4660-a162-09269045d5e3" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 09:44:25 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:44:26 user nova-compute[75229]: DEBUG nova.network.neutron [None req-5ebcc9ee-2955-4be7-9636-bccac98f0e53 tempest-TaggedAttachmentsTest-294727221 tempest-TaggedAttachmentsTest-294727221-project-member] [instance: c6fa2298-7111-4660-a162-09269045d5e3] Instance cache missing network info. {{(pid=75229) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 09:44:26 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:44:26 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:44:26 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:44:26 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:44:26 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:44:26 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:44:26 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-4b4efe05-1866-4fb6-a793-a43ec7f6e933 tempest-TestVolumeSwap-528292061 tempest-TestVolumeSwap-528292061-project-member] Acquiring lock "c307660b-01bb-471b-9e2e-5c2aaca65287" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:44:26 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-4b4efe05-1866-4fb6-a793-a43ec7f6e933 tempest-TestVolumeSwap-528292061 tempest-TestVolumeSwap-528292061-project-member] Lock "c307660b-01bb-471b-9e2e-5c2aaca65287" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:44:26 user nova-compute[75229]: DEBUG nova.compute.manager [None req-4b4efe05-1866-4fb6-a793-a43ec7f6e933 tempest-TestVolumeSwap-528292061 tempest-TestVolumeSwap-528292061-project-member] [instance: c307660b-01bb-471b-9e2e-5c2aaca65287] Starting instance... {{(pid=75229) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 09:44:26 user nova-compute[75229]: DEBUG nova.network.neutron [None req-5ebcc9ee-2955-4be7-9636-bccac98f0e53 tempest-TaggedAttachmentsTest-294727221 tempest-TaggedAttachmentsTest-294727221-project-member] [instance: c6fa2298-7111-4660-a162-09269045d5e3] Updating instance_info_cache with network_info: [{"id": "b310b3f2-f842-4918-8540-f9803e259b31", "address": "fa:16:3e:90:0c:ec", "network": {"id": "35508221-011f-4deb-81a1-6dfdae3f2375", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-827518066-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48b5edeee7494b6e94135faaab6afd50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb310b3f2-f8", "ovs_interfaceid": "b310b3f2-f842-4918-8540-f9803e259b31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 09:44:26 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-5ebcc9ee-2955-4be7-9636-bccac98f0e53 tempest-TaggedAttachmentsTest-294727221 tempest-TaggedAttachmentsTest-294727221-project-member] Releasing lock "refresh_cache-c6fa2298-7111-4660-a162-09269045d5e3" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 09:44:26 user nova-compute[75229]: DEBUG nova.compute.manager [None req-5ebcc9ee-2955-4be7-9636-bccac98f0e53 tempest-TaggedAttachmentsTest-294727221 tempest-TaggedAttachmentsTest-294727221-project-member] [instance: c6fa2298-7111-4660-a162-09269045d5e3] Instance network_info: |[{"id": "b310b3f2-f842-4918-8540-f9803e259b31", "address": "fa:16:3e:90:0c:ec", "network": {"id": "35508221-011f-4deb-81a1-6dfdae3f2375", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-827518066-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48b5edeee7494b6e94135faaab6afd50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb310b3f2-f8", "ovs_interfaceid": "b310b3f2-f842-4918-8540-f9803e259b31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75229) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 09:44:26 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-e3a1ac50-f234-4bf1-87c6-0cf673a2f4d2 req-8df56ca3-c2cc-44a7-bb2d-734720437223 service nova] Acquired lock "refresh_cache-c6fa2298-7111-4660-a162-09269045d5e3" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 09:44:26 user nova-compute[75229]: DEBUG nova.network.neutron [req-e3a1ac50-f234-4bf1-87c6-0cf673a2f4d2 req-8df56ca3-c2cc-44a7-bb2d-734720437223 service nova] [instance: c6fa2298-7111-4660-a162-09269045d5e3] Refreshing network info cache for port b310b3f2-f842-4918-8540-f9803e259b31 {{(pid=75229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 09:44:26 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-5ebcc9ee-2955-4be7-9636-bccac98f0e53 tempest-TaggedAttachmentsTest-294727221 tempest-TaggedAttachmentsTest-294727221-project-member] [instance: c6fa2298-7111-4660-a162-09269045d5e3] Start _get_guest_xml network_info=[{"id": "b310b3f2-f842-4918-8540-f9803e259b31", "address": "fa:16:3e:90:0c:ec", "network": {"id": "35508221-011f-4deb-81a1-6dfdae3f2375", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-827518066-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48b5edeee7494b6e94135faaab6afd50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb310b3f2-f8", "ovs_interfaceid": "b310b3f2-f842-4918-8540-f9803e259b31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T09:40:10Z,direct_url=<?>,disk_format='qcow2',id=3bef8470-ecc7-40e3-95d4-9254348ea72d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='de5a91106b6948ed937a7178ff9464c4',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T09:40:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'disk_bus': 'virtio', 'guest_format': None, 'encryption_secret_uuid': None, 'size': 0, 'device_type': 'disk', 'image_id': '3bef8470-ecc7-40e3-95d4-9254348ea72d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75229) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 09:44:26 user nova-compute[75229]: WARNING nova.virt.libvirt.driver [None req-5ebcc9ee-2955-4be7-9636-bccac98f0e53 tempest-TaggedAttachmentsTest-294727221 tempest-TaggedAttachmentsTest-294727221-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 09:44:26 user nova-compute[75229]: WARNING nova.virt.libvirt.driver [None req-5ebcc9ee-2955-4be7-9636-bccac98f0e53 tempest-TaggedAttachmentsTest-294727221 tempest-TaggedAttachmentsTest-294727221-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 09:44:26 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-4b4efe05-1866-4fb6-a793-a43ec7f6e933 tempest-TestVolumeSwap-528292061 tempest-TestVolumeSwap-528292061-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:44:26 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-4b4efe05-1866-4fb6-a793-a43ec7f6e933 tempest-TestVolumeSwap-528292061 tempest-TestVolumeSwap-528292061-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:44:26 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-5ebcc9ee-2955-4be7-9636-bccac98f0e53 tempest-TaggedAttachmentsTest-294727221 tempest-TaggedAttachmentsTest-294727221-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75229) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 09:44:26 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-5ebcc9ee-2955-4be7-9636-bccac98f0e53 tempest-TaggedAttachmentsTest-294727221 tempest-TaggedAttachmentsTest-294727221-project-member] CPU controller missing on host. {{(pid=75229) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 09:44:26 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-4b4efe05-1866-4fb6-a793-a43ec7f6e933 tempest-TestVolumeSwap-528292061 tempest-TestVolumeSwap-528292061-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75229) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 09:44:26 user nova-compute[75229]: INFO nova.compute.claims [None req-4b4efe05-1866-4fb6-a793-a43ec7f6e933 tempest-TestVolumeSwap-528292061 tempest-TestVolumeSwap-528292061-project-member] [instance: c307660b-01bb-471b-9e2e-5c2aaca65287] Claim successful on node user
Nov 14 09:44:26 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-5ebcc9ee-2955-4be7-9636-bccac98f0e53 tempest-TaggedAttachmentsTest-294727221 tempest-TaggedAttachmentsTest-294727221-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75229) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 09:44:26 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-5ebcc9ee-2955-4be7-9636-bccac98f0e53 tempest-TaggedAttachmentsTest-294727221 tempest-TaggedAttachmentsTest-294727221-project-member] CPU controller found on host. {{(pid=75229) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 09:44:26 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-5ebcc9ee-2955-4be7-9636-bccac98f0e53 tempest-TaggedAttachmentsTest-294727221 tempest-TaggedAttachmentsTest-294727221-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75229) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 09:44:26 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-5ebcc9ee-2955-4be7-9636-bccac98f0e53 tempest-TaggedAttachmentsTest-294727221 tempest-TaggedAttachmentsTest-294727221-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T09:39:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T09:40:10Z,direct_url=<?>,disk_format='qcow2',id=3bef8470-ecc7-40e3-95d4-9254348ea72d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='de5a91106b6948ed937a7178ff9464c4',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T09:40:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 09:44:26 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-5ebcc9ee-2955-4be7-9636-bccac98f0e53 tempest-TaggedAttachmentsTest-294727221 tempest-TaggedAttachmentsTest-294727221-project-member] Flavor limits 0:0:0 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 09:44:26 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-5ebcc9ee-2955-4be7-9636-bccac98f0e53 tempest-TaggedAttachmentsTest-294727221 tempest-TaggedAttachmentsTest-294727221-project-member] Image limits 0:0:0 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 09:44:26 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-5ebcc9ee-2955-4be7-9636-bccac98f0e53 tempest-TaggedAttachmentsTest-294727221 tempest-TaggedAttachmentsTest-294727221-project-member] Flavor pref 0:0:0 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 09:44:26 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-5ebcc9ee-2955-4be7-9636-bccac98f0e53 tempest-TaggedAttachmentsTest-294727221 tempest-TaggedAttachmentsTest-294727221-project-member] Image pref 0:0:0 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 09:44:26 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-5ebcc9ee-2955-4be7-9636-bccac98f0e53 tempest-TaggedAttachmentsTest-294727221 tempest-TaggedAttachmentsTest-294727221-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 09:44:26 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-5ebcc9ee-2955-4be7-9636-bccac98f0e53 tempest-TaggedAttachmentsTest-294727221 tempest-TaggedAttachmentsTest-294727221-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 09:44:26 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-5ebcc9ee-2955-4be7-9636-bccac98f0e53 tempest-TaggedAttachmentsTest-294727221 tempest-TaggedAttachmentsTest-294727221-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75229) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 09:44:26 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-5ebcc9ee-2955-4be7-9636-bccac98f0e53 tempest-TaggedAttachmentsTest-294727221 tempest-TaggedAttachmentsTest-294727221-project-member] Got 1 possible topologies {{(pid=75229) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 09:44:26 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-5ebcc9ee-2955-4be7-9636-bccac98f0e53 tempest-TaggedAttachmentsTest-294727221 tempest-TaggedAttachmentsTest-294727221-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 09:44:26 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-5ebcc9ee-2955-4be7-9636-bccac98f0e53 tempest-TaggedAttachmentsTest-294727221 tempest-TaggedAttachmentsTest-294727221-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 09:44:27 user nova-compute[75229]: DEBUG nova.virt.libvirt.vif [None req-5ebcc9ee-2955-4be7-9636-bccac98f0e53 tempest-TaggedAttachmentsTest-294727221 tempest-TaggedAttachmentsTest-294727221-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T09:44:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-685697079',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-685697079',id=8,image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAifCLOp7slCaJ90vuibP3D+iXI5GZCQPZCKwFW7R+vCvd5TEqQRxmD+LKPc4egtvjclTc91I+Ts0vc0Y63gnivit1SN7n4OIcVVjbAdupwqjax2fqD52aMGKY+5S2775A==',key_name='tempest-keypair-1995790410',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='48b5edeee7494b6e94135faaab6afd50',ramdisk_id='',reservation_id='r-xsfhi8mn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-294727221',owner_user_name='tempest-TaggedAttachmentsTest-294727221-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T09:44:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3c818850ce5c41b5b978031cdedfea65',uuid=c6fa2298-7111-4660-a162-09269045d5e3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b310b3f2-f842-4918-8540-f9803e259b31", "address": "fa:16:3e:90:0c:ec", "network": {"id": "35508221-011f-4deb-81a1-6dfdae3f2375", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-827518066-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48b5edeee7494b6e94135faaab6afd50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb310b3f2-f8", "ovs_interfaceid": "b310b3f2-f842-4918-8540-f9803e259b31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75229) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 09:44:27 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-5ebcc9ee-2955-4be7-9636-bccac98f0e53 tempest-TaggedAttachmentsTest-294727221 tempest-TaggedAttachmentsTest-294727221-project-member] Converting VIF {"id": "b310b3f2-f842-4918-8540-f9803e259b31", "address": "fa:16:3e:90:0c:ec", "network": {"id": "35508221-011f-4deb-81a1-6dfdae3f2375", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-827518066-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48b5edeee7494b6e94135faaab6afd50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb310b3f2-f8", "ovs_interfaceid": "b310b3f2-f842-4918-8540-f9803e259b31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 09:44:27 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-5ebcc9ee-2955-4be7-9636-bccac98f0e53 tempest-TaggedAttachmentsTest-294727221 tempest-TaggedAttachmentsTest-294727221-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:90:0c:ec,bridge_name='br-int',has_traffic_filtering=True,id=b310b3f2-f842-4918-8540-f9803e259b31,network=Network(35508221-011f-4deb-81a1-6dfdae3f2375),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb310b3f2-f8') {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 09:44:27 user nova-compute[75229]: DEBUG nova.objects.instance [None req-5ebcc9ee-2955-4be7-9636-bccac98f0e53 tempest-TaggedAttachmentsTest-294727221 tempest-TaggedAttachmentsTest-294727221-project-member] Lazy-loading 'pci_devices' on Instance uuid c6fa2298-7111-4660-a162-09269045d5e3 {{(pid=75229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 09:44:27 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-5ebcc9ee-2955-4be7-9636-bccac98f0e53 tempest-TaggedAttachmentsTest-294727221 tempest-TaggedAttachmentsTest-294727221-project-member] [instance: c6fa2298-7111-4660-a162-09269045d5e3] End _get_guest_xml xml=<domain type="kvm">
Nov 14 09:44:27 user nova-compute[75229]:   <uuid>c6fa2298-7111-4660-a162-09269045d5e3</uuid>
Nov 14 09:44:27 user nova-compute[75229]:   <name>instance-00000008</name>
Nov 14 09:44:27 user nova-compute[75229]:   <memory>524288</memory>
Nov 14 09:44:27 user nova-compute[75229]:   <vcpu>1</vcpu>
Nov 14 09:44:27 user nova-compute[75229]:   <metadata>
Nov 14 09:44:27 user nova-compute[75229]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 09:44:27 user nova-compute[75229]:       <nova:package version="0.0.0"/>
Nov 14 09:44:27 user nova-compute[75229]:       <nova:name>tempest-device-tagging-server-685697079</nova:name>
Nov 14 09:44:27 user nova-compute[75229]:       <nova:creationTime>2023-11-14 09:44:26</nova:creationTime>
Nov 14 09:44:27 user nova-compute[75229]:       <nova:flavor name="m1.tiny">
Nov 14 09:44:27 user nova-compute[75229]:         <nova:memory>512</nova:memory>
Nov 14 09:44:27 user nova-compute[75229]:         <nova:disk>1</nova:disk>
Nov 14 09:44:27 user nova-compute[75229]:         <nova:swap>0</nova:swap>
Nov 14 09:44:27 user nova-compute[75229]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 09:44:27 user nova-compute[75229]:         <nova:vcpus>1</nova:vcpus>
Nov 14 09:44:27 user nova-compute[75229]:       </nova:flavor>
Nov 14 09:44:27 user nova-compute[75229]:       <nova:owner>
Nov 14 09:44:27 user nova-compute[75229]:         <nova:user uuid="3c818850ce5c41b5b978031cdedfea65">tempest-TaggedAttachmentsTest-294727221-project-member</nova:user>
Nov 14 09:44:27 user nova-compute[75229]:         <nova:project uuid="48b5edeee7494b6e94135faaab6afd50">tempest-TaggedAttachmentsTest-294727221</nova:project>
Nov 14 09:44:27 user nova-compute[75229]:       </nova:owner>
Nov 14 09:44:27 user nova-compute[75229]:       <nova:root type="image" uuid="3bef8470-ecc7-40e3-95d4-9254348ea72d"/>
Nov 14 09:44:27 user nova-compute[75229]:       <nova:ports>
Nov 14 09:44:27 user nova-compute[75229]:         <nova:port uuid="b310b3f2-f842-4918-8540-f9803e259b31">
Nov 14 09:44:27 user nova-compute[75229]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 14 09:44:27 user nova-compute[75229]:         </nova:port>
Nov 14 09:44:27 user nova-compute[75229]:       </nova:ports>
Nov 14 09:44:27 user nova-compute[75229]:     </nova:instance>
Nov 14 09:44:27 user nova-compute[75229]:   </metadata>
Nov 14 09:44:27 user nova-compute[75229]:   <sysinfo type="smbios">
Nov 14 09:44:27 user nova-compute[75229]:     <system>
Nov 14 09:44:27 user nova-compute[75229]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 09:44:27 user nova-compute[75229]:       <entry name="product">OpenStack Nova</entry>
Nov 14 09:44:27 user nova-compute[75229]:       <entry name="version">0.0.0</entry>
Nov 14 09:44:27 user nova-compute[75229]:       <entry name="serial">c6fa2298-7111-4660-a162-09269045d5e3</entry>
Nov 14 09:44:27 user nova-compute[75229]:       <entry name="uuid">c6fa2298-7111-4660-a162-09269045d5e3</entry>
Nov 14 09:44:27 user nova-compute[75229]:       <entry name="family">Virtual Machine</entry>
Nov 14 09:44:27 user nova-compute[75229]:     </system>
Nov 14 09:44:27 user nova-compute[75229]:   </sysinfo>
Nov 14 09:44:27 user nova-compute[75229]:   <os>
Nov 14 09:44:27 user nova-compute[75229]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 09:44:27 user nova-compute[75229]:     <boot dev="hd"/>
Nov 14 09:44:27 user nova-compute[75229]:     <smbios mode="sysinfo"/>
Nov 14 09:44:27 user nova-compute[75229]:   </os>
Nov 14 09:44:27 user nova-compute[75229]:   <features>
Nov 14 09:44:27 user nova-compute[75229]:     <acpi/>
Nov 14 09:44:27 user nova-compute[75229]:     <apic/>
Nov 14 09:44:27 user nova-compute[75229]:     <vmcoreinfo/>
Nov 14 09:44:27 user nova-compute[75229]:   </features>
Nov 14 09:44:27 user nova-compute[75229]:   <clock offset="utc">
Nov 14 09:44:27 user nova-compute[75229]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 09:44:27 user nova-compute[75229]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 09:44:27 user nova-compute[75229]:     <timer name="hpet" present="no"/>
Nov 14 09:44:27 user nova-compute[75229]:   </clock>
Nov 14 09:44:27 user nova-compute[75229]:   <cpu mode="custom" match="exact">
Nov 14 09:44:27 user nova-compute[75229]:     <model>Nehalem</model>
Nov 14 09:44:27 user nova-compute[75229]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 09:44:27 user nova-compute[75229]:   </cpu>
Nov 14 09:44:27 user nova-compute[75229]:   <devices>
Nov 14 09:44:27 user nova-compute[75229]:     <disk type="file" device="disk">
Nov 14 09:44:27 user nova-compute[75229]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 09:44:27 user nova-compute[75229]:       <source file="/opt/stack/data/nova/instances/c6fa2298-7111-4660-a162-09269045d5e3/disk"/>
Nov 14 09:44:27 user nova-compute[75229]:       <target dev="vda" bus="virtio"/>
Nov 14 09:44:27 user nova-compute[75229]:     </disk>
Nov 14 09:44:27 user nova-compute[75229]:     <disk type="file" device="cdrom">
Nov 14 09:44:27 user nova-compute[75229]:       <driver name="qemu" type="raw" cache="none"/>
Nov 14 09:44:27 user nova-compute[75229]:       <source file="/opt/stack/data/nova/instances/c6fa2298-7111-4660-a162-09269045d5e3/disk.config"/>
Nov 14 09:44:27 user nova-compute[75229]:       <target dev="hda" bus="ide"/>
Nov 14 09:44:27 user nova-compute[75229]:     </disk>
Nov 14 09:44:27 user nova-compute[75229]:     <interface type="ethernet">
Nov 14 09:44:27 user nova-compute[75229]:       <mac address="fa:16:3e:90:0c:ec"/>
Nov 14 09:44:27 user nova-compute[75229]:       <model type="virtio"/>
Nov 14 09:44:27 user nova-compute[75229]:       <mtu size="1442"/>
Nov 14 09:44:27 user nova-compute[75229]:       <target dev="tapb310b3f2-f8"/>
Nov 14 09:44:27 user nova-compute[75229]:     </interface>
Nov 14 09:44:27 user nova-compute[75229]:     <serial type="pty">
Nov 14 09:44:27 user nova-compute[75229]:       <log file="/opt/stack/data/nova/instances/c6fa2298-7111-4660-a162-09269045d5e3/console.log" append="off"/>
Nov 14 09:44:27 user nova-compute[75229]:     </serial>
Nov 14 09:44:27 user nova-compute[75229]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 09:44:27 user nova-compute[75229]:     <video>
Nov 14 09:44:27 user nova-compute[75229]:       <model type="virtio"/>
Nov 14 09:44:27 user nova-compute[75229]:     </video>
Nov 14 09:44:27 user nova-compute[75229]:     <rng model="virtio">
Nov 14 09:44:27 user nova-compute[75229]:       <backend model="random">/dev/urandom</backend>
Nov 14 09:44:27 user nova-compute[75229]:     </rng>
Nov 14 09:44:27 user nova-compute[75229]:     <controller type="usb" index="0" model="none"/>
Nov 14 09:44:27 user nova-compute[75229]:     <memballoon model="virtio">
Nov 14 09:44:27 user nova-compute[75229]:       <stats period="10"/>
Nov 14 09:44:27 user nova-compute[75229]:     </memballoon>
Nov 14 09:44:27 user nova-compute[75229]:   </devices>
Nov 14 09:44:27 user nova-compute[75229]: </domain>
Nov 14 09:44:27 user nova-compute[75229]:  {{(pid=75229) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 09:44:27 user nova-compute[75229]: DEBUG nova.virt.libvirt.vif [None req-5ebcc9ee-2955-4be7-9636-bccac98f0e53 tempest-TaggedAttachmentsTest-294727221 tempest-TaggedAttachmentsTest-294727221-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T09:44:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-685697079',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-685697079',id=8,image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAifCLOp7slCaJ90vuibP3D+iXI5GZCQPZCKwFW7R+vCvd5TEqQRxmD+LKPc4egtvjclTc91I+Ts0vc0Y63gnivit1SN7n4OIcVVjbAdupwqjax2fqD52aMGKY+5S2775A==',key_name='tempest-keypair-1995790410',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='48b5edeee7494b6e94135faaab6afd50',ramdisk_id='',reservation_id='r-xsfhi8mn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-294727221',owner_user_name='tempest-TaggedAttachmentsTest-294727221-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T09:44:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3c818850ce5c41b5b978031cdedfea65',uuid=c6fa2298-7111-4660-a162-09269045d5e3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b310b3f2-f842-4918-8540-f9803e259b31", "address": "fa:16:3e:90:0c:ec", "network": {"id": "35508221-011f-4deb-81a1-6dfdae3f2375", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-827518066-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48b5edeee7494b6e94135faaab6afd50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb310b3f2-f8", "ovs_interfaceid": "b310b3f2-f842-4918-8540-f9803e259b31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 09:44:27 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-5ebcc9ee-2955-4be7-9636-bccac98f0e53 tempest-TaggedAttachmentsTest-294727221 tempest-TaggedAttachmentsTest-294727221-project-member] Converting VIF {"id": "b310b3f2-f842-4918-8540-f9803e259b31", "address": "fa:16:3e:90:0c:ec", "network": {"id": "35508221-011f-4deb-81a1-6dfdae3f2375", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-827518066-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48b5edeee7494b6e94135faaab6afd50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb310b3f2-f8", "ovs_interfaceid": "b310b3f2-f842-4918-8540-f9803e259b31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 09:44:27 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-5ebcc9ee-2955-4be7-9636-bccac98f0e53 tempest-TaggedAttachmentsTest-294727221 tempest-TaggedAttachmentsTest-294727221-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:90:0c:ec,bridge_name='br-int',has_traffic_filtering=True,id=b310b3f2-f842-4918-8540-f9803e259b31,network=Network(35508221-011f-4deb-81a1-6dfdae3f2375),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb310b3f2-f8') {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 09:44:27 user nova-compute[75229]: DEBUG os_vif [None req-5ebcc9ee-2955-4be7-9636-bccac98f0e53 tempest-TaggedAttachmentsTest-294727221 tempest-TaggedAttachmentsTest-294727221-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:90:0c:ec,bridge_name='br-int',has_traffic_filtering=True,id=b310b3f2-f842-4918-8540-f9803e259b31,network=Network(35508221-011f-4deb-81a1-6dfdae3f2375),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb310b3f2-f8') {{(pid=75229) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 09:44:27 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:44:27 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:44:27 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 09:44:27 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:44:27 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8f788527-c8fa-5a28-af39-c30cb7937176', '_type': 'linux-noop'}}, row=False) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:44:27 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:44:27 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 09:44:27 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:44:27 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb310b3f2-f8, may_exist=True, interface_attrs={}) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:44:27 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb310b3f2-f8, col_values=(('qos', UUID('3b8c85a3-d9d4-441c-b83e-26e98bd65996')),), if_exists=True) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:44:27 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb310b3f2-f8, col_values=(('external_ids', {'iface-id': 'b310b3f2-f842-4918-8540-f9803e259b31', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:90:0c:ec', 'vm-uuid': 'c6fa2298-7111-4660-a162-09269045d5e3'}),), if_exists=True) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:44:27 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:44:27 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 09:44:27 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:44:27 user nova-compute[75229]: INFO os_vif [None req-5ebcc9ee-2955-4be7-9636-bccac98f0e53 tempest-TaggedAttachmentsTest-294727221 tempest-TaggedAttachmentsTest-294727221-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:90:0c:ec,bridge_name='br-int',has_traffic_filtering=True,id=b310b3f2-f842-4918-8540-f9803e259b31,network=Network(35508221-011f-4deb-81a1-6dfdae3f2375),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb310b3f2-f8')
Nov 14 09:44:27 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-5ebcc9ee-2955-4be7-9636-bccac98f0e53 tempest-TaggedAttachmentsTest-294727221 tempest-TaggedAttachmentsTest-294727221-project-member] No BDM found with device name vda, not building metadata. {{(pid=75229) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 09:44:27 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-5ebcc9ee-2955-4be7-9636-bccac98f0e53 tempest-TaggedAttachmentsTest-294727221 tempest-TaggedAttachmentsTest-294727221-project-member] No BDM found with device name hda, not building metadata. {{(pid=75229) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 09:44:27 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-5ebcc9ee-2955-4be7-9636-bccac98f0e53 tempest-TaggedAttachmentsTest-294727221 tempest-TaggedAttachmentsTest-294727221-project-member] No VIF found with MAC fa:16:3e:90:0c:ec, not building metadata {{(pid=75229) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 09:44:27 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-5ebcc9ee-2955-4be7-9636-bccac98f0e53 tempest-TaggedAttachmentsTest-294727221 tempest-TaggedAttachmentsTest-294727221-project-member] [instance: c6fa2298-7111-4660-a162-09269045d5e3] Using config drive
Nov 14 09:44:27 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:44:27 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-5ebcc9ee-2955-4be7-9636-bccac98f0e53 tempest-TaggedAttachmentsTest-294727221 tempest-TaggedAttachmentsTest-294727221-project-member] [instance: c6fa2298-7111-4660-a162-09269045d5e3] Creating config drive at /opt/stack/data/nova/instances/c6fa2298-7111-4660-a162-09269045d5e3/disk.config
Nov 14 09:44:27 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-5ebcc9ee-2955-4be7-9636-bccac98f0e53 tempest-TaggedAttachmentsTest-294727221 tempest-TaggedAttachmentsTest-294727221-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/c6fa2298-7111-4660-a162-09269045d5e3/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp7ftxfe1q {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:44:27 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-5ebcc9ee-2955-4be7-9636-bccac98f0e53 tempest-TaggedAttachmentsTest-294727221 tempest-TaggedAttachmentsTest-294727221-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/c6fa2298-7111-4660-a162-09269045d5e3/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp7ftxfe1q" returned: 0 in 0.075s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:44:27 user nova-compute[75229]: DEBUG nova.compute.provider_tree [None req-4b4efe05-1866-4fb6-a793-a43ec7f6e933 tempest-TestVolumeSwap-528292061 tempest-TestVolumeSwap-528292061-project-member] Inventory has not changed in ProviderTree for provider: d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 {{(pid=75229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 09:44:27 user nova-compute[75229]: DEBUG nova.network.neutron [req-e3a1ac50-f234-4bf1-87c6-0cf673a2f4d2 req-8df56ca3-c2cc-44a7-bb2d-734720437223 service nova] [instance: c6fa2298-7111-4660-a162-09269045d5e3] Updated VIF entry in instance network info cache for port b310b3f2-f842-4918-8540-f9803e259b31. {{(pid=75229) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 09:44:27 user nova-compute[75229]: DEBUG nova.network.neutron [req-e3a1ac50-f234-4bf1-87c6-0cf673a2f4d2 req-8df56ca3-c2cc-44a7-bb2d-734720437223 service nova] [instance: c6fa2298-7111-4660-a162-09269045d5e3] Updating instance_info_cache with network_info: [{"id": "b310b3f2-f842-4918-8540-f9803e259b31", "address": "fa:16:3e:90:0c:ec", "network": {"id": "35508221-011f-4deb-81a1-6dfdae3f2375", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-827518066-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48b5edeee7494b6e94135faaab6afd50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb310b3f2-f8", "ovs_interfaceid": "b310b3f2-f842-4918-8540-f9803e259b31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 09:44:27 user nova-compute[75229]: DEBUG nova.scheduler.client.report [None req-4b4efe05-1866-4fb6-a793-a43ec7f6e933 tempest-TestVolumeSwap-528292061 tempest-TestVolumeSwap-528292061-project-member] Inventory has not changed for provider d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 09:44:27 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-e3a1ac50-f234-4bf1-87c6-0cf673a2f4d2 req-8df56ca3-c2cc-44a7-bb2d-734720437223 service nova] Releasing lock "refresh_cache-c6fa2298-7111-4660-a162-09269045d5e3" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 09:44:28 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-4b4efe05-1866-4fb6-a793-a43ec7f6e933 tempest-TestVolumeSwap-528292061 tempest-TestVolumeSwap-528292061-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.128s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:44:28 user nova-compute[75229]: DEBUG nova.compute.manager [None req-4b4efe05-1866-4fb6-a793-a43ec7f6e933 tempest-TestVolumeSwap-528292061 tempest-TestVolumeSwap-528292061-project-member] [instance: c307660b-01bb-471b-9e2e-5c2aaca65287] Start building networks asynchronously for instance. {{(pid=75229) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 09:44:28 user nova-compute[75229]: DEBUG nova.compute.manager [None req-4b4efe05-1866-4fb6-a793-a43ec7f6e933 tempest-TestVolumeSwap-528292061 tempest-TestVolumeSwap-528292061-project-member] [instance: c307660b-01bb-471b-9e2e-5c2aaca65287] Allocating IP information in the background. {{(pid=75229) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 09:44:28 user nova-compute[75229]: DEBUG nova.network.neutron [None req-4b4efe05-1866-4fb6-a793-a43ec7f6e933 tempest-TestVolumeSwap-528292061 tempest-TestVolumeSwap-528292061-project-member] [instance: c307660b-01bb-471b-9e2e-5c2aaca65287] allocate_for_instance() {{(pid=75229) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 09:44:28 user nova-compute[75229]: DEBUG nova.compute.manager [None req-93623460-a8e7-4988-9cd4-ee89abad768c tempest-AttachSCSIVolumeTestJSON-982350058 tempest-AttachSCSIVolumeTestJSON-982350058-project-member] [instance: 37e63bd9-44fc-4d07-b31b-570f69d7bc8a] Instance event wait completed in 0 seconds for  {{(pid=75229) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 09:44:28 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-93623460-a8e7-4988-9cd4-ee89abad768c tempest-AttachSCSIVolumeTestJSON-982350058 tempest-AttachSCSIVolumeTestJSON-982350058-project-member] [instance: 37e63bd9-44fc-4d07-b31b-570f69d7bc8a] Guest created on hypervisor {{(pid=75229) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 09:44:28 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-4b4efe05-1866-4fb6-a793-a43ec7f6e933 tempest-TestVolumeSwap-528292061 tempest-TestVolumeSwap-528292061-project-member] [instance: c307660b-01bb-471b-9e2e-5c2aaca65287] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 09:44:28 user nova-compute[75229]: INFO nova.virt.libvirt.driver [-] [instance: 37e63bd9-44fc-4d07-b31b-570f69d7bc8a] Instance spawned successfully.
Nov 14 09:44:28 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-93623460-a8e7-4988-9cd4-ee89abad768c tempest-AttachSCSIVolumeTestJSON-982350058 tempest-AttachSCSIVolumeTestJSON-982350058-project-member] [instance: 37e63bd9-44fc-4d07-b31b-570f69d7bc8a] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 09:44:28 user nova-compute[75229]: DEBUG nova.compute.manager [None req-4b4efe05-1866-4fb6-a793-a43ec7f6e933 tempest-TestVolumeSwap-528292061 tempest-TestVolumeSwap-528292061-project-member] [instance: c307660b-01bb-471b-9e2e-5c2aaca65287] Start building block device mappings for instance. {{(pid=75229) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 09:44:28 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-93623460-a8e7-4988-9cd4-ee89abad768c tempest-AttachSCSIVolumeTestJSON-982350058 tempest-AttachSCSIVolumeTestJSON-982350058-project-member] [instance: 37e63bd9-44fc-4d07-b31b-570f69d7bc8a] Found default for hw_input_bus of None {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 09:44:28 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-93623460-a8e7-4988-9cd4-ee89abad768c tempest-AttachSCSIVolumeTestJSON-982350058 tempest-AttachSCSIVolumeTestJSON-982350058-project-member] [instance: 37e63bd9-44fc-4d07-b31b-570f69d7bc8a] Found default for hw_pointer_model of None {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 09:44:28 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-93623460-a8e7-4988-9cd4-ee89abad768c tempest-AttachSCSIVolumeTestJSON-982350058 tempest-AttachSCSIVolumeTestJSON-982350058-project-member] [instance: 37e63bd9-44fc-4d07-b31b-570f69d7bc8a] Found default for hw_video_model of virtio {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 09:44:28 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-93623460-a8e7-4988-9cd4-ee89abad768c tempest-AttachSCSIVolumeTestJSON-982350058 tempest-AttachSCSIVolumeTestJSON-982350058-project-member] [instance: 37e63bd9-44fc-4d07-b31b-570f69d7bc8a] Found default for hw_vif_model of virtio {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 09:44:28 user nova-compute[75229]: DEBUG nova.policy [None req-4b4efe05-1866-4fb6-a793-a43ec7f6e933 tempest-TestVolumeSwap-528292061 tempest-TestVolumeSwap-528292061-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ef184ea38ecc4d9abe88fb7f6f79a1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f5ecf574b4a4b8bb0747c796c16e3e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75229) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 09:44:28 user nova-compute[75229]: INFO nova.compute.manager [None req-93623460-a8e7-4988-9cd4-ee89abad768c tempest-AttachSCSIVolumeTestJSON-982350058 tempest-AttachSCSIVolumeTestJSON-982350058-project-member] [instance: 37e63bd9-44fc-4d07-b31b-570f69d7bc8a] Took 14.03 seconds to spawn the instance on the hypervisor.
Nov 14 09:44:28 user nova-compute[75229]: DEBUG nova.compute.manager [None req-93623460-a8e7-4988-9cd4-ee89abad768c tempest-AttachSCSIVolumeTestJSON-982350058 tempest-AttachSCSIVolumeTestJSON-982350058-project-member] [instance: 37e63bd9-44fc-4d07-b31b-570f69d7bc8a] Checking state {{(pid=75229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 09:44:28 user nova-compute[75229]: DEBUG nova.compute.manager [None req-4b4efe05-1866-4fb6-a793-a43ec7f6e933 tempest-TestVolumeSwap-528292061 tempest-TestVolumeSwap-528292061-project-member] [instance: c307660b-01bb-471b-9e2e-5c2aaca65287] Start spawning the instance on the hypervisor. {{(pid=75229) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 09:44:28 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-4b4efe05-1866-4fb6-a793-a43ec7f6e933 tempest-TestVolumeSwap-528292061 tempest-TestVolumeSwap-528292061-project-member] [instance: c307660b-01bb-471b-9e2e-5c2aaca65287] Creating instance directory {{(pid=75229) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 09:44:28 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-4b4efe05-1866-4fb6-a793-a43ec7f6e933 tempest-TestVolumeSwap-528292061 tempest-TestVolumeSwap-528292061-project-member] [instance: c307660b-01bb-471b-9e2e-5c2aaca65287] Creating image(s)
Nov 14 09:44:28 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-4b4efe05-1866-4fb6-a793-a43ec7f6e933 tempest-TestVolumeSwap-528292061 tempest-TestVolumeSwap-528292061-project-member] Acquiring lock "/opt/stack/data/nova/instances/c307660b-01bb-471b-9e2e-5c2aaca65287/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:44:28 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-4b4efe05-1866-4fb6-a793-a43ec7f6e933 tempest-TestVolumeSwap-528292061 tempest-TestVolumeSwap-528292061-project-member] Lock "/opt/stack/data/nova/instances/c307660b-01bb-471b-9e2e-5c2aaca65287/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:44:28 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-4b4efe05-1866-4fb6-a793-a43ec7f6e933 tempest-TestVolumeSwap-528292061 tempest-TestVolumeSwap-528292061-project-member] Lock "/opt/stack/data/nova/instances/c307660b-01bb-471b-9e2e-5c2aaca65287/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:44:28 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-4b4efe05-1866-4fb6-a793-a43ec7f6e933 tempest-TestVolumeSwap-528292061 tempest-TestVolumeSwap-528292061-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6 --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:44:28 user nova-compute[75229]: INFO nova.compute.manager [None req-93623460-a8e7-4988-9cd4-ee89abad768c tempest-AttachSCSIVolumeTestJSON-982350058 tempest-AttachSCSIVolumeTestJSON-982350058-project-member] [instance: 37e63bd9-44fc-4d07-b31b-570f69d7bc8a] Took 15.57 seconds to build instance.
Nov 14 09:44:28 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-4b4efe05-1866-4fb6-a793-a43ec7f6e933 tempest-TestVolumeSwap-528292061 tempest-TestVolumeSwap-528292061-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6 --force-share --output=json" returned: 0 in 0.234s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:44:28 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-4b4efe05-1866-4fb6-a793-a43ec7f6e933 tempest-TestVolumeSwap-528292061 tempest-TestVolumeSwap-528292061-project-member] Acquiring lock "4f30e3fe703d2381679612a57b1fb80a467f60b6" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:44:28 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-4b4efe05-1866-4fb6-a793-a43ec7f6e933 tempest-TestVolumeSwap-528292061 tempest-TestVolumeSwap-528292061-project-member] Lock "4f30e3fe703d2381679612a57b1fb80a467f60b6" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:44:28 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-4b4efe05-1866-4fb6-a793-a43ec7f6e933 tempest-TestVolumeSwap-528292061 tempest-TestVolumeSwap-528292061-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6 --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:44:28 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-93623460-a8e7-4988-9cd4-ee89abad768c tempest-AttachSCSIVolumeTestJSON-982350058 tempest-AttachSCSIVolumeTestJSON-982350058-project-member] Lock "37e63bd9-44fc-4d07-b31b-570f69d7bc8a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.884s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:44:29 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-4b4efe05-1866-4fb6-a793-a43ec7f6e933 tempest-TestVolumeSwap-528292061 tempest-TestVolumeSwap-528292061-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6 --force-share --output=json" returned: 0 in 0.203s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:44:29 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-4b4efe05-1866-4fb6-a793-a43ec7f6e933 tempest-TestVolumeSwap-528292061 tempest-TestVolumeSwap-528292061-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6,backing_fmt=raw /opt/stack/data/nova/instances/c307660b-01bb-471b-9e2e-5c2aaca65287/disk 1073741824 {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:44:29 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-4b4efe05-1866-4fb6-a793-a43ec7f6e933 tempest-TestVolumeSwap-528292061 tempest-TestVolumeSwap-528292061-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6,backing_fmt=raw /opt/stack/data/nova/instances/c307660b-01bb-471b-9e2e-5c2aaca65287/disk 1073741824" returned: 0 in 0.076s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:44:29 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-4b4efe05-1866-4fb6-a793-a43ec7f6e933 tempest-TestVolumeSwap-528292061 tempest-TestVolumeSwap-528292061-project-member] Lock "4f30e3fe703d2381679612a57b1fb80a467f60b6" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.288s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:44:29 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-4b4efe05-1866-4fb6-a793-a43ec7f6e933 tempest-TestVolumeSwap-528292061 tempest-TestVolumeSwap-528292061-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6 --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:44:29 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-429dcfc7-1e9b-4657-9420-6a93f2309c0d tempest-VolumesActionsTest-433219387 tempest-VolumesActionsTest-433219387-project-member] Acquiring lock "c9d3e03d-be75-44b1-97b4-36c13715175b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:44:29 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-429dcfc7-1e9b-4657-9420-6a93f2309c0d tempest-VolumesActionsTest-433219387 tempest-VolumesActionsTest-433219387-project-member] Lock "c9d3e03d-be75-44b1-97b4-36c13715175b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:44:29 user nova-compute[75229]: DEBUG nova.compute.manager [None req-429dcfc7-1e9b-4657-9420-6a93f2309c0d tempest-VolumesActionsTest-433219387 tempest-VolumesActionsTest-433219387-project-member] [instance: c9d3e03d-be75-44b1-97b4-36c13715175b] Starting instance... {{(pid=75229) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 09:44:29 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:44:29 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:44:29 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:44:29 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-4b4efe05-1866-4fb6-a793-a43ec7f6e933 tempest-TestVolumeSwap-528292061 tempest-TestVolumeSwap-528292061-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6 --force-share --output=json" returned: 0 in 0.225s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:44:29 user nova-compute[75229]: DEBUG nova.virt.disk.api [None req-4b4efe05-1866-4fb6-a793-a43ec7f6e933 tempest-TestVolumeSwap-528292061 tempest-TestVolumeSwap-528292061-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c307660b-01bb-471b-9e2e-5c2aaca65287/disk. size=1073741824 {{(pid=75229) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 09:44:29 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-4b4efe05-1866-4fb6-a793-a43ec7f6e933 tempest-TestVolumeSwap-528292061 tempest-TestVolumeSwap-528292061-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c307660b-01bb-471b-9e2e-5c2aaca65287/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:44:29 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-429dcfc7-1e9b-4657-9420-6a93f2309c0d tempest-VolumesActionsTest-433219387 tempest-VolumesActionsTest-433219387-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:44:29 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-429dcfc7-1e9b-4657-9420-6a93f2309c0d tempest-VolumesActionsTest-433219387 tempest-VolumesActionsTest-433219387-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:44:29 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-429dcfc7-1e9b-4657-9420-6a93f2309c0d tempest-VolumesActionsTest-433219387 tempest-VolumesActionsTest-433219387-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75229) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 09:44:29 user nova-compute[75229]: INFO nova.compute.claims [None req-429dcfc7-1e9b-4657-9420-6a93f2309c0d tempest-VolumesActionsTest-433219387 tempest-VolumesActionsTest-433219387-project-member] [instance: c9d3e03d-be75-44b1-97b4-36c13715175b] Claim successful on node user
Nov 14 09:44:29 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-4b4efe05-1866-4fb6-a793-a43ec7f6e933 tempest-TestVolumeSwap-528292061 tempest-TestVolumeSwap-528292061-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c307660b-01bb-471b-9e2e-5c2aaca65287/disk --force-share --output=json" returned: 0 in 0.250s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:44:29 user nova-compute[75229]: DEBUG nova.virt.disk.api [None req-4b4efe05-1866-4fb6-a793-a43ec7f6e933 tempest-TestVolumeSwap-528292061 tempest-TestVolumeSwap-528292061-project-member] Cannot resize image /opt/stack/data/nova/instances/c307660b-01bb-471b-9e2e-5c2aaca65287/disk to a smaller size. {{(pid=75229) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 09:44:29 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-4b4efe05-1866-4fb6-a793-a43ec7f6e933 tempest-TestVolumeSwap-528292061 tempest-TestVolumeSwap-528292061-project-member] [instance: c307660b-01bb-471b-9e2e-5c2aaca65287] Created local disks {{(pid=75229) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 09:44:29 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-4b4efe05-1866-4fb6-a793-a43ec7f6e933 tempest-TestVolumeSwap-528292061 tempest-TestVolumeSwap-528292061-project-member] [instance: c307660b-01bb-471b-9e2e-5c2aaca65287] Ensure instance console log exists: /opt/stack/data/nova/instances/c307660b-01bb-471b-9e2e-5c2aaca65287/console.log {{(pid=75229) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 09:44:29 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-4b4efe05-1866-4fb6-a793-a43ec7f6e933 tempest-TestVolumeSwap-528292061 tempest-TestVolumeSwap-528292061-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:44:29 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-4b4efe05-1866-4fb6-a793-a43ec7f6e933 tempest-TestVolumeSwap-528292061 tempest-TestVolumeSwap-528292061-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:44:29 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-4b4efe05-1866-4fb6-a793-a43ec7f6e933 tempest-TestVolumeSwap-528292061 tempest-TestVolumeSwap-528292061-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:44:29 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:44:29 user nova-compute[75229]: DEBUG nova.network.neutron [None req-4b4efe05-1866-4fb6-a793-a43ec7f6e933 tempest-TestVolumeSwap-528292061 tempest-TestVolumeSwap-528292061-project-member] [instance: c307660b-01bb-471b-9e2e-5c2aaca65287] Successfully created port: 8e8a8e12-6ca8-4657-a4d4-e11c02ee8fa4 {{(pid=75229) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 09:44:30 user nova-compute[75229]: DEBUG nova.compute.provider_tree [None req-429dcfc7-1e9b-4657-9420-6a93f2309c0d tempest-VolumesActionsTest-433219387 tempest-VolumesActionsTest-433219387-project-member] Inventory has not changed in ProviderTree for provider: d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 {{(pid=75229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 09:44:30 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:44:30 user nova-compute[75229]: DEBUG nova.scheduler.client.report [None req-429dcfc7-1e9b-4657-9420-6a93f2309c0d tempest-VolumesActionsTest-433219387 tempest-VolumesActionsTest-433219387-project-member] Inventory has not changed for provider d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 09:44:30 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:44:30 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-429dcfc7-1e9b-4657-9420-6a93f2309c0d tempest-VolumesActionsTest-433219387 tempest-VolumesActionsTest-433219387-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.881s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:44:30 user nova-compute[75229]: DEBUG nova.compute.manager [None req-429dcfc7-1e9b-4657-9420-6a93f2309c0d tempest-VolumesActionsTest-433219387 tempest-VolumesActionsTest-433219387-project-member] [instance: c9d3e03d-be75-44b1-97b4-36c13715175b] Start building networks asynchronously for instance. {{(pid=75229) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 09:44:30 user nova-compute[75229]: DEBUG nova.compute.manager [None req-429dcfc7-1e9b-4657-9420-6a93f2309c0d tempest-VolumesActionsTest-433219387 tempest-VolumesActionsTest-433219387-project-member] [instance: c9d3e03d-be75-44b1-97b4-36c13715175b] Allocating IP information in the background. {{(pid=75229) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 09:44:30 user nova-compute[75229]: DEBUG nova.network.neutron [None req-429dcfc7-1e9b-4657-9420-6a93f2309c0d tempest-VolumesActionsTest-433219387 tempest-VolumesActionsTest-433219387-project-member] [instance: c9d3e03d-be75-44b1-97b4-36c13715175b] allocate_for_instance() {{(pid=75229) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 09:44:30 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-429dcfc7-1e9b-4657-9420-6a93f2309c0d tempest-VolumesActionsTest-433219387 tempest-VolumesActionsTest-433219387-project-member] [instance: c9d3e03d-be75-44b1-97b4-36c13715175b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 09:44:30 user nova-compute[75229]: DEBUG nova.compute.manager [None req-429dcfc7-1e9b-4657-9420-6a93f2309c0d tempest-VolumesActionsTest-433219387 tempest-VolumesActionsTest-433219387-project-member] [instance: c9d3e03d-be75-44b1-97b4-36c13715175b] Start building block device mappings for instance. {{(pid=75229) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 09:44:30 user nova-compute[75229]: DEBUG nova.policy [None req-429dcfc7-1e9b-4657-9420-6a93f2309c0d tempest-VolumesActionsTest-433219387 tempest-VolumesActionsTest-433219387-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b5ab788c6eca4c208943024e9d9ecdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20105ee2c3b54e72a2733d4ae8521c85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75229) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 09:44:30 user nova-compute[75229]: DEBUG nova.network.neutron [None req-4b4efe05-1866-4fb6-a793-a43ec7f6e933 tempest-TestVolumeSwap-528292061 tempest-TestVolumeSwap-528292061-project-member] [instance: c307660b-01bb-471b-9e2e-5c2aaca65287] Successfully updated port: 8e8a8e12-6ca8-4657-a4d4-e11c02ee8fa4 {{(pid=75229) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 09:44:30 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-4b4efe05-1866-4fb6-a793-a43ec7f6e933 tempest-TestVolumeSwap-528292061 tempest-TestVolumeSwap-528292061-project-member] Acquiring lock "refresh_cache-c307660b-01bb-471b-9e2e-5c2aaca65287" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 09:44:30 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-4b4efe05-1866-4fb6-a793-a43ec7f6e933 tempest-TestVolumeSwap-528292061 tempest-TestVolumeSwap-528292061-project-member] Acquired lock "refresh_cache-c307660b-01bb-471b-9e2e-5c2aaca65287" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 09:44:30 user nova-compute[75229]: DEBUG nova.network.neutron [None req-4b4efe05-1866-4fb6-a793-a43ec7f6e933 tempest-TestVolumeSwap-528292061 tempest-TestVolumeSwap-528292061-project-member] [instance: c307660b-01bb-471b-9e2e-5c2aaca65287] Building network info cache for instance {{(pid=75229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 09:44:30 user nova-compute[75229]: DEBUG nova.compute.manager [req-619cdb70-1d2b-448b-8853-b0e9d3681326 req-06e99d5c-cd5d-4648-a2d2-6911d621e413 service nova] [instance: c307660b-01bb-471b-9e2e-5c2aaca65287] Received event network-changed-8e8a8e12-6ca8-4657-a4d4-e11c02ee8fa4 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:44:30 user nova-compute[75229]: DEBUG nova.compute.manager [req-619cdb70-1d2b-448b-8853-b0e9d3681326 req-06e99d5c-cd5d-4648-a2d2-6911d621e413 service nova] [instance: c307660b-01bb-471b-9e2e-5c2aaca65287] Refreshing instance network info cache due to event network-changed-8e8a8e12-6ca8-4657-a4d4-e11c02ee8fa4. {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 09:44:30 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-619cdb70-1d2b-448b-8853-b0e9d3681326 req-06e99d5c-cd5d-4648-a2d2-6911d621e413 service nova] Acquiring lock "refresh_cache-c307660b-01bb-471b-9e2e-5c2aaca65287" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 09:44:30 user nova-compute[75229]: DEBUG nova.compute.manager [None req-429dcfc7-1e9b-4657-9420-6a93f2309c0d tempest-VolumesActionsTest-433219387 tempest-VolumesActionsTest-433219387-project-member] [instance: c9d3e03d-be75-44b1-97b4-36c13715175b] Start spawning the instance on the hypervisor. {{(pid=75229) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 09:44:30 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-429dcfc7-1e9b-4657-9420-6a93f2309c0d tempest-VolumesActionsTest-433219387 tempest-VolumesActionsTest-433219387-project-member] [instance: c9d3e03d-be75-44b1-97b4-36c13715175b] Creating instance directory {{(pid=75229) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 09:44:30 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-429dcfc7-1e9b-4657-9420-6a93f2309c0d tempest-VolumesActionsTest-433219387 tempest-VolumesActionsTest-433219387-project-member] [instance: c9d3e03d-be75-44b1-97b4-36c13715175b] Creating image(s)
Nov 14 09:44:30 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-429dcfc7-1e9b-4657-9420-6a93f2309c0d tempest-VolumesActionsTest-433219387 tempest-VolumesActionsTest-433219387-project-member] Acquiring lock "/opt/stack/data/nova/instances/c9d3e03d-be75-44b1-97b4-36c13715175b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:44:30 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-429dcfc7-1e9b-4657-9420-6a93f2309c0d tempest-VolumesActionsTest-433219387 tempest-VolumesActionsTest-433219387-project-member] Lock "/opt/stack/data/nova/instances/c9d3e03d-be75-44b1-97b4-36c13715175b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:44:30 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-429dcfc7-1e9b-4657-9420-6a93f2309c0d tempest-VolumesActionsTest-433219387 tempest-VolumesActionsTest-433219387-project-member] Lock "/opt/stack/data/nova/instances/c9d3e03d-be75-44b1-97b4-36c13715175b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:44:30 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-429dcfc7-1e9b-4657-9420-6a93f2309c0d tempest-VolumesActionsTest-433219387 tempest-VolumesActionsTest-433219387-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6 --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:44:30 user nova-compute[75229]: DEBUG nova.network.neutron [None req-4b4efe05-1866-4fb6-a793-a43ec7f6e933 tempest-TestVolumeSwap-528292061 tempest-TestVolumeSwap-528292061-project-member] [instance: c307660b-01bb-471b-9e2e-5c2aaca65287] Instance cache missing network info. {{(pid=75229) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 09:44:30 user nova-compute[75229]: DEBUG nova.compute.manager [req-d6bd031f-481d-4c87-a4fd-3f8120f39ef3 req-746c1529-d16f-48a1-bd5a-0f188b5fcb37 service nova] [instance: a60d339f-e134-477c-8505-bf8c79d2a21c] Received event network-vif-plugged-cb98fc47-7b69-4bde-9a4c-717cd44ba908 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:44:30 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-d6bd031f-481d-4c87-a4fd-3f8120f39ef3 req-746c1529-d16f-48a1-bd5a-0f188b5fcb37 service nova] Acquiring lock "a60d339f-e134-477c-8505-bf8c79d2a21c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:44:30 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-d6bd031f-481d-4c87-a4fd-3f8120f39ef3 req-746c1529-d16f-48a1-bd5a-0f188b5fcb37 service nova] Lock "a60d339f-e134-477c-8505-bf8c79d2a21c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:44:30 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-d6bd031f-481d-4c87-a4fd-3f8120f39ef3 req-746c1529-d16f-48a1-bd5a-0f188b5fcb37 service nova] Lock "a60d339f-e134-477c-8505-bf8c79d2a21c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:44:30 user nova-compute[75229]: DEBUG nova.compute.manager [req-d6bd031f-481d-4c87-a4fd-3f8120f39ef3 req-746c1529-d16f-48a1-bd5a-0f188b5fcb37 service nova] [instance: a60d339f-e134-477c-8505-bf8c79d2a21c] No waiting events found dispatching network-vif-plugged-cb98fc47-7b69-4bde-9a4c-717cd44ba908 {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 09:44:30 user nova-compute[75229]: WARNING nova.compute.manager [req-d6bd031f-481d-4c87-a4fd-3f8120f39ef3 req-746c1529-d16f-48a1-bd5a-0f188b5fcb37 service nova] [instance: a60d339f-e134-477c-8505-bf8c79d2a21c] Received unexpected event network-vif-plugged-cb98fc47-7b69-4bde-9a4c-717cd44ba908 for instance with vm_state active and task_state None.
Nov 14 09:44:30 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-429dcfc7-1e9b-4657-9420-6a93f2309c0d tempest-VolumesActionsTest-433219387 tempest-VolumesActionsTest-433219387-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6 --force-share --output=json" returned: 0 in 0.209s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:44:30 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-429dcfc7-1e9b-4657-9420-6a93f2309c0d tempest-VolumesActionsTest-433219387 tempest-VolumesActionsTest-433219387-project-member] Acquiring lock "4f30e3fe703d2381679612a57b1fb80a467f60b6" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:44:30 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-429dcfc7-1e9b-4657-9420-6a93f2309c0d tempest-VolumesActionsTest-433219387 tempest-VolumesActionsTest-433219387-project-member] Lock "4f30e3fe703d2381679612a57b1fb80a467f60b6" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:44:30 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-429dcfc7-1e9b-4657-9420-6a93f2309c0d tempest-VolumesActionsTest-433219387 tempest-VolumesActionsTest-433219387-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6 --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:44:31 user nova-compute[75229]: DEBUG nova.network.neutron [None req-4b4efe05-1866-4fb6-a793-a43ec7f6e933 tempest-TestVolumeSwap-528292061 tempest-TestVolumeSwap-528292061-project-member] [instance: c307660b-01bb-471b-9e2e-5c2aaca65287] Updating instance_info_cache with network_info: [{"id": "8e8a8e12-6ca8-4657-a4d4-e11c02ee8fa4", "address": "fa:16:3e:db:5c:48", "network": {"id": "57a65455-9929-439e-85a0-07a7a36dbd60", "bridge": "br-int", "label": "tempest-TestVolumeSwap-718745600-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f5ecf574b4a4b8bb0747c796c16e3e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e8a8e12-6c", "ovs_interfaceid": "8e8a8e12-6ca8-4657-a4d4-e11c02ee8fa4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 09:44:31 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-4b4efe05-1866-4fb6-a793-a43ec7f6e933 tempest-TestVolumeSwap-528292061 tempest-TestVolumeSwap-528292061-project-member] Releasing lock "refresh_cache-c307660b-01bb-471b-9e2e-5c2aaca65287" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 09:44:31 user nova-compute[75229]: DEBUG nova.compute.manager [None req-4b4efe05-1866-4fb6-a793-a43ec7f6e933 tempest-TestVolumeSwap-528292061 tempest-TestVolumeSwap-528292061-project-member] [instance: c307660b-01bb-471b-9e2e-5c2aaca65287] Instance network_info: |[{"id": "8e8a8e12-6ca8-4657-a4d4-e11c02ee8fa4", "address": "fa:16:3e:db:5c:48", "network": {"id": "57a65455-9929-439e-85a0-07a7a36dbd60", "bridge": "br-int", "label": "tempest-TestVolumeSwap-718745600-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f5ecf574b4a4b8bb0747c796c16e3e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e8a8e12-6c", "ovs_interfaceid": "8e8a8e12-6ca8-4657-a4d4-e11c02ee8fa4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75229) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 09:44:31 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-619cdb70-1d2b-448b-8853-b0e9d3681326 req-06e99d5c-cd5d-4648-a2d2-6911d621e413 service nova] Acquired lock "refresh_cache-c307660b-01bb-471b-9e2e-5c2aaca65287" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 09:44:31 user nova-compute[75229]: DEBUG nova.network.neutron [req-619cdb70-1d2b-448b-8853-b0e9d3681326 req-06e99d5c-cd5d-4648-a2d2-6911d621e413 service nova] [instance: c307660b-01bb-471b-9e2e-5c2aaca65287] Refreshing network info cache for port 8e8a8e12-6ca8-4657-a4d4-e11c02ee8fa4 {{(pid=75229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 09:44:31 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-4b4efe05-1866-4fb6-a793-a43ec7f6e933 tempest-TestVolumeSwap-528292061 tempest-TestVolumeSwap-528292061-project-member] [instance: c307660b-01bb-471b-9e2e-5c2aaca65287] Start _get_guest_xml network_info=[{"id": "8e8a8e12-6ca8-4657-a4d4-e11c02ee8fa4", "address": "fa:16:3e:db:5c:48", "network": {"id": "57a65455-9929-439e-85a0-07a7a36dbd60", "bridge": "br-int", "label": "tempest-TestVolumeSwap-718745600-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f5ecf574b4a4b8bb0747c796c16e3e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e8a8e12-6c", "ovs_interfaceid": "8e8a8e12-6ca8-4657-a4d4-e11c02ee8fa4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T09:40:10Z,direct_url=<?>,disk_format='qcow2',id=3bef8470-ecc7-40e3-95d4-9254348ea72d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='de5a91106b6948ed937a7178ff9464c4',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T09:40:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'disk_bus': 'virtio', 'guest_format': None, 'encryption_secret_uuid': None, 'size': 0, 'device_type': 'disk', 'image_id': '3bef8470-ecc7-40e3-95d4-9254348ea72d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75229) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 09:44:31 user nova-compute[75229]: WARNING nova.virt.libvirt.driver [None req-4b4efe05-1866-4fb6-a793-a43ec7f6e933 tempest-TestVolumeSwap-528292061 tempest-TestVolumeSwap-528292061-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 09:44:31 user nova-compute[75229]: WARNING nova.virt.libvirt.driver [None req-4b4efe05-1866-4fb6-a793-a43ec7f6e933 tempest-TestVolumeSwap-528292061 tempest-TestVolumeSwap-528292061-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 09:44:31 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-4b4efe05-1866-4fb6-a793-a43ec7f6e933 tempest-TestVolumeSwap-528292061 tempest-TestVolumeSwap-528292061-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75229) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 09:44:31 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-4b4efe05-1866-4fb6-a793-a43ec7f6e933 tempest-TestVolumeSwap-528292061 tempest-TestVolumeSwap-528292061-project-member] CPU controller missing on host. {{(pid=75229) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 09:44:31 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-429dcfc7-1e9b-4657-9420-6a93f2309c0d tempest-VolumesActionsTest-433219387 tempest-VolumesActionsTest-433219387-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6 --force-share --output=json" returned: 0 in 0.230s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:44:31 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-429dcfc7-1e9b-4657-9420-6a93f2309c0d tempest-VolumesActionsTest-433219387 tempest-VolumesActionsTest-433219387-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6,backing_fmt=raw /opt/stack/data/nova/instances/c9d3e03d-be75-44b1-97b4-36c13715175b/disk 1073741824 {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:44:31 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-4b4efe05-1866-4fb6-a793-a43ec7f6e933 tempest-TestVolumeSwap-528292061 tempest-TestVolumeSwap-528292061-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75229) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 09:44:31 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-4b4efe05-1866-4fb6-a793-a43ec7f6e933 tempest-TestVolumeSwap-528292061 tempest-TestVolumeSwap-528292061-project-member] CPU controller found on host. {{(pid=75229) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 09:44:31 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-4b4efe05-1866-4fb6-a793-a43ec7f6e933 tempest-TestVolumeSwap-528292061 tempest-TestVolumeSwap-528292061-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75229) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 09:44:31 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-4b4efe05-1866-4fb6-a793-a43ec7f6e933 tempest-TestVolumeSwap-528292061 tempest-TestVolumeSwap-528292061-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T09:39:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T09:40:10Z,direct_url=<?>,disk_format='qcow2',id=3bef8470-ecc7-40e3-95d4-9254348ea72d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='de5a91106b6948ed937a7178ff9464c4',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T09:40:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 09:44:31 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-4b4efe05-1866-4fb6-a793-a43ec7f6e933 tempest-TestVolumeSwap-528292061 tempest-TestVolumeSwap-528292061-project-member] Flavor limits 0:0:0 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 09:44:31 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-4b4efe05-1866-4fb6-a793-a43ec7f6e933 tempest-TestVolumeSwap-528292061 tempest-TestVolumeSwap-528292061-project-member] Image limits 0:0:0 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 09:44:31 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-4b4efe05-1866-4fb6-a793-a43ec7f6e933 tempest-TestVolumeSwap-528292061 tempest-TestVolumeSwap-528292061-project-member] Flavor pref 0:0:0 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 09:44:31 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-4b4efe05-1866-4fb6-a793-a43ec7f6e933 tempest-TestVolumeSwap-528292061 tempest-TestVolumeSwap-528292061-project-member] Image pref 0:0:0 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 09:44:31 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-4b4efe05-1866-4fb6-a793-a43ec7f6e933 tempest-TestVolumeSwap-528292061 tempest-TestVolumeSwap-528292061-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 09:44:31 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-4b4efe05-1866-4fb6-a793-a43ec7f6e933 tempest-TestVolumeSwap-528292061 tempest-TestVolumeSwap-528292061-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 09:44:31 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-4b4efe05-1866-4fb6-a793-a43ec7f6e933 tempest-TestVolumeSwap-528292061 tempest-TestVolumeSwap-528292061-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75229) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 09:44:31 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-4b4efe05-1866-4fb6-a793-a43ec7f6e933 tempest-TestVolumeSwap-528292061 tempest-TestVolumeSwap-528292061-project-member] Got 1 possible topologies {{(pid=75229) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 09:44:31 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-4b4efe05-1866-4fb6-a793-a43ec7f6e933 tempest-TestVolumeSwap-528292061 tempest-TestVolumeSwap-528292061-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 09:44:31 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-4b4efe05-1866-4fb6-a793-a43ec7f6e933 tempest-TestVolumeSwap-528292061 tempest-TestVolumeSwap-528292061-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 09:44:31 user nova-compute[75229]: DEBUG nova.virt.libvirt.vif [None req-4b4efe05-1866-4fb6-a793-a43ec7f6e933 tempest-TestVolumeSwap-528292061 tempest-TestVolumeSwap-528292061-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T09:44:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-922373847',display_name='tempest-TestVolumeSwap-server-922373847',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-922373847',id=9,image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB4nmno/8vn6yUbaWONTOhE7HhEu/oAqhAQITD0rFD19FekSXmzmcXifzJfm87fHntyCq/tU6IvKtRjyyVXhIy4dynTYhLMv9bafP6InQdaFmN/FXxKp3qYDCGjklanfhg==',key_name='tempest-keypair-37868600',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6f5ecf574b4a4b8bb0747c796c16e3e8',ramdisk_id='',reservation_id='r-r4fvm4ux',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-528292061',owner_user_name='tempest-TestVolumeSwap-528292061-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T09:44:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ef184ea38ecc4d9abe88fb7f6f79a1f7',uuid=c307660b-01bb-471b-9e2e-5c2aaca65287,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8e8a8e12-6ca8-4657-a4d4-e11c02ee8fa4", "address": "fa:16:3e:db:5c:48", "network": {"id": "57a65455-9929-439e-85a0-07a7a36dbd60", "bridge": "br-int", "label": "tempest-TestVolumeSwap-718745600-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f5ecf574b4a4b8bb0747c796c16e3e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e8a8e12-6c", "ovs_interfaceid": "8e8a8e12-6ca8-4657-a4d4-e11c02ee8fa4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75229) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 09:44:31 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-4b4efe05-1866-4fb6-a793-a43ec7f6e933 tempest-TestVolumeSwap-528292061 tempest-TestVolumeSwap-528292061-project-member] Converting VIF {"id": "8e8a8e12-6ca8-4657-a4d4-e11c02ee8fa4", "address": "fa:16:3e:db:5c:48", "network": {"id": "57a65455-9929-439e-85a0-07a7a36dbd60", "bridge": "br-int", "label": "tempest-TestVolumeSwap-718745600-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f5ecf574b4a4b8bb0747c796c16e3e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e8a8e12-6c", "ovs_interfaceid": "8e8a8e12-6ca8-4657-a4d4-e11c02ee8fa4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 09:44:31 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-4b4efe05-1866-4fb6-a793-a43ec7f6e933 tempest-TestVolumeSwap-528292061 tempest-TestVolumeSwap-528292061-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:db:5c:48,bridge_name='br-int',has_traffic_filtering=True,id=8e8a8e12-6ca8-4657-a4d4-e11c02ee8fa4,network=Network(57a65455-9929-439e-85a0-07a7a36dbd60),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e8a8e12-6c') {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 09:44:31 user nova-compute[75229]: DEBUG nova.objects.instance [None req-4b4efe05-1866-4fb6-a793-a43ec7f6e933 tempest-TestVolumeSwap-528292061 tempest-TestVolumeSwap-528292061-project-member] Lazy-loading 'pci_devices' on Instance uuid c307660b-01bb-471b-9e2e-5c2aaca65287 {{(pid=75229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 09:44:31 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-429dcfc7-1e9b-4657-9420-6a93f2309c0d tempest-VolumesActionsTest-433219387 tempest-VolumesActionsTest-433219387-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6,backing_fmt=raw /opt/stack/data/nova/instances/c9d3e03d-be75-44b1-97b4-36c13715175b/disk 1073741824" returned: 0 in 0.141s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:44:31 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-429dcfc7-1e9b-4657-9420-6a93f2309c0d tempest-VolumesActionsTest-433219387 tempest-VolumesActionsTest-433219387-project-member] Lock "4f30e3fe703d2381679612a57b1fb80a467f60b6" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.376s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:44:31 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-429dcfc7-1e9b-4657-9420-6a93f2309c0d tempest-VolumesActionsTest-433219387 tempest-VolumesActionsTest-433219387-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6 --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:44:31 user nova-compute[75229]: DEBUG nova.network.neutron [None req-429dcfc7-1e9b-4657-9420-6a93f2309c0d tempest-VolumesActionsTest-433219387 tempest-VolumesActionsTest-433219387-project-member] [instance: c9d3e03d-be75-44b1-97b4-36c13715175b] Successfully created port: 93b50b64-d7f2-48d0-bedb-ce1f6f5f44d5 {{(pid=75229) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 09:44:31 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-4b4efe05-1866-4fb6-a793-a43ec7f6e933 tempest-TestVolumeSwap-528292061 tempest-TestVolumeSwap-528292061-project-member] [instance: c307660b-01bb-471b-9e2e-5c2aaca65287] End _get_guest_xml xml=<domain type="kvm">
Nov 14 09:44:31 user nova-compute[75229]:   <uuid>c307660b-01bb-471b-9e2e-5c2aaca65287</uuid>
Nov 14 09:44:31 user nova-compute[75229]:   <name>instance-00000009</name>
Nov 14 09:44:31 user nova-compute[75229]:   <memory>524288</memory>
Nov 14 09:44:31 user nova-compute[75229]:   <vcpu>1</vcpu>
Nov 14 09:44:31 user nova-compute[75229]:   <metadata>
Nov 14 09:44:31 user nova-compute[75229]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 09:44:31 user nova-compute[75229]:       <nova:package version="0.0.0"/>
Nov 14 09:44:31 user nova-compute[75229]:       <nova:name>tempest-TestVolumeSwap-server-922373847</nova:name>
Nov 14 09:44:31 user nova-compute[75229]:       <nova:creationTime>2023-11-14 09:44:31</nova:creationTime>
Nov 14 09:44:31 user nova-compute[75229]:       <nova:flavor name="m1.tiny">
Nov 14 09:44:31 user nova-compute[75229]:         <nova:memory>512</nova:memory>
Nov 14 09:44:31 user nova-compute[75229]:         <nova:disk>1</nova:disk>
Nov 14 09:44:31 user nova-compute[75229]:         <nova:swap>0</nova:swap>
Nov 14 09:44:31 user nova-compute[75229]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 09:44:31 user nova-compute[75229]:         <nova:vcpus>1</nova:vcpus>
Nov 14 09:44:31 user nova-compute[75229]:       </nova:flavor>
Nov 14 09:44:31 user nova-compute[75229]:       <nova:owner>
Nov 14 09:44:31 user nova-compute[75229]:         <nova:user uuid="ef184ea38ecc4d9abe88fb7f6f79a1f7">tempest-TestVolumeSwap-528292061-project-member</nova:user>
Nov 14 09:44:31 user nova-compute[75229]:         <nova:project uuid="6f5ecf574b4a4b8bb0747c796c16e3e8">tempest-TestVolumeSwap-528292061</nova:project>
Nov 14 09:44:31 user nova-compute[75229]:       </nova:owner>
Nov 14 09:44:31 user nova-compute[75229]:       <nova:root type="image" uuid="3bef8470-ecc7-40e3-95d4-9254348ea72d"/>
Nov 14 09:44:31 user nova-compute[75229]:       <nova:ports>
Nov 14 09:44:31 user nova-compute[75229]:         <nova:port uuid="8e8a8e12-6ca8-4657-a4d4-e11c02ee8fa4">
Nov 14 09:44:31 user nova-compute[75229]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 14 09:44:31 user nova-compute[75229]:         </nova:port>
Nov 14 09:44:31 user nova-compute[75229]:       </nova:ports>
Nov 14 09:44:31 user nova-compute[75229]:     </nova:instance>
Nov 14 09:44:31 user nova-compute[75229]:   </metadata>
Nov 14 09:44:31 user nova-compute[75229]:   <sysinfo type="smbios">
Nov 14 09:44:31 user nova-compute[75229]:     <system>
Nov 14 09:44:31 user nova-compute[75229]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 09:44:31 user nova-compute[75229]:       <entry name="product">OpenStack Nova</entry>
Nov 14 09:44:31 user nova-compute[75229]:       <entry name="version">0.0.0</entry>
Nov 14 09:44:31 user nova-compute[75229]:       <entry name="serial">c307660b-01bb-471b-9e2e-5c2aaca65287</entry>
Nov 14 09:44:31 user nova-compute[75229]:       <entry name="uuid">c307660b-01bb-471b-9e2e-5c2aaca65287</entry>
Nov 14 09:44:31 user nova-compute[75229]:       <entry name="family">Virtual Machine</entry>
Nov 14 09:44:31 user nova-compute[75229]:     </system>
Nov 14 09:44:31 user nova-compute[75229]:   </sysinfo>
Nov 14 09:44:31 user nova-compute[75229]:   <os>
Nov 14 09:44:31 user nova-compute[75229]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 09:44:31 user nova-compute[75229]:     <boot dev="hd"/>
Nov 14 09:44:31 user nova-compute[75229]:     <smbios mode="sysinfo"/>
Nov 14 09:44:31 user nova-compute[75229]:   </os>
Nov 14 09:44:31 user nova-compute[75229]:   <features>
Nov 14 09:44:31 user nova-compute[75229]:     <acpi/>
Nov 14 09:44:31 user nova-compute[75229]:     <apic/>
Nov 14 09:44:31 user nova-compute[75229]:     <vmcoreinfo/>
Nov 14 09:44:31 user nova-compute[75229]:   </features>
Nov 14 09:44:31 user nova-compute[75229]:   <clock offset="utc">
Nov 14 09:44:31 user nova-compute[75229]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 09:44:31 user nova-compute[75229]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 09:44:31 user nova-compute[75229]:     <timer name="hpet" present="no"/>
Nov 14 09:44:31 user nova-compute[75229]:   </clock>
Nov 14 09:44:31 user nova-compute[75229]:   <cpu mode="custom" match="exact">
Nov 14 09:44:31 user nova-compute[75229]:     <model>Nehalem</model>
Nov 14 09:44:31 user nova-compute[75229]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 09:44:31 user nova-compute[75229]:   </cpu>
Nov 14 09:44:31 user nova-compute[75229]:   <devices>
Nov 14 09:44:31 user nova-compute[75229]:     <disk type="file" device="disk">
Nov 14 09:44:31 user nova-compute[75229]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 09:44:31 user nova-compute[75229]:       <source file="/opt/stack/data/nova/instances/c307660b-01bb-471b-9e2e-5c2aaca65287/disk"/>
Nov 14 09:44:31 user nova-compute[75229]:       <target dev="vda" bus="virtio"/>
Nov 14 09:44:31 user nova-compute[75229]:     </disk>
Nov 14 09:44:31 user nova-compute[75229]:     <interface type="ethernet">
Nov 14 09:44:31 user nova-compute[75229]:       <mac address="fa:16:3e:db:5c:48"/>
Nov 14 09:44:31 user nova-compute[75229]:       <model type="virtio"/>
Nov 14 09:44:31 user nova-compute[75229]:       <mtu size="1442"/>
Nov 14 09:44:31 user nova-compute[75229]:       <target dev="tap8e8a8e12-6c"/>
Nov 14 09:44:31 user nova-compute[75229]:     </interface>
Nov 14 09:44:31 user nova-compute[75229]:     <serial type="pty">
Nov 14 09:44:31 user nova-compute[75229]:       <log file="/opt/stack/data/nova/instances/c307660b-01bb-471b-9e2e-5c2aaca65287/console.log" append="off"/>
Nov 14 09:44:31 user nova-compute[75229]:     </serial>
Nov 14 09:44:31 user nova-compute[75229]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 09:44:31 user nova-compute[75229]:     <video>
Nov 14 09:44:31 user nova-compute[75229]:       <model type="virtio"/>
Nov 14 09:44:31 user nova-compute[75229]:     </video>
Nov 14 09:44:31 user nova-compute[75229]:     <rng model="virtio">
Nov 14 09:44:31 user nova-compute[75229]:       <backend model="random">/dev/urandom</backend>
Nov 14 09:44:31 user nova-compute[75229]:     </rng>
Nov 14 09:44:31 user nova-compute[75229]:     <controller type="usb" index="0" model="none"/>
Nov 14 09:44:31 user nova-compute[75229]:     <memballoon model="virtio">
Nov 14 09:44:31 user nova-compute[75229]:       <stats period="10"/>
Nov 14 09:44:31 user nova-compute[75229]:     </memballoon>
Nov 14 09:44:31 user nova-compute[75229]:   </devices>
Nov 14 09:44:31 user nova-compute[75229]: </domain>
Nov 14 09:44:31 user nova-compute[75229]:  {{(pid=75229) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 09:44:31 user nova-compute[75229]: DEBUG nova.virt.libvirt.vif [None req-4b4efe05-1866-4fb6-a793-a43ec7f6e933 tempest-TestVolumeSwap-528292061 tempest-TestVolumeSwap-528292061-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T09:44:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-922373847',display_name='tempest-TestVolumeSwap-server-922373847',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-922373847',id=9,image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB4nmno/8vn6yUbaWONTOhE7HhEu/oAqhAQITD0rFD19FekSXmzmcXifzJfm87fHntyCq/tU6IvKtRjyyVXhIy4dynTYhLMv9bafP6InQdaFmN/FXxKp3qYDCGjklanfhg==',key_name='tempest-keypair-37868600',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6f5ecf574b4a4b8bb0747c796c16e3e8',ramdisk_id='',reservation_id='r-r4fvm4ux',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-528292061',owner_user_name='tempest-TestVolumeSwap-528292061-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T09:44:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ef184ea38ecc4d9abe88fb7f6f79a1f7',uuid=c307660b-01bb-471b-9e2e-5c2aaca65287,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8e8a8e12-6ca8-4657-a4d4-e11c02ee8fa4", "address": "fa:16:3e:db:5c:48", "network": {"id": "57a65455-9929-439e-85a0-07a7a36dbd60", "bridge": "br-int", "label": "tempest-TestVolumeSwap-718745600-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f5ecf574b4a4b8bb0747c796c16e3e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e8a8e12-6c", "ovs_interfaceid": "8e8a8e12-6ca8-4657-a4d4-e11c02ee8fa4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 09:44:31 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-4b4efe05-1866-4fb6-a793-a43ec7f6e933 tempest-TestVolumeSwap-528292061 tempest-TestVolumeSwap-528292061-project-member] Converting VIF {"id": "8e8a8e12-6ca8-4657-a4d4-e11c02ee8fa4", "address": "fa:16:3e:db:5c:48", "network": {"id": "57a65455-9929-439e-85a0-07a7a36dbd60", "bridge": "br-int", "label": "tempest-TestVolumeSwap-718745600-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f5ecf574b4a4b8bb0747c796c16e3e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e8a8e12-6c", "ovs_interfaceid": "8e8a8e12-6ca8-4657-a4d4-e11c02ee8fa4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 09:44:31 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-4b4efe05-1866-4fb6-a793-a43ec7f6e933 tempest-TestVolumeSwap-528292061 tempest-TestVolumeSwap-528292061-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:db:5c:48,bridge_name='br-int',has_traffic_filtering=True,id=8e8a8e12-6ca8-4657-a4d4-e11c02ee8fa4,network=Network(57a65455-9929-439e-85a0-07a7a36dbd60),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e8a8e12-6c') {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 09:44:31 user nova-compute[75229]: DEBUG os_vif [None req-4b4efe05-1866-4fb6-a793-a43ec7f6e933 tempest-TestVolumeSwap-528292061 tempest-TestVolumeSwap-528292061-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:db:5c:48,bridge_name='br-int',has_traffic_filtering=True,id=8e8a8e12-6ca8-4657-a4d4-e11c02ee8fa4,network=Network(57a65455-9929-439e-85a0-07a7a36dbd60),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e8a8e12-6c') {{(pid=75229) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 09:44:31 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:44:31 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:44:31 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 09:44:31 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:44:31 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2314eb01-4fd6-5bf8-a801-c7d0bfb44583', '_type': 'linux-noop'}}, row=False) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:44:31 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:44:31 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 09:44:31 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:44:31 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8e8a8e12-6c, may_exist=True, interface_attrs={}) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:44:31 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8e8a8e12-6c, col_values=(('qos', UUID('d396a44a-2005-4d78-997b-4c8cfb33f5e7')),), if_exists=True) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:44:31 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8e8a8e12-6c, col_values=(('external_ids', {'iface-id': '8e8a8e12-6ca8-4657-a4d4-e11c02ee8fa4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:db:5c:48', 'vm-uuid': 'c307660b-01bb-471b-9e2e-5c2aaca65287'}),), if_exists=True) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:44:31 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:44:31 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 09:44:31 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:44:31 user nova-compute[75229]: INFO os_vif [None req-4b4efe05-1866-4fb6-a793-a43ec7f6e933 tempest-TestVolumeSwap-528292061 tempest-TestVolumeSwap-528292061-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:db:5c:48,bridge_name='br-int',has_traffic_filtering=True,id=8e8a8e12-6ca8-4657-a4d4-e11c02ee8fa4,network=Network(57a65455-9929-439e-85a0-07a7a36dbd60),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e8a8e12-6c')
Nov 14 09:44:31 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-429dcfc7-1e9b-4657-9420-6a93f2309c0d tempest-VolumesActionsTest-433219387 tempest-VolumesActionsTest-433219387-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6 --force-share --output=json" returned: 0 in 0.226s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:44:31 user nova-compute[75229]: DEBUG nova.virt.disk.api [None req-429dcfc7-1e9b-4657-9420-6a93f2309c0d tempest-VolumesActionsTest-433219387 tempest-VolumesActionsTest-433219387-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c9d3e03d-be75-44b1-97b4-36c13715175b/disk. size=1073741824 {{(pid=75229) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 09:44:31 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-429dcfc7-1e9b-4657-9420-6a93f2309c0d tempest-VolumesActionsTest-433219387 tempest-VolumesActionsTest-433219387-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9d3e03d-be75-44b1-97b4-36c13715175b/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:44:31 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-4b4efe05-1866-4fb6-a793-a43ec7f6e933 tempest-TestVolumeSwap-528292061 tempest-TestVolumeSwap-528292061-project-member] No BDM found with device name vda, not building metadata. {{(pid=75229) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 09:44:31 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-4b4efe05-1866-4fb6-a793-a43ec7f6e933 tempest-TestVolumeSwap-528292061 tempest-TestVolumeSwap-528292061-project-member] No VIF found with MAC fa:16:3e:db:5c:48, not building metadata {{(pid=75229) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 09:44:31 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-429dcfc7-1e9b-4657-9420-6a93f2309c0d tempest-VolumesActionsTest-433219387 tempest-VolumesActionsTest-433219387-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9d3e03d-be75-44b1-97b4-36c13715175b/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:44:31 user nova-compute[75229]: DEBUG nova.virt.disk.api [None req-429dcfc7-1e9b-4657-9420-6a93f2309c0d tempest-VolumesActionsTest-433219387 tempest-VolumesActionsTest-433219387-project-member] Cannot resize image /opt/stack/data/nova/instances/c9d3e03d-be75-44b1-97b4-36c13715175b/disk to a smaller size. {{(pid=75229) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 09:44:31 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-429dcfc7-1e9b-4657-9420-6a93f2309c0d tempest-VolumesActionsTest-433219387 tempest-VolumesActionsTest-433219387-project-member] [instance: c9d3e03d-be75-44b1-97b4-36c13715175b] Created local disks {{(pid=75229) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 09:44:31 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-429dcfc7-1e9b-4657-9420-6a93f2309c0d tempest-VolumesActionsTest-433219387 tempest-VolumesActionsTest-433219387-project-member] [instance: c9d3e03d-be75-44b1-97b4-36c13715175b] Ensure instance console log exists: /opt/stack/data/nova/instances/c9d3e03d-be75-44b1-97b4-36c13715175b/console.log {{(pid=75229) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 09:44:31 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-429dcfc7-1e9b-4657-9420-6a93f2309c0d tempest-VolumesActionsTest-433219387 tempest-VolumesActionsTest-433219387-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:44:31 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-429dcfc7-1e9b-4657-9420-6a93f2309c0d tempest-VolumesActionsTest-433219387 tempest-VolumesActionsTest-433219387-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:44:31 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-429dcfc7-1e9b-4657-9420-6a93f2309c0d tempest-VolumesActionsTest-433219387 tempest-VolumesActionsTest-433219387-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:44:31 user nova-compute[75229]: DEBUG nova.network.neutron [req-619cdb70-1d2b-448b-8853-b0e9d3681326 req-06e99d5c-cd5d-4648-a2d2-6911d621e413 service nova] [instance: c307660b-01bb-471b-9e2e-5c2aaca65287] Updated VIF entry in instance network info cache for port 8e8a8e12-6ca8-4657-a4d4-e11c02ee8fa4. {{(pid=75229) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 09:44:31 user nova-compute[75229]: DEBUG nova.network.neutron [req-619cdb70-1d2b-448b-8853-b0e9d3681326 req-06e99d5c-cd5d-4648-a2d2-6911d621e413 service nova] [instance: c307660b-01bb-471b-9e2e-5c2aaca65287] Updating instance_info_cache with network_info: [{"id": "8e8a8e12-6ca8-4657-a4d4-e11c02ee8fa4", "address": "fa:16:3e:db:5c:48", "network": {"id": "57a65455-9929-439e-85a0-07a7a36dbd60", "bridge": "br-int", "label": "tempest-TestVolumeSwap-718745600-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f5ecf574b4a4b8bb0747c796c16e3e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e8a8e12-6c", "ovs_interfaceid": "8e8a8e12-6ca8-4657-a4d4-e11c02ee8fa4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 09:44:31 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-619cdb70-1d2b-448b-8853-b0e9d3681326 req-06e99d5c-cd5d-4648-a2d2-6911d621e413 service nova] Releasing lock "refresh_cache-c307660b-01bb-471b-9e2e-5c2aaca65287" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 09:44:32 user nova-compute[75229]: DEBUG nova.compute.manager [None req-5ebcc9ee-2955-4be7-9636-bccac98f0e53 tempest-TaggedAttachmentsTest-294727221 tempest-TaggedAttachmentsTest-294727221-project-member] [instance: c6fa2298-7111-4660-a162-09269045d5e3] Instance event wait completed in 0 seconds for  {{(pid=75229) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 09:44:32 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-5ebcc9ee-2955-4be7-9636-bccac98f0e53 tempest-TaggedAttachmentsTest-294727221 tempest-TaggedAttachmentsTest-294727221-project-member] [instance: c6fa2298-7111-4660-a162-09269045d5e3] Guest created on hypervisor {{(pid=75229) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 09:44:32 user nova-compute[75229]: INFO nova.virt.libvirt.driver [-] [instance: c6fa2298-7111-4660-a162-09269045d5e3] Instance spawned successfully.
Nov 14 09:44:32 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-5ebcc9ee-2955-4be7-9636-bccac98f0e53 tempest-TaggedAttachmentsTest-294727221 tempest-TaggedAttachmentsTest-294727221-project-member] [instance: c6fa2298-7111-4660-a162-09269045d5e3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 09:44:32 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-5ebcc9ee-2955-4be7-9636-bccac98f0e53 tempest-TaggedAttachmentsTest-294727221 tempest-TaggedAttachmentsTest-294727221-project-member] [instance: c6fa2298-7111-4660-a162-09269045d5e3] Found default for hw_cdrom_bus of ide {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 09:44:32 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-5ebcc9ee-2955-4be7-9636-bccac98f0e53 tempest-TaggedAttachmentsTest-294727221 tempest-TaggedAttachmentsTest-294727221-project-member] [instance: c6fa2298-7111-4660-a162-09269045d5e3] Found default for hw_disk_bus of virtio {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 09:44:32 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-5ebcc9ee-2955-4be7-9636-bccac98f0e53 tempest-TaggedAttachmentsTest-294727221 tempest-TaggedAttachmentsTest-294727221-project-member] [instance: c6fa2298-7111-4660-a162-09269045d5e3] Found default for hw_input_bus of None {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 09:44:32 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-5ebcc9ee-2955-4be7-9636-bccac98f0e53 tempest-TaggedAttachmentsTest-294727221 tempest-TaggedAttachmentsTest-294727221-project-member] [instance: c6fa2298-7111-4660-a162-09269045d5e3] Found default for hw_pointer_model of None {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 09:44:32 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-5ebcc9ee-2955-4be7-9636-bccac98f0e53 tempest-TaggedAttachmentsTest-294727221 tempest-TaggedAttachmentsTest-294727221-project-member] [instance: c6fa2298-7111-4660-a162-09269045d5e3] Found default for hw_video_model of virtio {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 09:44:32 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-5ebcc9ee-2955-4be7-9636-bccac98f0e53 tempest-TaggedAttachmentsTest-294727221 tempest-TaggedAttachmentsTest-294727221-project-member] [instance: c6fa2298-7111-4660-a162-09269045d5e3] Found default for hw_vif_model of virtio {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 09:44:32 user nova-compute[75229]: INFO nova.compute.manager [None req-5ebcc9ee-2955-4be7-9636-bccac98f0e53 tempest-TaggedAttachmentsTest-294727221 tempest-TaggedAttachmentsTest-294727221-project-member] [instance: c6fa2298-7111-4660-a162-09269045d5e3] Took 9.53 seconds to spawn the instance on the hypervisor.
Nov 14 09:44:32 user nova-compute[75229]: DEBUG nova.compute.manager [None req-5ebcc9ee-2955-4be7-9636-bccac98f0e53 tempest-TaggedAttachmentsTest-294727221 tempest-TaggedAttachmentsTest-294727221-project-member] [instance: c6fa2298-7111-4660-a162-09269045d5e3] Checking state {{(pid=75229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 09:44:32 user nova-compute[75229]: INFO nova.compute.manager [None req-5ebcc9ee-2955-4be7-9636-bccac98f0e53 tempest-TaggedAttachmentsTest-294727221 tempest-TaggedAttachmentsTest-294727221-project-member] [instance: c6fa2298-7111-4660-a162-09269045d5e3] Took 11.62 seconds to build instance.
Nov 14 09:44:32 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-5ebcc9ee-2955-4be7-9636-bccac98f0e53 tempest-TaggedAttachmentsTest-294727221 tempest-TaggedAttachmentsTest-294727221-project-member] Lock "c6fa2298-7111-4660-a162-09269045d5e3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.764s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:44:32 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:44:32 user nova-compute[75229]: DEBUG nova.network.neutron [None req-429dcfc7-1e9b-4657-9420-6a93f2309c0d tempest-VolumesActionsTest-433219387 tempest-VolumesActionsTest-433219387-project-member] [instance: c9d3e03d-be75-44b1-97b4-36c13715175b] Successfully updated port: 93b50b64-d7f2-48d0-bedb-ce1f6f5f44d5 {{(pid=75229) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 09:44:32 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-429dcfc7-1e9b-4657-9420-6a93f2309c0d tempest-VolumesActionsTest-433219387 tempest-VolumesActionsTest-433219387-project-member] Acquiring lock "refresh_cache-c9d3e03d-be75-44b1-97b4-36c13715175b" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 09:44:32 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-429dcfc7-1e9b-4657-9420-6a93f2309c0d tempest-VolumesActionsTest-433219387 tempest-VolumesActionsTest-433219387-project-member] Acquired lock "refresh_cache-c9d3e03d-be75-44b1-97b4-36c13715175b" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 09:44:32 user nova-compute[75229]: DEBUG nova.network.neutron [None req-429dcfc7-1e9b-4657-9420-6a93f2309c0d tempest-VolumesActionsTest-433219387 tempest-VolumesActionsTest-433219387-project-member] [instance: c9d3e03d-be75-44b1-97b4-36c13715175b] Building network info cache for instance {{(pid=75229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 09:44:32 user nova-compute[75229]: DEBUG nova.compute.manager [req-079a6e6d-b440-41eb-bff8-1a03474f7b70 req-b8aa439b-9a6f-4ffc-b1d6-3c92c1642cc8 service nova] [instance: a60d339f-e134-477c-8505-bf8c79d2a21c] Received event network-vif-plugged-cb98fc47-7b69-4bde-9a4c-717cd44ba908 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:44:32 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-079a6e6d-b440-41eb-bff8-1a03474f7b70 req-b8aa439b-9a6f-4ffc-b1d6-3c92c1642cc8 service nova] Acquiring lock "a60d339f-e134-477c-8505-bf8c79d2a21c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:44:32 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-079a6e6d-b440-41eb-bff8-1a03474f7b70 req-b8aa439b-9a6f-4ffc-b1d6-3c92c1642cc8 service nova] Lock "a60d339f-e134-477c-8505-bf8c79d2a21c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:44:32 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-079a6e6d-b440-41eb-bff8-1a03474f7b70 req-b8aa439b-9a6f-4ffc-b1d6-3c92c1642cc8 service nova] Lock "a60d339f-e134-477c-8505-bf8c79d2a21c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:44:32 user nova-compute[75229]: DEBUG nova.compute.manager [req-079a6e6d-b440-41eb-bff8-1a03474f7b70 req-b8aa439b-9a6f-4ffc-b1d6-3c92c1642cc8 service nova] [instance: a60d339f-e134-477c-8505-bf8c79d2a21c] No waiting events found dispatching network-vif-plugged-cb98fc47-7b69-4bde-9a4c-717cd44ba908 {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 09:44:32 user nova-compute[75229]: WARNING nova.compute.manager [req-079a6e6d-b440-41eb-bff8-1a03474f7b70 req-b8aa439b-9a6f-4ffc-b1d6-3c92c1642cc8 service nova] [instance: a60d339f-e134-477c-8505-bf8c79d2a21c] Received unexpected event network-vif-plugged-cb98fc47-7b69-4bde-9a4c-717cd44ba908 for instance with vm_state active and task_state None.
Nov 14 09:44:32 user nova-compute[75229]: DEBUG nova.compute.manager [req-b61ed3f2-e457-4121-93ca-f29addf943a6 req-f02e2c5c-999b-452e-a49e-9152f2d5145b service nova] [instance: c9d3e03d-be75-44b1-97b4-36c13715175b] Received event network-changed-93b50b64-d7f2-48d0-bedb-ce1f6f5f44d5 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:44:32 user nova-compute[75229]: DEBUG nova.compute.manager [req-b61ed3f2-e457-4121-93ca-f29addf943a6 req-f02e2c5c-999b-452e-a49e-9152f2d5145b service nova] [instance: c9d3e03d-be75-44b1-97b4-36c13715175b] Refreshing instance network info cache due to event network-changed-93b50b64-d7f2-48d0-bedb-ce1f6f5f44d5. {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 09:44:32 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-b61ed3f2-e457-4121-93ca-f29addf943a6 req-f02e2c5c-999b-452e-a49e-9152f2d5145b service nova] Acquiring lock "refresh_cache-c9d3e03d-be75-44b1-97b4-36c13715175b" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 09:44:32 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:44:33 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:44:33 user nova-compute[75229]: DEBUG nova.network.neutron [None req-429dcfc7-1e9b-4657-9420-6a93f2309c0d tempest-VolumesActionsTest-433219387 tempest-VolumesActionsTest-433219387-project-member] [instance: c9d3e03d-be75-44b1-97b4-36c13715175b] Instance cache missing network info. {{(pid=75229) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 09:44:33 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:44:33 user nova-compute[75229]: DEBUG nova.compute.manager [req-5b16211b-966f-440e-8587-392bf6dea898 req-b291ea84-13db-45d0-a5e2-d17a8b66b5ca service nova] [instance: c307660b-01bb-471b-9e2e-5c2aaca65287] Received event network-vif-plugged-8e8a8e12-6ca8-4657-a4d4-e11c02ee8fa4 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:44:33 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-5b16211b-966f-440e-8587-392bf6dea898 req-b291ea84-13db-45d0-a5e2-d17a8b66b5ca service nova] Acquiring lock "c307660b-01bb-471b-9e2e-5c2aaca65287-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:44:33 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-5b16211b-966f-440e-8587-392bf6dea898 req-b291ea84-13db-45d0-a5e2-d17a8b66b5ca service nova] Lock "c307660b-01bb-471b-9e2e-5c2aaca65287-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:44:33 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-5b16211b-966f-440e-8587-392bf6dea898 req-b291ea84-13db-45d0-a5e2-d17a8b66b5ca service nova] Lock "c307660b-01bb-471b-9e2e-5c2aaca65287-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:44:33 user nova-compute[75229]: DEBUG nova.compute.manager [req-5b16211b-966f-440e-8587-392bf6dea898 req-b291ea84-13db-45d0-a5e2-d17a8b66b5ca service nova] [instance: c307660b-01bb-471b-9e2e-5c2aaca65287] No waiting events found dispatching network-vif-plugged-8e8a8e12-6ca8-4657-a4d4-e11c02ee8fa4 {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 09:44:33 user nova-compute[75229]: WARNING nova.compute.manager [req-5b16211b-966f-440e-8587-392bf6dea898 req-b291ea84-13db-45d0-a5e2-d17a8b66b5ca service nova] [instance: c307660b-01bb-471b-9e2e-5c2aaca65287] Received unexpected event network-vif-plugged-8e8a8e12-6ca8-4657-a4d4-e11c02ee8fa4 for instance with vm_state building and task_state spawning.
Nov 14 09:44:33 user nova-compute[75229]: DEBUG nova.network.neutron [None req-429dcfc7-1e9b-4657-9420-6a93f2309c0d tempest-VolumesActionsTest-433219387 tempest-VolumesActionsTest-433219387-project-member] [instance: c9d3e03d-be75-44b1-97b4-36c13715175b] Updating instance_info_cache with network_info: [{"id": "93b50b64-d7f2-48d0-bedb-ce1f6f5f44d5", "address": "fa:16:3e:1e:66:d2", "network": {"id": "12eca812-07b5-410d-be2d-5d950c49859b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1127953797-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20105ee2c3b54e72a2733d4ae8521c85", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93b50b64-d7", "ovs_interfaceid": "93b50b64-d7f2-48d0-bedb-ce1f6f5f44d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 09:44:33 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-429dcfc7-1e9b-4657-9420-6a93f2309c0d tempest-VolumesActionsTest-433219387 tempest-VolumesActionsTest-433219387-project-member] Releasing lock "refresh_cache-c9d3e03d-be75-44b1-97b4-36c13715175b" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 09:44:33 user nova-compute[75229]: DEBUG nova.compute.manager [None req-429dcfc7-1e9b-4657-9420-6a93f2309c0d tempest-VolumesActionsTest-433219387 tempest-VolumesActionsTest-433219387-project-member] [instance: c9d3e03d-be75-44b1-97b4-36c13715175b] Instance network_info: |[{"id": "93b50b64-d7f2-48d0-bedb-ce1f6f5f44d5", "address": "fa:16:3e:1e:66:d2", "network": {"id": "12eca812-07b5-410d-be2d-5d950c49859b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1127953797-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20105ee2c3b54e72a2733d4ae8521c85", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93b50b64-d7", "ovs_interfaceid": "93b50b64-d7f2-48d0-bedb-ce1f6f5f44d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75229) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 09:44:33 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-b61ed3f2-e457-4121-93ca-f29addf943a6 req-f02e2c5c-999b-452e-a49e-9152f2d5145b service nova] Acquired lock "refresh_cache-c9d3e03d-be75-44b1-97b4-36c13715175b" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 09:44:33 user nova-compute[75229]: DEBUG nova.network.neutron [req-b61ed3f2-e457-4121-93ca-f29addf943a6 req-f02e2c5c-999b-452e-a49e-9152f2d5145b service nova] [instance: c9d3e03d-be75-44b1-97b4-36c13715175b] Refreshing network info cache for port 93b50b64-d7f2-48d0-bedb-ce1f6f5f44d5 {{(pid=75229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 09:44:33 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-429dcfc7-1e9b-4657-9420-6a93f2309c0d tempest-VolumesActionsTest-433219387 tempest-VolumesActionsTest-433219387-project-member] [instance: c9d3e03d-be75-44b1-97b4-36c13715175b] Start _get_guest_xml network_info=[{"id": "93b50b64-d7f2-48d0-bedb-ce1f6f5f44d5", "address": "fa:16:3e:1e:66:d2", "network": {"id": "12eca812-07b5-410d-be2d-5d950c49859b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1127953797-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20105ee2c3b54e72a2733d4ae8521c85", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93b50b64-d7", "ovs_interfaceid": "93b50b64-d7f2-48d0-bedb-ce1f6f5f44d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T09:40:10Z,direct_url=<?>,disk_format='qcow2',id=3bef8470-ecc7-40e3-95d4-9254348ea72d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='de5a91106b6948ed937a7178ff9464c4',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T09:40:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'disk_bus': 'virtio', 'guest_format': None, 'encryption_secret_uuid': None, 'size': 0, 'device_type': 'disk', 'image_id': '3bef8470-ecc7-40e3-95d4-9254348ea72d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75229) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 09:44:33 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:44:33 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:44:33 user nova-compute[75229]: WARNING nova.virt.libvirt.driver [None req-429dcfc7-1e9b-4657-9420-6a93f2309c0d tempest-VolumesActionsTest-433219387 tempest-VolumesActionsTest-433219387-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 09:44:33 user nova-compute[75229]: WARNING nova.virt.libvirt.driver [None req-429dcfc7-1e9b-4657-9420-6a93f2309c0d tempest-VolumesActionsTest-433219387 tempest-VolumesActionsTest-433219387-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 09:44:33 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:44:33 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-429dcfc7-1e9b-4657-9420-6a93f2309c0d tempest-VolumesActionsTest-433219387 tempest-VolumesActionsTest-433219387-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75229) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 09:44:33 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-429dcfc7-1e9b-4657-9420-6a93f2309c0d tempest-VolumesActionsTest-433219387 tempest-VolumesActionsTest-433219387-project-member] CPU controller missing on host. {{(pid=75229) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 09:44:33 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-429dcfc7-1e9b-4657-9420-6a93f2309c0d tempest-VolumesActionsTest-433219387 tempest-VolumesActionsTest-433219387-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75229) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 09:44:33 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-429dcfc7-1e9b-4657-9420-6a93f2309c0d tempest-VolumesActionsTest-433219387 tempest-VolumesActionsTest-433219387-project-member] CPU controller found on host. {{(pid=75229) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 09:44:33 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-429dcfc7-1e9b-4657-9420-6a93f2309c0d tempest-VolumesActionsTest-433219387 tempest-VolumesActionsTest-433219387-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75229) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 09:44:33 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-429dcfc7-1e9b-4657-9420-6a93f2309c0d tempest-VolumesActionsTest-433219387 tempest-VolumesActionsTest-433219387-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T09:39:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T09:40:10Z,direct_url=<?>,disk_format='qcow2',id=3bef8470-ecc7-40e3-95d4-9254348ea72d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='de5a91106b6948ed937a7178ff9464c4',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T09:40:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 09:44:33 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-429dcfc7-1e9b-4657-9420-6a93f2309c0d tempest-VolumesActionsTest-433219387 tempest-VolumesActionsTest-433219387-project-member] Flavor limits 0:0:0 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 09:44:33 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-429dcfc7-1e9b-4657-9420-6a93f2309c0d tempest-VolumesActionsTest-433219387 tempest-VolumesActionsTest-433219387-project-member] Image limits 0:0:0 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 09:44:33 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-429dcfc7-1e9b-4657-9420-6a93f2309c0d tempest-VolumesActionsTest-433219387 tempest-VolumesActionsTest-433219387-project-member] Flavor pref 0:0:0 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 09:44:33 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-429dcfc7-1e9b-4657-9420-6a93f2309c0d tempest-VolumesActionsTest-433219387 tempest-VolumesActionsTest-433219387-project-member] Image pref 0:0:0 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 09:44:33 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-429dcfc7-1e9b-4657-9420-6a93f2309c0d tempest-VolumesActionsTest-433219387 tempest-VolumesActionsTest-433219387-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 09:44:33 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-429dcfc7-1e9b-4657-9420-6a93f2309c0d tempest-VolumesActionsTest-433219387 tempest-VolumesActionsTest-433219387-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 09:44:33 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-429dcfc7-1e9b-4657-9420-6a93f2309c0d tempest-VolumesActionsTest-433219387 tempest-VolumesActionsTest-433219387-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75229) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 09:44:33 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-429dcfc7-1e9b-4657-9420-6a93f2309c0d tempest-VolumesActionsTest-433219387 tempest-VolumesActionsTest-433219387-project-member] Got 1 possible topologies {{(pid=75229) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 09:44:33 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-429dcfc7-1e9b-4657-9420-6a93f2309c0d tempest-VolumesActionsTest-433219387 tempest-VolumesActionsTest-433219387-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 09:44:33 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-429dcfc7-1e9b-4657-9420-6a93f2309c0d tempest-VolumesActionsTest-433219387 tempest-VolumesActionsTest-433219387-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 09:44:33 user nova-compute[75229]: DEBUG nova.virt.libvirt.vif [None req-429dcfc7-1e9b-4657-9420-6a93f2309c0d tempest-VolumesActionsTest-433219387 tempest-VolumesActionsTest-433219387-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T09:44:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1619649382',display_name='tempest-VolumesActionsTest-instance-1619649382',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1619649382',id=10,image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='20105ee2c3b54e72a2733d4ae8521c85',ramdisk_id='',reservation_id='r-44osxnby',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-433219387',owner_user_name='tempest-VolumesActionsTest-433219387-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T09:44:31Z,user_data=None,user_id='b5ab788c6eca4c208943024e9d9ecdd8',uuid=c9d3e03d-be75-44b1-97b4-36c13715175b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "93b50b64-d7f2-48d0-bedb-ce1f6f5f44d5", "address": "fa:16:3e:1e:66:d2", "network": {"id": "12eca812-07b5-410d-be2d-5d950c49859b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1127953797-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20105ee2c3b54e72a2733d4ae8521c85", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93b50b64-d7", "ovs_interfaceid": "93b50b64-d7f2-48d0-bedb-ce1f6f5f44d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75229) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 09:44:33 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-429dcfc7-1e9b-4657-9420-6a93f2309c0d tempest-VolumesActionsTest-433219387 tempest-VolumesActionsTest-433219387-project-member] Converting VIF {"id": "93b50b64-d7f2-48d0-bedb-ce1f6f5f44d5", "address": "fa:16:3e:1e:66:d2", "network": {"id": "12eca812-07b5-410d-be2d-5d950c49859b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1127953797-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20105ee2c3b54e72a2733d4ae8521c85", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93b50b64-d7", "ovs_interfaceid": "93b50b64-d7f2-48d0-bedb-ce1f6f5f44d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 09:44:33 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-429dcfc7-1e9b-4657-9420-6a93f2309c0d tempest-VolumesActionsTest-433219387 tempest-VolumesActionsTest-433219387-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1e:66:d2,bridge_name='br-int',has_traffic_filtering=True,id=93b50b64-d7f2-48d0-bedb-ce1f6f5f44d5,network=Network(12eca812-07b5-410d-be2d-5d950c49859b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap93b50b64-d7') {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 09:44:33 user nova-compute[75229]: DEBUG nova.objects.instance [None req-429dcfc7-1e9b-4657-9420-6a93f2309c0d tempest-VolumesActionsTest-433219387 tempest-VolumesActionsTest-433219387-project-member] Lazy-loading 'pci_devices' on Instance uuid c9d3e03d-be75-44b1-97b4-36c13715175b {{(pid=75229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 09:44:33 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-429dcfc7-1e9b-4657-9420-6a93f2309c0d tempest-VolumesActionsTest-433219387 tempest-VolumesActionsTest-433219387-project-member] [instance: c9d3e03d-be75-44b1-97b4-36c13715175b] End _get_guest_xml xml=<domain type="kvm">
Nov 14 09:44:33 user nova-compute[75229]:   <uuid>c9d3e03d-be75-44b1-97b4-36c13715175b</uuid>
Nov 14 09:44:33 user nova-compute[75229]:   <name>instance-0000000a</name>
Nov 14 09:44:33 user nova-compute[75229]:   <memory>524288</memory>
Nov 14 09:44:33 user nova-compute[75229]:   <vcpu>1</vcpu>
Nov 14 09:44:33 user nova-compute[75229]:   <metadata>
Nov 14 09:44:33 user nova-compute[75229]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 09:44:33 user nova-compute[75229]:       <nova:package version="0.0.0"/>
Nov 14 09:44:33 user nova-compute[75229]:       <nova:name>tempest-VolumesActionsTest-instance-1619649382</nova:name>
Nov 14 09:44:33 user nova-compute[75229]:       <nova:creationTime>2023-11-14 09:44:33</nova:creationTime>
Nov 14 09:44:33 user nova-compute[75229]:       <nova:flavor name="m1.tiny">
Nov 14 09:44:33 user nova-compute[75229]:         <nova:memory>512</nova:memory>
Nov 14 09:44:33 user nova-compute[75229]:         <nova:disk>1</nova:disk>
Nov 14 09:44:33 user nova-compute[75229]:         <nova:swap>0</nova:swap>
Nov 14 09:44:33 user nova-compute[75229]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 09:44:33 user nova-compute[75229]:         <nova:vcpus>1</nova:vcpus>
Nov 14 09:44:33 user nova-compute[75229]:       </nova:flavor>
Nov 14 09:44:33 user nova-compute[75229]:       <nova:owner>
Nov 14 09:44:33 user nova-compute[75229]:         <nova:user uuid="b5ab788c6eca4c208943024e9d9ecdd8">tempest-VolumesActionsTest-433219387-project-member</nova:user>
Nov 14 09:44:33 user nova-compute[75229]:         <nova:project uuid="20105ee2c3b54e72a2733d4ae8521c85">tempest-VolumesActionsTest-433219387</nova:project>
Nov 14 09:44:33 user nova-compute[75229]:       </nova:owner>
Nov 14 09:44:33 user nova-compute[75229]:       <nova:root type="image" uuid="3bef8470-ecc7-40e3-95d4-9254348ea72d"/>
Nov 14 09:44:33 user nova-compute[75229]:       <nova:ports>
Nov 14 09:44:33 user nova-compute[75229]:         <nova:port uuid="93b50b64-d7f2-48d0-bedb-ce1f6f5f44d5">
Nov 14 09:44:33 user nova-compute[75229]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 14 09:44:33 user nova-compute[75229]:         </nova:port>
Nov 14 09:44:33 user nova-compute[75229]:       </nova:ports>
Nov 14 09:44:33 user nova-compute[75229]:     </nova:instance>
Nov 14 09:44:33 user nova-compute[75229]:   </metadata>
Nov 14 09:44:33 user nova-compute[75229]:   <sysinfo type="smbios">
Nov 14 09:44:33 user nova-compute[75229]:     <system>
Nov 14 09:44:33 user nova-compute[75229]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 09:44:33 user nova-compute[75229]:       <entry name="product">OpenStack Nova</entry>
Nov 14 09:44:33 user nova-compute[75229]:       <entry name="version">0.0.0</entry>
Nov 14 09:44:33 user nova-compute[75229]:       <entry name="serial">c9d3e03d-be75-44b1-97b4-36c13715175b</entry>
Nov 14 09:44:33 user nova-compute[75229]:       <entry name="uuid">c9d3e03d-be75-44b1-97b4-36c13715175b</entry>
Nov 14 09:44:33 user nova-compute[75229]:       <entry name="family">Virtual Machine</entry>
Nov 14 09:44:33 user nova-compute[75229]:     </system>
Nov 14 09:44:33 user nova-compute[75229]:   </sysinfo>
Nov 14 09:44:33 user nova-compute[75229]:   <os>
Nov 14 09:44:33 user nova-compute[75229]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 09:44:33 user nova-compute[75229]:     <boot dev="hd"/>
Nov 14 09:44:33 user nova-compute[75229]:     <smbios mode="sysinfo"/>
Nov 14 09:44:33 user nova-compute[75229]:   </os>
Nov 14 09:44:33 user nova-compute[75229]:   <features>
Nov 14 09:44:33 user nova-compute[75229]:     <acpi/>
Nov 14 09:44:33 user nova-compute[75229]:     <apic/>
Nov 14 09:44:33 user nova-compute[75229]:     <vmcoreinfo/>
Nov 14 09:44:33 user nova-compute[75229]:   </features>
Nov 14 09:44:33 user nova-compute[75229]:   <clock offset="utc">
Nov 14 09:44:33 user nova-compute[75229]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 09:44:33 user nova-compute[75229]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 09:44:33 user nova-compute[75229]:     <timer name="hpet" present="no"/>
Nov 14 09:44:33 user nova-compute[75229]:   </clock>
Nov 14 09:44:33 user nova-compute[75229]:   <cpu mode="custom" match="exact">
Nov 14 09:44:33 user nova-compute[75229]:     <model>Nehalem</model>
Nov 14 09:44:33 user nova-compute[75229]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 09:44:33 user nova-compute[75229]:   </cpu>
Nov 14 09:44:33 user nova-compute[75229]:   <devices>
Nov 14 09:44:33 user nova-compute[75229]:     <disk type="file" device="disk">
Nov 14 09:44:33 user nova-compute[75229]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 09:44:33 user nova-compute[75229]:       <source file="/opt/stack/data/nova/instances/c9d3e03d-be75-44b1-97b4-36c13715175b/disk"/>
Nov 14 09:44:33 user nova-compute[75229]:       <target dev="vda" bus="virtio"/>
Nov 14 09:44:33 user nova-compute[75229]:     </disk>
Nov 14 09:44:33 user nova-compute[75229]:     <interface type="ethernet">
Nov 14 09:44:33 user nova-compute[75229]:       <mac address="fa:16:3e:1e:66:d2"/>
Nov 14 09:44:33 user nova-compute[75229]:       <model type="virtio"/>
Nov 14 09:44:33 user nova-compute[75229]:       <mtu size="1442"/>
Nov 14 09:44:33 user nova-compute[75229]:       <target dev="tap93b50b64-d7"/>
Nov 14 09:44:33 user nova-compute[75229]:     </interface>
Nov 14 09:44:33 user nova-compute[75229]:     <serial type="pty">
Nov 14 09:44:33 user nova-compute[75229]:       <log file="/opt/stack/data/nova/instances/c9d3e03d-be75-44b1-97b4-36c13715175b/console.log" append="off"/>
Nov 14 09:44:33 user nova-compute[75229]:     </serial>
Nov 14 09:44:33 user nova-compute[75229]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 09:44:33 user nova-compute[75229]:     <video>
Nov 14 09:44:33 user nova-compute[75229]:       <model type="virtio"/>
Nov 14 09:44:33 user nova-compute[75229]:     </video>
Nov 14 09:44:33 user nova-compute[75229]:     <rng model="virtio">
Nov 14 09:44:33 user nova-compute[75229]:       <backend model="random">/dev/urandom</backend>
Nov 14 09:44:33 user nova-compute[75229]:     </rng>
Nov 14 09:44:33 user nova-compute[75229]:     <controller type="usb" index="0" model="none"/>
Nov 14 09:44:33 user nova-compute[75229]:     <memballoon model="virtio">
Nov 14 09:44:33 user nova-compute[75229]:       <stats period="10"/>
Nov 14 09:44:33 user nova-compute[75229]:     </memballoon>
Nov 14 09:44:33 user nova-compute[75229]:   </devices>
Nov 14 09:44:33 user nova-compute[75229]: </domain>
Nov 14 09:44:33 user nova-compute[75229]:  {{(pid=75229) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 09:44:33 user nova-compute[75229]: DEBUG nova.virt.libvirt.vif [None req-429dcfc7-1e9b-4657-9420-6a93f2309c0d tempest-VolumesActionsTest-433219387 tempest-VolumesActionsTest-433219387-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T09:44:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1619649382',display_name='tempest-VolumesActionsTest-instance-1619649382',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1619649382',id=10,image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='20105ee2c3b54e72a2733d4ae8521c85',ramdisk_id='',reservation_id='r-44osxnby',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-433219387',owner_user_name='tempest-VolumesActionsTest-433219387-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T09:44:31Z,user_data=None,user_id='b5ab788c6eca4c208943024e9d9ecdd8',uuid=c9d3e03d-be75-44b1-97b4-36c13715175b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "93b50b64-d7f2-48d0-bedb-ce1f6f5f44d5", "address": "fa:16:3e:1e:66:d2", "network": {"id": "12eca812-07b5-410d-be2d-5d950c49859b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1127953797-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20105ee2c3b54e72a2733d4ae8521c85", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93b50b64-d7", "ovs_interfaceid": "93b50b64-d7f2-48d0-bedb-ce1f6f5f44d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 09:44:33 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-429dcfc7-1e9b-4657-9420-6a93f2309c0d tempest-VolumesActionsTest-433219387 tempest-VolumesActionsTest-433219387-project-member] Converting VIF {"id": "93b50b64-d7f2-48d0-bedb-ce1f6f5f44d5", "address": "fa:16:3e:1e:66:d2", "network": {"id": "12eca812-07b5-410d-be2d-5d950c49859b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1127953797-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20105ee2c3b54e72a2733d4ae8521c85", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93b50b64-d7", "ovs_interfaceid": "93b50b64-d7f2-48d0-bedb-ce1f6f5f44d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 09:44:33 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-429dcfc7-1e9b-4657-9420-6a93f2309c0d tempest-VolumesActionsTest-433219387 tempest-VolumesActionsTest-433219387-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1e:66:d2,bridge_name='br-int',has_traffic_filtering=True,id=93b50b64-d7f2-48d0-bedb-ce1f6f5f44d5,network=Network(12eca812-07b5-410d-be2d-5d950c49859b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap93b50b64-d7') {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 09:44:33 user nova-compute[75229]: DEBUG os_vif [None req-429dcfc7-1e9b-4657-9420-6a93f2309c0d tempest-VolumesActionsTest-433219387 tempest-VolumesActionsTest-433219387-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1e:66:d2,bridge_name='br-int',has_traffic_filtering=True,id=93b50b64-d7f2-48d0-bedb-ce1f6f5f44d5,network=Network(12eca812-07b5-410d-be2d-5d950c49859b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap93b50b64-d7') {{(pid=75229) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 09:44:33 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:44:33 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:44:33 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 09:44:33 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:44:33 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '971ae862-13a8-5770-a12e-ede2e6801c88', '_type': 'linux-noop'}}, row=False) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:44:33 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 09:44:33 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:44:33 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap93b50b64-d7, may_exist=True, interface_attrs={}) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:44:33 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap93b50b64-d7, col_values=(('qos', UUID('e27e8357-fdc0-45fd-99f2-27fb6b7cb21e')),), if_exists=True) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:44:33 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap93b50b64-d7, col_values=(('external_ids', {'iface-id': '93b50b64-d7f2-48d0-bedb-ce1f6f5f44d5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1e:66:d2', 'vm-uuid': 'c9d3e03d-be75-44b1-97b4-36c13715175b'}),), if_exists=True) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:44:33 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:44:33 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 09:44:33 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:44:33 user nova-compute[75229]: INFO os_vif [None req-429dcfc7-1e9b-4657-9420-6a93f2309c0d tempest-VolumesActionsTest-433219387 tempest-VolumesActionsTest-433219387-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1e:66:d2,bridge_name='br-int',has_traffic_filtering=True,id=93b50b64-d7f2-48d0-bedb-ce1f6f5f44d5,network=Network(12eca812-07b5-410d-be2d-5d950c49859b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap93b50b64-d7')
Nov 14 09:44:34 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-429dcfc7-1e9b-4657-9420-6a93f2309c0d tempest-VolumesActionsTest-433219387 tempest-VolumesActionsTest-433219387-project-member] No BDM found with device name vda, not building metadata. {{(pid=75229) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 09:44:34 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-429dcfc7-1e9b-4657-9420-6a93f2309c0d tempest-VolumesActionsTest-433219387 tempest-VolumesActionsTest-433219387-project-member] No VIF found with MAC fa:16:3e:1e:66:d2, not building metadata {{(pid=75229) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 09:44:34 user nova-compute[75229]: DEBUG nova.network.neutron [req-b61ed3f2-e457-4121-93ca-f29addf943a6 req-f02e2c5c-999b-452e-a49e-9152f2d5145b service nova] [instance: c9d3e03d-be75-44b1-97b4-36c13715175b] Updated VIF entry in instance network info cache for port 93b50b64-d7f2-48d0-bedb-ce1f6f5f44d5. {{(pid=75229) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 09:44:34 user nova-compute[75229]: DEBUG nova.network.neutron [req-b61ed3f2-e457-4121-93ca-f29addf943a6 req-f02e2c5c-999b-452e-a49e-9152f2d5145b service nova] [instance: c9d3e03d-be75-44b1-97b4-36c13715175b] Updating instance_info_cache with network_info: [{"id": "93b50b64-d7f2-48d0-bedb-ce1f6f5f44d5", "address": "fa:16:3e:1e:66:d2", "network": {"id": "12eca812-07b5-410d-be2d-5d950c49859b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1127953797-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20105ee2c3b54e72a2733d4ae8521c85", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93b50b64-d7", "ovs_interfaceid": "93b50b64-d7f2-48d0-bedb-ce1f6f5f44d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 09:44:34 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-b61ed3f2-e457-4121-93ca-f29addf943a6 req-f02e2c5c-999b-452e-a49e-9152f2d5145b service nova] Releasing lock "refresh_cache-c9d3e03d-be75-44b1-97b4-36c13715175b" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 09:44:34 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-11c23928-73b0-4407-9d45-30f3ca8fd1e9 tempest-VolumesAssistedSnapshotsTest-596152604 tempest-VolumesAssistedSnapshotsTest-596152604-project-member] Acquiring lock "8623fdcc-99b7-44d6-ad81-dada5ba83a88" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:44:34 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-11c23928-73b0-4407-9d45-30f3ca8fd1e9 tempest-VolumesAssistedSnapshotsTest-596152604 tempest-VolumesAssistedSnapshotsTest-596152604-project-member] Lock "8623fdcc-99b7-44d6-ad81-dada5ba83a88" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:44:34 user nova-compute[75229]: DEBUG nova.compute.manager [None req-11c23928-73b0-4407-9d45-30f3ca8fd1e9 tempest-VolumesAssistedSnapshotsTest-596152604 tempest-VolumesAssistedSnapshotsTest-596152604-project-member] [instance: 8623fdcc-99b7-44d6-ad81-dada5ba83a88] Starting instance... {{(pid=75229) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 09:44:35 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-11c23928-73b0-4407-9d45-30f3ca8fd1e9 tempest-VolumesAssistedSnapshotsTest-596152604 tempest-VolumesAssistedSnapshotsTest-596152604-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:44:35 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-11c23928-73b0-4407-9d45-30f3ca8fd1e9 tempest-VolumesAssistedSnapshotsTest-596152604 tempest-VolumesAssistedSnapshotsTest-596152604-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:44:35 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-11c23928-73b0-4407-9d45-30f3ca8fd1e9 tempest-VolumesAssistedSnapshotsTest-596152604 tempest-VolumesAssistedSnapshotsTest-596152604-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75229) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 09:44:35 user nova-compute[75229]: INFO nova.compute.claims [None req-11c23928-73b0-4407-9d45-30f3ca8fd1e9 tempest-VolumesAssistedSnapshotsTest-596152604 tempest-VolumesAssistedSnapshotsTest-596152604-project-member] [instance: 8623fdcc-99b7-44d6-ad81-dada5ba83a88] Claim successful on node user
Nov 14 09:44:35 user nova-compute[75229]: DEBUG nova.compute.manager [req-28e3f8ff-3271-4670-8f1e-a269c9701d54 req-e224efed-69f0-4c6c-9e23-7e83525b3bb7 service nova] [instance: c307660b-01bb-471b-9e2e-5c2aaca65287] Received event network-vif-plugged-8e8a8e12-6ca8-4657-a4d4-e11c02ee8fa4 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:44:35 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-28e3f8ff-3271-4670-8f1e-a269c9701d54 req-e224efed-69f0-4c6c-9e23-7e83525b3bb7 service nova] Acquiring lock "c307660b-01bb-471b-9e2e-5c2aaca65287-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:44:35 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-28e3f8ff-3271-4670-8f1e-a269c9701d54 req-e224efed-69f0-4c6c-9e23-7e83525b3bb7 service nova] Lock "c307660b-01bb-471b-9e2e-5c2aaca65287-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:44:35 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-28e3f8ff-3271-4670-8f1e-a269c9701d54 req-e224efed-69f0-4c6c-9e23-7e83525b3bb7 service nova] Lock "c307660b-01bb-471b-9e2e-5c2aaca65287-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:44:35 user nova-compute[75229]: DEBUG nova.compute.manager [req-28e3f8ff-3271-4670-8f1e-a269c9701d54 req-e224efed-69f0-4c6c-9e23-7e83525b3bb7 service nova] [instance: c307660b-01bb-471b-9e2e-5c2aaca65287] No waiting events found dispatching network-vif-plugged-8e8a8e12-6ca8-4657-a4d4-e11c02ee8fa4 {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 09:44:35 user nova-compute[75229]: WARNING nova.compute.manager [req-28e3f8ff-3271-4670-8f1e-a269c9701d54 req-e224efed-69f0-4c6c-9e23-7e83525b3bb7 service nova] [instance: c307660b-01bb-471b-9e2e-5c2aaca65287] Received unexpected event network-vif-plugged-8e8a8e12-6ca8-4657-a4d4-e11c02ee8fa4 for instance with vm_state building and task_state spawning.
Nov 14 09:44:35 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:44:35 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:44:35 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:44:35 user nova-compute[75229]: DEBUG nova.compute.manager [None req-4b4efe05-1866-4fb6-a793-a43ec7f6e933 tempest-TestVolumeSwap-528292061 tempest-TestVolumeSwap-528292061-project-member] [instance: c307660b-01bb-471b-9e2e-5c2aaca65287] Instance event wait completed in 0 seconds for  {{(pid=75229) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 09:44:35 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-4b4efe05-1866-4fb6-a793-a43ec7f6e933 tempest-TestVolumeSwap-528292061 tempest-TestVolumeSwap-528292061-project-member] [instance: c307660b-01bb-471b-9e2e-5c2aaca65287] Guest created on hypervisor {{(pid=75229) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 09:44:35 user nova-compute[75229]: INFO nova.virt.libvirt.driver [-] [instance: c307660b-01bb-471b-9e2e-5c2aaca65287] Instance spawned successfully.
Nov 14 09:44:35 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-4b4efe05-1866-4fb6-a793-a43ec7f6e933 tempest-TestVolumeSwap-528292061 tempest-TestVolumeSwap-528292061-project-member] [instance: c307660b-01bb-471b-9e2e-5c2aaca65287] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 09:44:35 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-4b4efe05-1866-4fb6-a793-a43ec7f6e933 tempest-TestVolumeSwap-528292061 tempest-TestVolumeSwap-528292061-project-member] [instance: c307660b-01bb-471b-9e2e-5c2aaca65287] Found default for hw_cdrom_bus of ide {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 09:44:35 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-4b4efe05-1866-4fb6-a793-a43ec7f6e933 tempest-TestVolumeSwap-528292061 tempest-TestVolumeSwap-528292061-project-member] [instance: c307660b-01bb-471b-9e2e-5c2aaca65287] Found default for hw_disk_bus of virtio {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 09:44:35 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-4b4efe05-1866-4fb6-a793-a43ec7f6e933 tempest-TestVolumeSwap-528292061 tempest-TestVolumeSwap-528292061-project-member] [instance: c307660b-01bb-471b-9e2e-5c2aaca65287] Found default for hw_input_bus of None {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 09:44:35 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-4b4efe05-1866-4fb6-a793-a43ec7f6e933 tempest-TestVolumeSwap-528292061 tempest-TestVolumeSwap-528292061-project-member] [instance: c307660b-01bb-471b-9e2e-5c2aaca65287] Found default for hw_pointer_model of None {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 09:44:35 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-4b4efe05-1866-4fb6-a793-a43ec7f6e933 tempest-TestVolumeSwap-528292061 tempest-TestVolumeSwap-528292061-project-member] [instance: c307660b-01bb-471b-9e2e-5c2aaca65287] Found default for hw_video_model of virtio {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 09:44:35 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-4b4efe05-1866-4fb6-a793-a43ec7f6e933 tempest-TestVolumeSwap-528292061 tempest-TestVolumeSwap-528292061-project-member] [instance: c307660b-01bb-471b-9e2e-5c2aaca65287] Found default for hw_vif_model of virtio {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 09:44:35 user nova-compute[75229]: DEBUG nova.compute.provider_tree [None req-11c23928-73b0-4407-9d45-30f3ca8fd1e9 tempest-VolumesAssistedSnapshotsTest-596152604 tempest-VolumesAssistedSnapshotsTest-596152604-project-member] Inventory has not changed in ProviderTree for provider: d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 {{(pid=75229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 09:44:35 user nova-compute[75229]: DEBUG nova.scheduler.client.report [None req-11c23928-73b0-4407-9d45-30f3ca8fd1e9 tempest-VolumesAssistedSnapshotsTest-596152604 tempest-VolumesAssistedSnapshotsTest-596152604-project-member] Inventory has not changed for provider d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 09:44:35 user nova-compute[75229]: INFO nova.compute.manager [None req-4b4efe05-1866-4fb6-a793-a43ec7f6e933 tempest-TestVolumeSwap-528292061 tempest-TestVolumeSwap-528292061-project-member] [instance: c307660b-01bb-471b-9e2e-5c2aaca65287] Took 7.39 seconds to spawn the instance on the hypervisor.
Nov 14 09:44:35 user nova-compute[75229]: DEBUG nova.compute.manager [None req-4b4efe05-1866-4fb6-a793-a43ec7f6e933 tempest-TestVolumeSwap-528292061 tempest-TestVolumeSwap-528292061-project-member] [instance: c307660b-01bb-471b-9e2e-5c2aaca65287] Checking state {{(pid=75229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 09:44:35 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-11c23928-73b0-4407-9d45-30f3ca8fd1e9 tempest-VolumesAssistedSnapshotsTest-596152604 tempest-VolumesAssistedSnapshotsTest-596152604-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.849s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:44:35 user nova-compute[75229]: DEBUG nova.compute.manager [None req-11c23928-73b0-4407-9d45-30f3ca8fd1e9 tempest-VolumesAssistedSnapshotsTest-596152604 tempest-VolumesAssistedSnapshotsTest-596152604-project-member] [instance: 8623fdcc-99b7-44d6-ad81-dada5ba83a88] Start building networks asynchronously for instance. {{(pid=75229) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 09:44:36 user nova-compute[75229]: DEBUG nova.compute.manager [None req-11c23928-73b0-4407-9d45-30f3ca8fd1e9 tempest-VolumesAssistedSnapshotsTest-596152604 tempest-VolumesAssistedSnapshotsTest-596152604-project-member] [instance: 8623fdcc-99b7-44d6-ad81-dada5ba83a88] Allocating IP information in the background. {{(pid=75229) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 09:44:36 user nova-compute[75229]: DEBUG nova.network.neutron [None req-11c23928-73b0-4407-9d45-30f3ca8fd1e9 tempest-VolumesAssistedSnapshotsTest-596152604 tempest-VolumesAssistedSnapshotsTest-596152604-project-member] [instance: 8623fdcc-99b7-44d6-ad81-dada5ba83a88] allocate_for_instance() {{(pid=75229) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 09:44:36 user nova-compute[75229]: INFO nova.compute.manager [None req-4b4efe05-1866-4fb6-a793-a43ec7f6e933 tempest-TestVolumeSwap-528292061 tempest-TestVolumeSwap-528292061-project-member] [instance: c307660b-01bb-471b-9e2e-5c2aaca65287] Took 9.22 seconds to build instance.
Nov 14 09:44:36 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-11c23928-73b0-4407-9d45-30f3ca8fd1e9 tempest-VolumesAssistedSnapshotsTest-596152604 tempest-VolumesAssistedSnapshotsTest-596152604-project-member] [instance: 8623fdcc-99b7-44d6-ad81-dada5ba83a88] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 09:44:36 user nova-compute[75229]: DEBUG nova.compute.manager [None req-11c23928-73b0-4407-9d45-30f3ca8fd1e9 tempest-VolumesAssistedSnapshotsTest-596152604 tempest-VolumesAssistedSnapshotsTest-596152604-project-member] [instance: 8623fdcc-99b7-44d6-ad81-dada5ba83a88] Start building block device mappings for instance. {{(pid=75229) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 09:44:36 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-4b4efe05-1866-4fb6-a793-a43ec7f6e933 tempest-TestVolumeSwap-528292061 tempest-TestVolumeSwap-528292061-project-member] Lock "c307660b-01bb-471b-9e2e-5c2aaca65287" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.389s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:44:36 user nova-compute[75229]: DEBUG nova.policy [None req-11c23928-73b0-4407-9d45-30f3ca8fd1e9 tempest-VolumesAssistedSnapshotsTest-596152604 tempest-VolumesAssistedSnapshotsTest-596152604-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '95d8d6147d9245a1925bd5d4129a1719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2a5354424047a8a460451f7fd08233', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75229) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 09:44:36 user nova-compute[75229]: DEBUG nova.compute.manager [None req-11c23928-73b0-4407-9d45-30f3ca8fd1e9 tempest-VolumesAssistedSnapshotsTest-596152604 tempest-VolumesAssistedSnapshotsTest-596152604-project-member] [instance: 8623fdcc-99b7-44d6-ad81-dada5ba83a88] Start spawning the instance on the hypervisor. {{(pid=75229) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 09:44:36 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-11c23928-73b0-4407-9d45-30f3ca8fd1e9 tempest-VolumesAssistedSnapshotsTest-596152604 tempest-VolumesAssistedSnapshotsTest-596152604-project-member] [instance: 8623fdcc-99b7-44d6-ad81-dada5ba83a88] Creating instance directory {{(pid=75229) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 09:44:36 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-11c23928-73b0-4407-9d45-30f3ca8fd1e9 tempest-VolumesAssistedSnapshotsTest-596152604 tempest-VolumesAssistedSnapshotsTest-596152604-project-member] [instance: 8623fdcc-99b7-44d6-ad81-dada5ba83a88] Creating image(s)
Nov 14 09:44:36 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-11c23928-73b0-4407-9d45-30f3ca8fd1e9 tempest-VolumesAssistedSnapshotsTest-596152604 tempest-VolumesAssistedSnapshotsTest-596152604-project-member] Acquiring lock "/opt/stack/data/nova/instances/8623fdcc-99b7-44d6-ad81-dada5ba83a88/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:44:36 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-11c23928-73b0-4407-9d45-30f3ca8fd1e9 tempest-VolumesAssistedSnapshotsTest-596152604 tempest-VolumesAssistedSnapshotsTest-596152604-project-member] Lock "/opt/stack/data/nova/instances/8623fdcc-99b7-44d6-ad81-dada5ba83a88/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:44:36 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-11c23928-73b0-4407-9d45-30f3ca8fd1e9 tempest-VolumesAssistedSnapshotsTest-596152604 tempest-VolumesAssistedSnapshotsTest-596152604-project-member] Lock "/opt/stack/data/nova/instances/8623fdcc-99b7-44d6-ad81-dada5ba83a88/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:44:36 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-11c23928-73b0-4407-9d45-30f3ca8fd1e9 tempest-VolumesAssistedSnapshotsTest-596152604 tempest-VolumesAssistedSnapshotsTest-596152604-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6 --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:44:36 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:44:36 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:44:36 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-11c23928-73b0-4407-9d45-30f3ca8fd1e9 tempest-VolumesAssistedSnapshotsTest-596152604 tempest-VolumesAssistedSnapshotsTest-596152604-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6 --force-share --output=json" returned: 0 in 0.256s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:44:36 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-11c23928-73b0-4407-9d45-30f3ca8fd1e9 tempest-VolumesAssistedSnapshotsTest-596152604 tempest-VolumesAssistedSnapshotsTest-596152604-project-member] Acquiring lock "4f30e3fe703d2381679612a57b1fb80a467f60b6" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:44:36 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-11c23928-73b0-4407-9d45-30f3ca8fd1e9 tempest-VolumesAssistedSnapshotsTest-596152604 tempest-VolumesAssistedSnapshotsTest-596152604-project-member] Lock "4f30e3fe703d2381679612a57b1fb80a467f60b6" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.004s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:44:36 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-11c23928-73b0-4407-9d45-30f3ca8fd1e9 tempest-VolumesAssistedSnapshotsTest-596152604 tempest-VolumesAssistedSnapshotsTest-596152604-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6 --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:44:36 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-11c23928-73b0-4407-9d45-30f3ca8fd1e9 tempest-VolumesAssistedSnapshotsTest-596152604 tempest-VolumesAssistedSnapshotsTest-596152604-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6 --force-share --output=json" returned: 0 in 0.225s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:44:36 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-11c23928-73b0-4407-9d45-30f3ca8fd1e9 tempest-VolumesAssistedSnapshotsTest-596152604 tempest-VolumesAssistedSnapshotsTest-596152604-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6,backing_fmt=raw /opt/stack/data/nova/instances/8623fdcc-99b7-44d6-ad81-dada5ba83a88/disk 1073741824 {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:44:36 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-11c23928-73b0-4407-9d45-30f3ca8fd1e9 tempest-VolumesAssistedSnapshotsTest-596152604 tempest-VolumesAssistedSnapshotsTest-596152604-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6,backing_fmt=raw /opt/stack/data/nova/instances/8623fdcc-99b7-44d6-ad81-dada5ba83a88/disk 1073741824" returned: 0 in 0.075s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:44:36 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-11c23928-73b0-4407-9d45-30f3ca8fd1e9 tempest-VolumesAssistedSnapshotsTest-596152604 tempest-VolumesAssistedSnapshotsTest-596152604-project-member] Lock "4f30e3fe703d2381679612a57b1fb80a467f60b6" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.308s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:44:36 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-11c23928-73b0-4407-9d45-30f3ca8fd1e9 tempest-VolumesAssistedSnapshotsTest-596152604 tempest-VolumesAssistedSnapshotsTest-596152604-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6 --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:44:37 user nova-compute[75229]: DEBUG nova.network.neutron [None req-11c23928-73b0-4407-9d45-30f3ca8fd1e9 tempest-VolumesAssistedSnapshotsTest-596152604 tempest-VolumesAssistedSnapshotsTest-596152604-project-member] [instance: 8623fdcc-99b7-44d6-ad81-dada5ba83a88] Successfully created port: 30dd46f1-cc37-46dd-a47e-0bc23a724804 {{(pid=75229) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 09:44:37 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-11c23928-73b0-4407-9d45-30f3ca8fd1e9 tempest-VolumesAssistedSnapshotsTest-596152604 tempest-VolumesAssistedSnapshotsTest-596152604-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6 --force-share --output=json" returned: 0 in 0.281s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:44:37 user nova-compute[75229]: DEBUG nova.virt.disk.api [None req-11c23928-73b0-4407-9d45-30f3ca8fd1e9 tempest-VolumesAssistedSnapshotsTest-596152604 tempest-VolumesAssistedSnapshotsTest-596152604-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8623fdcc-99b7-44d6-ad81-dada5ba83a88/disk. size=1073741824 {{(pid=75229) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 09:44:37 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-11c23928-73b0-4407-9d45-30f3ca8fd1e9 tempest-VolumesAssistedSnapshotsTest-596152604 tempest-VolumesAssistedSnapshotsTest-596152604-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8623fdcc-99b7-44d6-ad81-dada5ba83a88/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:44:37 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-11c23928-73b0-4407-9d45-30f3ca8fd1e9 tempest-VolumesAssistedSnapshotsTest-596152604 tempest-VolumesAssistedSnapshotsTest-596152604-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8623fdcc-99b7-44d6-ad81-dada5ba83a88/disk --force-share --output=json" returned: 0 in 0.274s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:44:37 user nova-compute[75229]: DEBUG nova.virt.disk.api [None req-11c23928-73b0-4407-9d45-30f3ca8fd1e9 tempest-VolumesAssistedSnapshotsTest-596152604 tempest-VolumesAssistedSnapshotsTest-596152604-project-member] Cannot resize image /opt/stack/data/nova/instances/8623fdcc-99b7-44d6-ad81-dada5ba83a88/disk to a smaller size. {{(pid=75229) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 09:44:37 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-11c23928-73b0-4407-9d45-30f3ca8fd1e9 tempest-VolumesAssistedSnapshotsTest-596152604 tempest-VolumesAssistedSnapshotsTest-596152604-project-member] [instance: 8623fdcc-99b7-44d6-ad81-dada5ba83a88] Created local disks {{(pid=75229) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 09:44:37 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-11c23928-73b0-4407-9d45-30f3ca8fd1e9 tempest-VolumesAssistedSnapshotsTest-596152604 tempest-VolumesAssistedSnapshotsTest-596152604-project-member] [instance: 8623fdcc-99b7-44d6-ad81-dada5ba83a88] Ensure instance console log exists: /opt/stack/data/nova/instances/8623fdcc-99b7-44d6-ad81-dada5ba83a88/console.log {{(pid=75229) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 09:44:37 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-11c23928-73b0-4407-9d45-30f3ca8fd1e9 tempest-VolumesAssistedSnapshotsTest-596152604 tempest-VolumesAssistedSnapshotsTest-596152604-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:44:37 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-11c23928-73b0-4407-9d45-30f3ca8fd1e9 tempest-VolumesAssistedSnapshotsTest-596152604 tempest-VolumesAssistedSnapshotsTest-596152604-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:44:37 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-11c23928-73b0-4407-9d45-30f3ca8fd1e9 tempest-VolumesAssistedSnapshotsTest-596152604 tempest-VolumesAssistedSnapshotsTest-596152604-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:44:37 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:44:38 user nova-compute[75229]: DEBUG nova.network.neutron [None req-11c23928-73b0-4407-9d45-30f3ca8fd1e9 tempest-VolumesAssistedSnapshotsTest-596152604 tempest-VolumesAssistedSnapshotsTest-596152604-project-member] [instance: 8623fdcc-99b7-44d6-ad81-dada5ba83a88] Successfully updated port: 30dd46f1-cc37-46dd-a47e-0bc23a724804 {{(pid=75229) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 09:44:38 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-11c23928-73b0-4407-9d45-30f3ca8fd1e9 tempest-VolumesAssistedSnapshotsTest-596152604 tempest-VolumesAssistedSnapshotsTest-596152604-project-member] Acquiring lock "refresh_cache-8623fdcc-99b7-44d6-ad81-dada5ba83a88" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 09:44:38 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-11c23928-73b0-4407-9d45-30f3ca8fd1e9 tempest-VolumesAssistedSnapshotsTest-596152604 tempest-VolumesAssistedSnapshotsTest-596152604-project-member] Acquired lock "refresh_cache-8623fdcc-99b7-44d6-ad81-dada5ba83a88" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 09:44:38 user nova-compute[75229]: DEBUG nova.network.neutron [None req-11c23928-73b0-4407-9d45-30f3ca8fd1e9 tempest-VolumesAssistedSnapshotsTest-596152604 tempest-VolumesAssistedSnapshotsTest-596152604-project-member] [instance: 8623fdcc-99b7-44d6-ad81-dada5ba83a88] Building network info cache for instance {{(pid=75229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 09:44:38 user nova-compute[75229]: DEBUG nova.compute.manager [req-c6e52c87-e0c3-40a7-9a98-ba745b5fb7c1 req-329e2d34-9944-4eb1-8a3d-a5ad9a436809 service nova] [instance: 8623fdcc-99b7-44d6-ad81-dada5ba83a88] Received event network-changed-30dd46f1-cc37-46dd-a47e-0bc23a724804 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:44:38 user nova-compute[75229]: DEBUG nova.compute.manager [req-c6e52c87-e0c3-40a7-9a98-ba745b5fb7c1 req-329e2d34-9944-4eb1-8a3d-a5ad9a436809 service nova] [instance: 8623fdcc-99b7-44d6-ad81-dada5ba83a88] Refreshing instance network info cache due to event network-changed-30dd46f1-cc37-46dd-a47e-0bc23a724804. {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 09:44:38 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-c6e52c87-e0c3-40a7-9a98-ba745b5fb7c1 req-329e2d34-9944-4eb1-8a3d-a5ad9a436809 service nova] Acquiring lock "refresh_cache-8623fdcc-99b7-44d6-ad81-dada5ba83a88" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 09:44:38 user nova-compute[75229]: DEBUG nova.compute.manager [None req-429dcfc7-1e9b-4657-9420-6a93f2309c0d tempest-VolumesActionsTest-433219387 tempest-VolumesActionsTest-433219387-project-member] [instance: c9d3e03d-be75-44b1-97b4-36c13715175b] Instance event wait completed in 0 seconds for  {{(pid=75229) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 09:44:38 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-429dcfc7-1e9b-4657-9420-6a93f2309c0d tempest-VolumesActionsTest-433219387 tempest-VolumesActionsTest-433219387-project-member] [instance: c9d3e03d-be75-44b1-97b4-36c13715175b] Guest created on hypervisor {{(pid=75229) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 09:44:38 user nova-compute[75229]: INFO nova.virt.libvirt.driver [-] [instance: c9d3e03d-be75-44b1-97b4-36c13715175b] Instance spawned successfully.
Nov 14 09:44:38 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-429dcfc7-1e9b-4657-9420-6a93f2309c0d tempest-VolumesActionsTest-433219387 tempest-VolumesActionsTest-433219387-project-member] [instance: c9d3e03d-be75-44b1-97b4-36c13715175b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 09:44:38 user nova-compute[75229]: DEBUG nova.network.neutron [None req-11c23928-73b0-4407-9d45-30f3ca8fd1e9 tempest-VolumesAssistedSnapshotsTest-596152604 tempest-VolumesAssistedSnapshotsTest-596152604-project-member] [instance: 8623fdcc-99b7-44d6-ad81-dada5ba83a88] Instance cache missing network info. {{(pid=75229) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 09:44:38 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-429dcfc7-1e9b-4657-9420-6a93f2309c0d tempest-VolumesActionsTest-433219387 tempest-VolumesActionsTest-433219387-project-member] [instance: c9d3e03d-be75-44b1-97b4-36c13715175b] Found default for hw_cdrom_bus of ide {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 09:44:38 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-429dcfc7-1e9b-4657-9420-6a93f2309c0d tempest-VolumesActionsTest-433219387 tempest-VolumesActionsTest-433219387-project-member] [instance: c9d3e03d-be75-44b1-97b4-36c13715175b] Found default for hw_disk_bus of virtio {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 09:44:38 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-429dcfc7-1e9b-4657-9420-6a93f2309c0d tempest-VolumesActionsTest-433219387 tempest-VolumesActionsTest-433219387-project-member] [instance: c9d3e03d-be75-44b1-97b4-36c13715175b] Found default for hw_input_bus of None {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 09:44:38 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-429dcfc7-1e9b-4657-9420-6a93f2309c0d tempest-VolumesActionsTest-433219387 tempest-VolumesActionsTest-433219387-project-member] [instance: c9d3e03d-be75-44b1-97b4-36c13715175b] Found default for hw_pointer_model of None {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 09:44:38 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-429dcfc7-1e9b-4657-9420-6a93f2309c0d tempest-VolumesActionsTest-433219387 tempest-VolumesActionsTest-433219387-project-member] [instance: c9d3e03d-be75-44b1-97b4-36c13715175b] Found default for hw_video_model of virtio {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 09:44:38 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-429dcfc7-1e9b-4657-9420-6a93f2309c0d tempest-VolumesActionsTest-433219387 tempest-VolumesActionsTest-433219387-project-member] [instance: c9d3e03d-be75-44b1-97b4-36c13715175b] Found default for hw_vif_model of virtio {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 09:44:38 user nova-compute[75229]: INFO nova.compute.manager [None req-429dcfc7-1e9b-4657-9420-6a93f2309c0d tempest-VolumesActionsTest-433219387 tempest-VolumesActionsTest-433219387-project-member] [instance: c9d3e03d-be75-44b1-97b4-36c13715175b] Took 7.71 seconds to spawn the instance on the hypervisor.
Nov 14 09:44:38 user nova-compute[75229]: DEBUG nova.compute.manager [None req-429dcfc7-1e9b-4657-9420-6a93f2309c0d tempest-VolumesActionsTest-433219387 tempest-VolumesActionsTest-433219387-project-member] [instance: c9d3e03d-be75-44b1-97b4-36c13715175b] Checking state {{(pid=75229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 09:44:38 user nova-compute[75229]: DEBUG nova.network.neutron [None req-11c23928-73b0-4407-9d45-30f3ca8fd1e9 tempest-VolumesAssistedSnapshotsTest-596152604 tempest-VolumesAssistedSnapshotsTest-596152604-project-member] [instance: 8623fdcc-99b7-44d6-ad81-dada5ba83a88] Updating instance_info_cache with network_info: [{"id": "30dd46f1-cc37-46dd-a47e-0bc23a724804", "address": "fa:16:3e:86:32:73", "network": {"id": "6c0e2cbe-bbea-4552-a531-80981937bc7d", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-995922753-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7e2a5354424047a8a460451f7fd08233", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30dd46f1-cc", "ovs_interfaceid": "30dd46f1-cc37-46dd-a47e-0bc23a724804", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 09:44:38 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-11c23928-73b0-4407-9d45-30f3ca8fd1e9 tempest-VolumesAssistedSnapshotsTest-596152604 tempest-VolumesAssistedSnapshotsTest-596152604-project-member] Releasing lock "refresh_cache-8623fdcc-99b7-44d6-ad81-dada5ba83a88" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 09:44:38 user nova-compute[75229]: DEBUG nova.compute.manager [None req-11c23928-73b0-4407-9d45-30f3ca8fd1e9 tempest-VolumesAssistedSnapshotsTest-596152604 tempest-VolumesAssistedSnapshotsTest-596152604-project-member] [instance: 8623fdcc-99b7-44d6-ad81-dada5ba83a88] Instance network_info: |[{"id": "30dd46f1-cc37-46dd-a47e-0bc23a724804", "address": "fa:16:3e:86:32:73", "network": {"id": "6c0e2cbe-bbea-4552-a531-80981937bc7d", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-995922753-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7e2a5354424047a8a460451f7fd08233", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30dd46f1-cc", "ovs_interfaceid": "30dd46f1-cc37-46dd-a47e-0bc23a724804", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75229) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 09:44:38 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-c6e52c87-e0c3-40a7-9a98-ba745b5fb7c1 req-329e2d34-9944-4eb1-8a3d-a5ad9a436809 service nova] Acquired lock "refresh_cache-8623fdcc-99b7-44d6-ad81-dada5ba83a88" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 09:44:38 user nova-compute[75229]: DEBUG nova.network.neutron [req-c6e52c87-e0c3-40a7-9a98-ba745b5fb7c1 req-329e2d34-9944-4eb1-8a3d-a5ad9a436809 service nova] [instance: 8623fdcc-99b7-44d6-ad81-dada5ba83a88] Refreshing network info cache for port 30dd46f1-cc37-46dd-a47e-0bc23a724804 {{(pid=75229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 09:44:38 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-11c23928-73b0-4407-9d45-30f3ca8fd1e9 tempest-VolumesAssistedSnapshotsTest-596152604 tempest-VolumesAssistedSnapshotsTest-596152604-project-member] [instance: 8623fdcc-99b7-44d6-ad81-dada5ba83a88] Start _get_guest_xml network_info=[{"id": "30dd46f1-cc37-46dd-a47e-0bc23a724804", "address": "fa:16:3e:86:32:73", "network": {"id": "6c0e2cbe-bbea-4552-a531-80981937bc7d", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-995922753-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7e2a5354424047a8a460451f7fd08233", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30dd46f1-cc", "ovs_interfaceid": "30dd46f1-cc37-46dd-a47e-0bc23a724804", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T09:40:10Z,direct_url=<?>,disk_format='qcow2',id=3bef8470-ecc7-40e3-95d4-9254348ea72d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='de5a91106b6948ed937a7178ff9464c4',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T09:40:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'disk_bus': 'virtio', 'guest_format': None, 'encryption_secret_uuid': None, 'size': 0, 'device_type': 'disk', 'image_id': '3bef8470-ecc7-40e3-95d4-9254348ea72d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75229) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 09:44:38 user nova-compute[75229]: WARNING nova.virt.libvirt.driver [None req-11c23928-73b0-4407-9d45-30f3ca8fd1e9 tempest-VolumesAssistedSnapshotsTest-596152604 tempest-VolumesAssistedSnapshotsTest-596152604-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 09:44:38 user nova-compute[75229]: WARNING nova.virt.libvirt.driver [None req-11c23928-73b0-4407-9d45-30f3ca8fd1e9 tempest-VolumesAssistedSnapshotsTest-596152604 tempest-VolumesAssistedSnapshotsTest-596152604-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 09:44:38 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-11c23928-73b0-4407-9d45-30f3ca8fd1e9 tempest-VolumesAssistedSnapshotsTest-596152604 tempest-VolumesAssistedSnapshotsTest-596152604-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75229) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 09:44:38 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-11c23928-73b0-4407-9d45-30f3ca8fd1e9 tempest-VolumesAssistedSnapshotsTest-596152604 tempest-VolumesAssistedSnapshotsTest-596152604-project-member] CPU controller missing on host. {{(pid=75229) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 09:44:38 user nova-compute[75229]: INFO nova.compute.manager [None req-429dcfc7-1e9b-4657-9420-6a93f2309c0d tempest-VolumesActionsTest-433219387 tempest-VolumesActionsTest-433219387-project-member] [instance: c9d3e03d-be75-44b1-97b4-36c13715175b] Took 9.20 seconds to build instance.
Nov 14 09:44:38 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-11c23928-73b0-4407-9d45-30f3ca8fd1e9 tempest-VolumesAssistedSnapshotsTest-596152604 tempest-VolumesAssistedSnapshotsTest-596152604-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75229) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 09:44:38 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-11c23928-73b0-4407-9d45-30f3ca8fd1e9 tempest-VolumesAssistedSnapshotsTest-596152604 tempest-VolumesAssistedSnapshotsTest-596152604-project-member] CPU controller found on host. {{(pid=75229) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 09:44:38 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-11c23928-73b0-4407-9d45-30f3ca8fd1e9 tempest-VolumesAssistedSnapshotsTest-596152604 tempest-VolumesAssistedSnapshotsTest-596152604-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75229) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 09:44:38 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-11c23928-73b0-4407-9d45-30f3ca8fd1e9 tempest-VolumesAssistedSnapshotsTest-596152604 tempest-VolumesAssistedSnapshotsTest-596152604-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T09:39:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T09:40:10Z,direct_url=<?>,disk_format='qcow2',id=3bef8470-ecc7-40e3-95d4-9254348ea72d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='de5a91106b6948ed937a7178ff9464c4',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T09:40:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 09:44:38 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-11c23928-73b0-4407-9d45-30f3ca8fd1e9 tempest-VolumesAssistedSnapshotsTest-596152604 tempest-VolumesAssistedSnapshotsTest-596152604-project-member] Flavor limits 0:0:0 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 09:44:38 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-11c23928-73b0-4407-9d45-30f3ca8fd1e9 tempest-VolumesAssistedSnapshotsTest-596152604 tempest-VolumesAssistedSnapshotsTest-596152604-project-member] Image limits 0:0:0 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 09:44:38 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-11c23928-73b0-4407-9d45-30f3ca8fd1e9 tempest-VolumesAssistedSnapshotsTest-596152604 tempest-VolumesAssistedSnapshotsTest-596152604-project-member] Flavor pref 0:0:0 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 09:44:38 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-11c23928-73b0-4407-9d45-30f3ca8fd1e9 tempest-VolumesAssistedSnapshotsTest-596152604 tempest-VolumesAssistedSnapshotsTest-596152604-project-member] Image pref 0:0:0 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 09:44:38 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-11c23928-73b0-4407-9d45-30f3ca8fd1e9 tempest-VolumesAssistedSnapshotsTest-596152604 tempest-VolumesAssistedSnapshotsTest-596152604-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 09:44:38 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-11c23928-73b0-4407-9d45-30f3ca8fd1e9 tempest-VolumesAssistedSnapshotsTest-596152604 tempest-VolumesAssistedSnapshotsTest-596152604-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 09:44:38 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-11c23928-73b0-4407-9d45-30f3ca8fd1e9 tempest-VolumesAssistedSnapshotsTest-596152604 tempest-VolumesAssistedSnapshotsTest-596152604-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75229) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 09:44:38 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-11c23928-73b0-4407-9d45-30f3ca8fd1e9 tempest-VolumesAssistedSnapshotsTest-596152604 tempest-VolumesAssistedSnapshotsTest-596152604-project-member] Got 1 possible topologies {{(pid=75229) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 09:44:38 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-11c23928-73b0-4407-9d45-30f3ca8fd1e9 tempest-VolumesAssistedSnapshotsTest-596152604 tempest-VolumesAssistedSnapshotsTest-596152604-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 09:44:38 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-11c23928-73b0-4407-9d45-30f3ca8fd1e9 tempest-VolumesAssistedSnapshotsTest-596152604 tempest-VolumesAssistedSnapshotsTest-596152604-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 09:44:38 user nova-compute[75229]: DEBUG nova.virt.libvirt.vif [None req-11c23928-73b0-4407-9d45-30f3ca8fd1e9 tempest-VolumesAssistedSnapshotsTest-596152604 tempest-VolumesAssistedSnapshotsTest-596152604-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T09:44:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1700226473',display_name='tempest-VolumesAssistedSnapshotsTest-server-1700226473',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1700226473',id=11,image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNHzbrGhIKRryEAooEFrmdhtpTP105NCjCp0wjXFAhS3+1eN0KDVHL1g8f26q5PeHJwM45sTS1o4N05nvewb+OVnWKy7+WvkXlCnjHvd6JW1dZm5rcuYMXoWX0+jgnpPdA==',key_name='tempest-keypair-2054757497',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7e2a5354424047a8a460451f7fd08233',ramdisk_id='',reservation_id='r-7blmt5mz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-596152604',owner_user_name='tempest-VolumesAssistedSnapshotsTest-596152604-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T09:44:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='95d8d6147d9245a1925bd5d4129a1719',uuid=8623fdcc-99b7-44d6-ad81-dada5ba83a88,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "30dd46f1-cc37-46dd-a47e-0bc23a724804", "address": "fa:16:3e:86:32:73", "network": {"id": "6c0e2cbe-bbea-4552-a531-80981937bc7d", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-995922753-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7e2a5354424047a8a460451f7fd08233", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30dd46f1-cc", "ovs_interfaceid": "30dd46f1-cc37-46dd-a47e-0bc23a724804", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75229) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 09:44:38 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-11c23928-73b0-4407-9d45-30f3ca8fd1e9 tempest-VolumesAssistedSnapshotsTest-596152604 tempest-VolumesAssistedSnapshotsTest-596152604-project-member] Converting VIF {"id": "30dd46f1-cc37-46dd-a47e-0bc23a724804", "address": "fa:16:3e:86:32:73", "network": {"id": "6c0e2cbe-bbea-4552-a531-80981937bc7d", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-995922753-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7e2a5354424047a8a460451f7fd08233", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30dd46f1-cc", "ovs_interfaceid": "30dd46f1-cc37-46dd-a47e-0bc23a724804", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 09:44:38 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-11c23928-73b0-4407-9d45-30f3ca8fd1e9 tempest-VolumesAssistedSnapshotsTest-596152604 tempest-VolumesAssistedSnapshotsTest-596152604-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:86:32:73,bridge_name='br-int',has_traffic_filtering=True,id=30dd46f1-cc37-46dd-a47e-0bc23a724804,network=Network(6c0e2cbe-bbea-4552-a531-80981937bc7d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap30dd46f1-cc') {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 09:44:38 user nova-compute[75229]: DEBUG nova.objects.instance [None req-11c23928-73b0-4407-9d45-30f3ca8fd1e9 tempest-VolumesAssistedSnapshotsTest-596152604 tempest-VolumesAssistedSnapshotsTest-596152604-project-member] Lazy-loading 'pci_devices' on Instance uuid 8623fdcc-99b7-44d6-ad81-dada5ba83a88 {{(pid=75229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 09:44:38 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-429dcfc7-1e9b-4657-9420-6a93f2309c0d tempest-VolumesActionsTest-433219387 tempest-VolumesActionsTest-433219387-project-member] Lock "c9d3e03d-be75-44b1-97b4-36c13715175b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.472s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:44:38 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-11c23928-73b0-4407-9d45-30f3ca8fd1e9 tempest-VolumesAssistedSnapshotsTest-596152604 tempest-VolumesAssistedSnapshotsTest-596152604-project-member] [instance: 8623fdcc-99b7-44d6-ad81-dada5ba83a88] End _get_guest_xml xml=<domain type="kvm">
Nov 14 09:44:38 user nova-compute[75229]:   <uuid>8623fdcc-99b7-44d6-ad81-dada5ba83a88</uuid>
Nov 14 09:44:38 user nova-compute[75229]:   <name>instance-0000000b</name>
Nov 14 09:44:38 user nova-compute[75229]:   <memory>524288</memory>
Nov 14 09:44:38 user nova-compute[75229]:   <vcpu>1</vcpu>
Nov 14 09:44:38 user nova-compute[75229]:   <metadata>
Nov 14 09:44:38 user nova-compute[75229]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 09:44:38 user nova-compute[75229]:       <nova:package version="0.0.0"/>
Nov 14 09:44:38 user nova-compute[75229]:       <nova:name>tempest-VolumesAssistedSnapshotsTest-server-1700226473</nova:name>
Nov 14 09:44:38 user nova-compute[75229]:       <nova:creationTime>2023-11-14 09:44:38</nova:creationTime>
Nov 14 09:44:38 user nova-compute[75229]:       <nova:flavor name="m1.tiny">
Nov 14 09:44:38 user nova-compute[75229]:         <nova:memory>512</nova:memory>
Nov 14 09:44:38 user nova-compute[75229]:         <nova:disk>1</nova:disk>
Nov 14 09:44:38 user nova-compute[75229]:         <nova:swap>0</nova:swap>
Nov 14 09:44:38 user nova-compute[75229]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 09:44:38 user nova-compute[75229]:         <nova:vcpus>1</nova:vcpus>
Nov 14 09:44:38 user nova-compute[75229]:       </nova:flavor>
Nov 14 09:44:38 user nova-compute[75229]:       <nova:owner>
Nov 14 09:44:38 user nova-compute[75229]:         <nova:user uuid="95d8d6147d9245a1925bd5d4129a1719">tempest-VolumesAssistedSnapshotsTest-596152604-project-member</nova:user>
Nov 14 09:44:38 user nova-compute[75229]:         <nova:project uuid="7e2a5354424047a8a460451f7fd08233">tempest-VolumesAssistedSnapshotsTest-596152604</nova:project>
Nov 14 09:44:38 user nova-compute[75229]:       </nova:owner>
Nov 14 09:44:38 user nova-compute[75229]:       <nova:root type="image" uuid="3bef8470-ecc7-40e3-95d4-9254348ea72d"/>
Nov 14 09:44:38 user nova-compute[75229]:       <nova:ports>
Nov 14 09:44:38 user nova-compute[75229]:         <nova:port uuid="30dd46f1-cc37-46dd-a47e-0bc23a724804">
Nov 14 09:44:38 user nova-compute[75229]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 14 09:44:38 user nova-compute[75229]:         </nova:port>
Nov 14 09:44:38 user nova-compute[75229]:       </nova:ports>
Nov 14 09:44:38 user nova-compute[75229]:     </nova:instance>
Nov 14 09:44:38 user nova-compute[75229]:   </metadata>
Nov 14 09:44:38 user nova-compute[75229]:   <sysinfo type="smbios">
Nov 14 09:44:38 user nova-compute[75229]:     <system>
Nov 14 09:44:38 user nova-compute[75229]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 09:44:38 user nova-compute[75229]:       <entry name="product">OpenStack Nova</entry>
Nov 14 09:44:38 user nova-compute[75229]:       <entry name="version">0.0.0</entry>
Nov 14 09:44:38 user nova-compute[75229]:       <entry name="serial">8623fdcc-99b7-44d6-ad81-dada5ba83a88</entry>
Nov 14 09:44:38 user nova-compute[75229]:       <entry name="uuid">8623fdcc-99b7-44d6-ad81-dada5ba83a88</entry>
Nov 14 09:44:38 user nova-compute[75229]:       <entry name="family">Virtual Machine</entry>
Nov 14 09:44:38 user nova-compute[75229]:     </system>
Nov 14 09:44:38 user nova-compute[75229]:   </sysinfo>
Nov 14 09:44:38 user nova-compute[75229]:   <os>
Nov 14 09:44:38 user nova-compute[75229]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 09:44:38 user nova-compute[75229]:     <boot dev="hd"/>
Nov 14 09:44:38 user nova-compute[75229]:     <smbios mode="sysinfo"/>
Nov 14 09:44:38 user nova-compute[75229]:   </os>
Nov 14 09:44:38 user nova-compute[75229]:   <features>
Nov 14 09:44:38 user nova-compute[75229]:     <acpi/>
Nov 14 09:44:38 user nova-compute[75229]:     <apic/>
Nov 14 09:44:38 user nova-compute[75229]:     <vmcoreinfo/>
Nov 14 09:44:38 user nova-compute[75229]:   </features>
Nov 14 09:44:38 user nova-compute[75229]:   <clock offset="utc">
Nov 14 09:44:38 user nova-compute[75229]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 09:44:38 user nova-compute[75229]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 09:44:38 user nova-compute[75229]:     <timer name="hpet" present="no"/>
Nov 14 09:44:38 user nova-compute[75229]:   </clock>
Nov 14 09:44:38 user nova-compute[75229]:   <cpu mode="custom" match="exact">
Nov 14 09:44:38 user nova-compute[75229]:     <model>Nehalem</model>
Nov 14 09:44:38 user nova-compute[75229]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 09:44:38 user nova-compute[75229]:   </cpu>
Nov 14 09:44:38 user nova-compute[75229]:   <devices>
Nov 14 09:44:38 user nova-compute[75229]:     <disk type="file" device="disk">
Nov 14 09:44:38 user nova-compute[75229]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 09:44:38 user nova-compute[75229]:       <source file="/opt/stack/data/nova/instances/8623fdcc-99b7-44d6-ad81-dada5ba83a88/disk"/>
Nov 14 09:44:38 user nova-compute[75229]:       <target dev="vda" bus="virtio"/>
Nov 14 09:44:38 user nova-compute[75229]:     </disk>
Nov 14 09:44:38 user nova-compute[75229]:     <interface type="ethernet">
Nov 14 09:44:38 user nova-compute[75229]:       <mac address="fa:16:3e:86:32:73"/>
Nov 14 09:44:38 user nova-compute[75229]:       <model type="virtio"/>
Nov 14 09:44:38 user nova-compute[75229]:       <mtu size="1442"/>
Nov 14 09:44:38 user nova-compute[75229]:       <target dev="tap30dd46f1-cc"/>
Nov 14 09:44:38 user nova-compute[75229]:     </interface>
Nov 14 09:44:38 user nova-compute[75229]:     <serial type="pty">
Nov 14 09:44:38 user nova-compute[75229]:       <log file="/opt/stack/data/nova/instances/8623fdcc-99b7-44d6-ad81-dada5ba83a88/console.log" append="off"/>
Nov 14 09:44:38 user nova-compute[75229]:     </serial>
Nov 14 09:44:38 user nova-compute[75229]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 09:44:38 user nova-compute[75229]:     <video>
Nov 14 09:44:38 user nova-compute[75229]:       <model type="virtio"/>
Nov 14 09:44:38 user nova-compute[75229]:     </video>
Nov 14 09:44:38 user nova-compute[75229]:     <rng model="virtio">
Nov 14 09:44:38 user nova-compute[75229]:       <backend model="random">/dev/urandom</backend>
Nov 14 09:44:38 user nova-compute[75229]:     </rng>
Nov 14 09:44:38 user nova-compute[75229]:     <controller type="usb" index="0" model="none"/>
Nov 14 09:44:38 user nova-compute[75229]:     <memballoon model="virtio">
Nov 14 09:44:38 user nova-compute[75229]:       <stats period="10"/>
Nov 14 09:44:38 user nova-compute[75229]:     </memballoon>
Nov 14 09:44:38 user nova-compute[75229]:   </devices>
Nov 14 09:44:38 user nova-compute[75229]: </domain>
Nov 14 09:44:38 user nova-compute[75229]:  {{(pid=75229) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 09:44:38 user nova-compute[75229]: DEBUG nova.virt.libvirt.vif [None req-11c23928-73b0-4407-9d45-30f3ca8fd1e9 tempest-VolumesAssistedSnapshotsTest-596152604 tempest-VolumesAssistedSnapshotsTest-596152604-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T09:44:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1700226473',display_name='tempest-VolumesAssistedSnapshotsTest-server-1700226473',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1700226473',id=11,image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNHzbrGhIKRryEAooEFrmdhtpTP105NCjCp0wjXFAhS3+1eN0KDVHL1g8f26q5PeHJwM45sTS1o4N05nvewb+OVnWKy7+WvkXlCnjHvd6JW1dZm5rcuYMXoWX0+jgnpPdA==',key_name='tempest-keypair-2054757497',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7e2a5354424047a8a460451f7fd08233',ramdisk_id='',reservation_id='r-7blmt5mz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-596152604',owner_user_name='tempest-VolumesAssistedSnapshotsTest-596152604-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T09:44:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='95d8d6147d9245a1925bd5d4129a1719',uuid=8623fdcc-99b7-44d6-ad81-dada5ba83a88,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "30dd46f1-cc37-46dd-a47e-0bc23a724804", "address": "fa:16:3e:86:32:73", "network": {"id": "6c0e2cbe-bbea-4552-a531-80981937bc7d", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-995922753-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7e2a5354424047a8a460451f7fd08233", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30dd46f1-cc", "ovs_interfaceid": "30dd46f1-cc37-46dd-a47e-0bc23a724804", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 09:44:38 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-11c23928-73b0-4407-9d45-30f3ca8fd1e9 tempest-VolumesAssistedSnapshotsTest-596152604 tempest-VolumesAssistedSnapshotsTest-596152604-project-member] Converting VIF {"id": "30dd46f1-cc37-46dd-a47e-0bc23a724804", "address": "fa:16:3e:86:32:73", "network": {"id": "6c0e2cbe-bbea-4552-a531-80981937bc7d", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-995922753-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7e2a5354424047a8a460451f7fd08233", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30dd46f1-cc", "ovs_interfaceid": "30dd46f1-cc37-46dd-a47e-0bc23a724804", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 09:44:38 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-11c23928-73b0-4407-9d45-30f3ca8fd1e9 tempest-VolumesAssistedSnapshotsTest-596152604 tempest-VolumesAssistedSnapshotsTest-596152604-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:86:32:73,bridge_name='br-int',has_traffic_filtering=True,id=30dd46f1-cc37-46dd-a47e-0bc23a724804,network=Network(6c0e2cbe-bbea-4552-a531-80981937bc7d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap30dd46f1-cc') {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 09:44:38 user nova-compute[75229]: DEBUG os_vif [None req-11c23928-73b0-4407-9d45-30f3ca8fd1e9 tempest-VolumesAssistedSnapshotsTest-596152604 tempest-VolumesAssistedSnapshotsTest-596152604-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:86:32:73,bridge_name='br-int',has_traffic_filtering=True,id=30dd46f1-cc37-46dd-a47e-0bc23a724804,network=Network(6c0e2cbe-bbea-4552-a531-80981937bc7d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap30dd46f1-cc') {{(pid=75229) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 09:44:38 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:44:38 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:44:38 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 09:44:38 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:44:38 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd2935c9d-5654-51a6-9dc8-64c9db8bebbf', '_type': 'linux-noop'}}, row=False) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:44:38 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:44:38 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 09:44:38 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:44:38 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap30dd46f1-cc, may_exist=True, interface_attrs={}) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:44:38 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap30dd46f1-cc, col_values=(('qos', UUID('36eba990-ec1d-4e68-88ce-7092864be8af')),), if_exists=True) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:44:38 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap30dd46f1-cc, col_values=(('external_ids', {'iface-id': '30dd46f1-cc37-46dd-a47e-0bc23a724804', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:86:32:73', 'vm-uuid': '8623fdcc-99b7-44d6-ad81-dada5ba83a88'}),), if_exists=True) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:44:38 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:44:38 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 09:44:38 user nova-compute[75229]: INFO os_vif [None req-11c23928-73b0-4407-9d45-30f3ca8fd1e9 tempest-VolumesAssistedSnapshotsTest-596152604 tempest-VolumesAssistedSnapshotsTest-596152604-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:86:32:73,bridge_name='br-int',has_traffic_filtering=True,id=30dd46f1-cc37-46dd-a47e-0bc23a724804,network=Network(6c0e2cbe-bbea-4552-a531-80981937bc7d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap30dd46f1-cc')
Nov 14 09:44:38 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-11c23928-73b0-4407-9d45-30f3ca8fd1e9 tempest-VolumesAssistedSnapshotsTest-596152604 tempest-VolumesAssistedSnapshotsTest-596152604-project-member] No BDM found with device name vda, not building metadata. {{(pid=75229) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 09:44:38 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-11c23928-73b0-4407-9d45-30f3ca8fd1e9 tempest-VolumesAssistedSnapshotsTest-596152604 tempest-VolumesAssistedSnapshotsTest-596152604-project-member] No VIF found with MAC fa:16:3e:86:32:73, not building metadata {{(pid=75229) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 09:44:39 user nova-compute[75229]: DEBUG nova.network.neutron [req-c6e52c87-e0c3-40a7-9a98-ba745b5fb7c1 req-329e2d34-9944-4eb1-8a3d-a5ad9a436809 service nova] [instance: 8623fdcc-99b7-44d6-ad81-dada5ba83a88] Updated VIF entry in instance network info cache for port 30dd46f1-cc37-46dd-a47e-0bc23a724804. {{(pid=75229) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 09:44:39 user nova-compute[75229]: DEBUG nova.network.neutron [req-c6e52c87-e0c3-40a7-9a98-ba745b5fb7c1 req-329e2d34-9944-4eb1-8a3d-a5ad9a436809 service nova] [instance: 8623fdcc-99b7-44d6-ad81-dada5ba83a88] Updating instance_info_cache with network_info: [{"id": "30dd46f1-cc37-46dd-a47e-0bc23a724804", "address": "fa:16:3e:86:32:73", "network": {"id": "6c0e2cbe-bbea-4552-a531-80981937bc7d", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-995922753-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7e2a5354424047a8a460451f7fd08233", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30dd46f1-cc", "ovs_interfaceid": "30dd46f1-cc37-46dd-a47e-0bc23a724804", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 09:44:39 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-c6e52c87-e0c3-40a7-9a98-ba745b5fb7c1 req-329e2d34-9944-4eb1-8a3d-a5ad9a436809 service nova] Releasing lock "refresh_cache-8623fdcc-99b7-44d6-ad81-dada5ba83a88" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 09:44:40 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:44:40 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:44:40 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:44:41 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:44:41 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:44:41 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:44:41 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 09:44:41 user nova-compute[75229]: DEBUG nova.compute.manager [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Cleaning up deleted instances {{(pid=75229) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 14 09:44:41 user nova-compute[75229]: DEBUG nova.compute.manager [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] There are 0 instances to clean {{(pid=75229) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 14 09:44:41 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 09:44:41 user nova-compute[75229]: DEBUG nova.compute.manager [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75229) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 14 09:44:41 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 09:44:42 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:44:42 user nova-compute[75229]: DEBUG nova.compute.manager [None req-11c23928-73b0-4407-9d45-30f3ca8fd1e9 tempest-VolumesAssistedSnapshotsTest-596152604 tempest-VolumesAssistedSnapshotsTest-596152604-project-member] [instance: 8623fdcc-99b7-44d6-ad81-dada5ba83a88] Instance event wait completed in 0 seconds for  {{(pid=75229) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 09:44:42 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-11c23928-73b0-4407-9d45-30f3ca8fd1e9 tempest-VolumesAssistedSnapshotsTest-596152604 tempest-VolumesAssistedSnapshotsTest-596152604-project-member] [instance: 8623fdcc-99b7-44d6-ad81-dada5ba83a88] Guest created on hypervisor {{(pid=75229) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 09:44:42 user nova-compute[75229]: INFO nova.virt.libvirt.driver [-] [instance: 8623fdcc-99b7-44d6-ad81-dada5ba83a88] Instance spawned successfully.
Nov 14 09:44:42 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-11c23928-73b0-4407-9d45-30f3ca8fd1e9 tempest-VolumesAssistedSnapshotsTest-596152604 tempest-VolumesAssistedSnapshotsTest-596152604-project-member] [instance: 8623fdcc-99b7-44d6-ad81-dada5ba83a88] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 09:44:42 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-11c23928-73b0-4407-9d45-30f3ca8fd1e9 tempest-VolumesAssistedSnapshotsTest-596152604 tempest-VolumesAssistedSnapshotsTest-596152604-project-member] [instance: 8623fdcc-99b7-44d6-ad81-dada5ba83a88] Found default for hw_cdrom_bus of ide {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 09:44:42 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-11c23928-73b0-4407-9d45-30f3ca8fd1e9 tempest-VolumesAssistedSnapshotsTest-596152604 tempest-VolumesAssistedSnapshotsTest-596152604-project-member] [instance: 8623fdcc-99b7-44d6-ad81-dada5ba83a88] Found default for hw_disk_bus of virtio {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 09:44:42 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-11c23928-73b0-4407-9d45-30f3ca8fd1e9 tempest-VolumesAssistedSnapshotsTest-596152604 tempest-VolumesAssistedSnapshotsTest-596152604-project-member] [instance: 8623fdcc-99b7-44d6-ad81-dada5ba83a88] Found default for hw_input_bus of None {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 09:44:42 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-11c23928-73b0-4407-9d45-30f3ca8fd1e9 tempest-VolumesAssistedSnapshotsTest-596152604 tempest-VolumesAssistedSnapshotsTest-596152604-project-member] [instance: 8623fdcc-99b7-44d6-ad81-dada5ba83a88] Found default for hw_pointer_model of None {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 09:44:42 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-11c23928-73b0-4407-9d45-30f3ca8fd1e9 tempest-VolumesAssistedSnapshotsTest-596152604 tempest-VolumesAssistedSnapshotsTest-596152604-project-member] [instance: 8623fdcc-99b7-44d6-ad81-dada5ba83a88] Found default for hw_video_model of virtio {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 09:44:42 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-11c23928-73b0-4407-9d45-30f3ca8fd1e9 tempest-VolumesAssistedSnapshotsTest-596152604 tempest-VolumesAssistedSnapshotsTest-596152604-project-member] [instance: 8623fdcc-99b7-44d6-ad81-dada5ba83a88] Found default for hw_vif_model of virtio {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 09:44:43 user nova-compute[75229]: INFO nova.compute.manager [None req-11c23928-73b0-4407-9d45-30f3ca8fd1e9 tempest-VolumesAssistedSnapshotsTest-596152604 tempest-VolumesAssistedSnapshotsTest-596152604-project-member] [instance: 8623fdcc-99b7-44d6-ad81-dada5ba83a88] Took 6.69 seconds to spawn the instance on the hypervisor.
Nov 14 09:44:43 user nova-compute[75229]: DEBUG nova.compute.manager [None req-11c23928-73b0-4407-9d45-30f3ca8fd1e9 tempest-VolumesAssistedSnapshotsTest-596152604 tempest-VolumesAssistedSnapshotsTest-596152604-project-member] [instance: 8623fdcc-99b7-44d6-ad81-dada5ba83a88] Checking state {{(pid=75229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 09:44:43 user nova-compute[75229]: INFO nova.compute.manager [None req-11c23928-73b0-4407-9d45-30f3ca8fd1e9 tempest-VolumesAssistedSnapshotsTest-596152604 tempest-VolumesAssistedSnapshotsTest-596152604-project-member] [instance: 8623fdcc-99b7-44d6-ad81-dada5ba83a88] Took 8.03 seconds to build instance.
Nov 14 09:44:43 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-11c23928-73b0-4407-9d45-30f3ca8fd1e9 tempest-VolumesAssistedSnapshotsTest-596152604 tempest-VolumesAssistedSnapshotsTest-596152604-project-member] Lock "8623fdcc-99b7-44d6-ad81-dada5ba83a88" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.235s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:44:43 user nova-compute[75229]: DEBUG nova.compute.manager [req-86e725f5-754b-45d1-8edc-773a08de9363 req-d3c95865-67bc-4eec-8232-aa42ba8488e1 service nova] [instance: 359ff85c-c332-4059-8db4-689a0483d068] Received event network-vif-plugged-a799c237-ea4a-472d-b149-904fabda7414 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:44:43 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-86e725f5-754b-45d1-8edc-773a08de9363 req-d3c95865-67bc-4eec-8232-aa42ba8488e1 service nova] Acquiring lock "359ff85c-c332-4059-8db4-689a0483d068-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:44:43 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-86e725f5-754b-45d1-8edc-773a08de9363 req-d3c95865-67bc-4eec-8232-aa42ba8488e1 service nova] Lock "359ff85c-c332-4059-8db4-689a0483d068-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:44:43 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-86e725f5-754b-45d1-8edc-773a08de9363 req-d3c95865-67bc-4eec-8232-aa42ba8488e1 service nova] Lock "359ff85c-c332-4059-8db4-689a0483d068-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:44:43 user nova-compute[75229]: DEBUG nova.compute.manager [req-86e725f5-754b-45d1-8edc-773a08de9363 req-d3c95865-67bc-4eec-8232-aa42ba8488e1 service nova] [instance: 359ff85c-c332-4059-8db4-689a0483d068] No waiting events found dispatching network-vif-plugged-a799c237-ea4a-472d-b149-904fabda7414 {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 09:44:43 user nova-compute[75229]: WARNING nova.compute.manager [req-86e725f5-754b-45d1-8edc-773a08de9363 req-d3c95865-67bc-4eec-8232-aa42ba8488e1 service nova] [instance: 359ff85c-c332-4059-8db4-689a0483d068] Received unexpected event network-vif-plugged-a799c237-ea4a-472d-b149-904fabda7414 for instance with vm_state active and task_state None.
Nov 14 09:44:43 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 09:44:43 user nova-compute[75229]: DEBUG nova.compute.manager [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Starting heal instance info cache {{(pid=75229) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 09:44:43 user nova-compute[75229]: DEBUG nova.compute.manager [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Rebuilding the list of instances to heal {{(pid=75229) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 09:44:43 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:44:43 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Acquiring lock "refresh_cache-90bd76df-96cb-4bec-9862-853d94cdbaab" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 09:44:43 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Acquired lock "refresh_cache-90bd76df-96cb-4bec-9862-853d94cdbaab" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 09:44:43 user nova-compute[75229]: DEBUG nova.network.neutron [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] [instance: 90bd76df-96cb-4bec-9862-853d94cdbaab] Forcefully refreshing network info cache for instance {{(pid=75229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 09:44:43 user nova-compute[75229]: DEBUG nova.objects.instance [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Lazy-loading 'info_cache' on Instance uuid 90bd76df-96cb-4bec-9862-853d94cdbaab {{(pid=75229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 09:44:45 user nova-compute[75229]: DEBUG nova.network.neutron [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] [instance: 90bd76df-96cb-4bec-9862-853d94cdbaab] Updating instance_info_cache with network_info: [{"id": "3b9b5b2a-5b1b-4ec6-900d-c27e7c4a625e", "address": "fa:16:3e:6e:aa:df", "network": {"id": "589aea41-545f-4875-ab56-b7aa273dad6f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-785276916-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee9447f169de43829fe3ed51592752e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b9b5b2a-5b", "ovs_interfaceid": "3b9b5b2a-5b1b-4ec6-900d-c27e7c4a625e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 09:44:45 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Releasing lock "refresh_cache-90bd76df-96cb-4bec-9862-853d94cdbaab" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 09:44:45 user nova-compute[75229]: DEBUG nova.compute.manager [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] [instance: 90bd76df-96cb-4bec-9862-853d94cdbaab] Updated the network info_cache for instance {{(pid=75229) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 09:44:45 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 09:44:45 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 09:44:45 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 09:44:45 user nova-compute[75229]: DEBUG nova.compute.manager [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75229) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 09:44:45 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 09:44:45 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:44:45 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:44:45 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:44:45 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Auditing locally available compute resources for user (node: user) {{(pid=75229) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 09:44:45 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb53ba25-d865-41ae-90f3-6e154e2778ba/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:44:45 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb53ba25-d865-41ae-90f3-6e154e2778ba/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:44:45 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb53ba25-d865-41ae-90f3-6e154e2778ba/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:44:45 user nova-compute[75229]: DEBUG nova.compute.manager [req-44bab84b-02ae-4489-8f43-ff41348b02ea req-71ac0ea1-0953-4fa0-ae99-a1f80ad2bc29 service nova] [instance: 359ff85c-c332-4059-8db4-689a0483d068] Received event network-vif-plugged-a799c237-ea4a-472d-b149-904fabda7414 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:44:45 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-44bab84b-02ae-4489-8f43-ff41348b02ea req-71ac0ea1-0953-4fa0-ae99-a1f80ad2bc29 service nova] Acquiring lock "359ff85c-c332-4059-8db4-689a0483d068-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:44:45 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-44bab84b-02ae-4489-8f43-ff41348b02ea req-71ac0ea1-0953-4fa0-ae99-a1f80ad2bc29 service nova] Lock "359ff85c-c332-4059-8db4-689a0483d068-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:44:45 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-44bab84b-02ae-4489-8f43-ff41348b02ea req-71ac0ea1-0953-4fa0-ae99-a1f80ad2bc29 service nova] Lock "359ff85c-c332-4059-8db4-689a0483d068-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:44:45 user nova-compute[75229]: DEBUG nova.compute.manager [req-44bab84b-02ae-4489-8f43-ff41348b02ea req-71ac0ea1-0953-4fa0-ae99-a1f80ad2bc29 service nova] [instance: 359ff85c-c332-4059-8db4-689a0483d068] No waiting events found dispatching network-vif-plugged-a799c237-ea4a-472d-b149-904fabda7414 {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 09:44:45 user nova-compute[75229]: WARNING nova.compute.manager [req-44bab84b-02ae-4489-8f43-ff41348b02ea req-71ac0ea1-0953-4fa0-ae99-a1f80ad2bc29 service nova] [instance: 359ff85c-c332-4059-8db4-689a0483d068] Received unexpected event network-vif-plugged-a799c237-ea4a-472d-b149-904fabda7414 for instance with vm_state active and task_state None.
Nov 14 09:44:45 user nova-compute[75229]: DEBUG nova.compute.manager [req-44bab84b-02ae-4489-8f43-ff41348b02ea req-71ac0ea1-0953-4fa0-ae99-a1f80ad2bc29 service nova] [instance: eb53ba25-d865-41ae-90f3-6e154e2778ba] Received event network-vif-plugged-695e538f-be1d-4450-84a0-2a0bb92dd2ac {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:44:45 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-44bab84b-02ae-4489-8f43-ff41348b02ea req-71ac0ea1-0953-4fa0-ae99-a1f80ad2bc29 service nova] Acquiring lock "eb53ba25-d865-41ae-90f3-6e154e2778ba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:44:45 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-44bab84b-02ae-4489-8f43-ff41348b02ea req-71ac0ea1-0953-4fa0-ae99-a1f80ad2bc29 service nova] Lock "eb53ba25-d865-41ae-90f3-6e154e2778ba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:44:45 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-44bab84b-02ae-4489-8f43-ff41348b02ea req-71ac0ea1-0953-4fa0-ae99-a1f80ad2bc29 service nova] Lock "eb53ba25-d865-41ae-90f3-6e154e2778ba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:44:45 user nova-compute[75229]: DEBUG nova.compute.manager [req-44bab84b-02ae-4489-8f43-ff41348b02ea req-71ac0ea1-0953-4fa0-ae99-a1f80ad2bc29 service nova] [instance: eb53ba25-d865-41ae-90f3-6e154e2778ba] No waiting events found dispatching network-vif-plugged-695e538f-be1d-4450-84a0-2a0bb92dd2ac {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 09:44:45 user nova-compute[75229]: WARNING nova.compute.manager [req-44bab84b-02ae-4489-8f43-ff41348b02ea req-71ac0ea1-0953-4fa0-ae99-a1f80ad2bc29 service nova] [instance: eb53ba25-d865-41ae-90f3-6e154e2778ba] Received unexpected event network-vif-plugged-695e538f-be1d-4450-84a0-2a0bb92dd2ac for instance with vm_state active and task_state None.
Nov 14 09:44:45 user nova-compute[75229]: DEBUG nova.compute.manager [req-44bab84b-02ae-4489-8f43-ff41348b02ea req-71ac0ea1-0953-4fa0-ae99-a1f80ad2bc29 service nova] [instance: eb53ba25-d865-41ae-90f3-6e154e2778ba] Received event network-vif-plugged-695e538f-be1d-4450-84a0-2a0bb92dd2ac {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:44:45 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-44bab84b-02ae-4489-8f43-ff41348b02ea req-71ac0ea1-0953-4fa0-ae99-a1f80ad2bc29 service nova] Acquiring lock "eb53ba25-d865-41ae-90f3-6e154e2778ba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:44:45 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-44bab84b-02ae-4489-8f43-ff41348b02ea req-71ac0ea1-0953-4fa0-ae99-a1f80ad2bc29 service nova] Lock "eb53ba25-d865-41ae-90f3-6e154e2778ba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:44:45 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-44bab84b-02ae-4489-8f43-ff41348b02ea req-71ac0ea1-0953-4fa0-ae99-a1f80ad2bc29 service nova] Lock "eb53ba25-d865-41ae-90f3-6e154e2778ba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:44:45 user nova-compute[75229]: DEBUG nova.compute.manager [req-44bab84b-02ae-4489-8f43-ff41348b02ea req-71ac0ea1-0953-4fa0-ae99-a1f80ad2bc29 service nova] [instance: eb53ba25-d865-41ae-90f3-6e154e2778ba] No waiting events found dispatching network-vif-plugged-695e538f-be1d-4450-84a0-2a0bb92dd2ac {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 09:44:45 user nova-compute[75229]: WARNING nova.compute.manager [req-44bab84b-02ae-4489-8f43-ff41348b02ea req-71ac0ea1-0953-4fa0-ae99-a1f80ad2bc29 service nova] [instance: eb53ba25-d865-41ae-90f3-6e154e2778ba] Received unexpected event network-vif-plugged-695e538f-be1d-4450-84a0-2a0bb92dd2ac for instance with vm_state active and task_state None.
Nov 14 09:44:45 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb53ba25-d865-41ae-90f3-6e154e2778ba/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:44:45 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/359ff85c-c332-4059-8db4-689a0483d068/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:44:46 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/359ff85c-c332-4059-8db4-689a0483d068/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:44:46 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/359ff85c-c332-4059-8db4-689a0483d068/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:44:46 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/359ff85c-c332-4059-8db4-689a0483d068/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:44:46 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7750cbc-b3d0-44aa-8b88-c291ba007a8a/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:44:46 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7750cbc-b3d0-44aa-8b88-c291ba007a8a/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:44:46 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7750cbc-b3d0-44aa-8b88-c291ba007a8a/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:44:46 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7750cbc-b3d0-44aa-8b88-c291ba007a8a/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:44:46 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90bd76df-96cb-4bec-9862-853d94cdbaab/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:44:46 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90bd76df-96cb-4bec-9862-853d94cdbaab/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:44:46 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90bd76df-96cb-4bec-9862-853d94cdbaab/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:44:47 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90bd76df-96cb-4bec-9862-853d94cdbaab/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:44:47 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a60d339f-e134-477c-8505-bf8c79d2a21c/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:44:47 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a60d339f-e134-477c-8505-bf8c79d2a21c/disk --force-share --output=json" returned: 0 in 0.270s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:44:47 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a60d339f-e134-477c-8505-bf8c79d2a21c/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:44:47 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a60d339f-e134-477c-8505-bf8c79d2a21c/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:44:47 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-d5268eb3-e108-4421-b72a-35533ea3a492 tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] Acquiring lock "af5fd5af-63a6-4eee-a4ef-6088a3713214" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:44:47 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-d5268eb3-e108-4421-b72a-35533ea3a492 tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] Lock "af5fd5af-63a6-4eee-a4ef-6088a3713214" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:44:47 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6fa2298-7111-4660-a162-09269045d5e3/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:44:47 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:44:47 user nova-compute[75229]: DEBUG nova.compute.manager [None req-d5268eb3-e108-4421-b72a-35533ea3a492 tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] [instance: af5fd5af-63a6-4eee-a4ef-6088a3713214] Starting instance... {{(pid=75229) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 09:44:47 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-d5268eb3-e108-4421-b72a-35533ea3a492 tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:44:47 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-d5268eb3-e108-4421-b72a-35533ea3a492 tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:44:47 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-d5268eb3-e108-4421-b72a-35533ea3a492 tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75229) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 09:44:47 user nova-compute[75229]: INFO nova.compute.claims [None req-d5268eb3-e108-4421-b72a-35533ea3a492 tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] [instance: af5fd5af-63a6-4eee-a4ef-6088a3713214] Claim successful on node user
Nov 14 09:44:47 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6fa2298-7111-4660-a162-09269045d5e3/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:44:47 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6fa2298-7111-4660-a162-09269045d5e3/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:44:48 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6fa2298-7111-4660-a162-09269045d5e3/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:44:48 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9d3e03d-be75-44b1-97b4-36c13715175b/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:44:48 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9d3e03d-be75-44b1-97b4-36c13715175b/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:44:48 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9d3e03d-be75-44b1-97b4-36c13715175b/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:44:48 user nova-compute[75229]: DEBUG nova.compute.provider_tree [None req-d5268eb3-e108-4421-b72a-35533ea3a492 tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] Inventory has not changed in ProviderTree for provider: d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 {{(pid=75229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 09:44:48 user nova-compute[75229]: DEBUG nova.scheduler.client.report [None req-d5268eb3-e108-4421-b72a-35533ea3a492 tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] Inventory has not changed for provider d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 09:44:48 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9d3e03d-be75-44b1-97b4-36c13715175b/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:44:48 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37e63bd9-44fc-4d07-b31b-570f69d7bc8a/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:44:48 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-d5268eb3-e108-4421-b72a-35533ea3a492 tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.878s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:44:48 user nova-compute[75229]: DEBUG nova.compute.manager [None req-d5268eb3-e108-4421-b72a-35533ea3a492 tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] [instance: af5fd5af-63a6-4eee-a4ef-6088a3713214] Start building networks asynchronously for instance. {{(pid=75229) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 09:44:48 user nova-compute[75229]: DEBUG nova.compute.manager [None req-d5268eb3-e108-4421-b72a-35533ea3a492 tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] [instance: af5fd5af-63a6-4eee-a4ef-6088a3713214] Allocating IP information in the background. {{(pid=75229) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 09:44:48 user nova-compute[75229]: DEBUG nova.network.neutron [None req-d5268eb3-e108-4421-b72a-35533ea3a492 tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] [instance: af5fd5af-63a6-4eee-a4ef-6088a3713214] allocate_for_instance() {{(pid=75229) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 09:44:48 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-d5268eb3-e108-4421-b72a-35533ea3a492 tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] [instance: af5fd5af-63a6-4eee-a4ef-6088a3713214] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 09:44:48 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37e63bd9-44fc-4d07-b31b-570f69d7bc8a/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:44:48 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37e63bd9-44fc-4d07-b31b-570f69d7bc8a/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:44:48 user nova-compute[75229]: DEBUG nova.compute.manager [None req-d5268eb3-e108-4421-b72a-35533ea3a492 tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] [instance: af5fd5af-63a6-4eee-a4ef-6088a3713214] Start building block device mappings for instance. {{(pid=75229) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 09:44:48 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:44:48 user nova-compute[75229]: INFO nova.virt.block_device [None req-d5268eb3-e108-4421-b72a-35533ea3a492 tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] [instance: af5fd5af-63a6-4eee-a4ef-6088a3713214] Booting with volume c2324d4e-6e60-47fd-b536-144a7ea32dce at /dev/vda
Nov 14 09:44:49 user nova-compute[75229]: DEBUG os_brick.utils [None req-d5268eb3-e108-4421-b72a-35533ea3a492 tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 09:44:49 user nova-compute[75229]: INFO oslo.privsep.daemon [None req-d5268eb3-e108-4421-b72a-35533ea3a492 tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmpjebi5mba/privsep.sock']
Nov 14 09:44:49 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37e63bd9-44fc-4d07-b31b-570f69d7bc8a/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:44:49 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e09b3809-2e23-401c-9a72-88feb2bb657c/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:44:49 user sudo[86436]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmpjebi5mba/privsep.sock
Nov 14 09:44:49 user sudo[86436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 14 09:44:49 user nova-compute[75229]: DEBUG nova.policy [None req-d5268eb3-e108-4421-b72a-35533ea3a492 tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b040ec7bb6eb42ee9d25a5333297bfee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a9197db757f4a1cafd571eef8d47b15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75229) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 09:44:49 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e09b3809-2e23-401c-9a72-88feb2bb657c/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:44:49 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e09b3809-2e23-401c-9a72-88feb2bb657c/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:44:49 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e09b3809-2e23-401c-9a72-88feb2bb657c/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:44:49 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8623fdcc-99b7-44d6-ad81-dada5ba83a88/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:44:49 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8623fdcc-99b7-44d6-ad81-dada5ba83a88/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:44:49 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8623fdcc-99b7-44d6-ad81-dada5ba83a88/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:44:49 user nova-compute[75229]: DEBUG nova.network.neutron [None req-d5268eb3-e108-4421-b72a-35533ea3a492 tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] [instance: af5fd5af-63a6-4eee-a4ef-6088a3713214] Successfully created port: a1999f33-4f1d-47b0-a91a-48bce4600e9b {{(pid=75229) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 09:44:49 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8623fdcc-99b7-44d6-ad81-dada5ba83a88/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:44:49 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c307660b-01bb-471b-9e2e-5c2aaca65287/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:44:50 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c307660b-01bb-471b-9e2e-5c2aaca65287/disk --force-share --output=json" returned: 0 in 0.292s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:44:50 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c307660b-01bb-471b-9e2e-5c2aaca65287/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:44:50 user nova-compute[75229]: DEBUG nova.network.neutron [None req-d5268eb3-e108-4421-b72a-35533ea3a492 tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] [instance: af5fd5af-63a6-4eee-a4ef-6088a3713214] Successfully created port: 0979136b-2418-4434-9466-75d116e8c780 {{(pid=75229) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 09:44:50 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c307660b-01bb-471b-9e2e-5c2aaca65287/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:44:50 user sudo[86436]: pam_unix(sudo:session): session closed for user root
Nov 14 09:44:50 user nova-compute[75229]: DEBUG nova.network.neutron [None req-d5268eb3-e108-4421-b72a-35533ea3a492 tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] [instance: af5fd5af-63a6-4eee-a4ef-6088a3713214] Successfully created port: 1f37d277-e3ac-48ca-b618-27b872f41824 {{(pid=75229) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 09:44:50 user nova-compute[75229]: INFO oslo.privsep.daemon [None req-d5268eb3-e108-4421-b72a-35533ea3a492 tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] Spawned new privsep daemon via rootwrap
Nov 14 09:44:50 user nova-compute[75229]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 14 09:44:50 user nova-compute[75229]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 14 09:44:50 user nova-compute[75229]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_SYS_ADMIN/CAP_SYS_ADMIN/none
Nov 14 09:44:50 user nova-compute[75229]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 86458
Nov 14 09:44:50 user nova-compute[75229]: WARNING nova.virt.libvirt.driver [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 09:44:50 user nova-compute[75229]: WARNING nova.virt.libvirt.driver [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 09:44:50 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Hypervisor/Node resource view: name=user free_ram=7167MB free_disk=25.662254333496094GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75229) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 09:44:50 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:44:50 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:44:50 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e5099ff-6da5-4edc-ba2a-7677b2ca1f45]: (2,) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:44:50 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:44:51 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:44:51 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4470ada-f30a-4536-b242-fff4b712a54f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f1154031c835\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:44:51 user nova-compute[75229]: WARNING os_brick.initiator.connectors.nvmeof [None req-d5268eb3-e108-4421-b72a-35533ea3a492 tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath'
Nov 14 09:44:51 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:44:51 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:44:51 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[d84d0ac9-49ad-47b3-927c-0ebff73a3a43]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:44:51 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:44:51 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:44:51 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[228f01ee-2034-47c7-aadd-de360c7dbdb2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:44:51 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[d38b53a4-3095-449c-a0cd-014d0c219d48]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:44:51 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-d5268eb3-e108-4421-b72a-35533ea3a492 tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] Running cmd (subprocess): nvme version {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:44:51 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-d5268eb3-e108-4421-b72a-35533ea3a492 tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] 'nvme version' failed. Not Retrying. {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 09:44:51 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d5268eb3-e108-4421-b72a-35533ea3a492 tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] nvme not present on system {{(pid=75229) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 09:44:51 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:44:51 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 09:44:51 user nova-compute[75229]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 09:44:51 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[4566c930-b91b-44a1-bf47-70e004e4140a]: (4, '') {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:44:51 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.lightos [None req-d5268eb3-e108-4421-b72a-35533ea3a492 tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75229) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 09:44:51 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.lightos [None req-d5268eb3-e108-4421-b72a-35533ea3a492 tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75229) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 09:44:51 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.lightos [None req-d5268eb3-e108-4421-b72a-35533ea3a492 tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] LIGHTOS: no hostnqn found. {{(pid=75229) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 09:44:51 user nova-compute[75229]: DEBUG os_brick.utils [None req-d5268eb3-e108-4421-b72a-35533ea3a492 tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] <== get_connector_properties: return (2123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f1154031c835', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 09:44:51 user nova-compute[75229]: DEBUG nova.virt.block_device [None req-d5268eb3-e108-4421-b72a-35533ea3a492 tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] [instance: af5fd5af-63a6-4eee-a4ef-6088a3713214] Updating existing volume attachment record: 873513d8-60d2-4264-b10f-a93c66a70584 {{(pid=75229) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 09:44:51 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Instance 90bd76df-96cb-4bec-9862-853d94cdbaab actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 09:44:51 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Instance 359ff85c-c332-4059-8db4-689a0483d068 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 09:44:51 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Instance a7750cbc-b3d0-44aa-8b88-c291ba007a8a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 09:44:51 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Instance e09b3809-2e23-401c-9a72-88feb2bb657c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 09:44:51 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Instance a60d339f-e134-477c-8505-bf8c79d2a21c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 09:44:51 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Instance eb53ba25-d865-41ae-90f3-6e154e2778ba actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 09:44:51 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Instance 37e63bd9-44fc-4d07-b31b-570f69d7bc8a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 09:44:51 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Instance c6fa2298-7111-4660-a162-09269045d5e3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 09:44:51 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Instance c307660b-01bb-471b-9e2e-5c2aaca65287 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 09:44:51 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Instance c9d3e03d-be75-44b1-97b4-36c13715175b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 09:44:51 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Instance 8623fdcc-99b7-44d6-ad81-dada5ba83a88 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 09:44:51 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Instance af5fd5af-63a6-4eee-a4ef-6088a3713214 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 09:44:51 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=75229) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 09:44:51 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=75229) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 09:44:51 user nova-compute[75229]: DEBUG nova.scheduler.client.report [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Refreshing inventories for resource provider d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 {{(pid=75229) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 14 09:44:51 user nova-compute[75229]: DEBUG nova.scheduler.client.report [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Updating ProviderTree inventory for provider d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75229) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 14 09:44:51 user nova-compute[75229]: DEBUG nova.compute.provider_tree [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Updating inventory in ProviderTree for provider d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 14 09:44:51 user nova-compute[75229]: DEBUG nova.scheduler.client.report [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Refreshing aggregate associations for resource provider d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3, aggregates: None {{(pid=75229) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 14 09:44:51 user nova-compute[75229]: DEBUG nova.scheduler.client.report [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Refreshing trait associations for resource provider d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3, traits: COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_MMX,HW_CPU_X86_SSE42,HW_CPU_X86_SSSE3,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_TRUSTED_CERTS,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSE,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_USB,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_RESCUE_BFV {{(pid=75229) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 14 09:44:51 user nova-compute[75229]: DEBUG nova.compute.provider_tree [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Inventory has not changed in ProviderTree for provider: d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 {{(pid=75229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 09:44:51 user nova-compute[75229]: DEBUG nova.scheduler.client.report [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Inventory has not changed for provider d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 09:44:51 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Compute_service record updated for user:user {{(pid=75229) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 09:44:51 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:44:51 user nova-compute[75229]: DEBUG nova.network.neutron [None req-d5268eb3-e108-4421-b72a-35533ea3a492 tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] [instance: af5fd5af-63a6-4eee-a4ef-6088a3713214] Successfully created port: 768a662a-4bcd-4844-a9ed-f8b8f6b8aa0d {{(pid=75229) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 09:44:52 user nova-compute[75229]: DEBUG nova.network.neutron [None req-d5268eb3-e108-4421-b72a-35533ea3a492 tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] [instance: af5fd5af-63a6-4eee-a4ef-6088a3713214] Successfully created port: b7fff2b1-9f14-4632-83e2-3f0a8e4c788b {{(pid=75229) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 09:44:52 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 09:44:52 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 09:44:52 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 09:44:52 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 09:44:52 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:44:52 user nova-compute[75229]: DEBUG nova.network.neutron [None req-d5268eb3-e108-4421-b72a-35533ea3a492 tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] [instance: af5fd5af-63a6-4eee-a4ef-6088a3713214] Successfully updated port: a1999f33-4f1d-47b0-a91a-48bce4600e9b {{(pid=75229) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 09:44:52 user nova-compute[75229]: DEBUG nova.compute.manager [req-e7f9a2d8-81d9-40ed-a7d3-dc2aa71c0064 req-c28f9105-d837-470f-b025-92948d5fb005 service nova] [instance: af5fd5af-63a6-4eee-a4ef-6088a3713214] Received event network-changed-a1999f33-4f1d-47b0-a91a-48bce4600e9b {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:44:52 user nova-compute[75229]: DEBUG nova.compute.manager [req-e7f9a2d8-81d9-40ed-a7d3-dc2aa71c0064 req-c28f9105-d837-470f-b025-92948d5fb005 service nova] [instance: af5fd5af-63a6-4eee-a4ef-6088a3713214] Refreshing instance network info cache due to event network-changed-a1999f33-4f1d-47b0-a91a-48bce4600e9b. {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 09:44:52 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-e7f9a2d8-81d9-40ed-a7d3-dc2aa71c0064 req-c28f9105-d837-470f-b025-92948d5fb005 service nova] Acquiring lock "refresh_cache-af5fd5af-63a6-4eee-a4ef-6088a3713214" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 09:44:52 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-e7f9a2d8-81d9-40ed-a7d3-dc2aa71c0064 req-c28f9105-d837-470f-b025-92948d5fb005 service nova] Acquired lock "refresh_cache-af5fd5af-63a6-4eee-a4ef-6088a3713214" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 09:44:52 user nova-compute[75229]: DEBUG nova.network.neutron [req-e7f9a2d8-81d9-40ed-a7d3-dc2aa71c0064 req-c28f9105-d837-470f-b025-92948d5fb005 service nova] [instance: af5fd5af-63a6-4eee-a4ef-6088a3713214] Refreshing network info cache for port a1999f33-4f1d-47b0-a91a-48bce4600e9b {{(pid=75229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 09:44:53 user nova-compute[75229]: DEBUG nova.network.neutron [req-e7f9a2d8-81d9-40ed-a7d3-dc2aa71c0064 req-c28f9105-d837-470f-b025-92948d5fb005 service nova] [instance: af5fd5af-63a6-4eee-a4ef-6088a3713214] Instance cache missing network info. {{(pid=75229) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 09:44:53 user nova-compute[75229]: DEBUG nova.network.neutron [req-e7f9a2d8-81d9-40ed-a7d3-dc2aa71c0064 req-c28f9105-d837-470f-b025-92948d5fb005 service nova] [instance: af5fd5af-63a6-4eee-a4ef-6088a3713214] Updating instance_info_cache with network_info: [] {{(pid=75229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 09:44:53 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-e7f9a2d8-81d9-40ed-a7d3-dc2aa71c0064 req-c28f9105-d837-470f-b025-92948d5fb005 service nova] Releasing lock "refresh_cache-af5fd5af-63a6-4eee-a4ef-6088a3713214" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 09:44:53 user nova-compute[75229]: DEBUG nova.network.neutron [None req-d5268eb3-e108-4421-b72a-35533ea3a492 tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] [instance: af5fd5af-63a6-4eee-a4ef-6088a3713214] Successfully updated port: 2f37eb91-97ea-477b-b6c1-933b50ccfca6 {{(pid=75229) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 09:44:53 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:44:54 user nova-compute[75229]: DEBUG nova.network.neutron [None req-d5268eb3-e108-4421-b72a-35533ea3a492 tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] [instance: af5fd5af-63a6-4eee-a4ef-6088a3713214] Successfully updated port: f8dc5389-6e53-421a-9a3a-6c90a89a6eb2 {{(pid=75229) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 09:44:54 user nova-compute[75229]: DEBUG nova.network.neutron [None req-d5268eb3-e108-4421-b72a-35533ea3a492 tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] [instance: af5fd5af-63a6-4eee-a4ef-6088a3713214] Successfully updated port: 0979136b-2418-4434-9466-75d116e8c780 {{(pid=75229) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 09:44:54 user nova-compute[75229]: DEBUG nova.compute.manager [req-032f1bc9-b9ff-498c-9fbc-2609254de9b7 req-e2b044c1-71dd-4ca0-a216-3ac944040d90 service nova] [instance: af5fd5af-63a6-4eee-a4ef-6088a3713214] Received event network-changed-2f37eb91-97ea-477b-b6c1-933b50ccfca6 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:44:54 user nova-compute[75229]: DEBUG nova.compute.manager [req-032f1bc9-b9ff-498c-9fbc-2609254de9b7 req-e2b044c1-71dd-4ca0-a216-3ac944040d90 service nova] [instance: af5fd5af-63a6-4eee-a4ef-6088a3713214] Refreshing instance network info cache due to event network-changed-2f37eb91-97ea-477b-b6c1-933b50ccfca6. {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 09:44:54 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-032f1bc9-b9ff-498c-9fbc-2609254de9b7 req-e2b044c1-71dd-4ca0-a216-3ac944040d90 service nova] Acquiring lock "refresh_cache-af5fd5af-63a6-4eee-a4ef-6088a3713214" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 09:44:54 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-032f1bc9-b9ff-498c-9fbc-2609254de9b7 req-e2b044c1-71dd-4ca0-a216-3ac944040d90 service nova] Acquired lock "refresh_cache-af5fd5af-63a6-4eee-a4ef-6088a3713214" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 09:44:54 user nova-compute[75229]: DEBUG nova.network.neutron [req-032f1bc9-b9ff-498c-9fbc-2609254de9b7 req-e2b044c1-71dd-4ca0-a216-3ac944040d90 service nova] [instance: af5fd5af-63a6-4eee-a4ef-6088a3713214] Refreshing network info cache for port 2f37eb91-97ea-477b-b6c1-933b50ccfca6 {{(pid=75229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 09:44:55 user nova-compute[75229]: DEBUG nova.network.neutron [req-032f1bc9-b9ff-498c-9fbc-2609254de9b7 req-e2b044c1-71dd-4ca0-a216-3ac944040d90 service nova] [instance: af5fd5af-63a6-4eee-a4ef-6088a3713214] Instance cache missing network info. {{(pid=75229) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 09:44:55 user nova-compute[75229]: DEBUG nova.network.neutron [req-032f1bc9-b9ff-498c-9fbc-2609254de9b7 req-e2b044c1-71dd-4ca0-a216-3ac944040d90 service nova] [instance: af5fd5af-63a6-4eee-a4ef-6088a3713214] Updating instance_info_cache with network_info: [] {{(pid=75229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 09:44:55 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-032f1bc9-b9ff-498c-9fbc-2609254de9b7 req-e2b044c1-71dd-4ca0-a216-3ac944040d90 service nova] Releasing lock "refresh_cache-af5fd5af-63a6-4eee-a4ef-6088a3713214" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 09:44:55 user nova-compute[75229]: DEBUG nova.compute.manager [req-032f1bc9-b9ff-498c-9fbc-2609254de9b7 req-e2b044c1-71dd-4ca0-a216-3ac944040d90 service nova] [instance: af5fd5af-63a6-4eee-a4ef-6088a3713214] Received event network-changed-f8dc5389-6e53-421a-9a3a-6c90a89a6eb2 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:44:55 user nova-compute[75229]: DEBUG nova.compute.manager [req-032f1bc9-b9ff-498c-9fbc-2609254de9b7 req-e2b044c1-71dd-4ca0-a216-3ac944040d90 service nova] [instance: af5fd5af-63a6-4eee-a4ef-6088a3713214] Refreshing instance network info cache due to event network-changed-f8dc5389-6e53-421a-9a3a-6c90a89a6eb2. {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 09:44:55 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-032f1bc9-b9ff-498c-9fbc-2609254de9b7 req-e2b044c1-71dd-4ca0-a216-3ac944040d90 service nova] Acquiring lock "refresh_cache-af5fd5af-63a6-4eee-a4ef-6088a3713214" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 09:44:55 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-032f1bc9-b9ff-498c-9fbc-2609254de9b7 req-e2b044c1-71dd-4ca0-a216-3ac944040d90 service nova] Acquired lock "refresh_cache-af5fd5af-63a6-4eee-a4ef-6088a3713214" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 09:44:55 user nova-compute[75229]: DEBUG nova.network.neutron [req-032f1bc9-b9ff-498c-9fbc-2609254de9b7 req-e2b044c1-71dd-4ca0-a216-3ac944040d90 service nova] [instance: af5fd5af-63a6-4eee-a4ef-6088a3713214] Refreshing network info cache for port f8dc5389-6e53-421a-9a3a-6c90a89a6eb2 {{(pid=75229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 09:44:55 user nova-compute[75229]: DEBUG nova.network.neutron [None req-d5268eb3-e108-4421-b72a-35533ea3a492 tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] [instance: af5fd5af-63a6-4eee-a4ef-6088a3713214] Successfully updated port: 1f37d277-e3ac-48ca-b618-27b872f41824 {{(pid=75229) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 09:44:55 user nova-compute[75229]: DEBUG nova.network.neutron [req-032f1bc9-b9ff-498c-9fbc-2609254de9b7 req-e2b044c1-71dd-4ca0-a216-3ac944040d90 service nova] [instance: af5fd5af-63a6-4eee-a4ef-6088a3713214] Instance cache missing network info. {{(pid=75229) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 09:44:55 user nova-compute[75229]: DEBUG nova.network.neutron [req-032f1bc9-b9ff-498c-9fbc-2609254de9b7 req-e2b044c1-71dd-4ca0-a216-3ac944040d90 service nova] [instance: af5fd5af-63a6-4eee-a4ef-6088a3713214] Updating instance_info_cache with network_info: [] {{(pid=75229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 09:44:55 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-032f1bc9-b9ff-498c-9fbc-2609254de9b7 req-e2b044c1-71dd-4ca0-a216-3ac944040d90 service nova] Releasing lock "refresh_cache-af5fd5af-63a6-4eee-a4ef-6088a3713214" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 09:44:55 user nova-compute[75229]: DEBUG nova.compute.manager [req-032f1bc9-b9ff-498c-9fbc-2609254de9b7 req-e2b044c1-71dd-4ca0-a216-3ac944040d90 service nova] [instance: af5fd5af-63a6-4eee-a4ef-6088a3713214] Received event network-changed-0979136b-2418-4434-9466-75d116e8c780 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:44:55 user nova-compute[75229]: DEBUG nova.compute.manager [req-032f1bc9-b9ff-498c-9fbc-2609254de9b7 req-e2b044c1-71dd-4ca0-a216-3ac944040d90 service nova] [instance: af5fd5af-63a6-4eee-a4ef-6088a3713214] Refreshing instance network info cache due to event network-changed-0979136b-2418-4434-9466-75d116e8c780. {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 09:44:55 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-032f1bc9-b9ff-498c-9fbc-2609254de9b7 req-e2b044c1-71dd-4ca0-a216-3ac944040d90 service nova] Acquiring lock "refresh_cache-af5fd5af-63a6-4eee-a4ef-6088a3713214" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 09:44:55 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-032f1bc9-b9ff-498c-9fbc-2609254de9b7 req-e2b044c1-71dd-4ca0-a216-3ac944040d90 service nova] Acquired lock "refresh_cache-af5fd5af-63a6-4eee-a4ef-6088a3713214" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 09:44:55 user nova-compute[75229]: DEBUG nova.network.neutron [req-032f1bc9-b9ff-498c-9fbc-2609254de9b7 req-e2b044c1-71dd-4ca0-a216-3ac944040d90 service nova] [instance: af5fd5af-63a6-4eee-a4ef-6088a3713214] Refreshing network info cache for port 0979136b-2418-4434-9466-75d116e8c780 {{(pid=75229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 09:44:55 user nova-compute[75229]: INFO nova.virt.block_device [None req-d5268eb3-e108-4421-b72a-35533ea3a492 tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] [instance: af5fd5af-63a6-4eee-a4ef-6088a3713214] Booting with volume 18a1e95e-5df1-4db1-92bc-6cd67729c7a7 at /dev/vdb
Nov 14 09:44:55 user nova-compute[75229]: DEBUG nova.network.neutron [req-032f1bc9-b9ff-498c-9fbc-2609254de9b7 req-e2b044c1-71dd-4ca0-a216-3ac944040d90 service nova] [instance: af5fd5af-63a6-4eee-a4ef-6088a3713214] Instance cache missing network info. {{(pid=75229) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 09:44:55 user nova-compute[75229]: DEBUG os_brick.utils [None req-d5268eb3-e108-4421-b72a-35533ea3a492 tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 09:44:55 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:44:55 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:44:55 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[d258d5b4-6424-4366-9cc3-a5f60e2c84bb]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f1154031c835\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:44:55 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:44:55 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:44:55 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[a53c79e7-5802-44ae-b439-959abee21945]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:44:55 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:44:55 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:44:55 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e7a9970-4b4c-42f3-a035-1c04bef89256]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:44:55 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[447e2832-6218-4c2a-b421-d17e6307869b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:44:55 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-d5268eb3-e108-4421-b72a-35533ea3a492 tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] Running cmd (subprocess): nvme version {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:44:55 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-d5268eb3-e108-4421-b72a-35533ea3a492 tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] 'nvme version' failed. Not Retrying. {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 09:44:55 user nova-compute[75229]: DEBUG nova.network.neutron [req-032f1bc9-b9ff-498c-9fbc-2609254de9b7 req-e2b044c1-71dd-4ca0-a216-3ac944040d90 service nova] [instance: af5fd5af-63a6-4eee-a4ef-6088a3713214] Updating instance_info_cache with network_info: [] {{(pid=75229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 09:44:55 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d5268eb3-e108-4421-b72a-35533ea3a492 tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] nvme not present on system {{(pid=75229) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 09:44:55 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:44:55 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-032f1bc9-b9ff-498c-9fbc-2609254de9b7 req-e2b044c1-71dd-4ca0-a216-3ac944040d90 service nova] Releasing lock "refresh_cache-af5fd5af-63a6-4eee-a4ef-6088a3713214" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 09:44:55 user nova-compute[75229]: DEBUG nova.network.neutron [None req-d5268eb3-e108-4421-b72a-35533ea3a492 tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] [instance: af5fd5af-63a6-4eee-a4ef-6088a3713214] Successfully updated port: 768a662a-4bcd-4844-a9ed-f8b8f6b8aa0d {{(pid=75229) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 09:44:55 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 09:44:55 user nova-compute[75229]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 09:44:55 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d967b35-9e4e-4899-9e4c-484fe2218e86]: (4, '') {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:44:55 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.lightos [None req-d5268eb3-e108-4421-b72a-35533ea3a492 tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75229) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 09:44:55 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.lightos [None req-d5268eb3-e108-4421-b72a-35533ea3a492 tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75229) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 09:44:55 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.lightos [None req-d5268eb3-e108-4421-b72a-35533ea3a492 tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] LIGHTOS: no hostnqn found. {{(pid=75229) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 09:44:55 user nova-compute[75229]: DEBUG os_brick.utils [None req-d5268eb3-e108-4421-b72a-35533ea3a492 tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] <== get_connector_properties: return (136ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f1154031c835', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 09:44:55 user nova-compute[75229]: DEBUG nova.virt.block_device [None req-d5268eb3-e108-4421-b72a-35533ea3a492 tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] [instance: af5fd5af-63a6-4eee-a4ef-6088a3713214] Updating existing volume attachment record: 41008f75-df22-404f-8c47-f26b6cc5e9b3 {{(pid=75229) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 09:44:56 user nova-compute[75229]: DEBUG nova.network.neutron [None req-d5268eb3-e108-4421-b72a-35533ea3a492 tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] [instance: af5fd5af-63a6-4eee-a4ef-6088a3713214] Successfully updated port: b7fff2b1-9f14-4632-83e2-3f0a8e4c788b {{(pid=75229) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 09:44:56 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-d5268eb3-e108-4421-b72a-35533ea3a492 tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] Acquiring lock "refresh_cache-af5fd5af-63a6-4eee-a4ef-6088a3713214" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 09:44:56 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-d5268eb3-e108-4421-b72a-35533ea3a492 tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] Acquired lock "refresh_cache-af5fd5af-63a6-4eee-a4ef-6088a3713214" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 09:44:56 user nova-compute[75229]: DEBUG nova.network.neutron [None req-d5268eb3-e108-4421-b72a-35533ea3a492 tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] [instance: af5fd5af-63a6-4eee-a4ef-6088a3713214] Building network info cache for instance {{(pid=75229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 09:44:56 user nova-compute[75229]: DEBUG nova.network.neutron [None req-d5268eb3-e108-4421-b72a-35533ea3a492 tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] [instance: af5fd5af-63a6-4eee-a4ef-6088a3713214] Instance cache missing network info. {{(pid=75229) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 09:44:57 user nova-compute[75229]: DEBUG nova.compute.manager [req-257b342f-fb97-4569-997f-f802eb263c66 req-0e458eb9-48ff-49ee-8889-77cb7422934a service nova] [instance: af5fd5af-63a6-4eee-a4ef-6088a3713214] Received event network-changed-1f37d277-e3ac-48ca-b618-27b872f41824 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:44:57 user nova-compute[75229]: DEBUG nova.compute.manager [req-257b342f-fb97-4569-997f-f802eb263c66 req-0e458eb9-48ff-49ee-8889-77cb7422934a service nova] [instance: af5fd5af-63a6-4eee-a4ef-6088a3713214] Refreshing instance network info cache due to event network-changed-1f37d277-e3ac-48ca-b618-27b872f41824. {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 09:44:57 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-257b342f-fb97-4569-997f-f802eb263c66 req-0e458eb9-48ff-49ee-8889-77cb7422934a service nova] Acquiring lock "refresh_cache-af5fd5af-63a6-4eee-a4ef-6088a3713214" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 09:44:57 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:44:58 user nova-compute[75229]: DEBUG nova.network.neutron [None req-d5268eb3-e108-4421-b72a-35533ea3a492 tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] [instance: af5fd5af-63a6-4eee-a4ef-6088a3713214] Updating instance_info_cache with network_info: [{"id": "a1999f33-4f1d-47b0-a91a-48bce4600e9b", "address": "fa:16:3e:d9:f9:d0", "network": {"id": "a4d3d0e0-1dec-40de-a03f-4241b910cf16", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-380540777-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a9197db757f4a1cafd571eef8d47b15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1999f33-4f", "ovs_interfaceid": "a1999f33-4f1d-47b0-a91a-48bce4600e9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2f37eb91-97ea-477b-b6c1-933b50ccfca6", "address": "fa:16:3e:1b:33:6b", "network": {"id": "4176f9ca-0910-416d-99e3-a8156bd87229", "bridge": "br-int", "label": "tempest-device-tagging-net1-45180450", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.34", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6a9197db757f4a1cafd571eef8d47b15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f37eb91-97", "ovs_interfaceid": "2f37eb91-97ea-477b-b6c1-933b50ccfca6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f8dc5389-6e53-421a-9a3a-6c90a89a6eb2", "address": "fa:16:3e:69:0d:d2", "network": {"id": "4176f9ca-0910-416d-99e3-a8156bd87229", "bridge": "br-int", "label": "tempest-device-tagging-net1-45180450", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.210", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6a9197db757f4a1cafd571eef8d47b15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8dc5389-6e", "ovs_interfaceid": "f8dc5389-6e53-421a-9a3a-6c90a89a6eb2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0979136b-2418-4434-9466-75d116e8c780", "address": "fa:16:3e:4d:a2:e0", "network": {"id": "4176f9ca-0910-416d-99e3-a8156bd87229", "bridge": "br-int", "label": "tempest-device-tagging-net1-45180450", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.156", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6a9197db757f4a1cafd571eef8d47b15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0979136b-24", "ovs_interfaceid": "0979136b-2418-4434-9466-75d116e8c780", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1f37d277-e3ac-48ca-b618-27b872f41824", "address": "fa:16:3e:c0:9e:a0", "network": {"id": "4176f9ca-0910-416d-99e3-a8156bd87229", "bridge": "br-int", "label": "tempest-device-tagging-net1-45180450", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.24", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6a9197db757f4a1cafd571eef8d47b15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f37d277-e3", "ovs_interfaceid": "1f37d277-e3ac-48ca-b618-27b872f41824", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "768a662a-4bcd-4844-a9ed-f8b8f6b8aa0d", "address": "fa:16:3e:10:aa:95", "network": {"id": "0f777eef-d2ac-43b9-bbef-4f075e98903f", "bridge": "br-int", "label": "tempest-device-tagging-net2-1010361890", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "6a9197db757f4a1cafd571eef8d47b15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap768a662a-4b", "ovs_interfaceid": "768a662a-4bcd-4844-a9ed-f8b8f6b8aa0d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b7fff2b1-9f14-4632-83e2-3f0a8e4c788b", "address": "fa:16:3e:68:f2:55", "network": {"id": "0f777eef-d2ac-43b9-bbef-4f075e98903f", "bridge": "br-int", "label": "tempest-device-tagging-net2-1010361890", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "6a9197db757f4a1cafd571eef8d47b15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7fff2b1-9f", "ovs_interfaceid": "b7fff2b1-9f14-4632-83e2-3f0a8e4c788b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 09:44:58 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-d5268eb3-e108-4421-b72a-35533ea3a492 tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] Releasing lock "refresh_cache-af5fd5af-63a6-4eee-a4ef-6088a3713214" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 09:44:58 user nova-compute[75229]: DEBUG nova.compute.manager [None req-d5268eb3-e108-4421-b72a-35533ea3a492 tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] [instance: af5fd5af-63a6-4eee-a4ef-6088a3713214] Instance network_info: |[{"id": "a1999f33-4f1d-47b0-a91a-48bce4600e9b", "address": "fa:16:3e:d9:f9:d0", "network": {"id": "a4d3d0e0-1dec-40de-a03f-4241b910cf16", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-380540777-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a9197db757f4a1cafd571eef8d47b15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1999f33-4f", "ovs_interfaceid": "a1999f33-4f1d-47b0-a91a-48bce4600e9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2f37eb91-97ea-477b-b6c1-933b50ccfca6", "address": "fa:16:3e:1b:33:6b", "network": {"id": "4176f9ca-0910-416d-99e3-a8156bd87229", "bridge": "br-int", "label": "tempest-device-tagging-net1-45180450", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.34", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6a9197db757f4a1cafd571eef8d47b15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f37eb91-97", "ovs_interfaceid": "2f37eb91-97ea-477b-b6c1-933b50ccfca6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f8dc5389-6e53-421a-9a3a-6c90a89a6eb2", "address": "fa:16:3e:69:0d:d2", "network": {"id": "4176f9ca-0910-416d-99e3-a8156bd87229", "bridge": "br-int", "label": "tempest-device-tagging-net1-45180450", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.210", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6a9197db757f4a1cafd571eef8d47b15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8dc5389-6e", "ovs_interfaceid": "f8dc5389-6e53-421a-9a3a-6c90a89a6eb2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0979136b-2418-4434-9466-75d116e8c780", "address": "fa:16:3e:4d:a2:e0", "network": {"id": "4176f9ca-0910-416d-99e3-a8156bd87229", "bridge": "br-int", "label": "tempest-device-tagging-net1-45180450", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.156", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6a9197db757f4a1cafd571eef8d47b15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0979136b-24", "ovs_interfaceid": "0979136b-2418-4434-9466-75d116e8c780", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1f37d277-e3ac-48ca-b618-27b872f41824", "address": "fa:16:3e:c0:9e:a0", "network": {"id": "4176f9ca-0910-416d-99e3-a8156bd87229", "bridge": "br-int", "label": "tempest-device-tagging-net1-45180450", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.24", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6a9197db757f4a1cafd571eef8d47b15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f37d277-e3", "ovs_interfaceid": "1f37d277-e3ac-48ca-b618-27b872f41824", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "768a662a-4bcd-4844-a9ed-f8b8f6b8aa0d", "address": "fa:16:3e:10:aa:95", "network": {"id": "0f777eef-d2ac-43b9-bbef-4f075e98903f", "bridge": "br-int", "label": "tempest-device-tagging-net2-1010361890", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "6a9197db757f4a1cafd571eef8d47b15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap768a662a-4b", "ovs_interfaceid": "768a662a-4bcd-4844-a9ed-f8b8f6b8aa0d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b7fff2b1-9f14-4632-83e2-3f0a8e4c788b", "address": "fa:16:3e:68:f2:55", "network": {"id": "0f777eef-d2ac-43b9-bbef-4f075e98903f", "bridge": "br-int", "label": "tempest-device-tagging-net2-1010361890", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "6a9197db757f4a1cafd571eef8d47b15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7fff2b1-9f", "ovs_interfaceid": "b7fff2b1-9f14-4632-83e2-3f0a8e4c788b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75229) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 09:44:58 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-257b342f-fb97-4569-997f-f802eb263c66 req-0e458eb9-48ff-49ee-8889-77cb7422934a service nova] Acquired lock "refresh_cache-af5fd5af-63a6-4eee-a4ef-6088a3713214" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 09:44:58 user nova-compute[75229]: DEBUG nova.network.neutron [req-257b342f-fb97-4569-997f-f802eb263c66 req-0e458eb9-48ff-49ee-8889-77cb7422934a service nova] [instance: af5fd5af-63a6-4eee-a4ef-6088a3713214] Refreshing network info cache for port 1f37d277-e3ac-48ca-b618-27b872f41824 {{(pid=75229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 09:44:58 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:44:59 user nova-compute[75229]: DEBUG nova.network.neutron [req-257b342f-fb97-4569-997f-f802eb263c66 req-0e458eb9-48ff-49ee-8889-77cb7422934a service nova] [instance: af5fd5af-63a6-4eee-a4ef-6088a3713214] Updated VIF entry in instance network info cache for port 1f37d277-e3ac-48ca-b618-27b872f41824. {{(pid=75229) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 09:44:59 user nova-compute[75229]: DEBUG nova.network.neutron [req-257b342f-fb97-4569-997f-f802eb263c66 req-0e458eb9-48ff-49ee-8889-77cb7422934a service nova] [instance: af5fd5af-63a6-4eee-a4ef-6088a3713214] Updating instance_info_cache with network_info: [{"id": "a1999f33-4f1d-47b0-a91a-48bce4600e9b", "address": "fa:16:3e:d9:f9:d0", "network": {"id": "a4d3d0e0-1dec-40de-a03f-4241b910cf16", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-380540777-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a9197db757f4a1cafd571eef8d47b15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1999f33-4f", "ovs_interfaceid": "a1999f33-4f1d-47b0-a91a-48bce4600e9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2f37eb91-97ea-477b-b6c1-933b50ccfca6", "address": "fa:16:3e:1b:33:6b", "network": {"id": "4176f9ca-0910-416d-99e3-a8156bd87229", "bridge": "br-int", "label": "tempest-device-tagging-net1-45180450", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.34", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6a9197db757f4a1cafd571eef8d47b15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f37eb91-97", "ovs_interfaceid": "2f37eb91-97ea-477b-b6c1-933b50ccfca6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f8dc5389-6e53-421a-9a3a-6c90a89a6eb2", "address": "fa:16:3e:69:0d:d2", "network": {"id": "4176f9ca-0910-416d-99e3-a8156bd87229", "bridge": "br-int", "label": "tempest-device-tagging-net1-45180450", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.210", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6a9197db757f4a1cafd571eef8d47b15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8dc5389-6e", "ovs_interfaceid": "f8dc5389-6e53-421a-9a3a-6c90a89a6eb2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0979136b-2418-4434-9466-75d116e8c780", "address": "fa:16:3e:4d:a2:e0", "network": {"id": "4176f9ca-0910-416d-99e3-a8156bd87229", "bridge": "br-int", "label": "tempest-device-tagging-net1-45180450", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.156", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6a9197db757f4a1cafd571eef8d47b15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0979136b-24", "ovs_interfaceid": "0979136b-2418-4434-9466-75d116e8c780", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1f37d277-e3ac-48ca-b618-27b872f41824", "address": "fa:16:3e:c0:9e:a0", "network": {"id": "4176f9ca-0910-416d-99e3-a8156bd87229", "bridge": "br-int", "label": "tempest-device-tagging-net1-45180450", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.24", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6a9197db757f4a1cafd571eef8d47b15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f37d277-e3", "ovs_interfaceid": "1f37d277-e3ac-48ca-b618-27b872f41824", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "768a662a-4bcd-4844-a9ed-f8b8f6b8aa0d", "address": "fa:16:3e:10:aa:95", "network": {"id": "0f777eef-d2ac-43b9-bbef-4f075e98903f", "bridge": "br-int", "label": "tempest-device-tagging-net2-1010361890", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "6a9197db757f4a1cafd571eef8d47b15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap768a662a-4b", "ovs_interfaceid": "768a662a-4bcd-4844-a9ed-f8b8f6b8aa0d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b7fff2b1-9f14-4632-83e2-3f0a8e4c788b", "address": "fa:16:3e:68:f2:55", "network": {"id": "0f777eef-d2ac-43b9-bbef-4f075e98903f", "bridge": "br-int", "label": "tempest-device-tagging-net2-1010361890", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "6a9197db757f4a1cafd571eef8d47b15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7fff2b1-9f", "ovs_interfaceid": "b7fff2b1-9f14-4632-83e2-3f0a8e4c788b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 09:44:59 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-257b342f-fb97-4569-997f-f802eb263c66 req-0e458eb9-48ff-49ee-8889-77cb7422934a service nova] Releasing lock "refresh_cache-af5fd5af-63a6-4eee-a4ef-6088a3713214" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 09:44:59 user nova-compute[75229]: DEBUG nova.compute.manager [req-257b342f-fb97-4569-997f-f802eb263c66 req-0e458eb9-48ff-49ee-8889-77cb7422934a service nova] [instance: af5fd5af-63a6-4eee-a4ef-6088a3713214] Received event network-changed-768a662a-4bcd-4844-a9ed-f8b8f6b8aa0d {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:44:59 user nova-compute[75229]: DEBUG nova.compute.manager [req-257b342f-fb97-4569-997f-f802eb263c66 req-0e458eb9-48ff-49ee-8889-77cb7422934a service nova] [instance: af5fd5af-63a6-4eee-a4ef-6088a3713214] Refreshing instance network info cache due to event network-changed-768a662a-4bcd-4844-a9ed-f8b8f6b8aa0d. {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 09:44:59 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-257b342f-fb97-4569-997f-f802eb263c66 req-0e458eb9-48ff-49ee-8889-77cb7422934a service nova] Acquiring lock "refresh_cache-af5fd5af-63a6-4eee-a4ef-6088a3713214" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 09:44:59 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-257b342f-fb97-4569-997f-f802eb263c66 req-0e458eb9-48ff-49ee-8889-77cb7422934a service nova] Acquired lock "refresh_cache-af5fd5af-63a6-4eee-a4ef-6088a3713214" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 09:44:59 user nova-compute[75229]: DEBUG nova.network.neutron [req-257b342f-fb97-4569-997f-f802eb263c66 req-0e458eb9-48ff-49ee-8889-77cb7422934a service nova] [instance: af5fd5af-63a6-4eee-a4ef-6088a3713214] Refreshing network info cache for port 768a662a-4bcd-4844-a9ed-f8b8f6b8aa0d {{(pid=75229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 09:44:59 user nova-compute[75229]: DEBUG nova.network.neutron [req-257b342f-fb97-4569-997f-f802eb263c66 req-0e458eb9-48ff-49ee-8889-77cb7422934a service nova] [instance: af5fd5af-63a6-4eee-a4ef-6088a3713214] Updated VIF entry in instance network info cache for port 768a662a-4bcd-4844-a9ed-f8b8f6b8aa0d. {{(pid=75229) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 09:44:59 user nova-compute[75229]: DEBUG nova.network.neutron [req-257b342f-fb97-4569-997f-f802eb263c66 req-0e458eb9-48ff-49ee-8889-77cb7422934a service nova] [instance: af5fd5af-63a6-4eee-a4ef-6088a3713214] Updating instance_info_cache with network_info: [{"id": "a1999f33-4f1d-47b0-a91a-48bce4600e9b", "address": "fa:16:3e:d9:f9:d0", "network": {"id": "a4d3d0e0-1dec-40de-a03f-4241b910cf16", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-380540777-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a9197db757f4a1cafd571eef8d47b15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1999f33-4f", "ovs_interfaceid": "a1999f33-4f1d-47b0-a91a-48bce4600e9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2f37eb91-97ea-477b-b6c1-933b50ccfca6", "address": "fa:16:3e:1b:33:6b", "network": {"id": "4176f9ca-0910-416d-99e3-a8156bd87229", "bridge": "br-int", "label": "tempest-device-tagging-net1-45180450", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.34", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6a9197db757f4a1cafd571eef8d47b15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f37eb91-97", "ovs_interfaceid": "2f37eb91-97ea-477b-b6c1-933b50ccfca6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f8dc5389-6e53-421a-9a3a-6c90a89a6eb2", "address": "fa:16:3e:69:0d:d2", "network": {"id": "4176f9ca-0910-416d-99e3-a8156bd87229", "bridge": "br-int", "label": "tempest-device-tagging-net1-45180450", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.210", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6a9197db757f4a1cafd571eef8d47b15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8dc5389-6e", "ovs_interfaceid": "f8dc5389-6e53-421a-9a3a-6c90a89a6eb2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0979136b-2418-4434-9466-75d116e8c780", "address": "fa:16:3e:4d:a2:e0", "network": {"id": "4176f9ca-0910-416d-99e3-a8156bd87229", "bridge": "br-int", "label": "tempest-device-tagging-net1-45180450", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.156", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6a9197db757f4a1cafd571eef8d47b15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0979136b-24", "ovs_interfaceid": "0979136b-2418-4434-9466-75d116e8c780", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1f37d277-e3ac-48ca-b618-27b872f41824", "address": "fa:16:3e:c0:9e:a0", "network": {"id": "4176f9ca-0910-416d-99e3-a8156bd87229", "bridge": "br-int", "label": "tempest-device-tagging-net1-45180450", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.24", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6a9197db757f4a1cafd571eef8d47b15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f37d277-e3", "ovs_interfaceid": "1f37d277-e3ac-48ca-b618-27b872f41824", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "768a662a-4bcd-4844-a9ed-f8b8f6b8aa0d", "address": "fa:16:3e:10:aa:95", "network": {"id": "0f777eef-d2ac-43b9-bbef-4f075e98903f", "bridge": "br-int", "label": "tempest-device-tagging-net2-1010361890", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "6a9197db757f4a1cafd571eef8d47b15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap768a662a-4b", "ovs_interfaceid": "768a662a-4bcd-4844-a9ed-f8b8f6b8aa0d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b7fff2b1-9f14-4632-83e2-3f0a8e4c788b", "address": "fa:16:3e:68:f2:55", "network": {"id": "0f777eef-d2ac-43b9-bbef-4f075e98903f", "bridge": "br-int", "label": "tempest-device-tagging-net2-1010361890", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "6a9197db757f4a1cafd571eef8d47b15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7fff2b1-9f", "ovs_interfaceid": "b7fff2b1-9f14-4632-83e2-3f0a8e4c788b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 09:44:59 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-257b342f-fb97-4569-997f-f802eb263c66 req-0e458eb9-48ff-49ee-8889-77cb7422934a service nova] Releasing lock "refresh_cache-af5fd5af-63a6-4eee-a4ef-6088a3713214" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 09:44:59 user nova-compute[75229]: DEBUG nova.compute.manager [req-257b342f-fb97-4569-997f-f802eb263c66 req-0e458eb9-48ff-49ee-8889-77cb7422934a service nova] [instance: af5fd5af-63a6-4eee-a4ef-6088a3713214] Received event network-changed-b7fff2b1-9f14-4632-83e2-3f0a8e4c788b {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:44:59 user nova-compute[75229]: DEBUG nova.compute.manager [req-257b342f-fb97-4569-997f-f802eb263c66 req-0e458eb9-48ff-49ee-8889-77cb7422934a service nova] [instance: af5fd5af-63a6-4eee-a4ef-6088a3713214] Refreshing instance network info cache due to event network-changed-b7fff2b1-9f14-4632-83e2-3f0a8e4c788b. {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 09:44:59 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-257b342f-fb97-4569-997f-f802eb263c66 req-0e458eb9-48ff-49ee-8889-77cb7422934a service nova] Acquiring lock "refresh_cache-af5fd5af-63a6-4eee-a4ef-6088a3713214" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 09:44:59 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-257b342f-fb97-4569-997f-f802eb263c66 req-0e458eb9-48ff-49ee-8889-77cb7422934a service nova] Acquired lock "refresh_cache-af5fd5af-63a6-4eee-a4ef-6088a3713214" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 09:44:59 user nova-compute[75229]: DEBUG nova.network.neutron [req-257b342f-fb97-4569-997f-f802eb263c66 req-0e458eb9-48ff-49ee-8889-77cb7422934a service nova] [instance: af5fd5af-63a6-4eee-a4ef-6088a3713214] Refreshing network info cache for port b7fff2b1-9f14-4632-83e2-3f0a8e4c788b {{(pid=75229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 09:45:00 user nova-compute[75229]: DEBUG nova.network.neutron [req-257b342f-fb97-4569-997f-f802eb263c66 req-0e458eb9-48ff-49ee-8889-77cb7422934a service nova] [instance: af5fd5af-63a6-4eee-a4ef-6088a3713214] Updated VIF entry in instance network info cache for port b7fff2b1-9f14-4632-83e2-3f0a8e4c788b. {{(pid=75229) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 09:45:00 user nova-compute[75229]: DEBUG nova.network.neutron [req-257b342f-fb97-4569-997f-f802eb263c66 req-0e458eb9-48ff-49ee-8889-77cb7422934a service nova] [instance: af5fd5af-63a6-4eee-a4ef-6088a3713214] Updating instance_info_cache with network_info: [{"id": "a1999f33-4f1d-47b0-a91a-48bce4600e9b", "address": "fa:16:3e:d9:f9:d0", "network": {"id": "a4d3d0e0-1dec-40de-a03f-4241b910cf16", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-380540777-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a9197db757f4a1cafd571eef8d47b15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1999f33-4f", "ovs_interfaceid": "a1999f33-4f1d-47b0-a91a-48bce4600e9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2f37eb91-97ea-477b-b6c1-933b50ccfca6", "address": "fa:16:3e:1b:33:6b", "network": {"id": "4176f9ca-0910-416d-99e3-a8156bd87229", "bridge": "br-int", "label": "tempest-device-tagging-net1-45180450", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.34", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6a9197db757f4a1cafd571eef8d47b15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f37eb91-97", "ovs_interfaceid": "2f37eb91-97ea-477b-b6c1-933b50ccfca6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f8dc5389-6e53-421a-9a3a-6c90a89a6eb2", "address": "fa:16:3e:69:0d:d2", "network": {"id": "4176f9ca-0910-416d-99e3-a8156bd87229", "bridge": "br-int", "label": "tempest-device-tagging-net1-45180450", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.210", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6a9197db757f4a1cafd571eef8d47b15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8dc5389-6e", "ovs_interfaceid": "f8dc5389-6e53-421a-9a3a-6c90a89a6eb2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0979136b-2418-4434-9466-75d116e8c780", "address": "fa:16:3e:4d:a2:e0", "network": {"id": "4176f9ca-0910-416d-99e3-a8156bd87229", "bridge": "br-int", "label": "tempest-device-tagging-net1-45180450", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.156", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6a9197db757f4a1cafd571eef8d47b15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0979136b-24", "ovs_interfaceid": "0979136b-2418-4434-9466-75d116e8c780", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1f37d277-e3ac-48ca-b618-27b872f41824", "address": "fa:16:3e:c0:9e:a0", "network": {"id": "4176f9ca-0910-416d-99e3-a8156bd87229", "bridge": "br-int", "label": "tempest-device-tagging-net1-45180450", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.24", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6a9197db757f4a1cafd571eef8d47b15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f37d277-e3", "ovs_interfaceid": "1f37d277-e3ac-48ca-b618-27b872f41824", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "768a662a-4bcd-4844-a9ed-f8b8f6b8aa0d", "address": "fa:16:3e:10:aa:95", "network": {"id": "0f777eef-d2ac-43b9-bbef-4f075e98903f", "bridge": "br-int", "label": "tempest-device-tagging-net2-1010361890", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "6a9197db757f4a1cafd571eef8d47b15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap768a662a-4b", "ovs_interfaceid": "768a662a-4bcd-4844-a9ed-f8b8f6b8aa0d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b7fff2b1-9f14-4632-83e2-3f0a8e4c788b", "address": "fa:16:3e:68:f2:55", "network": {"id": "0f777eef-d2ac-43b9-bbef-4f075e98903f", "bridge": "br-int", "label": "tempest-device-tagging-net2-1010361890", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "6a9197db757f4a1cafd571eef8d47b15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7fff2b1-9f", "ovs_interfaceid": "b7fff2b1-9f14-4632-83e2-3f0a8e4c788b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 09:45:00 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-257b342f-fb97-4569-997f-f802eb263c66 req-0e458eb9-48ff-49ee-8889-77cb7422934a service nova] Releasing lock "refresh_cache-af5fd5af-63a6-4eee-a4ef-6088a3713214" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 09:45:00 user nova-compute[75229]: INFO nova.virt.block_device [None req-d5268eb3-e108-4421-b72a-35533ea3a492 tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] [instance: af5fd5af-63a6-4eee-a4ef-6088a3713214] Booting with volume 97f588de-32d5-4d48-9c06-5925263ba117 at /dev/vdc
Nov 14 09:45:00 user nova-compute[75229]: DEBUG os_brick.utils [None req-d5268eb3-e108-4421-b72a-35533ea3a492 tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 09:45:00 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:45:00 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:45:00 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ea1c6ae-a15d-427a-888b-131f587bbd46]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f1154031c835\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:45:00 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:45:00 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:45:00 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[5abac01f-5262-44b7-a048-c149b7a674a6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:45:00 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:45:00 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:45:00 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6af1297-98a7-46a7-8283-7c927f172702]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:45:00 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa53a890-b54f-428e-9bb0-55bafe3dff76]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:45:00 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-d5268eb3-e108-4421-b72a-35533ea3a492 tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] Running cmd (subprocess): nvme version {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:45:00 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-d5268eb3-e108-4421-b72a-35533ea3a492 tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] 'nvme version' failed. Not Retrying. {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 09:45:00 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d5268eb3-e108-4421-b72a-35533ea3a492 tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] nvme not present on system {{(pid=75229) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 09:45:00 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:45:00 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 09:45:00 user nova-compute[75229]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 09:45:00 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[34288d0c-6037-43fb-a30e-9bd071eec650]: (4, '') {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:45:00 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.lightos [None req-d5268eb3-e108-4421-b72a-35533ea3a492 tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75229) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 09:45:00 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.lightos [None req-d5268eb3-e108-4421-b72a-35533ea3a492 tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75229) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 09:45:00 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.lightos [None req-d5268eb3-e108-4421-b72a-35533ea3a492 tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] LIGHTOS: no hostnqn found. {{(pid=75229) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 09:45:00 user nova-compute[75229]: DEBUG os_brick.utils [None req-d5268eb3-e108-4421-b72a-35533ea3a492 tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f1154031c835', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 09:45:00 user nova-compute[75229]: DEBUG nova.virt.block_device [None req-d5268eb3-e108-4421-b72a-35533ea3a492 tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] [instance: af5fd5af-63a6-4eee-a4ef-6088a3713214] Updating existing volume attachment record: 267d2eca-5c0b-4049-b31c-cd0a90880095 {{(pid=75229) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 09:45:02 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:45:03 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:45:04 user nova-compute[75229]: DEBUG nova.compute.manager [None req-d5268eb3-e108-4421-b72a-35533ea3a492 tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] [instance: af5fd5af-63a6-4eee-a4ef-6088a3713214] Start spawning the instance on the hypervisor. {{(pid=75229) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 09:45:04 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-d5268eb3-e108-4421-b72a-35533ea3a492 tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] [instance: af5fd5af-63a6-4eee-a4ef-6088a3713214] Creating instance directory {{(pid=75229) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 09:45:04 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-d5268eb3-e108-4421-b72a-35533ea3a492 tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] [instance: af5fd5af-63a6-4eee-a4ef-6088a3713214] Creating image(s)
Nov 14 09:45:04 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-d5268eb3-e108-4421-b72a-35533ea3a492 tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] [instance: af5fd5af-63a6-4eee-a4ef-6088a3713214] Did not create local disks {{(pid=75229) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 14 09:45:04 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-d5268eb3-e108-4421-b72a-35533ea3a492 tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] [instance: af5fd5af-63a6-4eee-a4ef-6088a3713214] Ensure instance console log exists: /opt/stack/data/nova/instances/af5fd5af-63a6-4eee-a4ef-6088a3713214/console.log {{(pid=75229) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 09:45:04 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-d5268eb3-e108-4421-b72a-35533ea3a492 tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:45:04 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-d5268eb3-e108-4421-b72a-35533ea3a492 tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:45:04 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-d5268eb3-e108-4421-b72a-35533ea3a492 tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:45:04 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-d5268eb3-e108-4421-b72a-35533ea3a492 tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] [instance: af5fd5af-63a6-4eee-a4ef-6088a3713214] Start _get_guest_xml network_info=[{"id": "a1999f33-4f1d-47b0-a91a-48bce4600e9b", "address": "fa:16:3e:d9:f9:d0", "network": {"id": "a4d3d0e0-1dec-40de-a03f-4241b910cf16", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-380540777-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a9197db757f4a1cafd571eef8d47b15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1999f33-4f", "ovs_interfaceid": "a1999f33-4f1d-47b0-a91a-48bce4600e9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2f37eb91-97ea-477b-b6c1-933b50ccfca6", "address": "fa:16:3e:1b:33:6b", "network": {"id": "4176f9ca-0910-416d-99e3-a8156bd87229", "bridge": "br-int", "label": "tempest-device-tagging-net1-45180450", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.34", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6a9197db757f4a1cafd571eef8d47b15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f37eb91-97", "ovs_interfaceid": "2f37eb91-97ea-477b-b6c1-933b50ccfca6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f8dc5389-6e53-421a-9a3a-6c90a89a6eb2", "address": "fa:16:3e:69:0d:d2", "network": {"id": "4176f9ca-0910-416d-99e3-a8156bd87229", "bridge": "br-int", "label": "tempest-device-tagging-net1-45180450", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.210", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6a9197db757f4a1cafd571eef8d47b15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8dc5389-6e", "ovs_interfaceid": "f8dc5389-6e53-421a-9a3a-6c90a89a6eb2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0979136b-2418-4434-9466-75d116e8c780", "address": "fa:16:3e:4d:a2:e0", "network": {"id": "4176f9ca-0910-416d-99e3-a8156bd87229", "bridge": "br-int", "label": "tempest-device-tagging-net1-45180450", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.156", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6a9197db757f4a1cafd571eef8d47b15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0979136b-24", "ovs_interfaceid": "0979136b-2418-4434-9466-75d116e8c780", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1f37d277-e3ac-48ca-b618-27b872f41824", "address": "fa:16:3e:c0:9e:a0", "network": {"id": "4176f9ca-0910-416d-99e3-a8156bd87229", "bridge": "br-int", "label": "tempest-device-tagging-net1-45180450", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.24", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6a9197db757f4a1cafd571eef8d47b15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f37d277-e3", "ovs_interfaceid": "1f37d277-e3ac-48ca-b618-27b872f41824", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "768a662a-4bcd-4844-a9ed-f8b8f6b8aa0d", "address": "fa:16:3e:10:aa:95", "network": {"id": "0f777eef-d2ac-43b9-bbef-4f075e98903f", "bridge": "br-int", "label": "tempest-device-tagging-net2-1010361890", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "6a9197db757f4a1cafd571eef8d47b15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap768a662a-4b", "ovs_interfaceid": "768a662a-4bcd-4844-a9ed-f8b8f6b8aa0d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b7fff2b1-9f14-4632-83e2-3f0a8e4c788b", "address": "fa:16:3e:68:f2:55", "network": {"id": "0f777eef-d2ac-43b9-bbef-4f075e98903f", "bridge": "br-int", "label": "tempest-device-tagging-net2-1010361890", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "6a9197db757f4a1cafd571eef8d47b15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7fff2b1-9f", "ovs_interfaceid": "b7fff2b1-9f14-4632-83e2-3f0a8e4c788b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T09:40:10Z,direct_url=<?>,disk_format='qcow2',id=3bef8470-ecc7-40e3-95d4-9254348ea72d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='de5a91106b6948ed937a7178ff9464c4',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T09:40:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:c2324d4e-6e60-47fd-b536-144a7ea32dce', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OTmFoJDy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'af5fd5af-63a6-4eee-a4ef-6088a3713214', 'attached_at': '', 'detached_at': '', 'volume_id': 'c2324d4e-6e60-47fd-b536-144a7ea32dce', 'serial': 'c2324d4e-6e60-47fd-b536-144a7ea32dce'}, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'attachment_id': '873513d8-60d2-4264-b10f-a93c66a70584', 'guest_format': None, 'device_type': 'disk', 'volume_type': None}, {'boot_index': 1, 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:18a1e95e-5df1-4db1-92bc-6cd67729c7a7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'quUPbjLv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'af5fd5af-63a6-4eee-a4ef-6088a3713214', 'attached_at': '', 'detached_at': '', 'volume_id': '18a1e95e-5df1-4db1-92bc-6cd67729c7a7', 'serial': '18a1e95e-5df1-4db1-92bc-6cd67729c7a7'}, 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'attachment_id': '41008f75-df22-404f-8c47-f26b6cc5e9b3', 'guest_format': None, 'device_type': 'disk', 'volume_type': None}, {'boot_index': 2, 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:97f588de-32d5-4d48-9c06-5925263ba117', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qiIJvnPa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'af5fd5af-63a6-4eee-a4ef-6088a3713214', 'attached_at': '', 'detached_at': '', 'volume_id': '97f588de-32d5-4d48-9c06-5925263ba117', 'serial': '97f588de-32d5-4d48-9c06-5925263ba117'}, 'disk_bus': 'virtio', 'mount_device': '/dev/vdc', 'attachment_id': '267d2eca-5c0b-4049-b31c-cd0a90880095', 'guest_format': None, 'device_type': 'disk', 'volume_type': None} {{(pid=75229) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 09:45:04 user nova-compute[75229]: WARNING nova.virt.libvirt.driver [None req-d5268eb3-e108-4421-b72a-35533ea3a492 tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 09:45:04 user nova-compute[75229]: WARNING nova.virt.libvirt.driver [None req-d5268eb3-e108-4421-b72a-35533ea3a492 tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 09:45:04 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-d5268eb3-e108-4421-b72a-35533ea3a492 tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75229) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 09:45:04 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-d5268eb3-e108-4421-b72a-35533ea3a492 tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] CPU controller missing on host. {{(pid=75229) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 09:45:04 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-d5268eb3-e108-4421-b72a-35533ea3a492 tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75229) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 09:45:04 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-d5268eb3-e108-4421-b72a-35533ea3a492 tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] CPU controller found on host. {{(pid=75229) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 09:45:04 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-d5268eb3-e108-4421-b72a-35533ea3a492 tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75229) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 09:45:04 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-d5268eb3-e108-4421-b72a-35533ea3a492 tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T09:39:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T09:40:10Z,direct_url=<?>,disk_format='qcow2',id=3bef8470-ecc7-40e3-95d4-9254348ea72d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='de5a91106b6948ed937a7178ff9464c4',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T09:40:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 09:45:04 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-d5268eb3-e108-4421-b72a-35533ea3a492 tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] Flavor limits 0:0:0 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 09:45:04 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-d5268eb3-e108-4421-b72a-35533ea3a492 tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] Image limits 0:0:0 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 09:45:04 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-d5268eb3-e108-4421-b72a-35533ea3a492 tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] Flavor pref 0:0:0 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 09:45:04 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-d5268eb3-e108-4421-b72a-35533ea3a492 tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] Image pref 0:0:0 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 09:45:04 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-d5268eb3-e108-4421-b72a-35533ea3a492 tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 09:45:04 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-d5268eb3-e108-4421-b72a-35533ea3a492 tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 09:45:04 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-d5268eb3-e108-4421-b72a-35533ea3a492 tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75229) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 09:45:04 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-d5268eb3-e108-4421-b72a-35533ea3a492 tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] Got 1 possible topologies {{(pid=75229) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 09:45:04 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-d5268eb3-e108-4421-b72a-35533ea3a492 tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 09:45:04 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-d5268eb3-e108-4421-b72a-35533ea3a492 tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 09:45:04 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-d5268eb3-e108-4421-b72a-35533ea3a492 tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] Acquiring lock "cache_volume_driver" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:45:04 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-d5268eb3-e108-4421-b72a-35533ea3a492 tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] Lock "cache_volume_driver" acquired by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:45:04 user nova-compute[75229]: DEBUG os_brick.initiator.connector [None req-d5268eb3-e108-4421-b72a-35533ea3a492 tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] Factory for ISCSI on None {{(pid=75229) factory /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connector.py:281}}
Nov 14 09:45:04 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-d5268eb3-e108-4421-b72a-35533ea3a492 tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] Lock "cache_volume_driver" "released" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: held 0.004s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:45:04 user nova-compute[75229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d5268eb3-e108-4421-b72a-35533ea3a492 tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] [instance: af5fd5af-63a6-4eee-a4ef-6088a3713214] Calling os-brick to attach iSCSI Volume {{(pid=75229) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 09:45:04 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5268eb3-e108-4421-b72a-35533ea3a492 tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f73f85151b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c2324d4e-6e60-47fd-b536-144a7ea32dce', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OTmFoJDy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 09:45:04 user nova-compute[75229]: WARNING os_brick.initiator.connectors.base [None req-d5268eb3-e108-4421-b72a-35533ea3a492 tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 09:45:04 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-d5268eb3-e108-4421-b72a-35533ea3a492 tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 09:45:04 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-d5268eb3-e108-4421-b72a-35533ea3a492 tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 09:45:04 user nova-compute[75229]: WARNING os_brick.initiator.connectors.base [None req-d5268eb3-e108-4421-b72a-35533ea3a492 tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 09:45:04 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-d5268eb3-e108-4421-b72a-35533ea3a492 tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c2324d4e-6e60-47fd-b536-144a7ea32dce" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 09:45:04 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-d5268eb3-e108-4421-b72a-35533ea3a492 tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c2324d4e-6e60-47fd-b536-144a7ea32dce" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 09:45:04 user nova-compute[75229]: INFO os_brick.initiator.connectors.iscsi [None req-d5268eb3-e108-4421-b72a-35533ea3a492 tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 09:45:04 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2324d4e-6e60-47fd-b536-144a7ea32dce -p 172.16.0.220:3260 {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:45:04 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2324d4e-6e60-47fd-b536-144a7ea32dce -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:45:04 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd463bf4-6eae-493d-ac78-52d18feb2d4d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:45:04 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5268eb3-e108-4421-b72a-35533ea3a492 tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 09:45:04 user nova-compute[75229]:  {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:45:04 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2324d4e-6e60-47fd-b536-144a7ea32dce -p 172.16.0.220:3260 --interface default --op new {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:45:04 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2324d4e-6e60-47fd-b536-144a7ea32dce -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:45:04 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[88331830-523f-43c0-b229-ccc907a0c25e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c2324d4e-6e60-47fd-b536-144a7ea32dce] added\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:45:04 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5268eb3-e108-4421-b72a-35533ea3a492 tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c2324d4e-6e60-47fd-b536-144a7ea32dce] added
Nov 14 09:45:04 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:45:04 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2324d4e-6e60-47fd-b536-144a7ea32dce -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:45:04 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2324d4e-6e60-47fd-b536-144a7ea32dce -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:45:04 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[43daf41f-7cec-4de2-aa36-0d5556ecfba4]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:45:04 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5268eb3-e108-4421-b72a-35533ea3a492 tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:45:04 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2324d4e-6e60-47fd-b536-144a7ea32dce -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:45:05 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2324d4e-6e60-47fd-b536-144a7ea32dce -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:45:05 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c929821-f3ab-477a-aec1-38caebc1ca4d]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:45:05 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5268eb3-e108-4421-b72a-35533ea3a492 tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:45:05 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2324d4e-6e60-47fd-b536-144a7ea32dce -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OTmFoJDy {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:45:05 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2324d4e-6e60-47fd-b536-144a7ea32dce -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OTmFoJDy" returned: 0 in 0.018s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:45:05 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[fac63bd6-c9fb-42da-a82b-da2135c2d1ed]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:45:05 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5268eb3-e108-4421-b72a-35533ea3a492 tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'OTmFoJDy'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:45:05 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2324d4e-6e60-47fd-b536-144a7ea32dce -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:45:05 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2324d4e-6e60-47fd-b536-144a7ea32dce -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:45:05 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[079b4940-0ba2-48a3-b405-6b3402e7437d]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:45:05 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5268eb3-e108-4421-b72a-35533ea3a492 tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:45:05 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:45:05 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:45:05 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6a3a6b4-64ae-41ec-8100-e501a42ccd6d]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:45:05 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5268eb3-e108-4421-b72a-35533ea3a492 tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 14 09:45:05 user nova-compute[75229]:  {{(pid=75229) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 09:45:05 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5268eb3-e108-4421-b72a-35533ea3a492 tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 14 09:45:05 user nova-compute[75229]:  {{(pid=75229) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 09:45:05 user nova-compute[75229]: WARNING os_brick.initiator.connectors.iscsi [None req-d5268eb3-e108-4421-b72a-35533ea3a492 tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 14 09:45:05 user nova-compute[75229]: 
Nov 14 09:45:05 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2324d4e-6e60-47fd-b536-144a7ea32dce -p 172.16.0.220:3260 --login {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:45:05 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2324d4e-6e60-47fd-b536-144a7ea32dce -p 172.16.0.220:3260 --login" returned: 0 in 0.049s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:45:05 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[450ff353-1493-49fe-b65e-b2060a74901c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c2324d4e-6e60-47fd-b536-144a7ea32dce, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c2324d4e-6e60-47fd-b536-144a7ea32dce, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:45:05 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5268eb3-e108-4421-b72a-35533ea3a492 tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c2324d4e-6e60-47fd-b536-144a7ea32dce, portal: 172.16.0.220,3260]
Nov 14 09:45:05 user nova-compute[75229]: Login to [iface: default, target: iqn.2010-10.org.openstack:c2324d4e-6e60-47fd-b536-144a7ea32dce, portal: 172.16.0.220,3260] successful.
Nov 14 09:45:05 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:45:05 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2324d4e-6e60-47fd-b536-144a7ea32dce -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:45:05 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2324d4e-6e60-47fd-b536-144a7ea32dce -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:45:05 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[91fa606a-3a17-43da-813a-84d2c37ed301]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:45:05 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5268eb3-e108-4421-b72a-35533ea3a492 tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:45:05 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:45:05 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:45:05 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[940bd3ac-d8c9-4eed-b18f-5ad2d55ad87b]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2324d4e-6e60-47fd-b536-144a7ea32dce (non-flash)\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:45:05 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5268eb3-e108-4421-b72a-35533ea3a492 tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2324d4e-6e60-47fd-b536-144a7ea32dce (non-flash)
Nov 14 09:45:05 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 09:45:05 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5268eb3-e108-4421-b72a-35533ea3a492 tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2324d4e-6e60-47fd-b536-144a7ea32dce (non-flash)
Nov 14 09:45:05 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 09:45:05 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-d5268eb3-e108-4421-b72a-35533ea3a492 tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c2324d4e-6e60-47fd-b536-144a7ea32dce" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.273s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 09:45:05 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5268eb3-e108-4421-b72a-35533ea3a492 tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] Connected to 172.16.0.220:3260 {{(pid=75229) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 09:45:05 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-d5268eb3-e108-4421-b72a-35533ea3a492 tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] HCTL ('33', '-', '-', 0) found on session 2 with lun 0 {{(pid=75229) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 09:45:05 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-d5268eb3-e108-4421-b72a-35533ea3a492 tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75229) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 09:45:05 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:45:05 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.014s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:45:05 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[e81464f7-a83a-469a-bdab-0a53978a8d7a]: (4, ('- - 0', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:45:05 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-d5268eb3-e108-4421-b72a-35533ea3a492 tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: None {{(pid=75229) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 09:45:06 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-d5268eb3-e108-4421-b72a-35533ea3a492 tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75229) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 09:45:06 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5268eb3-e108-4421-b72a-35533ea3a492 tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:c2324d4e-6e60-47fd-b536-144a7ea32dce', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OTmFoJDy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75229) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 09:45:06 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-d5268eb3-e108-4421-b72a-35533ea3a492 tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.301s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 09:45:06 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5268eb3-e108-4421-b72a-35533ea3a492 tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] <== connect_volume: return (1303ms) {'type': 'block', 'scsi_wwn': '23735353337306232', 'path': '/dev/sdb'} {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 09:45:06 user nova-compute[75229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d5268eb3-e108-4421-b72a-35533ea3a492 tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] [instance: af5fd5af-63a6-4eee-a4ef-6088a3713214] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23735353337306232', 'path': '/dev/sdb'} {{(pid=75229) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 09:45:06 user nova-compute[75229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d5268eb3-e108-4421-b72a-35533ea3a492 tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] [instance: af5fd5af-63a6-4eee-a4ef-6088a3713214] Calling os-brick to attach iSCSI Volume {{(pid=75229) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 09:45:06 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5268eb3-e108-4421-b72a-35533ea3a492 tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f73f85151b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:18a1e95e-5df1-4db1-92bc-6cd67729c7a7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'quUPbjLv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 09:45:06 user nova-compute[75229]: WARNING os_brick.initiator.connectors.base [None req-d5268eb3-e108-4421-b72a-35533ea3a492 tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 09:45:06 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-d5268eb3-e108-4421-b72a-35533ea3a492 tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 09:45:06 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-d5268eb3-e108-4421-b72a-35533ea3a492 tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 09:45:06 user nova-compute[75229]: WARNING os_brick.initiator.connectors.base [None req-d5268eb3-e108-4421-b72a-35533ea3a492 tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 09:45:06 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-d5268eb3-e108-4421-b72a-35533ea3a492 tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:18a1e95e-5df1-4db1-92bc-6cd67729c7a7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 09:45:06 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-d5268eb3-e108-4421-b72a-35533ea3a492 tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:18a1e95e-5df1-4db1-92bc-6cd67729c7a7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 09:45:06 user nova-compute[75229]: INFO os_brick.initiator.connectors.iscsi [None req-d5268eb3-e108-4421-b72a-35533ea3a492 tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 09:45:06 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:18a1e95e-5df1-4db1-92bc-6cd67729c7a7 -p 172.16.0.220:3260 {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:45:06 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:18a1e95e-5df1-4db1-92bc-6cd67729c7a7 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:45:06 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[aac75b81-b386-42f2-a187-3ad3fae2676c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:45:06 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5268eb3-e108-4421-b72a-35533ea3a492 tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 09:45:06 user nova-compute[75229]:  {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:45:06 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:18a1e95e-5df1-4db1-92bc-6cd67729c7a7 -p 172.16.0.220:3260 --interface default --op new {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:45:06 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:18a1e95e-5df1-4db1-92bc-6cd67729c7a7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:45:06 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[cab670a1-39eb-4521-af7a-da9146c20206]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:18a1e95e-5df1-4db1-92bc-6cd67729c7a7] added\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:45:06 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5268eb3-e108-4421-b72a-35533ea3a492 tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:18a1e95e-5df1-4db1-92bc-6cd67729c7a7] added
Nov 14 09:45:06 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:45:06 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:18a1e95e-5df1-4db1-92bc-6cd67729c7a7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:45:06 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:18a1e95e-5df1-4db1-92bc-6cd67729c7a7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:45:06 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[84e0bf80-b2e7-4138-90ac-f9425589ab47]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:45:06 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5268eb3-e108-4421-b72a-35533ea3a492 tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:45:06 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:18a1e95e-5df1-4db1-92bc-6cd67729c7a7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:45:06 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:18a1e95e-5df1-4db1-92bc-6cd67729c7a7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:45:06 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[27c0db1c-ee91-43a8-b3ce-9dc6975c3ea1]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:45:06 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5268eb3-e108-4421-b72a-35533ea3a492 tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:45:06 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:18a1e95e-5df1-4db1-92bc-6cd67729c7a7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v quUPbjLv {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:45:06 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:18a1e95e-5df1-4db1-92bc-6cd67729c7a7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v quUPbjLv" returned: 0 in 0.022s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:45:06 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[0645d4ae-5035-4cb7-ba26-d0be8f7785b0]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:45:06 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5268eb3-e108-4421-b72a-35533ea3a492 tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'quUPbjLv'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:45:06 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:18a1e95e-5df1-4db1-92bc-6cd67729c7a7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:45:06 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:18a1e95e-5df1-4db1-92bc-6cd67729c7a7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:45:06 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[d00017a9-1d80-4ad7-bbd0-8adefff53730]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:45:06 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5268eb3-e108-4421-b72a-35533ea3a492 tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:45:06 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:45:06 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:45:06 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[3795b286-1659-458a-9996-48577b94bb2e]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2324d4e-6e60-47fd-b536-144a7ea32dce (non-flash)\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:45:06 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5268eb3-e108-4421-b72a-35533ea3a492 tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2324d4e-6e60-47fd-b536-144a7ea32dce (non-flash)
Nov 14 09:45:06 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 09:45:06 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5268eb3-e108-4421-b72a-35533ea3a492 tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2324d4e-6e60-47fd-b536-144a7ea32dce (non-flash)
Nov 14 09:45:06 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 09:45:06 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:18a1e95e-5df1-4db1-92bc-6cd67729c7a7 -p 172.16.0.220:3260 --login {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:45:06 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:18a1e95e-5df1-4db1-92bc-6cd67729c7a7 -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:45:06 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e45bbcc-a6b3-406d-b0fe-ea960ca6738d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:18a1e95e-5df1-4db1-92bc-6cd67729c7a7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:18a1e95e-5df1-4db1-92bc-6cd67729c7a7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:45:06 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5268eb3-e108-4421-b72a-35533ea3a492 tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:18a1e95e-5df1-4db1-92bc-6cd67729c7a7, portal: 172.16.0.220,3260]
Nov 14 09:45:06 user nova-compute[75229]: Login to [iface: default, target: iqn.2010-10.org.openstack:18a1e95e-5df1-4db1-92bc-6cd67729c7a7, portal: 172.16.0.220,3260] successful.
Nov 14 09:45:06 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:45:06 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:18a1e95e-5df1-4db1-92bc-6cd67729c7a7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:45:06 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:18a1e95e-5df1-4db1-92bc-6cd67729c7a7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:45:06 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[143ff7fe-4a6d-412a-90fe-a4d8318edb78]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:45:06 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5268eb3-e108-4421-b72a-35533ea3a492 tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:45:06 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:45:06 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:45:06 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[957d5aaf-bfbf-4068-bcb9-429e32433309]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2324d4e-6e60-47fd-b536-144a7ea32dce (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18a1e95e-5df1-4db1-92bc-6cd67729c7a7 (non-flash)\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:45:06 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5268eb3-e108-4421-b72a-35533ea3a492 tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2324d4e-6e60-47fd-b536-144a7ea32dce (non-flash)
Nov 14 09:45:06 user nova-compute[75229]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18a1e95e-5df1-4db1-92bc-6cd67729c7a7 (non-flash)
Nov 14 09:45:06 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 09:45:06 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5268eb3-e108-4421-b72a-35533ea3a492 tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2324d4e-6e60-47fd-b536-144a7ea32dce (non-flash)
Nov 14 09:45:06 user nova-compute[75229]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18a1e95e-5df1-4db1-92bc-6cd67729c7a7 (non-flash)
Nov 14 09:45:06 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 09:45:06 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-d5268eb3-e108-4421-b72a-35533ea3a492 tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:18a1e95e-5df1-4db1-92bc-6cd67729c7a7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.271s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 09:45:06 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5268eb3-e108-4421-b72a-35533ea3a492 tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] Connected to 172.16.0.220:3260 {{(pid=75229) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 09:45:06 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-d5268eb3-e108-4421-b72a-35533ea3a492 tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] HCTL ('34', '-', '-', 0) found on session 3 with lun 0 {{(pid=75229) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 09:45:06 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-d5268eb3-e108-4421-b72a-35533ea3a492 tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75229) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 09:45:06 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:45:06 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.015s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:45:06 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[50401b6c-8dce-4f92-883b-875c95a2abeb]: (4, ('- - 0', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:45:06 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-d5268eb3-e108-4421-b72a-35533ea3a492 tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] Searching for a device in session 3 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75229) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 09:45:06 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5268eb3-e108-4421-b72a-35533ea3a492 tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:18a1e95e-5df1-4db1-92bc-6cd67729c7a7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'quUPbjLv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75229) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 09:45:07 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-d5268eb3-e108-4421-b72a-35533ea3a492 tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.302s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 09:45:07 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5268eb3-e108-4421-b72a-35533ea3a492 tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] <== connect_volume: return (1304ms) {'type': 'block', 'scsi_wwn': '26237393036626537', 'path': '/dev/sdc'} {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 09:45:07 user nova-compute[75229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d5268eb3-e108-4421-b72a-35533ea3a492 tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] [instance: af5fd5af-63a6-4eee-a4ef-6088a3713214] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26237393036626537', 'path': '/dev/sdc'} {{(pid=75229) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 09:45:07 user nova-compute[75229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d5268eb3-e108-4421-b72a-35533ea3a492 tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] [instance: af5fd5af-63a6-4eee-a4ef-6088a3713214] Calling os-brick to attach iSCSI Volume {{(pid=75229) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 09:45:07 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5268eb3-e108-4421-b72a-35533ea3a492 tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f73f85151b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:97f588de-32d5-4d48-9c06-5925263ba117', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qiIJvnPa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 09:45:07 user nova-compute[75229]: WARNING os_brick.initiator.connectors.base [None req-d5268eb3-e108-4421-b72a-35533ea3a492 tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 09:45:07 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-d5268eb3-e108-4421-b72a-35533ea3a492 tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 09:45:07 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-d5268eb3-e108-4421-b72a-35533ea3a492 tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 09:45:07 user nova-compute[75229]: WARNING os_brick.initiator.connectors.base [None req-d5268eb3-e108-4421-b72a-35533ea3a492 tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 09:45:07 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-d5268eb3-e108-4421-b72a-35533ea3a492 tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:97f588de-32d5-4d48-9c06-5925263ba117" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 09:45:07 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-d5268eb3-e108-4421-b72a-35533ea3a492 tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:97f588de-32d5-4d48-9c06-5925263ba117" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 09:45:07 user nova-compute[75229]: INFO os_brick.initiator.connectors.iscsi [None req-d5268eb3-e108-4421-b72a-35533ea3a492 tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 09:45:07 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97f588de-32d5-4d48-9c06-5925263ba117 -p 172.16.0.220:3260 {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:45:07 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97f588de-32d5-4d48-9c06-5925263ba117 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:45:07 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[df441ca4-d02c-44e0-9d94-7c59656e94df]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:45:07 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5268eb3-e108-4421-b72a-35533ea3a492 tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 09:45:07 user nova-compute[75229]:  {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:45:07 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97f588de-32d5-4d48-9c06-5925263ba117 -p 172.16.0.220:3260 --interface default --op new {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:45:07 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97f588de-32d5-4d48-9c06-5925263ba117 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:45:07 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[2df092be-e418-41a4-8f02-9df7371dd398]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:97f588de-32d5-4d48-9c06-5925263ba117] added\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:45:07 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5268eb3-e108-4421-b72a-35533ea3a492 tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:97f588de-32d5-4d48-9c06-5925263ba117] added
Nov 14 09:45:07 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:45:07 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:45:07 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97f588de-32d5-4d48-9c06-5925263ba117 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:45:07 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97f588de-32d5-4d48-9c06-5925263ba117 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:45:07 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[577b238d-90f0-479c-b790-d2833c1eb468]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:45:07 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5268eb3-e108-4421-b72a-35533ea3a492 tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:45:07 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97f588de-32d5-4d48-9c06-5925263ba117 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:45:07 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97f588de-32d5-4d48-9c06-5925263ba117 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:45:07 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f3d4db6-465e-4f42-84bc-9814339e76cf]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:45:07 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5268eb3-e108-4421-b72a-35533ea3a492 tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:45:07 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97f588de-32d5-4d48-9c06-5925263ba117 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qiIJvnPa {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:45:07 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97f588de-32d5-4d48-9c06-5925263ba117 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qiIJvnPa" returned: 0 in 0.017s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:45:07 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b86e8e3-adbe-4e7a-a837-2ef549da51fb]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:45:07 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5268eb3-e108-4421-b72a-35533ea3a492 tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qiIJvnPa'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:45:07 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97f588de-32d5-4d48-9c06-5925263ba117 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:45:07 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97f588de-32d5-4d48-9c06-5925263ba117 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:45:07 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[42cbe7db-0769-46ce-842c-fb56deddbea3]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:45:07 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5268eb3-e108-4421-b72a-35533ea3a492 tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:45:07 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:45:07 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:45:07 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4cb5693-2fb0-446e-a30d-5d17818fb773]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2324d4e-6e60-47fd-b536-144a7ea32dce (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18a1e95e-5df1-4db1-92bc-6cd67729c7a7 (non-flash)\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:45:07 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5268eb3-e108-4421-b72a-35533ea3a492 tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2324d4e-6e60-47fd-b536-144a7ea32dce (non-flash)
Nov 14 09:45:07 user nova-compute[75229]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18a1e95e-5df1-4db1-92bc-6cd67729c7a7 (non-flash)
Nov 14 09:45:07 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 09:45:07 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5268eb3-e108-4421-b72a-35533ea3a492 tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2324d4e-6e60-47fd-b536-144a7ea32dce (non-flash)
Nov 14 09:45:07 user nova-compute[75229]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18a1e95e-5df1-4db1-92bc-6cd67729c7a7 (non-flash)
Nov 14 09:45:07 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 09:45:07 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97f588de-32d5-4d48-9c06-5925263ba117 -p 172.16.0.220:3260 --login {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:45:07 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97f588de-32d5-4d48-9c06-5925263ba117 -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:45:07 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[393d028e-2b55-4110-8501-a607a9a3ae09]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:97f588de-32d5-4d48-9c06-5925263ba117, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:97f588de-32d5-4d48-9c06-5925263ba117, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:45:07 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5268eb3-e108-4421-b72a-35533ea3a492 tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:97f588de-32d5-4d48-9c06-5925263ba117, portal: 172.16.0.220,3260]
Nov 14 09:45:07 user nova-compute[75229]: Login to [iface: default, target: iqn.2010-10.org.openstack:97f588de-32d5-4d48-9c06-5925263ba117, portal: 172.16.0.220,3260] successful.
Nov 14 09:45:07 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:45:07 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97f588de-32d5-4d48-9c06-5925263ba117 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:45:07 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97f588de-32d5-4d48-9c06-5925263ba117 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:45:07 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[121d6ead-d2a4-4c2f-b963-846cdd01c0cd]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:45:07 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5268eb3-e108-4421-b72a-35533ea3a492 tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:45:07 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:45:07 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:45:07 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[322bc063-ae84-40bf-9885-0a0602c3d21e]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2324d4e-6e60-47fd-b536-144a7ea32dce (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18a1e95e-5df1-4db1-92bc-6cd67729c7a7 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97f588de-32d5-4d48-9c06-5925263ba117 (non-flash)\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:45:07 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5268eb3-e108-4421-b72a-35533ea3a492 tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2324d4e-6e60-47fd-b536-144a7ea32dce (non-flash)
Nov 14 09:45:07 user nova-compute[75229]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18a1e95e-5df1-4db1-92bc-6cd67729c7a7 (non-flash)
Nov 14 09:45:07 user nova-compute[75229]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97f588de-32d5-4d48-9c06-5925263ba117 (non-flash)
Nov 14 09:45:07 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 09:45:07 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5268eb3-e108-4421-b72a-35533ea3a492 tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2324d4e-6e60-47fd-b536-144a7ea32dce (non-flash)
Nov 14 09:45:07 user nova-compute[75229]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18a1e95e-5df1-4db1-92bc-6cd67729c7a7 (non-flash)
Nov 14 09:45:07 user nova-compute[75229]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97f588de-32d5-4d48-9c06-5925263ba117 (non-flash)
Nov 14 09:45:07 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 09:45:07 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-d5268eb3-e108-4421-b72a-35533ea3a492 tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:97f588de-32d5-4d48-9c06-5925263ba117" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.253s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 09:45:07 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5268eb3-e108-4421-b72a-35533ea3a492 tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] Connected to 172.16.0.220:3260 {{(pid=75229) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 09:45:07 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-d5268eb3-e108-4421-b72a-35533ea3a492 tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] HCTL ('35', '-', '-', 0) found on session 4 with lun 0 {{(pid=75229) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 09:45:07 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-d5268eb3-e108-4421-b72a-35533ea3a492 tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75229) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 09:45:07 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:45:07 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:45:07 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[446407fa-3dd0-400b-9698-3254f1710b46]: (4, ('- - 0', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:45:07 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-d5268eb3-e108-4421-b72a-35533ea3a492 tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] Searching for a device in session 4 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75229) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 09:45:07 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5268eb3-e108-4421-b72a-35533ea3a492 tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:97f588de-32d5-4d48-9c06-5925263ba117', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qiIJvnPa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75229) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 09:45:08 user nova-compute[75229]: DEBUG nova.compute.manager [req-f6bba78e-04da-4ed0-9fa7-de7d37973342 req-d65a2145-a4d0-4f4f-a73a-866928a73d9b service nova] [instance: 37e63bd9-44fc-4d07-b31b-570f69d7bc8a] Received event network-vif-plugged-22c0a013-145e-46f8-ab59-f883d51567e6 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:45:08 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-f6bba78e-04da-4ed0-9fa7-de7d37973342 req-d65a2145-a4d0-4f4f-a73a-866928a73d9b service nova] Acquiring lock "37e63bd9-44fc-4d07-b31b-570f69d7bc8a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:45:08 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-f6bba78e-04da-4ed0-9fa7-de7d37973342 req-d65a2145-a4d0-4f4f-a73a-866928a73d9b service nova] Lock "37e63bd9-44fc-4d07-b31b-570f69d7bc8a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:45:08 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-f6bba78e-04da-4ed0-9fa7-de7d37973342 req-d65a2145-a4d0-4f4f-a73a-866928a73d9b service nova] Lock "37e63bd9-44fc-4d07-b31b-570f69d7bc8a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:45:08 user nova-compute[75229]: DEBUG nova.compute.manager [req-f6bba78e-04da-4ed0-9fa7-de7d37973342 req-d65a2145-a4d0-4f4f-a73a-866928a73d9b service nova] [instance: 37e63bd9-44fc-4d07-b31b-570f69d7bc8a] No waiting events found dispatching network-vif-plugged-22c0a013-145e-46f8-ab59-f883d51567e6 {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 09:45:08 user nova-compute[75229]: WARNING nova.compute.manager [req-f6bba78e-04da-4ed0-9fa7-de7d37973342 req-d65a2145-a4d0-4f4f-a73a-866928a73d9b service nova] [instance: 37e63bd9-44fc-4d07-b31b-570f69d7bc8a] Received unexpected event network-vif-plugged-22c0a013-145e-46f8-ab59-f883d51567e6 for instance with vm_state active and task_state None.
Nov 14 09:45:08 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:45:08 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-d5268eb3-e108-4421-b72a-35533ea3a492 tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.283s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 09:45:08 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5268eb3-e108-4421-b72a-35533ea3a492 tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] <== connect_volume: return (1284ms) {'type': 'block', 'scsi_wwn': '23234373839636335', 'path': '/dev/sdd'} {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 09:45:08 user nova-compute[75229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d5268eb3-e108-4421-b72a-35533ea3a492 tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] [instance: af5fd5af-63a6-4eee-a4ef-6088a3713214] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23234373839636335', 'path': '/dev/sdd'} {{(pid=75229) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 09:45:08 user nova-compute[75229]: DEBUG nova.virt.libvirt.vif [None req-d5268eb3-e108-4421-b72a-35533ea3a492 tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T09:44:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-552825535',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-552825535',id=12,image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMcZzdcOYH5cGR1627n6lcQmf726zLltPq4eG5lA89YeaaRpoKefjSoTcpxyVE/DVVi6OLlkF5TWRyNz2Wsn2gQ3fyLDODqgBhgcWeknmoj7yj+as0ZGoZ7gmrjVqaQkQw==',key_name='tempest-keypair-1600873511',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6a9197db757f4a1cafd571eef8d47b15',ramdisk_id='',reservation_id='r-k72il8ne',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-818020951',owner_user_name='tempest-TaggedBootDevicesTest-818020951-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T09:44:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b040ec7bb6eb42ee9d25a5333297bfee',uuid=af5fd5af-63a6-4eee-a4ef-6088a3713214,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a1999f33-4f1d-47b0-a91a-48bce4600e9b", "address": "fa:16:3e:d9:f9:d0", "network": {"id": "a4d3d0e0-1dec-40de-a03f-4241b910cf16", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-380540777-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a9197db757f4a1cafd571eef8d47b15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1999f33-4f", "ovs_interfaceid": "a1999f33-4f1d-47b0-a91a-48bce4600e9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75229) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 09:45:08 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-d5268eb3-e108-4421-b72a-35533ea3a492 tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] Converting VIF {"id": "a1999f33-4f1d-47b0-a91a-48bce4600e9b", "address": "fa:16:3e:d9:f9:d0", "network": {"id": "a4d3d0e0-1dec-40de-a03f-4241b910cf16", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-380540777-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a9197db757f4a1cafd571eef8d47b15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1999f33-4f", "ovs_interfaceid": "a1999f33-4f1d-47b0-a91a-48bce4600e9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 09:45:08 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-d5268eb3-e108-4421-b72a-35533ea3a492 tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d9:f9:d0,bridge_name='br-int',has_traffic_filtering=True,id=a1999f33-4f1d-47b0-a91a-48bce4600e9b,network=Network(a4d3d0e0-1dec-40de-a03f-4241b910cf16),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa1999f33-4f') {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 09:45:08 user nova-compute[75229]: DEBUG nova.virt.libvirt.vif [None req-d5268eb3-e108-4421-b72a-35533ea3a492 tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T09:44:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-552825535',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-552825535',id=12,image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMcZzdcOYH5cGR1627n6lcQmf726zLltPq4eG5lA89YeaaRpoKefjSoTcpxyVE/DVVi6OLlkF5TWRyNz2Wsn2gQ3fyLDODqgBhgcWeknmoj7yj+as0ZGoZ7gmrjVqaQkQw==',key_name='tempest-keypair-1600873511',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6a9197db757f4a1cafd571eef8d47b15',ramdisk_id='',reservation_id='r-k72il8ne',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-818020951',owner_user_name='tempest-TaggedBootDevicesTest-818020951-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T09:44:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b040ec7bb6eb42ee9d25a5333297bfee',uuid=af5fd5af-63a6-4eee-a4ef-6088a3713214,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2f37eb91-97ea-477b-b6c1-933b50ccfca6", "address": "fa:16:3e:1b:33:6b", "network": {"id": "4176f9ca-0910-416d-99e3-a8156bd87229", "bridge": "br-int", "label": "tempest-device-tagging-net1-45180450", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.34", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6a9197db757f4a1cafd571eef8d47b15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f37eb91-97", "ovs_interfaceid": "2f37eb91-97ea-477b-b6c1-933b50ccfca6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75229) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 09:45:08 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-d5268eb3-e108-4421-b72a-35533ea3a492 tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] Converting VIF {"id": "2f37eb91-97ea-477b-b6c1-933b50ccfca6", "address": "fa:16:3e:1b:33:6b", "network": {"id": "4176f9ca-0910-416d-99e3-a8156bd87229", "bridge": "br-int", "label": "tempest-device-tagging-net1-45180450", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.34", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6a9197db757f4a1cafd571eef8d47b15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f37eb91-97", "ovs_interfaceid": "2f37eb91-97ea-477b-b6c1-933b50ccfca6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 09:45:08 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-d5268eb3-e108-4421-b72a-35533ea3a492 tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1b:33:6b,bridge_name='br-int',has_traffic_filtering=True,id=2f37eb91-97ea-477b-b6c1-933b50ccfca6,network=Network(4176f9ca-0910-416d-99e3-a8156bd87229),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap2f37eb91-97') {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 09:45:08 user nova-compute[75229]: DEBUG nova.virt.libvirt.vif [None req-d5268eb3-e108-4421-b72a-35533ea3a492 tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T09:44:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-552825535',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-552825535',id=12,image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMcZzdcOYH5cGR1627n6lcQmf726zLltPq4eG5lA89YeaaRpoKefjSoTcpxyVE/DVVi6OLlkF5TWRyNz2Wsn2gQ3fyLDODqgBhgcWeknmoj7yj+as0ZGoZ7gmrjVqaQkQw==',key_name='tempest-keypair-1600873511',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6a9197db757f4a1cafd571eef8d47b15',ramdisk_id='',reservation_id='r-k72il8ne',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-818020951',owner_user_name='tempest-TaggedBootDevicesTest-818020951-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T09:44:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b040ec7bb6eb42ee9d25a5333297bfee',uuid=af5fd5af-63a6-4eee-a4ef-6088a3713214,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f8dc5389-6e53-421a-9a3a-6c90a89a6eb2", "address": "fa:16:3e:69:0d:d2", "network": {"id": "4176f9ca-0910-416d-99e3-a8156bd87229", "bridge": "br-int", "label": "tempest-device-tagging-net1-45180450", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.210", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6a9197db757f4a1cafd571eef8d47b15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8dc5389-6e", "ovs_interfaceid": "f8dc5389-6e53-421a-9a3a-6c90a89a6eb2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75229) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 09:45:08 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-d5268eb3-e108-4421-b72a-35533ea3a492 tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] Converting VIF {"id": "f8dc5389-6e53-421a-9a3a-6c90a89a6eb2", "address": "fa:16:3e:69:0d:d2", "network": {"id": "4176f9ca-0910-416d-99e3-a8156bd87229", "bridge": "br-int", "label": "tempest-device-tagging-net1-45180450", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.210", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6a9197db757f4a1cafd571eef8d47b15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8dc5389-6e", "ovs_interfaceid": "f8dc5389-6e53-421a-9a3a-6c90a89a6eb2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 09:45:08 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-d5268eb3-e108-4421-b72a-35533ea3a492 tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:69:0d:d2,bridge_name='br-int',has_traffic_filtering=True,id=f8dc5389-6e53-421a-9a3a-6c90a89a6eb2,network=Network(4176f9ca-0910-416d-99e3-a8156bd87229),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf8dc5389-6e') {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 09:45:08 user nova-compute[75229]: DEBUG nova.virt.libvirt.vif [None req-d5268eb3-e108-4421-b72a-35533ea3a492 tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T09:44:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-552825535',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-552825535',id=12,image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMcZzdcOYH5cGR1627n6lcQmf726zLltPq4eG5lA89YeaaRpoKefjSoTcpxyVE/DVVi6OLlkF5TWRyNz2Wsn2gQ3fyLDODqgBhgcWeknmoj7yj+as0ZGoZ7gmrjVqaQkQw==',key_name='tempest-keypair-1600873511',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6a9197db757f4a1cafd571eef8d47b15',ramdisk_id='',reservation_id='r-k72il8ne',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-818020951',owner_user_name='tempest-TaggedBootDevicesTest-818020951-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T09:44:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b040ec7bb6eb42ee9d25a5333297bfee',uuid=af5fd5af-63a6-4eee-a4ef-6088a3713214,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0979136b-2418-4434-9466-75d116e8c780", "address": "fa:16:3e:4d:a2:e0", "network": {"id": "4176f9ca-0910-416d-99e3-a8156bd87229", "bridge": "br-int", "label": "tempest-device-tagging-net1-45180450", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.156", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6a9197db757f4a1cafd571eef8d47b15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0979136b-24", "ovs_interfaceid": "0979136b-2418-4434-9466-75d116e8c780", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75229) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 09:45:08 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-d5268eb3-e108-4421-b72a-35533ea3a492 tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] Converting VIF {"id": "0979136b-2418-4434-9466-75d116e8c780", "address": "fa:16:3e:4d:a2:e0", "network": {"id": "4176f9ca-0910-416d-99e3-a8156bd87229", "bridge": "br-int", "label": "tempest-device-tagging-net1-45180450", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.156", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6a9197db757f4a1cafd571eef8d47b15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0979136b-24", "ovs_interfaceid": "0979136b-2418-4434-9466-75d116e8c780", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 09:45:08 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-d5268eb3-e108-4421-b72a-35533ea3a492 tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4d:a2:e0,bridge_name='br-int',has_traffic_filtering=True,id=0979136b-2418-4434-9466-75d116e8c780,network=Network(4176f9ca-0910-416d-99e3-a8156bd87229),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0979136b-24') {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 09:45:08 user nova-compute[75229]: DEBUG nova.virt.libvirt.vif [None req-d5268eb3-e108-4421-b72a-35533ea3a492 tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T09:44:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-552825535',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-552825535',id=12,image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMcZzdcOYH5cGR1627n6lcQmf726zLltPq4eG5lA89YeaaRpoKefjSoTcpxyVE/DVVi6OLlkF5TWRyNz2Wsn2gQ3fyLDODqgBhgcWeknmoj7yj+as0ZGoZ7gmrjVqaQkQw==',key_name='tempest-keypair-1600873511',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6a9197db757f4a1cafd571eef8d47b15',ramdisk_id='',reservation_id='r-k72il8ne',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-818020951',owner_user_name='tempest-TaggedBootDevicesTest-818020951-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T09:44:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b040ec7bb6eb42ee9d25a5333297bfee',uuid=af5fd5af-63a6-4eee-a4ef-6088a3713214,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1f37d277-e3ac-48ca-b618-27b872f41824", "address": "fa:16:3e:c0:9e:a0", "network": {"id": "4176f9ca-0910-416d-99e3-a8156bd87229", "bridge": "br-int", "label": "tempest-device-tagging-net1-45180450", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.24", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6a9197db757f4a1cafd571eef8d47b15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f37d277-e3", "ovs_interfaceid": "1f37d277-e3ac-48ca-b618-27b872f41824", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75229) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 09:45:08 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-d5268eb3-e108-4421-b72a-35533ea3a492 tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] Converting VIF {"id": "1f37d277-e3ac-48ca-b618-27b872f41824", "address": "fa:16:3e:c0:9e:a0", "network": {"id": "4176f9ca-0910-416d-99e3-a8156bd87229", "bridge": "br-int", "label": "tempest-device-tagging-net1-45180450", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.24", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6a9197db757f4a1cafd571eef8d47b15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f37d277-e3", "ovs_interfaceid": "1f37d277-e3ac-48ca-b618-27b872f41824", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 09:45:08 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-d5268eb3-e108-4421-b72a-35533ea3a492 tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c0:9e:a0,bridge_name='br-int',has_traffic_filtering=True,id=1f37d277-e3ac-48ca-b618-27b872f41824,network=Network(4176f9ca-0910-416d-99e3-a8156bd87229),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f37d277-e3') {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 09:45:08 user nova-compute[75229]: DEBUG nova.virt.libvirt.vif [None req-d5268eb3-e108-4421-b72a-35533ea3a492 tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T09:44:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-552825535',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-552825535',id=12,image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMcZzdcOYH5cGR1627n6lcQmf726zLltPq4eG5lA89YeaaRpoKefjSoTcpxyVE/DVVi6OLlkF5TWRyNz2Wsn2gQ3fyLDODqgBhgcWeknmoj7yj+as0ZGoZ7gmrjVqaQkQw==',key_name='tempest-keypair-1600873511',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6a9197db757f4a1cafd571eef8d47b15',ramdisk_id='',reservation_id='r-k72il8ne',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-818020951',owner_user_name='tempest-TaggedBootDevicesTest-818020951-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T09:44:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b040ec7bb6eb42ee9d25a5333297bfee',uuid=af5fd5af-63a6-4eee-a4ef-6088a3713214,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "768a662a-4bcd-4844-a9ed-f8b8f6b8aa0d", "address": "fa:16:3e:10:aa:95", "network": {"id": "0f777eef-d2ac-43b9-bbef-4f075e98903f", "bridge": "br-int", "label": "tempest-device-tagging-net2-1010361890", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "6a9197db757f4a1cafd571eef8d47b15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap768a662a-4b", "ovs_interfaceid": "768a662a-4bcd-4844-a9ed-f8b8f6b8aa0d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75229) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 09:45:08 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-d5268eb3-e108-4421-b72a-35533ea3a492 tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] Converting VIF {"id": "768a662a-4bcd-4844-a9ed-f8b8f6b8aa0d", "address": "fa:16:3e:10:aa:95", "network": {"id": "0f777eef-d2ac-43b9-bbef-4f075e98903f", "bridge": "br-int", "label": "tempest-device-tagging-net2-1010361890", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "6a9197db757f4a1cafd571eef8d47b15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap768a662a-4b", "ovs_interfaceid": "768a662a-4bcd-4844-a9ed-f8b8f6b8aa0d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 09:45:08 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-d5268eb3-e108-4421-b72a-35533ea3a492 tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:10:aa:95,bridge_name='br-int',has_traffic_filtering=True,id=768a662a-4bcd-4844-a9ed-f8b8f6b8aa0d,network=Network(0f777eef-d2ac-43b9-bbef-4f075e98903f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap768a662a-4b') {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 09:45:08 user nova-compute[75229]: DEBUG nova.virt.libvirt.vif [None req-d5268eb3-e108-4421-b72a-35533ea3a492 tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T09:44:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-552825535',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-552825535',id=12,image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMcZzdcOYH5cGR1627n6lcQmf726zLltPq4eG5lA89YeaaRpoKefjSoTcpxyVE/DVVi6OLlkF5TWRyNz2Wsn2gQ3fyLDODqgBhgcWeknmoj7yj+as0ZGoZ7gmrjVqaQkQw==',key_name='tempest-keypair-1600873511',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6a9197db757f4a1cafd571eef8d47b15',ramdisk_id='',reservation_id='r-k72il8ne',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-818020951',owner_user_name='tempest-TaggedBootDevicesTest-818020951-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T09:44:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b040ec7bb6eb42ee9d25a5333297bfee',uuid=af5fd5af-63a6-4eee-a4ef-6088a3713214,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b7fff2b1-9f14-4632-83e2-3f0a8e4c788b", "address": "fa:16:3e:68:f2:55", "network": {"id": "0f777eef-d2ac-43b9-bbef-4f075e98903f", "bridge": "br-int", "label": "tempest-device-tagging-net2-1010361890", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "6a9197db757f4a1cafd571eef8d47b15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7fff2b1-9f", "ovs_interfaceid": "b7fff2b1-9f14-4632-83e2-3f0a8e4c788b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75229) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 09:45:08 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-d5268eb3-e108-4421-b72a-35533ea3a492 tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] Converting VIF {"id": "b7fff2b1-9f14-4632-83e2-3f0a8e4c788b", "address": "fa:16:3e:68:f2:55", "network": {"id": "0f777eef-d2ac-43b9-bbef-4f075e98903f", "bridge": "br-int", "label": "tempest-device-tagging-net2-1010361890", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "6a9197db757f4a1cafd571eef8d47b15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7fff2b1-9f", "ovs_interfaceid": "b7fff2b1-9f14-4632-83e2-3f0a8e4c788b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 09:45:08 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-d5268eb3-e108-4421-b72a-35533ea3a492 tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:68:f2:55,bridge_name='br-int',has_traffic_filtering=True,id=b7fff2b1-9f14-4632-83e2-3f0a8e4c788b,network=Network(0f777eef-d2ac-43b9-bbef-4f075e98903f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7fff2b1-9f') {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 09:45:08 user nova-compute[75229]: DEBUG nova.objects.instance [None req-d5268eb3-e108-4421-b72a-35533ea3a492 tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] Lazy-loading 'pci_devices' on Instance uuid af5fd5af-63a6-4eee-a4ef-6088a3713214 {{(pid=75229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 09:45:08 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-d5268eb3-e108-4421-b72a-35533ea3a492 tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] [instance: af5fd5af-63a6-4eee-a4ef-6088a3713214] End _get_guest_xml xml=<domain type="kvm">
Nov 14 09:45:08 user nova-compute[75229]:   <uuid>af5fd5af-63a6-4eee-a4ef-6088a3713214</uuid>
Nov 14 09:45:08 user nova-compute[75229]:   <name>instance-0000000c</name>
Nov 14 09:45:08 user nova-compute[75229]:   <memory>524288</memory>
Nov 14 09:45:08 user nova-compute[75229]:   <vcpu>1</vcpu>
Nov 14 09:45:08 user nova-compute[75229]:   <metadata>
Nov 14 09:45:08 user nova-compute[75229]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 09:45:08 user nova-compute[75229]:       <nova:package version="0.0.0"/>
Nov 14 09:45:08 user nova-compute[75229]:       <nova:name>tempest-device-tagging-server-552825535</nova:name>
Nov 14 09:45:08 user nova-compute[75229]:       <nova:creationTime>2023-11-14 09:45:04</nova:creationTime>
Nov 14 09:45:08 user nova-compute[75229]:       <nova:flavor name="m1.tiny">
Nov 14 09:45:08 user nova-compute[75229]:         <nova:memory>512</nova:memory>
Nov 14 09:45:08 user nova-compute[75229]:         <nova:disk>1</nova:disk>
Nov 14 09:45:08 user nova-compute[75229]:         <nova:swap>0</nova:swap>
Nov 14 09:45:08 user nova-compute[75229]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 09:45:08 user nova-compute[75229]:         <nova:vcpus>1</nova:vcpus>
Nov 14 09:45:08 user nova-compute[75229]:       </nova:flavor>
Nov 14 09:45:08 user nova-compute[75229]:       <nova:owner>
Nov 14 09:45:08 user nova-compute[75229]:         <nova:user uuid="b040ec7bb6eb42ee9d25a5333297bfee">tempest-TaggedBootDevicesTest-818020951-project-member</nova:user>
Nov 14 09:45:08 user nova-compute[75229]:         <nova:project uuid="6a9197db757f4a1cafd571eef8d47b15">tempest-TaggedBootDevicesTest-818020951</nova:project>
Nov 14 09:45:08 user nova-compute[75229]:       </nova:owner>
Nov 14 09:45:08 user nova-compute[75229]:       <nova:root type="image" uuid="3bef8470-ecc7-40e3-95d4-9254348ea72d"/>
Nov 14 09:45:08 user nova-compute[75229]:       <nova:ports>
Nov 14 09:45:08 user nova-compute[75229]:         <nova:port uuid="a1999f33-4f1d-47b0-a91a-48bce4600e9b">
Nov 14 09:45:08 user nova-compute[75229]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 14 09:45:08 user nova-compute[75229]:         </nova:port>
Nov 14 09:45:08 user nova-compute[75229]:         <nova:port uuid="2f37eb91-97ea-477b-b6c1-933b50ccfca6">
Nov 14 09:45:08 user nova-compute[75229]:           <nova:ip type="fixed" address="10.1.1.34" ipVersion="4"/>
Nov 14 09:45:08 user nova-compute[75229]:         </nova:port>
Nov 14 09:45:08 user nova-compute[75229]:         <nova:port uuid="f8dc5389-6e53-421a-9a3a-6c90a89a6eb2">
Nov 14 09:45:08 user nova-compute[75229]:           <nova:ip type="fixed" address="10.1.1.210" ipVersion="4"/>
Nov 14 09:45:08 user nova-compute[75229]:         </nova:port>
Nov 14 09:45:08 user nova-compute[75229]:         <nova:port uuid="0979136b-2418-4434-9466-75d116e8c780">
Nov 14 09:45:08 user nova-compute[75229]:           <nova:ip type="fixed" address="10.1.1.156" ipVersion="4"/>
Nov 14 09:45:08 user nova-compute[75229]:         </nova:port>
Nov 14 09:45:08 user nova-compute[75229]:         <nova:port uuid="1f37d277-e3ac-48ca-b618-27b872f41824">
Nov 14 09:45:08 user nova-compute[75229]:           <nova:ip type="fixed" address="10.1.1.24" ipVersion="4"/>
Nov 14 09:45:08 user nova-compute[75229]:         </nova:port>
Nov 14 09:45:08 user nova-compute[75229]:         <nova:port uuid="768a662a-4bcd-4844-a9ed-f8b8f6b8aa0d">
Nov 14 09:45:08 user nova-compute[75229]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Nov 14 09:45:08 user nova-compute[75229]:         </nova:port>
Nov 14 09:45:08 user nova-compute[75229]:         <nova:port uuid="b7fff2b1-9f14-4632-83e2-3f0a8e4c788b">
Nov 14 09:45:08 user nova-compute[75229]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Nov 14 09:45:08 user nova-compute[75229]:         </nova:port>
Nov 14 09:45:08 user nova-compute[75229]:       </nova:ports>
Nov 14 09:45:08 user nova-compute[75229]:     </nova:instance>
Nov 14 09:45:08 user nova-compute[75229]:   </metadata>
Nov 14 09:45:08 user nova-compute[75229]:   <sysinfo type="smbios">
Nov 14 09:45:08 user nova-compute[75229]:     <system>
Nov 14 09:45:08 user nova-compute[75229]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 09:45:08 user nova-compute[75229]:       <entry name="product">OpenStack Nova</entry>
Nov 14 09:45:08 user nova-compute[75229]:       <entry name="version">0.0.0</entry>
Nov 14 09:45:08 user nova-compute[75229]:       <entry name="serial">af5fd5af-63a6-4eee-a4ef-6088a3713214</entry>
Nov 14 09:45:08 user nova-compute[75229]:       <entry name="uuid">af5fd5af-63a6-4eee-a4ef-6088a3713214</entry>
Nov 14 09:45:08 user nova-compute[75229]:       <entry name="family">Virtual Machine</entry>
Nov 14 09:45:08 user nova-compute[75229]:     </system>
Nov 14 09:45:08 user nova-compute[75229]:   </sysinfo>
Nov 14 09:45:08 user nova-compute[75229]:   <os>
Nov 14 09:45:08 user nova-compute[75229]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 09:45:08 user nova-compute[75229]:     <boot dev="hd"/>
Nov 14 09:45:08 user nova-compute[75229]:     <smbios mode="sysinfo"/>
Nov 14 09:45:08 user nova-compute[75229]:   </os>
Nov 14 09:45:08 user nova-compute[75229]:   <features>
Nov 14 09:45:08 user nova-compute[75229]:     <acpi/>
Nov 14 09:45:08 user nova-compute[75229]:     <apic/>
Nov 14 09:45:08 user nova-compute[75229]:     <vmcoreinfo/>
Nov 14 09:45:08 user nova-compute[75229]:   </features>
Nov 14 09:45:08 user nova-compute[75229]:   <clock offset="utc">
Nov 14 09:45:08 user nova-compute[75229]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 09:45:08 user nova-compute[75229]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 09:45:08 user nova-compute[75229]:     <timer name="hpet" present="no"/>
Nov 14 09:45:08 user nova-compute[75229]:   </clock>
Nov 14 09:45:08 user nova-compute[75229]:   <cpu mode="custom" match="exact">
Nov 14 09:45:08 user nova-compute[75229]:     <model>Nehalem</model>
Nov 14 09:45:08 user nova-compute[75229]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 09:45:08 user nova-compute[75229]:   </cpu>
Nov 14 09:45:08 user nova-compute[75229]:   <devices>
Nov 14 09:45:08 user nova-compute[75229]:     <disk type="file" device="cdrom">
Nov 14 09:45:08 user nova-compute[75229]:       <driver name="qemu" type="raw" cache="none"/>
Nov 14 09:45:08 user nova-compute[75229]:       <source file="/opt/stack/data/nova/instances/af5fd5af-63a6-4eee-a4ef-6088a3713214/disk.config"/>
Nov 14 09:45:08 user nova-compute[75229]:       <target dev="hda" bus="ide"/>
Nov 14 09:45:08 user nova-compute[75229]:     </disk>
Nov 14 09:45:08 user nova-compute[75229]:     <disk type="block" device="disk">
Nov 14 09:45:08 user nova-compute[75229]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 09:45:08 user nova-compute[75229]:       <source dev="/dev/sdb"/>
Nov 14 09:45:08 user nova-compute[75229]:       <target dev="vda" bus="virtio"/>
Nov 14 09:45:08 user nova-compute[75229]:       <serial>c2324d4e-6e60-47fd-b536-144a7ea32dce</serial>
Nov 14 09:45:08 user nova-compute[75229]:     </disk>
Nov 14 09:45:08 user nova-compute[75229]:     <disk type="block" device="disk">
Nov 14 09:45:08 user nova-compute[75229]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 09:45:08 user nova-compute[75229]:       <source dev="/dev/sdc"/>
Nov 14 09:45:08 user nova-compute[75229]:       <target dev="vdb" bus="virtio"/>
Nov 14 09:45:08 user nova-compute[75229]:       <serial>18a1e95e-5df1-4db1-92bc-6cd67729c7a7</serial>
Nov 14 09:45:08 user nova-compute[75229]:     </disk>
Nov 14 09:45:08 user nova-compute[75229]:     <disk type="block" device="disk">
Nov 14 09:45:08 user nova-compute[75229]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 09:45:08 user nova-compute[75229]:       <source dev="/dev/sdd"/>
Nov 14 09:45:08 user nova-compute[75229]:       <target dev="vdc" bus="virtio"/>
Nov 14 09:45:08 user nova-compute[75229]:       <serial>97f588de-32d5-4d48-9c06-5925263ba117</serial>
Nov 14 09:45:08 user nova-compute[75229]:     </disk>
Nov 14 09:45:08 user nova-compute[75229]:     <interface type="ethernet">
Nov 14 09:45:08 user nova-compute[75229]:       <mac address="fa:16:3e:d9:f9:d0"/>
Nov 14 09:45:08 user nova-compute[75229]:       <model type="virtio"/>
Nov 14 09:45:08 user nova-compute[75229]:       <mtu size="1442"/>
Nov 14 09:45:08 user nova-compute[75229]:       <target dev="tapa1999f33-4f"/>
Nov 14 09:45:08 user nova-compute[75229]:     </interface>
Nov 14 09:45:08 user nova-compute[75229]:     <interface type="ethernet">
Nov 14 09:45:08 user nova-compute[75229]:       <mac address="fa:16:3e:1b:33:6b"/>
Nov 14 09:45:08 user nova-compute[75229]:       <model type="virtio"/>
Nov 14 09:45:08 user nova-compute[75229]:       <mtu size="1442"/>
Nov 14 09:45:08 user nova-compute[75229]:       <target dev="tap2f37eb91-97"/>
Nov 14 09:45:08 user nova-compute[75229]:     </interface>
Nov 14 09:45:08 user nova-compute[75229]:     <interface type="ethernet">
Nov 14 09:45:08 user nova-compute[75229]:       <mac address="fa:16:3e:69:0d:d2"/>
Nov 14 09:45:08 user nova-compute[75229]:       <model type="virtio"/>
Nov 14 09:45:08 user nova-compute[75229]:       <mtu size="1442"/>
Nov 14 09:45:08 user nova-compute[75229]:       <target dev="tapf8dc5389-6e"/>
Nov 14 09:45:08 user nova-compute[75229]:     </interface>
Nov 14 09:45:08 user nova-compute[75229]:     <interface type="ethernet">
Nov 14 09:45:08 user nova-compute[75229]:       <mac address="fa:16:3e:4d:a2:e0"/>
Nov 14 09:45:08 user nova-compute[75229]:       <model type="virtio"/>
Nov 14 09:45:08 user nova-compute[75229]:       <mtu size="1442"/>
Nov 14 09:45:08 user nova-compute[75229]:       <target dev="tap0979136b-24"/>
Nov 14 09:45:08 user nova-compute[75229]:     </interface>
Nov 14 09:45:08 user nova-compute[75229]:     <interface type="ethernet">
Nov 14 09:45:08 user nova-compute[75229]:       <mac address="fa:16:3e:c0:9e:a0"/>
Nov 14 09:45:08 user nova-compute[75229]:       <model type="virtio"/>
Nov 14 09:45:08 user nova-compute[75229]:       <mtu size="1442"/>
Nov 14 09:45:08 user nova-compute[75229]:       <target dev="tap1f37d277-e3"/>
Nov 14 09:45:08 user nova-compute[75229]:     </interface>
Nov 14 09:45:08 user nova-compute[75229]:     <interface type="ethernet">
Nov 14 09:45:08 user nova-compute[75229]:       <mac address="fa:16:3e:10:aa:95"/>
Nov 14 09:45:08 user nova-compute[75229]:       <model type="virtio"/>
Nov 14 09:45:08 user nova-compute[75229]:       <mtu size="1442"/>
Nov 14 09:45:08 user nova-compute[75229]:       <target dev="tap768a662a-4b"/>
Nov 14 09:45:08 user nova-compute[75229]:     </interface>
Nov 14 09:45:08 user nova-compute[75229]:     <interface type="ethernet">
Nov 14 09:45:08 user nova-compute[75229]:       <mac address="fa:16:3e:68:f2:55"/>
Nov 14 09:45:08 user nova-compute[75229]:       <model type="virtio"/>
Nov 14 09:45:08 user nova-compute[75229]:       <mtu size="1442"/>
Nov 14 09:45:08 user nova-compute[75229]:       <target dev="tapb7fff2b1-9f"/>
Nov 14 09:45:08 user nova-compute[75229]:     </interface>
Nov 14 09:45:08 user nova-compute[75229]:     <serial type="pty">
Nov 14 09:45:08 user nova-compute[75229]:       <log file="/opt/stack/data/nova/instances/af5fd5af-63a6-4eee-a4ef-6088a3713214/console.log" append="off"/>
Nov 14 09:45:08 user nova-compute[75229]:     </serial>
Nov 14 09:45:08 user nova-compute[75229]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 09:45:08 user nova-compute[75229]:     <video>
Nov 14 09:45:08 user nova-compute[75229]:       <model type="virtio"/>
Nov 14 09:45:08 user nova-compute[75229]:     </video>
Nov 14 09:45:08 user nova-compute[75229]:     <rng model="virtio">
Nov 14 09:45:08 user nova-compute[75229]:       <backend model="random">/dev/urandom</backend>
Nov 14 09:45:08 user nova-compute[75229]:     </rng>
Nov 14 09:45:08 user nova-compute[75229]:     <controller type="usb" index="0" model="none"/>
Nov 14 09:45:08 user nova-compute[75229]:     <memballoon model="virtio">
Nov 14 09:45:08 user nova-compute[75229]:       <stats period="10"/>
Nov 14 09:45:08 user nova-compute[75229]:     </memballoon>
Nov 14 09:45:08 user nova-compute[75229]:   </devices>
Nov 14 09:45:08 user nova-compute[75229]: </domain>
Nov 14 09:45:08 user nova-compute[75229]:  {{(pid=75229) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 09:45:08 user nova-compute[75229]: DEBUG nova.virt.libvirt.vif [None req-d5268eb3-e108-4421-b72a-35533ea3a492 tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T09:44:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-552825535',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-552825535',id=12,image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMcZzdcOYH5cGR1627n6lcQmf726zLltPq4eG5lA89YeaaRpoKefjSoTcpxyVE/DVVi6OLlkF5TWRyNz2Wsn2gQ3fyLDODqgBhgcWeknmoj7yj+as0ZGoZ7gmrjVqaQkQw==',key_name='tempest-keypair-1600873511',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6a9197db757f4a1cafd571eef8d47b15',ramdisk_id='',reservation_id='r-k72il8ne',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-818020951',owner_user_name='tempest-TaggedBootDevicesTest-818020951-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T09:44:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b040ec7bb6eb42ee9d25a5333297bfee',uuid=af5fd5af-63a6-4eee-a4ef-6088a3713214,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a1999f33-4f1d-47b0-a91a-48bce4600e9b", "address": "fa:16:3e:d9:f9:d0", "network": {"id": "a4d3d0e0-1dec-40de-a03f-4241b910cf16", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-380540777-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a9197db757f4a1cafd571eef8d47b15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1999f33-4f", "ovs_interfaceid": "a1999f33-4f1d-47b0-a91a-48bce4600e9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 09:45:08 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-d5268eb3-e108-4421-b72a-35533ea3a492 tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] Converting VIF {"id": "a1999f33-4f1d-47b0-a91a-48bce4600e9b", "address": "fa:16:3e:d9:f9:d0", "network": {"id": "a4d3d0e0-1dec-40de-a03f-4241b910cf16", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-380540777-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a9197db757f4a1cafd571eef8d47b15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1999f33-4f", "ovs_interfaceid": "a1999f33-4f1d-47b0-a91a-48bce4600e9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 09:45:08 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-d5268eb3-e108-4421-b72a-35533ea3a492 tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d9:f9:d0,bridge_name='br-int',has_traffic_filtering=True,id=a1999f33-4f1d-47b0-a91a-48bce4600e9b,network=Network(a4d3d0e0-1dec-40de-a03f-4241b910cf16),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa1999f33-4f') {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 09:45:08 user nova-compute[75229]: DEBUG os_vif [None req-d5268eb3-e108-4421-b72a-35533ea3a492 tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d9:f9:d0,bridge_name='br-int',has_traffic_filtering=True,id=a1999f33-4f1d-47b0-a91a-48bce4600e9b,network=Network(a4d3d0e0-1dec-40de-a03f-4241b910cf16),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa1999f33-4f') {{(pid=75229) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 09:45:08 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:45:08 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:45:08 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 09:45:08 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:45:08 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '65fac6ab-8cc5-5eea-b95b-ade325043a4a', '_type': 'linux-noop'}}, row=False) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:45:08 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 09:45:08 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:45:08 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa1999f33-4f, may_exist=True, interface_attrs={}) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:45:08 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa1999f33-4f, col_values=(('qos', UUID('ece33c38-8f93-43aa-a66b-8fcded9a2da4')),), if_exists=True) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:45:08 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa1999f33-4f, col_values=(('external_ids', {'iface-id': 'a1999f33-4f1d-47b0-a91a-48bce4600e9b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d9:f9:d0', 'vm-uuid': 'af5fd5af-63a6-4eee-a4ef-6088a3713214'}),), if_exists=True) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:45:08 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 09:45:08 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:45:08 user nova-compute[75229]: INFO os_vif [None req-d5268eb3-e108-4421-b72a-35533ea3a492 tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d9:f9:d0,bridge_name='br-int',has_traffic_filtering=True,id=a1999f33-4f1d-47b0-a91a-48bce4600e9b,network=Network(a4d3d0e0-1dec-40de-a03f-4241b910cf16),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa1999f33-4f')
Nov 14 09:45:08 user nova-compute[75229]: DEBUG nova.virt.libvirt.vif [None req-d5268eb3-e108-4421-b72a-35533ea3a492 tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T09:44:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-552825535',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-552825535',id=12,image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMcZzdcOYH5cGR1627n6lcQmf726zLltPq4eG5lA89YeaaRpoKefjSoTcpxyVE/DVVi6OLlkF5TWRyNz2Wsn2gQ3fyLDODqgBhgcWeknmoj7yj+as0ZGoZ7gmrjVqaQkQw==',key_name='tempest-keypair-1600873511',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6a9197db757f4a1cafd571eef8d47b15',ramdisk_id='',reservation_id='r-k72il8ne',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-818020951',owner_user_name='tempest-TaggedBootDevicesTest-818020951-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T09:44:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b040ec7bb6eb42ee9d25a5333297bfee',uuid=af5fd5af-63a6-4eee-a4ef-6088a3713214,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2f37eb91-97ea-477b-b6c1-933b50ccfca6", "address": "fa:16:3e:1b:33:6b", "network": {"id": "4176f9ca-0910-416d-99e3-a8156bd87229", "bridge": "br-int", "label": "tempest-device-tagging-net1-45180450", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.34", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6a9197db757f4a1cafd571eef8d47b15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f37eb91-97", "ovs_interfaceid": "2f37eb91-97ea-477b-b6c1-933b50ccfca6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75229) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 09:45:08 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-d5268eb3-e108-4421-b72a-35533ea3a492 tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] Converting VIF {"id": "2f37eb91-97ea-477b-b6c1-933b50ccfca6", "address": "fa:16:3e:1b:33:6b", "network": {"id": "4176f9ca-0910-416d-99e3-a8156bd87229", "bridge": "br-int", "label": "tempest-device-tagging-net1-45180450", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.34", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6a9197db757f4a1cafd571eef8d47b15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f37eb91-97", "ovs_interfaceid": "2f37eb91-97ea-477b-b6c1-933b50ccfca6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 09:45:08 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-d5268eb3-e108-4421-b72a-35533ea3a492 tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1b:33:6b,bridge_name='br-int',has_traffic_filtering=True,id=2f37eb91-97ea-477b-b6c1-933b50ccfca6,network=Network(4176f9ca-0910-416d-99e3-a8156bd87229),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap2f37eb91-97') {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 09:45:08 user nova-compute[75229]: DEBUG os_vif [None req-d5268eb3-e108-4421-b72a-35533ea3a492 tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1b:33:6b,bridge_name='br-int',has_traffic_filtering=True,id=2f37eb91-97ea-477b-b6c1-933b50ccfca6,network=Network(4176f9ca-0910-416d-99e3-a8156bd87229),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap2f37eb91-97') {{(pid=75229) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 09:45:08 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:45:08 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:45:08 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 09:45:08 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:45:08 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6aa15216-3586-5f73-8894-2740d53d5834', '_type': 'linux-noop'}}, row=False) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:45:08 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 09:45:09 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:45:09 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:45:09 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2f37eb91-97, may_exist=True, interface_attrs={}) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:45:09 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2f37eb91-97, col_values=(('qos', UUID('d285989f-d07e-4a33-87da-12b2265aed2a')),), if_exists=True) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:45:09 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2f37eb91-97, col_values=(('external_ids', {'iface-id': '2f37eb91-97ea-477b-b6c1-933b50ccfca6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1b:33:6b', 'vm-uuid': 'af5fd5af-63a6-4eee-a4ef-6088a3713214'}),), if_exists=True) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:45:09 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 09:45:09 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:45:09 user nova-compute[75229]: INFO os_vif [None req-d5268eb3-e108-4421-b72a-35533ea3a492 tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1b:33:6b,bridge_name='br-int',has_traffic_filtering=True,id=2f37eb91-97ea-477b-b6c1-933b50ccfca6,network=Network(4176f9ca-0910-416d-99e3-a8156bd87229),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap2f37eb91-97')
Nov 14 09:45:09 user nova-compute[75229]: DEBUG nova.virt.libvirt.vif [None req-d5268eb3-e108-4421-b72a-35533ea3a492 tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T09:44:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-552825535',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-552825535',id=12,image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMcZzdcOYH5cGR1627n6lcQmf726zLltPq4eG5lA89YeaaRpoKefjSoTcpxyVE/DVVi6OLlkF5TWRyNz2Wsn2gQ3fyLDODqgBhgcWeknmoj7yj+as0ZGoZ7gmrjVqaQkQw==',key_name='tempest-keypair-1600873511',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6a9197db757f4a1cafd571eef8d47b15',ramdisk_id='',reservation_id='r-k72il8ne',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-818020951',owner_user_name='tempest-TaggedBootDevicesTest-818020951-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T09:44:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b040ec7bb6eb42ee9d25a5333297bfee',uuid=af5fd5af-63a6-4eee-a4ef-6088a3713214,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f8dc5389-6e53-421a-9a3a-6c90a89a6eb2", "address": "fa:16:3e:69:0d:d2", "network": {"id": "4176f9ca-0910-416d-99e3-a8156bd87229", "bridge": "br-int", "label": "tempest-device-tagging-net1-45180450", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.210", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6a9197db757f4a1cafd571eef8d47b15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8dc5389-6e", "ovs_interfaceid": "f8dc5389-6e53-421a-9a3a-6c90a89a6eb2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75229) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 09:45:09 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-d5268eb3-e108-4421-b72a-35533ea3a492 tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] Converting VIF {"id": "f8dc5389-6e53-421a-9a3a-6c90a89a6eb2", "address": "fa:16:3e:69:0d:d2", "network": {"id": "4176f9ca-0910-416d-99e3-a8156bd87229", "bridge": "br-int", "label": "tempest-device-tagging-net1-45180450", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.210", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6a9197db757f4a1cafd571eef8d47b15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8dc5389-6e", "ovs_interfaceid": "f8dc5389-6e53-421a-9a3a-6c90a89a6eb2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 09:45:09 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-d5268eb3-e108-4421-b72a-35533ea3a492 tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:69:0d:d2,bridge_name='br-int',has_traffic_filtering=True,id=f8dc5389-6e53-421a-9a3a-6c90a89a6eb2,network=Network(4176f9ca-0910-416d-99e3-a8156bd87229),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf8dc5389-6e') {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 09:45:09 user nova-compute[75229]: DEBUG os_vif [None req-d5268eb3-e108-4421-b72a-35533ea3a492 tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:69:0d:d2,bridge_name='br-int',has_traffic_filtering=True,id=f8dc5389-6e53-421a-9a3a-6c90a89a6eb2,network=Network(4176f9ca-0910-416d-99e3-a8156bd87229),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf8dc5389-6e') {{(pid=75229) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 09:45:09 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:45:09 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:45:09 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 09:45:09 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:45:09 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b8a6523c-6753-5d71-b7c1-9ab6e9e83b27', '_type': 'linux-noop'}}, row=False) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:45:09 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 09:45:09 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:45:09 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:45:09 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf8dc5389-6e, may_exist=True, interface_attrs={}) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:45:09 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf8dc5389-6e, col_values=(('qos', UUID('8bdbb8eb-8ad1-4ec4-aa65-ccc301c1c5b1')),), if_exists=True) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:45:09 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf8dc5389-6e, col_values=(('external_ids', {'iface-id': 'f8dc5389-6e53-421a-9a3a-6c90a89a6eb2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:69:0d:d2', 'vm-uuid': 'af5fd5af-63a6-4eee-a4ef-6088a3713214'}),), if_exists=True) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:45:09 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:45:09 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 09:45:09 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:45:09 user nova-compute[75229]: INFO os_vif [None req-d5268eb3-e108-4421-b72a-35533ea3a492 tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:69:0d:d2,bridge_name='br-int',has_traffic_filtering=True,id=f8dc5389-6e53-421a-9a3a-6c90a89a6eb2,network=Network(4176f9ca-0910-416d-99e3-a8156bd87229),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf8dc5389-6e')
Nov 14 09:45:09 user nova-compute[75229]: DEBUG nova.virt.libvirt.vif [None req-d5268eb3-e108-4421-b72a-35533ea3a492 tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T09:44:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-552825535',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-552825535',id=12,image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMcZzdcOYH5cGR1627n6lcQmf726zLltPq4eG5lA89YeaaRpoKefjSoTcpxyVE/DVVi6OLlkF5TWRyNz2Wsn2gQ3fyLDODqgBhgcWeknmoj7yj+as0ZGoZ7gmrjVqaQkQw==',key_name='tempest-keypair-1600873511',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6a9197db757f4a1cafd571eef8d47b15',ramdisk_id='',reservation_id='r-k72il8ne',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-818020951',owner_user_name='tempest-TaggedBootDevicesTest-818020951-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T09:44:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b040ec7bb6eb42ee9d25a5333297bfee',uuid=af5fd5af-63a6-4eee-a4ef-6088a3713214,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0979136b-2418-4434-9466-75d116e8c780", "address": "fa:16:3e:4d:a2:e0", "network": {"id": "4176f9ca-0910-416d-99e3-a8156bd87229", "bridge": "br-int", "label": "tempest-device-tagging-net1-45180450", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.156", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6a9197db757f4a1cafd571eef8d47b15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0979136b-24", "ovs_interfaceid": "0979136b-2418-4434-9466-75d116e8c780", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 09:45:09 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-d5268eb3-e108-4421-b72a-35533ea3a492 tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] Converting VIF {"id": "0979136b-2418-4434-9466-75d116e8c780", "address": "fa:16:3e:4d:a2:e0", "network": {"id": "4176f9ca-0910-416d-99e3-a8156bd87229", "bridge": "br-int", "label": "tempest-device-tagging-net1-45180450", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.156", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6a9197db757f4a1cafd571eef8d47b15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0979136b-24", "ovs_interfaceid": "0979136b-2418-4434-9466-75d116e8c780", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 09:45:09 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-d5268eb3-e108-4421-b72a-35533ea3a492 tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4d:a2:e0,bridge_name='br-int',has_traffic_filtering=True,id=0979136b-2418-4434-9466-75d116e8c780,network=Network(4176f9ca-0910-416d-99e3-a8156bd87229),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0979136b-24') {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 09:45:09 user nova-compute[75229]: DEBUG os_vif [None req-d5268eb3-e108-4421-b72a-35533ea3a492 tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4d:a2:e0,bridge_name='br-int',has_traffic_filtering=True,id=0979136b-2418-4434-9466-75d116e8c780,network=Network(4176f9ca-0910-416d-99e3-a8156bd87229),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0979136b-24') {{(pid=75229) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 09:45:09 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:45:09 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:45:09 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 09:45:09 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:45:09 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4b80e621-2ef4-5608-8260-f8cde050a849', '_type': 'linux-noop'}}, row=False) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:45:09 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:45:09 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 09:45:09 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:45:09 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:45:09 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0979136b-24, may_exist=True, interface_attrs={}) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:45:09 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0979136b-24, col_values=(('qos', UUID('13abf746-d2f5-47f4-98dd-ede214f9e2f3')),), if_exists=True) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:45:09 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0979136b-24, col_values=(('external_ids', {'iface-id': '0979136b-2418-4434-9466-75d116e8c780', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4d:a2:e0', 'vm-uuid': 'af5fd5af-63a6-4eee-a4ef-6088a3713214'}),), if_exists=True) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:45:09 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:45:09 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 09:45:09 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:45:09 user nova-compute[75229]: INFO os_vif [None req-d5268eb3-e108-4421-b72a-35533ea3a492 tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4d:a2:e0,bridge_name='br-int',has_traffic_filtering=True,id=0979136b-2418-4434-9466-75d116e8c780,network=Network(4176f9ca-0910-416d-99e3-a8156bd87229),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0979136b-24')
Nov 14 09:45:09 user nova-compute[75229]: DEBUG nova.virt.libvirt.vif [None req-d5268eb3-e108-4421-b72a-35533ea3a492 tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T09:44:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-552825535',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-552825535',id=12,image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMcZzdcOYH5cGR1627n6lcQmf726zLltPq4eG5lA89YeaaRpoKefjSoTcpxyVE/DVVi6OLlkF5TWRyNz2Wsn2gQ3fyLDODqgBhgcWeknmoj7yj+as0ZGoZ7gmrjVqaQkQw==',key_name='tempest-keypair-1600873511',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6a9197db757f4a1cafd571eef8d47b15',ramdisk_id='',reservation_id='r-k72il8ne',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-818020951',owner_user_name='tempest-TaggedBootDevicesTest-818020951-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T09:44:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b040ec7bb6eb42ee9d25a5333297bfee',uuid=af5fd5af-63a6-4eee-a4ef-6088a3713214,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1f37d277-e3ac-48ca-b618-27b872f41824", "address": "fa:16:3e:c0:9e:a0", "network": {"id": "4176f9ca-0910-416d-99e3-a8156bd87229", "bridge": "br-int", "label": "tempest-device-tagging-net1-45180450", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.24", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6a9197db757f4a1cafd571eef8d47b15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f37d277-e3", "ovs_interfaceid": "1f37d277-e3ac-48ca-b618-27b872f41824", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 09:45:09 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-d5268eb3-e108-4421-b72a-35533ea3a492 tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] Converting VIF {"id": "1f37d277-e3ac-48ca-b618-27b872f41824", "address": "fa:16:3e:c0:9e:a0", "network": {"id": "4176f9ca-0910-416d-99e3-a8156bd87229", "bridge": "br-int", "label": "tempest-device-tagging-net1-45180450", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.24", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6a9197db757f4a1cafd571eef8d47b15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f37d277-e3", "ovs_interfaceid": "1f37d277-e3ac-48ca-b618-27b872f41824", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 09:45:09 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-d5268eb3-e108-4421-b72a-35533ea3a492 tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c0:9e:a0,bridge_name='br-int',has_traffic_filtering=True,id=1f37d277-e3ac-48ca-b618-27b872f41824,network=Network(4176f9ca-0910-416d-99e3-a8156bd87229),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f37d277-e3') {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 09:45:09 user nova-compute[75229]: DEBUG os_vif [None req-d5268eb3-e108-4421-b72a-35533ea3a492 tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c0:9e:a0,bridge_name='br-int',has_traffic_filtering=True,id=1f37d277-e3ac-48ca-b618-27b872f41824,network=Network(4176f9ca-0910-416d-99e3-a8156bd87229),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f37d277-e3') {{(pid=75229) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 09:45:09 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:45:09 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:45:09 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 09:45:09 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:45:09 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd5cfe9ac-9946-5dd5-a027-66f69f4afe01', '_type': 'linux-noop'}}, row=False) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:45:09 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:45:09 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 09:45:09 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:45:09 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:45:09 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1f37d277-e3, may_exist=True, interface_attrs={}) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:45:09 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1f37d277-e3, col_values=(('qos', UUID('7581c0e0-fba1-4d66-b6e1-2b607d30c438')),), if_exists=True) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:45:09 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1f37d277-e3, col_values=(('external_ids', {'iface-id': '1f37d277-e3ac-48ca-b618-27b872f41824', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c0:9e:a0', 'vm-uuid': 'af5fd5af-63a6-4eee-a4ef-6088a3713214'}),), if_exists=True) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:45:09 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:45:09 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 09:45:09 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:45:09 user nova-compute[75229]: INFO os_vif [None req-d5268eb3-e108-4421-b72a-35533ea3a492 tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c0:9e:a0,bridge_name='br-int',has_traffic_filtering=True,id=1f37d277-e3ac-48ca-b618-27b872f41824,network=Network(4176f9ca-0910-416d-99e3-a8156bd87229),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f37d277-e3')
Nov 14 09:45:09 user nova-compute[75229]: DEBUG nova.virt.libvirt.vif [None req-d5268eb3-e108-4421-b72a-35533ea3a492 tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T09:44:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-552825535',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-552825535',id=12,image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMcZzdcOYH5cGR1627n6lcQmf726zLltPq4eG5lA89YeaaRpoKefjSoTcpxyVE/DVVi6OLlkF5TWRyNz2Wsn2gQ3fyLDODqgBhgcWeknmoj7yj+as0ZGoZ7gmrjVqaQkQw==',key_name='tempest-keypair-1600873511',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6a9197db757f4a1cafd571eef8d47b15',ramdisk_id='',reservation_id='r-k72il8ne',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-818020951',owner_user_name='tempest-TaggedBootDevicesTest-818020951-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T09:44:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b040ec7bb6eb42ee9d25a5333297bfee',uuid=af5fd5af-63a6-4eee-a4ef-6088a3713214,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "768a662a-4bcd-4844-a9ed-f8b8f6b8aa0d", "address": "fa:16:3e:10:aa:95", "network": {"id": "0f777eef-d2ac-43b9-bbef-4f075e98903f", "bridge": "br-int", "label": "tempest-device-tagging-net2-1010361890", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "6a9197db757f4a1cafd571eef8d47b15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap768a662a-4b", "ovs_interfaceid": "768a662a-4bcd-4844-a9ed-f8b8f6b8aa0d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 09:45:09 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-d5268eb3-e108-4421-b72a-35533ea3a492 tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] Converting VIF {"id": "768a662a-4bcd-4844-a9ed-f8b8f6b8aa0d", "address": "fa:16:3e:10:aa:95", "network": {"id": "0f777eef-d2ac-43b9-bbef-4f075e98903f", "bridge": "br-int", "label": "tempest-device-tagging-net2-1010361890", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "6a9197db757f4a1cafd571eef8d47b15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap768a662a-4b", "ovs_interfaceid": "768a662a-4bcd-4844-a9ed-f8b8f6b8aa0d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 09:45:09 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-d5268eb3-e108-4421-b72a-35533ea3a492 tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:10:aa:95,bridge_name='br-int',has_traffic_filtering=True,id=768a662a-4bcd-4844-a9ed-f8b8f6b8aa0d,network=Network(0f777eef-d2ac-43b9-bbef-4f075e98903f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap768a662a-4b') {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 09:45:09 user nova-compute[75229]: DEBUG os_vif [None req-d5268eb3-e108-4421-b72a-35533ea3a492 tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:10:aa:95,bridge_name='br-int',has_traffic_filtering=True,id=768a662a-4bcd-4844-a9ed-f8b8f6b8aa0d,network=Network(0f777eef-d2ac-43b9-bbef-4f075e98903f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap768a662a-4b') {{(pid=75229) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 09:45:09 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:45:09 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:45:09 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 09:45:09 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:45:09 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6f9cab9a-b1bc-56f3-9dc7-2b9b15433319', '_type': 'linux-noop'}}, row=False) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:45:09 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:45:09 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 09:45:09 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:45:09 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:45:09 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap768a662a-4b, may_exist=True, interface_attrs={}) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:45:09 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap768a662a-4b, col_values=(('qos', UUID('13e57b8f-f40b-411a-aea6-bbb708b961c1')),), if_exists=True) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:45:09 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap768a662a-4b, col_values=(('external_ids', {'iface-id': '768a662a-4bcd-4844-a9ed-f8b8f6b8aa0d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:10:aa:95', 'vm-uuid': 'af5fd5af-63a6-4eee-a4ef-6088a3713214'}),), if_exists=True) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:45:09 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:45:09 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 09:45:09 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:45:09 user nova-compute[75229]: INFO os_vif [None req-d5268eb3-e108-4421-b72a-35533ea3a492 tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:10:aa:95,bridge_name='br-int',has_traffic_filtering=True,id=768a662a-4bcd-4844-a9ed-f8b8f6b8aa0d,network=Network(0f777eef-d2ac-43b9-bbef-4f075e98903f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap768a662a-4b')
Nov 14 09:45:09 user nova-compute[75229]: DEBUG nova.virt.libvirt.vif [None req-d5268eb3-e108-4421-b72a-35533ea3a492 tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T09:44:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-552825535',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-552825535',id=12,image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMcZzdcOYH5cGR1627n6lcQmf726zLltPq4eG5lA89YeaaRpoKefjSoTcpxyVE/DVVi6OLlkF5TWRyNz2Wsn2gQ3fyLDODqgBhgcWeknmoj7yj+as0ZGoZ7gmrjVqaQkQw==',key_name='tempest-keypair-1600873511',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6a9197db757f4a1cafd571eef8d47b15',ramdisk_id='',reservation_id='r-k72il8ne',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-818020951',owner_user_name='tempest-TaggedBootDevicesTest-818020951-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T09:44:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b040ec7bb6eb42ee9d25a5333297bfee',uuid=af5fd5af-63a6-4eee-a4ef-6088a3713214,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b7fff2b1-9f14-4632-83e2-3f0a8e4c788b", "address": "fa:16:3e:68:f2:55", "network": {"id": "0f777eef-d2ac-43b9-bbef-4f075e98903f", "bridge": "br-int", "label": "tempest-device-tagging-net2-1010361890", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "6a9197db757f4a1cafd571eef8d47b15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7fff2b1-9f", "ovs_interfaceid": "b7fff2b1-9f14-4632-83e2-3f0a8e4c788b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 09:45:09 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-d5268eb3-e108-4421-b72a-35533ea3a492 tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] Converting VIF {"id": "b7fff2b1-9f14-4632-83e2-3f0a8e4c788b", "address": "fa:16:3e:68:f2:55", "network": {"id": "0f777eef-d2ac-43b9-bbef-4f075e98903f", "bridge": "br-int", "label": "tempest-device-tagging-net2-1010361890", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "6a9197db757f4a1cafd571eef8d47b15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7fff2b1-9f", "ovs_interfaceid": "b7fff2b1-9f14-4632-83e2-3f0a8e4c788b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 09:45:09 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-d5268eb3-e108-4421-b72a-35533ea3a492 tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:68:f2:55,bridge_name='br-int',has_traffic_filtering=True,id=b7fff2b1-9f14-4632-83e2-3f0a8e4c788b,network=Network(0f777eef-d2ac-43b9-bbef-4f075e98903f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7fff2b1-9f') {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 09:45:09 user nova-compute[75229]: DEBUG os_vif [None req-d5268eb3-e108-4421-b72a-35533ea3a492 tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:68:f2:55,bridge_name='br-int',has_traffic_filtering=True,id=b7fff2b1-9f14-4632-83e2-3f0a8e4c788b,network=Network(0f777eef-d2ac-43b9-bbef-4f075e98903f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7fff2b1-9f') {{(pid=75229) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 09:45:09 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:45:09 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:45:09 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 09:45:09 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:45:09 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '33dc423b-c7d1-5e08-82e0-079a937ae12b', '_type': 'linux-noop'}}, row=False) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:45:09 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:45:09 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 09:45:09 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:45:09 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:45:09 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb7fff2b1-9f, may_exist=True, interface_attrs={}) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:45:09 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb7fff2b1-9f, col_values=(('qos', UUID('df7aacb5-8b47-4664-a4a3-bd80c7d6c78c')),), if_exists=True) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:45:09 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb7fff2b1-9f, col_values=(('external_ids', {'iface-id': 'b7fff2b1-9f14-4632-83e2-3f0a8e4c788b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:68:f2:55', 'vm-uuid': 'af5fd5af-63a6-4eee-a4ef-6088a3713214'}),), if_exists=True) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:45:09 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:45:09 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 09:45:09 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:45:09 user nova-compute[75229]: INFO os_vif [None req-d5268eb3-e108-4421-b72a-35533ea3a492 tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:68:f2:55,bridge_name='br-int',has_traffic_filtering=True,id=b7fff2b1-9f14-4632-83e2-3f0a8e4c788b,network=Network(0f777eef-d2ac-43b9-bbef-4f075e98903f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7fff2b1-9f')
Nov 14 09:45:09 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-d5268eb3-e108-4421-b72a-35533ea3a492 tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] No BDM found with device name hda, not building metadata. {{(pid=75229) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 09:45:09 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-d5268eb3-e108-4421-b72a-35533ea3a492 tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75229) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 09:45:09 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-d5268eb3-e108-4421-b72a-35533ea3a492 tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] No VIF found with MAC fa:16:3e:d9:f9:d0, not building metadata {{(pid=75229) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 09:45:09 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-d5268eb3-e108-4421-b72a-35533ea3a492 tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] No VIF found with MAC fa:16:3e:c0:9e:a0, not building metadata {{(pid=75229) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 09:45:09 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-d5268eb3-e108-4421-b72a-35533ea3a492 tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] [instance: af5fd5af-63a6-4eee-a4ef-6088a3713214] Using config drive
Nov 14 09:45:09 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-d5268eb3-e108-4421-b72a-35533ea3a492 tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] [instance: af5fd5af-63a6-4eee-a4ef-6088a3713214] Creating config drive at /opt/stack/data/nova/instances/af5fd5af-63a6-4eee-a4ef-6088a3713214/disk.config
Nov 14 09:45:09 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-d5268eb3-e108-4421-b72a-35533ea3a492 tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/af5fd5af-63a6-4eee-a4ef-6088a3713214/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpnhou015g {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:45:09 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-d5268eb3-e108-4421-b72a-35533ea3a492 tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/af5fd5af-63a6-4eee-a4ef-6088a3713214/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpnhou015g" returned: 0 in 0.062s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:45:10 user nova-compute[75229]: DEBUG nova.compute.manager [req-5adf94a3-2a15-4ca9-97ac-0c502de0e2a7 req-7fe5ece2-c408-4afb-909a-44895a2cfd2b service nova] [instance: 37e63bd9-44fc-4d07-b31b-570f69d7bc8a] Received event network-vif-plugged-22c0a013-145e-46f8-ab59-f883d51567e6 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:45:10 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-5adf94a3-2a15-4ca9-97ac-0c502de0e2a7 req-7fe5ece2-c408-4afb-909a-44895a2cfd2b service nova] Acquiring lock "37e63bd9-44fc-4d07-b31b-570f69d7bc8a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:45:10 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-5adf94a3-2a15-4ca9-97ac-0c502de0e2a7 req-7fe5ece2-c408-4afb-909a-44895a2cfd2b service nova] Lock "37e63bd9-44fc-4d07-b31b-570f69d7bc8a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:45:10 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-5adf94a3-2a15-4ca9-97ac-0c502de0e2a7 req-7fe5ece2-c408-4afb-909a-44895a2cfd2b service nova] Lock "37e63bd9-44fc-4d07-b31b-570f69d7bc8a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:45:10 user nova-compute[75229]: DEBUG nova.compute.manager [req-5adf94a3-2a15-4ca9-97ac-0c502de0e2a7 req-7fe5ece2-c408-4afb-909a-44895a2cfd2b service nova] [instance: 37e63bd9-44fc-4d07-b31b-570f69d7bc8a] No waiting events found dispatching network-vif-plugged-22c0a013-145e-46f8-ab59-f883d51567e6 {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 09:45:10 user nova-compute[75229]: WARNING nova.compute.manager [req-5adf94a3-2a15-4ca9-97ac-0c502de0e2a7 req-7fe5ece2-c408-4afb-909a-44895a2cfd2b service nova] [instance: 37e63bd9-44fc-4d07-b31b-570f69d7bc8a] Received unexpected event network-vif-plugged-22c0a013-145e-46f8-ab59-f883d51567e6 for instance with vm_state active and task_state None.
Nov 14 09:45:10 user nova-compute[75229]: DEBUG nova.compute.manager [req-5adf94a3-2a15-4ca9-97ac-0c502de0e2a7 req-7fe5ece2-c408-4afb-909a-44895a2cfd2b service nova] [instance: c6fa2298-7111-4660-a162-09269045d5e3] Received event network-vif-plugged-b310b3f2-f842-4918-8540-f9803e259b31 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:45:10 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-5adf94a3-2a15-4ca9-97ac-0c502de0e2a7 req-7fe5ece2-c408-4afb-909a-44895a2cfd2b service nova] Acquiring lock "c6fa2298-7111-4660-a162-09269045d5e3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:45:10 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-5adf94a3-2a15-4ca9-97ac-0c502de0e2a7 req-7fe5ece2-c408-4afb-909a-44895a2cfd2b service nova] Lock "c6fa2298-7111-4660-a162-09269045d5e3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:45:10 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-5adf94a3-2a15-4ca9-97ac-0c502de0e2a7 req-7fe5ece2-c408-4afb-909a-44895a2cfd2b service nova] Lock "c6fa2298-7111-4660-a162-09269045d5e3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:45:10 user nova-compute[75229]: DEBUG nova.compute.manager [req-5adf94a3-2a15-4ca9-97ac-0c502de0e2a7 req-7fe5ece2-c408-4afb-909a-44895a2cfd2b service nova] [instance: c6fa2298-7111-4660-a162-09269045d5e3] No waiting events found dispatching network-vif-plugged-b310b3f2-f842-4918-8540-f9803e259b31 {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 09:45:10 user nova-compute[75229]: WARNING nova.compute.manager [req-5adf94a3-2a15-4ca9-97ac-0c502de0e2a7 req-7fe5ece2-c408-4afb-909a-44895a2cfd2b service nova] [instance: c6fa2298-7111-4660-a162-09269045d5e3] Received unexpected event network-vif-plugged-b310b3f2-f842-4918-8540-f9803e259b31 for instance with vm_state active and task_state None.
Nov 14 09:45:10 user nova-compute[75229]: DEBUG nova.compute.manager [req-5adf94a3-2a15-4ca9-97ac-0c502de0e2a7 req-7fe5ece2-c408-4afb-909a-44895a2cfd2b service nova] [instance: c6fa2298-7111-4660-a162-09269045d5e3] Received event network-vif-plugged-b310b3f2-f842-4918-8540-f9803e259b31 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:45:10 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-5adf94a3-2a15-4ca9-97ac-0c502de0e2a7 req-7fe5ece2-c408-4afb-909a-44895a2cfd2b service nova] Acquiring lock "c6fa2298-7111-4660-a162-09269045d5e3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:45:10 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-5adf94a3-2a15-4ca9-97ac-0c502de0e2a7 req-7fe5ece2-c408-4afb-909a-44895a2cfd2b service nova] Lock "c6fa2298-7111-4660-a162-09269045d5e3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:45:10 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-5adf94a3-2a15-4ca9-97ac-0c502de0e2a7 req-7fe5ece2-c408-4afb-909a-44895a2cfd2b service nova] Lock "c6fa2298-7111-4660-a162-09269045d5e3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:45:10 user nova-compute[75229]: DEBUG nova.compute.manager [req-5adf94a3-2a15-4ca9-97ac-0c502de0e2a7 req-7fe5ece2-c408-4afb-909a-44895a2cfd2b service nova] [instance: c6fa2298-7111-4660-a162-09269045d5e3] No waiting events found dispatching network-vif-plugged-b310b3f2-f842-4918-8540-f9803e259b31 {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 09:45:10 user nova-compute[75229]: WARNING nova.compute.manager [req-5adf94a3-2a15-4ca9-97ac-0c502de0e2a7 req-7fe5ece2-c408-4afb-909a-44895a2cfd2b service nova] [instance: c6fa2298-7111-4660-a162-09269045d5e3] Received unexpected event network-vif-plugged-b310b3f2-f842-4918-8540-f9803e259b31 for instance with vm_state active and task_state None.
Nov 14 09:45:10 user nova-compute[75229]: DEBUG nova.compute.manager [req-5adf94a3-2a15-4ca9-97ac-0c502de0e2a7 req-7fe5ece2-c408-4afb-909a-44895a2cfd2b service nova] [instance: c9d3e03d-be75-44b1-97b4-36c13715175b] Received event network-vif-plugged-93b50b64-d7f2-48d0-bedb-ce1f6f5f44d5 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:45:10 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-5adf94a3-2a15-4ca9-97ac-0c502de0e2a7 req-7fe5ece2-c408-4afb-909a-44895a2cfd2b service nova] Acquiring lock "c9d3e03d-be75-44b1-97b4-36c13715175b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:45:10 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-5adf94a3-2a15-4ca9-97ac-0c502de0e2a7 req-7fe5ece2-c408-4afb-909a-44895a2cfd2b service nova] Lock "c9d3e03d-be75-44b1-97b4-36c13715175b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:45:10 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-5adf94a3-2a15-4ca9-97ac-0c502de0e2a7 req-7fe5ece2-c408-4afb-909a-44895a2cfd2b service nova] Lock "c9d3e03d-be75-44b1-97b4-36c13715175b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:45:10 user nova-compute[75229]: DEBUG nova.compute.manager [req-5adf94a3-2a15-4ca9-97ac-0c502de0e2a7 req-7fe5ece2-c408-4afb-909a-44895a2cfd2b service nova] [instance: c9d3e03d-be75-44b1-97b4-36c13715175b] No waiting events found dispatching network-vif-plugged-93b50b64-d7f2-48d0-bedb-ce1f6f5f44d5 {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 09:45:10 user nova-compute[75229]: WARNING nova.compute.manager [req-5adf94a3-2a15-4ca9-97ac-0c502de0e2a7 req-7fe5ece2-c408-4afb-909a-44895a2cfd2b service nova] [instance: c9d3e03d-be75-44b1-97b4-36c13715175b] Received unexpected event network-vif-plugged-93b50b64-d7f2-48d0-bedb-ce1f6f5f44d5 for instance with vm_state active and task_state None.
Nov 14 09:45:10 user nova-compute[75229]: DEBUG nova.compute.manager [req-5adf94a3-2a15-4ca9-97ac-0c502de0e2a7 req-7fe5ece2-c408-4afb-909a-44895a2cfd2b service nova] [instance: c9d3e03d-be75-44b1-97b4-36c13715175b] Received event network-vif-plugged-93b50b64-d7f2-48d0-bedb-ce1f6f5f44d5 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:45:10 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-5adf94a3-2a15-4ca9-97ac-0c502de0e2a7 req-7fe5ece2-c408-4afb-909a-44895a2cfd2b service nova] Acquiring lock "c9d3e03d-be75-44b1-97b4-36c13715175b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:45:10 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-5adf94a3-2a15-4ca9-97ac-0c502de0e2a7 req-7fe5ece2-c408-4afb-909a-44895a2cfd2b service nova] Lock "c9d3e03d-be75-44b1-97b4-36c13715175b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:45:10 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-5adf94a3-2a15-4ca9-97ac-0c502de0e2a7 req-7fe5ece2-c408-4afb-909a-44895a2cfd2b service nova] Lock "c9d3e03d-be75-44b1-97b4-36c13715175b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:45:10 user nova-compute[75229]: DEBUG nova.compute.manager [req-5adf94a3-2a15-4ca9-97ac-0c502de0e2a7 req-7fe5ece2-c408-4afb-909a-44895a2cfd2b service nova] [instance: c9d3e03d-be75-44b1-97b4-36c13715175b] No waiting events found dispatching network-vif-plugged-93b50b64-d7f2-48d0-bedb-ce1f6f5f44d5 {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 09:45:10 user nova-compute[75229]: WARNING nova.compute.manager [req-5adf94a3-2a15-4ca9-97ac-0c502de0e2a7 req-7fe5ece2-c408-4afb-909a-44895a2cfd2b service nova] [instance: c9d3e03d-be75-44b1-97b4-36c13715175b] Received unexpected event network-vif-plugged-93b50b64-d7f2-48d0-bedb-ce1f6f5f44d5 for instance with vm_state active and task_state None.
Nov 14 09:45:10 user nova-compute[75229]: DEBUG nova.compute.manager [req-5adf94a3-2a15-4ca9-97ac-0c502de0e2a7 req-7fe5ece2-c408-4afb-909a-44895a2cfd2b service nova] [instance: 8623fdcc-99b7-44d6-ad81-dada5ba83a88] Received event network-vif-plugged-30dd46f1-cc37-46dd-a47e-0bc23a724804 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:45:10 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-5adf94a3-2a15-4ca9-97ac-0c502de0e2a7 req-7fe5ece2-c408-4afb-909a-44895a2cfd2b service nova] Acquiring lock "8623fdcc-99b7-44d6-ad81-dada5ba83a88-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:45:10 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-5adf94a3-2a15-4ca9-97ac-0c502de0e2a7 req-7fe5ece2-c408-4afb-909a-44895a2cfd2b service nova] Lock "8623fdcc-99b7-44d6-ad81-dada5ba83a88-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:45:10 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-5adf94a3-2a15-4ca9-97ac-0c502de0e2a7 req-7fe5ece2-c408-4afb-909a-44895a2cfd2b service nova] Lock "8623fdcc-99b7-44d6-ad81-dada5ba83a88-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:45:10 user nova-compute[75229]: DEBUG nova.compute.manager [req-5adf94a3-2a15-4ca9-97ac-0c502de0e2a7 req-7fe5ece2-c408-4afb-909a-44895a2cfd2b service nova] [instance: 8623fdcc-99b7-44d6-ad81-dada5ba83a88] No waiting events found dispatching network-vif-plugged-30dd46f1-cc37-46dd-a47e-0bc23a724804 {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 09:45:10 user nova-compute[75229]: WARNING nova.compute.manager [req-5adf94a3-2a15-4ca9-97ac-0c502de0e2a7 req-7fe5ece2-c408-4afb-909a-44895a2cfd2b service nova] [instance: 8623fdcc-99b7-44d6-ad81-dada5ba83a88] Received unexpected event network-vif-plugged-30dd46f1-cc37-46dd-a47e-0bc23a724804 for instance with vm_state active and task_state None.
Nov 14 09:45:10 user nova-compute[75229]: DEBUG nova.compute.manager [req-5adf94a3-2a15-4ca9-97ac-0c502de0e2a7 req-7fe5ece2-c408-4afb-909a-44895a2cfd2b service nova] [instance: 8623fdcc-99b7-44d6-ad81-dada5ba83a88] Received event network-vif-plugged-30dd46f1-cc37-46dd-a47e-0bc23a724804 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:45:10 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-5adf94a3-2a15-4ca9-97ac-0c502de0e2a7 req-7fe5ece2-c408-4afb-909a-44895a2cfd2b service nova] Acquiring lock "8623fdcc-99b7-44d6-ad81-dada5ba83a88-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:45:10 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-5adf94a3-2a15-4ca9-97ac-0c502de0e2a7 req-7fe5ece2-c408-4afb-909a-44895a2cfd2b service nova] Lock "8623fdcc-99b7-44d6-ad81-dada5ba83a88-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:45:10 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-5adf94a3-2a15-4ca9-97ac-0c502de0e2a7 req-7fe5ece2-c408-4afb-909a-44895a2cfd2b service nova] Lock "8623fdcc-99b7-44d6-ad81-dada5ba83a88-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:45:10 user nova-compute[75229]: DEBUG nova.compute.manager [req-5adf94a3-2a15-4ca9-97ac-0c502de0e2a7 req-7fe5ece2-c408-4afb-909a-44895a2cfd2b service nova] [instance: 8623fdcc-99b7-44d6-ad81-dada5ba83a88] No waiting events found dispatching network-vif-plugged-30dd46f1-cc37-46dd-a47e-0bc23a724804 {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 09:45:10 user nova-compute[75229]: WARNING nova.compute.manager [req-5adf94a3-2a15-4ca9-97ac-0c502de0e2a7 req-7fe5ece2-c408-4afb-909a-44895a2cfd2b service nova] [instance: 8623fdcc-99b7-44d6-ad81-dada5ba83a88] Received unexpected event network-vif-plugged-30dd46f1-cc37-46dd-a47e-0bc23a724804 for instance with vm_state active and task_state None.
Nov 14 09:45:11 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:45:11 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:45:11 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:45:11 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:45:11 user nova-compute[75229]: DEBUG nova.compute.manager [req-9033ddc7-dac8-4d0d-931b-339d87fc7d42 req-3531b213-44d0-4d89-b038-29cc3ad370b2 service nova] [instance: af5fd5af-63a6-4eee-a4ef-6088a3713214] Received event network-vif-plugged-a1999f33-4f1d-47b0-a91a-48bce4600e9b {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:45:11 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-9033ddc7-dac8-4d0d-931b-339d87fc7d42 req-3531b213-44d0-4d89-b038-29cc3ad370b2 service nova] Acquiring lock "af5fd5af-63a6-4eee-a4ef-6088a3713214-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:45:11 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-9033ddc7-dac8-4d0d-931b-339d87fc7d42 req-3531b213-44d0-4d89-b038-29cc3ad370b2 service nova] Lock "af5fd5af-63a6-4eee-a4ef-6088a3713214-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:45:11 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-9033ddc7-dac8-4d0d-931b-339d87fc7d42 req-3531b213-44d0-4d89-b038-29cc3ad370b2 service nova] Lock "af5fd5af-63a6-4eee-a4ef-6088a3713214-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:45:11 user nova-compute[75229]: DEBUG nova.compute.manager [req-9033ddc7-dac8-4d0d-931b-339d87fc7d42 req-3531b213-44d0-4d89-b038-29cc3ad370b2 service nova] [instance: af5fd5af-63a6-4eee-a4ef-6088a3713214] No waiting events found dispatching network-vif-plugged-a1999f33-4f1d-47b0-a91a-48bce4600e9b {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 09:45:11 user nova-compute[75229]: WARNING nova.compute.manager [req-9033ddc7-dac8-4d0d-931b-339d87fc7d42 req-3531b213-44d0-4d89-b038-29cc3ad370b2 service nova] [instance: af5fd5af-63a6-4eee-a4ef-6088a3713214] Received unexpected event network-vif-plugged-a1999f33-4f1d-47b0-a91a-48bce4600e9b for instance with vm_state building and task_state spawning.
Nov 14 09:45:11 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:45:12 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:45:12 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:45:12 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:45:12 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:45:12 user nova-compute[75229]: DEBUG nova.compute.manager [req-59d7792a-0047-4459-b34b-9d7ccc97edef req-2cbf7dfa-ab19-43fc-afe7-33da0b3ff956 service nova] [instance: af5fd5af-63a6-4eee-a4ef-6088a3713214] Received event network-vif-plugged-2f37eb91-97ea-477b-b6c1-933b50ccfca6 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:45:12 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-59d7792a-0047-4459-b34b-9d7ccc97edef req-2cbf7dfa-ab19-43fc-afe7-33da0b3ff956 service nova] Acquiring lock "af5fd5af-63a6-4eee-a4ef-6088a3713214-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:45:12 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-59d7792a-0047-4459-b34b-9d7ccc97edef req-2cbf7dfa-ab19-43fc-afe7-33da0b3ff956 service nova] Lock "af5fd5af-63a6-4eee-a4ef-6088a3713214-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:45:12 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-59d7792a-0047-4459-b34b-9d7ccc97edef req-2cbf7dfa-ab19-43fc-afe7-33da0b3ff956 service nova] Lock "af5fd5af-63a6-4eee-a4ef-6088a3713214-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:45:12 user nova-compute[75229]: DEBUG nova.compute.manager [req-59d7792a-0047-4459-b34b-9d7ccc97edef req-2cbf7dfa-ab19-43fc-afe7-33da0b3ff956 service nova] [instance: af5fd5af-63a6-4eee-a4ef-6088a3713214] No waiting events found dispatching network-vif-plugged-2f37eb91-97ea-477b-b6c1-933b50ccfca6 {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 09:45:12 user nova-compute[75229]: WARNING nova.compute.manager [req-59d7792a-0047-4459-b34b-9d7ccc97edef req-2cbf7dfa-ab19-43fc-afe7-33da0b3ff956 service nova] [instance: af5fd5af-63a6-4eee-a4ef-6088a3713214] Received unexpected event network-vif-plugged-2f37eb91-97ea-477b-b6c1-933b50ccfca6 for instance with vm_state building and task_state spawning.
Nov 14 09:45:12 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:45:12 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:45:12 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:45:12 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:45:12 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:45:12 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:45:12 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:45:12 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:45:12 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:45:12 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:45:12 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:45:12 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:45:12 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:45:13 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:45:13 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:45:13 user nova-compute[75229]: DEBUG nova.compute.manager [req-bfee6e06-4163-45e1-9cd2-a4fe9d4d577e req-cac14de4-10c9-45bd-9755-cf096298f177 service nova] [instance: af5fd5af-63a6-4eee-a4ef-6088a3713214] Received event network-vif-plugged-1f37d277-e3ac-48ca-b618-27b872f41824 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:45:13 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-bfee6e06-4163-45e1-9cd2-a4fe9d4d577e req-cac14de4-10c9-45bd-9755-cf096298f177 service nova] Acquiring lock "af5fd5af-63a6-4eee-a4ef-6088a3713214-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:45:13 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-bfee6e06-4163-45e1-9cd2-a4fe9d4d577e req-cac14de4-10c9-45bd-9755-cf096298f177 service nova] Lock "af5fd5af-63a6-4eee-a4ef-6088a3713214-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:45:13 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-bfee6e06-4163-45e1-9cd2-a4fe9d4d577e req-cac14de4-10c9-45bd-9755-cf096298f177 service nova] Lock "af5fd5af-63a6-4eee-a4ef-6088a3713214-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:45:13 user nova-compute[75229]: DEBUG nova.compute.manager [req-bfee6e06-4163-45e1-9cd2-a4fe9d4d577e req-cac14de4-10c9-45bd-9755-cf096298f177 service nova] [instance: af5fd5af-63a6-4eee-a4ef-6088a3713214] No waiting events found dispatching network-vif-plugged-1f37d277-e3ac-48ca-b618-27b872f41824 {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 09:45:13 user nova-compute[75229]: WARNING nova.compute.manager [req-bfee6e06-4163-45e1-9cd2-a4fe9d4d577e req-cac14de4-10c9-45bd-9755-cf096298f177 service nova] [instance: af5fd5af-63a6-4eee-a4ef-6088a3713214] Received unexpected event network-vif-plugged-1f37d277-e3ac-48ca-b618-27b872f41824 for instance with vm_state building and task_state spawning.
Nov 14 09:45:13 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:45:13 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:45:13 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:45:13 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:45:13 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:45:13 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:45:13 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:45:13 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:45:13 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:45:13 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:45:13 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:45:13 user nova-compute[75229]: DEBUG nova.compute.manager [req-2df6a4ab-a999-4e85-afd9-b96e1eefaf00 req-ecc5570b-6113-4c5e-92e8-b55c0809a742 service nova] [instance: af5fd5af-63a6-4eee-a4ef-6088a3713214] Received event network-vif-plugged-a1999f33-4f1d-47b0-a91a-48bce4600e9b {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:45:13 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-2df6a4ab-a999-4e85-afd9-b96e1eefaf00 req-ecc5570b-6113-4c5e-92e8-b55c0809a742 service nova] Acquiring lock "af5fd5af-63a6-4eee-a4ef-6088a3713214-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:45:13 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-2df6a4ab-a999-4e85-afd9-b96e1eefaf00 req-ecc5570b-6113-4c5e-92e8-b55c0809a742 service nova] Lock "af5fd5af-63a6-4eee-a4ef-6088a3713214-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:45:13 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-2df6a4ab-a999-4e85-afd9-b96e1eefaf00 req-ecc5570b-6113-4c5e-92e8-b55c0809a742 service nova] Lock "af5fd5af-63a6-4eee-a4ef-6088a3713214-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:45:13 user nova-compute[75229]: DEBUG nova.compute.manager [req-2df6a4ab-a999-4e85-afd9-b96e1eefaf00 req-ecc5570b-6113-4c5e-92e8-b55c0809a742 service nova] [instance: af5fd5af-63a6-4eee-a4ef-6088a3713214] No waiting events found dispatching network-vif-plugged-a1999f33-4f1d-47b0-a91a-48bce4600e9b {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 09:45:13 user nova-compute[75229]: WARNING nova.compute.manager [req-2df6a4ab-a999-4e85-afd9-b96e1eefaf00 req-ecc5570b-6113-4c5e-92e8-b55c0809a742 service nova] [instance: af5fd5af-63a6-4eee-a4ef-6088a3713214] Received unexpected event network-vif-plugged-a1999f33-4f1d-47b0-a91a-48bce4600e9b for instance with vm_state building and task_state spawning.
Nov 14 09:45:13 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:45:13 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:45:14 user nova-compute[75229]: DEBUG nova.compute.manager [req-6b29a195-fa78-4268-af7c-098077187db6 req-d3ecc22a-30c1-4e09-91a2-5075663e22b1 service nova] [instance: af5fd5af-63a6-4eee-a4ef-6088a3713214] Received event network-vif-plugged-2f37eb91-97ea-477b-b6c1-933b50ccfca6 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:45:14 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-6b29a195-fa78-4268-af7c-098077187db6 req-d3ecc22a-30c1-4e09-91a2-5075663e22b1 service nova] Acquiring lock "af5fd5af-63a6-4eee-a4ef-6088a3713214-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:45:14 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-6b29a195-fa78-4268-af7c-098077187db6 req-d3ecc22a-30c1-4e09-91a2-5075663e22b1 service nova] Lock "af5fd5af-63a6-4eee-a4ef-6088a3713214-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:45:14 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-6b29a195-fa78-4268-af7c-098077187db6 req-d3ecc22a-30c1-4e09-91a2-5075663e22b1 service nova] Lock "af5fd5af-63a6-4eee-a4ef-6088a3713214-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:45:14 user nova-compute[75229]: DEBUG nova.compute.manager [req-6b29a195-fa78-4268-af7c-098077187db6 req-d3ecc22a-30c1-4e09-91a2-5075663e22b1 service nova] [instance: af5fd5af-63a6-4eee-a4ef-6088a3713214] No waiting events found dispatching network-vif-plugged-2f37eb91-97ea-477b-b6c1-933b50ccfca6 {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 09:45:14 user nova-compute[75229]: WARNING nova.compute.manager [req-6b29a195-fa78-4268-af7c-098077187db6 req-d3ecc22a-30c1-4e09-91a2-5075663e22b1 service nova] [instance: af5fd5af-63a6-4eee-a4ef-6088a3713214] Received unexpected event network-vif-plugged-2f37eb91-97ea-477b-b6c1-933b50ccfca6 for instance with vm_state building and task_state spawning.
Nov 14 09:45:14 user nova-compute[75229]: DEBUG nova.compute.manager [req-6b29a195-fa78-4268-af7c-098077187db6 req-d3ecc22a-30c1-4e09-91a2-5075663e22b1 service nova] [instance: af5fd5af-63a6-4eee-a4ef-6088a3713214] Received event network-vif-plugged-f8dc5389-6e53-421a-9a3a-6c90a89a6eb2 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:45:14 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-6b29a195-fa78-4268-af7c-098077187db6 req-d3ecc22a-30c1-4e09-91a2-5075663e22b1 service nova] Acquiring lock "af5fd5af-63a6-4eee-a4ef-6088a3713214-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:45:14 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-6b29a195-fa78-4268-af7c-098077187db6 req-d3ecc22a-30c1-4e09-91a2-5075663e22b1 service nova] Lock "af5fd5af-63a6-4eee-a4ef-6088a3713214-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:45:14 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-6b29a195-fa78-4268-af7c-098077187db6 req-d3ecc22a-30c1-4e09-91a2-5075663e22b1 service nova] Lock "af5fd5af-63a6-4eee-a4ef-6088a3713214-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:45:14 user nova-compute[75229]: DEBUG nova.compute.manager [req-6b29a195-fa78-4268-af7c-098077187db6 req-d3ecc22a-30c1-4e09-91a2-5075663e22b1 service nova] [instance: af5fd5af-63a6-4eee-a4ef-6088a3713214] No waiting events found dispatching network-vif-plugged-f8dc5389-6e53-421a-9a3a-6c90a89a6eb2 {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 09:45:14 user nova-compute[75229]: WARNING nova.compute.manager [req-6b29a195-fa78-4268-af7c-098077187db6 req-d3ecc22a-30c1-4e09-91a2-5075663e22b1 service nova] [instance: af5fd5af-63a6-4eee-a4ef-6088a3713214] Received unexpected event network-vif-plugged-f8dc5389-6e53-421a-9a3a-6c90a89a6eb2 for instance with vm_state building and task_state spawning.
Nov 14 09:45:14 user nova-compute[75229]: DEBUG nova.compute.manager [req-6b29a195-fa78-4268-af7c-098077187db6 req-d3ecc22a-30c1-4e09-91a2-5075663e22b1 service nova] [instance: af5fd5af-63a6-4eee-a4ef-6088a3713214] Received event network-vif-plugged-f8dc5389-6e53-421a-9a3a-6c90a89a6eb2 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:45:14 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-6b29a195-fa78-4268-af7c-098077187db6 req-d3ecc22a-30c1-4e09-91a2-5075663e22b1 service nova] Acquiring lock "af5fd5af-63a6-4eee-a4ef-6088a3713214-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:45:14 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-6b29a195-fa78-4268-af7c-098077187db6 req-d3ecc22a-30c1-4e09-91a2-5075663e22b1 service nova] Lock "af5fd5af-63a6-4eee-a4ef-6088a3713214-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:45:14 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-6b29a195-fa78-4268-af7c-098077187db6 req-d3ecc22a-30c1-4e09-91a2-5075663e22b1 service nova] Lock "af5fd5af-63a6-4eee-a4ef-6088a3713214-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:45:14 user nova-compute[75229]: DEBUG nova.compute.manager [req-6b29a195-fa78-4268-af7c-098077187db6 req-d3ecc22a-30c1-4e09-91a2-5075663e22b1 service nova] [instance: af5fd5af-63a6-4eee-a4ef-6088a3713214] No waiting events found dispatching network-vif-plugged-f8dc5389-6e53-421a-9a3a-6c90a89a6eb2 {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 09:45:14 user nova-compute[75229]: WARNING nova.compute.manager [req-6b29a195-fa78-4268-af7c-098077187db6 req-d3ecc22a-30c1-4e09-91a2-5075663e22b1 service nova] [instance: af5fd5af-63a6-4eee-a4ef-6088a3713214] Received unexpected event network-vif-plugged-f8dc5389-6e53-421a-9a3a-6c90a89a6eb2 for instance with vm_state building and task_state spawning.
Nov 14 09:45:14 user nova-compute[75229]: DEBUG nova.compute.manager [req-6b29a195-fa78-4268-af7c-098077187db6 req-d3ecc22a-30c1-4e09-91a2-5075663e22b1 service nova] [instance: af5fd5af-63a6-4eee-a4ef-6088a3713214] Received event network-vif-plugged-0979136b-2418-4434-9466-75d116e8c780 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:45:14 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-6b29a195-fa78-4268-af7c-098077187db6 req-d3ecc22a-30c1-4e09-91a2-5075663e22b1 service nova] Acquiring lock "af5fd5af-63a6-4eee-a4ef-6088a3713214-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:45:14 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-6b29a195-fa78-4268-af7c-098077187db6 req-d3ecc22a-30c1-4e09-91a2-5075663e22b1 service nova] Lock "af5fd5af-63a6-4eee-a4ef-6088a3713214-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:45:14 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-6b29a195-fa78-4268-af7c-098077187db6 req-d3ecc22a-30c1-4e09-91a2-5075663e22b1 service nova] Lock "af5fd5af-63a6-4eee-a4ef-6088a3713214-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:45:14 user nova-compute[75229]: DEBUG nova.compute.manager [req-6b29a195-fa78-4268-af7c-098077187db6 req-d3ecc22a-30c1-4e09-91a2-5075663e22b1 service nova] [instance: af5fd5af-63a6-4eee-a4ef-6088a3713214] No waiting events found dispatching network-vif-plugged-0979136b-2418-4434-9466-75d116e8c780 {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 09:45:14 user nova-compute[75229]: WARNING nova.compute.manager [req-6b29a195-fa78-4268-af7c-098077187db6 req-d3ecc22a-30c1-4e09-91a2-5075663e22b1 service nova] [instance: af5fd5af-63a6-4eee-a4ef-6088a3713214] Received unexpected event network-vif-plugged-0979136b-2418-4434-9466-75d116e8c780 for instance with vm_state building and task_state spawning.
Nov 14 09:45:14 user nova-compute[75229]: DEBUG nova.compute.manager [req-6b29a195-fa78-4268-af7c-098077187db6 req-d3ecc22a-30c1-4e09-91a2-5075663e22b1 service nova] [instance: af5fd5af-63a6-4eee-a4ef-6088a3713214] Received event network-vif-plugged-0979136b-2418-4434-9466-75d116e8c780 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:45:14 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-6b29a195-fa78-4268-af7c-098077187db6 req-d3ecc22a-30c1-4e09-91a2-5075663e22b1 service nova] Acquiring lock "af5fd5af-63a6-4eee-a4ef-6088a3713214-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:45:14 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-6b29a195-fa78-4268-af7c-098077187db6 req-d3ecc22a-30c1-4e09-91a2-5075663e22b1 service nova] Lock "af5fd5af-63a6-4eee-a4ef-6088a3713214-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:45:14 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-6b29a195-fa78-4268-af7c-098077187db6 req-d3ecc22a-30c1-4e09-91a2-5075663e22b1 service nova] Lock "af5fd5af-63a6-4eee-a4ef-6088a3713214-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:45:14 user nova-compute[75229]: DEBUG nova.compute.manager [req-6b29a195-fa78-4268-af7c-098077187db6 req-d3ecc22a-30c1-4e09-91a2-5075663e22b1 service nova] [instance: af5fd5af-63a6-4eee-a4ef-6088a3713214] No waiting events found dispatching network-vif-plugged-0979136b-2418-4434-9466-75d116e8c780 {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 09:45:14 user nova-compute[75229]: WARNING nova.compute.manager [req-6b29a195-fa78-4268-af7c-098077187db6 req-d3ecc22a-30c1-4e09-91a2-5075663e22b1 service nova] [instance: af5fd5af-63a6-4eee-a4ef-6088a3713214] Received unexpected event network-vif-plugged-0979136b-2418-4434-9466-75d116e8c780 for instance with vm_state building and task_state spawning.
Nov 14 09:45:14 user nova-compute[75229]: DEBUG nova.compute.manager [req-6b29a195-fa78-4268-af7c-098077187db6 req-d3ecc22a-30c1-4e09-91a2-5075663e22b1 service nova] [instance: af5fd5af-63a6-4eee-a4ef-6088a3713214] Received event network-vif-plugged-b7fff2b1-9f14-4632-83e2-3f0a8e4c788b {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:45:14 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-6b29a195-fa78-4268-af7c-098077187db6 req-d3ecc22a-30c1-4e09-91a2-5075663e22b1 service nova] Acquiring lock "af5fd5af-63a6-4eee-a4ef-6088a3713214-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:45:14 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-6b29a195-fa78-4268-af7c-098077187db6 req-d3ecc22a-30c1-4e09-91a2-5075663e22b1 service nova] Lock "af5fd5af-63a6-4eee-a4ef-6088a3713214-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:45:14 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-6b29a195-fa78-4268-af7c-098077187db6 req-d3ecc22a-30c1-4e09-91a2-5075663e22b1 service nova] Lock "af5fd5af-63a6-4eee-a4ef-6088a3713214-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:45:14 user nova-compute[75229]: DEBUG nova.compute.manager [req-6b29a195-fa78-4268-af7c-098077187db6 req-d3ecc22a-30c1-4e09-91a2-5075663e22b1 service nova] [instance: af5fd5af-63a6-4eee-a4ef-6088a3713214] No waiting events found dispatching network-vif-plugged-b7fff2b1-9f14-4632-83e2-3f0a8e4c788b {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 09:45:14 user nova-compute[75229]: WARNING nova.compute.manager [req-6b29a195-fa78-4268-af7c-098077187db6 req-d3ecc22a-30c1-4e09-91a2-5075663e22b1 service nova] [instance: af5fd5af-63a6-4eee-a4ef-6088a3713214] Received unexpected event network-vif-plugged-b7fff2b1-9f14-4632-83e2-3f0a8e4c788b for instance with vm_state building and task_state spawning.
Nov 14 09:45:14 user nova-compute[75229]: DEBUG nova.compute.manager [req-6b29a195-fa78-4268-af7c-098077187db6 req-d3ecc22a-30c1-4e09-91a2-5075663e22b1 service nova] [instance: af5fd5af-63a6-4eee-a4ef-6088a3713214] Received event network-vif-plugged-b7fff2b1-9f14-4632-83e2-3f0a8e4c788b {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:45:14 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-6b29a195-fa78-4268-af7c-098077187db6 req-d3ecc22a-30c1-4e09-91a2-5075663e22b1 service nova] Acquiring lock "af5fd5af-63a6-4eee-a4ef-6088a3713214-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:45:14 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-6b29a195-fa78-4268-af7c-098077187db6 req-d3ecc22a-30c1-4e09-91a2-5075663e22b1 service nova] Lock "af5fd5af-63a6-4eee-a4ef-6088a3713214-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:45:14 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-6b29a195-fa78-4268-af7c-098077187db6 req-d3ecc22a-30c1-4e09-91a2-5075663e22b1 service nova] Lock "af5fd5af-63a6-4eee-a4ef-6088a3713214-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:45:14 user nova-compute[75229]: DEBUG nova.compute.manager [req-6b29a195-fa78-4268-af7c-098077187db6 req-d3ecc22a-30c1-4e09-91a2-5075663e22b1 service nova] [instance: af5fd5af-63a6-4eee-a4ef-6088a3713214] No waiting events found dispatching network-vif-plugged-b7fff2b1-9f14-4632-83e2-3f0a8e4c788b {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 09:45:14 user nova-compute[75229]: WARNING nova.compute.manager [req-6b29a195-fa78-4268-af7c-098077187db6 req-d3ecc22a-30c1-4e09-91a2-5075663e22b1 service nova] [instance: af5fd5af-63a6-4eee-a4ef-6088a3713214] Received unexpected event network-vif-plugged-b7fff2b1-9f14-4632-83e2-3f0a8e4c788b for instance with vm_state building and task_state spawning.
Nov 14 09:45:14 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:45:14 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:45:14 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:45:14 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:45:14 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:45:14 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:45:14 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:45:15 user nova-compute[75229]: DEBUG nova.compute.manager [req-03023951-ded3-4c4f-881d-8700c3f865e0 req-a43ec8c8-58ac-4324-be6f-28042b212bbb service nova] [instance: af5fd5af-63a6-4eee-a4ef-6088a3713214] Received event network-vif-plugged-1f37d277-e3ac-48ca-b618-27b872f41824 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:45:15 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-03023951-ded3-4c4f-881d-8700c3f865e0 req-a43ec8c8-58ac-4324-be6f-28042b212bbb service nova] Acquiring lock "af5fd5af-63a6-4eee-a4ef-6088a3713214-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:45:15 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-03023951-ded3-4c4f-881d-8700c3f865e0 req-a43ec8c8-58ac-4324-be6f-28042b212bbb service nova] Lock "af5fd5af-63a6-4eee-a4ef-6088a3713214-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:45:15 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-03023951-ded3-4c4f-881d-8700c3f865e0 req-a43ec8c8-58ac-4324-be6f-28042b212bbb service nova] Lock "af5fd5af-63a6-4eee-a4ef-6088a3713214-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:45:15 user nova-compute[75229]: DEBUG nova.compute.manager [req-03023951-ded3-4c4f-881d-8700c3f865e0 req-a43ec8c8-58ac-4324-be6f-28042b212bbb service nova] [instance: af5fd5af-63a6-4eee-a4ef-6088a3713214] No waiting events found dispatching network-vif-plugged-1f37d277-e3ac-48ca-b618-27b872f41824 {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 09:45:15 user nova-compute[75229]: WARNING nova.compute.manager [req-03023951-ded3-4c4f-881d-8700c3f865e0 req-a43ec8c8-58ac-4324-be6f-28042b212bbb service nova] [instance: af5fd5af-63a6-4eee-a4ef-6088a3713214] Received unexpected event network-vif-plugged-1f37d277-e3ac-48ca-b618-27b872f41824 for instance with vm_state building and task_state spawning.
Nov 14 09:45:15 user nova-compute[75229]: DEBUG nova.compute.manager [req-03023951-ded3-4c4f-881d-8700c3f865e0 req-a43ec8c8-58ac-4324-be6f-28042b212bbb service nova] [instance: af5fd5af-63a6-4eee-a4ef-6088a3713214] Received event network-vif-plugged-768a662a-4bcd-4844-a9ed-f8b8f6b8aa0d {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:45:15 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-03023951-ded3-4c4f-881d-8700c3f865e0 req-a43ec8c8-58ac-4324-be6f-28042b212bbb service nova] Acquiring lock "af5fd5af-63a6-4eee-a4ef-6088a3713214-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:45:15 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-03023951-ded3-4c4f-881d-8700c3f865e0 req-a43ec8c8-58ac-4324-be6f-28042b212bbb service nova] Lock "af5fd5af-63a6-4eee-a4ef-6088a3713214-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:45:15 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-03023951-ded3-4c4f-881d-8700c3f865e0 req-a43ec8c8-58ac-4324-be6f-28042b212bbb service nova] Lock "af5fd5af-63a6-4eee-a4ef-6088a3713214-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:45:15 user nova-compute[75229]: DEBUG nova.compute.manager [req-03023951-ded3-4c4f-881d-8700c3f865e0 req-a43ec8c8-58ac-4324-be6f-28042b212bbb service nova] [instance: af5fd5af-63a6-4eee-a4ef-6088a3713214] No waiting events found dispatching network-vif-plugged-768a662a-4bcd-4844-a9ed-f8b8f6b8aa0d {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 09:45:15 user nova-compute[75229]: WARNING nova.compute.manager [req-03023951-ded3-4c4f-881d-8700c3f865e0 req-a43ec8c8-58ac-4324-be6f-28042b212bbb service nova] [instance: af5fd5af-63a6-4eee-a4ef-6088a3713214] Received unexpected event network-vif-plugged-768a662a-4bcd-4844-a9ed-f8b8f6b8aa0d for instance with vm_state building and task_state spawning.
Nov 14 09:45:15 user nova-compute[75229]: DEBUG nova.compute.manager [req-03023951-ded3-4c4f-881d-8700c3f865e0 req-a43ec8c8-58ac-4324-be6f-28042b212bbb service nova] [instance: af5fd5af-63a6-4eee-a4ef-6088a3713214] Received event network-vif-plugged-768a662a-4bcd-4844-a9ed-f8b8f6b8aa0d {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:45:15 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-03023951-ded3-4c4f-881d-8700c3f865e0 req-a43ec8c8-58ac-4324-be6f-28042b212bbb service nova] Acquiring lock "af5fd5af-63a6-4eee-a4ef-6088a3713214-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:45:15 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-03023951-ded3-4c4f-881d-8700c3f865e0 req-a43ec8c8-58ac-4324-be6f-28042b212bbb service nova] Lock "af5fd5af-63a6-4eee-a4ef-6088a3713214-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:45:15 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-03023951-ded3-4c4f-881d-8700c3f865e0 req-a43ec8c8-58ac-4324-be6f-28042b212bbb service nova] Lock "af5fd5af-63a6-4eee-a4ef-6088a3713214-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:45:15 user nova-compute[75229]: DEBUG nova.compute.manager [req-03023951-ded3-4c4f-881d-8700c3f865e0 req-a43ec8c8-58ac-4324-be6f-28042b212bbb service nova] [instance: af5fd5af-63a6-4eee-a4ef-6088a3713214] No waiting events found dispatching network-vif-plugged-768a662a-4bcd-4844-a9ed-f8b8f6b8aa0d {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 09:45:15 user nova-compute[75229]: WARNING nova.compute.manager [req-03023951-ded3-4c4f-881d-8700c3f865e0 req-a43ec8c8-58ac-4324-be6f-28042b212bbb service nova] [instance: af5fd5af-63a6-4eee-a4ef-6088a3713214] Received unexpected event network-vif-plugged-768a662a-4bcd-4844-a9ed-f8b8f6b8aa0d for instance with vm_state building and task_state spawning.
Nov 14 09:45:15 user nova-compute[75229]: DEBUG nova.compute.manager [None req-d5268eb3-e108-4421-b72a-35533ea3a492 tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] [instance: af5fd5af-63a6-4eee-a4ef-6088a3713214] Instance event wait completed in 0 seconds for  {{(pid=75229) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 09:45:15 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-d5268eb3-e108-4421-b72a-35533ea3a492 tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] [instance: af5fd5af-63a6-4eee-a4ef-6088a3713214] Guest created on hypervisor {{(pid=75229) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 09:45:15 user nova-compute[75229]: INFO nova.virt.libvirt.driver [-] [instance: af5fd5af-63a6-4eee-a4ef-6088a3713214] Instance spawned successfully.
Nov 14 09:45:15 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-d5268eb3-e108-4421-b72a-35533ea3a492 tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] [instance: af5fd5af-63a6-4eee-a4ef-6088a3713214] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 09:45:15 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-d5268eb3-e108-4421-b72a-35533ea3a492 tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] [instance: af5fd5af-63a6-4eee-a4ef-6088a3713214] Found default for hw_cdrom_bus of ide {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 09:45:15 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-d5268eb3-e108-4421-b72a-35533ea3a492 tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] [instance: af5fd5af-63a6-4eee-a4ef-6088a3713214] Found default for hw_disk_bus of virtio {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 09:45:15 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-d5268eb3-e108-4421-b72a-35533ea3a492 tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] [instance: af5fd5af-63a6-4eee-a4ef-6088a3713214] Found default for hw_input_bus of None {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 09:45:15 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-d5268eb3-e108-4421-b72a-35533ea3a492 tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] [instance: af5fd5af-63a6-4eee-a4ef-6088a3713214] Found default for hw_pointer_model of None {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 09:45:15 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-d5268eb3-e108-4421-b72a-35533ea3a492 tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] [instance: af5fd5af-63a6-4eee-a4ef-6088a3713214] Found default for hw_video_model of virtio {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 09:45:15 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-d5268eb3-e108-4421-b72a-35533ea3a492 tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] [instance: af5fd5af-63a6-4eee-a4ef-6088a3713214] Found default for hw_vif_model of virtio {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 09:45:15 user nova-compute[75229]: INFO nova.compute.manager [None req-d5268eb3-e108-4421-b72a-35533ea3a492 tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] [instance: af5fd5af-63a6-4eee-a4ef-6088a3713214] Took 10.98 seconds to spawn the instance on the hypervisor.
Nov 14 09:45:15 user nova-compute[75229]: DEBUG nova.compute.manager [None req-d5268eb3-e108-4421-b72a-35533ea3a492 tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] [instance: af5fd5af-63a6-4eee-a4ef-6088a3713214] Checking state {{(pid=75229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 09:45:15 user nova-compute[75229]: INFO nova.compute.manager [None req-d5268eb3-e108-4421-b72a-35533ea3a492 tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] [instance: af5fd5af-63a6-4eee-a4ef-6088a3713214] Took 28.21 seconds to build instance.
Nov 14 09:45:15 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-d5268eb3-e108-4421-b72a-35533ea3a492 tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] Lock "af5fd5af-63a6-4eee-a4ef-6088a3713214" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 28.346s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:45:17 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:45:19 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:45:24 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:45:29 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:45:34 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 09:45:37 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:45:39 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:45:41 user nova-compute[75229]: DEBUG nova.compute.manager [req-2653c3d9-0a90-4f32-889c-ccf8a489a8d1 req-b35c8310-6c56-497f-9446-7941e1c49af3 service nova] [instance: 90bd76df-96cb-4bec-9862-853d94cdbaab] Received event network-changed-3b9b5b2a-5b1b-4ec6-900d-c27e7c4a625e {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:45:41 user nova-compute[75229]: DEBUG nova.compute.manager [req-2653c3d9-0a90-4f32-889c-ccf8a489a8d1 req-b35c8310-6c56-497f-9446-7941e1c49af3 service nova] [instance: 90bd76df-96cb-4bec-9862-853d94cdbaab] Refreshing instance network info cache due to event network-changed-3b9b5b2a-5b1b-4ec6-900d-c27e7c4a625e. {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 09:45:41 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-2653c3d9-0a90-4f32-889c-ccf8a489a8d1 req-b35c8310-6c56-497f-9446-7941e1c49af3 service nova] Acquiring lock "refresh_cache-90bd76df-96cb-4bec-9862-853d94cdbaab" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 09:45:41 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-2653c3d9-0a90-4f32-889c-ccf8a489a8d1 req-b35c8310-6c56-497f-9446-7941e1c49af3 service nova] Acquired lock "refresh_cache-90bd76df-96cb-4bec-9862-853d94cdbaab" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 09:45:41 user nova-compute[75229]: DEBUG nova.network.neutron [req-2653c3d9-0a90-4f32-889c-ccf8a489a8d1 req-b35c8310-6c56-497f-9446-7941e1c49af3 service nova] [instance: 90bd76df-96cb-4bec-9862-853d94cdbaab] Refreshing network info cache for port 3b9b5b2a-5b1b-4ec6-900d-c27e7c4a625e {{(pid=75229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 09:45:42 user nova-compute[75229]: DEBUG nova.network.neutron [req-2653c3d9-0a90-4f32-889c-ccf8a489a8d1 req-b35c8310-6c56-497f-9446-7941e1c49af3 service nova] [instance: 90bd76df-96cb-4bec-9862-853d94cdbaab] Updated VIF entry in instance network info cache for port 3b9b5b2a-5b1b-4ec6-900d-c27e7c4a625e. {{(pid=75229) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 09:45:42 user nova-compute[75229]: DEBUG nova.network.neutron [req-2653c3d9-0a90-4f32-889c-ccf8a489a8d1 req-b35c8310-6c56-497f-9446-7941e1c49af3 service nova] [instance: 90bd76df-96cb-4bec-9862-853d94cdbaab] Updating instance_info_cache with network_info: [{"id": "3b9b5b2a-5b1b-4ec6-900d-c27e7c4a625e", "address": "fa:16:3e:6e:aa:df", "network": {"id": "589aea41-545f-4875-ab56-b7aa273dad6f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-785276916-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee9447f169de43829fe3ed51592752e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b9b5b2a-5b", "ovs_interfaceid": "3b9b5b2a-5b1b-4ec6-900d-c27e7c4a625e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 09:45:42 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-2653c3d9-0a90-4f32-889c-ccf8a489a8d1 req-b35c8310-6c56-497f-9446-7941e1c49af3 service nova] Releasing lock "refresh_cache-90bd76df-96cb-4bec-9862-853d94cdbaab" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 09:45:42 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-59d343f7-0107-4e0b-a8d1-30bf458029e1 tempest-DeleteServersTestJSON-1002799117 tempest-DeleteServersTestJSON-1002799117-project-member] Acquiring lock "359ff85c-c332-4059-8db4-689a0483d068" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:45:42 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-59d343f7-0107-4e0b-a8d1-30bf458029e1 tempest-DeleteServersTestJSON-1002799117 tempest-DeleteServersTestJSON-1002799117-project-member] Lock "359ff85c-c332-4059-8db4-689a0483d068" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:45:42 user nova-compute[75229]: DEBUG nova.objects.instance [None req-59d343f7-0107-4e0b-a8d1-30bf458029e1 tempest-DeleteServersTestJSON-1002799117 tempest-DeleteServersTestJSON-1002799117-project-member] Lazy-loading 'flavor' on Instance uuid 359ff85c-c332-4059-8db4-689a0483d068 {{(pid=75229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 09:45:42 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-59d343f7-0107-4e0b-a8d1-30bf458029e1 tempest-DeleteServersTestJSON-1002799117 tempest-DeleteServersTestJSON-1002799117-project-member] Lock "359ff85c-c332-4059-8db4-689a0483d068" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.080s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:45:42 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-59d343f7-0107-4e0b-a8d1-30bf458029e1 tempest-DeleteServersTestJSON-1002799117 tempest-DeleteServersTestJSON-1002799117-project-member] Acquiring lock "359ff85c-c332-4059-8db4-689a0483d068" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:45:42 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-59d343f7-0107-4e0b-a8d1-30bf458029e1 tempest-DeleteServersTestJSON-1002799117 tempest-DeleteServersTestJSON-1002799117-project-member] Lock "359ff85c-c332-4059-8db4-689a0483d068" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:45:42 user nova-compute[75229]: INFO nova.compute.manager [None req-59d343f7-0107-4e0b-a8d1-30bf458029e1 tempest-DeleteServersTestJSON-1002799117 tempest-DeleteServersTestJSON-1002799117-project-member] [instance: 359ff85c-c332-4059-8db4-689a0483d068] Attaching volume ef4a6d4a-4d11-4a4f-a7cb-1a77ff053145 to /dev/vdb
Nov 14 09:45:42 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:45:42 user nova-compute[75229]: DEBUG os_brick.utils [None req-59d343f7-0107-4e0b-a8d1-30bf458029e1 tempest-DeleteServersTestJSON-1002799117 tempest-DeleteServersTestJSON-1002799117-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 09:45:42 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:45:42 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:45:42 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a119838-5e62-442a-ae3c-63054f937acc]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f1154031c835\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:45:42 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:45:42 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:45:42 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[23bad053-1946-44fe-9db3-21736d906ded]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:45:42 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:45:42 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:45:42 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[71cf7607-18b3-4c5f-8415-c815c242bbd8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:45:42 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[34a0811d-2d40-4dda-a3ca-4d01847bebbe]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:45:42 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-59d343f7-0107-4e0b-a8d1-30bf458029e1 tempest-DeleteServersTestJSON-1002799117 tempest-DeleteServersTestJSON-1002799117-project-member] Running cmd (subprocess): nvme version {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:45:42 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-59d343f7-0107-4e0b-a8d1-30bf458029e1 tempest-DeleteServersTestJSON-1002799117 tempest-DeleteServersTestJSON-1002799117-project-member] 'nvme version' failed. Not Retrying. {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 09:45:42 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.nvmeof [None req-59d343f7-0107-4e0b-a8d1-30bf458029e1 tempest-DeleteServersTestJSON-1002799117 tempest-DeleteServersTestJSON-1002799117-project-member] nvme not present on system {{(pid=75229) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 09:45:42 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:45:42 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 09:45:42 user nova-compute[75229]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 09:45:42 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[97a8d67c-04e3-46d5-9714-226c43eab171]: (4, '') {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:45:42 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.lightos [None req-59d343f7-0107-4e0b-a8d1-30bf458029e1 tempest-DeleteServersTestJSON-1002799117 tempest-DeleteServersTestJSON-1002799117-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75229) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 09:45:42 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.lightos [None req-59d343f7-0107-4e0b-a8d1-30bf458029e1 tempest-DeleteServersTestJSON-1002799117 tempest-DeleteServersTestJSON-1002799117-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75229) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 09:45:42 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.lightos [None req-59d343f7-0107-4e0b-a8d1-30bf458029e1 tempest-DeleteServersTestJSON-1002799117 tempest-DeleteServersTestJSON-1002799117-project-member] LIGHTOS: no hostnqn found. {{(pid=75229) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 09:45:42 user nova-compute[75229]: DEBUG os_brick.utils [None req-59d343f7-0107-4e0b-a8d1-30bf458029e1 tempest-DeleteServersTestJSON-1002799117 tempest-DeleteServersTestJSON-1002799117-project-member] <== get_connector_properties: return (113ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f1154031c835', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 09:45:42 user nova-compute[75229]: DEBUG nova.virt.block_device [None req-59d343f7-0107-4e0b-a8d1-30bf458029e1 tempest-DeleteServersTestJSON-1002799117 tempest-DeleteServersTestJSON-1002799117-project-member] [instance: 359ff85c-c332-4059-8db4-689a0483d068] Updating existing volume attachment record: 1ffe60a5-b6ab-461e-b3bd-a5b81381ad0c {{(pid=75229) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 09:45:44 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:45:44 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 09:45:44 user nova-compute[75229]: DEBUG nova.compute.manager [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Starting heal instance info cache {{(pid=75229) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 09:45:44 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-579c9294-7beb-4492-a3f5-2947051de716 tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Acquiring lock "90bd76df-96cb-4bec-9862-853d94cdbaab" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:45:44 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-579c9294-7beb-4492-a3f5-2947051de716 tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Lock "90bd76df-96cb-4bec-9862-853d94cdbaab" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:45:44 user nova-compute[75229]: INFO nova.compute.manager [None req-579c9294-7beb-4492-a3f5-2947051de716 tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] [instance: 90bd76df-96cb-4bec-9862-853d94cdbaab] Shelving
Nov 14 09:45:44 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Acquiring lock "refresh_cache-359ff85c-c332-4059-8db4-689a0483d068" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 09:45:44 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Acquired lock "refresh_cache-359ff85c-c332-4059-8db4-689a0483d068" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 09:45:44 user nova-compute[75229]: DEBUG nova.network.neutron [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] [instance: 359ff85c-c332-4059-8db4-689a0483d068] Forcefully refreshing network info cache for instance {{(pid=75229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 09:45:44 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:45:44 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:45:44 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:45:45 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:45:45 user nova-compute[75229]: DEBUG nova.compute.manager [req-f6623a15-8120-4060-bee2-bc55a6045d71 req-7086b64c-f6d6-4d4f-b15f-3910ba09fbc1 service nova] [instance: 90bd76df-96cb-4bec-9862-853d94cdbaab] Received event network-vif-unplugged-3b9b5b2a-5b1b-4ec6-900d-c27e7c4a625e {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:45:45 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-f6623a15-8120-4060-bee2-bc55a6045d71 req-7086b64c-f6d6-4d4f-b15f-3910ba09fbc1 service nova] Acquiring lock "90bd76df-96cb-4bec-9862-853d94cdbaab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:45:45 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-f6623a15-8120-4060-bee2-bc55a6045d71 req-7086b64c-f6d6-4d4f-b15f-3910ba09fbc1 service nova] Lock "90bd76df-96cb-4bec-9862-853d94cdbaab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:45:45 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-f6623a15-8120-4060-bee2-bc55a6045d71 req-7086b64c-f6d6-4d4f-b15f-3910ba09fbc1 service nova] Lock "90bd76df-96cb-4bec-9862-853d94cdbaab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:45:45 user nova-compute[75229]: DEBUG nova.compute.manager [req-f6623a15-8120-4060-bee2-bc55a6045d71 req-7086b64c-f6d6-4d4f-b15f-3910ba09fbc1 service nova] [instance: 90bd76df-96cb-4bec-9862-853d94cdbaab] No waiting events found dispatching network-vif-unplugged-3b9b5b2a-5b1b-4ec6-900d-c27e7c4a625e {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 09:45:45 user nova-compute[75229]: WARNING nova.compute.manager [req-f6623a15-8120-4060-bee2-bc55a6045d71 req-7086b64c-f6d6-4d4f-b15f-3910ba09fbc1 service nova] [instance: 90bd76df-96cb-4bec-9862-853d94cdbaab] Received unexpected event network-vif-unplugged-3b9b5b2a-5b1b-4ec6-900d-c27e7c4a625e for instance with vm_state active and task_state shelving.
Nov 14 09:45:45 user nova-compute[75229]: INFO nova.virt.libvirt.driver [-] [instance: 90bd76df-96cb-4bec-9862-853d94cdbaab] Instance destroyed successfully.
Nov 14 09:45:45 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:45:45 user nova-compute[75229]: DEBUG nova.network.neutron [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] [instance: 359ff85c-c332-4059-8db4-689a0483d068] Updating instance_info_cache with network_info: [{"id": "a799c237-ea4a-472d-b149-904fabda7414", "address": "fa:16:3e:80:1f:b3", "network": {"id": "60446365-aa09-4526-8746-a7069b8083c7", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1696625928-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac677c251f874551947d944c52d1d7b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa799c237-ea", "ovs_interfaceid": "a799c237-ea4a-472d-b149-904fabda7414", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 09:45:45 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Releasing lock "refresh_cache-359ff85c-c332-4059-8db4-689a0483d068" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 09:45:45 user nova-compute[75229]: DEBUG nova.compute.manager [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] [instance: 359ff85c-c332-4059-8db4-689a0483d068] Updated the network info_cache for instance {{(pid=75229) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 09:45:45 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 09:45:45 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 09:45:45 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-579c9294-7beb-4492-a3f5-2947051de716 tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] [instance: 90bd76df-96cb-4bec-9862-853d94cdbaab] Beginning cold snapshot process
Nov 14 09:45:45 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:45:45 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:45:45 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:45:45 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Auditing locally available compute resources for user (node: user) {{(pid=75229) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 09:45:45 user nova-compute[75229]: DEBUG nova.compute.manager [req-037d6347-a749-49c9-9e79-72e0d087f3cc req-fedf6bad-954a-4bec-8eaa-93aafced68f9 service nova] [instance: a7750cbc-b3d0-44aa-8b88-c291ba007a8a] Received event network-changed-e5b20e94-618c-4c51-b20f-1d3f1fb921b6 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:45:45 user nova-compute[75229]: DEBUG nova.compute.manager [req-037d6347-a749-49c9-9e79-72e0d087f3cc req-fedf6bad-954a-4bec-8eaa-93aafced68f9 service nova] [instance: a7750cbc-b3d0-44aa-8b88-c291ba007a8a] Refreshing instance network info cache due to event network-changed-e5b20e94-618c-4c51-b20f-1d3f1fb921b6. {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 09:45:45 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-037d6347-a749-49c9-9e79-72e0d087f3cc req-fedf6bad-954a-4bec-8eaa-93aafced68f9 service nova] Acquiring lock "refresh_cache-a7750cbc-b3d0-44aa-8b88-c291ba007a8a" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 09:45:45 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-037d6347-a749-49c9-9e79-72e0d087f3cc req-fedf6bad-954a-4bec-8eaa-93aafced68f9 service nova] Acquired lock "refresh_cache-a7750cbc-b3d0-44aa-8b88-c291ba007a8a" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 09:45:45 user nova-compute[75229]: DEBUG nova.network.neutron [req-037d6347-a749-49c9-9e79-72e0d087f3cc req-fedf6bad-954a-4bec-8eaa-93aafced68f9 service nova] [instance: a7750cbc-b3d0-44aa-8b88-c291ba007a8a] Refreshing network info cache for port e5b20e94-618c-4c51-b20f-1d3f1fb921b6 {{(pid=75229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 09:45:45 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb53ba25-d865-41ae-90f3-6e154e2778ba/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:45:45 user nova-compute[75229]: DEBUG nova.privsep.utils [None req-579c9294-7beb-4492-a3f5-2947051de716 tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75229) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 14 09:45:45 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-579c9294-7beb-4492-a3f5-2947051de716 tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/90bd76df-96cb-4bec-9862-853d94cdbaab/disk /opt/stack/data/nova/instances/snapshots/tmplpyh4pui/b60a74fdf1c144e28e4a0de52ddab57e {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:45:46 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb53ba25-d865-41ae-90f3-6e154e2778ba/disk --force-share --output=json" returned: 0 in 0.313s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:45:46 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb53ba25-d865-41ae-90f3-6e154e2778ba/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:45:46 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb53ba25-d865-41ae-90f3-6e154e2778ba/disk --force-share --output=json" returned: 0 in 0.312s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:45:46 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/359ff85c-c332-4059-8db4-689a0483d068/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:45:46 user nova-compute[75229]: DEBUG nova.network.neutron [req-037d6347-a749-49c9-9e79-72e0d087f3cc req-fedf6bad-954a-4bec-8eaa-93aafced68f9 service nova] [instance: a7750cbc-b3d0-44aa-8b88-c291ba007a8a] Updated VIF entry in instance network info cache for port e5b20e94-618c-4c51-b20f-1d3f1fb921b6. {{(pid=75229) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 09:45:46 user nova-compute[75229]: DEBUG nova.network.neutron [req-037d6347-a749-49c9-9e79-72e0d087f3cc req-fedf6bad-954a-4bec-8eaa-93aafced68f9 service nova] [instance: a7750cbc-b3d0-44aa-8b88-c291ba007a8a] Updating instance_info_cache with network_info: [{"id": "e5b20e94-618c-4c51-b20f-1d3f1fb921b6", "address": "fa:16:3e:e5:e8:ed", "network": {"id": "5dfc532f-3d5d-4342-b7f1-12c9c3992a54", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1457278473-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.147", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46e65cdd021f4a3db7c9254bb6d98b46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5b20e94-61", "ovs_interfaceid": "e5b20e94-618c-4c51-b20f-1d3f1fb921b6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 09:45:46 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-037d6347-a749-49c9-9e79-72e0d087f3cc req-fedf6bad-954a-4bec-8eaa-93aafced68f9 service nova] Releasing lock "refresh_cache-a7750cbc-b3d0-44aa-8b88-c291ba007a8a" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 09:45:46 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/359ff85c-c332-4059-8db4-689a0483d068/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:45:46 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/359ff85c-c332-4059-8db4-689a0483d068/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:45:46 user nova-compute[75229]: DEBUG nova.compute.manager [req-1253faa7-40cb-49dc-8085-83e60e344fa9 req-916bd088-cc9a-400c-8dd0-73beefe51c71 service nova] [instance: e09b3809-2e23-401c-9a72-88feb2bb657c] Received event network-changed-472488d2-9453-4d74-a6b1-6966b835572d {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:45:46 user nova-compute[75229]: DEBUG nova.compute.manager [req-1253faa7-40cb-49dc-8085-83e60e344fa9 req-916bd088-cc9a-400c-8dd0-73beefe51c71 service nova] [instance: e09b3809-2e23-401c-9a72-88feb2bb657c] Refreshing instance network info cache due to event network-changed-472488d2-9453-4d74-a6b1-6966b835572d. {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 09:45:46 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-1253faa7-40cb-49dc-8085-83e60e344fa9 req-916bd088-cc9a-400c-8dd0-73beefe51c71 service nova] Acquiring lock "refresh_cache-e09b3809-2e23-401c-9a72-88feb2bb657c" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 09:45:46 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-1253faa7-40cb-49dc-8085-83e60e344fa9 req-916bd088-cc9a-400c-8dd0-73beefe51c71 service nova] Acquired lock "refresh_cache-e09b3809-2e23-401c-9a72-88feb2bb657c" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 09:45:46 user nova-compute[75229]: DEBUG nova.network.neutron [req-1253faa7-40cb-49dc-8085-83e60e344fa9 req-916bd088-cc9a-400c-8dd0-73beefe51c71 service nova] [instance: e09b3809-2e23-401c-9a72-88feb2bb657c] Refreshing network info cache for port 472488d2-9453-4d74-a6b1-6966b835572d {{(pid=75229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 09:45:46 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-579c9294-7beb-4492-a3f5-2947051de716 tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/90bd76df-96cb-4bec-9862-853d94cdbaab/disk /opt/stack/data/nova/instances/snapshots/tmplpyh4pui/b60a74fdf1c144e28e4a0de52ddab57e" returned: 0 in 0.981s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:45:46 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-579c9294-7beb-4492-a3f5-2947051de716 tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] [instance: 90bd76df-96cb-4bec-9862-853d94cdbaab] Snapshot extracted, beginning image upload
Nov 14 09:45:46 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/359ff85c-c332-4059-8db4-689a0483d068/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:45:46 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7750cbc-b3d0-44aa-8b88-c291ba007a8a/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:45:46 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7750cbc-b3d0-44aa-8b88-c291ba007a8a/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:45:46 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7750cbc-b3d0-44aa-8b88-c291ba007a8a/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:45:47 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7750cbc-b3d0-44aa-8b88-c291ba007a8a/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:45:47 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90bd76df-96cb-4bec-9862-853d94cdbaab/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:45:47 user nova-compute[75229]: DEBUG nova.compute.manager [req-711d1bc3-eeab-496b-bfde-fd888c669833 req-d4972abf-f263-4810-8f30-3ebd9cc87b5f service nova] [instance: 90bd76df-96cb-4bec-9862-853d94cdbaab] Received event network-vif-plugged-3b9b5b2a-5b1b-4ec6-900d-c27e7c4a625e {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:45:47 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-711d1bc3-eeab-496b-bfde-fd888c669833 req-d4972abf-f263-4810-8f30-3ebd9cc87b5f service nova] Acquiring lock "90bd76df-96cb-4bec-9862-853d94cdbaab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:45:47 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-711d1bc3-eeab-496b-bfde-fd888c669833 req-d4972abf-f263-4810-8f30-3ebd9cc87b5f service nova] Lock "90bd76df-96cb-4bec-9862-853d94cdbaab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:45:47 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-711d1bc3-eeab-496b-bfde-fd888c669833 req-d4972abf-f263-4810-8f30-3ebd9cc87b5f service nova] Lock "90bd76df-96cb-4bec-9862-853d94cdbaab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:45:47 user nova-compute[75229]: DEBUG nova.compute.manager [req-711d1bc3-eeab-496b-bfde-fd888c669833 req-d4972abf-f263-4810-8f30-3ebd9cc87b5f service nova] [instance: 90bd76df-96cb-4bec-9862-853d94cdbaab] No waiting events found dispatching network-vif-plugged-3b9b5b2a-5b1b-4ec6-900d-c27e7c4a625e {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 09:45:47 user nova-compute[75229]: WARNING nova.compute.manager [req-711d1bc3-eeab-496b-bfde-fd888c669833 req-d4972abf-f263-4810-8f30-3ebd9cc87b5f service nova] [instance: 90bd76df-96cb-4bec-9862-853d94cdbaab] Received unexpected event network-vif-plugged-3b9b5b2a-5b1b-4ec6-900d-c27e7c4a625e for instance with vm_state active and task_state shelving_image_uploading.
Nov 14 09:45:47 user nova-compute[75229]: DEBUG nova.network.neutron [req-1253faa7-40cb-49dc-8085-83e60e344fa9 req-916bd088-cc9a-400c-8dd0-73beefe51c71 service nova] [instance: e09b3809-2e23-401c-9a72-88feb2bb657c] Updated VIF entry in instance network info cache for port 472488d2-9453-4d74-a6b1-6966b835572d. {{(pid=75229) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 09:45:47 user nova-compute[75229]: DEBUG nova.network.neutron [req-1253faa7-40cb-49dc-8085-83e60e344fa9 req-916bd088-cc9a-400c-8dd0-73beefe51c71 service nova] [instance: e09b3809-2e23-401c-9a72-88feb2bb657c] Updating instance_info_cache with network_info: [{"id": "472488d2-9453-4d74-a6b1-6966b835572d", "address": "fa:16:3e:9f:3a:e8", "network": {"id": "f5285ef5-fa74-4079-a8cd-f970d97c97c3", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-62550527-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.73", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54dca06fda8b43d5bc92fa7c97a872a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap472488d2-94", "ovs_interfaceid": "472488d2-9453-4d74-a6b1-6966b835572d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 09:45:47 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-1253faa7-40cb-49dc-8085-83e60e344fa9 req-916bd088-cc9a-400c-8dd0-73beefe51c71 service nova] Releasing lock "refresh_cache-e09b3809-2e23-401c-9a72-88feb2bb657c" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 09:45:47 user nova-compute[75229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-59d343f7-0107-4e0b-a8d1-30bf458029e1 tempest-DeleteServersTestJSON-1002799117 tempest-DeleteServersTestJSON-1002799117-project-member] [instance: 359ff85c-c332-4059-8db4-689a0483d068] Calling os-brick to attach iSCSI Volume {{(pid=75229) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 09:45:47 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-59d343f7-0107-4e0b-a8d1-30bf458029e1 tempest-DeleteServersTestJSON-1002799117 tempest-DeleteServersTestJSON-1002799117-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f73f85151b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ef4a6d4a-4d11-4a4f-a7cb-1a77ff053145', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QlWfZubj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 09:45:47 user nova-compute[75229]: WARNING os_brick.initiator.connectors.base [None req-59d343f7-0107-4e0b-a8d1-30bf458029e1 tempest-DeleteServersTestJSON-1002799117 tempest-DeleteServersTestJSON-1002799117-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 09:45:47 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-59d343f7-0107-4e0b-a8d1-30bf458029e1 tempest-DeleteServersTestJSON-1002799117 tempest-DeleteServersTestJSON-1002799117-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 09:45:47 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-59d343f7-0107-4e0b-a8d1-30bf458029e1 tempest-DeleteServersTestJSON-1002799117 tempest-DeleteServersTestJSON-1002799117-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 09:45:47 user nova-compute[75229]: WARNING os_brick.initiator.connectors.base [None req-59d343f7-0107-4e0b-a8d1-30bf458029e1 tempest-DeleteServersTestJSON-1002799117 tempest-DeleteServersTestJSON-1002799117-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 09:45:47 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-59d343f7-0107-4e0b-a8d1-30bf458029e1 tempest-DeleteServersTestJSON-1002799117 tempest-DeleteServersTestJSON-1002799117-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ef4a6d4a-4d11-4a4f-a7cb-1a77ff053145" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 09:45:47 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-59d343f7-0107-4e0b-a8d1-30bf458029e1 tempest-DeleteServersTestJSON-1002799117 tempest-DeleteServersTestJSON-1002799117-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ef4a6d4a-4d11-4a4f-a7cb-1a77ff053145" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 09:45:47 user nova-compute[75229]: INFO os_brick.initiator.connectors.iscsi [None req-59d343f7-0107-4e0b-a8d1-30bf458029e1 tempest-DeleteServersTestJSON-1002799117 tempest-DeleteServersTestJSON-1002799117-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 09:45:47 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef4a6d4a-4d11-4a4f-a7cb-1a77ff053145 -p 172.16.0.220:3260 {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:45:47 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef4a6d4a-4d11-4a4f-a7cb-1a77ff053145 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:45:47 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[61b8f13d-b32d-4f88-bf33-d43c32a3a53f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:45:47 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-59d343f7-0107-4e0b-a8d1-30bf458029e1 tempest-DeleteServersTestJSON-1002799117 tempest-DeleteServersTestJSON-1002799117-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 09:45:47 user nova-compute[75229]:  {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:45:47 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef4a6d4a-4d11-4a4f-a7cb-1a77ff053145 -p 172.16.0.220:3260 --interface default --op new {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:45:47 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef4a6d4a-4d11-4a4f-a7cb-1a77ff053145 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:45:47 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e536ca8-56ba-436a-8c8c-dbf61b64fcf2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ef4a6d4a-4d11-4a4f-a7cb-1a77ff053145] added\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:45:47 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-59d343f7-0107-4e0b-a8d1-30bf458029e1 tempest-DeleteServersTestJSON-1002799117 tempest-DeleteServersTestJSON-1002799117-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ef4a6d4a-4d11-4a4f-a7cb-1a77ff053145] added
Nov 14 09:45:47 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:45:47 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef4a6d4a-4d11-4a4f-a7cb-1a77ff053145 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:45:47 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90bd76df-96cb-4bec-9862-853d94cdbaab/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:45:47 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90bd76df-96cb-4bec-9862-853d94cdbaab/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:45:47 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef4a6d4a-4d11-4a4f-a7cb-1a77ff053145 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:45:47 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f882c0c-c2a3-4a04-b8ab-fd7d7867d187]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:45:47 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-59d343f7-0107-4e0b-a8d1-30bf458029e1 tempest-DeleteServersTestJSON-1002799117 tempest-DeleteServersTestJSON-1002799117-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:45:47 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef4a6d4a-4d11-4a4f-a7cb-1a77ff053145 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:45:47 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef4a6d4a-4d11-4a4f-a7cb-1a77ff053145 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:45:47 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[36f053c1-0069-4b5b-890e-cf5c34d06ea6]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:45:47 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-59d343f7-0107-4e0b-a8d1-30bf458029e1 tempest-DeleteServersTestJSON-1002799117 tempest-DeleteServersTestJSON-1002799117-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:45:47 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef4a6d4a-4d11-4a4f-a7cb-1a77ff053145 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QlWfZubj {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:45:47 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef4a6d4a-4d11-4a4f-a7cb-1a77ff053145 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QlWfZubj" returned: 0 in 0.020s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:45:47 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c8010ab-1148-49ce-9ab1-a01abe575dfd]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:45:47 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-59d343f7-0107-4e0b-a8d1-30bf458029e1 tempest-DeleteServersTestJSON-1002799117 tempest-DeleteServersTestJSON-1002799117-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QlWfZubj'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:45:47 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef4a6d4a-4d11-4a4f-a7cb-1a77ff053145 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:45:47 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef4a6d4a-4d11-4a4f-a7cb-1a77ff053145 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:45:47 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[40cbc3ad-ef65-47d2-aa07-c35086cb7e75]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:45:47 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-59d343f7-0107-4e0b-a8d1-30bf458029e1 tempest-DeleteServersTestJSON-1002799117 tempest-DeleteServersTestJSON-1002799117-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:45:47 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:45:47 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:45:47 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa7ae5eb-8237-47cd-8ed9-15a9f68c6a61]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2324d4e-6e60-47fd-b536-144a7ea32dce (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18a1e95e-5df1-4db1-92bc-6cd67729c7a7 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97f588de-32d5-4d48-9c06-5925263ba117 (non-flash)\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:45:47 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-59d343f7-0107-4e0b-a8d1-30bf458029e1 tempest-DeleteServersTestJSON-1002799117 tempest-DeleteServersTestJSON-1002799117-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2324d4e-6e60-47fd-b536-144a7ea32dce (non-flash)
Nov 14 09:45:47 user nova-compute[75229]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18a1e95e-5df1-4db1-92bc-6cd67729c7a7 (non-flash)
Nov 14 09:45:47 user nova-compute[75229]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97f588de-32d5-4d48-9c06-5925263ba117 (non-flash)
Nov 14 09:45:47 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 09:45:47 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-59d343f7-0107-4e0b-a8d1-30bf458029e1 tempest-DeleteServersTestJSON-1002799117 tempest-DeleteServersTestJSON-1002799117-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2324d4e-6e60-47fd-b536-144a7ea32dce (non-flash)
Nov 14 09:45:47 user nova-compute[75229]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18a1e95e-5df1-4db1-92bc-6cd67729c7a7 (non-flash)
Nov 14 09:45:47 user nova-compute[75229]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97f588de-32d5-4d48-9c06-5925263ba117 (non-flash)
Nov 14 09:45:47 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 09:45:47 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef4a6d4a-4d11-4a4f-a7cb-1a77ff053145 -p 172.16.0.220:3260 --login {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:45:47 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90bd76df-96cb-4bec-9862-853d94cdbaab/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:45:47 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a60d339f-e134-477c-8505-bf8c79d2a21c/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:45:47 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef4a6d4a-4d11-4a4f-a7cb-1a77ff053145 -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:45:47 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6813f6c-fa45-4004-8490-be00ea8349f6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ef4a6d4a-4d11-4a4f-a7cb-1a77ff053145, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ef4a6d4a-4d11-4a4f-a7cb-1a77ff053145, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:45:47 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-59d343f7-0107-4e0b-a8d1-30bf458029e1 tempest-DeleteServersTestJSON-1002799117 tempest-DeleteServersTestJSON-1002799117-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ef4a6d4a-4d11-4a4f-a7cb-1a77ff053145, portal: 172.16.0.220,3260]
Nov 14 09:45:47 user nova-compute[75229]: Login to [iface: default, target: iqn.2010-10.org.openstack:ef4a6d4a-4d11-4a4f-a7cb-1a77ff053145, portal: 172.16.0.220,3260] successful.
Nov 14 09:45:47 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:45:47 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef4a6d4a-4d11-4a4f-a7cb-1a77ff053145 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:45:47 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef4a6d4a-4d11-4a4f-a7cb-1a77ff053145 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:45:47 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[f325d08b-c155-459f-84a6-0a1bc061ff7a]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:45:47 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-59d343f7-0107-4e0b-a8d1-30bf458029e1 tempest-DeleteServersTestJSON-1002799117 tempest-DeleteServersTestJSON-1002799117-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:45:47 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:45:47 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:45:47 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[97044153-590b-482a-8208-dd9fc02c9d25]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2324d4e-6e60-47fd-b536-144a7ea32dce (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18a1e95e-5df1-4db1-92bc-6cd67729c7a7 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97f588de-32d5-4d48-9c06-5925263ba117 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef4a6d4a-4d11-4a4f-a7cb-1a77ff053145 (non-flash)\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:45:47 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-59d343f7-0107-4e0b-a8d1-30bf458029e1 tempest-DeleteServersTestJSON-1002799117 tempest-DeleteServersTestJSON-1002799117-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2324d4e-6e60-47fd-b536-144a7ea32dce (non-flash)
Nov 14 09:45:47 user nova-compute[75229]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18a1e95e-5df1-4db1-92bc-6cd67729c7a7 (non-flash)
Nov 14 09:45:47 user nova-compute[75229]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97f588de-32d5-4d48-9c06-5925263ba117 (non-flash)
Nov 14 09:45:47 user nova-compute[75229]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef4a6d4a-4d11-4a4f-a7cb-1a77ff053145 (non-flash)
Nov 14 09:45:47 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 09:45:47 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-59d343f7-0107-4e0b-a8d1-30bf458029e1 tempest-DeleteServersTestJSON-1002799117 tempest-DeleteServersTestJSON-1002799117-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2324d4e-6e60-47fd-b536-144a7ea32dce (non-flash)
Nov 14 09:45:47 user nova-compute[75229]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18a1e95e-5df1-4db1-92bc-6cd67729c7a7 (non-flash)
Nov 14 09:45:47 user nova-compute[75229]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97f588de-32d5-4d48-9c06-5925263ba117 (non-flash)
Nov 14 09:45:47 user nova-compute[75229]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef4a6d4a-4d11-4a4f-a7cb-1a77ff053145 (non-flash)
Nov 14 09:45:47 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 09:45:47 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-59d343f7-0107-4e0b-a8d1-30bf458029e1 tempest-DeleteServersTestJSON-1002799117 tempest-DeleteServersTestJSON-1002799117-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ef4a6d4a-4d11-4a4f-a7cb-1a77ff053145" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.353s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 09:45:47 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-59d343f7-0107-4e0b-a8d1-30bf458029e1 tempest-DeleteServersTestJSON-1002799117 tempest-DeleteServersTestJSON-1002799117-project-member] Connected to 172.16.0.220:3260 {{(pid=75229) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 09:45:47 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-59d343f7-0107-4e0b-a8d1-30bf458029e1 tempest-DeleteServersTestJSON-1002799117 tempest-DeleteServersTestJSON-1002799117-project-member] HCTL ('36', '-', '-', 0) found on session 5 with lun 0 {{(pid=75229) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 09:45:47 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-59d343f7-0107-4e0b-a8d1-30bf458029e1 tempest-DeleteServersTestJSON-1002799117 tempest-DeleteServersTestJSON-1002799117-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75229) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 09:45:47 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:45:47 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.019s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:45:47 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[60161a73-8ddc-4b6f-a364-50878a6ca61b]: (4, ('- - 0', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:45:47 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-59d343f7-0107-4e0b-a8d1-30bf458029e1 tempest-DeleteServersTestJSON-1002799117 tempest-DeleteServersTestJSON-1002799117-project-member] Searching for a device in session 5 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75229) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 09:45:47 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-59d343f7-0107-4e0b-a8d1-30bf458029e1 tempest-DeleteServersTestJSON-1002799117 tempest-DeleteServersTestJSON-1002799117-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:ef4a6d4a-4d11-4a4f-a7cb-1a77ff053145', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QlWfZubj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75229) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 09:45:47 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:45:47 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a60d339f-e134-477c-8505-bf8c79d2a21c/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:45:47 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a60d339f-e134-477c-8505-bf8c79d2a21c/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:45:47 user nova-compute[75229]: DEBUG nova.compute.manager [None req-83ae62a8-d9d3-403b-937d-62f0e38ae89b tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] [instance: e09b3809-2e23-401c-9a72-88feb2bb657c] Checking state {{(pid=75229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 09:45:47 user nova-compute[75229]: INFO nova.compute.manager [None req-83ae62a8-d9d3-403b-937d-62f0e38ae89b tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] [instance: e09b3809-2e23-401c-9a72-88feb2bb657c] instance snapshotting
Nov 14 09:45:47 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-83ae62a8-d9d3-403b-937d-62f0e38ae89b tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] [instance: e09b3809-2e23-401c-9a72-88feb2bb657c] Beginning live snapshot process
Nov 14 09:45:47 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a60d339f-e134-477c-8505-bf8c79d2a21c/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:45:47 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6fa2298-7111-4660-a162-09269045d5e3/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:45:48 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-83ae62a8-d9d3-403b-937d-62f0e38ae89b tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e09b3809-2e23-401c-9a72-88feb2bb657c/disk --force-share --output=json -f qcow2 {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:45:48 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6fa2298-7111-4660-a162-09269045d5e3/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:45:48 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6fa2298-7111-4660-a162-09269045d5e3/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:45:48 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-83ae62a8-d9d3-403b-937d-62f0e38ae89b tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e09b3809-2e23-401c-9a72-88feb2bb657c/disk --force-share --output=json -f qcow2" returned: 0 in 0.178s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:45:48 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-83ae62a8-d9d3-403b-937d-62f0e38ae89b tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e09b3809-2e23-401c-9a72-88feb2bb657c/disk --force-share --output=json -f qcow2 {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:45:48 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6fa2298-7111-4660-a162-09269045d5e3/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:45:48 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9d3e03d-be75-44b1-97b4-36c13715175b/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:45:48 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-83ae62a8-d9d3-403b-937d-62f0e38ae89b tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e09b3809-2e23-401c-9a72-88feb2bb657c/disk --force-share --output=json -f qcow2" returned: 0 in 0.174s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:45:48 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-83ae62a8-d9d3-403b-937d-62f0e38ae89b tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6 --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:45:48 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9d3e03d-be75-44b1-97b4-36c13715175b/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:45:48 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9d3e03d-be75-44b1-97b4-36c13715175b/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:45:48 user nova-compute[75229]: DEBUG nova.compute.manager [req-c154ae26-b62a-4b07-91ec-93bafbbcbeda req-ba5eac6a-6b66-4347-917d-ff8743f4dbcf service nova] [instance: a60d339f-e134-477c-8505-bf8c79d2a21c] Received event network-changed-cb98fc47-7b69-4bde-9a4c-717cd44ba908 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:45:48 user nova-compute[75229]: DEBUG nova.compute.manager [req-c154ae26-b62a-4b07-91ec-93bafbbcbeda req-ba5eac6a-6b66-4347-917d-ff8743f4dbcf service nova] [instance: a60d339f-e134-477c-8505-bf8c79d2a21c] Refreshing instance network info cache due to event network-changed-cb98fc47-7b69-4bde-9a4c-717cd44ba908. {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 09:45:48 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-c154ae26-b62a-4b07-91ec-93bafbbcbeda req-ba5eac6a-6b66-4347-917d-ff8743f4dbcf service nova] Acquiring lock "refresh_cache-a60d339f-e134-477c-8505-bf8c79d2a21c" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 09:45:48 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-c154ae26-b62a-4b07-91ec-93bafbbcbeda req-ba5eac6a-6b66-4347-917d-ff8743f4dbcf service nova] Acquired lock "refresh_cache-a60d339f-e134-477c-8505-bf8c79d2a21c" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 09:45:48 user nova-compute[75229]: DEBUG nova.network.neutron [req-c154ae26-b62a-4b07-91ec-93bafbbcbeda req-ba5eac6a-6b66-4347-917d-ff8743f4dbcf service nova] [instance: a60d339f-e134-477c-8505-bf8c79d2a21c] Refreshing network info cache for port cb98fc47-7b69-4bde-9a4c-717cd44ba908 {{(pid=75229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 09:45:48 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-83ae62a8-d9d3-403b-937d-62f0e38ae89b tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6 --force-share --output=json" returned: 0 in 0.177s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:45:48 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-83ae62a8-d9d3-403b-937d-62f0e38ae89b tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpe8gkhlu5/2596411db2804396b98fef9f31155414.delta 1073741824 {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:45:48 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-83ae62a8-d9d3-403b-937d-62f0e38ae89b tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpe8gkhlu5/2596411db2804396b98fef9f31155414.delta 1073741824" returned: 0 in 0.055s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:45:48 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-59d343f7-0107-4e0b-a8d1-30bf458029e1 tempest-DeleteServersTestJSON-1002799117 tempest-DeleteServersTestJSON-1002799117-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.395s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 09:45:48 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-59d343f7-0107-4e0b-a8d1-30bf458029e1 tempest-DeleteServersTestJSON-1002799117 tempest-DeleteServersTestJSON-1002799117-project-member] <== connect_volume: return (1397ms) {'type': 'block', 'scsi_wwn': '26334336532353135', 'path': '/dev/sde'} {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 09:45:48 user nova-compute[75229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-59d343f7-0107-4e0b-a8d1-30bf458029e1 tempest-DeleteServersTestJSON-1002799117 tempest-DeleteServersTestJSON-1002799117-project-member] [instance: 359ff85c-c332-4059-8db4-689a0483d068] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26334336532353135', 'path': '/dev/sde'} {{(pid=75229) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 09:45:48 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-83ae62a8-d9d3-403b-937d-62f0e38ae89b tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] [instance: e09b3809-2e23-401c-9a72-88feb2bb657c] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 14 09:45:48 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-83ae62a8-d9d3-403b-937d-62f0e38ae89b tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] Checking UEFI support for host arch (x86_64) {{(pid=75229) supports_uefi /opt/stack/nova/nova/virt/libvirt/host.py:1751}}
Nov 14 09:45:48 user nova-compute[75229]: INFO nova.virt.libvirt.host [None req-83ae62a8-d9d3-403b-937d-62f0e38ae89b tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] UEFI support detected
Nov 14 09:45:48 user nova-compute[75229]: DEBUG nova.objects.instance [None req-59d343f7-0107-4e0b-a8d1-30bf458029e1 tempest-DeleteServersTestJSON-1002799117 tempest-DeleteServersTestJSON-1002799117-project-member] Lazy-loading 'flavor' on Instance uuid 359ff85c-c332-4059-8db4-689a0483d068 {{(pid=75229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 09:45:48 user nova-compute[75229]: DEBUG nova.virt.libvirt.guest [None req-59d343f7-0107-4e0b-a8d1-30bf458029e1 tempest-DeleteServersTestJSON-1002799117 tempest-DeleteServersTestJSON-1002799117-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 09:45:48 user nova-compute[75229]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 09:45:48 user nova-compute[75229]:   <source dev="/dev/sde"/>
Nov 14 09:45:48 user nova-compute[75229]:   <target dev="vdb" bus="virtio"/>
Nov 14 09:45:48 user nova-compute[75229]:   <serial>ef4a6d4a-4d11-4a4f-a7cb-1a77ff053145</serial>
Nov 14 09:45:48 user nova-compute[75229]: </disk>
Nov 14 09:45:48 user nova-compute[75229]:  {{(pid=75229) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 09:45:48 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9d3e03d-be75-44b1-97b4-36c13715175b/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:45:48 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37e63bd9-44fc-4d07-b31b-570f69d7bc8a/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:45:48 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37e63bd9-44fc-4d07-b31b-570f69d7bc8a/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:45:48 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37e63bd9-44fc-4d07-b31b-570f69d7bc8a/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:45:49 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37e63bd9-44fc-4d07-b31b-570f69d7bc8a/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:45:49 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-59d343f7-0107-4e0b-a8d1-30bf458029e1 tempest-DeleteServersTestJSON-1002799117 tempest-DeleteServersTestJSON-1002799117-project-member] No BDM found with device name vda, not building metadata. {{(pid=75229) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 09:45:49 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-59d343f7-0107-4e0b-a8d1-30bf458029e1 tempest-DeleteServersTestJSON-1002799117 tempest-DeleteServersTestJSON-1002799117-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75229) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 09:45:49 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-59d343f7-0107-4e0b-a8d1-30bf458029e1 tempest-DeleteServersTestJSON-1002799117 tempest-DeleteServersTestJSON-1002799117-project-member] No VIF found with MAC fa:16:3e:80:1f:b3, not building metadata {{(pid=75229) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 09:45:49 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-59d343f7-0107-4e0b-a8d1-30bf458029e1 tempest-DeleteServersTestJSON-1002799117 tempest-DeleteServersTestJSON-1002799117-project-member] Lock "359ff85c-c332-4059-8db4-689a0483d068" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.662s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:45:49 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:45:49 user nova-compute[75229]: DEBUG nova.network.neutron [req-c154ae26-b62a-4b07-91ec-93bafbbcbeda req-ba5eac6a-6b66-4347-917d-ff8743f4dbcf service nova] [instance: a60d339f-e134-477c-8505-bf8c79d2a21c] Updated VIF entry in instance network info cache for port cb98fc47-7b69-4bde-9a4c-717cd44ba908. {{(pid=75229) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 09:45:49 user nova-compute[75229]: DEBUG nova.network.neutron [req-c154ae26-b62a-4b07-91ec-93bafbbcbeda req-ba5eac6a-6b66-4347-917d-ff8743f4dbcf service nova] [instance: a60d339f-e134-477c-8505-bf8c79d2a21c] Updating instance_info_cache with network_info: [{"id": "cb98fc47-7b69-4bde-9a4c-717cd44ba908", "address": "fa:16:3e:6c:f4:6d", "network": {"id": "2b667d50-4579-4453-b4d3-a818a0d2c6fc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1719812180-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.24", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32e17c7c586542139cdbc5bfda57e075", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb98fc47-7b", "ovs_interfaceid": "cb98fc47-7b69-4bde-9a4c-717cd44ba908", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 09:45:49 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-c154ae26-b62a-4b07-91ec-93bafbbcbeda req-ba5eac6a-6b66-4347-917d-ff8743f4dbcf service nova] Releasing lock "refresh_cache-a60d339f-e134-477c-8505-bf8c79d2a21c" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 09:45:49 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-579c9294-7beb-4492-a3f5-2947051de716 tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] [instance: 90bd76df-96cb-4bec-9862-853d94cdbaab] Snapshot image upload complete
Nov 14 09:45:49 user nova-compute[75229]: DEBUG nova.compute.manager [None req-579c9294-7beb-4492-a3f5-2947051de716 tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] [instance: 90bd76df-96cb-4bec-9862-853d94cdbaab] Checking state {{(pid=75229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 09:45:49 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e09b3809-2e23-401c-9a72-88feb2bb657c/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:45:49 user nova-compute[75229]: DEBUG nova.virt.libvirt.guest [None req-83ae62a8-d9d3-403b-937d-62f0e38ae89b tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] COPY block job progress, current cursor: 1179648 final cursor: 75497472 {{(pid=75229) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 09:45:49 user nova-compute[75229]: INFO nova.compute.manager [None req-579c9294-7beb-4492-a3f5-2947051de716 tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] [instance: 90bd76df-96cb-4bec-9862-853d94cdbaab] Shelve offloading
Nov 14 09:45:49 user nova-compute[75229]: INFO nova.virt.libvirt.driver [-] [instance: 90bd76df-96cb-4bec-9862-853d94cdbaab] Instance destroyed successfully.
Nov 14 09:45:49 user nova-compute[75229]: DEBUG nova.compute.manager [None req-579c9294-7beb-4492-a3f5-2947051de716 tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] [instance: 90bd76df-96cb-4bec-9862-853d94cdbaab] Checking state {{(pid=75229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 09:45:49 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-579c9294-7beb-4492-a3f5-2947051de716 tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Acquiring lock "refresh_cache-90bd76df-96cb-4bec-9862-853d94cdbaab" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 09:45:49 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-579c9294-7beb-4492-a3f5-2947051de716 tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Acquired lock "refresh_cache-90bd76df-96cb-4bec-9862-853d94cdbaab" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 09:45:49 user nova-compute[75229]: DEBUG nova.network.neutron [None req-579c9294-7beb-4492-a3f5-2947051de716 tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] [instance: 90bd76df-96cb-4bec-9862-853d94cdbaab] Building network info cache for instance {{(pid=75229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 09:45:49 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e09b3809-2e23-401c-9a72-88feb2bb657c/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:45:49 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e09b3809-2e23-401c-9a72-88feb2bb657c/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:45:50 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e09b3809-2e23-401c-9a72-88feb2bb657c/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:45:50 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8623fdcc-99b7-44d6-ad81-dada5ba83a88/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:45:50 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8623fdcc-99b7-44d6-ad81-dada5ba83a88/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:45:50 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8623fdcc-99b7-44d6-ad81-dada5ba83a88/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:45:50 user nova-compute[75229]: DEBUG nova.virt.libvirt.guest [None req-83ae62a8-d9d3-403b-937d-62f0e38ae89b tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=75229) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 09:45:50 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-83ae62a8-d9d3-403b-937d-62f0e38ae89b tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] [instance: e09b3809-2e23-401c-9a72-88feb2bb657c] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 14 09:45:50 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-d95bf7bd-07e2-4ce7-9cc4-a286beede32e tempest-DeleteServersTestJSON-1002799117 tempest-DeleteServersTestJSON-1002799117-project-member] Acquiring lock "359ff85c-c332-4059-8db4-689a0483d068" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:45:50 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-d95bf7bd-07e2-4ce7-9cc4-a286beede32e tempest-DeleteServersTestJSON-1002799117 tempest-DeleteServersTestJSON-1002799117-project-member] Lock "359ff85c-c332-4059-8db4-689a0483d068" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:45:50 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-d95bf7bd-07e2-4ce7-9cc4-a286beede32e tempest-DeleteServersTestJSON-1002799117 tempest-DeleteServersTestJSON-1002799117-project-member] Acquiring lock "359ff85c-c332-4059-8db4-689a0483d068-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:45:50 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-d95bf7bd-07e2-4ce7-9cc4-a286beede32e tempest-DeleteServersTestJSON-1002799117 tempest-DeleteServersTestJSON-1002799117-project-member] Lock "359ff85c-c332-4059-8db4-689a0483d068-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:45:50 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-d95bf7bd-07e2-4ce7-9cc4-a286beede32e tempest-DeleteServersTestJSON-1002799117 tempest-DeleteServersTestJSON-1002799117-project-member] Lock "359ff85c-c332-4059-8db4-689a0483d068-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:45:50 user nova-compute[75229]: INFO nova.compute.manager [None req-d95bf7bd-07e2-4ce7-9cc4-a286beede32e tempest-DeleteServersTestJSON-1002799117 tempest-DeleteServersTestJSON-1002799117-project-member] [instance: 359ff85c-c332-4059-8db4-689a0483d068] Terminating instance
Nov 14 09:45:50 user nova-compute[75229]: DEBUG nova.compute.manager [None req-d95bf7bd-07e2-4ce7-9cc4-a286beede32e tempest-DeleteServersTestJSON-1002799117 tempest-DeleteServersTestJSON-1002799117-project-member] [instance: 359ff85c-c332-4059-8db4-689a0483d068] Start destroying the instance on the hypervisor. {{(pid=75229) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 09:45:50 user nova-compute[75229]: DEBUG nova.network.neutron [None req-579c9294-7beb-4492-a3f5-2947051de716 tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] [instance: 90bd76df-96cb-4bec-9862-853d94cdbaab] Updating instance_info_cache with network_info: [{"id": "3b9b5b2a-5b1b-4ec6-900d-c27e7c4a625e", "address": "fa:16:3e:6e:aa:df", "network": {"id": "589aea41-545f-4875-ab56-b7aa273dad6f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-785276916-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee9447f169de43829fe3ed51592752e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b9b5b2a-5b", "ovs_interfaceid": "3b9b5b2a-5b1b-4ec6-900d-c27e7c4a625e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 09:45:50 user nova-compute[75229]: DEBUG nova.privsep.utils [None req-83ae62a8-d9d3-403b-937d-62f0e38ae89b tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75229) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 14 09:45:50 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-83ae62a8-d9d3-403b-937d-62f0e38ae89b tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpe8gkhlu5/2596411db2804396b98fef9f31155414.delta /opt/stack/data/nova/instances/snapshots/tmpe8gkhlu5/2596411db2804396b98fef9f31155414 {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:45:50 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-579c9294-7beb-4492-a3f5-2947051de716 tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Releasing lock "refresh_cache-90bd76df-96cb-4bec-9862-853d94cdbaab" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 09:45:50 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8623fdcc-99b7-44d6-ad81-dada5ba83a88/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:45:50 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:45:50 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c307660b-01bb-471b-9e2e-5c2aaca65287/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:45:50 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:45:50 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:45:50 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:45:50 user nova-compute[75229]: DEBUG nova.compute.manager [req-224700e2-3980-4be9-a9e3-dd32912a1eb9 req-b89d9107-e915-4cc7-8ecf-b133111da575 service nova] [instance: 359ff85c-c332-4059-8db4-689a0483d068] Received event network-vif-unplugged-a799c237-ea4a-472d-b149-904fabda7414 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:45:50 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-224700e2-3980-4be9-a9e3-dd32912a1eb9 req-b89d9107-e915-4cc7-8ecf-b133111da575 service nova] Acquiring lock "359ff85c-c332-4059-8db4-689a0483d068-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:45:50 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-224700e2-3980-4be9-a9e3-dd32912a1eb9 req-b89d9107-e915-4cc7-8ecf-b133111da575 service nova] Lock "359ff85c-c332-4059-8db4-689a0483d068-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:45:50 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-224700e2-3980-4be9-a9e3-dd32912a1eb9 req-b89d9107-e915-4cc7-8ecf-b133111da575 service nova] Lock "359ff85c-c332-4059-8db4-689a0483d068-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:45:50 user nova-compute[75229]: DEBUG nova.compute.manager [req-224700e2-3980-4be9-a9e3-dd32912a1eb9 req-b89d9107-e915-4cc7-8ecf-b133111da575 service nova] [instance: 359ff85c-c332-4059-8db4-689a0483d068] No waiting events found dispatching network-vif-unplugged-a799c237-ea4a-472d-b149-904fabda7414 {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 09:45:50 user nova-compute[75229]: DEBUG nova.compute.manager [req-224700e2-3980-4be9-a9e3-dd32912a1eb9 req-b89d9107-e915-4cc7-8ecf-b133111da575 service nova] [instance: 359ff85c-c332-4059-8db4-689a0483d068] Received event network-vif-unplugged-a799c237-ea4a-472d-b149-904fabda7414 for instance with task_state deleting. {{(pid=75229) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 09:45:50 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-83ae62a8-d9d3-403b-937d-62f0e38ae89b tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpe8gkhlu5/2596411db2804396b98fef9f31155414.delta /opt/stack/data/nova/instances/snapshots/tmpe8gkhlu5/2596411db2804396b98fef9f31155414" returned: 0 in 0.259s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:45:50 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-83ae62a8-d9d3-403b-937d-62f0e38ae89b tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] [instance: e09b3809-2e23-401c-9a72-88feb2bb657c] Snapshot extracted, beginning image upload
Nov 14 09:45:50 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c307660b-01bb-471b-9e2e-5c2aaca65287/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:45:50 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c307660b-01bb-471b-9e2e-5c2aaca65287/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:45:50 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c307660b-01bb-471b-9e2e-5c2aaca65287/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:45:50 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75229) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 09:45:50 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75229) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 09:45:50 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] skipping disk /dev/sdd (vdc) as it is a volume {{(pid=75229) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 09:45:51 user nova-compute[75229]: DEBUG nova.compute.manager [req-5c4a64f2-2345-4788-b418-dfea3d469557 req-c4cd70b8-6d6b-4430-b8f4-ad1844c7eb84 service nova] [instance: 90bd76df-96cb-4bec-9862-853d94cdbaab] Received event network-changed-3b9b5b2a-5b1b-4ec6-900d-c27e7c4a625e {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:45:51 user nova-compute[75229]: DEBUG nova.compute.manager [req-5c4a64f2-2345-4788-b418-dfea3d469557 req-c4cd70b8-6d6b-4430-b8f4-ad1844c7eb84 service nova] [instance: 90bd76df-96cb-4bec-9862-853d94cdbaab] Refreshing instance network info cache due to event network-changed-3b9b5b2a-5b1b-4ec6-900d-c27e7c4a625e. {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 09:45:51 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-5c4a64f2-2345-4788-b418-dfea3d469557 req-c4cd70b8-6d6b-4430-b8f4-ad1844c7eb84 service nova] Acquiring lock "refresh_cache-90bd76df-96cb-4bec-9862-853d94cdbaab" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 09:45:51 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-5c4a64f2-2345-4788-b418-dfea3d469557 req-c4cd70b8-6d6b-4430-b8f4-ad1844c7eb84 service nova] Acquired lock "refresh_cache-90bd76df-96cb-4bec-9862-853d94cdbaab" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 09:45:51 user nova-compute[75229]: DEBUG nova.network.neutron [req-5c4a64f2-2345-4788-b418-dfea3d469557 req-c4cd70b8-6d6b-4430-b8f4-ad1844c7eb84 service nova] [instance: 90bd76df-96cb-4bec-9862-853d94cdbaab] Refreshing network info cache for port 3b9b5b2a-5b1b-4ec6-900d-c27e7c4a625e {{(pid=75229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 09:45:51 user nova-compute[75229]: WARNING nova.virt.libvirt.driver [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 09:45:51 user nova-compute[75229]: WARNING nova.virt.libvirt.driver [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 09:45:51 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Hypervisor/Node resource view: name=user free_ram=6812MB free_disk=25.542823791503906GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75229) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 09:45:51 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:45:51 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:45:51 user nova-compute[75229]: INFO nova.virt.libvirt.driver [-] [instance: 359ff85c-c332-4059-8db4-689a0483d068] Instance destroyed successfully.
Nov 14 09:45:51 user nova-compute[75229]: DEBUG nova.objects.instance [None req-d95bf7bd-07e2-4ce7-9cc4-a286beede32e tempest-DeleteServersTestJSON-1002799117 tempest-DeleteServersTestJSON-1002799117-project-member] Lazy-loading 'resources' on Instance uuid 359ff85c-c332-4059-8db4-689a0483d068 {{(pid=75229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 09:45:51 user nova-compute[75229]: INFO nova.virt.libvirt.driver [-] [instance: 90bd76df-96cb-4bec-9862-853d94cdbaab] Instance destroyed successfully.
Nov 14 09:45:51 user nova-compute[75229]: DEBUG nova.objects.instance [None req-579c9294-7beb-4492-a3f5-2947051de716 tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Lazy-loading 'resources' on Instance uuid 90bd76df-96cb-4bec-9862-853d94cdbaab {{(pid=75229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 09:45:51 user nova-compute[75229]: DEBUG nova.virt.libvirt.vif [None req-d95bf7bd-07e2-4ce7-9cc4-a286beede32e tempest-DeleteServersTestJSON-1002799117 tempest-DeleteServersTestJSON-1002799117-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T09:43:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1980018315',display_name='tempest-DeleteServersTestJSON-server-1980018315',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1980018315',id=2,image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-14T09:44:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ac677c251f874551947d944c52d1d7b3',ramdisk_id='',reservation_id='r-wbmjkc23',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-DeleteServersTestJSON-1002799117',owner_user_name='tempest-DeleteServersTestJSON-1002799117-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T09:44:12Z,user_data=None,user_id='17e39818cb9344ca80bda511052e08aa',uuid=359ff85c-c332-4059-8db4-689a0483d068,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a799c237-ea4a-472d-b149-904fabda7414", "address": "fa:16:3e:80:1f:b3", "network": {"id": "60446365-aa09-4526-8746-a7069b8083c7", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1696625928-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac677c251f874551947d944c52d1d7b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa799c237-ea", "ovs_interfaceid": "a799c237-ea4a-472d-b149-904fabda7414", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 09:45:51 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-d95bf7bd-07e2-4ce7-9cc4-a286beede32e tempest-DeleteServersTestJSON-1002799117 tempest-DeleteServersTestJSON-1002799117-project-member] Converting VIF {"id": "a799c237-ea4a-472d-b149-904fabda7414", "address": "fa:16:3e:80:1f:b3", "network": {"id": "60446365-aa09-4526-8746-a7069b8083c7", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1696625928-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac677c251f874551947d944c52d1d7b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa799c237-ea", "ovs_interfaceid": "a799c237-ea4a-472d-b149-904fabda7414", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 09:45:51 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-d95bf7bd-07e2-4ce7-9cc4-a286beede32e tempest-DeleteServersTestJSON-1002799117 tempest-DeleteServersTestJSON-1002799117-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:80:1f:b3,bridge_name='br-int',has_traffic_filtering=True,id=a799c237-ea4a-472d-b149-904fabda7414,network=Network(60446365-aa09-4526-8746-a7069b8083c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa799c237-ea') {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 09:45:51 user nova-compute[75229]: DEBUG os_vif [None req-d95bf7bd-07e2-4ce7-9cc4-a286beede32e tempest-DeleteServersTestJSON-1002799117 tempest-DeleteServersTestJSON-1002799117-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:80:1f:b3,bridge_name='br-int',has_traffic_filtering=True,id=a799c237-ea4a-472d-b149-904fabda7414,network=Network(60446365-aa09-4526-8746-a7069b8083c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa799c237-ea') {{(pid=75229) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 09:45:51 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:45:51 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa799c237-ea, bridge=br-int, if_exists=True) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:45:51 user nova-compute[75229]: DEBUG nova.virt.libvirt.vif [None req-579c9294-7beb-4492-a3f5-2947051de716 tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T09:43:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-87180804',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-87180804',id=1,image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBONBC1lBOnKk20p2/o3g2DEYV4S0MmOiqL/3y6SgEGtYnRMtY9LagRV/BjgoGYzS5kUwcO+hOCn5LYUUXOZHlgFkRWsPnsSDpaRCWI7qP5isDTcuxzANHv5hb9uWPGI5Xw==',key_name='tempest-keypair-454270943',keypairs=<?>,launch_index=0,launched_at=2023-11-14T09:44:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='ee9447f169de43829fe3ed51592752e9',ramdisk_id='',reservation_id='r-p5469a2c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-730167895',owner_user_name='tempest-AttachVolumeShelveTestJSON-730167895-project-member',shelved_at='2023-11-14T09:45:49.706176',shelved_host='user',shelved_image_id='55b212ef-adfd-491b-9fbc-0043d02f3866'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T09:45:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='319a0a5ee47a426799d40e0ebb62a3b0',uuid=90bd76df-96cb-4bec-9862-853d94cdbaab,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "3b9b5b2a-5b1b-4ec6-900d-c27e7c4a625e", "address": "fa:16:3e:6e:aa:df", "network": {"id": "589aea41-545f-4875-ab56-b7aa273dad6f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-785276916-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee9447f169de43829fe3ed51592752e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b9b5b2a-5b", "ovs_interfaceid": "3b9b5b2a-5b1b-4ec6-900d-c27e7c4a625e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 09:45:51 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-579c9294-7beb-4492-a3f5-2947051de716 tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Converting VIF {"id": "3b9b5b2a-5b1b-4ec6-900d-c27e7c4a625e", "address": "fa:16:3e:6e:aa:df", "network": {"id": "589aea41-545f-4875-ab56-b7aa273dad6f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-785276916-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee9447f169de43829fe3ed51592752e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b9b5b2a-5b", "ovs_interfaceid": "3b9b5b2a-5b1b-4ec6-900d-c27e7c4a625e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 09:45:51 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-579c9294-7beb-4492-a3f5-2947051de716 tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6e:aa:df,bridge_name='br-int',has_traffic_filtering=True,id=3b9b5b2a-5b1b-4ec6-900d-c27e7c4a625e,network=Network(589aea41-545f-4875-ab56-b7aa273dad6f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b9b5b2a-5b') {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 09:45:51 user nova-compute[75229]: DEBUG os_vif [None req-579c9294-7beb-4492-a3f5-2947051de716 tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6e:aa:df,bridge_name='br-int',has_traffic_filtering=True,id=3b9b5b2a-5b1b-4ec6-900d-c27e7c4a625e,network=Network(589aea41-545f-4875-ab56-b7aa273dad6f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b9b5b2a-5b') {{(pid=75229) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 09:45:51 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:45:51 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 09:45:51 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:45:51 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:45:51 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3b9b5b2a-5b, bridge=br-int, if_exists=True) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:45:51 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:45:51 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:45:51 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:45:51 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=679f95b9-efdd-45a0-ab6f-b1342459c297) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:45:51 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:45:51 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 09:45:51 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:45:51 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=00615bbf-810c-468f-afea-d22001288f24) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:45:51 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:45:51 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:45:51 user nova-compute[75229]: INFO os_vif [None req-d95bf7bd-07e2-4ce7-9cc4-a286beede32e tempest-DeleteServersTestJSON-1002799117 tempest-DeleteServersTestJSON-1002799117-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:80:1f:b3,bridge_name='br-int',has_traffic_filtering=True,id=a799c237-ea4a-472d-b149-904fabda7414,network=Network(60446365-aa09-4526-8746-a7069b8083c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa799c237-ea')
Nov 14 09:45:51 user nova-compute[75229]: INFO os_vif [None req-579c9294-7beb-4492-a3f5-2947051de716 tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6e:aa:df,bridge_name='br-int',has_traffic_filtering=True,id=3b9b5b2a-5b1b-4ec6-900d-c27e7c4a625e,network=Network(589aea41-545f-4875-ab56-b7aa273dad6f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b9b5b2a-5b')
Nov 14 09:45:51 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-579c9294-7beb-4492-a3f5-2947051de716 tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] [instance: 90bd76df-96cb-4bec-9862-853d94cdbaab] Deleting instance files /opt/stack/data/nova/instances/90bd76df-96cb-4bec-9862-853d94cdbaab_del
Nov 14 09:45:51 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-579c9294-7beb-4492-a3f5-2947051de716 tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] [instance: 90bd76df-96cb-4bec-9862-853d94cdbaab] Deletion of /opt/stack/data/nova/instances/90bd76df-96cb-4bec-9862-853d94cdbaab_del complete
Nov 14 09:45:51 user nova-compute[75229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d95bf7bd-07e2-4ce7-9cc4-a286beede32e tempest-DeleteServersTestJSON-1002799117 tempest-DeleteServersTestJSON-1002799117-project-member] [instance: 359ff85c-c332-4059-8db4-689a0483d068] calling os-brick to detach iSCSI Volume {{(pid=75229) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 09:45:51 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-d95bf7bd-07e2-4ce7-9cc4-a286beede32e tempest-DeleteServersTestJSON-1002799117 tempest-DeleteServersTestJSON-1002799117-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f73f85151b0>, {'target_iqn': 'iqn.2010-10.org.openstack:ef4a6d4a-4d11-4a4f-a7cb-1a77ff053145', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QlWfZubj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 09:45:51 user nova-compute[75229]: WARNING os_brick.initiator.connectors.base [None req-d95bf7bd-07e2-4ce7-9cc4-a286beede32e tempest-DeleteServersTestJSON-1002799117 tempest-DeleteServersTestJSON-1002799117-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 09:45:51 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-d95bf7bd-07e2-4ce7-9cc4-a286beede32e tempest-DeleteServersTestJSON-1002799117 tempest-DeleteServersTestJSON-1002799117-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 09:45:51 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-d95bf7bd-07e2-4ce7-9cc4-a286beede32e tempest-DeleteServersTestJSON-1002799117 tempest-DeleteServersTestJSON-1002799117-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 09:45:51 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:45:51 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:45:51 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4d99961-8b65-4ca7-8b7d-b51e08832e7a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c2324d4e-6e60-47fd-b536-144a7ea32dce\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:97f588de-32d5-4d48-9c06-5925263ba117\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:18a1e95e-5df1-4db1-92bc-6cd67729c7a7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ef4a6d4a-4d11-4a4f-a7cb-1a77ff053145\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:45:51 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-d95bf7bd-07e2-4ce7-9cc4-a286beede32e tempest-DeleteServersTestJSON-1002799117 tempest-DeleteServersTestJSON-1002799117-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 09:45:51 user nova-compute[75229]: No targets found.
Nov 14 09:45:51 user nova-compute[75229]: iSNS:
Nov 14 09:45:51 user nova-compute[75229]: No targets found.
Nov 14 09:45:51 user nova-compute[75229]: STATIC:
Nov 14 09:45:51 user nova-compute[75229]: Target: iqn.2010-10.org.openstack:c2324d4e-6e60-47fd-b536-144a7ea32dce
Nov 14 09:45:51 user nova-compute[75229]:         Portal: 172.16.0.220:3260,-1
Nov 14 09:45:51 user nova-compute[75229]:                 Iface Name: default
Nov 14 09:45:51 user nova-compute[75229]: Target: iqn.2010-10.org.openstack:97f588de-32d5-4d48-9c06-5925263ba117
Nov 14 09:45:51 user nova-compute[75229]:         Portal: 172.16.0.220:3260,-1
Nov 14 09:45:51 user nova-compute[75229]:                 Iface Name: default
Nov 14 09:45:51 user nova-compute[75229]: Target: iqn.2010-10.org.openstack:18a1e95e-5df1-4db1-92bc-6cd67729c7a7
Nov 14 09:45:51 user nova-compute[75229]:         Portal: 172.16.0.220:3260,-1
Nov 14 09:45:51 user nova-compute[75229]:                 Iface Name: default
Nov 14 09:45:51 user nova-compute[75229]: Target: iqn.2010-10.org.openstack:ef4a6d4a-4d11-4a4f-a7cb-1a77ff053145
Nov 14 09:45:51 user nova-compute[75229]:         Portal: 172.16.0.220:3260,-1
Nov 14 09:45:51 user nova-compute[75229]:                 Iface Name: default
Nov 14 09:45:51 user nova-compute[75229]: FIRMWARE:
Nov 14 09:45:51 user nova-compute[75229]: No targets found.
Nov 14 09:45:51 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 09:45:51 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-d95bf7bd-07e2-4ce7-9cc4-a286beede32e tempest-DeleteServersTestJSON-1002799117 tempest-DeleteServersTestJSON-1002799117-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 09:45:51 user nova-compute[75229]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 09:45:51 user nova-compute[75229]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75229) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 09:45:51 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-d95bf7bd-07e2-4ce7-9cc4-a286beede32e tempest-DeleteServersTestJSON-1002799117 tempest-DeleteServersTestJSON-1002799117-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ef4a6d4a-4d11-4a4f-a7cb-1a77ff053145', 0)] {{(pid=75229) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 09:45:51 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:45:51 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:45:51 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad89a2bf-ff8d-487b-b989-85228c3a20cd]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:18a1e95e-5df1-4db1-92bc-6cd67729c7a7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:97f588de-32d5-4d48-9c06-5925263ba117\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c2324d4e-6e60-47fd-b536-144a7ea32dce\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ef4a6d4a-4d11-4a4f-a7cb-1a77ff053145\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:45:51 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:45:51 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:45:51 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[961245a0-f1aa-4b64-99ed-d72a3ba6883f]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2324d4e-6e60-47fd-b536-144a7ea32dce (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18a1e95e-5df1-4db1-92bc-6cd67729c7a7 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97f588de-32d5-4d48-9c06-5925263ba117 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef4a6d4a-4d11-4a4f-a7cb-1a77ff053145 (non-flash)\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:45:51 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-d95bf7bd-07e2-4ce7-9cc4-a286beede32e tempest-DeleteServersTestJSON-1002799117 tempest-DeleteServersTestJSON-1002799117-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2324d4e-6e60-47fd-b536-144a7ea32dce (non-flash)
Nov 14 09:45:51 user nova-compute[75229]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18a1e95e-5df1-4db1-92bc-6cd67729c7a7 (non-flash)
Nov 14 09:45:51 user nova-compute[75229]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97f588de-32d5-4d48-9c06-5925263ba117 (non-flash)
Nov 14 09:45:51 user nova-compute[75229]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef4a6d4a-4d11-4a4f-a7cb-1a77ff053145 (non-flash)
Nov 14 09:45:51 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 09:45:51 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-d95bf7bd-07e2-4ce7-9cc4-a286beede32e tempest-DeleteServersTestJSON-1002799117 tempest-DeleteServersTestJSON-1002799117-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2324d4e-6e60-47fd-b536-144a7ea32dce (non-flash)
Nov 14 09:45:51 user nova-compute[75229]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18a1e95e-5df1-4db1-92bc-6cd67729c7a7 (non-flash)
Nov 14 09:45:51 user nova-compute[75229]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97f588de-32d5-4d48-9c06-5925263ba117 (non-flash)
Nov 14 09:45:51 user nova-compute[75229]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef4a6d4a-4d11-4a4f-a7cb-1a77ff053145 (non-flash)
Nov 14 09:45:51 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 09:45:51 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-d95bf7bd-07e2-4ce7-9cc4-a286beede32e tempest-DeleteServersTestJSON-1002799117 tempest-DeleteServersTestJSON-1002799117-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f73f84c1fc0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ef4a6d4a-4d11-4a4f-a7cb-1a77ff053145'): ({'sde'}, set())}) {{(pid=75229) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 09:45:51 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-d95bf7bd-07e2-4ce7-9cc4-a286beede32e tempest-DeleteServersTestJSON-1002799117 tempest-DeleteServersTestJSON-1002799117-project-member] Removing single pathed devices sde {{(pid=75229) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 09:45:51 user nova-compute[75229]: INFO nova.scheduler.client.report [None req-579c9294-7beb-4492-a3f5-2947051de716 tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Deleted allocations for instance 90bd76df-96cb-4bec-9862-853d94cdbaab
Nov 14 09:45:51 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Instance 359ff85c-c332-4059-8db4-689a0483d068 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 09:45:51 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Instance a7750cbc-b3d0-44aa-8b88-c291ba007a8a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 09:45:51 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Instance e09b3809-2e23-401c-9a72-88feb2bb657c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 09:45:51 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Instance a60d339f-e134-477c-8505-bf8c79d2a21c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 09:45:51 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Instance eb53ba25-d865-41ae-90f3-6e154e2778ba actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 09:45:51 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Instance 37e63bd9-44fc-4d07-b31b-570f69d7bc8a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 09:45:51 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Instance c6fa2298-7111-4660-a162-09269045d5e3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 09:45:51 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Instance c307660b-01bb-471b-9e2e-5c2aaca65287 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 09:45:51 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Instance c9d3e03d-be75-44b1-97b4-36c13715175b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 09:45:51 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Instance 8623fdcc-99b7-44d6-ad81-dada5ba83a88 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 09:45:51 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Instance af5fd5af-63a6-4eee-a4ef-6088a3713214 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 09:45:51 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=75229) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 09:45:51 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=75229) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 09:45:51 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:45:51 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:45:51 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b3a47b1-2c4e-43d4-8f08-17240d001c74]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:45:51 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:45:51 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:45:51 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8f8f154-cacc-48dc-90f9-9cc1984a3eb7]: (4, ('ok\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:45:51 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-d95bf7bd-07e2-4ce7-9cc4-a286beede32e tempest-DeleteServersTestJSON-1002799117 tempest-DeleteServersTestJSON-1002799117-project-member] Flushing IO for device /dev/sde {{(pid=75229) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 09:45:51 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:45:51 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.012s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:45:51 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[2145c380-cba1-4a3d-beb4-9e7fda9fa3e7]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:45:51 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-d95bf7bd-07e2-4ce7-9cc4-a286beede32e tempest-DeleteServersTestJSON-1002799117 tempest-DeleteServersTestJSON-1002799117-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75229) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 09:45:51 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:45:51 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-579c9294-7beb-4492-a3f5-2947051de716 tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:45:51 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.036s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:45:51 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a33f9c2-624c-41bf-83b0-adece239fe9c]: (4, ('1', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:45:51 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-d95bf7bd-07e2-4ce7-9cc4-a286beede32e tempest-DeleteServersTestJSON-1002799117 tempest-DeleteServersTestJSON-1002799117-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75229) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 09:45:51 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-d95bf7bd-07e2-4ce7-9cc4-a286beede32e tempest-DeleteServersTestJSON-1002799117 tempest-DeleteServersTestJSON-1002799117-project-member] SCSI volumes sde have been removed. {{(pid=75229) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 09:45:51 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-d95bf7bd-07e2-4ce7-9cc4-a286beede32e tempest-DeleteServersTestJSON-1002799117 tempest-DeleteServersTestJSON-1002799117-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ef4a6d4a-4d11-4a4f-a7cb-1a77ff053145')] {{(pid=75229) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 09:45:51 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef4a6d4a-4d11-4a4f-a7cb-1a77ff053145 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:45:51 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef4a6d4a-4d11-4a4f-a7cb-1a77ff053145 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:45:51 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4cd34dc-b917-4469-b8e4-29cff678b8e5]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:45:51 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-d95bf7bd-07e2-4ce7-9cc4-a286beede32e tempest-DeleteServersTestJSON-1002799117 tempest-DeleteServersTestJSON-1002799117-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:45:51 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef4a6d4a-4d11-4a4f-a7cb-1a77ff053145 -p 172.16.0.220:3260 --logout {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:45:51 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef4a6d4a-4d11-4a4f-a7cb-1a77ff053145 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:45:51 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bbff31b-8f03-4a33-b43e-d3a2a13adfe1]: (4, ('Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:ef4a6d4a-4d11-4a4f-a7cb-1a77ff053145, portal: 172.16.0.220,3260]\nLogout of [sid: 5, target: iqn.2010-10.org.openstack:ef4a6d4a-4d11-4a4f-a7cb-1a77ff053145, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:45:51 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-d95bf7bd-07e2-4ce7-9cc4-a286beede32e tempest-DeleteServersTestJSON-1002799117 tempest-DeleteServersTestJSON-1002799117-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:ef4a6d4a-4d11-4a4f-a7cb-1a77ff053145, portal: 172.16.0.220,3260]
Nov 14 09:45:51 user nova-compute[75229]: Logout of [sid: 5, target: iqn.2010-10.org.openstack:ef4a6d4a-4d11-4a4f-a7cb-1a77ff053145, portal: 172.16.0.220,3260] successful.
Nov 14 09:45:51 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:45:51 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef4a6d4a-4d11-4a4f-a7cb-1a77ff053145 -p 172.16.0.220:3260 --op delete {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:45:51 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef4a6d4a-4d11-4a4f-a7cb-1a77ff053145 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:45:51 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6afea78-a231-4b96-9aeb-2e23a57faa6a]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:45:51 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-d95bf7bd-07e2-4ce7-9cc4-a286beede32e tempest-DeleteServersTestJSON-1002799117 tempest-DeleteServersTestJSON-1002799117-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:45:51 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-d95bf7bd-07e2-4ce7-9cc4-a286beede32e tempest-DeleteServersTestJSON-1002799117 tempest-DeleteServersTestJSON-1002799117-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.320s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 09:45:51 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-d95bf7bd-07e2-4ce7-9cc4-a286beede32e tempest-DeleteServersTestJSON-1002799117 tempest-DeleteServersTestJSON-1002799117-project-member] <== disconnect_volume: return (321ms) None {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 09:45:51 user nova-compute[75229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d95bf7bd-07e2-4ce7-9cc4-a286beede32e tempest-DeleteServersTestJSON-1002799117 tempest-DeleteServersTestJSON-1002799117-project-member] [instance: 359ff85c-c332-4059-8db4-689a0483d068] Disconnected iSCSI Volume {{(pid=75229) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 09:45:51 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-d95bf7bd-07e2-4ce7-9cc4-a286beede32e tempest-DeleteServersTestJSON-1002799117 tempest-DeleteServersTestJSON-1002799117-project-member] [instance: 359ff85c-c332-4059-8db4-689a0483d068] Deleting instance files /opt/stack/data/nova/instances/359ff85c-c332-4059-8db4-689a0483d068_del
Nov 14 09:45:51 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-d95bf7bd-07e2-4ce7-9cc4-a286beede32e tempest-DeleteServersTestJSON-1002799117 tempest-DeleteServersTestJSON-1002799117-project-member] [instance: 359ff85c-c332-4059-8db4-689a0483d068] Deletion of /opt/stack/data/nova/instances/359ff85c-c332-4059-8db4-689a0483d068_del complete
Nov 14 09:45:51 user nova-compute[75229]: DEBUG nova.network.neutron [req-5c4a64f2-2345-4788-b418-dfea3d469557 req-c4cd70b8-6d6b-4430-b8f4-ad1844c7eb84 service nova] [instance: 90bd76df-96cb-4bec-9862-853d94cdbaab] Updated VIF entry in instance network info cache for port 3b9b5b2a-5b1b-4ec6-900d-c27e7c4a625e. {{(pid=75229) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 09:45:51 user nova-compute[75229]: DEBUG nova.network.neutron [req-5c4a64f2-2345-4788-b418-dfea3d469557 req-c4cd70b8-6d6b-4430-b8f4-ad1844c7eb84 service nova] [instance: 90bd76df-96cb-4bec-9862-853d94cdbaab] Updating instance_info_cache with network_info: [{"id": "3b9b5b2a-5b1b-4ec6-900d-c27e7c4a625e", "address": "fa:16:3e:6e:aa:df", "network": {"id": "589aea41-545f-4875-ab56-b7aa273dad6f", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-785276916-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee9447f169de43829fe3ed51592752e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap3b9b5b2a-5b", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 09:45:51 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-5c4a64f2-2345-4788-b418-dfea3d469557 req-c4cd70b8-6d6b-4430-b8f4-ad1844c7eb84 service nova] Releasing lock "refresh_cache-90bd76df-96cb-4bec-9862-853d94cdbaab" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 09:45:51 user nova-compute[75229]: INFO nova.compute.manager [None req-d95bf7bd-07e2-4ce7-9cc4-a286beede32e tempest-DeleteServersTestJSON-1002799117 tempest-DeleteServersTestJSON-1002799117-project-member] [instance: 359ff85c-c332-4059-8db4-689a0483d068] Took 1.59 seconds to destroy the instance on the hypervisor.
Nov 14 09:45:51 user nova-compute[75229]: DEBUG oslo.service.loopingcall [None req-d95bf7bd-07e2-4ce7-9cc4-a286beede32e tempest-DeleteServersTestJSON-1002799117 tempest-DeleteServersTestJSON-1002799117-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75229) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 09:45:51 user nova-compute[75229]: DEBUG nova.compute.manager [-] [instance: 359ff85c-c332-4059-8db4-689a0483d068] Deallocating network for instance {{(pid=75229) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 09:45:51 user nova-compute[75229]: DEBUG nova.network.neutron [-] [instance: 359ff85c-c332-4059-8db4-689a0483d068] deallocate_for_instance() {{(pid=75229) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 09:45:51 user nova-compute[75229]: DEBUG nova.compute.provider_tree [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Inventory has not changed in ProviderTree for provider: d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 {{(pid=75229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 09:45:51 user nova-compute[75229]: DEBUG nova.scheduler.client.report [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Inventory has not changed for provider d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 09:45:52 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Compute_service record updated for user:user {{(pid=75229) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 09:45:52 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.566s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:45:52 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-579c9294-7beb-4492-a3f5-2947051de716 tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.295s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:45:52 user nova-compute[75229]: DEBUG nova.objects.instance [None req-579c9294-7beb-4492-a3f5-2947051de716 tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Lazy-loading 'numa_topology' on Instance uuid 90bd76df-96cb-4bec-9862-853d94cdbaab {{(pid=75229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 09:45:52 user nova-compute[75229]: DEBUG nova.objects.base [None req-579c9294-7beb-4492-a3f5-2947051de716 tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Object Instance<90bd76df-96cb-4bec-9862-853d94cdbaab> lazy-loaded attributes: resources,numa_topology {{(pid=75229) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 09:45:52 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 09:45:52 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 09:45:52 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 09:45:52 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 09:45:52 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 09:45:52 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 09:45:52 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 09:45:52 user nova-compute[75229]: DEBUG nova.compute.manager [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75229) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 09:45:52 user nova-compute[75229]: DEBUG nova.compute.provider_tree [None req-579c9294-7beb-4492-a3f5-2947051de716 tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Inventory has not changed in ProviderTree for provider: d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 {{(pid=75229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 09:45:52 user nova-compute[75229]: DEBUG nova.scheduler.client.report [None req-579c9294-7beb-4492-a3f5-2947051de716 tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Inventory has not changed for provider d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 09:45:52 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-579c9294-7beb-4492-a3f5-2947051de716 tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.342s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:45:52 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-579c9294-7beb-4492-a3f5-2947051de716 tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Lock "90bd76df-96cb-4bec-9862-853d94cdbaab" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 7.674s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:45:52 user nova-compute[75229]: DEBUG nova.network.neutron [-] [instance: 359ff85c-c332-4059-8db4-689a0483d068] Updating instance_info_cache with network_info: [] {{(pid=75229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 09:45:52 user nova-compute[75229]: INFO nova.compute.manager [-] [instance: 359ff85c-c332-4059-8db4-689a0483d068] Took 0.65 seconds to deallocate network for instance.
Nov 14 09:45:52 user nova-compute[75229]: DEBUG nova.compute.manager [req-b1f95a0e-c318-4f21-95b5-6b8b009defa5 req-cf0eff84-af5c-49f8-ae7d-0a0cee3a9f00 service nova] [instance: 359ff85c-c332-4059-8db4-689a0483d068] Received event network-vif-plugged-a799c237-ea4a-472d-b149-904fabda7414 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:45:52 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-b1f95a0e-c318-4f21-95b5-6b8b009defa5 req-cf0eff84-af5c-49f8-ae7d-0a0cee3a9f00 service nova] Acquiring lock "359ff85c-c332-4059-8db4-689a0483d068-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:45:52 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-b1f95a0e-c318-4f21-95b5-6b8b009defa5 req-cf0eff84-af5c-49f8-ae7d-0a0cee3a9f00 service nova] Lock "359ff85c-c332-4059-8db4-689a0483d068-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:45:52 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-b1f95a0e-c318-4f21-95b5-6b8b009defa5 req-cf0eff84-af5c-49f8-ae7d-0a0cee3a9f00 service nova] Lock "359ff85c-c332-4059-8db4-689a0483d068-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:45:52 user nova-compute[75229]: DEBUG nova.compute.manager [req-b1f95a0e-c318-4f21-95b5-6b8b009defa5 req-cf0eff84-af5c-49f8-ae7d-0a0cee3a9f00 service nova] [instance: 359ff85c-c332-4059-8db4-689a0483d068] No waiting events found dispatching network-vif-plugged-a799c237-ea4a-472d-b149-904fabda7414 {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 09:45:52 user nova-compute[75229]: WARNING nova.compute.manager [req-b1f95a0e-c318-4f21-95b5-6b8b009defa5 req-cf0eff84-af5c-49f8-ae7d-0a0cee3a9f00 service nova] [instance: 359ff85c-c332-4059-8db4-689a0483d068] Received unexpected event network-vif-plugged-a799c237-ea4a-472d-b149-904fabda7414 for instance with vm_state active and task_state deleting.
Nov 14 09:45:52 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:45:53 user nova-compute[75229]: DEBUG nova.compute.manager [req-c7bed01b-6d2b-4239-972a-009e25c872f4 req-708ec32b-8ce0-48db-b84a-160c888ffe7a service nova] [instance: 359ff85c-c332-4059-8db4-689a0483d068] Received event network-vif-deleted-a799c237-ea4a-472d-b149-904fabda7414 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:45:53 user nova-compute[75229]: INFO nova.compute.manager [None req-d95bf7bd-07e2-4ce7-9cc4-a286beede32e tempest-DeleteServersTestJSON-1002799117 tempest-DeleteServersTestJSON-1002799117-project-member] [instance: 359ff85c-c332-4059-8db4-689a0483d068] Took 0.77 seconds to detach 1 volumes for instance.
Nov 14 09:45:53 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-83ae62a8-d9d3-403b-937d-62f0e38ae89b tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] [instance: e09b3809-2e23-401c-9a72-88feb2bb657c] Snapshot image upload complete
Nov 14 09:45:53 user nova-compute[75229]: INFO nova.compute.manager [None req-83ae62a8-d9d3-403b-937d-62f0e38ae89b tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] [instance: e09b3809-2e23-401c-9a72-88feb2bb657c] Took 5.58 seconds to snapshot the instance on the hypervisor.
Nov 14 09:45:53 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-d95bf7bd-07e2-4ce7-9cc4-a286beede32e tempest-DeleteServersTestJSON-1002799117 tempest-DeleteServersTestJSON-1002799117-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:45:53 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-d95bf7bd-07e2-4ce7-9cc4-a286beede32e tempest-DeleteServersTestJSON-1002799117 tempest-DeleteServersTestJSON-1002799117-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:45:53 user nova-compute[75229]: DEBUG nova.compute.provider_tree [None req-d95bf7bd-07e2-4ce7-9cc4-a286beede32e tempest-DeleteServersTestJSON-1002799117 tempest-DeleteServersTestJSON-1002799117-project-member] Inventory has not changed in ProviderTree for provider: d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 {{(pid=75229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 09:45:53 user nova-compute[75229]: DEBUG nova.scheduler.client.report [None req-d95bf7bd-07e2-4ce7-9cc4-a286beede32e tempest-DeleteServersTestJSON-1002799117 tempest-DeleteServersTestJSON-1002799117-project-member] Inventory has not changed for provider d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 09:45:53 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-d95bf7bd-07e2-4ce7-9cc4-a286beede32e tempest-DeleteServersTestJSON-1002799117 tempest-DeleteServersTestJSON-1002799117-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.331s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:45:53 user nova-compute[75229]: INFO nova.scheduler.client.report [None req-d95bf7bd-07e2-4ce7-9cc4-a286beede32e tempest-DeleteServersTestJSON-1002799117 tempest-DeleteServersTestJSON-1002799117-project-member] Deleted allocations for instance 359ff85c-c332-4059-8db4-689a0483d068
Nov 14 09:45:53 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-d95bf7bd-07e2-4ce7-9cc4-a286beede32e tempest-DeleteServersTestJSON-1002799117 tempest-DeleteServersTestJSON-1002799117-project-member] Lock "359ff85c-c332-4059-8db4-689a0483d068" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.584s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:45:56 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:45:57 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:45:58 user nova-compute[75229]: DEBUG nova.compute.manager [req-dde2fddc-4254-478c-9926-e1b2e46656a3 req-9a66d460-39dd-4a3e-874d-7f6f4d249e38 service nova] [instance: eb53ba25-d865-41ae-90f3-6e154e2778ba] Received event network-changed-695e538f-be1d-4450-84a0-2a0bb92dd2ac {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:45:58 user nova-compute[75229]: DEBUG nova.compute.manager [req-dde2fddc-4254-478c-9926-e1b2e46656a3 req-9a66d460-39dd-4a3e-874d-7f6f4d249e38 service nova] [instance: eb53ba25-d865-41ae-90f3-6e154e2778ba] Refreshing instance network info cache due to event network-changed-695e538f-be1d-4450-84a0-2a0bb92dd2ac. {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 09:45:58 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-dde2fddc-4254-478c-9926-e1b2e46656a3 req-9a66d460-39dd-4a3e-874d-7f6f4d249e38 service nova] Acquiring lock "refresh_cache-eb53ba25-d865-41ae-90f3-6e154e2778ba" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 09:45:58 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-dde2fddc-4254-478c-9926-e1b2e46656a3 req-9a66d460-39dd-4a3e-874d-7f6f4d249e38 service nova] Acquired lock "refresh_cache-eb53ba25-d865-41ae-90f3-6e154e2778ba" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 09:45:58 user nova-compute[75229]: DEBUG nova.network.neutron [req-dde2fddc-4254-478c-9926-e1b2e46656a3 req-9a66d460-39dd-4a3e-874d-7f6f4d249e38 service nova] [instance: eb53ba25-d865-41ae-90f3-6e154e2778ba] Refreshing network info cache for port 695e538f-be1d-4450-84a0-2a0bb92dd2ac {{(pid=75229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 09:45:58 user nova-compute[75229]: DEBUG nova.network.neutron [req-dde2fddc-4254-478c-9926-e1b2e46656a3 req-9a66d460-39dd-4a3e-874d-7f6f4d249e38 service nova] [instance: eb53ba25-d865-41ae-90f3-6e154e2778ba] Updated VIF entry in instance network info cache for port 695e538f-be1d-4450-84a0-2a0bb92dd2ac. {{(pid=75229) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 09:45:58 user nova-compute[75229]: DEBUG nova.network.neutron [req-dde2fddc-4254-478c-9926-e1b2e46656a3 req-9a66d460-39dd-4a3e-874d-7f6f4d249e38 service nova] [instance: eb53ba25-d865-41ae-90f3-6e154e2778ba] Updating instance_info_cache with network_info: [{"id": "695e538f-be1d-4450-84a0-2a0bb92dd2ac", "address": "fa:16:3e:4e:66:82", "network": {"id": "9ace077c-6658-4348-ac9b-f6be125b4f0f", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1010403250-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.168", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6026f6867f00423283219da921bef367", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap695e538f-be", "ovs_interfaceid": "695e538f-be1d-4450-84a0-2a0bb92dd2ac", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 09:45:58 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-dde2fddc-4254-478c-9926-e1b2e46656a3 req-9a66d460-39dd-4a3e-874d-7f6f4d249e38 service nova] Releasing lock "refresh_cache-eb53ba25-d865-41ae-90f3-6e154e2778ba" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 09:45:59 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-301ccca5-557a-483a-8ba4-5922602417ba tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] Acquiring lock "eb53ba25-d865-41ae-90f3-6e154e2778ba" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:45:59 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-301ccca5-557a-483a-8ba4-5922602417ba tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] Lock "eb53ba25-d865-41ae-90f3-6e154e2778ba" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:45:59 user nova-compute[75229]: DEBUG nova.objects.instance [None req-301ccca5-557a-483a-8ba4-5922602417ba tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] Lazy-loading 'flavor' on Instance uuid eb53ba25-d865-41ae-90f3-6e154e2778ba {{(pid=75229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 09:46:00 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-301ccca5-557a-483a-8ba4-5922602417ba tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] Lock "eb53ba25-d865-41ae-90f3-6e154e2778ba" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.092s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:46:00 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-301ccca5-557a-483a-8ba4-5922602417ba tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] Acquiring lock "eb53ba25-d865-41ae-90f3-6e154e2778ba" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:46:00 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-301ccca5-557a-483a-8ba4-5922602417ba tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] Lock "eb53ba25-d865-41ae-90f3-6e154e2778ba" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:46:00 user nova-compute[75229]: INFO nova.compute.manager [None req-301ccca5-557a-483a-8ba4-5922602417ba tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] [instance: eb53ba25-d865-41ae-90f3-6e154e2778ba] Attaching volume 6d564ec4-7fbb-40b5-9085-41e3720c3a3b to /dev/vdb
Nov 14 09:46:00 user nova-compute[75229]: DEBUG os_brick.utils [None req-301ccca5-557a-483a-8ba4-5922602417ba tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 09:46:00 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:46:00 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:46:00 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb5f91cf-0d4f-48f3-9fdd-efc85dd69116]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f1154031c835\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:46:00 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:46:00 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:46:00 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[107f42bd-67d6-435e-997d-dd764f88df19]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:46:00 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:46:00 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:46:00 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ade9024-cfbe-48e3-a0d7-9a89aeef3e52]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:46:00 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd1277a2-d1cb-4060-a5b8-9a09cdad8dd5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:46:00 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-301ccca5-557a-483a-8ba4-5922602417ba tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] Running cmd (subprocess): nvme version {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:46:00 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-301ccca5-557a-483a-8ba4-5922602417ba tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] 'nvme version' failed. Not Retrying. {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 09:46:00 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.nvmeof [None req-301ccca5-557a-483a-8ba4-5922602417ba tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] nvme not present on system {{(pid=75229) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 09:46:00 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:46:00 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 09:46:00 user nova-compute[75229]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 09:46:00 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[b804d082-5907-4406-b545-ec86d68dd02a]: (4, '') {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:46:00 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.lightos [None req-301ccca5-557a-483a-8ba4-5922602417ba tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75229) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 09:46:00 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.lightos [None req-301ccca5-557a-483a-8ba4-5922602417ba tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75229) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 09:46:00 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.lightos [None req-301ccca5-557a-483a-8ba4-5922602417ba tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] LIGHTOS: no hostnqn found. {{(pid=75229) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 09:46:00 user nova-compute[75229]: DEBUG os_brick.utils [None req-301ccca5-557a-483a-8ba4-5922602417ba tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f1154031c835', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 09:46:00 user nova-compute[75229]: DEBUG nova.virt.block_device [None req-301ccca5-557a-483a-8ba4-5922602417ba tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] [instance: eb53ba25-d865-41ae-90f3-6e154e2778ba] Updating existing volume attachment record: 49a5a735-75c7-4e6f-aaef-11a69c12f5ad {{(pid=75229) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 09:46:01 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:46:02 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:46:03 user nova-compute[75229]: DEBUG nova.compute.manager [req-2ae4ef4a-249d-4ed8-9765-8d066a310da4 req-1912b15c-1597-43b2-ac7d-6932271d12cc service nova] [instance: 37e63bd9-44fc-4d07-b31b-570f69d7bc8a] Received event network-changed-22c0a013-145e-46f8-ab59-f883d51567e6 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:46:03 user nova-compute[75229]: DEBUG nova.compute.manager [req-2ae4ef4a-249d-4ed8-9765-8d066a310da4 req-1912b15c-1597-43b2-ac7d-6932271d12cc service nova] [instance: 37e63bd9-44fc-4d07-b31b-570f69d7bc8a] Refreshing instance network info cache due to event network-changed-22c0a013-145e-46f8-ab59-f883d51567e6. {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 09:46:03 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-2ae4ef4a-249d-4ed8-9765-8d066a310da4 req-1912b15c-1597-43b2-ac7d-6932271d12cc service nova] Acquiring lock "refresh_cache-37e63bd9-44fc-4d07-b31b-570f69d7bc8a" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 09:46:03 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-2ae4ef4a-249d-4ed8-9765-8d066a310da4 req-1912b15c-1597-43b2-ac7d-6932271d12cc service nova] Acquired lock "refresh_cache-37e63bd9-44fc-4d07-b31b-570f69d7bc8a" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 09:46:03 user nova-compute[75229]: DEBUG nova.network.neutron [req-2ae4ef4a-249d-4ed8-9765-8d066a310da4 req-1912b15c-1597-43b2-ac7d-6932271d12cc service nova] [instance: 37e63bd9-44fc-4d07-b31b-570f69d7bc8a] Refreshing network info cache for port 22c0a013-145e-46f8-ab59-f883d51567e6 {{(pid=75229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 09:46:04 user nova-compute[75229]: DEBUG nova.network.neutron [req-2ae4ef4a-249d-4ed8-9765-8d066a310da4 req-1912b15c-1597-43b2-ac7d-6932271d12cc service nova] [instance: 37e63bd9-44fc-4d07-b31b-570f69d7bc8a] Updated VIF entry in instance network info cache for port 22c0a013-145e-46f8-ab59-f883d51567e6. {{(pid=75229) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 09:46:04 user nova-compute[75229]: DEBUG nova.network.neutron [req-2ae4ef4a-249d-4ed8-9765-8d066a310da4 req-1912b15c-1597-43b2-ac7d-6932271d12cc service nova] [instance: 37e63bd9-44fc-4d07-b31b-570f69d7bc8a] Updating instance_info_cache with network_info: [{"id": "22c0a013-145e-46f8-ab59-f883d51567e6", "address": "fa:16:3e:4f:33:04", "network": {"id": "7141cb71-7f74-4de2-93a0-c94b9c8630fd", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1370522646-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.45", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6cef322ee4d4353bf72c6ede953e1bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22c0a013-14", "ovs_interfaceid": "22c0a013-145e-46f8-ab59-f883d51567e6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 09:46:04 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-2ae4ef4a-249d-4ed8-9765-8d066a310da4 req-1912b15c-1597-43b2-ac7d-6932271d12cc service nova] Releasing lock "refresh_cache-37e63bd9-44fc-4d07-b31b-570f69d7bc8a" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 09:46:04 user nova-compute[75229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-301ccca5-557a-483a-8ba4-5922602417ba tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] [instance: eb53ba25-d865-41ae-90f3-6e154e2778ba] Calling os-brick to attach iSCSI Volume {{(pid=75229) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 09:46:04 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-301ccca5-557a-483a-8ba4-5922602417ba tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f73f85151b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6d564ec4-7fbb-40b5-9085-41e3720c3a3b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IWuHSLTF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 09:46:04 user nova-compute[75229]: WARNING os_brick.initiator.connectors.base [None req-301ccca5-557a-483a-8ba4-5922602417ba tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 09:46:04 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-301ccca5-557a-483a-8ba4-5922602417ba tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 09:46:04 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-301ccca5-557a-483a-8ba4-5922602417ba tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 09:46:04 user nova-compute[75229]: WARNING os_brick.initiator.connectors.base [None req-301ccca5-557a-483a-8ba4-5922602417ba tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 09:46:04 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-301ccca5-557a-483a-8ba4-5922602417ba tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6d564ec4-7fbb-40b5-9085-41e3720c3a3b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 09:46:04 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-301ccca5-557a-483a-8ba4-5922602417ba tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6d564ec4-7fbb-40b5-9085-41e3720c3a3b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 09:46:04 user nova-compute[75229]: INFO os_brick.initiator.connectors.iscsi [None req-301ccca5-557a-483a-8ba4-5922602417ba tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 09:46:04 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d564ec4-7fbb-40b5-9085-41e3720c3a3b -p 172.16.0.220:3260 {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:46:04 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d564ec4-7fbb-40b5-9085-41e3720c3a3b -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:46:04 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f4c9708-1344-45f3-a0f2-fbd9d571b8a2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:46:04 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-301ccca5-557a-483a-8ba4-5922602417ba tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 09:46:04 user nova-compute[75229]:  {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:46:04 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d564ec4-7fbb-40b5-9085-41e3720c3a3b -p 172.16.0.220:3260 --interface default --op new {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:46:04 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d564ec4-7fbb-40b5-9085-41e3720c3a3b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:46:04 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f4bc5d8-0427-4c13-90a4-d569212c7a7f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6d564ec4-7fbb-40b5-9085-41e3720c3a3b] added\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:46:04 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-301ccca5-557a-483a-8ba4-5922602417ba tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6d564ec4-7fbb-40b5-9085-41e3720c3a3b] added
Nov 14 09:46:04 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:46:04 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d564ec4-7fbb-40b5-9085-41e3720c3a3b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:46:04 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d564ec4-7fbb-40b5-9085-41e3720c3a3b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:46:04 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[e829ac76-df16-4e3c-8318-dd1716b465d9]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:46:04 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-301ccca5-557a-483a-8ba4-5922602417ba tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:46:04 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d564ec4-7fbb-40b5-9085-41e3720c3a3b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:46:04 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d564ec4-7fbb-40b5-9085-41e3720c3a3b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:46:04 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[187768fc-6d85-4cdc-9b32-d5359d08fc80]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:46:04 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-301ccca5-557a-483a-8ba4-5922602417ba tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:46:04 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d564ec4-7fbb-40b5-9085-41e3720c3a3b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IWuHSLTF {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:46:04 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d564ec4-7fbb-40b5-9085-41e3720c3a3b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IWuHSLTF" returned: 0 in 0.017s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:46:04 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[c57615cf-b4cb-432c-a231-a0ab6e0cbbf1]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:46:04 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-301ccca5-557a-483a-8ba4-5922602417ba tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'IWuHSLTF'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:46:04 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d564ec4-7fbb-40b5-9085-41e3720c3a3b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:46:04 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d564ec4-7fbb-40b5-9085-41e3720c3a3b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:46:04 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[8719f6c2-eb83-4eeb-9f7d-7977542134d9]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:46:04 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-301ccca5-557a-483a-8ba4-5922602417ba tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:46:04 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:46:04 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:46:04 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff6146fe-e38b-4c66-ae95-b3115b2f0300]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2324d4e-6e60-47fd-b536-144a7ea32dce (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18a1e95e-5df1-4db1-92bc-6cd67729c7a7 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97f588de-32d5-4d48-9c06-5925263ba117 (non-flash)\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:46:04 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-301ccca5-557a-483a-8ba4-5922602417ba tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2324d4e-6e60-47fd-b536-144a7ea32dce (non-flash)
Nov 14 09:46:04 user nova-compute[75229]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18a1e95e-5df1-4db1-92bc-6cd67729c7a7 (non-flash)
Nov 14 09:46:04 user nova-compute[75229]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97f588de-32d5-4d48-9c06-5925263ba117 (non-flash)
Nov 14 09:46:04 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 09:46:04 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-301ccca5-557a-483a-8ba4-5922602417ba tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2324d4e-6e60-47fd-b536-144a7ea32dce (non-flash)
Nov 14 09:46:04 user nova-compute[75229]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18a1e95e-5df1-4db1-92bc-6cd67729c7a7 (non-flash)
Nov 14 09:46:04 user nova-compute[75229]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97f588de-32d5-4d48-9c06-5925263ba117 (non-flash)
Nov 14 09:46:04 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 09:46:04 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d564ec4-7fbb-40b5-9085-41e3720c3a3b -p 172.16.0.220:3260 --login {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:46:04 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d564ec4-7fbb-40b5-9085-41e3720c3a3b -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:46:04 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ed5f12e-77d1-47fb-b8ce-3e56f467f338]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6d564ec4-7fbb-40b5-9085-41e3720c3a3b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6d564ec4-7fbb-40b5-9085-41e3720c3a3b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:46:04 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-301ccca5-557a-483a-8ba4-5922602417ba tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6d564ec4-7fbb-40b5-9085-41e3720c3a3b, portal: 172.16.0.220,3260]
Nov 14 09:46:04 user nova-compute[75229]: Login to [iface: default, target: iqn.2010-10.org.openstack:6d564ec4-7fbb-40b5-9085-41e3720c3a3b, portal: 172.16.0.220,3260] successful.
Nov 14 09:46:04 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:46:04 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d564ec4-7fbb-40b5-9085-41e3720c3a3b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:46:04 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d564ec4-7fbb-40b5-9085-41e3720c3a3b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:46:04 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[2702ad89-e4d4-4af4-b00a-79fa9aa7d923]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:46:04 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-301ccca5-557a-483a-8ba4-5922602417ba tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:46:04 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:46:04 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:46:04 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[5168fa83-4c00-451b-a7de-9de2408e13be]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2324d4e-6e60-47fd-b536-144a7ea32dce (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18a1e95e-5df1-4db1-92bc-6cd67729c7a7 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97f588de-32d5-4d48-9c06-5925263ba117 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d564ec4-7fbb-40b5-9085-41e3720c3a3b (non-flash)\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:46:04 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-301ccca5-557a-483a-8ba4-5922602417ba tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2324d4e-6e60-47fd-b536-144a7ea32dce (non-flash)
Nov 14 09:46:04 user nova-compute[75229]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18a1e95e-5df1-4db1-92bc-6cd67729c7a7 (non-flash)
Nov 14 09:46:04 user nova-compute[75229]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97f588de-32d5-4d48-9c06-5925263ba117 (non-flash)
Nov 14 09:46:04 user nova-compute[75229]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d564ec4-7fbb-40b5-9085-41e3720c3a3b (non-flash)
Nov 14 09:46:04 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 09:46:04 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-301ccca5-557a-483a-8ba4-5922602417ba tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2324d4e-6e60-47fd-b536-144a7ea32dce (non-flash)
Nov 14 09:46:04 user nova-compute[75229]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18a1e95e-5df1-4db1-92bc-6cd67729c7a7 (non-flash)
Nov 14 09:46:04 user nova-compute[75229]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97f588de-32d5-4d48-9c06-5925263ba117 (non-flash)
Nov 14 09:46:04 user nova-compute[75229]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d564ec4-7fbb-40b5-9085-41e3720c3a3b (non-flash)
Nov 14 09:46:04 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 09:46:04 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-301ccca5-557a-483a-8ba4-5922602417ba tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6d564ec4-7fbb-40b5-9085-41e3720c3a3b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.263s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 09:46:04 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-301ccca5-557a-483a-8ba4-5922602417ba tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] Connected to 172.16.0.220:3260 {{(pid=75229) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 09:46:04 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-301ccca5-557a-483a-8ba4-5922602417ba tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] HCTL ('36', '-', '-', 0) found on session 6 with lun 0 {{(pid=75229) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 09:46:04 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-301ccca5-557a-483a-8ba4-5922602417ba tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75229) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 09:46:04 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:46:04 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.016s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:46:04 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[27b7346c-2998-48c3-9ebc-39d19c8f68c8]: (4, ('- - 0', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:46:04 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-301ccca5-557a-483a-8ba4-5922602417ba tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] Searching for a device in session 6 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75229) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 09:46:04 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-301ccca5-557a-483a-8ba4-5922602417ba tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:6d564ec4-7fbb-40b5-9085-41e3720c3a3b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IWuHSLTF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75229) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 09:46:05 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-d8abba30-f791-4340-a71b-d8efc620e80f tempest-AttachSCSIVolumeTestJSON-982350058 tempest-AttachSCSIVolumeTestJSON-982350058-project-member] Acquiring lock "37e63bd9-44fc-4d07-b31b-570f69d7bc8a" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:46:05 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-d8abba30-f791-4340-a71b-d8efc620e80f tempest-AttachSCSIVolumeTestJSON-982350058 tempest-AttachSCSIVolumeTestJSON-982350058-project-member] Lock "37e63bd9-44fc-4d07-b31b-570f69d7bc8a" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:46:05 user nova-compute[75229]: DEBUG nova.objects.instance [None req-d8abba30-f791-4340-a71b-d8efc620e80f tempest-AttachSCSIVolumeTestJSON-982350058 tempest-AttachSCSIVolumeTestJSON-982350058-project-member] Lazy-loading 'flavor' on Instance uuid 37e63bd9-44fc-4d07-b31b-570f69d7bc8a {{(pid=75229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 09:46:05 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-d8abba30-f791-4340-a71b-d8efc620e80f tempest-AttachSCSIVolumeTestJSON-982350058 tempest-AttachSCSIVolumeTestJSON-982350058-project-member] Lock "37e63bd9-44fc-4d07-b31b-570f69d7bc8a" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.048s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:46:05 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-d8abba30-f791-4340-a71b-d8efc620e80f tempest-AttachSCSIVolumeTestJSON-982350058 tempest-AttachSCSIVolumeTestJSON-982350058-project-member] Acquiring lock "37e63bd9-44fc-4d07-b31b-570f69d7bc8a" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:46:05 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-d8abba30-f791-4340-a71b-d8efc620e80f tempest-AttachSCSIVolumeTestJSON-982350058 tempest-AttachSCSIVolumeTestJSON-982350058-project-member] Lock "37e63bd9-44fc-4d07-b31b-570f69d7bc8a" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:46:05 user nova-compute[75229]: INFO nova.compute.manager [None req-d8abba30-f791-4340-a71b-d8efc620e80f tempest-AttachSCSIVolumeTestJSON-982350058 tempest-AttachSCSIVolumeTestJSON-982350058-project-member] [instance: 37e63bd9-44fc-4d07-b31b-570f69d7bc8a] Attaching volume 72bed504-5114-4179-b266-7cae18a4f75b to /dev/sdc
Nov 14 09:46:05 user nova-compute[75229]: DEBUG os_brick.utils [None req-d8abba30-f791-4340-a71b-d8efc620e80f tempest-AttachSCSIVolumeTestJSON-982350058 tempest-AttachSCSIVolumeTestJSON-982350058-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 09:46:05 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:46:05 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:46:05 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4c08f64-bd3f-4c35-9af5-26bb78e41234]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f1154031c835\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:46:05 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:46:05 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:46:05 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[26b9ef30-ffec-45b1-a7b8-5e9209193468]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:46:05 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:46:05 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:46:05 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[9307d033-e62c-42d7-aff7-d35c1b1200d3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:46:05 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ac20dd4-b806-4196-a15c-50b3ef2b477e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:46:05 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-d8abba30-f791-4340-a71b-d8efc620e80f tempest-AttachSCSIVolumeTestJSON-982350058 tempest-AttachSCSIVolumeTestJSON-982350058-project-member] Running cmd (subprocess): nvme version {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:46:05 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-d8abba30-f791-4340-a71b-d8efc620e80f tempest-AttachSCSIVolumeTestJSON-982350058 tempest-AttachSCSIVolumeTestJSON-982350058-project-member] 'nvme version' failed. Not Retrying. {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 09:46:05 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d8abba30-f791-4340-a71b-d8efc620e80f tempest-AttachSCSIVolumeTestJSON-982350058 tempest-AttachSCSIVolumeTestJSON-982350058-project-member] nvme not present on system {{(pid=75229) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 09:46:05 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:46:05 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 09:46:05 user nova-compute[75229]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 09:46:05 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a6d65a5-4a97-424f-b979-eaac90af3ac5]: (4, '') {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:46:05 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.lightos [None req-d8abba30-f791-4340-a71b-d8efc620e80f tempest-AttachSCSIVolumeTestJSON-982350058 tempest-AttachSCSIVolumeTestJSON-982350058-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75229) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 09:46:05 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.lightos [None req-d8abba30-f791-4340-a71b-d8efc620e80f tempest-AttachSCSIVolumeTestJSON-982350058 tempest-AttachSCSIVolumeTestJSON-982350058-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75229) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 09:46:05 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.lightos [None req-d8abba30-f791-4340-a71b-d8efc620e80f tempest-AttachSCSIVolumeTestJSON-982350058 tempest-AttachSCSIVolumeTestJSON-982350058-project-member] LIGHTOS: no hostnqn found. {{(pid=75229) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 09:46:05 user nova-compute[75229]: DEBUG os_brick.utils [None req-d8abba30-f791-4340-a71b-d8efc620e80f tempest-AttachSCSIVolumeTestJSON-982350058 tempest-AttachSCSIVolumeTestJSON-982350058-project-member] <== get_connector_properties: return (110ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f1154031c835', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 09:46:05 user nova-compute[75229]: DEBUG nova.virt.block_device [None req-d8abba30-f791-4340-a71b-d8efc620e80f tempest-AttachSCSIVolumeTestJSON-982350058 tempest-AttachSCSIVolumeTestJSON-982350058-project-member] [instance: 37e63bd9-44fc-4d07-b31b-570f69d7bc8a] Updating existing volume attachment record: 1127bad3-fe78-485d-947c-4a6fa0b1ed06 {{(pid=75229) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 09:46:05 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-301ccca5-557a-483a-8ba4-5922602417ba tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.295s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 09:46:05 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-301ccca5-557a-483a-8ba4-5922602417ba tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] <== connect_volume: return (1297ms) {'type': 'block', 'scsi_wwn': '23436613863663332', 'path': '/dev/sde'} {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 09:46:05 user nova-compute[75229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-301ccca5-557a-483a-8ba4-5922602417ba tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] [instance: eb53ba25-d865-41ae-90f3-6e154e2778ba] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23436613863663332', 'path': '/dev/sde'} {{(pid=75229) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 09:46:05 user nova-compute[75229]: DEBUG nova.objects.instance [None req-301ccca5-557a-483a-8ba4-5922602417ba tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] Lazy-loading 'flavor' on Instance uuid eb53ba25-d865-41ae-90f3-6e154e2778ba {{(pid=75229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 09:46:05 user nova-compute[75229]: DEBUG nova.virt.libvirt.guest [None req-301ccca5-557a-483a-8ba4-5922602417ba tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 09:46:05 user nova-compute[75229]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 09:46:05 user nova-compute[75229]:   <source dev="/dev/sde"/>
Nov 14 09:46:05 user nova-compute[75229]:   <target dev="vdb" bus="virtio"/>
Nov 14 09:46:05 user nova-compute[75229]:   <serial>6d564ec4-7fbb-40b5-9085-41e3720c3a3b</serial>
Nov 14 09:46:05 user nova-compute[75229]: </disk>
Nov 14 09:46:05 user nova-compute[75229]:  {{(pid=75229) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 09:46:06 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-301ccca5-557a-483a-8ba4-5922602417ba tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] No BDM found with device name vda, not building metadata. {{(pid=75229) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 09:46:06 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-301ccca5-557a-483a-8ba4-5922602417ba tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75229) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 09:46:06 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-301ccca5-557a-483a-8ba4-5922602417ba tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] No VIF found with MAC fa:16:3e:4e:66:82, not building metadata {{(pid=75229) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 09:46:06 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-301ccca5-557a-483a-8ba4-5922602417ba tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] Lock "eb53ba25-d865-41ae-90f3-6e154e2778ba" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.283s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:46:06 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:46:07 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-4b352d56-a679-405a-b2cf-a9499ba8ad6d tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] Acquiring lock "eb53ba25-d865-41ae-90f3-6e154e2778ba" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:46:07 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-4b352d56-a679-405a-b2cf-a9499ba8ad6d tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] Lock "eb53ba25-d865-41ae-90f3-6e154e2778ba" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:46:07 user nova-compute[75229]: INFO nova.compute.manager [None req-4b352d56-a679-405a-b2cf-a9499ba8ad6d tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] [instance: eb53ba25-d865-41ae-90f3-6e154e2778ba] Detaching volume 6d564ec4-7fbb-40b5-9085-41e3720c3a3b
Nov 14 09:46:07 user nova-compute[75229]: INFO nova.virt.block_device [None req-4b352d56-a679-405a-b2cf-a9499ba8ad6d tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] [instance: eb53ba25-d865-41ae-90f3-6e154e2778ba] Attempting to driver detach volume 6d564ec4-7fbb-40b5-9085-41e3720c3a3b from mountpoint /dev/vdb
Nov 14 09:46:07 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-4b352d56-a679-405a-b2cf-a9499ba8ad6d tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] Attempting to detach device vdb from instance eb53ba25-d865-41ae-90f3-6e154e2778ba from the persistent domain config. {{(pid=75229) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 09:46:07 user nova-compute[75229]: DEBUG nova.virt.libvirt.guest [None req-4b352d56-a679-405a-b2cf-a9499ba8ad6d tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 09:46:07 user nova-compute[75229]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 09:46:07 user nova-compute[75229]:   <source dev="/dev/sde"/>
Nov 14 09:46:07 user nova-compute[75229]:   <target dev="vdb" bus="virtio"/>
Nov 14 09:46:07 user nova-compute[75229]:   <serial>6d564ec4-7fbb-40b5-9085-41e3720c3a3b</serial>
Nov 14 09:46:07 user nova-compute[75229]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 09:46:07 user nova-compute[75229]: </disk>
Nov 14 09:46:07 user nova-compute[75229]:  {{(pid=75229) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 09:46:07 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-4b352d56-a679-405a-b2cf-a9499ba8ad6d tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] Successfully detached device vdb from instance eb53ba25-d865-41ae-90f3-6e154e2778ba from the persistent domain config.
Nov 14 09:46:07 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-4b352d56-a679-405a-b2cf-a9499ba8ad6d tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance eb53ba25-d865-41ae-90f3-6e154e2778ba from the live domain config. {{(pid=75229) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 09:46:07 user nova-compute[75229]: DEBUG nova.virt.libvirt.guest [None req-4b352d56-a679-405a-b2cf-a9499ba8ad6d tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 09:46:07 user nova-compute[75229]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 09:46:07 user nova-compute[75229]:   <source dev="/dev/sde"/>
Nov 14 09:46:07 user nova-compute[75229]:   <target dev="vdb" bus="virtio"/>
Nov 14 09:46:07 user nova-compute[75229]:   <serial>6d564ec4-7fbb-40b5-9085-41e3720c3a3b</serial>
Nov 14 09:46:07 user nova-compute[75229]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 09:46:07 user nova-compute[75229]: </disk>
Nov 14 09:46:07 user nova-compute[75229]:  {{(pid=75229) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 09:46:07 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:46:07 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-4b352d56-a679-405a-b2cf-a9499ba8ad6d tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance eb53ba25-d865-41ae-90f3-6e154e2778ba {{(pid=75229) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 09:46:09 user nova-compute[75229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d8abba30-f791-4340-a71b-d8efc620e80f tempest-AttachSCSIVolumeTestJSON-982350058 tempest-AttachSCSIVolumeTestJSON-982350058-project-member] [instance: 37e63bd9-44fc-4d07-b31b-570f69d7bc8a] Calling os-brick to attach iSCSI Volume {{(pid=75229) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 09:46:09 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8abba30-f791-4340-a71b-d8efc620e80f tempest-AttachSCSIVolumeTestJSON-982350058 tempest-AttachSCSIVolumeTestJSON-982350058-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f73f85151b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:72bed504-5114-4179-b266-7cae18a4f75b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BOkrNpTQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 09:46:09 user nova-compute[75229]: WARNING os_brick.initiator.connectors.base [None req-d8abba30-f791-4340-a71b-d8efc620e80f tempest-AttachSCSIVolumeTestJSON-982350058 tempest-AttachSCSIVolumeTestJSON-982350058-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 09:46:09 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-d8abba30-f791-4340-a71b-d8efc620e80f tempest-AttachSCSIVolumeTestJSON-982350058 tempest-AttachSCSIVolumeTestJSON-982350058-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 09:46:09 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-d8abba30-f791-4340-a71b-d8efc620e80f tempest-AttachSCSIVolumeTestJSON-982350058 tempest-AttachSCSIVolumeTestJSON-982350058-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 09:46:09 user nova-compute[75229]: WARNING os_brick.initiator.connectors.base [None req-d8abba30-f791-4340-a71b-d8efc620e80f tempest-AttachSCSIVolumeTestJSON-982350058 tempest-AttachSCSIVolumeTestJSON-982350058-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 09:46:09 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-d8abba30-f791-4340-a71b-d8efc620e80f tempest-AttachSCSIVolumeTestJSON-982350058 tempest-AttachSCSIVolumeTestJSON-982350058-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:72bed504-5114-4179-b266-7cae18a4f75b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 09:46:09 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-d8abba30-f791-4340-a71b-d8efc620e80f tempest-AttachSCSIVolumeTestJSON-982350058 tempest-AttachSCSIVolumeTestJSON-982350058-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:72bed504-5114-4179-b266-7cae18a4f75b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 09:46:09 user nova-compute[75229]: INFO os_brick.initiator.connectors.iscsi [None req-d8abba30-f791-4340-a71b-d8efc620e80f tempest-AttachSCSIVolumeTestJSON-982350058 tempest-AttachSCSIVolumeTestJSON-982350058-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 09:46:09 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72bed504-5114-4179-b266-7cae18a4f75b -p 172.16.0.220:3260 {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:46:10 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72bed504-5114-4179-b266-7cae18a4f75b -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:46:10 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac1845e7-f7f8-4610-8692-c453c93088ed]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:46:10 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8abba30-f791-4340-a71b-d8efc620e80f tempest-AttachSCSIVolumeTestJSON-982350058 tempest-AttachSCSIVolumeTestJSON-982350058-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 09:46:10 user nova-compute[75229]:  {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:46:10 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72bed504-5114-4179-b266-7cae18a4f75b -p 172.16.0.220:3260 --interface default --op new {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:46:10 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72bed504-5114-4179-b266-7cae18a4f75b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:46:10 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[41ac7968-b238-41ba-853f-56f769429e12]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:72bed504-5114-4179-b266-7cae18a4f75b] added\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:46:10 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8abba30-f791-4340-a71b-d8efc620e80f tempest-AttachSCSIVolumeTestJSON-982350058 tempest-AttachSCSIVolumeTestJSON-982350058-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:72bed504-5114-4179-b266-7cae18a4f75b] added
Nov 14 09:46:10 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:46:10 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72bed504-5114-4179-b266-7cae18a4f75b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:46:10 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72bed504-5114-4179-b266-7cae18a4f75b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:46:10 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6fb2b9a-c74f-4754-a9bf-26335e2c91bf]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:46:10 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8abba30-f791-4340-a71b-d8efc620e80f tempest-AttachSCSIVolumeTestJSON-982350058 tempest-AttachSCSIVolumeTestJSON-982350058-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:46:10 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72bed504-5114-4179-b266-7cae18a4f75b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:46:10 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72bed504-5114-4179-b266-7cae18a4f75b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:46:10 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[996731b0-2f9c-4d0d-b7eb-86eb4370cd06]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:46:10 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8abba30-f791-4340-a71b-d8efc620e80f tempest-AttachSCSIVolumeTestJSON-982350058 tempest-AttachSCSIVolumeTestJSON-982350058-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:46:10 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72bed504-5114-4179-b266-7cae18a4f75b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BOkrNpTQ {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:46:10 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72bed504-5114-4179-b266-7cae18a4f75b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BOkrNpTQ" returned: 0 in 0.017s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:46:10 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c3bc84e-d8e6-456d-b67c-3e8f41381284]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:46:10 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8abba30-f791-4340-a71b-d8efc620e80f tempest-AttachSCSIVolumeTestJSON-982350058 tempest-AttachSCSIVolumeTestJSON-982350058-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BOkrNpTQ'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:46:10 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72bed504-5114-4179-b266-7cae18a4f75b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:46:10 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72bed504-5114-4179-b266-7cae18a4f75b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:46:10 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[768beb01-bd7f-4acf-be34-51fd4fceda6c]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:46:10 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8abba30-f791-4340-a71b-d8efc620e80f tempest-AttachSCSIVolumeTestJSON-982350058 tempest-AttachSCSIVolumeTestJSON-982350058-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:46:10 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:46:10 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:46:10 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b63cbc3-fedb-4973-8f2e-5829e24df4e0]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2324d4e-6e60-47fd-b536-144a7ea32dce (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18a1e95e-5df1-4db1-92bc-6cd67729c7a7 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97f588de-32d5-4d48-9c06-5925263ba117 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d564ec4-7fbb-40b5-9085-41e3720c3a3b (non-flash)\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:46:10 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8abba30-f791-4340-a71b-d8efc620e80f tempest-AttachSCSIVolumeTestJSON-982350058 tempest-AttachSCSIVolumeTestJSON-982350058-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2324d4e-6e60-47fd-b536-144a7ea32dce (non-flash)
Nov 14 09:46:10 user nova-compute[75229]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18a1e95e-5df1-4db1-92bc-6cd67729c7a7 (non-flash)
Nov 14 09:46:10 user nova-compute[75229]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97f588de-32d5-4d48-9c06-5925263ba117 (non-flash)
Nov 14 09:46:10 user nova-compute[75229]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d564ec4-7fbb-40b5-9085-41e3720c3a3b (non-flash)
Nov 14 09:46:10 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 09:46:10 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8abba30-f791-4340-a71b-d8efc620e80f tempest-AttachSCSIVolumeTestJSON-982350058 tempest-AttachSCSIVolumeTestJSON-982350058-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2324d4e-6e60-47fd-b536-144a7ea32dce (non-flash)
Nov 14 09:46:10 user nova-compute[75229]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18a1e95e-5df1-4db1-92bc-6cd67729c7a7 (non-flash)
Nov 14 09:46:10 user nova-compute[75229]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97f588de-32d5-4d48-9c06-5925263ba117 (non-flash)
Nov 14 09:46:10 user nova-compute[75229]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d564ec4-7fbb-40b5-9085-41e3720c3a3b (non-flash)
Nov 14 09:46:10 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 09:46:10 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72bed504-5114-4179-b266-7cae18a4f75b -p 172.16.0.220:3260 --login {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:46:10 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72bed504-5114-4179-b266-7cae18a4f75b -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:46:10 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[eac4c35d-4298-484e-ab34-ecb816fbccfd]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:72bed504-5114-4179-b266-7cae18a4f75b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:72bed504-5114-4179-b266-7cae18a4f75b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:46:10 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8abba30-f791-4340-a71b-d8efc620e80f tempest-AttachSCSIVolumeTestJSON-982350058 tempest-AttachSCSIVolumeTestJSON-982350058-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:72bed504-5114-4179-b266-7cae18a4f75b, portal: 172.16.0.220,3260]
Nov 14 09:46:10 user nova-compute[75229]: Login to [iface: default, target: iqn.2010-10.org.openstack:72bed504-5114-4179-b266-7cae18a4f75b, portal: 172.16.0.220,3260] successful.
Nov 14 09:46:10 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:46:10 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72bed504-5114-4179-b266-7cae18a4f75b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:46:10 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72bed504-5114-4179-b266-7cae18a4f75b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:46:10 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b62a14b-3e3a-4eb2-af5f-f32440319a8a]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:46:10 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8abba30-f791-4340-a71b-d8efc620e80f tempest-AttachSCSIVolumeTestJSON-982350058 tempest-AttachSCSIVolumeTestJSON-982350058-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:46:10 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:46:10 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:46:10 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8ae66f3-a11d-421d-8825-d07f4245b561]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2324d4e-6e60-47fd-b536-144a7ea32dce (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18a1e95e-5df1-4db1-92bc-6cd67729c7a7 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97f588de-32d5-4d48-9c06-5925263ba117 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d564ec4-7fbb-40b5-9085-41e3720c3a3b (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72bed504-5114-4179-b266-7cae18a4f75b (non-flash)\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:46:10 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8abba30-f791-4340-a71b-d8efc620e80f tempest-AttachSCSIVolumeTestJSON-982350058 tempest-AttachSCSIVolumeTestJSON-982350058-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2324d4e-6e60-47fd-b536-144a7ea32dce (non-flash)
Nov 14 09:46:10 user nova-compute[75229]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18a1e95e-5df1-4db1-92bc-6cd67729c7a7 (non-flash)
Nov 14 09:46:10 user nova-compute[75229]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97f588de-32d5-4d48-9c06-5925263ba117 (non-flash)
Nov 14 09:46:10 user nova-compute[75229]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d564ec4-7fbb-40b5-9085-41e3720c3a3b (non-flash)
Nov 14 09:46:10 user nova-compute[75229]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72bed504-5114-4179-b266-7cae18a4f75b (non-flash)
Nov 14 09:46:10 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 09:46:10 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8abba30-f791-4340-a71b-d8efc620e80f tempest-AttachSCSIVolumeTestJSON-982350058 tempest-AttachSCSIVolumeTestJSON-982350058-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2324d4e-6e60-47fd-b536-144a7ea32dce (non-flash)
Nov 14 09:46:10 user nova-compute[75229]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18a1e95e-5df1-4db1-92bc-6cd67729c7a7 (non-flash)
Nov 14 09:46:10 user nova-compute[75229]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97f588de-32d5-4d48-9c06-5925263ba117 (non-flash)
Nov 14 09:46:10 user nova-compute[75229]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d564ec4-7fbb-40b5-9085-41e3720c3a3b (non-flash)
Nov 14 09:46:10 user nova-compute[75229]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72bed504-5114-4179-b266-7cae18a4f75b (non-flash)
Nov 14 09:46:10 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 09:46:10 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-d8abba30-f791-4340-a71b-d8efc620e80f tempest-AttachSCSIVolumeTestJSON-982350058 tempest-AttachSCSIVolumeTestJSON-982350058-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:72bed504-5114-4179-b266-7cae18a4f75b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.267s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 09:46:10 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8abba30-f791-4340-a71b-d8efc620e80f tempest-AttachSCSIVolumeTestJSON-982350058 tempest-AttachSCSIVolumeTestJSON-982350058-project-member] Connected to 172.16.0.220:3260 {{(pid=75229) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 09:46:10 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-d8abba30-f791-4340-a71b-d8efc620e80f tempest-AttachSCSIVolumeTestJSON-982350058 tempest-AttachSCSIVolumeTestJSON-982350058-project-member] HCTL ('37', '-', '-', 0) found on session 7 with lun 0 {{(pid=75229) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 09:46:10 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-d8abba30-f791-4340-a71b-d8efc620e80f tempest-AttachSCSIVolumeTestJSON-982350058 tempest-AttachSCSIVolumeTestJSON-982350058-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75229) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 09:46:10 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:46:10 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.015s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:46:10 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d508bad-f622-4539-b3a6-fe2c2b621ace]: (4, ('- - 0', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:46:10 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-d8abba30-f791-4340-a71b-d8efc620e80f tempest-AttachSCSIVolumeTestJSON-982350058 tempest-AttachSCSIVolumeTestJSON-982350058-project-member] Searching for a device in session 7 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75229) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 09:46:10 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8abba30-f791-4340-a71b-d8efc620e80f tempest-AttachSCSIVolumeTestJSON-982350058 tempest-AttachSCSIVolumeTestJSON-982350058-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:72bed504-5114-4179-b266-7cae18a4f75b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BOkrNpTQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75229) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 09:46:11 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-d8abba30-f791-4340-a71b-d8efc620e80f tempest-AttachSCSIVolumeTestJSON-982350058 tempest-AttachSCSIVolumeTestJSON-982350058-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.299s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 09:46:11 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8abba30-f791-4340-a71b-d8efc620e80f tempest-AttachSCSIVolumeTestJSON-982350058 tempest-AttachSCSIVolumeTestJSON-982350058-project-member] <== connect_volume: return (1300ms) {'type': 'block', 'scsi_wwn': '26437383734396433', 'path': '/dev/sdf'} {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 09:46:11 user nova-compute[75229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d8abba30-f791-4340-a71b-d8efc620e80f tempest-AttachSCSIVolumeTestJSON-982350058 tempest-AttachSCSIVolumeTestJSON-982350058-project-member] [instance: 37e63bd9-44fc-4d07-b31b-570f69d7bc8a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26437383734396433', 'path': '/dev/sdf'} {{(pid=75229) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 09:46:11 user nova-compute[75229]: DEBUG nova.objects.instance [None req-d8abba30-f791-4340-a71b-d8efc620e80f tempest-AttachSCSIVolumeTestJSON-982350058 tempest-AttachSCSIVolumeTestJSON-982350058-project-member] Lazy-loading 'flavor' on Instance uuid 37e63bd9-44fc-4d07-b31b-570f69d7bc8a {{(pid=75229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 09:46:11 user nova-compute[75229]: DEBUG nova.virt.libvirt.guest [None req-d8abba30-f791-4340-a71b-d8efc620e80f tempest-AttachSCSIVolumeTestJSON-982350058 tempest-AttachSCSIVolumeTestJSON-982350058-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 09:46:11 user nova-compute[75229]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 09:46:11 user nova-compute[75229]:   <source dev="/dev/sdf"/>
Nov 14 09:46:11 user nova-compute[75229]:   <target dev="sdc" bus="scsi"/>
Nov 14 09:46:11 user nova-compute[75229]:   <serial>72bed504-5114-4179-b266-7cae18a4f75b</serial>
Nov 14 09:46:11 user nova-compute[75229]:   <address type="drive" controller="0" unit="2"/>
Nov 14 09:46:11 user nova-compute[75229]: </disk>
Nov 14 09:46:11 user nova-compute[75229]:  {{(pid=75229) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 09:46:11 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:46:11 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-d8abba30-f791-4340-a71b-d8efc620e80f tempest-AttachSCSIVolumeTestJSON-982350058 tempest-AttachSCSIVolumeTestJSON-982350058-project-member] No BDM found with device name sda, not building metadata. {{(pid=75229) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 09:46:11 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-d8abba30-f791-4340-a71b-d8efc620e80f tempest-AttachSCSIVolumeTestJSON-982350058 tempest-AttachSCSIVolumeTestJSON-982350058-project-member] No BDM found with device name sdb, not building metadata. {{(pid=75229) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 09:46:11 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-d8abba30-f791-4340-a71b-d8efc620e80f tempest-AttachSCSIVolumeTestJSON-982350058 tempest-AttachSCSIVolumeTestJSON-982350058-project-member] No BDM found with device name sdc, not building metadata. {{(pid=75229) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 09:46:11 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-d8abba30-f791-4340-a71b-d8efc620e80f tempest-AttachSCSIVolumeTestJSON-982350058 tempest-AttachSCSIVolumeTestJSON-982350058-project-member] No VIF found with MAC fa:16:3e:4f:33:04, not building metadata {{(pid=75229) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 09:46:11 user nova-compute[75229]: DEBUG nova.compute.manager [req-a5638b9a-15b3-4c07-9cd9-1aefb5c854f3 req-7b9a23f5-e5c9-4a02-8724-c53ac364fa7b service nova] [instance: c6fa2298-7111-4660-a162-09269045d5e3] Received event network-changed-b310b3f2-f842-4918-8540-f9803e259b31 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:46:11 user nova-compute[75229]: DEBUG nova.compute.manager [req-a5638b9a-15b3-4c07-9cd9-1aefb5c854f3 req-7b9a23f5-e5c9-4a02-8724-c53ac364fa7b service nova] [instance: c6fa2298-7111-4660-a162-09269045d5e3] Refreshing instance network info cache due to event network-changed-b310b3f2-f842-4918-8540-f9803e259b31. {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 09:46:11 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-a5638b9a-15b3-4c07-9cd9-1aefb5c854f3 req-7b9a23f5-e5c9-4a02-8724-c53ac364fa7b service nova] Acquiring lock "refresh_cache-c6fa2298-7111-4660-a162-09269045d5e3" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 09:46:11 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-a5638b9a-15b3-4c07-9cd9-1aefb5c854f3 req-7b9a23f5-e5c9-4a02-8724-c53ac364fa7b service nova] Acquired lock "refresh_cache-c6fa2298-7111-4660-a162-09269045d5e3" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 09:46:11 user nova-compute[75229]: DEBUG nova.network.neutron [req-a5638b9a-15b3-4c07-9cd9-1aefb5c854f3 req-7b9a23f5-e5c9-4a02-8724-c53ac364fa7b service nova] [instance: c6fa2298-7111-4660-a162-09269045d5e3] Refreshing network info cache for port b310b3f2-f842-4918-8540-f9803e259b31 {{(pid=75229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 09:46:11 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-d8abba30-f791-4340-a71b-d8efc620e80f tempest-AttachSCSIVolumeTestJSON-982350058 tempest-AttachSCSIVolumeTestJSON-982350058-project-member] Lock "37e63bd9-44fc-4d07-b31b-570f69d7bc8a" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.419s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:46:12 user nova-compute[75229]: DEBUG nova.network.neutron [req-a5638b9a-15b3-4c07-9cd9-1aefb5c854f3 req-7b9a23f5-e5c9-4a02-8724-c53ac364fa7b service nova] [instance: c6fa2298-7111-4660-a162-09269045d5e3] Updated VIF entry in instance network info cache for port b310b3f2-f842-4918-8540-f9803e259b31. {{(pid=75229) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 09:46:12 user nova-compute[75229]: DEBUG nova.network.neutron [req-a5638b9a-15b3-4c07-9cd9-1aefb5c854f3 req-7b9a23f5-e5c9-4a02-8724-c53ac364fa7b service nova] [instance: c6fa2298-7111-4660-a162-09269045d5e3] Updating instance_info_cache with network_info: [{"id": "b310b3f2-f842-4918-8540-f9803e259b31", "address": "fa:16:3e:90:0c:ec", "network": {"id": "35508221-011f-4deb-81a1-6dfdae3f2375", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-827518066-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.156", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48b5edeee7494b6e94135faaab6afd50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb310b3f2-f8", "ovs_interfaceid": "b310b3f2-f842-4918-8540-f9803e259b31", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 09:46:12 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-a5638b9a-15b3-4c07-9cd9-1aefb5c854f3 req-7b9a23f5-e5c9-4a02-8724-c53ac364fa7b service nova] Releasing lock "refresh_cache-c6fa2298-7111-4660-a162-09269045d5e3" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 09:46:12 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-f7c579b7-b7ce-4b5d-b593-8ee5a5d4f6ba tempest-TaggedAttachmentsTest-294727221 tempest-TaggedAttachmentsTest-294727221-project-member] Acquiring lock "interface-c6fa2298-7111-4660-a162-09269045d5e3-None" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:46:12 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-f7c579b7-b7ce-4b5d-b593-8ee5a5d4f6ba tempest-TaggedAttachmentsTest-294727221 tempest-TaggedAttachmentsTest-294727221-project-member] Lock "interface-c6fa2298-7111-4660-a162-09269045d5e3-None" acquired by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:46:12 user nova-compute[75229]: DEBUG nova.objects.instance [None req-f7c579b7-b7ce-4b5d-b593-8ee5a5d4f6ba tempest-TaggedAttachmentsTest-294727221 tempest-TaggedAttachmentsTest-294727221-project-member] Lazy-loading 'flavor' on Instance uuid c6fa2298-7111-4660-a162-09269045d5e3 {{(pid=75229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 09:46:12 user nova-compute[75229]: DEBUG nova.objects.instance [None req-f7c579b7-b7ce-4b5d-b593-8ee5a5d4f6ba tempest-TaggedAttachmentsTest-294727221 tempest-TaggedAttachmentsTest-294727221-project-member] Lazy-loading 'pci_requests' on Instance uuid c6fa2298-7111-4660-a162-09269045d5e3 {{(pid=75229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 09:46:12 user nova-compute[75229]: DEBUG nova.objects.base [None req-f7c579b7-b7ce-4b5d-b593-8ee5a5d4f6ba tempest-TaggedAttachmentsTest-294727221 tempest-TaggedAttachmentsTest-294727221-project-member] Object Instance<c6fa2298-7111-4660-a162-09269045d5e3> lazy-loaded attributes: flavor,pci_requests {{(pid=75229) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 09:46:12 user nova-compute[75229]: DEBUG nova.network.neutron [None req-f7c579b7-b7ce-4b5d-b593-8ee5a5d4f6ba tempest-TaggedAttachmentsTest-294727221 tempest-TaggedAttachmentsTest-294727221-project-member] [instance: c6fa2298-7111-4660-a162-09269045d5e3] allocate_for_instance() {{(pid=75229) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 09:46:12 user nova-compute[75229]: DEBUG nova.policy [None req-f7c579b7-b7ce-4b5d-b593-8ee5a5d4f6ba tempest-TaggedAttachmentsTest-294727221 tempest-TaggedAttachmentsTest-294727221-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3c818850ce5c41b5b978031cdedfea65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48b5edeee7494b6e94135faaab6afd50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75229) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 09:46:12 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:46:13 user nova-compute[75229]: DEBUG nova.network.neutron [None req-f7c579b7-b7ce-4b5d-b593-8ee5a5d4f6ba tempest-TaggedAttachmentsTest-294727221 tempest-TaggedAttachmentsTest-294727221-project-member] [instance: c6fa2298-7111-4660-a162-09269045d5e3] Successfully created port: 1c95e48f-ad0e-41b2-8638-ddefc9360154 {{(pid=75229) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 09:46:13 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-1a874eb1-bc94-4d89-bceb-f6525a412799 tempest-AttachSCSIVolumeTestJSON-982350058 tempest-AttachSCSIVolumeTestJSON-982350058-project-member] Acquiring lock "37e63bd9-44fc-4d07-b31b-570f69d7bc8a" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:46:13 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-1a874eb1-bc94-4d89-bceb-f6525a412799 tempest-AttachSCSIVolumeTestJSON-982350058 tempest-AttachSCSIVolumeTestJSON-982350058-project-member] Lock "37e63bd9-44fc-4d07-b31b-570f69d7bc8a" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:46:13 user nova-compute[75229]: INFO nova.compute.manager [None req-1a874eb1-bc94-4d89-bceb-f6525a412799 tempest-AttachSCSIVolumeTestJSON-982350058 tempest-AttachSCSIVolumeTestJSON-982350058-project-member] [instance: 37e63bd9-44fc-4d07-b31b-570f69d7bc8a] Detaching volume 72bed504-5114-4179-b266-7cae18a4f75b
Nov 14 09:46:13 user nova-compute[75229]: INFO nova.virt.block_device [None req-1a874eb1-bc94-4d89-bceb-f6525a412799 tempest-AttachSCSIVolumeTestJSON-982350058 tempest-AttachSCSIVolumeTestJSON-982350058-project-member] [instance: 37e63bd9-44fc-4d07-b31b-570f69d7bc8a] Attempting to driver detach volume 72bed504-5114-4179-b266-7cae18a4f75b from mountpoint /dev/sdc
Nov 14 09:46:13 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-1a874eb1-bc94-4d89-bceb-f6525a412799 tempest-AttachSCSIVolumeTestJSON-982350058 tempest-AttachSCSIVolumeTestJSON-982350058-project-member] Attempting to detach device sdc from instance 37e63bd9-44fc-4d07-b31b-570f69d7bc8a from the persistent domain config. {{(pid=75229) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 09:46:13 user nova-compute[75229]: DEBUG nova.virt.libvirt.guest [None req-1a874eb1-bc94-4d89-bceb-f6525a412799 tempest-AttachSCSIVolumeTestJSON-982350058 tempest-AttachSCSIVolumeTestJSON-982350058-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 09:46:13 user nova-compute[75229]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 09:46:13 user nova-compute[75229]:   <source dev="/dev/sdf"/>
Nov 14 09:46:13 user nova-compute[75229]:   <target dev="sdc" bus="scsi"/>
Nov 14 09:46:13 user nova-compute[75229]:   <serial>72bed504-5114-4179-b266-7cae18a4f75b</serial>
Nov 14 09:46:13 user nova-compute[75229]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Nov 14 09:46:13 user nova-compute[75229]: </disk>
Nov 14 09:46:13 user nova-compute[75229]:  {{(pid=75229) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 09:46:13 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-1a874eb1-bc94-4d89-bceb-f6525a412799 tempest-AttachSCSIVolumeTestJSON-982350058 tempest-AttachSCSIVolumeTestJSON-982350058-project-member] Successfully detached device sdc from instance 37e63bd9-44fc-4d07-b31b-570f69d7bc8a from the persistent domain config.
Nov 14 09:46:13 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-1a874eb1-bc94-4d89-bceb-f6525a412799 tempest-AttachSCSIVolumeTestJSON-982350058 tempest-AttachSCSIVolumeTestJSON-982350058-project-member] (1/8): Attempting to detach device sdc with device alias scsi0-0-0-2 from instance 37e63bd9-44fc-4d07-b31b-570f69d7bc8a from the live domain config. {{(pid=75229) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 09:46:13 user nova-compute[75229]: DEBUG nova.virt.libvirt.guest [None req-1a874eb1-bc94-4d89-bceb-f6525a412799 tempest-AttachSCSIVolumeTestJSON-982350058 tempest-AttachSCSIVolumeTestJSON-982350058-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 09:46:13 user nova-compute[75229]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 09:46:13 user nova-compute[75229]:   <source dev="/dev/sdf"/>
Nov 14 09:46:13 user nova-compute[75229]:   <target dev="sdc" bus="scsi"/>
Nov 14 09:46:13 user nova-compute[75229]:   <serial>72bed504-5114-4179-b266-7cae18a4f75b</serial>
Nov 14 09:46:13 user nova-compute[75229]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Nov 14 09:46:13 user nova-compute[75229]: </disk>
Nov 14 09:46:13 user nova-compute[75229]:  {{(pid=75229) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 09:46:13 user nova-compute[75229]: DEBUG nova.network.neutron [None req-f7c579b7-b7ce-4b5d-b593-8ee5a5d4f6ba tempest-TaggedAttachmentsTest-294727221 tempest-TaggedAttachmentsTest-294727221-project-member] [instance: c6fa2298-7111-4660-a162-09269045d5e3] Successfully updated port: 1c95e48f-ad0e-41b2-8638-ddefc9360154 {{(pid=75229) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 09:46:13 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-f7c579b7-b7ce-4b5d-b593-8ee5a5d4f6ba tempest-TaggedAttachmentsTest-294727221 tempest-TaggedAttachmentsTest-294727221-project-member] Acquiring lock "refresh_cache-c6fa2298-7111-4660-a162-09269045d5e3" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 09:46:13 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-f7c579b7-b7ce-4b5d-b593-8ee5a5d4f6ba tempest-TaggedAttachmentsTest-294727221 tempest-TaggedAttachmentsTest-294727221-project-member] Acquired lock "refresh_cache-c6fa2298-7111-4660-a162-09269045d5e3" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 09:46:13 user nova-compute[75229]: DEBUG nova.network.neutron [None req-f7c579b7-b7ce-4b5d-b593-8ee5a5d4f6ba tempest-TaggedAttachmentsTest-294727221 tempest-TaggedAttachmentsTest-294727221-project-member] [instance: c6fa2298-7111-4660-a162-09269045d5e3] Building network info cache for instance {{(pid=75229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 09:46:13 user nova-compute[75229]: DEBUG nova.compute.manager [req-28284b91-24f5-4e2e-bb59-738f7a311da3 req-5b3980af-6814-44db-bbba-4bcd399fd604 service nova] [instance: c6fa2298-7111-4660-a162-09269045d5e3] Received event network-changed-1c95e48f-ad0e-41b2-8638-ddefc9360154 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:46:13 user nova-compute[75229]: DEBUG nova.compute.manager [req-28284b91-24f5-4e2e-bb59-738f7a311da3 req-5b3980af-6814-44db-bbba-4bcd399fd604 service nova] [instance: c6fa2298-7111-4660-a162-09269045d5e3] Refreshing instance network info cache due to event network-changed-1c95e48f-ad0e-41b2-8638-ddefc9360154. {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 09:46:13 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-28284b91-24f5-4e2e-bb59-738f7a311da3 req-5b3980af-6814-44db-bbba-4bcd399fd604 service nova] Acquiring lock "refresh_cache-c6fa2298-7111-4660-a162-09269045d5e3" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 09:46:13 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-1a874eb1-bc94-4d89-bceb-f6525a412799 tempest-AttachSCSIVolumeTestJSON-982350058 tempest-AttachSCSIVolumeTestJSON-982350058-project-member] Start waiting for the detach event from libvirt for device sdc with device alias scsi0-0-0-2 for instance 37e63bd9-44fc-4d07-b31b-570f69d7bc8a {{(pid=75229) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 09:46:14 user nova-compute[75229]: DEBUG nova.network.neutron [None req-f7c579b7-b7ce-4b5d-b593-8ee5a5d4f6ba tempest-TaggedAttachmentsTest-294727221 tempest-TaggedAttachmentsTest-294727221-project-member] [instance: c6fa2298-7111-4660-a162-09269045d5e3] Updating instance_info_cache with network_info: [{"id": "b310b3f2-f842-4918-8540-f9803e259b31", "address": "fa:16:3e:90:0c:ec", "network": {"id": "35508221-011f-4deb-81a1-6dfdae3f2375", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-827518066-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.156", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48b5edeee7494b6e94135faaab6afd50", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb310b3f2-f8", "ovs_interfaceid": "b310b3f2-f842-4918-8540-f9803e259b31", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1c95e48f-ad0e-41b2-8638-ddefc9360154", "address": "fa:16:3e:64:36:66", "network": {"id": "843bda3e-9929-4282-9fa6-ed93ebd7afcd", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1455996506", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.228", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "48b5edeee7494b6e94135faaab6afd50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c95e48f-ad", "ovs_interfaceid": "1c95e48f-ad0e-41b2-8638-ddefc9360154", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 09:46:14 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-f7c579b7-b7ce-4b5d-b593-8ee5a5d4f6ba tempest-TaggedAttachmentsTest-294727221 tempest-TaggedAttachmentsTest-294727221-project-member] Releasing lock "refresh_cache-c6fa2298-7111-4660-a162-09269045d5e3" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 09:46:14 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-28284b91-24f5-4e2e-bb59-738f7a311da3 req-5b3980af-6814-44db-bbba-4bcd399fd604 service nova] Acquired lock "refresh_cache-c6fa2298-7111-4660-a162-09269045d5e3" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 09:46:14 user nova-compute[75229]: DEBUG nova.network.neutron [req-28284b91-24f5-4e2e-bb59-738f7a311da3 req-5b3980af-6814-44db-bbba-4bcd399fd604 service nova] [instance: c6fa2298-7111-4660-a162-09269045d5e3] Refreshing network info cache for port 1c95e48f-ad0e-41b2-8638-ddefc9360154 {{(pid=75229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 09:46:14 user nova-compute[75229]: DEBUG nova.virt.libvirt.vif [None req-f7c579b7-b7ce-4b5d-b593-8ee5a5d4f6ba tempest-TaggedAttachmentsTest-294727221 tempest-TaggedAttachmentsTest-294727221-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T09:44:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-685697079',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-685697079',id=8,image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAifCLOp7slCaJ90vuibP3D+iXI5GZCQPZCKwFW7R+vCvd5TEqQRxmD+LKPc4egtvjclTc91I+Ts0vc0Y63gnivit1SN7n4OIcVVjbAdupwqjax2fqD52aMGKY+5S2775A==',key_name='tempest-keypair-1995790410',keypairs=<?>,launch_index=0,launched_at=2023-11-14T09:44:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='48b5edeee7494b6e94135faaab6afd50',ramdisk_id='',reservation_id='r-xsfhi8mn',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-294727221',owner_user_name='tempest-TaggedAttachmentsTest-294727221-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T09:44:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3c818850ce5c41b5b978031cdedfea65',uuid=c6fa2298-7111-4660-a162-09269045d5e3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1c95e48f-ad0e-41b2-8638-ddefc9360154", "address": "fa:16:3e:64:36:66", "network": {"id": "843bda3e-9929-4282-9fa6-ed93ebd7afcd", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1455996506", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.228", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "48b5edeee7494b6e94135faaab6afd50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c95e48f-ad", "ovs_interfaceid": "1c95e48f-ad0e-41b2-8638-ddefc9360154", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 09:46:14 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-f7c579b7-b7ce-4b5d-b593-8ee5a5d4f6ba tempest-TaggedAttachmentsTest-294727221 tempest-TaggedAttachmentsTest-294727221-project-member] Converting VIF {"id": "1c95e48f-ad0e-41b2-8638-ddefc9360154", "address": "fa:16:3e:64:36:66", "network": {"id": "843bda3e-9929-4282-9fa6-ed93ebd7afcd", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1455996506", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.228", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "48b5edeee7494b6e94135faaab6afd50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c95e48f-ad", "ovs_interfaceid": "1c95e48f-ad0e-41b2-8638-ddefc9360154", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 09:46:14 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-f7c579b7-b7ce-4b5d-b593-8ee5a5d4f6ba tempest-TaggedAttachmentsTest-294727221 tempest-TaggedAttachmentsTest-294727221-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:64:36:66,bridge_name='br-int',has_traffic_filtering=True,id=1c95e48f-ad0e-41b2-8638-ddefc9360154,network=Network(843bda3e-9929-4282-9fa6-ed93ebd7afcd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1c95e48f-ad') {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 09:46:14 user nova-compute[75229]: DEBUG os_vif [None req-f7c579b7-b7ce-4b5d-b593-8ee5a5d4f6ba tempest-TaggedAttachmentsTest-294727221 tempest-TaggedAttachmentsTest-294727221-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:64:36:66,bridge_name='br-int',has_traffic_filtering=True,id=1c95e48f-ad0e-41b2-8638-ddefc9360154,network=Network(843bda3e-9929-4282-9fa6-ed93ebd7afcd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1c95e48f-ad') {{(pid=75229) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 09:46:14 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:46:14 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:46:14 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 09:46:14 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:46:14 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b7bfb718-1cca-5e22-ab5d-5ed53c032996', '_type': 'linux-noop'}}, row=False) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:46:14 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:46:14 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 09:46:14 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:46:14 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1c95e48f-ad, may_exist=True, interface_attrs={}) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:46:14 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1c95e48f-ad, col_values=(('qos', UUID('729c19d4-99d8-49ab-8658-23c9742dbbc5')),), if_exists=True) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:46:14 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1c95e48f-ad, col_values=(('external_ids', {'iface-id': '1c95e48f-ad0e-41b2-8638-ddefc9360154', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:64:36:66', 'vm-uuid': 'c6fa2298-7111-4660-a162-09269045d5e3'}),), if_exists=True) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:46:14 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:46:14 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 09:46:14 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:46:14 user nova-compute[75229]: INFO os_vif [None req-f7c579b7-b7ce-4b5d-b593-8ee5a5d4f6ba tempest-TaggedAttachmentsTest-294727221 tempest-TaggedAttachmentsTest-294727221-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:64:36:66,bridge_name='br-int',has_traffic_filtering=True,id=1c95e48f-ad0e-41b2-8638-ddefc9360154,network=Network(843bda3e-9929-4282-9fa6-ed93ebd7afcd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1c95e48f-ad')
Nov 14 09:46:14 user nova-compute[75229]: DEBUG nova.virt.libvirt.vif [None req-f7c579b7-b7ce-4b5d-b593-8ee5a5d4f6ba tempest-TaggedAttachmentsTest-294727221 tempest-TaggedAttachmentsTest-294727221-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T09:44:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-685697079',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-685697079',id=8,image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAifCLOp7slCaJ90vuibP3D+iXI5GZCQPZCKwFW7R+vCvd5TEqQRxmD+LKPc4egtvjclTc91I+Ts0vc0Y63gnivit1SN7n4OIcVVjbAdupwqjax2fqD52aMGKY+5S2775A==',key_name='tempest-keypair-1995790410',keypairs=<?>,launch_index=0,launched_at=2023-11-14T09:44:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='48b5edeee7494b6e94135faaab6afd50',ramdisk_id='',reservation_id='r-xsfhi8mn',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-294727221',owner_user_name='tempest-TaggedAttachmentsTest-294727221-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T09:44:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3c818850ce5c41b5b978031cdedfea65',uuid=c6fa2298-7111-4660-a162-09269045d5e3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1c95e48f-ad0e-41b2-8638-ddefc9360154", "address": "fa:16:3e:64:36:66", "network": {"id": "843bda3e-9929-4282-9fa6-ed93ebd7afcd", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1455996506", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.228", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "48b5edeee7494b6e94135faaab6afd50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c95e48f-ad", "ovs_interfaceid": "1c95e48f-ad0e-41b2-8638-ddefc9360154", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75229) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 09:46:14 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-f7c579b7-b7ce-4b5d-b593-8ee5a5d4f6ba tempest-TaggedAttachmentsTest-294727221 tempest-TaggedAttachmentsTest-294727221-project-member] Converting VIF {"id": "1c95e48f-ad0e-41b2-8638-ddefc9360154", "address": "fa:16:3e:64:36:66", "network": {"id": "843bda3e-9929-4282-9fa6-ed93ebd7afcd", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1455996506", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.228", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "48b5edeee7494b6e94135faaab6afd50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c95e48f-ad", "ovs_interfaceid": "1c95e48f-ad0e-41b2-8638-ddefc9360154", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 09:46:14 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-f7c579b7-b7ce-4b5d-b593-8ee5a5d4f6ba tempest-TaggedAttachmentsTest-294727221 tempest-TaggedAttachmentsTest-294727221-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:64:36:66,bridge_name='br-int',has_traffic_filtering=True,id=1c95e48f-ad0e-41b2-8638-ddefc9360154,network=Network(843bda3e-9929-4282-9fa6-ed93ebd7afcd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1c95e48f-ad') {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 09:46:14 user nova-compute[75229]: DEBUG nova.virt.libvirt.guest [None req-f7c579b7-b7ce-4b5d-b593-8ee5a5d4f6ba tempest-TaggedAttachmentsTest-294727221 tempest-TaggedAttachmentsTest-294727221-project-member] attach device xml: <interface type="ethernet">
Nov 14 09:46:14 user nova-compute[75229]:   <mac address="fa:16:3e:64:36:66"/>
Nov 14 09:46:14 user nova-compute[75229]:   <model type="virtio"/>
Nov 14 09:46:14 user nova-compute[75229]:   <mtu size="1442"/>
Nov 14 09:46:14 user nova-compute[75229]:   <target dev="tap1c95e48f-ad"/>
Nov 14 09:46:14 user nova-compute[75229]: </interface>
Nov 14 09:46:14 user nova-compute[75229]:  {{(pid=75229) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 09:46:14 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:46:14 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:46:14 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:46:14 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-f7c579b7-b7ce-4b5d-b593-8ee5a5d4f6ba tempest-TaggedAttachmentsTest-294727221 tempest-TaggedAttachmentsTest-294727221-project-member] No BDM found with device name vda, not building metadata. {{(pid=75229) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 09:46:14 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-f7c579b7-b7ce-4b5d-b593-8ee5a5d4f6ba tempest-TaggedAttachmentsTest-294727221 tempest-TaggedAttachmentsTest-294727221-project-member] No BDM found with device name hda, not building metadata. {{(pid=75229) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 09:46:14 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-f7c579b7-b7ce-4b5d-b593-8ee5a5d4f6ba tempest-TaggedAttachmentsTest-294727221 tempest-TaggedAttachmentsTest-294727221-project-member] No VIF found with MAC fa:16:3e:90:0c:ec, not building metadata {{(pid=75229) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 09:46:15 user nova-compute[75229]: DEBUG nova.virt.libvirt.guest [None req-f7c579b7-b7ce-4b5d-b593-8ee5a5d4f6ba tempest-TaggedAttachmentsTest-294727221 tempest-TaggedAttachmentsTest-294727221-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 09:46:15 user nova-compute[75229]:   <nova:package version="0.0.0"/>
Nov 14 09:46:15 user nova-compute[75229]:   <nova:name>tempest-device-tagging-server-685697079</nova:name>
Nov 14 09:46:15 user nova-compute[75229]:   <nova:creationTime>2023-11-14 09:46:15</nova:creationTime>
Nov 14 09:46:15 user nova-compute[75229]:   <nova:flavor name="m1.tiny">
Nov 14 09:46:15 user nova-compute[75229]:     <nova:memory>512</nova:memory>
Nov 14 09:46:15 user nova-compute[75229]:     <nova:disk>1</nova:disk>
Nov 14 09:46:15 user nova-compute[75229]:     <nova:swap>0</nova:swap>
Nov 14 09:46:15 user nova-compute[75229]:     <nova:ephemeral>0</nova:ephemeral>
Nov 14 09:46:15 user nova-compute[75229]:     <nova:vcpus>1</nova:vcpus>
Nov 14 09:46:15 user nova-compute[75229]:   </nova:flavor>
Nov 14 09:46:15 user nova-compute[75229]:   <nova:owner>
Nov 14 09:46:15 user nova-compute[75229]:     <nova:user uuid="3c818850ce5c41b5b978031cdedfea65">tempest-TaggedAttachmentsTest-294727221-project-member</nova:user>
Nov 14 09:46:15 user nova-compute[75229]:     <nova:project uuid="48b5edeee7494b6e94135faaab6afd50">tempest-TaggedAttachmentsTest-294727221</nova:project>
Nov 14 09:46:15 user nova-compute[75229]:   </nova:owner>
Nov 14 09:46:15 user nova-compute[75229]:   <nova:root type="image" uuid="3bef8470-ecc7-40e3-95d4-9254348ea72d"/>
Nov 14 09:46:15 user nova-compute[75229]:   <nova:ports>
Nov 14 09:46:15 user nova-compute[75229]:     <nova:port uuid="b310b3f2-f842-4918-8540-f9803e259b31">
Nov 14 09:46:15 user nova-compute[75229]:       <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 14 09:46:15 user nova-compute[75229]:     </nova:port>
Nov 14 09:46:15 user nova-compute[75229]:     <nova:port uuid="1c95e48f-ad0e-41b2-8638-ddefc9360154">
Nov 14 09:46:15 user nova-compute[75229]:       <nova:ip type="fixed" address="10.10.10.228" ipVersion="4"/>
Nov 14 09:46:15 user nova-compute[75229]:     </nova:port>
Nov 14 09:46:15 user nova-compute[75229]:   </nova:ports>
Nov 14 09:46:15 user nova-compute[75229]: </nova:instance>
Nov 14 09:46:15 user nova-compute[75229]:  {{(pid=75229) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 14 09:46:15 user nova-compute[75229]: DEBUG nova.network.neutron [req-28284b91-24f5-4e2e-bb59-738f7a311da3 req-5b3980af-6814-44db-bbba-4bcd399fd604 service nova] [instance: c6fa2298-7111-4660-a162-09269045d5e3] Updated VIF entry in instance network info cache for port 1c95e48f-ad0e-41b2-8638-ddefc9360154. {{(pid=75229) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 09:46:15 user nova-compute[75229]: DEBUG nova.network.neutron [req-28284b91-24f5-4e2e-bb59-738f7a311da3 req-5b3980af-6814-44db-bbba-4bcd399fd604 service nova] [instance: c6fa2298-7111-4660-a162-09269045d5e3] Updating instance_info_cache with network_info: [{"id": "b310b3f2-f842-4918-8540-f9803e259b31", "address": "fa:16:3e:90:0c:ec", "network": {"id": "35508221-011f-4deb-81a1-6dfdae3f2375", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-827518066-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.156", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48b5edeee7494b6e94135faaab6afd50", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb310b3f2-f8", "ovs_interfaceid": "b310b3f2-f842-4918-8540-f9803e259b31", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1c95e48f-ad0e-41b2-8638-ddefc9360154", "address": "fa:16:3e:64:36:66", "network": {"id": "843bda3e-9929-4282-9fa6-ed93ebd7afcd", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1455996506", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.228", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "48b5edeee7494b6e94135faaab6afd50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c95e48f-ad", "ovs_interfaceid": "1c95e48f-ad0e-41b2-8638-ddefc9360154", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 09:46:15 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-28284b91-24f5-4e2e-bb59-738f7a311da3 req-5b3980af-6814-44db-bbba-4bcd399fd604 service nova] Releasing lock "refresh_cache-c6fa2298-7111-4660-a162-09269045d5e3" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 09:46:15 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-f7c579b7-b7ce-4b5d-b593-8ee5a5d4f6ba tempest-TaggedAttachmentsTest-294727221 tempest-TaggedAttachmentsTest-294727221-project-member] Lock "interface-c6fa2298-7111-4660-a162-09269045d5e3-None" "released" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: held 2.828s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:46:15 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:46:15 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:46:15 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:46:15 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-15c836a5-c427-4282-8fdb-434e2a122820 tempest-TaggedAttachmentsTest-294727221 tempest-TaggedAttachmentsTest-294727221-project-member] Acquiring lock "c6fa2298-7111-4660-a162-09269045d5e3" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:46:15 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-15c836a5-c427-4282-8fdb-434e2a122820 tempest-TaggedAttachmentsTest-294727221 tempest-TaggedAttachmentsTest-294727221-project-member] Lock "c6fa2298-7111-4660-a162-09269045d5e3" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:46:15 user nova-compute[75229]: DEBUG nova.objects.instance [None req-15c836a5-c427-4282-8fdb-434e2a122820 tempest-TaggedAttachmentsTest-294727221 tempest-TaggedAttachmentsTest-294727221-project-member] Lazy-loading 'flavor' on Instance uuid c6fa2298-7111-4660-a162-09269045d5e3 {{(pid=75229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 09:46:15 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-15c836a5-c427-4282-8fdb-434e2a122820 tempest-TaggedAttachmentsTest-294727221 tempest-TaggedAttachmentsTest-294727221-project-member] Lock "c6fa2298-7111-4660-a162-09269045d5e3" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:46:15 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-15c836a5-c427-4282-8fdb-434e2a122820 tempest-TaggedAttachmentsTest-294727221 tempest-TaggedAttachmentsTest-294727221-project-member] Acquiring lock "c6fa2298-7111-4660-a162-09269045d5e3" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:46:15 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-15c836a5-c427-4282-8fdb-434e2a122820 tempest-TaggedAttachmentsTest-294727221 tempest-TaggedAttachmentsTest-294727221-project-member] Lock "c6fa2298-7111-4660-a162-09269045d5e3" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:46:15 user nova-compute[75229]: INFO nova.compute.manager [None req-15c836a5-c427-4282-8fdb-434e2a122820 tempest-TaggedAttachmentsTest-294727221 tempest-TaggedAttachmentsTest-294727221-project-member] [instance: c6fa2298-7111-4660-a162-09269045d5e3] Attaching volume 7144f229-1f5e-4155-aba1-ab44218df41a to /dev/vdb
Nov 14 09:46:15 user nova-compute[75229]: DEBUG os_brick.utils [None req-15c836a5-c427-4282-8fdb-434e2a122820 tempest-TaggedAttachmentsTest-294727221 tempest-TaggedAttachmentsTest-294727221-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 09:46:15 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:46:15 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:46:15 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[825269e2-07f6-48e6-9cfd-fcd9021a50d9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f1154031c835\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:46:15 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:46:15 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:46:15 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[44dcd749-84c7-4e02-b5be-f89f60842f54]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:46:15 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:46:15 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:46:15 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[22dbc3db-42b6-4fa7-ac13-7e029daa78b1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:46:15 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[31738e73-7c52-4ec1-b02e-0089911a9d66]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:46:15 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-15c836a5-c427-4282-8fdb-434e2a122820 tempest-TaggedAttachmentsTest-294727221 tempest-TaggedAttachmentsTest-294727221-project-member] Running cmd (subprocess): nvme version {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:46:15 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-15c836a5-c427-4282-8fdb-434e2a122820 tempest-TaggedAttachmentsTest-294727221 tempest-TaggedAttachmentsTest-294727221-project-member] 'nvme version' failed. Not Retrying. {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 09:46:15 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.nvmeof [None req-15c836a5-c427-4282-8fdb-434e2a122820 tempest-TaggedAttachmentsTest-294727221 tempest-TaggedAttachmentsTest-294727221-project-member] nvme not present on system {{(pid=75229) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 09:46:15 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:46:15 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 09:46:15 user nova-compute[75229]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 09:46:15 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e1800af-9e0b-40a8-a3d2-bea390d3f143]: (4, '') {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:46:15 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.lightos [None req-15c836a5-c427-4282-8fdb-434e2a122820 tempest-TaggedAttachmentsTest-294727221 tempest-TaggedAttachmentsTest-294727221-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75229) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 09:46:15 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.lightos [None req-15c836a5-c427-4282-8fdb-434e2a122820 tempest-TaggedAttachmentsTest-294727221 tempest-TaggedAttachmentsTest-294727221-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75229) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 09:46:15 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.lightos [None req-15c836a5-c427-4282-8fdb-434e2a122820 tempest-TaggedAttachmentsTest-294727221 tempest-TaggedAttachmentsTest-294727221-project-member] LIGHTOS: no hostnqn found. {{(pid=75229) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 09:46:15 user nova-compute[75229]: DEBUG os_brick.utils [None req-15c836a5-c427-4282-8fdb-434e2a122820 tempest-TaggedAttachmentsTest-294727221 tempest-TaggedAttachmentsTest-294727221-project-member] <== get_connector_properties: return (113ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f1154031c835', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 09:46:15 user nova-compute[75229]: DEBUG nova.virt.block_device [None req-15c836a5-c427-4282-8fdb-434e2a122820 tempest-TaggedAttachmentsTest-294727221 tempest-TaggedAttachmentsTest-294727221-project-member] [instance: c6fa2298-7111-4660-a162-09269045d5e3] Updating existing volume attachment record: 7e071aca-dfb7-45f4-912f-3047dd4e86d3 {{(pid=75229) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 09:46:15 user nova-compute[75229]: DEBUG nova.compute.manager [req-39daed63-5489-4b8c-9554-7a541aba172e req-64fc6e05-7a94-4246-8882-3b9e89d7df10 service nova] [instance: c6fa2298-7111-4660-a162-09269045d5e3] Received event network-vif-plugged-1c95e48f-ad0e-41b2-8638-ddefc9360154 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:46:15 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-39daed63-5489-4b8c-9554-7a541aba172e req-64fc6e05-7a94-4246-8882-3b9e89d7df10 service nova] Acquiring lock "c6fa2298-7111-4660-a162-09269045d5e3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:46:15 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-39daed63-5489-4b8c-9554-7a541aba172e req-64fc6e05-7a94-4246-8882-3b9e89d7df10 service nova] Lock "c6fa2298-7111-4660-a162-09269045d5e3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:46:15 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-39daed63-5489-4b8c-9554-7a541aba172e req-64fc6e05-7a94-4246-8882-3b9e89d7df10 service nova] Lock "c6fa2298-7111-4660-a162-09269045d5e3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:46:15 user nova-compute[75229]: DEBUG nova.compute.manager [req-39daed63-5489-4b8c-9554-7a541aba172e req-64fc6e05-7a94-4246-8882-3b9e89d7df10 service nova] [instance: c6fa2298-7111-4660-a162-09269045d5e3] No waiting events found dispatching network-vif-plugged-1c95e48f-ad0e-41b2-8638-ddefc9360154 {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 09:46:15 user nova-compute[75229]: WARNING nova.compute.manager [req-39daed63-5489-4b8c-9554-7a541aba172e req-64fc6e05-7a94-4246-8882-3b9e89d7df10 service nova] [instance: c6fa2298-7111-4660-a162-09269045d5e3] Received unexpected event network-vif-plugged-1c95e48f-ad0e-41b2-8638-ddefc9360154 for instance with vm_state active and task_state None.
Nov 14 09:46:15 user nova-compute[75229]: DEBUG nova.compute.manager [req-39daed63-5489-4b8c-9554-7a541aba172e req-64fc6e05-7a94-4246-8882-3b9e89d7df10 service nova] [instance: c6fa2298-7111-4660-a162-09269045d5e3] Received event network-vif-plugged-1c95e48f-ad0e-41b2-8638-ddefc9360154 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:46:15 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-39daed63-5489-4b8c-9554-7a541aba172e req-64fc6e05-7a94-4246-8882-3b9e89d7df10 service nova] Acquiring lock "c6fa2298-7111-4660-a162-09269045d5e3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:46:15 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-39daed63-5489-4b8c-9554-7a541aba172e req-64fc6e05-7a94-4246-8882-3b9e89d7df10 service nova] Lock "c6fa2298-7111-4660-a162-09269045d5e3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:46:15 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-39daed63-5489-4b8c-9554-7a541aba172e req-64fc6e05-7a94-4246-8882-3b9e89d7df10 service nova] Lock "c6fa2298-7111-4660-a162-09269045d5e3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:46:15 user nova-compute[75229]: DEBUG nova.compute.manager [req-39daed63-5489-4b8c-9554-7a541aba172e req-64fc6e05-7a94-4246-8882-3b9e89d7df10 service nova] [instance: c6fa2298-7111-4660-a162-09269045d5e3] No waiting events found dispatching network-vif-plugged-1c95e48f-ad0e-41b2-8638-ddefc9360154 {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 09:46:15 user nova-compute[75229]: WARNING nova.compute.manager [req-39daed63-5489-4b8c-9554-7a541aba172e req-64fc6e05-7a94-4246-8882-3b9e89d7df10 service nova] [instance: c6fa2298-7111-4660-a162-09269045d5e3] Received unexpected event network-vif-plugged-1c95e48f-ad0e-41b2-8638-ddefc9360154 for instance with vm_state active and task_state None.
Nov 14 09:46:16 user nova-compute[75229]: DEBUG nova.compute.manager [req-baba0f74-4185-47c7-b774-57771b63dacc req-164a1212-2464-42b4-a8c6-62b0cb0b2457 service nova] [instance: c307660b-01bb-471b-9e2e-5c2aaca65287] Received event network-changed-8e8a8e12-6ca8-4657-a4d4-e11c02ee8fa4 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:46:16 user nova-compute[75229]: DEBUG nova.compute.manager [req-baba0f74-4185-47c7-b774-57771b63dacc req-164a1212-2464-42b4-a8c6-62b0cb0b2457 service nova] [instance: c307660b-01bb-471b-9e2e-5c2aaca65287] Refreshing instance network info cache due to event network-changed-8e8a8e12-6ca8-4657-a4d4-e11c02ee8fa4. {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 09:46:16 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-baba0f74-4185-47c7-b774-57771b63dacc req-164a1212-2464-42b4-a8c6-62b0cb0b2457 service nova] Acquiring lock "refresh_cache-c307660b-01bb-471b-9e2e-5c2aaca65287" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 09:46:16 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-baba0f74-4185-47c7-b774-57771b63dacc req-164a1212-2464-42b4-a8c6-62b0cb0b2457 service nova] Acquired lock "refresh_cache-c307660b-01bb-471b-9e2e-5c2aaca65287" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 09:46:16 user nova-compute[75229]: DEBUG nova.network.neutron [req-baba0f74-4185-47c7-b774-57771b63dacc req-164a1212-2464-42b4-a8c6-62b0cb0b2457 service nova] [instance: c307660b-01bb-471b-9e2e-5c2aaca65287] Refreshing network info cache for port 8e8a8e12-6ca8-4657-a4d4-e11c02ee8fa4 {{(pid=75229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 09:46:16 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-95b98aa9-d8e4-4891-9faf-e13fe82deae7 tempest-TestVolumeSwap-528292061 tempest-TestVolumeSwap-528292061-project-member] Acquiring lock "c307660b-01bb-471b-9e2e-5c2aaca65287" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:46:16 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-95b98aa9-d8e4-4891-9faf-e13fe82deae7 tempest-TestVolumeSwap-528292061 tempest-TestVolumeSwap-528292061-project-member] Lock "c307660b-01bb-471b-9e2e-5c2aaca65287" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:46:16 user nova-compute[75229]: DEBUG nova.objects.instance [None req-95b98aa9-d8e4-4891-9faf-e13fe82deae7 tempest-TestVolumeSwap-528292061 tempest-TestVolumeSwap-528292061-project-member] Lazy-loading 'flavor' on Instance uuid c307660b-01bb-471b-9e2e-5c2aaca65287 {{(pid=75229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 09:46:16 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-95b98aa9-d8e4-4891-9faf-e13fe82deae7 tempest-TestVolumeSwap-528292061 tempest-TestVolumeSwap-528292061-project-member] Lock "c307660b-01bb-471b-9e2e-5c2aaca65287" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:46:16 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-95b98aa9-d8e4-4891-9faf-e13fe82deae7 tempest-TestVolumeSwap-528292061 tempest-TestVolumeSwap-528292061-project-member] Acquiring lock "c307660b-01bb-471b-9e2e-5c2aaca65287" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:46:16 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-95b98aa9-d8e4-4891-9faf-e13fe82deae7 tempest-TestVolumeSwap-528292061 tempest-TestVolumeSwap-528292061-project-member] Lock "c307660b-01bb-471b-9e2e-5c2aaca65287" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:46:16 user nova-compute[75229]: INFO nova.compute.manager [None req-95b98aa9-d8e4-4891-9faf-e13fe82deae7 tempest-TestVolumeSwap-528292061 tempest-TestVolumeSwap-528292061-project-member] [instance: c307660b-01bb-471b-9e2e-5c2aaca65287] Attaching volume 52ae1fea-5339-4958-88ae-d103080e7743 to /dev/vdb
Nov 14 09:46:16 user nova-compute[75229]: DEBUG os_brick.utils [None req-95b98aa9-d8e4-4891-9faf-e13fe82deae7 tempest-TestVolumeSwap-528292061 tempest-TestVolumeSwap-528292061-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 09:46:16 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:46:16 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:46:16 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8b23659-2f45-4e97-8b59-f379b84c4ebb]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f1154031c835\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:46:17 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:46:17 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:46:17 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb02f2e9-25b4-46a7-814e-a4abcb050c07]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:46:17 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:46:17 user nova-compute[75229]: DEBUG nova.network.neutron [req-baba0f74-4185-47c7-b774-57771b63dacc req-164a1212-2464-42b4-a8c6-62b0cb0b2457 service nova] [instance: c307660b-01bb-471b-9e2e-5c2aaca65287] Updated VIF entry in instance network info cache for port 8e8a8e12-6ca8-4657-a4d4-e11c02ee8fa4. {{(pid=75229) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 09:46:17 user nova-compute[75229]: DEBUG nova.network.neutron [req-baba0f74-4185-47c7-b774-57771b63dacc req-164a1212-2464-42b4-a8c6-62b0cb0b2457 service nova] [instance: c307660b-01bb-471b-9e2e-5c2aaca65287] Updating instance_info_cache with network_info: [{"id": "8e8a8e12-6ca8-4657-a4d4-e11c02ee8fa4", "address": "fa:16:3e:db:5c:48", "network": {"id": "57a65455-9929-439e-85a0-07a7a36dbd60", "bridge": "br-int", "label": "tempest-TestVolumeSwap-718745600-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.55", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f5ecf574b4a4b8bb0747c796c16e3e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e8a8e12-6c", "ovs_interfaceid": "8e8a8e12-6ca8-4657-a4d4-e11c02ee8fa4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 09:46:17 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:46:17 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0203a43-8164-46d2-b2e2-1558939b991e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:46:17 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[95d951ca-7ed9-45b9-bd90-7a992d99f42e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:46:17 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-95b98aa9-d8e4-4891-9faf-e13fe82deae7 tempest-TestVolumeSwap-528292061 tempest-TestVolumeSwap-528292061-project-member] Running cmd (subprocess): nvme version {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:46:17 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-95b98aa9-d8e4-4891-9faf-e13fe82deae7 tempest-TestVolumeSwap-528292061 tempest-TestVolumeSwap-528292061-project-member] 'nvme version' failed. Not Retrying. {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 09:46:17 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.nvmeof [None req-95b98aa9-d8e4-4891-9faf-e13fe82deae7 tempest-TestVolumeSwap-528292061 tempest-TestVolumeSwap-528292061-project-member] nvme not present on system {{(pid=75229) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 09:46:17 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-baba0f74-4185-47c7-b774-57771b63dacc req-164a1212-2464-42b4-a8c6-62b0cb0b2457 service nova] Releasing lock "refresh_cache-c307660b-01bb-471b-9e2e-5c2aaca65287" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 09:46:17 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:46:17 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 09:46:17 user nova-compute[75229]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 09:46:17 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c262048-8be4-4c97-b070-3b3c017416ff]: (4, '') {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:46:17 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.lightos [None req-95b98aa9-d8e4-4891-9faf-e13fe82deae7 tempest-TestVolumeSwap-528292061 tempest-TestVolumeSwap-528292061-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75229) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 09:46:17 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.lightos [None req-95b98aa9-d8e4-4891-9faf-e13fe82deae7 tempest-TestVolumeSwap-528292061 tempest-TestVolumeSwap-528292061-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75229) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 09:46:17 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.lightos [None req-95b98aa9-d8e4-4891-9faf-e13fe82deae7 tempest-TestVolumeSwap-528292061 tempest-TestVolumeSwap-528292061-project-member] LIGHTOS: no hostnqn found. {{(pid=75229) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 09:46:17 user nova-compute[75229]: DEBUG os_brick.utils [None req-95b98aa9-d8e4-4891-9faf-e13fe82deae7 tempest-TestVolumeSwap-528292061 tempest-TestVolumeSwap-528292061-project-member] <== get_connector_properties: return (109ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f1154031c835', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 09:46:17 user nova-compute[75229]: DEBUG nova.virt.block_device [None req-95b98aa9-d8e4-4891-9faf-e13fe82deae7 tempest-TestVolumeSwap-528292061 tempest-TestVolumeSwap-528292061-project-member] [instance: c307660b-01bb-471b-9e2e-5c2aaca65287] Updating existing volume attachment record: 2f807368-9401-43ea-a602-b762ff5b4fb8 {{(pid=75229) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 09:46:17 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:46:19 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:46:19 user nova-compute[75229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-15c836a5-c427-4282-8fdb-434e2a122820 tempest-TaggedAttachmentsTest-294727221 tempest-TaggedAttachmentsTest-294727221-project-member] [instance: c6fa2298-7111-4660-a162-09269045d5e3] Calling os-brick to attach iSCSI Volume {{(pid=75229) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 09:46:19 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-15c836a5-c427-4282-8fdb-434e2a122820 tempest-TaggedAttachmentsTest-294727221 tempest-TaggedAttachmentsTest-294727221-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f73f85151b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7144f229-1f5e-4155-aba1-ab44218df41a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PKNhXWaY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 09:46:19 user nova-compute[75229]: WARNING os_brick.initiator.connectors.base [None req-15c836a5-c427-4282-8fdb-434e2a122820 tempest-TaggedAttachmentsTest-294727221 tempest-TaggedAttachmentsTest-294727221-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 09:46:19 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-15c836a5-c427-4282-8fdb-434e2a122820 tempest-TaggedAttachmentsTest-294727221 tempest-TaggedAttachmentsTest-294727221-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 09:46:20 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-15c836a5-c427-4282-8fdb-434e2a122820 tempest-TaggedAttachmentsTest-294727221 tempest-TaggedAttachmentsTest-294727221-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 09:46:20 user nova-compute[75229]: WARNING os_brick.initiator.connectors.base [None req-15c836a5-c427-4282-8fdb-434e2a122820 tempest-TaggedAttachmentsTest-294727221 tempest-TaggedAttachmentsTest-294727221-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 09:46:20 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-15c836a5-c427-4282-8fdb-434e2a122820 tempest-TaggedAttachmentsTest-294727221 tempest-TaggedAttachmentsTest-294727221-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7144f229-1f5e-4155-aba1-ab44218df41a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 09:46:20 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-15c836a5-c427-4282-8fdb-434e2a122820 tempest-TaggedAttachmentsTest-294727221 tempest-TaggedAttachmentsTest-294727221-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7144f229-1f5e-4155-aba1-ab44218df41a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 09:46:20 user nova-compute[75229]: INFO os_brick.initiator.connectors.iscsi [None req-15c836a5-c427-4282-8fdb-434e2a122820 tempest-TaggedAttachmentsTest-294727221 tempest-TaggedAttachmentsTest-294727221-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 09:46:20 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7144f229-1f5e-4155-aba1-ab44218df41a -p 172.16.0.220:3260 {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:46:20 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7144f229-1f5e-4155-aba1-ab44218df41a -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:46:20 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6d5f0d5-2477-41b4-8a04-878bf59caf34]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:46:20 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-15c836a5-c427-4282-8fdb-434e2a122820 tempest-TaggedAttachmentsTest-294727221 tempest-TaggedAttachmentsTest-294727221-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 09:46:20 user nova-compute[75229]:  {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:46:20 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7144f229-1f5e-4155-aba1-ab44218df41a -p 172.16.0.220:3260 --interface default --op new {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:46:20 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7144f229-1f5e-4155-aba1-ab44218df41a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:46:20 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d0f6e38-5472-41a0-b1f7-2e3cfe0ce60b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7144f229-1f5e-4155-aba1-ab44218df41a] added\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:46:20 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-15c836a5-c427-4282-8fdb-434e2a122820 tempest-TaggedAttachmentsTest-294727221 tempest-TaggedAttachmentsTest-294727221-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7144f229-1f5e-4155-aba1-ab44218df41a] added
Nov 14 09:46:20 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:46:20 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7144f229-1f5e-4155-aba1-ab44218df41a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:46:20 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7144f229-1f5e-4155-aba1-ab44218df41a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:46:20 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[906fb60e-684a-4118-b1f5-59089e55082f]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:46:20 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-15c836a5-c427-4282-8fdb-434e2a122820 tempest-TaggedAttachmentsTest-294727221 tempest-TaggedAttachmentsTest-294727221-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:46:20 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7144f229-1f5e-4155-aba1-ab44218df41a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:46:20 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7144f229-1f5e-4155-aba1-ab44218df41a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:46:20 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e90c38e-5b6f-4a58-a6b9-b815ec37d98c]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:46:20 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-15c836a5-c427-4282-8fdb-434e2a122820 tempest-TaggedAttachmentsTest-294727221 tempest-TaggedAttachmentsTest-294727221-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:46:20 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7144f229-1f5e-4155-aba1-ab44218df41a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PKNhXWaY {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:46:20 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7144f229-1f5e-4155-aba1-ab44218df41a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PKNhXWaY" returned: 0 in 0.020s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:46:20 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[919d21d8-3691-43ce-a3e3-db91ed80cad2]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:46:20 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-15c836a5-c427-4282-8fdb-434e2a122820 tempest-TaggedAttachmentsTest-294727221 tempest-TaggedAttachmentsTest-294727221-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PKNhXWaY'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:46:20 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7144f229-1f5e-4155-aba1-ab44218df41a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:46:20 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7144f229-1f5e-4155-aba1-ab44218df41a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:46:20 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa146fe1-9752-4048-a019-1ac293da3683]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:46:20 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-15c836a5-c427-4282-8fdb-434e2a122820 tempest-TaggedAttachmentsTest-294727221 tempest-TaggedAttachmentsTest-294727221-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:46:20 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:46:20 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:46:20 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[783fed8f-71b5-4441-89d4-90ce3077ad0f]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2324d4e-6e60-47fd-b536-144a7ea32dce (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18a1e95e-5df1-4db1-92bc-6cd67729c7a7 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97f588de-32d5-4d48-9c06-5925263ba117 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d564ec4-7fbb-40b5-9085-41e3720c3a3b (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72bed504-5114-4179-b266-7cae18a4f75b (non-flash)\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:46:20 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-15c836a5-c427-4282-8fdb-434e2a122820 tempest-TaggedAttachmentsTest-294727221 tempest-TaggedAttachmentsTest-294727221-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2324d4e-6e60-47fd-b536-144a7ea32dce (non-flash)
Nov 14 09:46:20 user nova-compute[75229]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18a1e95e-5df1-4db1-92bc-6cd67729c7a7 (non-flash)
Nov 14 09:46:20 user nova-compute[75229]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97f588de-32d5-4d48-9c06-5925263ba117 (non-flash)
Nov 14 09:46:20 user nova-compute[75229]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d564ec4-7fbb-40b5-9085-41e3720c3a3b (non-flash)
Nov 14 09:46:20 user nova-compute[75229]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72bed504-5114-4179-b266-7cae18a4f75b (non-flash)
Nov 14 09:46:20 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 09:46:20 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-15c836a5-c427-4282-8fdb-434e2a122820 tempest-TaggedAttachmentsTest-294727221 tempest-TaggedAttachmentsTest-294727221-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2324d4e-6e60-47fd-b536-144a7ea32dce (non-flash)
Nov 14 09:46:20 user nova-compute[75229]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18a1e95e-5df1-4db1-92bc-6cd67729c7a7 (non-flash)
Nov 14 09:46:20 user nova-compute[75229]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97f588de-32d5-4d48-9c06-5925263ba117 (non-flash)
Nov 14 09:46:20 user nova-compute[75229]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d564ec4-7fbb-40b5-9085-41e3720c3a3b (non-flash)
Nov 14 09:46:20 user nova-compute[75229]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72bed504-5114-4179-b266-7cae18a4f75b (non-flash)
Nov 14 09:46:20 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 09:46:20 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7144f229-1f5e-4155-aba1-ab44218df41a -p 172.16.0.220:3260 --login {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:46:20 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7144f229-1f5e-4155-aba1-ab44218df41a -p 172.16.0.220:3260 --login" returned: 0 in 0.075s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:46:20 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[e77593d5-598a-4ebd-8e03-b3920ef33505]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7144f229-1f5e-4155-aba1-ab44218df41a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7144f229-1f5e-4155-aba1-ab44218df41a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:46:20 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-15c836a5-c427-4282-8fdb-434e2a122820 tempest-TaggedAttachmentsTest-294727221 tempest-TaggedAttachmentsTest-294727221-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7144f229-1f5e-4155-aba1-ab44218df41a, portal: 172.16.0.220,3260]
Nov 14 09:46:20 user nova-compute[75229]: Login to [iface: default, target: iqn.2010-10.org.openstack:7144f229-1f5e-4155-aba1-ab44218df41a, portal: 172.16.0.220,3260] successful.
Nov 14 09:46:20 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:46:20 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7144f229-1f5e-4155-aba1-ab44218df41a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:46:20 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7144f229-1f5e-4155-aba1-ab44218df41a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:46:20 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[101af160-9b07-41da-884b-4bf6a3050f8c]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:46:20 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-15c836a5-c427-4282-8fdb-434e2a122820 tempest-TaggedAttachmentsTest-294727221 tempest-TaggedAttachmentsTest-294727221-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:46:20 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:46:20 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:46:20 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[76f838ad-a857-420d-9ac7-b908a9e23194]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2324d4e-6e60-47fd-b536-144a7ea32dce (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18a1e95e-5df1-4db1-92bc-6cd67729c7a7 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97f588de-32d5-4d48-9c06-5925263ba117 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d564ec4-7fbb-40b5-9085-41e3720c3a3b (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72bed504-5114-4179-b266-7cae18a4f75b (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7144f229-1f5e-4155-aba1-ab44218df41a (non-flash)\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:46:20 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-15c836a5-c427-4282-8fdb-434e2a122820 tempest-TaggedAttachmentsTest-294727221 tempest-TaggedAttachmentsTest-294727221-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2324d4e-6e60-47fd-b536-144a7ea32dce (non-flash)
Nov 14 09:46:20 user nova-compute[75229]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18a1e95e-5df1-4db1-92bc-6cd67729c7a7 (non-flash)
Nov 14 09:46:20 user nova-compute[75229]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97f588de-32d5-4d48-9c06-5925263ba117 (non-flash)
Nov 14 09:46:20 user nova-compute[75229]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d564ec4-7fbb-40b5-9085-41e3720c3a3b (non-flash)
Nov 14 09:46:20 user nova-compute[75229]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72bed504-5114-4179-b266-7cae18a4f75b (non-flash)
Nov 14 09:46:20 user nova-compute[75229]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7144f229-1f5e-4155-aba1-ab44218df41a (non-flash)
Nov 14 09:46:20 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 09:46:20 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-15c836a5-c427-4282-8fdb-434e2a122820 tempest-TaggedAttachmentsTest-294727221 tempest-TaggedAttachmentsTest-294727221-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2324d4e-6e60-47fd-b536-144a7ea32dce (non-flash)
Nov 14 09:46:20 user nova-compute[75229]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18a1e95e-5df1-4db1-92bc-6cd67729c7a7 (non-flash)
Nov 14 09:46:20 user nova-compute[75229]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97f588de-32d5-4d48-9c06-5925263ba117 (non-flash)
Nov 14 09:46:20 user nova-compute[75229]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d564ec4-7fbb-40b5-9085-41e3720c3a3b (non-flash)
Nov 14 09:46:20 user nova-compute[75229]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72bed504-5114-4179-b266-7cae18a4f75b (non-flash)
Nov 14 09:46:20 user nova-compute[75229]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7144f229-1f5e-4155-aba1-ab44218df41a (non-flash)
Nov 14 09:46:20 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 09:46:20 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-15c836a5-c427-4282-8fdb-434e2a122820 tempest-TaggedAttachmentsTest-294727221 tempest-TaggedAttachmentsTest-294727221-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7144f229-1f5e-4155-aba1-ab44218df41a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.308s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 09:46:20 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-15c836a5-c427-4282-8fdb-434e2a122820 tempest-TaggedAttachmentsTest-294727221 tempest-TaggedAttachmentsTest-294727221-project-member] Connected to 172.16.0.220:3260 {{(pid=75229) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 09:46:20 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-15c836a5-c427-4282-8fdb-434e2a122820 tempest-TaggedAttachmentsTest-294727221 tempest-TaggedAttachmentsTest-294727221-project-member] HCTL ('38', '-', '-', 0) found on session 8 with lun 0 {{(pid=75229) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 09:46:20 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-15c836a5-c427-4282-8fdb-434e2a122820 tempest-TaggedAttachmentsTest-294727221 tempest-TaggedAttachmentsTest-294727221-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=75229) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 09:46:20 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:46:20 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.016s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:46:20 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2db1805-681a-4f5c-9d13-1db09372970d]: (4, ('- - 0', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:46:20 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-15c836a5-c427-4282-8fdb-434e2a122820 tempest-TaggedAttachmentsTest-294727221 tempest-TaggedAttachmentsTest-294727221-project-member] Searching for a device in session 8 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=75229) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 09:46:20 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-15c836a5-c427-4282-8fdb-434e2a122820 tempest-TaggedAttachmentsTest-294727221 tempest-TaggedAttachmentsTest-294727221-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:7144f229-1f5e-4155-aba1-ab44218df41a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PKNhXWaY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75229) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 09:46:21 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-15c836a5-c427-4282-8fdb-434e2a122820 tempest-TaggedAttachmentsTest-294727221 tempest-TaggedAttachmentsTest-294727221-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.343s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 09:46:21 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-15c836a5-c427-4282-8fdb-434e2a122820 tempest-TaggedAttachmentsTest-294727221 tempest-TaggedAttachmentsTest-294727221-project-member] <== connect_volume: return (1345ms) {'type': 'block', 'scsi_wwn': '23761643766343166', 'path': '/dev/sdg'} {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 09:46:21 user nova-compute[75229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-15c836a5-c427-4282-8fdb-434e2a122820 tempest-TaggedAttachmentsTest-294727221 tempest-TaggedAttachmentsTest-294727221-project-member] [instance: c6fa2298-7111-4660-a162-09269045d5e3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23761643766343166', 'path': '/dev/sdg'} {{(pid=75229) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 09:46:21 user nova-compute[75229]: DEBUG nova.objects.instance [None req-15c836a5-c427-4282-8fdb-434e2a122820 tempest-TaggedAttachmentsTest-294727221 tempest-TaggedAttachmentsTest-294727221-project-member] Lazy-loading 'flavor' on Instance uuid c6fa2298-7111-4660-a162-09269045d5e3 {{(pid=75229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 09:46:21 user nova-compute[75229]: DEBUG nova.virt.libvirt.guest [None req-15c836a5-c427-4282-8fdb-434e2a122820 tempest-TaggedAttachmentsTest-294727221 tempest-TaggedAttachmentsTest-294727221-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 09:46:21 user nova-compute[75229]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 09:46:21 user nova-compute[75229]:   <source dev="/dev/sdg"/>
Nov 14 09:46:21 user nova-compute[75229]:   <target dev="vdb" bus="virtio"/>
Nov 14 09:46:21 user nova-compute[75229]:   <serial>7144f229-1f5e-4155-aba1-ab44218df41a</serial>
Nov 14 09:46:21 user nova-compute[75229]: </disk>
Nov 14 09:46:21 user nova-compute[75229]:  {{(pid=75229) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 09:46:21 user nova-compute[75229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-95b98aa9-d8e4-4891-9faf-e13fe82deae7 tempest-TestVolumeSwap-528292061 tempest-TestVolumeSwap-528292061-project-member] [instance: c307660b-01bb-471b-9e2e-5c2aaca65287] Calling os-brick to attach iSCSI Volume {{(pid=75229) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 09:46:21 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-95b98aa9-d8e4-4891-9faf-e13fe82deae7 tempest-TestVolumeSwap-528292061 tempest-TestVolumeSwap-528292061-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f73f85151b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:52ae1fea-5339-4958-88ae-d103080e7743', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xkXQEUcf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 09:46:21 user nova-compute[75229]: WARNING os_brick.initiator.connectors.base [None req-95b98aa9-d8e4-4891-9faf-e13fe82deae7 tempest-TestVolumeSwap-528292061 tempest-TestVolumeSwap-528292061-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 09:46:21 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-95b98aa9-d8e4-4891-9faf-e13fe82deae7 tempest-TestVolumeSwap-528292061 tempest-TestVolumeSwap-528292061-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 09:46:21 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-95b98aa9-d8e4-4891-9faf-e13fe82deae7 tempest-TestVolumeSwap-528292061 tempest-TestVolumeSwap-528292061-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 09:46:21 user nova-compute[75229]: WARNING os_brick.initiator.connectors.base [None req-95b98aa9-d8e4-4891-9faf-e13fe82deae7 tempest-TestVolumeSwap-528292061 tempest-TestVolumeSwap-528292061-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 09:46:21 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-95b98aa9-d8e4-4891-9faf-e13fe82deae7 tempest-TestVolumeSwap-528292061 tempest-TestVolumeSwap-528292061-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:52ae1fea-5339-4958-88ae-d103080e7743" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 09:46:21 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-95b98aa9-d8e4-4891-9faf-e13fe82deae7 tempest-TestVolumeSwap-528292061 tempest-TestVolumeSwap-528292061-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:52ae1fea-5339-4958-88ae-d103080e7743" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 09:46:21 user nova-compute[75229]: INFO os_brick.initiator.connectors.iscsi [None req-95b98aa9-d8e4-4891-9faf-e13fe82deae7 tempest-TestVolumeSwap-528292061 tempest-TestVolumeSwap-528292061-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 09:46:21 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52ae1fea-5339-4958-88ae-d103080e7743 -p 172.16.0.220:3260 {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:46:21 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52ae1fea-5339-4958-88ae-d103080e7743 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:46:21 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[047149f9-072e-4e63-a825-b971f0b09999]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:46:21 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-95b98aa9-d8e4-4891-9faf-e13fe82deae7 tempest-TestVolumeSwap-528292061 tempest-TestVolumeSwap-528292061-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 09:46:21 user nova-compute[75229]:  {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:46:21 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52ae1fea-5339-4958-88ae-d103080e7743 -p 172.16.0.220:3260 --interface default --op new {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:46:21 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52ae1fea-5339-4958-88ae-d103080e7743 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:46:21 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[112f7be9-297b-47b9-aafb-2f7b4a890198]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:52ae1fea-5339-4958-88ae-d103080e7743] added\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:46:21 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-95b98aa9-d8e4-4891-9faf-e13fe82deae7 tempest-TestVolumeSwap-528292061 tempest-TestVolumeSwap-528292061-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:52ae1fea-5339-4958-88ae-d103080e7743] added
Nov 14 09:46:21 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:46:21 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52ae1fea-5339-4958-88ae-d103080e7743 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:46:21 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52ae1fea-5339-4958-88ae-d103080e7743 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:46:21 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0da041c-e1f2-47bf-8a3b-e59d5c39827a]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:46:21 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-95b98aa9-d8e4-4891-9faf-e13fe82deae7 tempest-TestVolumeSwap-528292061 tempest-TestVolumeSwap-528292061-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:46:21 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52ae1fea-5339-4958-88ae-d103080e7743 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:46:21 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52ae1fea-5339-4958-88ae-d103080e7743 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:46:21 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ce8f40e-afc8-4c7f-bef7-87187f60c76a]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:46:21 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-95b98aa9-d8e4-4891-9faf-e13fe82deae7 tempest-TestVolumeSwap-528292061 tempest-TestVolumeSwap-528292061-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:46:21 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52ae1fea-5339-4958-88ae-d103080e7743 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xkXQEUcf {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:46:21 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52ae1fea-5339-4958-88ae-d103080e7743 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xkXQEUcf" returned: 0 in 0.018s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:46:21 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e55668f-4d3e-4f65-9cb9-23249f217fd7]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:46:21 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-95b98aa9-d8e4-4891-9faf-e13fe82deae7 tempest-TestVolumeSwap-528292061 tempest-TestVolumeSwap-528292061-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xkXQEUcf'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:46:21 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52ae1fea-5339-4958-88ae-d103080e7743 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:46:21 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52ae1fea-5339-4958-88ae-d103080e7743 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:46:21 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[630d9e7c-b2c0-4da1-a19f-207fb26b408e]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:46:21 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-95b98aa9-d8e4-4891-9faf-e13fe82deae7 tempest-TestVolumeSwap-528292061 tempest-TestVolumeSwap-528292061-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:46:21 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:46:21 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:46:21 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[988727cb-caad-4b6b-8d00-e234af62f606]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2324d4e-6e60-47fd-b536-144a7ea32dce (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18a1e95e-5df1-4db1-92bc-6cd67729c7a7 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97f588de-32d5-4d48-9c06-5925263ba117 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d564ec4-7fbb-40b5-9085-41e3720c3a3b (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72bed504-5114-4179-b266-7cae18a4f75b (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7144f229-1f5e-4155-aba1-ab44218df41a (non-flash)\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:46:21 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-95b98aa9-d8e4-4891-9faf-e13fe82deae7 tempest-TestVolumeSwap-528292061 tempest-TestVolumeSwap-528292061-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2324d4e-6e60-47fd-b536-144a7ea32dce (non-flash)
Nov 14 09:46:21 user nova-compute[75229]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18a1e95e-5df1-4db1-92bc-6cd67729c7a7 (non-flash)
Nov 14 09:46:21 user nova-compute[75229]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97f588de-32d5-4d48-9c06-5925263ba117 (non-flash)
Nov 14 09:46:21 user nova-compute[75229]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d564ec4-7fbb-40b5-9085-41e3720c3a3b (non-flash)
Nov 14 09:46:21 user nova-compute[75229]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72bed504-5114-4179-b266-7cae18a4f75b (non-flash)
Nov 14 09:46:21 user nova-compute[75229]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7144f229-1f5e-4155-aba1-ab44218df41a (non-flash)
Nov 14 09:46:21 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 09:46:21 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-95b98aa9-d8e4-4891-9faf-e13fe82deae7 tempest-TestVolumeSwap-528292061 tempest-TestVolumeSwap-528292061-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2324d4e-6e60-47fd-b536-144a7ea32dce (non-flash)
Nov 14 09:46:21 user nova-compute[75229]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18a1e95e-5df1-4db1-92bc-6cd67729c7a7 (non-flash)
Nov 14 09:46:21 user nova-compute[75229]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97f588de-32d5-4d48-9c06-5925263ba117 (non-flash)
Nov 14 09:46:21 user nova-compute[75229]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d564ec4-7fbb-40b5-9085-41e3720c3a3b (non-flash)
Nov 14 09:46:21 user nova-compute[75229]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72bed504-5114-4179-b266-7cae18a4f75b (non-flash)
Nov 14 09:46:21 user nova-compute[75229]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7144f229-1f5e-4155-aba1-ab44218df41a (non-flash)
Nov 14 09:46:21 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 09:46:21 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52ae1fea-5339-4958-88ae-d103080e7743 -p 172.16.0.220:3260 --login {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:46:21 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-15c836a5-c427-4282-8fdb-434e2a122820 tempest-TaggedAttachmentsTest-294727221 tempest-TaggedAttachmentsTest-294727221-project-member] No BDM found with device name vda, not building metadata. {{(pid=75229) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 09:46:21 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-15c836a5-c427-4282-8fdb-434e2a122820 tempest-TaggedAttachmentsTest-294727221 tempest-TaggedAttachmentsTest-294727221-project-member] No BDM found with device name hda, not building metadata. {{(pid=75229) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 09:46:21 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-15c836a5-c427-4282-8fdb-434e2a122820 tempest-TaggedAttachmentsTest-294727221 tempest-TaggedAttachmentsTest-294727221-project-member] No VIF found with MAC fa:16:3e:90:0c:ec, not building metadata {{(pid=75229) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 09:46:21 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52ae1fea-5339-4958-88ae-d103080e7743 -p 172.16.0.220:3260 --login" returned: 0 in 0.078s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:46:21 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[6167d6da-5d3d-4b64-afc4-5228f196a8d8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:52ae1fea-5339-4958-88ae-d103080e7743, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:52ae1fea-5339-4958-88ae-d103080e7743, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:46:21 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-95b98aa9-d8e4-4891-9faf-e13fe82deae7 tempest-TestVolumeSwap-528292061 tempest-TestVolumeSwap-528292061-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:52ae1fea-5339-4958-88ae-d103080e7743, portal: 172.16.0.220,3260]
Nov 14 09:46:21 user nova-compute[75229]: Login to [iface: default, target: iqn.2010-10.org.openstack:52ae1fea-5339-4958-88ae-d103080e7743, portal: 172.16.0.220,3260] successful.
Nov 14 09:46:21 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:46:21 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52ae1fea-5339-4958-88ae-d103080e7743 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:46:21 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52ae1fea-5339-4958-88ae-d103080e7743 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:46:21 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7c780a2-264a-4520-8382-69364c927fb3]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:46:21 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-95b98aa9-d8e4-4891-9faf-e13fe82deae7 tempest-TestVolumeSwap-528292061 tempest-TestVolumeSwap-528292061-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:46:21 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:46:21 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:46:21 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[7250d599-0ffd-4594-9e4b-38aafa7eb798]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2324d4e-6e60-47fd-b536-144a7ea32dce (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18a1e95e-5df1-4db1-92bc-6cd67729c7a7 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97f588de-32d5-4d48-9c06-5925263ba117 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d564ec4-7fbb-40b5-9085-41e3720c3a3b (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72bed504-5114-4179-b266-7cae18a4f75b (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7144f229-1f5e-4155-aba1-ab44218df41a (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52ae1fea-5339-4958-88ae-d103080e7743 (non-flash)\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:46:21 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-95b98aa9-d8e4-4891-9faf-e13fe82deae7 tempest-TestVolumeSwap-528292061 tempest-TestVolumeSwap-528292061-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2324d4e-6e60-47fd-b536-144a7ea32dce (non-flash)
Nov 14 09:46:21 user nova-compute[75229]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18a1e95e-5df1-4db1-92bc-6cd67729c7a7 (non-flash)
Nov 14 09:46:21 user nova-compute[75229]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97f588de-32d5-4d48-9c06-5925263ba117 (non-flash)
Nov 14 09:46:21 user nova-compute[75229]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d564ec4-7fbb-40b5-9085-41e3720c3a3b (non-flash)
Nov 14 09:46:21 user nova-compute[75229]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72bed504-5114-4179-b266-7cae18a4f75b (non-flash)
Nov 14 09:46:21 user nova-compute[75229]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7144f229-1f5e-4155-aba1-ab44218df41a (non-flash)
Nov 14 09:46:21 user nova-compute[75229]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52ae1fea-5339-4958-88ae-d103080e7743 (non-flash)
Nov 14 09:46:21 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 09:46:21 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-95b98aa9-d8e4-4891-9faf-e13fe82deae7 tempest-TestVolumeSwap-528292061 tempest-TestVolumeSwap-528292061-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2324d4e-6e60-47fd-b536-144a7ea32dce (non-flash)
Nov 14 09:46:21 user nova-compute[75229]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18a1e95e-5df1-4db1-92bc-6cd67729c7a7 (non-flash)
Nov 14 09:46:21 user nova-compute[75229]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97f588de-32d5-4d48-9c06-5925263ba117 (non-flash)
Nov 14 09:46:21 user nova-compute[75229]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d564ec4-7fbb-40b5-9085-41e3720c3a3b (non-flash)
Nov 14 09:46:21 user nova-compute[75229]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72bed504-5114-4179-b266-7cae18a4f75b (non-flash)
Nov 14 09:46:21 user nova-compute[75229]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7144f229-1f5e-4155-aba1-ab44218df41a (non-flash)
Nov 14 09:46:21 user nova-compute[75229]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52ae1fea-5339-4958-88ae-d103080e7743 (non-flash)
Nov 14 09:46:21 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 09:46:21 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-95b98aa9-d8e4-4891-9faf-e13fe82deae7 tempest-TestVolumeSwap-528292061 tempest-TestVolumeSwap-528292061-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:52ae1fea-5339-4958-88ae-d103080e7743" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.306s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 09:46:21 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-95b98aa9-d8e4-4891-9faf-e13fe82deae7 tempest-TestVolumeSwap-528292061 tempest-TestVolumeSwap-528292061-project-member] Connected to 172.16.0.220:3260 {{(pid=75229) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 09:46:21 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-95b98aa9-d8e4-4891-9faf-e13fe82deae7 tempest-TestVolumeSwap-528292061 tempest-TestVolumeSwap-528292061-project-member] HCTL ('39', '-', '-', 0) found on session 9 with lun 0 {{(pid=75229) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 09:46:21 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-95b98aa9-d8e4-4891-9faf-e13fe82deae7 tempest-TestVolumeSwap-528292061 tempest-TestVolumeSwap-528292061-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=75229) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 09:46:21 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:46:21 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.016s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:46:21 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[1efec93c-18f6-41b1-97b4-12122e0d8710]: (4, ('- - 0', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:46:21 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-95b98aa9-d8e4-4891-9faf-e13fe82deae7 tempest-TestVolumeSwap-528292061 tempest-TestVolumeSwap-528292061-project-member] Searching for a device in session 9 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=75229) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 09:46:21 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-95b98aa9-d8e4-4891-9faf-e13fe82deae7 tempest-TestVolumeSwap-528292061 tempest-TestVolumeSwap-528292061-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:52ae1fea-5339-4958-88ae-d103080e7743', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xkXQEUcf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75229) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 09:46:21 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-15c836a5-c427-4282-8fdb-434e2a122820 tempest-TaggedAttachmentsTest-294727221 tempest-TaggedAttachmentsTest-294727221-project-member] Lock "c6fa2298-7111-4660-a162-09269045d5e3" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.425s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:46:22 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:46:22 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-95b98aa9-d8e4-4891-9faf-e13fe82deae7 tempest-TestVolumeSwap-528292061 tempest-TestVolumeSwap-528292061-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.339s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 09:46:22 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-95b98aa9-d8e4-4891-9faf-e13fe82deae7 tempest-TestVolumeSwap-528292061 tempest-TestVolumeSwap-528292061-project-member] <== connect_volume: return (1341ms) {'type': 'block', 'scsi_wwn': '26132343636646636', 'path': '/dev/sdh'} {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 09:46:22 user nova-compute[75229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-95b98aa9-d8e4-4891-9faf-e13fe82deae7 tempest-TestVolumeSwap-528292061 tempest-TestVolumeSwap-528292061-project-member] [instance: c307660b-01bb-471b-9e2e-5c2aaca65287] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26132343636646636', 'path': '/dev/sdh'} {{(pid=75229) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 09:46:22 user nova-compute[75229]: DEBUG nova.objects.instance [None req-95b98aa9-d8e4-4891-9faf-e13fe82deae7 tempest-TestVolumeSwap-528292061 tempest-TestVolumeSwap-528292061-project-member] Lazy-loading 'flavor' on Instance uuid c307660b-01bb-471b-9e2e-5c2aaca65287 {{(pid=75229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 09:46:22 user nova-compute[75229]: DEBUG nova.virt.libvirt.guest [None req-95b98aa9-d8e4-4891-9faf-e13fe82deae7 tempest-TestVolumeSwap-528292061 tempest-TestVolumeSwap-528292061-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 09:46:22 user nova-compute[75229]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 09:46:22 user nova-compute[75229]:   <source dev="/dev/sdh"/>
Nov 14 09:46:22 user nova-compute[75229]:   <target dev="vdb" bus="virtio"/>
Nov 14 09:46:22 user nova-compute[75229]:   <serial>52ae1fea-5339-4958-88ae-d103080e7743</serial>
Nov 14 09:46:22 user nova-compute[75229]: </disk>
Nov 14 09:46:22 user nova-compute[75229]:  {{(pid=75229) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 09:46:23 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-afde6df1-6d68-4670-9fb4-d8da73363148 tempest-TaggedAttachmentsTest-294727221 tempest-TaggedAttachmentsTest-294727221-project-member] Acquiring lock "c6fa2298-7111-4660-a162-09269045d5e3" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:46:23 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-afde6df1-6d68-4670-9fb4-d8da73363148 tempest-TaggedAttachmentsTest-294727221 tempest-TaggedAttachmentsTest-294727221-project-member] Lock "c6fa2298-7111-4660-a162-09269045d5e3" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:46:23 user nova-compute[75229]: INFO nova.compute.manager [None req-afde6df1-6d68-4670-9fb4-d8da73363148 tempest-TaggedAttachmentsTest-294727221 tempest-TaggedAttachmentsTest-294727221-project-member] [instance: c6fa2298-7111-4660-a162-09269045d5e3] Detaching volume 7144f229-1f5e-4155-aba1-ab44218df41a
Nov 14 09:46:23 user nova-compute[75229]: INFO nova.virt.block_device [None req-afde6df1-6d68-4670-9fb4-d8da73363148 tempest-TaggedAttachmentsTest-294727221 tempest-TaggedAttachmentsTest-294727221-project-member] [instance: c6fa2298-7111-4660-a162-09269045d5e3] Attempting to driver detach volume 7144f229-1f5e-4155-aba1-ab44218df41a from mountpoint /dev/vdb
Nov 14 09:46:23 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-afde6df1-6d68-4670-9fb4-d8da73363148 tempest-TaggedAttachmentsTest-294727221 tempest-TaggedAttachmentsTest-294727221-project-member] Attempting to detach device vdb from instance c6fa2298-7111-4660-a162-09269045d5e3 from the persistent domain config. {{(pid=75229) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 09:46:23 user nova-compute[75229]: DEBUG nova.virt.libvirt.guest [None req-afde6df1-6d68-4670-9fb4-d8da73363148 tempest-TaggedAttachmentsTest-294727221 tempest-TaggedAttachmentsTest-294727221-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 09:46:23 user nova-compute[75229]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 09:46:23 user nova-compute[75229]:   <source dev="/dev/sdg"/>
Nov 14 09:46:23 user nova-compute[75229]:   <target dev="vdb" bus="virtio"/>
Nov 14 09:46:23 user nova-compute[75229]:   <serial>7144f229-1f5e-4155-aba1-ab44218df41a</serial>
Nov 14 09:46:23 user nova-compute[75229]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 14 09:46:23 user nova-compute[75229]: </disk>
Nov 14 09:46:23 user nova-compute[75229]:  {{(pid=75229) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 09:46:23 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-afde6df1-6d68-4670-9fb4-d8da73363148 tempest-TaggedAttachmentsTest-294727221 tempest-TaggedAttachmentsTest-294727221-project-member] Successfully detached device vdb from instance c6fa2298-7111-4660-a162-09269045d5e3 from the persistent domain config.
Nov 14 09:46:23 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-afde6df1-6d68-4670-9fb4-d8da73363148 tempest-TaggedAttachmentsTest-294727221 tempest-TaggedAttachmentsTest-294727221-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance c6fa2298-7111-4660-a162-09269045d5e3 from the live domain config. {{(pid=75229) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 09:46:23 user nova-compute[75229]: DEBUG nova.virt.libvirt.guest [None req-afde6df1-6d68-4670-9fb4-d8da73363148 tempest-TaggedAttachmentsTest-294727221 tempest-TaggedAttachmentsTest-294727221-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 09:46:23 user nova-compute[75229]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 09:46:23 user nova-compute[75229]:   <source dev="/dev/sdg"/>
Nov 14 09:46:23 user nova-compute[75229]:   <target dev="vdb" bus="virtio"/>
Nov 14 09:46:23 user nova-compute[75229]:   <serial>7144f229-1f5e-4155-aba1-ab44218df41a</serial>
Nov 14 09:46:23 user nova-compute[75229]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 14 09:46:23 user nova-compute[75229]: </disk>
Nov 14 09:46:23 user nova-compute[75229]:  {{(pid=75229) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 09:46:23 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-95b98aa9-d8e4-4891-9faf-e13fe82deae7 tempest-TestVolumeSwap-528292061 tempest-TestVolumeSwap-528292061-project-member] No BDM found with device name vda, not building metadata. {{(pid=75229) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 09:46:23 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-95b98aa9-d8e4-4891-9faf-e13fe82deae7 tempest-TestVolumeSwap-528292061 tempest-TestVolumeSwap-528292061-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75229) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 09:46:23 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-95b98aa9-d8e4-4891-9faf-e13fe82deae7 tempest-TestVolumeSwap-528292061 tempest-TestVolumeSwap-528292061-project-member] No VIF found with MAC fa:16:3e:db:5c:48, not building metadata {{(pid=75229) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 09:46:23 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-b4474294-930a-4ac7-aafb-be162e9acee7 tempest-VolumesActionsTest-433219387 tempest-VolumesActionsTest-433219387-project-member] Acquiring lock "c9d3e03d-be75-44b1-97b4-36c13715175b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:46:23 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-b4474294-930a-4ac7-aafb-be162e9acee7 tempest-VolumesActionsTest-433219387 tempest-VolumesActionsTest-433219387-project-member] Lock "c9d3e03d-be75-44b1-97b4-36c13715175b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:46:23 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-b4474294-930a-4ac7-aafb-be162e9acee7 tempest-VolumesActionsTest-433219387 tempest-VolumesActionsTest-433219387-project-member] Acquiring lock "c9d3e03d-be75-44b1-97b4-36c13715175b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:46:23 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-b4474294-930a-4ac7-aafb-be162e9acee7 tempest-VolumesActionsTest-433219387 tempest-VolumesActionsTest-433219387-project-member] Lock "c9d3e03d-be75-44b1-97b4-36c13715175b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:46:23 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-b4474294-930a-4ac7-aafb-be162e9acee7 tempest-VolumesActionsTest-433219387 tempest-VolumesActionsTest-433219387-project-member] Lock "c9d3e03d-be75-44b1-97b4-36c13715175b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:46:23 user nova-compute[75229]: INFO nova.compute.manager [None req-b4474294-930a-4ac7-aafb-be162e9acee7 tempest-VolumesActionsTest-433219387 tempest-VolumesActionsTest-433219387-project-member] [instance: c9d3e03d-be75-44b1-97b4-36c13715175b] Terminating instance
Nov 14 09:46:23 user nova-compute[75229]: DEBUG nova.compute.manager [None req-b4474294-930a-4ac7-aafb-be162e9acee7 tempest-VolumesActionsTest-433219387 tempest-VolumesActionsTest-433219387-project-member] [instance: c9d3e03d-be75-44b1-97b4-36c13715175b] Start destroying the instance on the hypervisor. {{(pid=75229) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 09:46:23 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:46:23 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-95b98aa9-d8e4-4891-9faf-e13fe82deae7 tempest-TestVolumeSwap-528292061 tempest-TestVolumeSwap-528292061-project-member] Lock "c307660b-01bb-471b-9e2e-5c2aaca65287" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.736s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:46:23 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:46:23 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:46:23 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:46:23 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-afde6df1-6d68-4670-9fb4-d8da73363148 tempest-TaggedAttachmentsTest-294727221 tempest-TaggedAttachmentsTest-294727221-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance c6fa2298-7111-4660-a162-09269045d5e3 {{(pid=75229) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 09:46:23 user nova-compute[75229]: DEBUG nova.compute.manager [req-f9a6ada2-6615-42da-8188-ec6d9e395378 req-eecbb04e-a608-4c83-860f-19958b8fd7e5 service nova] [instance: c9d3e03d-be75-44b1-97b4-36c13715175b] Received event network-vif-unplugged-93b50b64-d7f2-48d0-bedb-ce1f6f5f44d5 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:46:23 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-f9a6ada2-6615-42da-8188-ec6d9e395378 req-eecbb04e-a608-4c83-860f-19958b8fd7e5 service nova] Acquiring lock "c9d3e03d-be75-44b1-97b4-36c13715175b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:46:23 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-f9a6ada2-6615-42da-8188-ec6d9e395378 req-eecbb04e-a608-4c83-860f-19958b8fd7e5 service nova] Lock "c9d3e03d-be75-44b1-97b4-36c13715175b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:46:23 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-f9a6ada2-6615-42da-8188-ec6d9e395378 req-eecbb04e-a608-4c83-860f-19958b8fd7e5 service nova] Lock "c9d3e03d-be75-44b1-97b4-36c13715175b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:46:23 user nova-compute[75229]: DEBUG nova.compute.manager [req-f9a6ada2-6615-42da-8188-ec6d9e395378 req-eecbb04e-a608-4c83-860f-19958b8fd7e5 service nova] [instance: c9d3e03d-be75-44b1-97b4-36c13715175b] No waiting events found dispatching network-vif-unplugged-93b50b64-d7f2-48d0-bedb-ce1f6f5f44d5 {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 09:46:23 user nova-compute[75229]: DEBUG nova.compute.manager [req-f9a6ada2-6615-42da-8188-ec6d9e395378 req-eecbb04e-a608-4c83-860f-19958b8fd7e5 service nova] [instance: c9d3e03d-be75-44b1-97b4-36c13715175b] Received event network-vif-unplugged-93b50b64-d7f2-48d0-bedb-ce1f6f5f44d5 for instance with task_state deleting. {{(pid=75229) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 09:46:24 user nova-compute[75229]: INFO nova.virt.libvirt.driver [-] [instance: c9d3e03d-be75-44b1-97b4-36c13715175b] Instance destroyed successfully.
Nov 14 09:46:24 user nova-compute[75229]: DEBUG nova.objects.instance [None req-b4474294-930a-4ac7-aafb-be162e9acee7 tempest-VolumesActionsTest-433219387 tempest-VolumesActionsTest-433219387-project-member] Lazy-loading 'resources' on Instance uuid c9d3e03d-be75-44b1-97b4-36c13715175b {{(pid=75229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 09:46:24 user nova-compute[75229]: DEBUG nova.virt.libvirt.vif [None req-b4474294-930a-4ac7-aafb-be162e9acee7 tempest-VolumesActionsTest-433219387 tempest-VolumesActionsTest-433219387-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T09:44:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1619649382',display_name='tempest-VolumesActionsTest-instance-1619649382',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1619649382',id=10,image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-14T09:44:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='20105ee2c3b54e72a2733d4ae8521c85',ramdisk_id='',reservation_id='r-44osxnby',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-433219387',owner_user_name='tempest-VolumesActionsTest-433219387-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T09:44:39Z,user_data=None,user_id='b5ab788c6eca4c208943024e9d9ecdd8',uuid=c9d3e03d-be75-44b1-97b4-36c13715175b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "93b50b64-d7f2-48d0-bedb-ce1f6f5f44d5", "address": "fa:16:3e:1e:66:d2", "network": {"id": "12eca812-07b5-410d-be2d-5d950c49859b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1127953797-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20105ee2c3b54e72a2733d4ae8521c85", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93b50b64-d7", "ovs_interfaceid": "93b50b64-d7f2-48d0-bedb-ce1f6f5f44d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 09:46:24 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-b4474294-930a-4ac7-aafb-be162e9acee7 tempest-VolumesActionsTest-433219387 tempest-VolumesActionsTest-433219387-project-member] Converting VIF {"id": "93b50b64-d7f2-48d0-bedb-ce1f6f5f44d5", "address": "fa:16:3e:1e:66:d2", "network": {"id": "12eca812-07b5-410d-be2d-5d950c49859b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1127953797-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20105ee2c3b54e72a2733d4ae8521c85", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93b50b64-d7", "ovs_interfaceid": "93b50b64-d7f2-48d0-bedb-ce1f6f5f44d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 09:46:24 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-b4474294-930a-4ac7-aafb-be162e9acee7 tempest-VolumesActionsTest-433219387 tempest-VolumesActionsTest-433219387-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1e:66:d2,bridge_name='br-int',has_traffic_filtering=True,id=93b50b64-d7f2-48d0-bedb-ce1f6f5f44d5,network=Network(12eca812-07b5-410d-be2d-5d950c49859b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap93b50b64-d7') {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 09:46:24 user nova-compute[75229]: DEBUG os_vif [None req-b4474294-930a-4ac7-aafb-be162e9acee7 tempest-VolumesActionsTest-433219387 tempest-VolumesActionsTest-433219387-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1e:66:d2,bridge_name='br-int',has_traffic_filtering=True,id=93b50b64-d7f2-48d0-bedb-ce1f6f5f44d5,network=Network(12eca812-07b5-410d-be2d-5d950c49859b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap93b50b64-d7') {{(pid=75229) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 09:46:24 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:46:24 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap93b50b64-d7, bridge=br-int, if_exists=True) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:46:24 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:46:24 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 09:46:24 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:46:24 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e27e8357-fdc0-45fd-99f2-27fb6b7cb21e) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:46:24 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:46:24 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:46:24 user nova-compute[75229]: INFO os_vif [None req-b4474294-930a-4ac7-aafb-be162e9acee7 tempest-VolumesActionsTest-433219387 tempest-VolumesActionsTest-433219387-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1e:66:d2,bridge_name='br-int',has_traffic_filtering=True,id=93b50b64-d7f2-48d0-bedb-ce1f6f5f44d5,network=Network(12eca812-07b5-410d-be2d-5d950c49859b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap93b50b64-d7')
Nov 14 09:46:24 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-b4474294-930a-4ac7-aafb-be162e9acee7 tempest-VolumesActionsTest-433219387 tempest-VolumesActionsTest-433219387-project-member] [instance: c9d3e03d-be75-44b1-97b4-36c13715175b] Deleting instance files /opt/stack/data/nova/instances/c9d3e03d-be75-44b1-97b4-36c13715175b_del
Nov 14 09:46:24 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-b4474294-930a-4ac7-aafb-be162e9acee7 tempest-VolumesActionsTest-433219387 tempest-VolumesActionsTest-433219387-project-member] [instance: c9d3e03d-be75-44b1-97b4-36c13715175b] Deletion of /opt/stack/data/nova/instances/c9d3e03d-be75-44b1-97b4-36c13715175b_del complete
Nov 14 09:46:24 user nova-compute[75229]: INFO nova.compute.manager [None req-b4474294-930a-4ac7-aafb-be162e9acee7 tempest-VolumesActionsTest-433219387 tempest-VolumesActionsTest-433219387-project-member] [instance: c9d3e03d-be75-44b1-97b4-36c13715175b] Took 0.79 seconds to destroy the instance on the hypervisor.
Nov 14 09:46:24 user nova-compute[75229]: DEBUG oslo.service.loopingcall [None req-b4474294-930a-4ac7-aafb-be162e9acee7 tempest-VolumesActionsTest-433219387 tempest-VolumesActionsTest-433219387-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75229) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 09:46:24 user nova-compute[75229]: DEBUG nova.compute.manager [-] [instance: c9d3e03d-be75-44b1-97b4-36c13715175b] Deallocating network for instance {{(pid=75229) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 09:46:24 user nova-compute[75229]: DEBUG nova.network.neutron [-] [instance: c9d3e03d-be75-44b1-97b4-36c13715175b] deallocate_for_instance() {{(pid=75229) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 09:46:24 user nova-compute[75229]: DEBUG nova.network.neutron [-] [instance: c9d3e03d-be75-44b1-97b4-36c13715175b] Updating instance_info_cache with network_info: [] {{(pid=75229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 09:46:24 user nova-compute[75229]: INFO nova.compute.manager [-] [instance: c9d3e03d-be75-44b1-97b4-36c13715175b] Took 0.41 seconds to deallocate network for instance.
Nov 14 09:46:24 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-b4474294-930a-4ac7-aafb-be162e9acee7 tempest-VolumesActionsTest-433219387 tempest-VolumesActionsTest-433219387-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:46:24 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-b4474294-930a-4ac7-aafb-be162e9acee7 tempest-VolumesActionsTest-433219387 tempest-VolumesActionsTest-433219387-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:46:24 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-46a6734f-557c-4e1b-a94f-736be046e361 tempest-TestVolumeSwap-1816306665 tempest-TestVolumeSwap-1816306665-project-admin] Acquiring lock "c307660b-01bb-471b-9e2e-5c2aaca65287" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:46:24 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-46a6734f-557c-4e1b-a94f-736be046e361 tempest-TestVolumeSwap-1816306665 tempest-TestVolumeSwap-1816306665-project-admin] Lock "c307660b-01bb-471b-9e2e-5c2aaca65287" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:46:25 user nova-compute[75229]: DEBUG os_brick.utils [None req-46a6734f-557c-4e1b-a94f-736be046e361 tempest-TestVolumeSwap-1816306665 tempest-TestVolumeSwap-1816306665-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 09:46:25 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:46:25 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:46:25 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfe68cbf-b528-48be-ab22-1441748bd34b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f1154031c835\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:46:25 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:46:25 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:46:25 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[9974ebf5-ae2f-4306-9e04-3195ba7a6109]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:46:25 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:46:25 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:46:25 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[21986330-ee3e-4a22-b563-b8d7384213a2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:46:25 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea40c392-45d1-4e93-a879-487066bb6e16]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:46:25 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-46a6734f-557c-4e1b-a94f-736be046e361 tempest-TestVolumeSwap-1816306665 tempest-TestVolumeSwap-1816306665-project-admin] Running cmd (subprocess): nvme version {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:46:25 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-46a6734f-557c-4e1b-a94f-736be046e361 tempest-TestVolumeSwap-1816306665 tempest-TestVolumeSwap-1816306665-project-admin] 'nvme version' failed. Not Retrying. {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 09:46:25 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.nvmeof [None req-46a6734f-557c-4e1b-a94f-736be046e361 tempest-TestVolumeSwap-1816306665 tempest-TestVolumeSwap-1816306665-project-admin] nvme not present on system {{(pid=75229) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 09:46:25 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:46:25 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 09:46:25 user nova-compute[75229]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 09:46:25 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[778d8358-65cd-4923-bf28-a528b7f0ac38]: (4, '') {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:46:25 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.lightos [None req-46a6734f-557c-4e1b-a94f-736be046e361 tempest-TestVolumeSwap-1816306665 tempest-TestVolumeSwap-1816306665-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75229) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 09:46:25 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.lightos [None req-46a6734f-557c-4e1b-a94f-736be046e361 tempest-TestVolumeSwap-1816306665 tempest-TestVolumeSwap-1816306665-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75229) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 09:46:25 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.lightos [None req-46a6734f-557c-4e1b-a94f-736be046e361 tempest-TestVolumeSwap-1816306665 tempest-TestVolumeSwap-1816306665-project-admin] LIGHTOS: no hostnqn found. {{(pid=75229) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 09:46:25 user nova-compute[75229]: DEBUG os_brick.utils [None req-46a6734f-557c-4e1b-a94f-736be046e361 tempest-TestVolumeSwap-1816306665 tempest-TestVolumeSwap-1816306665-project-admin] <== get_connector_properties: return (145ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f1154031c835', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 09:46:25 user nova-compute[75229]: DEBUG nova.compute.provider_tree [None req-b4474294-930a-4ac7-aafb-be162e9acee7 tempest-VolumesActionsTest-433219387 tempest-VolumesActionsTest-433219387-project-member] Inventory has not changed in ProviderTree for provider: d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 {{(pid=75229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 09:46:25 user nova-compute[75229]: DEBUG nova.scheduler.client.report [None req-b4474294-930a-4ac7-aafb-be162e9acee7 tempest-VolumesActionsTest-433219387 tempest-VolumesActionsTest-433219387-project-member] Inventory has not changed for provider d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 09:46:25 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-b4474294-930a-4ac7-aafb-be162e9acee7 tempest-VolumesActionsTest-433219387 tempest-VolumesActionsTest-433219387-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.434s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:46:25 user nova-compute[75229]: INFO nova.compute.manager [None req-46a6734f-557c-4e1b-a94f-736be046e361 tempest-TestVolumeSwap-1816306665 tempest-TestVolumeSwap-1816306665-project-admin] [instance: c307660b-01bb-471b-9e2e-5c2aaca65287] Swapping volume 52ae1fea-5339-4958-88ae-d103080e7743 for e2472759-033a-4051-9dec-4516d0aef07d
Nov 14 09:46:25 user nova-compute[75229]: INFO nova.scheduler.client.report [None req-b4474294-930a-4ac7-aafb-be162e9acee7 tempest-VolumesActionsTest-433219387 tempest-VolumesActionsTest-433219387-project-member] Deleted allocations for instance c9d3e03d-be75-44b1-97b4-36c13715175b
Nov 14 09:46:25 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-b4474294-930a-4ac7-aafb-be162e9acee7 tempest-VolumesActionsTest-433219387 tempest-VolumesActionsTest-433219387-project-member] Lock "c9d3e03d-be75-44b1-97b4-36c13715175b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.012s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:46:25 user nova-compute[75229]: DEBUG nova.compute.manager [req-ac9a0149-04a9-43d5-bd7d-2b529e0382a5 req-34ebf3a5-ff4d-447a-8c36-dca855c71a53 service nova] [instance: 8623fdcc-99b7-44d6-ad81-dada5ba83a88] Received event network-changed-30dd46f1-cc37-46dd-a47e-0bc23a724804 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:46:25 user nova-compute[75229]: DEBUG nova.compute.manager [req-ac9a0149-04a9-43d5-bd7d-2b529e0382a5 req-34ebf3a5-ff4d-447a-8c36-dca855c71a53 service nova] [instance: 8623fdcc-99b7-44d6-ad81-dada5ba83a88] Refreshing instance network info cache due to event network-changed-30dd46f1-cc37-46dd-a47e-0bc23a724804. {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 09:46:25 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-ac9a0149-04a9-43d5-bd7d-2b529e0382a5 req-34ebf3a5-ff4d-447a-8c36-dca855c71a53 service nova] Acquiring lock "refresh_cache-8623fdcc-99b7-44d6-ad81-dada5ba83a88" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 09:46:25 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-ac9a0149-04a9-43d5-bd7d-2b529e0382a5 req-34ebf3a5-ff4d-447a-8c36-dca855c71a53 service nova] Acquired lock "refresh_cache-8623fdcc-99b7-44d6-ad81-dada5ba83a88" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 09:46:25 user nova-compute[75229]: DEBUG nova.network.neutron [req-ac9a0149-04a9-43d5-bd7d-2b529e0382a5 req-34ebf3a5-ff4d-447a-8c36-dca855c71a53 service nova] [instance: 8623fdcc-99b7-44d6-ad81-dada5ba83a88] Refreshing network info cache for port 30dd46f1-cc37-46dd-a47e-0bc23a724804 {{(pid=75229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 09:46:25 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-228dcd15-94ef-4720-adce-ebf479a4b6c7 tempest-VolumesAssistedSnapshotsTest-1584778058 tempest-VolumesAssistedSnapshotsTest-1584778058-project-admin] Acquiring lock "8623fdcc-99b7-44d6-ad81-dada5ba83a88" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:46:25 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-228dcd15-94ef-4720-adce-ebf479a4b6c7 tempest-VolumesAssistedSnapshotsTest-1584778058 tempest-VolumesAssistedSnapshotsTest-1584778058-project-admin] Lock "8623fdcc-99b7-44d6-ad81-dada5ba83a88" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:46:25 user nova-compute[75229]: DEBUG nova.objects.instance [None req-228dcd15-94ef-4720-adce-ebf479a4b6c7 tempest-VolumesAssistedSnapshotsTest-1584778058 tempest-VolumesAssistedSnapshotsTest-1584778058-project-admin] Lazy-loading 'flavor' on Instance uuid 8623fdcc-99b7-44d6-ad81-dada5ba83a88 {{(pid=75229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 09:46:25 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-228dcd15-94ef-4720-adce-ebf479a4b6c7 tempest-VolumesAssistedSnapshotsTest-1584778058 tempest-VolumesAssistedSnapshotsTest-1584778058-project-admin] Lock "8623fdcc-99b7-44d6-ad81-dada5ba83a88" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.096s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:46:26 user nova-compute[75229]: DEBUG nova.compute.manager [req-7dafda5a-b52a-4bb6-b4bc-05d495bdc866 req-e5a8ea89-239e-44d6-a5c3-e53b62d34bf3 service nova] [instance: c9d3e03d-be75-44b1-97b4-36c13715175b] Received event network-vif-plugged-93b50b64-d7f2-48d0-bedb-ce1f6f5f44d5 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:46:26 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-7dafda5a-b52a-4bb6-b4bc-05d495bdc866 req-e5a8ea89-239e-44d6-a5c3-e53b62d34bf3 service nova] Acquiring lock "c9d3e03d-be75-44b1-97b4-36c13715175b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:46:26 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-7dafda5a-b52a-4bb6-b4bc-05d495bdc866 req-e5a8ea89-239e-44d6-a5c3-e53b62d34bf3 service nova] Lock "c9d3e03d-be75-44b1-97b4-36c13715175b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:46:26 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-7dafda5a-b52a-4bb6-b4bc-05d495bdc866 req-e5a8ea89-239e-44d6-a5c3-e53b62d34bf3 service nova] Lock "c9d3e03d-be75-44b1-97b4-36c13715175b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:46:26 user nova-compute[75229]: DEBUG nova.compute.manager [req-7dafda5a-b52a-4bb6-b4bc-05d495bdc866 req-e5a8ea89-239e-44d6-a5c3-e53b62d34bf3 service nova] [instance: c9d3e03d-be75-44b1-97b4-36c13715175b] No waiting events found dispatching network-vif-plugged-93b50b64-d7f2-48d0-bedb-ce1f6f5f44d5 {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 09:46:26 user nova-compute[75229]: WARNING nova.compute.manager [req-7dafda5a-b52a-4bb6-b4bc-05d495bdc866 req-e5a8ea89-239e-44d6-a5c3-e53b62d34bf3 service nova] [instance: c9d3e03d-be75-44b1-97b4-36c13715175b] Received unexpected event network-vif-plugged-93b50b64-d7f2-48d0-bedb-ce1f6f5f44d5 for instance with vm_state deleted and task_state None.
Nov 14 09:46:26 user nova-compute[75229]: DEBUG nova.compute.manager [req-7dafda5a-b52a-4bb6-b4bc-05d495bdc866 req-e5a8ea89-239e-44d6-a5c3-e53b62d34bf3 service nova] [instance: c9d3e03d-be75-44b1-97b4-36c13715175b] Received event network-vif-deleted-93b50b64-d7f2-48d0-bedb-ce1f6f5f44d5 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:46:26 user nova-compute[75229]: DEBUG nova.network.neutron [req-ac9a0149-04a9-43d5-bd7d-2b529e0382a5 req-34ebf3a5-ff4d-447a-8c36-dca855c71a53 service nova] [instance: 8623fdcc-99b7-44d6-ad81-dada5ba83a88] Updated VIF entry in instance network info cache for port 30dd46f1-cc37-46dd-a47e-0bc23a724804. {{(pid=75229) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 09:46:26 user nova-compute[75229]: DEBUG nova.network.neutron [req-ac9a0149-04a9-43d5-bd7d-2b529e0382a5 req-34ebf3a5-ff4d-447a-8c36-dca855c71a53 service nova] [instance: 8623fdcc-99b7-44d6-ad81-dada5ba83a88] Updating instance_info_cache with network_info: [{"id": "30dd46f1-cc37-46dd-a47e-0bc23a724804", "address": "fa:16:3e:86:32:73", "network": {"id": "6c0e2cbe-bbea-4552-a531-80981937bc7d", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-995922753-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7e2a5354424047a8a460451f7fd08233", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30dd46f1-cc", "ovs_interfaceid": "30dd46f1-cc37-46dd-a47e-0bc23a724804", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 09:46:26 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-ac9a0149-04a9-43d5-bd7d-2b529e0382a5 req-34ebf3a5-ff4d-447a-8c36-dca855c71a53 service nova] Releasing lock "refresh_cache-8623fdcc-99b7-44d6-ad81-dada5ba83a88" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 09:46:26 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-228dcd15-94ef-4720-adce-ebf479a4b6c7 tempest-VolumesAssistedSnapshotsTest-1584778058 tempest-VolumesAssistedSnapshotsTest-1584778058-project-admin] Acquiring lock "8623fdcc-99b7-44d6-ad81-dada5ba83a88" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:46:26 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-228dcd15-94ef-4720-adce-ebf479a4b6c7 tempest-VolumesAssistedSnapshotsTest-1584778058 tempest-VolumesAssistedSnapshotsTest-1584778058-project-admin] Lock "8623fdcc-99b7-44d6-ad81-dada5ba83a88" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:46:26 user nova-compute[75229]: INFO nova.compute.manager [None req-228dcd15-94ef-4720-adce-ebf479a4b6c7 tempest-VolumesAssistedSnapshotsTest-1584778058 tempest-VolumesAssistedSnapshotsTest-1584778058-project-admin] [instance: 8623fdcc-99b7-44d6-ad81-dada5ba83a88] Attaching volume c7022511-a003-46d5-bcc1-064be770a829 to /dev/vdb
Nov 14 09:46:26 user nova-compute[75229]: DEBUG os_brick.utils [None req-228dcd15-94ef-4720-adce-ebf479a4b6c7 tempest-VolumesAssistedSnapshotsTest-1584778058 tempest-VolumesAssistedSnapshotsTest-1584778058-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 09:46:26 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:46:26 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:46:26 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[c90329aa-a9b0-4006-b8be-2feb44a06776]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f1154031c835\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:46:26 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:46:26 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:46:26 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff6217fe-4292-4b2c-9651-ca044ce1eb1f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:46:26 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:46:26 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:46:26 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0bfbaf3-216e-4fe7-a26e-5bfd9f10ba8f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:46:26 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[02eda788-5db8-49b0-bc2c-629dbcf45e0d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:46:26 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-228dcd15-94ef-4720-adce-ebf479a4b6c7 tempest-VolumesAssistedSnapshotsTest-1584778058 tempest-VolumesAssistedSnapshotsTest-1584778058-project-admin] Running cmd (subprocess): nvme version {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:46:26 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-228dcd15-94ef-4720-adce-ebf479a4b6c7 tempest-VolumesAssistedSnapshotsTest-1584778058 tempest-VolumesAssistedSnapshotsTest-1584778058-project-admin] 'nvme version' failed. Not Retrying. {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 09:46:26 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.nvmeof [None req-228dcd15-94ef-4720-adce-ebf479a4b6c7 tempest-VolumesAssistedSnapshotsTest-1584778058 tempest-VolumesAssistedSnapshotsTest-1584778058-project-admin] nvme not present on system {{(pid=75229) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 09:46:26 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:46:26 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 09:46:26 user nova-compute[75229]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 09:46:26 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[d795488e-57fe-4166-81fb-1f510895f0b3]: (4, '') {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:46:26 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.lightos [None req-228dcd15-94ef-4720-adce-ebf479a4b6c7 tempest-VolumesAssistedSnapshotsTest-1584778058 tempest-VolumesAssistedSnapshotsTest-1584778058-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75229) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 09:46:26 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.lightos [None req-228dcd15-94ef-4720-adce-ebf479a4b6c7 tempest-VolumesAssistedSnapshotsTest-1584778058 tempest-VolumesAssistedSnapshotsTest-1584778058-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75229) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 09:46:26 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.lightos [None req-228dcd15-94ef-4720-adce-ebf479a4b6c7 tempest-VolumesAssistedSnapshotsTest-1584778058 tempest-VolumesAssistedSnapshotsTest-1584778058-project-admin] LIGHTOS: no hostnqn found. {{(pid=75229) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 09:46:26 user nova-compute[75229]: DEBUG os_brick.utils [None req-228dcd15-94ef-4720-adce-ebf479a4b6c7 tempest-VolumesAssistedSnapshotsTest-1584778058 tempest-VolumesAssistedSnapshotsTest-1584778058-project-admin] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f1154031c835', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 09:46:26 user nova-compute[75229]: DEBUG nova.virt.block_device [None req-228dcd15-94ef-4720-adce-ebf479a4b6c7 tempest-VolumesAssistedSnapshotsTest-1584778058 tempest-VolumesAssistedSnapshotsTest-1584778058-project-admin] [instance: 8623fdcc-99b7-44d6-ad81-dada5ba83a88] Updating existing volume attachment record: 8c0d272e-dc93-4fe8-a4e3-43366c198f51 {{(pid=75229) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 09:46:27 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:46:27 user nova-compute[75229]: WARNING nova.virt.libvirt.driver [None req-4b352d56-a679-405a-b2cf-a9499ba8ad6d tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance eb53ba25-d865-41ae-90f3-6e154e2778ba is timed out.
Nov 14 09:46:27 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-4b352d56-a679-405a-b2cf-a9499ba8ad6d tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] Successfully detached device vdb from instance eb53ba25-d865-41ae-90f3-6e154e2778ba from the live domain config.
Nov 14 09:46:27 user nova-compute[75229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4b352d56-a679-405a-b2cf-a9499ba8ad6d tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] [instance: eb53ba25-d865-41ae-90f3-6e154e2778ba] calling os-brick to detach iSCSI Volume {{(pid=75229) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 09:46:27 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b352d56-a679-405a-b2cf-a9499ba8ad6d tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f73f85151b0>, {'target_iqn': 'iqn.2010-10.org.openstack:6d564ec4-7fbb-40b5-9085-41e3720c3a3b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IWuHSLTF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 09:46:27 user nova-compute[75229]: WARNING os_brick.initiator.connectors.base [None req-4b352d56-a679-405a-b2cf-a9499ba8ad6d tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 09:46:27 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-4b352d56-a679-405a-b2cf-a9499ba8ad6d tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 09:46:27 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-4b352d56-a679-405a-b2cf-a9499ba8ad6d tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 09:46:27 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:46:27 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.028s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:46:27 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[0529347c-6d61-4bb1-8f67-5f6c360ec6c6]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c2324d4e-6e60-47fd-b536-144a7ea32dce\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:52ae1fea-5339-4958-88ae-d103080e7743\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:72bed504-5114-4179-b266-7cae18a4f75b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:97f588de-32d5-4d48-9c06-5925263ba117\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:18a1e95e-5df1-4db1-92bc-6cd67729c7a7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6d564ec4-7fbb-40b5-9085-41e3720c3a3b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7144f229-1f5e-4155-aba1-ab44218df41a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:46:27 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b352d56-a679-405a-b2cf-a9499ba8ad6d tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 09:46:27 user nova-compute[75229]: No targets found.
Nov 14 09:46:27 user nova-compute[75229]: iSNS:
Nov 14 09:46:27 user nova-compute[75229]: No targets found.
Nov 14 09:46:27 user nova-compute[75229]: STATIC:
Nov 14 09:46:27 user nova-compute[75229]: Target: iqn.2010-10.org.openstack:c2324d4e-6e60-47fd-b536-144a7ea32dce
Nov 14 09:46:27 user nova-compute[75229]:         Portal: 172.16.0.220:3260,-1
Nov 14 09:46:27 user nova-compute[75229]:                 Iface Name: default
Nov 14 09:46:27 user nova-compute[75229]: Target: iqn.2010-10.org.openstack:52ae1fea-5339-4958-88ae-d103080e7743
Nov 14 09:46:27 user nova-compute[75229]:         Portal: 172.16.0.220:3260,-1
Nov 14 09:46:27 user nova-compute[75229]:                 Iface Name: default
Nov 14 09:46:27 user nova-compute[75229]: Target: iqn.2010-10.org.openstack:72bed504-5114-4179-b266-7cae18a4f75b
Nov 14 09:46:27 user nova-compute[75229]:         Portal: 172.16.0.220:3260,-1
Nov 14 09:46:27 user nova-compute[75229]:                 Iface Name: default
Nov 14 09:46:27 user nova-compute[75229]: Target: iqn.2010-10.org.openstack:97f588de-32d5-4d48-9c06-5925263ba117
Nov 14 09:46:27 user nova-compute[75229]:         Portal: 172.16.0.220:3260,-1
Nov 14 09:46:27 user nova-compute[75229]:                 Iface Name: default
Nov 14 09:46:27 user nova-compute[75229]: Target: iqn.2010-10.org.openstack:18a1e95e-5df1-4db1-92bc-6cd67729c7a7
Nov 14 09:46:27 user nova-compute[75229]:         Portal: 172.16.0.220:3260,-1
Nov 14 09:46:27 user nova-compute[75229]:                 Iface Name: default
Nov 14 09:46:27 user nova-compute[75229]: Target: iqn.2010-10.org.openstack:6d564ec4-7fbb-40b5-9085-41e3720c3a3b
Nov 14 09:46:27 user nova-compute[75229]:         Portal: 172.16.0.220:3260,-1
Nov 14 09:46:27 user nova-compute[75229]:                 Iface Name: default
Nov 14 09:46:27 user nova-compute[75229]: Target: iqn.2010-10.org.openstack:7144f229-1f5e-4155-aba1-ab44218df41a
Nov 14 09:46:27 user nova-compute[75229]:         Portal: 172.16.0.220:3260,-1
Nov 14 09:46:27 user nova-compute[75229]:                 Iface Name: default
Nov 14 09:46:27 user nova-compute[75229]: FIRMWARE:
Nov 14 09:46:27 user nova-compute[75229]: No targets found.
Nov 14 09:46:27 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 09:46:27 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b352d56-a679-405a-b2cf-a9499ba8ad6d tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 09:46:27 user nova-compute[75229]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 09:46:27 user nova-compute[75229]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75229) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 09:46:27 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b352d56-a679-405a-b2cf-a9499ba8ad6d tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6d564ec4-7fbb-40b5-9085-41e3720c3a3b', 0)] {{(pid=75229) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 09:46:27 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:46:27 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:46:27 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[384dbd62-d7a0-4d45-a9c5-9518c118f30d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:18a1e95e-5df1-4db1-92bc-6cd67729c7a7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:52ae1fea-5339-4958-88ae-d103080e7743\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6d564ec4-7fbb-40b5-9085-41e3720c3a3b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7144f229-1f5e-4155-aba1-ab44218df41a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:72bed504-5114-4179-b266-7cae18a4f75b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:97f588de-32d5-4d48-9c06-5925263ba117\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c2324d4e-6e60-47fd-b536-144a7ea32dce\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:46:27 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:46:27 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:46:27 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4915d75-3d62-4f7f-adad-c5a3e1c8ba52]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2324d4e-6e60-47fd-b536-144a7ea32dce (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18a1e95e-5df1-4db1-92bc-6cd67729c7a7 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97f588de-32d5-4d48-9c06-5925263ba117 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d564ec4-7fbb-40b5-9085-41e3720c3a3b (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72bed504-5114-4179-b266-7cae18a4f75b (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7144f229-1f5e-4155-aba1-ab44218df41a (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52ae1fea-5339-4958-88ae-d103080e7743 (non-flash)\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:46:27 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b352d56-a679-405a-b2cf-a9499ba8ad6d tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2324d4e-6e60-47fd-b536-144a7ea32dce (non-flash)
Nov 14 09:46:27 user nova-compute[75229]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18a1e95e-5df1-4db1-92bc-6cd67729c7a7 (non-flash)
Nov 14 09:46:27 user nova-compute[75229]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97f588de-32d5-4d48-9c06-5925263ba117 (non-flash)
Nov 14 09:46:27 user nova-compute[75229]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d564ec4-7fbb-40b5-9085-41e3720c3a3b (non-flash)
Nov 14 09:46:27 user nova-compute[75229]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72bed504-5114-4179-b266-7cae18a4f75b (non-flash)
Nov 14 09:46:27 user nova-compute[75229]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7144f229-1f5e-4155-aba1-ab44218df41a (non-flash)
Nov 14 09:46:27 user nova-compute[75229]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52ae1fea-5339-4958-88ae-d103080e7743 (non-flash)
Nov 14 09:46:27 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 09:46:27 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b352d56-a679-405a-b2cf-a9499ba8ad6d tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2324d4e-6e60-47fd-b536-144a7ea32dce (non-flash)
Nov 14 09:46:27 user nova-compute[75229]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18a1e95e-5df1-4db1-92bc-6cd67729c7a7 (non-flash)
Nov 14 09:46:27 user nova-compute[75229]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97f588de-32d5-4d48-9c06-5925263ba117 (non-flash)
Nov 14 09:46:27 user nova-compute[75229]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d564ec4-7fbb-40b5-9085-41e3720c3a3b (non-flash)
Nov 14 09:46:27 user nova-compute[75229]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72bed504-5114-4179-b266-7cae18a4f75b (non-flash)
Nov 14 09:46:27 user nova-compute[75229]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7144f229-1f5e-4155-aba1-ab44218df41a (non-flash)
Nov 14 09:46:27 user nova-compute[75229]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52ae1fea-5339-4958-88ae-d103080e7743 (non-flash)
Nov 14 09:46:27 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 09:46:27 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b352d56-a679-405a-b2cf-a9499ba8ad6d tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f73f85c7130>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6d564ec4-7fbb-40b5-9085-41e3720c3a3b'): ({'sde'}, set())}) {{(pid=75229) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 09:46:27 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-4b352d56-a679-405a-b2cf-a9499ba8ad6d tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] Removing single pathed devices sde {{(pid=75229) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 09:46:27 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:46:27 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:46:28 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b2284b9-aa97-48e2-b376-dfdef9c6c5b1]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:46:28 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:46:28 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.017s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:46:28 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[0aaedf4b-ecd4-45cb-a46c-91c65e2e32ba]: (4, ('ok\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:46:28 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-4b352d56-a679-405a-b2cf-a9499ba8ad6d tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] Flushing IO for device /dev/sde {{(pid=75229) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 09:46:28 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:46:28 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.012s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:46:28 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0eaf7d7-46f7-4881-8c96-9d39e4ab86ba]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:46:28 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-4b352d56-a679-405a-b2cf-a9499ba8ad6d tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75229) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 09:46:28 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:46:28 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.046s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:46:28 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2478fc8-0ffa-4f31-97e8-c35bbff0b44f]: (4, ('1', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:46:28 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-4b352d56-a679-405a-b2cf-a9499ba8ad6d tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75229) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 09:46:28 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-4b352d56-a679-405a-b2cf-a9499ba8ad6d tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] SCSI volumes sde have been removed. {{(pid=75229) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 09:46:28 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b352d56-a679-405a-b2cf-a9499ba8ad6d tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6d564ec4-7fbb-40b5-9085-41e3720c3a3b')] {{(pid=75229) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 09:46:28 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d564ec4-7fbb-40b5-9085-41e3720c3a3b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:46:28 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d564ec4-7fbb-40b5-9085-41e3720c3a3b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:46:28 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa4edd2c-b81d-486d-9182-3cdcf7045768]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:46:28 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b352d56-a679-405a-b2cf-a9499ba8ad6d tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:46:28 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d564ec4-7fbb-40b5-9085-41e3720c3a3b -p 172.16.0.220:3260 --logout {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:46:28 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d564ec4-7fbb-40b5-9085-41e3720c3a3b -p 172.16.0.220:3260 --logout" returned: 0 in 0.088s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:46:28 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[de4161c7-f714-4e1d-8891-95a8c13404e7]: (4, ('Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:6d564ec4-7fbb-40b5-9085-41e3720c3a3b, portal: 172.16.0.220,3260]\nLogout of [sid: 6, target: iqn.2010-10.org.openstack:6d564ec4-7fbb-40b5-9085-41e3720c3a3b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:46:28 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b352d56-a679-405a-b2cf-a9499ba8ad6d tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:6d564ec4-7fbb-40b5-9085-41e3720c3a3b, portal: 172.16.0.220,3260]
Nov 14 09:46:28 user nova-compute[75229]: Logout of [sid: 6, target: iqn.2010-10.org.openstack:6d564ec4-7fbb-40b5-9085-41e3720c3a3b, portal: 172.16.0.220,3260] successful.
Nov 14 09:46:28 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:46:28 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d564ec4-7fbb-40b5-9085-41e3720c3a3b -p 172.16.0.220:3260 --op delete {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:46:28 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d564ec4-7fbb-40b5-9085-41e3720c3a3b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:46:28 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[11021104-3b3f-4ce6-980d-ffde793bbb5b]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:46:28 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b352d56-a679-405a-b2cf-a9499ba8ad6d tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:46:28 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-4b352d56-a679-405a-b2cf-a9499ba8ad6d tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.357s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 09:46:28 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b352d56-a679-405a-b2cf-a9499ba8ad6d tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] <== disconnect_volume: return (360ms) None {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 09:46:28 user nova-compute[75229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4b352d56-a679-405a-b2cf-a9499ba8ad6d tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] [instance: eb53ba25-d865-41ae-90f3-6e154e2778ba] Disconnected iSCSI Volume {{(pid=75229) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 09:46:29 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:46:30 user nova-compute[75229]: DEBUG nova.objects.instance [None req-4b352d56-a679-405a-b2cf-a9499ba8ad6d tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] Lazy-loading 'flavor' on Instance uuid eb53ba25-d865-41ae-90f3-6e154e2778ba {{(pid=75229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 09:46:30 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-4b352d56-a679-405a-b2cf-a9499ba8ad6d tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] Lock "eb53ba25-d865-41ae-90f3-6e154e2778ba" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 23.033s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:46:30 user nova-compute[75229]: DEBUG nova.compute.manager [None req-46a6734f-557c-4e1b-a94f-736be046e361 tempest-TestVolumeSwap-1816306665 tempest-TestVolumeSwap-1816306665-project-admin] [instance: c307660b-01bb-471b-9e2e-5c2aaca65287] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:e2472759-033a-4051-9dec-4516d0aef07d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JCKHSoDN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'c307660b-01bb-471b-9e2e-5c2aaca65287', 'attached_at': '', 'detached_at': '', 'volume_id': 'e2472759-033a-4051-9dec-4516d0aef07d', 'serial': 'e2472759-033a-4051-9dec-4516d0aef07d'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:52ae1fea-5339-4958-88ae-d103080e7743', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xkXQEUcf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, 'status': 'reserved', 'instance': 'c307660b-01bb-471b-9e2e-5c2aaca65287', 'attached_at': '', 'detached_at': '', 'volume_id': '52ae1fea-5339-4958-88ae-d103080e7743', 'serial'} {{(pid=75229) _swap_volume /opt/stack/nova/nova/compute/manager.py:7782}}
Nov 14 09:46:30 user nova-compute[75229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-46a6734f-557c-4e1b-a94f-736be046e361 tempest-TestVolumeSwap-1816306665 tempest-TestVolumeSwap-1816306665-project-admin] [instance: c307660b-01bb-471b-9e2e-5c2aaca65287] Calling os-brick to attach iSCSI Volume {{(pid=75229) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 09:46:30 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-46a6734f-557c-4e1b-a94f-736be046e361 tempest-TestVolumeSwap-1816306665 tempest-TestVolumeSwap-1816306665-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f73f85151b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e2472759-033a-4051-9dec-4516d0aef07d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JCKHSoDN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 09:46:30 user nova-compute[75229]: WARNING os_brick.initiator.connectors.base [None req-46a6734f-557c-4e1b-a94f-736be046e361 tempest-TestVolumeSwap-1816306665 tempest-TestVolumeSwap-1816306665-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 09:46:30 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-46a6734f-557c-4e1b-a94f-736be046e361 tempest-TestVolumeSwap-1816306665 tempest-TestVolumeSwap-1816306665-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 09:46:30 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-46a6734f-557c-4e1b-a94f-736be046e361 tempest-TestVolumeSwap-1816306665 tempest-TestVolumeSwap-1816306665-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 09:46:30 user nova-compute[75229]: WARNING os_brick.initiator.connectors.base [None req-46a6734f-557c-4e1b-a94f-736be046e361 tempest-TestVolumeSwap-1816306665 tempest-TestVolumeSwap-1816306665-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 09:46:30 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-46a6734f-557c-4e1b-a94f-736be046e361 tempest-TestVolumeSwap-1816306665 tempest-TestVolumeSwap-1816306665-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e2472759-033a-4051-9dec-4516d0aef07d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 09:46:30 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-46a6734f-557c-4e1b-a94f-736be046e361 tempest-TestVolumeSwap-1816306665 tempest-TestVolumeSwap-1816306665-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e2472759-033a-4051-9dec-4516d0aef07d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 09:46:30 user nova-compute[75229]: INFO os_brick.initiator.connectors.iscsi [None req-46a6734f-557c-4e1b-a94f-736be046e361 tempest-TestVolumeSwap-1816306665 tempest-TestVolumeSwap-1816306665-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 09:46:30 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2472759-033a-4051-9dec-4516d0aef07d -p 172.16.0.220:3260 {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:46:30 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2472759-033a-4051-9dec-4516d0aef07d -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:46:30 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[157bf907-b634-4586-9115-555ecbfd43cd]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:46:30 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-46a6734f-557c-4e1b-a94f-736be046e361 tempest-TestVolumeSwap-1816306665 tempest-TestVolumeSwap-1816306665-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 09:46:30 user nova-compute[75229]:  {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:46:30 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2472759-033a-4051-9dec-4516d0aef07d -p 172.16.0.220:3260 --interface default --op new {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:46:30 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2472759-033a-4051-9dec-4516d0aef07d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:46:30 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab0f02bf-21d1-4d2a-89e8-31d3dad89864]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e2472759-033a-4051-9dec-4516d0aef07d] added\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:46:30 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-46a6734f-557c-4e1b-a94f-736be046e361 tempest-TestVolumeSwap-1816306665 tempest-TestVolumeSwap-1816306665-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e2472759-033a-4051-9dec-4516d0aef07d] added
Nov 14 09:46:30 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:46:30 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2472759-033a-4051-9dec-4516d0aef07d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:46:30 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2472759-033a-4051-9dec-4516d0aef07d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:46:30 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6cbddf2-a7c7-4894-ba12-7e35430ff909]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:46:30 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-46a6734f-557c-4e1b-a94f-736be046e361 tempest-TestVolumeSwap-1816306665 tempest-TestVolumeSwap-1816306665-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:46:30 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2472759-033a-4051-9dec-4516d0aef07d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:46:30 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2472759-033a-4051-9dec-4516d0aef07d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:46:30 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[37675e26-ff95-41be-b83a-57169a0dac23]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:46:30 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-46a6734f-557c-4e1b-a94f-736be046e361 tempest-TestVolumeSwap-1816306665 tempest-TestVolumeSwap-1816306665-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:46:30 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2472759-033a-4051-9dec-4516d0aef07d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JCKHSoDN {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:46:30 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2472759-033a-4051-9dec-4516d0aef07d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JCKHSoDN" returned: 0 in 0.018s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:46:30 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2a6dd9c-8c20-474e-8c8e-1b9f622ea18e]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:46:30 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-46a6734f-557c-4e1b-a94f-736be046e361 tempest-TestVolumeSwap-1816306665 tempest-TestVolumeSwap-1816306665-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'JCKHSoDN'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:46:30 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2472759-033a-4051-9dec-4516d0aef07d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:46:30 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2472759-033a-4051-9dec-4516d0aef07d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:46:30 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1f6a01c-8bb7-4e2b-8f4e-7ca3e2020007]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:46:30 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-46a6734f-557c-4e1b-a94f-736be046e361 tempest-TestVolumeSwap-1816306665 tempest-TestVolumeSwap-1816306665-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:46:30 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:46:30 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:46:30 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[984a26ae-874f-433d-87c8-81e122470895]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2324d4e-6e60-47fd-b536-144a7ea32dce (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18a1e95e-5df1-4db1-92bc-6cd67729c7a7 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97f588de-32d5-4d48-9c06-5925263ba117 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72bed504-5114-4179-b266-7cae18a4f75b (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7144f229-1f5e-4155-aba1-ab44218df41a (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52ae1fea-5339-4958-88ae-d103080e7743 (non-flash)\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:46:30 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-46a6734f-557c-4e1b-a94f-736be046e361 tempest-TestVolumeSwap-1816306665 tempest-TestVolumeSwap-1816306665-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2324d4e-6e60-47fd-b536-144a7ea32dce (non-flash)
Nov 14 09:46:30 user nova-compute[75229]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18a1e95e-5df1-4db1-92bc-6cd67729c7a7 (non-flash)
Nov 14 09:46:30 user nova-compute[75229]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97f588de-32d5-4d48-9c06-5925263ba117 (non-flash)
Nov 14 09:46:30 user nova-compute[75229]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72bed504-5114-4179-b266-7cae18a4f75b (non-flash)
Nov 14 09:46:30 user nova-compute[75229]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7144f229-1f5e-4155-aba1-ab44218df41a (non-flash)
Nov 14 09:46:30 user nova-compute[75229]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52ae1fea-5339-4958-88ae-d103080e7743 (non-flash)
Nov 14 09:46:30 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 09:46:30 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-46a6734f-557c-4e1b-a94f-736be046e361 tempest-TestVolumeSwap-1816306665 tempest-TestVolumeSwap-1816306665-project-admin] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2324d4e-6e60-47fd-b536-144a7ea32dce (non-flash)
Nov 14 09:46:30 user nova-compute[75229]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18a1e95e-5df1-4db1-92bc-6cd67729c7a7 (non-flash)
Nov 14 09:46:30 user nova-compute[75229]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97f588de-32d5-4d48-9c06-5925263ba117 (non-flash)
Nov 14 09:46:30 user nova-compute[75229]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72bed504-5114-4179-b266-7cae18a4f75b (non-flash)
Nov 14 09:46:30 user nova-compute[75229]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7144f229-1f5e-4155-aba1-ab44218df41a (non-flash)
Nov 14 09:46:30 user nova-compute[75229]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52ae1fea-5339-4958-88ae-d103080e7743 (non-flash)
Nov 14 09:46:30 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 09:46:30 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2472759-033a-4051-9dec-4516d0aef07d -p 172.16.0.220:3260 --login {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:46:30 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2472759-033a-4051-9dec-4516d0aef07d -p 172.16.0.220:3260 --login" returned: 0 in 0.076s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:46:30 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[86d32b0e-7d2d-495a-a2f2-91e0d175bbcf]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e2472759-033a-4051-9dec-4516d0aef07d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e2472759-033a-4051-9dec-4516d0aef07d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:46:30 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-46a6734f-557c-4e1b-a94f-736be046e361 tempest-TestVolumeSwap-1816306665 tempest-TestVolumeSwap-1816306665-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e2472759-033a-4051-9dec-4516d0aef07d, portal: 172.16.0.220,3260]
Nov 14 09:46:30 user nova-compute[75229]: Login to [iface: default, target: iqn.2010-10.org.openstack:e2472759-033a-4051-9dec-4516d0aef07d, portal: 172.16.0.220,3260] successful.
Nov 14 09:46:30 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:46:30 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2472759-033a-4051-9dec-4516d0aef07d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:46:30 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2472759-033a-4051-9dec-4516d0aef07d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:46:30 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ac0310f-af9b-47b3-8f0d-a1b716daddaf]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:46:30 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-46a6734f-557c-4e1b-a94f-736be046e361 tempest-TestVolumeSwap-1816306665 tempest-TestVolumeSwap-1816306665-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:46:30 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:46:30 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:46:30 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba98ff1b-c8bf-4306-8b03-f165bec3414e]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2472759-033a-4051-9dec-4516d0aef07d (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2324d4e-6e60-47fd-b536-144a7ea32dce (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18a1e95e-5df1-4db1-92bc-6cd67729c7a7 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97f588de-32d5-4d48-9c06-5925263ba117 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72bed504-5114-4179-b266-7cae18a4f75b (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7144f229-1f5e-4155-aba1-ab44218df41a (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52ae1fea-5339-4958-88ae-d103080e7743 (non-flash)\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:46:30 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-46a6734f-557c-4e1b-a94f-736be046e361 tempest-TestVolumeSwap-1816306665 tempest-TestVolumeSwap-1816306665-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2472759-033a-4051-9dec-4516d0aef07d (non-flash)
Nov 14 09:46:30 user nova-compute[75229]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2324d4e-6e60-47fd-b536-144a7ea32dce (non-flash)
Nov 14 09:46:30 user nova-compute[75229]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18a1e95e-5df1-4db1-92bc-6cd67729c7a7 (non-flash)
Nov 14 09:46:30 user nova-compute[75229]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97f588de-32d5-4d48-9c06-5925263ba117 (non-flash)
Nov 14 09:46:30 user nova-compute[75229]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72bed504-5114-4179-b266-7cae18a4f75b (non-flash)
Nov 14 09:46:30 user nova-compute[75229]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7144f229-1f5e-4155-aba1-ab44218df41a (non-flash)
Nov 14 09:46:30 user nova-compute[75229]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52ae1fea-5339-4958-88ae-d103080e7743 (non-flash)
Nov 14 09:46:30 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 09:46:30 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-46a6734f-557c-4e1b-a94f-736be046e361 tempest-TestVolumeSwap-1816306665 tempest-TestVolumeSwap-1816306665-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2472759-033a-4051-9dec-4516d0aef07d (non-flash)
Nov 14 09:46:30 user nova-compute[75229]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2324d4e-6e60-47fd-b536-144a7ea32dce (non-flash)
Nov 14 09:46:30 user nova-compute[75229]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18a1e95e-5df1-4db1-92bc-6cd67729c7a7 (non-flash)
Nov 14 09:46:30 user nova-compute[75229]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97f588de-32d5-4d48-9c06-5925263ba117 (non-flash)
Nov 14 09:46:30 user nova-compute[75229]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72bed504-5114-4179-b266-7cae18a4f75b (non-flash)
Nov 14 09:46:30 user nova-compute[75229]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7144f229-1f5e-4155-aba1-ab44218df41a (non-flash)
Nov 14 09:46:30 user nova-compute[75229]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52ae1fea-5339-4958-88ae-d103080e7743 (non-flash)
Nov 14 09:46:30 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 09:46:30 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-46a6734f-557c-4e1b-a94f-736be046e361 tempest-TestVolumeSwap-1816306665 tempest-TestVolumeSwap-1816306665-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e2472759-033a-4051-9dec-4516d0aef07d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.306s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 09:46:30 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-46a6734f-557c-4e1b-a94f-736be046e361 tempest-TestVolumeSwap-1816306665 tempest-TestVolumeSwap-1816306665-project-admin] Connected to 172.16.0.220:3260 {{(pid=75229) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 09:46:30 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-46a6734f-557c-4e1b-a94f-736be046e361 tempest-TestVolumeSwap-1816306665 tempest-TestVolumeSwap-1816306665-project-admin] HCTL ('36', '-', '-', 0) found on session 10 with lun 0 {{(pid=75229) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 09:46:30 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-46a6734f-557c-4e1b-a94f-736be046e361 tempest-TestVolumeSwap-1816306665 tempest-TestVolumeSwap-1816306665-project-admin] Scanning host 36 c: -, t: -, l: 0) {{(pid=75229) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 09:46:30 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:46:30 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.015s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:46:30 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[70b5961b-7953-4e2a-9009-d285c5a5ef51]: (4, ('- - 0', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:46:30 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-46a6734f-557c-4e1b-a94f-736be046e361 tempest-TestVolumeSwap-1816306665 tempest-TestVolumeSwap-1816306665-project-admin] Searching for a device in session 10 and hctl ['36', '*', '*', 0] yield: None {{(pid=75229) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 09:46:30 user nova-compute[75229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-228dcd15-94ef-4720-adce-ebf479a4b6c7 tempest-VolumesAssistedSnapshotsTest-1584778058 tempest-VolumesAssistedSnapshotsTest-1584778058-project-admin] [instance: 8623fdcc-99b7-44d6-ad81-dada5ba83a88] Calling os-brick to attach iSCSI Volume {{(pid=75229) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 09:46:30 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-228dcd15-94ef-4720-adce-ebf479a4b6c7 tempest-VolumesAssistedSnapshotsTest-1584778058 tempest-VolumesAssistedSnapshotsTest-1584778058-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f73f85151b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c7022511-a003-46d5-bcc1-064be770a829', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uzVNLYUt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 09:46:30 user nova-compute[75229]: WARNING os_brick.initiator.connectors.base [None req-228dcd15-94ef-4720-adce-ebf479a4b6c7 tempest-VolumesAssistedSnapshotsTest-1584778058 tempest-VolumesAssistedSnapshotsTest-1584778058-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 09:46:30 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-228dcd15-94ef-4720-adce-ebf479a4b6c7 tempest-VolumesAssistedSnapshotsTest-1584778058 tempest-VolumesAssistedSnapshotsTest-1584778058-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 09:46:31 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-46a6734f-557c-4e1b-a94f-736be046e361 tempest-TestVolumeSwap-1816306665 tempest-TestVolumeSwap-1816306665-project-admin] Searching for a device in session 10 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75229) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 09:46:31 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-46a6734f-557c-4e1b-a94f-736be046e361 tempest-TestVolumeSwap-1816306665 tempest-TestVolumeSwap-1816306665-project-admin] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:e2472759-033a-4051-9dec-4516d0aef07d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JCKHSoDN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75229) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 09:46:31 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-46a6734f-557c-4e1b-a94f-736be046e361 tempest-TestVolumeSwap-1816306665 tempest-TestVolumeSwap-1816306665-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.335s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 09:46:31 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-46a6734f-557c-4e1b-a94f-736be046e361 tempest-TestVolumeSwap-1816306665 tempest-TestVolumeSwap-1816306665-project-admin] <== connect_volume: return (1336ms) {'type': 'block', 'scsi_wwn': '23431343437613839', 'path': '/dev/sde'} {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 09:46:31 user nova-compute[75229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-46a6734f-557c-4e1b-a94f-736be046e361 tempest-TestVolumeSwap-1816306665 tempest-TestVolumeSwap-1816306665-project-admin] [instance: c307660b-01bb-471b-9e2e-5c2aaca65287] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23431343437613839', 'path': '/dev/sde'} {{(pid=75229) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 09:46:31 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-228dcd15-94ef-4720-adce-ebf479a4b6c7 tempest-VolumesAssistedSnapshotsTest-1584778058 tempest-VolumesAssistedSnapshotsTest-1584778058-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.922s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 09:46:31 user nova-compute[75229]: WARNING os_brick.initiator.connectors.base [None req-228dcd15-94ef-4720-adce-ebf479a4b6c7 tempest-VolumesAssistedSnapshotsTest-1584778058 tempest-VolumesAssistedSnapshotsTest-1584778058-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 09:46:31 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-228dcd15-94ef-4720-adce-ebf479a4b6c7 tempest-VolumesAssistedSnapshotsTest-1584778058 tempest-VolumesAssistedSnapshotsTest-1584778058-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c7022511-a003-46d5-bcc1-064be770a829" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 09:46:31 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-228dcd15-94ef-4720-adce-ebf479a4b6c7 tempest-VolumesAssistedSnapshotsTest-1584778058 tempest-VolumesAssistedSnapshotsTest-1584778058-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c7022511-a003-46d5-bcc1-064be770a829" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 09:46:31 user nova-compute[75229]: INFO os_brick.initiator.connectors.iscsi [None req-228dcd15-94ef-4720-adce-ebf479a4b6c7 tempest-VolumesAssistedSnapshotsTest-1584778058 tempest-VolumesAssistedSnapshotsTest-1584778058-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 09:46:31 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7022511-a003-46d5-bcc1-064be770a829 -p 172.16.0.220:3260 {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:46:31 user nova-compute[75229]: DEBUG nova.objects.instance [None req-46a6734f-557c-4e1b-a94f-736be046e361 tempest-TestVolumeSwap-1816306665 tempest-TestVolumeSwap-1816306665-project-admin] Lazy-loading 'flavor' on Instance uuid c307660b-01bb-471b-9e2e-5c2aaca65287 {{(pid=75229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 09:46:31 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7022511-a003-46d5-bcc1-064be770a829 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:46:31 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[abcf3796-50b4-4a84-b255-378c25df9e18]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:46:31 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-228dcd15-94ef-4720-adce-ebf479a4b6c7 tempest-VolumesAssistedSnapshotsTest-1584778058 tempest-VolumesAssistedSnapshotsTest-1584778058-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 09:46:31 user nova-compute[75229]:  {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:46:31 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7022511-a003-46d5-bcc1-064be770a829 -p 172.16.0.220:3260 --interface default --op new {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:46:31 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7022511-a003-46d5-bcc1-064be770a829 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:46:31 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a0e541e-56cb-46a6-9e78-40fc9dd8f180]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c7022511-a003-46d5-bcc1-064be770a829] added\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:46:31 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-228dcd15-94ef-4720-adce-ebf479a4b6c7 tempest-VolumesAssistedSnapshotsTest-1584778058 tempest-VolumesAssistedSnapshotsTest-1584778058-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c7022511-a003-46d5-bcc1-064be770a829] added
Nov 14 09:46:31 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:46:31 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7022511-a003-46d5-bcc1-064be770a829 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:46:31 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7022511-a003-46d5-bcc1-064be770a829 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:46:31 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[29692792-8568-4c51-871f-dfeea0f1a65a]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:46:31 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-228dcd15-94ef-4720-adce-ebf479a4b6c7 tempest-VolumesAssistedSnapshotsTest-1584778058 tempest-VolumesAssistedSnapshotsTest-1584778058-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:46:31 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7022511-a003-46d5-bcc1-064be770a829 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:46:31 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7022511-a003-46d5-bcc1-064be770a829 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:46:31 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3c38228-e744-4af2-bd6a-9a1a55c0d9b0]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:46:31 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-228dcd15-94ef-4720-adce-ebf479a4b6c7 tempest-VolumesAssistedSnapshotsTest-1584778058 tempest-VolumesAssistedSnapshotsTest-1584778058-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:46:31 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7022511-a003-46d5-bcc1-064be770a829 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uzVNLYUt {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:46:31 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7022511-a003-46d5-bcc1-064be770a829 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uzVNLYUt" returned: 0 in 0.018s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:46:31 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[b39dfed7-b119-4fd7-9a50-d6454e844e90]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:46:31 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-228dcd15-94ef-4720-adce-ebf479a4b6c7 tempest-VolumesAssistedSnapshotsTest-1584778058 tempest-VolumesAssistedSnapshotsTest-1584778058-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'uzVNLYUt'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:46:31 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7022511-a003-46d5-bcc1-064be770a829 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:46:31 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7022511-a003-46d5-bcc1-064be770a829 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:46:31 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[0181e5c4-979e-4c52-ab4a-c7e532fb039f]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:46:31 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-228dcd15-94ef-4720-adce-ebf479a4b6c7 tempest-VolumesAssistedSnapshotsTest-1584778058 tempest-VolumesAssistedSnapshotsTest-1584778058-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:46:31 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:46:31 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:46:31 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ef07d33-6ea6-4298-9271-50115a1d0d3f]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2472759-033a-4051-9dec-4516d0aef07d (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2324d4e-6e60-47fd-b536-144a7ea32dce (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18a1e95e-5df1-4db1-92bc-6cd67729c7a7 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97f588de-32d5-4d48-9c06-5925263ba117 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72bed504-5114-4179-b266-7cae18a4f75b (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7144f229-1f5e-4155-aba1-ab44218df41a (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52ae1fea-5339-4958-88ae-d103080e7743 (non-flash)\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:46:31 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-228dcd15-94ef-4720-adce-ebf479a4b6c7 tempest-VolumesAssistedSnapshotsTest-1584778058 tempest-VolumesAssistedSnapshotsTest-1584778058-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2472759-033a-4051-9dec-4516d0aef07d (non-flash)
Nov 14 09:46:31 user nova-compute[75229]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2324d4e-6e60-47fd-b536-144a7ea32dce (non-flash)
Nov 14 09:46:31 user nova-compute[75229]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18a1e95e-5df1-4db1-92bc-6cd67729c7a7 (non-flash)
Nov 14 09:46:31 user nova-compute[75229]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97f588de-32d5-4d48-9c06-5925263ba117 (non-flash)
Nov 14 09:46:31 user nova-compute[75229]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72bed504-5114-4179-b266-7cae18a4f75b (non-flash)
Nov 14 09:46:31 user nova-compute[75229]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7144f229-1f5e-4155-aba1-ab44218df41a (non-flash)
Nov 14 09:46:31 user nova-compute[75229]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52ae1fea-5339-4958-88ae-d103080e7743 (non-flash)
Nov 14 09:46:31 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 09:46:31 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-228dcd15-94ef-4720-adce-ebf479a4b6c7 tempest-VolumesAssistedSnapshotsTest-1584778058 tempest-VolumesAssistedSnapshotsTest-1584778058-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2472759-033a-4051-9dec-4516d0aef07d (non-flash)
Nov 14 09:46:31 user nova-compute[75229]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2324d4e-6e60-47fd-b536-144a7ea32dce (non-flash)
Nov 14 09:46:31 user nova-compute[75229]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18a1e95e-5df1-4db1-92bc-6cd67729c7a7 (non-flash)
Nov 14 09:46:31 user nova-compute[75229]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97f588de-32d5-4d48-9c06-5925263ba117 (non-flash)
Nov 14 09:46:31 user nova-compute[75229]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72bed504-5114-4179-b266-7cae18a4f75b (non-flash)
Nov 14 09:46:31 user nova-compute[75229]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7144f229-1f5e-4155-aba1-ab44218df41a (non-flash)
Nov 14 09:46:31 user nova-compute[75229]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52ae1fea-5339-4958-88ae-d103080e7743 (non-flash)
Nov 14 09:46:31 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 09:46:31 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7022511-a003-46d5-bcc1-064be770a829 -p 172.16.0.220:3260 --login {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:46:31 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7022511-a003-46d5-bcc1-064be770a829 -p 172.16.0.220:3260 --login" returned: 0 in 0.092s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:46:31 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[667632b7-e55f-4e46-9554-70e6b47e5f86]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c7022511-a003-46d5-bcc1-064be770a829, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c7022511-a003-46d5-bcc1-064be770a829, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:46:31 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-228dcd15-94ef-4720-adce-ebf479a4b6c7 tempest-VolumesAssistedSnapshotsTest-1584778058 tempest-VolumesAssistedSnapshotsTest-1584778058-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c7022511-a003-46d5-bcc1-064be770a829, portal: 172.16.0.220,3260]
Nov 14 09:46:31 user nova-compute[75229]: Login to [iface: default, target: iqn.2010-10.org.openstack:c7022511-a003-46d5-bcc1-064be770a829, portal: 172.16.0.220,3260] successful.
Nov 14 09:46:31 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:46:31 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7022511-a003-46d5-bcc1-064be770a829 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:46:31 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7022511-a003-46d5-bcc1-064be770a829 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:46:31 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3c9a562-54d3-4f22-90e9-c182958ca096]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:46:32 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-228dcd15-94ef-4720-adce-ebf479a4b6c7 tempest-VolumesAssistedSnapshotsTest-1584778058 tempest-VolumesAssistedSnapshotsTest-1584778058-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:46:32 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:46:32 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:46:32 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2adc196-41ce-409b-9e8c-eda680f1a357]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2472759-033a-4051-9dec-4516d0aef07d (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7022511-a003-46d5-bcc1-064be770a829 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2324d4e-6e60-47fd-b536-144a7ea32dce (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18a1e95e-5df1-4db1-92bc-6cd67729c7a7 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97f588de-32d5-4d48-9c06-5925263ba117 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72bed504-5114-4179-b266-7cae18a4f75b (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7144f229-1f5e-4155-aba1-ab44218df41a (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52ae1fea-5339-4958-88ae-d103080e7743 (non-flash)\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:46:32 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-228dcd15-94ef-4720-adce-ebf479a4b6c7 tempest-VolumesAssistedSnapshotsTest-1584778058 tempest-VolumesAssistedSnapshotsTest-1584778058-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2472759-033a-4051-9dec-4516d0aef07d (non-flash)
Nov 14 09:46:32 user nova-compute[75229]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7022511-a003-46d5-bcc1-064be770a829 (non-flash)
Nov 14 09:46:32 user nova-compute[75229]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2324d4e-6e60-47fd-b536-144a7ea32dce (non-flash)
Nov 14 09:46:32 user nova-compute[75229]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18a1e95e-5df1-4db1-92bc-6cd67729c7a7 (non-flash)
Nov 14 09:46:32 user nova-compute[75229]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97f588de-32d5-4d48-9c06-5925263ba117 (non-flash)
Nov 14 09:46:32 user nova-compute[75229]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72bed504-5114-4179-b266-7cae18a4f75b (non-flash)
Nov 14 09:46:32 user nova-compute[75229]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7144f229-1f5e-4155-aba1-ab44218df41a (non-flash)
Nov 14 09:46:32 user nova-compute[75229]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52ae1fea-5339-4958-88ae-d103080e7743 (non-flash)
Nov 14 09:46:32 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 09:46:32 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-228dcd15-94ef-4720-adce-ebf479a4b6c7 tempest-VolumesAssistedSnapshotsTest-1584778058 tempest-VolumesAssistedSnapshotsTest-1584778058-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2472759-033a-4051-9dec-4516d0aef07d (non-flash)
Nov 14 09:46:32 user nova-compute[75229]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7022511-a003-46d5-bcc1-064be770a829 (non-flash)
Nov 14 09:46:32 user nova-compute[75229]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2324d4e-6e60-47fd-b536-144a7ea32dce (non-flash)
Nov 14 09:46:32 user nova-compute[75229]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18a1e95e-5df1-4db1-92bc-6cd67729c7a7 (non-flash)
Nov 14 09:46:32 user nova-compute[75229]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97f588de-32d5-4d48-9c06-5925263ba117 (non-flash)
Nov 14 09:46:32 user nova-compute[75229]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72bed504-5114-4179-b266-7cae18a4f75b (non-flash)
Nov 14 09:46:32 user nova-compute[75229]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7144f229-1f5e-4155-aba1-ab44218df41a (non-flash)
Nov 14 09:46:32 user nova-compute[75229]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52ae1fea-5339-4958-88ae-d103080e7743 (non-flash)
Nov 14 09:46:32 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 09:46:32 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-228dcd15-94ef-4720-adce-ebf479a4b6c7 tempest-VolumesAssistedSnapshotsTest-1584778058 tempest-VolumesAssistedSnapshotsTest-1584778058-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c7022511-a003-46d5-bcc1-064be770a829" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.333s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 09:46:32 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-228dcd15-94ef-4720-adce-ebf479a4b6c7 tempest-VolumesAssistedSnapshotsTest-1584778058 tempest-VolumesAssistedSnapshotsTest-1584778058-project-admin] Connected to 172.16.0.220:3260 {{(pid=75229) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 09:46:32 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-228dcd15-94ef-4720-adce-ebf479a4b6c7 tempest-VolumesAssistedSnapshotsTest-1584778058 tempest-VolumesAssistedSnapshotsTest-1584778058-project-admin] HCTL ('40', '-', '-', 0) found on session 11 with lun 0 {{(pid=75229) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 09:46:32 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-228dcd15-94ef-4720-adce-ebf479a4b6c7 tempest-VolumesAssistedSnapshotsTest-1584778058 tempest-VolumesAssistedSnapshotsTest-1584778058-project-admin] Scanning host 40 c: -, t: -, l: 0) {{(pid=75229) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 09:46:32 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:46:32 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.015s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:46:32 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[78caee01-12aa-46b7-9822-35f9b511ca85]: (4, ('- - 0', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:46:32 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-228dcd15-94ef-4720-adce-ebf479a4b6c7 tempest-VolumesAssistedSnapshotsTest-1584778058 tempest-VolumesAssistedSnapshotsTest-1584778058-project-admin] Searching for a device in session 11 and hctl ['40', '*', '*', 0] yield: None {{(pid=75229) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 09:46:32 user nova-compute[75229]: DEBUG nova.virt.libvirt.guest [None req-46a6734f-557c-4e1b-a94f-736be046e361 tempest-TestVolumeSwap-1816306665 tempest-TestVolumeSwap-1816306665-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=75229) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 09:46:32 user nova-compute[75229]: DEBUG nova.virt.libvirt.guest [None req-46a6734f-557c-4e1b-a94f-736be046e361 tempest-TestVolumeSwap-1816306665 tempest-TestVolumeSwap-1816306665-project-admin] COPY block job progress, current cursor: 148897792 final cursor: 1073741824 {{(pid=75229) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 09:46:32 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:46:33 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-228dcd15-94ef-4720-adce-ebf479a4b6c7 tempest-VolumesAssistedSnapshotsTest-1584778058 tempest-VolumesAssistedSnapshotsTest-1584778058-project-admin] Searching for a device in session 11 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=75229) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 09:46:33 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-228dcd15-94ef-4720-adce-ebf479a4b6c7 tempest-VolumesAssistedSnapshotsTest-1584778058 tempest-VolumesAssistedSnapshotsTest-1584778058-project-admin] Connected to sdi using {'target_iqn': 'iqn.2010-10.org.openstack:c7022511-a003-46d5-bcc1-064be770a829', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uzVNLYUt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75229) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 09:46:33 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-228dcd15-94ef-4720-adce-ebf479a4b6c7 tempest-VolumesAssistedSnapshotsTest-1584778058 tempest-VolumesAssistedSnapshotsTest-1584778058-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.362s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 09:46:33 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-228dcd15-94ef-4720-adce-ebf479a4b6c7 tempest-VolumesAssistedSnapshotsTest-1584778058 tempest-VolumesAssistedSnapshotsTest-1584778058-project-admin] <== connect_volume: return (2284ms) {'type': 'block', 'scsi_wwn': '26663393432343837', 'path': '/dev/sdi'} {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 09:46:33 user nova-compute[75229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-228dcd15-94ef-4720-adce-ebf479a4b6c7 tempest-VolumesAssistedSnapshotsTest-1584778058 tempest-VolumesAssistedSnapshotsTest-1584778058-project-admin] [instance: 8623fdcc-99b7-44d6-ad81-dada5ba83a88] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26663393432343837', 'path': '/dev/sdi'} {{(pid=75229) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 09:46:33 user nova-compute[75229]: DEBUG nova.objects.instance [None req-228dcd15-94ef-4720-adce-ebf479a4b6c7 tempest-VolumesAssistedSnapshotsTest-1584778058 tempest-VolumesAssistedSnapshotsTest-1584778058-project-admin] Lazy-loading 'flavor' on Instance uuid 8623fdcc-99b7-44d6-ad81-dada5ba83a88 {{(pid=75229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 09:46:33 user nova-compute[75229]: DEBUG nova.virt.libvirt.guest [None req-228dcd15-94ef-4720-adce-ebf479a4b6c7 tempest-VolumesAssistedSnapshotsTest-1584778058 tempest-VolumesAssistedSnapshotsTest-1584778058-project-admin] attach device xml: <disk type="block" device="disk">
Nov 14 09:46:33 user nova-compute[75229]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 09:46:33 user nova-compute[75229]:   <source dev="/dev/sdi"/>
Nov 14 09:46:33 user nova-compute[75229]:   <target dev="vdb" bus="virtio"/>
Nov 14 09:46:33 user nova-compute[75229]:   <serial>c7022511-a003-46d5-bcc1-064be770a829</serial>
Nov 14 09:46:33 user nova-compute[75229]: </disk>
Nov 14 09:46:33 user nova-compute[75229]:  {{(pid=75229) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 09:46:33 user nova-compute[75229]: DEBUG nova.virt.libvirt.guest [None req-46a6734f-557c-4e1b-a94f-736be046e361 tempest-TestVolumeSwap-1816306665 tempest-TestVolumeSwap-1816306665-project-admin] COPY block job progress, current cursor: 332398592 final cursor: 1073741824 {{(pid=75229) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 09:46:33 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-228dcd15-94ef-4720-adce-ebf479a4b6c7 tempest-VolumesAssistedSnapshotsTest-1584778058 tempest-VolumesAssistedSnapshotsTest-1584778058-project-admin] No BDM found with device name vda, not building metadata. {{(pid=75229) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 09:46:33 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-228dcd15-94ef-4720-adce-ebf479a4b6c7 tempest-VolumesAssistedSnapshotsTest-1584778058 tempest-VolumesAssistedSnapshotsTest-1584778058-project-admin] No BDM found with device name vdb, not building metadata. {{(pid=75229) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 09:46:33 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-228dcd15-94ef-4720-adce-ebf479a4b6c7 tempest-VolumesAssistedSnapshotsTest-1584778058 tempest-VolumesAssistedSnapshotsTest-1584778058-project-admin] No VIF found with MAC fa:16:3e:86:32:73, not building metadata {{(pid=75229) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 09:46:33 user nova-compute[75229]: DEBUG nova.virt.libvirt.guest [None req-46a6734f-557c-4e1b-a94f-736be046e361 tempest-TestVolumeSwap-1816306665 tempest-TestVolumeSwap-1816306665-project-admin] COPY block job progress, current cursor: 492830720 final cursor: 1073741824 {{(pid=75229) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 09:46:33 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-228dcd15-94ef-4720-adce-ebf479a4b6c7 tempest-VolumesAssistedSnapshotsTest-1584778058 tempest-VolumesAssistedSnapshotsTest-1584778058-project-admin] Lock "8623fdcc-99b7-44d6-ad81-dada5ba83a88" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.629s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:46:33 user nova-compute[75229]: WARNING nova.virt.libvirt.driver [None req-1a874eb1-bc94-4d89-bceb-f6525a412799 tempest-AttachSCSIVolumeTestJSON-982350058 tempest-AttachSCSIVolumeTestJSON-982350058-project-member] Waiting for libvirt event about the detach of device sdc with device alias scsi0-0-0-2 from instance 37e63bd9-44fc-4d07-b31b-570f69d7bc8a is timed out.
Nov 14 09:46:33 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-1a874eb1-bc94-4d89-bceb-f6525a412799 tempest-AttachSCSIVolumeTestJSON-982350058 tempest-AttachSCSIVolumeTestJSON-982350058-project-member] Successfully detached device sdc from instance 37e63bd9-44fc-4d07-b31b-570f69d7bc8a from the live domain config.
Nov 14 09:46:33 user nova-compute[75229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1a874eb1-bc94-4d89-bceb-f6525a412799 tempest-AttachSCSIVolumeTestJSON-982350058 tempest-AttachSCSIVolumeTestJSON-982350058-project-member] [instance: 37e63bd9-44fc-4d07-b31b-570f69d7bc8a] calling os-brick to detach iSCSI Volume {{(pid=75229) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 09:46:33 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a874eb1-bc94-4d89-bceb-f6525a412799 tempest-AttachSCSIVolumeTestJSON-982350058 tempest-AttachSCSIVolumeTestJSON-982350058-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f73f85151b0>, {'target_iqn': 'iqn.2010-10.org.openstack:72bed504-5114-4179-b266-7cae18a4f75b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BOkrNpTQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 09:46:33 user nova-compute[75229]: WARNING os_brick.initiator.connectors.base [None req-1a874eb1-bc94-4d89-bceb-f6525a412799 tempest-AttachSCSIVolumeTestJSON-982350058 tempest-AttachSCSIVolumeTestJSON-982350058-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 09:46:33 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-1a874eb1-bc94-4d89-bceb-f6525a412799 tempest-AttachSCSIVolumeTestJSON-982350058 tempest-AttachSCSIVolumeTestJSON-982350058-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 09:46:33 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-1a874eb1-bc94-4d89-bceb-f6525a412799 tempest-AttachSCSIVolumeTestJSON-982350058 tempest-AttachSCSIVolumeTestJSON-982350058-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 09:46:33 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:46:33 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:46:33 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[f79198f8-f586-4cae-83e2-d84b6e7d150e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c2324d4e-6e60-47fd-b536-144a7ea32dce\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:52ae1fea-5339-4958-88ae-d103080e7743\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:72bed504-5114-4179-b266-7cae18a4f75b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:97f588de-32d5-4d48-9c06-5925263ba117\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:18a1e95e-5df1-4db1-92bc-6cd67729c7a7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c7022511-a003-46d5-bcc1-064be770a829\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e2472759-033a-4051-9dec-4516d0aef07d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7144f229-1f5e-4155-aba1-ab44218df41a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:46:33 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a874eb1-bc94-4d89-bceb-f6525a412799 tempest-AttachSCSIVolumeTestJSON-982350058 tempest-AttachSCSIVolumeTestJSON-982350058-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 09:46:33 user nova-compute[75229]: No targets found.
Nov 14 09:46:33 user nova-compute[75229]: iSNS:
Nov 14 09:46:33 user nova-compute[75229]: No targets found.
Nov 14 09:46:33 user nova-compute[75229]: STATIC:
Nov 14 09:46:33 user nova-compute[75229]: Target: iqn.2010-10.org.openstack:c2324d4e-6e60-47fd-b536-144a7ea32dce
Nov 14 09:46:33 user nova-compute[75229]:         Portal: 172.16.0.220:3260,-1
Nov 14 09:46:33 user nova-compute[75229]:                 Iface Name: default
Nov 14 09:46:33 user nova-compute[75229]: Target: iqn.2010-10.org.openstack:52ae1fea-5339-4958-88ae-d103080e7743
Nov 14 09:46:33 user nova-compute[75229]:         Portal: 172.16.0.220:3260,-1
Nov 14 09:46:33 user nova-compute[75229]:                 Iface Name: default
Nov 14 09:46:33 user nova-compute[75229]: Target: iqn.2010-10.org.openstack:72bed504-5114-4179-b266-7cae18a4f75b
Nov 14 09:46:33 user nova-compute[75229]:         Portal: 172.16.0.220:3260,-1
Nov 14 09:46:33 user nova-compute[75229]:                 Iface Name: default
Nov 14 09:46:33 user nova-compute[75229]: Target: iqn.2010-10.org.openstack:97f588de-32d5-4d48-9c06-5925263ba117
Nov 14 09:46:33 user nova-compute[75229]:         Portal: 172.16.0.220:3260,-1
Nov 14 09:46:33 user nova-compute[75229]:                 Iface Name: default
Nov 14 09:46:33 user nova-compute[75229]: Target: iqn.2010-10.org.openstack:18a1e95e-5df1-4db1-92bc-6cd67729c7a7
Nov 14 09:46:33 user nova-compute[75229]:         Portal: 172.16.0.220:3260,-1
Nov 14 09:46:33 user nova-compute[75229]:                 Iface Name: default
Nov 14 09:46:33 user nova-compute[75229]: Target: iqn.2010-10.org.openstack:c7022511-a003-46d5-bcc1-064be770a829
Nov 14 09:46:33 user nova-compute[75229]:         Portal: 172.16.0.220:3260,-1
Nov 14 09:46:33 user nova-compute[75229]:                 Iface Name: default
Nov 14 09:46:33 user nova-compute[75229]: Target: iqn.2010-10.org.openstack:e2472759-033a-4051-9dec-4516d0aef07d
Nov 14 09:46:33 user nova-compute[75229]:         Portal: 172.16.0.220:3260,-1
Nov 14 09:46:33 user nova-compute[75229]:                 Iface Name: default
Nov 14 09:46:33 user nova-compute[75229]: Target: iqn.2010-10.org.openstack:7144f229-1f5e-4155-aba1-ab44218df41a
Nov 14 09:46:33 user nova-compute[75229]:         Portal: 172.16.0.220:3260,-1
Nov 14 09:46:33 user nova-compute[75229]:                 Iface Name: default
Nov 14 09:46:33 user nova-compute[75229]: FIRMWARE:
Nov 14 09:46:33 user nova-compute[75229]: No targets found.
Nov 14 09:46:33 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 09:46:33 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a874eb1-bc94-4d89-bceb-f6525a412799 tempest-AttachSCSIVolumeTestJSON-982350058 tempest-AttachSCSIVolumeTestJSON-982350058-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 09:46:33 user nova-compute[75229]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 09:46:33 user nova-compute[75229]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75229) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 09:46:33 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a874eb1-bc94-4d89-bceb-f6525a412799 tempest-AttachSCSIVolumeTestJSON-982350058 tempest-AttachSCSIVolumeTestJSON-982350058-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:72bed504-5114-4179-b266-7cae18a4f75b', 0)] {{(pid=75229) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 09:46:33 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:46:33 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:46:33 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[985cdba9-edc7-4a95-8948-c185044cbd69]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:18a1e95e-5df1-4db1-92bc-6cd67729c7a7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:52ae1fea-5339-4958-88ae-d103080e7743\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7144f229-1f5e-4155-aba1-ab44218df41a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:72bed504-5114-4179-b266-7cae18a4f75b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:97f588de-32d5-4d48-9c06-5925263ba117\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c2324d4e-6e60-47fd-b536-144a7ea32dce\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c7022511-a003-46d5-bcc1-064be770a829\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e2472759-033a-4051-9dec-4516d0aef07d\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:46:33 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:46:33 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:46:33 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[0151e6d8-a99f-442e-b1ac-acfdd568132e]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2472759-033a-4051-9dec-4516d0aef07d (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7022511-a003-46d5-bcc1-064be770a829 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2324d4e-6e60-47fd-b536-144a7ea32dce (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18a1e95e-5df1-4db1-92bc-6cd67729c7a7 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97f588de-32d5-4d48-9c06-5925263ba117 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72bed504-5114-4179-b266-7cae18a4f75b (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7144f229-1f5e-4155-aba1-ab44218df41a (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52ae1fea-5339-4958-88ae-d103080e7743 (non-flash)\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:46:33 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a874eb1-bc94-4d89-bceb-f6525a412799 tempest-AttachSCSIVolumeTestJSON-982350058 tempest-AttachSCSIVolumeTestJSON-982350058-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2472759-033a-4051-9dec-4516d0aef07d (non-flash)
Nov 14 09:46:33 user nova-compute[75229]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7022511-a003-46d5-bcc1-064be770a829 (non-flash)
Nov 14 09:46:33 user nova-compute[75229]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2324d4e-6e60-47fd-b536-144a7ea32dce (non-flash)
Nov 14 09:46:33 user nova-compute[75229]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18a1e95e-5df1-4db1-92bc-6cd67729c7a7 (non-flash)
Nov 14 09:46:33 user nova-compute[75229]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97f588de-32d5-4d48-9c06-5925263ba117 (non-flash)
Nov 14 09:46:33 user nova-compute[75229]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72bed504-5114-4179-b266-7cae18a4f75b (non-flash)
Nov 14 09:46:33 user nova-compute[75229]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7144f229-1f5e-4155-aba1-ab44218df41a (non-flash)
Nov 14 09:46:33 user nova-compute[75229]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52ae1fea-5339-4958-88ae-d103080e7743 (non-flash)
Nov 14 09:46:33 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 09:46:33 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a874eb1-bc94-4d89-bceb-f6525a412799 tempest-AttachSCSIVolumeTestJSON-982350058 tempest-AttachSCSIVolumeTestJSON-982350058-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2472759-033a-4051-9dec-4516d0aef07d (non-flash)
Nov 14 09:46:33 user nova-compute[75229]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7022511-a003-46d5-bcc1-064be770a829 (non-flash)
Nov 14 09:46:33 user nova-compute[75229]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2324d4e-6e60-47fd-b536-144a7ea32dce (non-flash)
Nov 14 09:46:33 user nova-compute[75229]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18a1e95e-5df1-4db1-92bc-6cd67729c7a7 (non-flash)
Nov 14 09:46:33 user nova-compute[75229]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97f588de-32d5-4d48-9c06-5925263ba117 (non-flash)
Nov 14 09:46:33 user nova-compute[75229]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72bed504-5114-4179-b266-7cae18a4f75b (non-flash)
Nov 14 09:46:33 user nova-compute[75229]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7144f229-1f5e-4155-aba1-ab44218df41a (non-flash)
Nov 14 09:46:33 user nova-compute[75229]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52ae1fea-5339-4958-88ae-d103080e7743 (non-flash)
Nov 14 09:46:33 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 09:46:33 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a874eb1-bc94-4d89-bceb-f6525a412799 tempest-AttachSCSIVolumeTestJSON-982350058 tempest-AttachSCSIVolumeTestJSON-982350058-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f741819b6d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:72bed504-5114-4179-b266-7cae18a4f75b'): ({'sdf'}, set())}) {{(pid=75229) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 09:46:33 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-1a874eb1-bc94-4d89-bceb-f6525a412799 tempest-AttachSCSIVolumeTestJSON-982350058 tempest-AttachSCSIVolumeTestJSON-982350058-project-member] Removing single pathed devices sdf {{(pid=75229) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 09:46:33 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:46:34 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:46:34 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6a5292c-cf93-48c2-86d6-2db261876593]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:46:34 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:46:34 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.022s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:46:34 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a67688f-7245-4bbe-b9ed-0d4356c4d9c1]: (4, ('ok\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:46:34 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-1a874eb1-bc94-4d89-bceb-f6525a412799 tempest-AttachSCSIVolumeTestJSON-982350058 tempest-AttachSCSIVolumeTestJSON-982350058-project-member] Flushing IO for device /dev/sdf {{(pid=75229) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 09:46:34 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:46:34 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.014s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:46:34 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c77e817-949f-4b9c-92a6-4f5863ba09bc]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:46:34 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-1a874eb1-bc94-4d89-bceb-f6525a412799 tempest-AttachSCSIVolumeTestJSON-982350058 tempest-AttachSCSIVolumeTestJSON-982350058-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75229) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 09:46:34 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:46:34 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.047s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:46:34 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[2784110a-88a4-47ab-a925-7813d4eb46b5]: (4, ('1', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:46:34 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-1a874eb1-bc94-4d89-bceb-f6525a412799 tempest-AttachSCSIVolumeTestJSON-982350058 tempest-AttachSCSIVolumeTestJSON-982350058-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75229) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 09:46:34 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-1a874eb1-bc94-4d89-bceb-f6525a412799 tempest-AttachSCSIVolumeTestJSON-982350058 tempest-AttachSCSIVolumeTestJSON-982350058-project-member] SCSI volumes sdf have been removed. {{(pid=75229) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 09:46:34 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a874eb1-bc94-4d89-bceb-f6525a412799 tempest-AttachSCSIVolumeTestJSON-982350058 tempest-AttachSCSIVolumeTestJSON-982350058-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:72bed504-5114-4179-b266-7cae18a4f75b')] {{(pid=75229) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 09:46:34 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72bed504-5114-4179-b266-7cae18a4f75b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:46:34 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72bed504-5114-4179-b266-7cae18a4f75b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:46:34 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bc06637-b398-4974-89f0-7623d66df6cd]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:46:34 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a874eb1-bc94-4d89-bceb-f6525a412799 tempest-AttachSCSIVolumeTestJSON-982350058 tempest-AttachSCSIVolumeTestJSON-982350058-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:46:34 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72bed504-5114-4179-b266-7cae18a4f75b -p 172.16.0.220:3260 --logout {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:46:34 user nova-compute[75229]: DEBUG nova.virt.libvirt.guest [None req-46a6734f-557c-4e1b-a94f-736be046e361 tempest-TestVolumeSwap-1816306665 tempest-TestVolumeSwap-1816306665-project-admin] COPY block job progress, current cursor: 650117120 final cursor: 1073741824 {{(pid=75229) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 09:46:34 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:46:34 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72bed504-5114-4179-b266-7cae18a4f75b -p 172.16.0.220:3260 --logout" returned: 0 in 0.144s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:46:34 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a99ad07-aad8-4d58-a9f8-bd3271278d3a]: (4, ('Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:72bed504-5114-4179-b266-7cae18a4f75b, portal: 172.16.0.220,3260]\nLogout of [sid: 7, target: iqn.2010-10.org.openstack:72bed504-5114-4179-b266-7cae18a4f75b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:46:34 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a874eb1-bc94-4d89-bceb-f6525a412799 tempest-AttachSCSIVolumeTestJSON-982350058 tempest-AttachSCSIVolumeTestJSON-982350058-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:72bed504-5114-4179-b266-7cae18a4f75b, portal: 172.16.0.220,3260]
Nov 14 09:46:34 user nova-compute[75229]: Logout of [sid: 7, target: iqn.2010-10.org.openstack:72bed504-5114-4179-b266-7cae18a4f75b, portal: 172.16.0.220,3260] successful.
Nov 14 09:46:34 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:46:34 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72bed504-5114-4179-b266-7cae18a4f75b -p 172.16.0.220:3260 --op delete {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:46:34 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72bed504-5114-4179-b266-7cae18a4f75b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.046s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:46:34 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dce1533-3d05-4197-b220-f1437af7e982]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:46:34 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a874eb1-bc94-4d89-bceb-f6525a412799 tempest-AttachSCSIVolumeTestJSON-982350058 tempest-AttachSCSIVolumeTestJSON-982350058-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:46:34 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-1a874eb1-bc94-4d89-bceb-f6525a412799 tempest-AttachSCSIVolumeTestJSON-982350058 tempest-AttachSCSIVolumeTestJSON-982350058-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.455s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 09:46:34 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a874eb1-bc94-4d89-bceb-f6525a412799 tempest-AttachSCSIVolumeTestJSON-982350058 tempest-AttachSCSIVolumeTestJSON-982350058-project-member] <== disconnect_volume: return (457ms) None {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 09:46:34 user nova-compute[75229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1a874eb1-bc94-4d89-bceb-f6525a412799 tempest-AttachSCSIVolumeTestJSON-982350058 tempest-AttachSCSIVolumeTestJSON-982350058-project-member] [instance: 37e63bd9-44fc-4d07-b31b-570f69d7bc8a] Disconnected iSCSI Volume {{(pid=75229) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 09:46:34 user nova-compute[75229]: DEBUG nova.virt.libvirt.guest [None req-46a6734f-557c-4e1b-a94f-736be046e361 tempest-TestVolumeSwap-1816306665 tempest-TestVolumeSwap-1816306665-project-admin] COPY block job progress, current cursor: 775946240 final cursor: 1073741824 {{(pid=75229) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 09:46:34 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-68af3203-f01d-4f37-b9fb-ced68304d9db tempest-VolumesAssistedSnapshotsTest-54650267 tempest-VolumesAssistedSnapshotsTest-54650267-project] [instance: 8623fdcc-99b7-44d6-ad81-dada5ba83a88] volume_snapshot_create: create_info: {'snapshot_id': '5a12e48a-d3ad-4047-a836-1c6fc963ee2b', 'type': 'qcow2', 'new_file': 'new_file'} {{(pid=75229) volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3576}}
Nov 14 09:46:34 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-68af3203-f01d-4f37-b9fb-ced68304d9db tempest-VolumesAssistedSnapshotsTest-54650267 tempest-VolumesAssistedSnapshotsTest-54650267-project] [instance: 8623fdcc-99b7-44d6-ad81-dada5ba83a88] snap xml: <domainsnapshot>
Nov 14 09:46:34 user nova-compute[75229]:   <disks>
Nov 14 09:46:34 user nova-compute[75229]:     <disk name="/dev/sdi" snapshot="external" type="file">
Nov 14 09:46:34 user nova-compute[75229]:       <source file="/dev/new_file"/>
Nov 14 09:46:34 user nova-compute[75229]:     </disk>
Nov 14 09:46:34 user nova-compute[75229]:     <disk name="vda" snapshot="no"/>
Nov 14 09:46:34 user nova-compute[75229]:   </disks>
Nov 14 09:46:34 user nova-compute[75229]: </domainsnapshot>
Nov 14 09:46:34 user nova-compute[75229]:  {{(pid=75229) _volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3517}}
Nov 14 09:46:34 user nova-compute[75229]: DEBUG nova.objects.instance [None req-68af3203-f01d-4f37-b9fb-ced68304d9db tempest-VolumesAssistedSnapshotsTest-54650267 tempest-VolumesAssistedSnapshotsTest-54650267-project] Lazy-loading 'system_metadata' on Instance uuid 8623fdcc-99b7-44d6-ad81-dada5ba83a88 {{(pid=75229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 09:46:34 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-68af3203-f01d-4f37-b9fb-ced68304d9db tempest-VolumesAssistedSnapshotsTest-54650267 tempest-VolumesAssistedSnapshotsTest-54650267-project] [instance: 8623fdcc-99b7-44d6-ad81-dada5ba83a88] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 14 09:46:34 user nova-compute[75229]: ERROR nova.virt.libvirt.driver [None req-68af3203-f01d-4f37-b9fb-ced68304d9db tempest-VolumesAssistedSnapshotsTest-54650267 tempest-VolumesAssistedSnapshotsTest-54650267-project] [instance: 8623fdcc-99b7-44d6-ad81-dada5ba83a88] Unable to create VM snapshot, failing volume_snapshot operation.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 14 09:46:34 user nova-compute[75229]: ERROR nova.virt.libvirt.driver [instance: 8623fdcc-99b7-44d6-ad81-dada5ba83a88] Traceback (most recent call last):
Nov 14 09:46:34 user nova-compute[75229]: ERROR nova.virt.libvirt.driver [instance: 8623fdcc-99b7-44d6-ad81-dada5ba83a88]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 14 09:46:34 user nova-compute[75229]: ERROR nova.virt.libvirt.driver [instance: 8623fdcc-99b7-44d6-ad81-dada5ba83a88]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 14 09:46:34 user nova-compute[75229]: ERROR nova.virt.libvirt.driver [instance: 8623fdcc-99b7-44d6-ad81-dada5ba83a88]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 14 09:46:34 user nova-compute[75229]: ERROR nova.virt.libvirt.driver [instance: 8623fdcc-99b7-44d6-ad81-dada5ba83a88]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 14 09:46:34 user nova-compute[75229]: ERROR nova.virt.libvirt.driver [instance: 8623fdcc-99b7-44d6-ad81-dada5ba83a88]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 14 09:46:34 user nova-compute[75229]: ERROR nova.virt.libvirt.driver [instance: 8623fdcc-99b7-44d6-ad81-dada5ba83a88]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 14 09:46:34 user nova-compute[75229]: ERROR nova.virt.libvirt.driver [instance: 8623fdcc-99b7-44d6-ad81-dada5ba83a88]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 14 09:46:34 user nova-compute[75229]: ERROR nova.virt.libvirt.driver [instance: 8623fdcc-99b7-44d6-ad81-dada5ba83a88]     rv = execute(f, *args, **kwargs)
Nov 14 09:46:34 user nova-compute[75229]: ERROR nova.virt.libvirt.driver [instance: 8623fdcc-99b7-44d6-ad81-dada5ba83a88]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 14 09:46:34 user nova-compute[75229]: ERROR nova.virt.libvirt.driver [instance: 8623fdcc-99b7-44d6-ad81-dada5ba83a88]     six.reraise(c, e, tb)
Nov 14 09:46:34 user nova-compute[75229]: ERROR nova.virt.libvirt.driver [instance: 8623fdcc-99b7-44d6-ad81-dada5ba83a88]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 14 09:46:34 user nova-compute[75229]: ERROR nova.virt.libvirt.driver [instance: 8623fdcc-99b7-44d6-ad81-dada5ba83a88]     raise value
Nov 14 09:46:34 user nova-compute[75229]: ERROR nova.virt.libvirt.driver [instance: 8623fdcc-99b7-44d6-ad81-dada5ba83a88]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 14 09:46:34 user nova-compute[75229]: ERROR nova.virt.libvirt.driver [instance: 8623fdcc-99b7-44d6-ad81-dada5ba83a88]     rv = meth(*args, **kwargs)
Nov 14 09:46:34 user nova-compute[75229]: ERROR nova.virt.libvirt.driver [instance: 8623fdcc-99b7-44d6-ad81-dada5ba83a88]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 14 09:46:34 user nova-compute[75229]: ERROR nova.virt.libvirt.driver [instance: 8623fdcc-99b7-44d6-ad81-dada5ba83a88]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 14 09:46:34 user nova-compute[75229]: ERROR nova.virt.libvirt.driver [instance: 8623fdcc-99b7-44d6-ad81-dada5ba83a88] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 14 09:46:34 user nova-compute[75229]: ERROR nova.virt.libvirt.driver [instance: 8623fdcc-99b7-44d6-ad81-dada5ba83a88] 
Nov 14 09:46:34 user nova-compute[75229]: ERROR nova.virt.libvirt.driver [None req-68af3203-f01d-4f37-b9fb-ced68304d9db tempest-VolumesAssistedSnapshotsTest-54650267 tempest-VolumesAssistedSnapshotsTest-54650267-project] [instance: 8623fdcc-99b7-44d6-ad81-dada5ba83a88] Error occurred during volume_snapshot_create, sending error status to Cinder.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 14 09:46:34 user nova-compute[75229]: ERROR nova.virt.libvirt.driver [instance: 8623fdcc-99b7-44d6-ad81-dada5ba83a88] Traceback (most recent call last):
Nov 14 09:46:34 user nova-compute[75229]: ERROR nova.virt.libvirt.driver [instance: 8623fdcc-99b7-44d6-ad81-dada5ba83a88]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 14 09:46:34 user nova-compute[75229]: ERROR nova.virt.libvirt.driver [instance: 8623fdcc-99b7-44d6-ad81-dada5ba83a88]     self._volume_snapshot_create(context, instance, guest,
Nov 14 09:46:34 user nova-compute[75229]: ERROR nova.virt.libvirt.driver [instance: 8623fdcc-99b7-44d6-ad81-dada5ba83a88]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 14 09:46:34 user nova-compute[75229]: ERROR nova.virt.libvirt.driver [instance: 8623fdcc-99b7-44d6-ad81-dada5ba83a88]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 14 09:46:34 user nova-compute[75229]: ERROR nova.virt.libvirt.driver [instance: 8623fdcc-99b7-44d6-ad81-dada5ba83a88]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 14 09:46:34 user nova-compute[75229]: ERROR nova.virt.libvirt.driver [instance: 8623fdcc-99b7-44d6-ad81-dada5ba83a88]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 14 09:46:34 user nova-compute[75229]: ERROR nova.virt.libvirt.driver [instance: 8623fdcc-99b7-44d6-ad81-dada5ba83a88]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 14 09:46:34 user nova-compute[75229]: ERROR nova.virt.libvirt.driver [instance: 8623fdcc-99b7-44d6-ad81-dada5ba83a88]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 14 09:46:34 user nova-compute[75229]: ERROR nova.virt.libvirt.driver [instance: 8623fdcc-99b7-44d6-ad81-dada5ba83a88]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 14 09:46:34 user nova-compute[75229]: ERROR nova.virt.libvirt.driver [instance: 8623fdcc-99b7-44d6-ad81-dada5ba83a88]     rv = execute(f, *args, **kwargs)
Nov 14 09:46:34 user nova-compute[75229]: ERROR nova.virt.libvirt.driver [instance: 8623fdcc-99b7-44d6-ad81-dada5ba83a88]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 14 09:46:34 user nova-compute[75229]: ERROR nova.virt.libvirt.driver [instance: 8623fdcc-99b7-44d6-ad81-dada5ba83a88]     six.reraise(c, e, tb)
Nov 14 09:46:34 user nova-compute[75229]: ERROR nova.virt.libvirt.driver [instance: 8623fdcc-99b7-44d6-ad81-dada5ba83a88]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 14 09:46:34 user nova-compute[75229]: ERROR nova.virt.libvirt.driver [instance: 8623fdcc-99b7-44d6-ad81-dada5ba83a88]     raise value
Nov 14 09:46:34 user nova-compute[75229]: ERROR nova.virt.libvirt.driver [instance: 8623fdcc-99b7-44d6-ad81-dada5ba83a88]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 14 09:46:34 user nova-compute[75229]: ERROR nova.virt.libvirt.driver [instance: 8623fdcc-99b7-44d6-ad81-dada5ba83a88]     rv = meth(*args, **kwargs)
Nov 14 09:46:34 user nova-compute[75229]: ERROR nova.virt.libvirt.driver [instance: 8623fdcc-99b7-44d6-ad81-dada5ba83a88]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 14 09:46:34 user nova-compute[75229]: ERROR nova.virt.libvirt.driver [instance: 8623fdcc-99b7-44d6-ad81-dada5ba83a88]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 14 09:46:34 user nova-compute[75229]: ERROR nova.virt.libvirt.driver [instance: 8623fdcc-99b7-44d6-ad81-dada5ba83a88] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 14 09:46:34 user nova-compute[75229]: ERROR nova.virt.libvirt.driver [instance: 8623fdcc-99b7-44d6-ad81-dada5ba83a88] 
Nov 14 09:46:35 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-8edba405-3926-48bf-97a4-600c61741ef7 tempest-VolumesAssistedSnapshotsTest-54650267 tempest-VolumesAssistedSnapshotsTest-54650267-project] [instance: 8623fdcc-99b7-44d6-ad81-dada5ba83a88] volume_snapshot_delete: delete_info: {'volume_id': 'c7022511-a003-46d5-bcc1-064be770a829'} {{(pid=75229) _volume_snapshot_delete /opt/stack/nova/nova/virt/libvirt/driver.py:3677}}
Nov 14 09:46:35 user nova-compute[75229]: ERROR nova.virt.libvirt.driver [None req-8edba405-3926-48bf-97a4-600c61741ef7 tempest-VolumesAssistedSnapshotsTest-54650267 tempest-VolumesAssistedSnapshotsTest-54650267-project] [instance: 8623fdcc-99b7-44d6-ad81-dada5ba83a88] Error occurred during volume_snapshot_delete, sending error status to Cinder.: KeyError: 'type'
Nov 14 09:46:35 user nova-compute[75229]: ERROR nova.virt.libvirt.driver [instance: 8623fdcc-99b7-44d6-ad81-dada5ba83a88] Traceback (most recent call last):
Nov 14 09:46:35 user nova-compute[75229]: ERROR nova.virt.libvirt.driver [instance: 8623fdcc-99b7-44d6-ad81-dada5ba83a88]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 14 09:46:35 user nova-compute[75229]: ERROR nova.virt.libvirt.driver [instance: 8623fdcc-99b7-44d6-ad81-dada5ba83a88]     self._volume_snapshot_delete(context, instance, volume_id,
Nov 14 09:46:35 user nova-compute[75229]: ERROR nova.virt.libvirt.driver [instance: 8623fdcc-99b7-44d6-ad81-dada5ba83a88]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 14 09:46:35 user nova-compute[75229]: ERROR nova.virt.libvirt.driver [instance: 8623fdcc-99b7-44d6-ad81-dada5ba83a88]     if delete_info['type'] != 'qcow2':
Nov 14 09:46:35 user nova-compute[75229]: ERROR nova.virt.libvirt.driver [instance: 8623fdcc-99b7-44d6-ad81-dada5ba83a88] KeyError: 'type'
Nov 14 09:46:35 user nova-compute[75229]: ERROR nova.virt.libvirt.driver [instance: 8623fdcc-99b7-44d6-ad81-dada5ba83a88] 
Nov 14 09:46:35 user nova-compute[75229]: ERROR nova.virt.libvirt.driver [None req-8edba405-3926-48bf-97a4-600c61741ef7 tempest-VolumesAssistedSnapshotsTest-54650267 tempest-VolumesAssistedSnapshotsTest-54650267-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot None could not be found.
Nov 14 09:46:35 user nova-compute[75229]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 14 09:46:35 user nova-compute[75229]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 14 09:46:35 user nova-compute[75229]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_delete(context, instance, volume_id,
Nov 14 09:46:35 user nova-compute[75229]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 14 09:46:35 user nova-compute[75229]: ERROR nova.virt.libvirt.driver     if delete_info['type'] != 'qcow2':
Nov 14 09:46:35 user nova-compute[75229]: ERROR nova.virt.libvirt.driver KeyError: 'type'
Nov 14 09:46:35 user nova-compute[75229]: ERROR nova.virt.libvirt.driver 
Nov 14 09:46:35 user nova-compute[75229]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 14 09:46:35 user nova-compute[75229]: ERROR nova.virt.libvirt.driver 
Nov 14 09:46:35 user nova-compute[75229]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 14 09:46:35 user nova-compute[75229]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 14 09:46:35 user nova-compute[75229]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 14 09:46:35 user nova-compute[75229]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 14 09:46:35 user nova-compute[75229]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 14 09:46:35 user nova-compute[75229]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 14 09:46:35 user nova-compute[75229]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 14 09:46:35 user nova-compute[75229]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 14 09:46:35 user nova-compute[75229]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 14 09:46:35 user nova-compute[75229]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 14 09:46:35 user nova-compute[75229]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 14 09:46:35 user nova-compute[75229]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 14 09:46:35 user nova-compute[75229]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 14 09:46:35 user nova-compute[75229]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 14 09:46:35 user nova-compute[75229]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 14 09:46:35 user nova-compute[75229]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot None could not be found. (HTTP 404) (Request-ID: req-71d85fb4-ebb4-4654-aa32-14d79a0483f7)
Nov 14 09:46:35 user nova-compute[75229]: ERROR nova.virt.libvirt.driver 
Nov 14 09:46:35 user nova-compute[75229]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 14 09:46:35 user nova-compute[75229]: ERROR nova.virt.libvirt.driver 
Nov 14 09:46:35 user nova-compute[75229]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 14 09:46:35 user nova-compute[75229]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3416, in _volume_snapshot_update_status
Nov 14 09:46:35 user nova-compute[75229]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Nov 14 09:46:35 user nova-compute[75229]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 14 09:46:35 user nova-compute[75229]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Nov 14 09:46:35 user nova-compute[75229]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Nov 14 09:46:35 user nova-compute[75229]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Nov 14 09:46:35 user nova-compute[75229]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Nov 14 09:46:35 user nova-compute[75229]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Nov 14 09:46:35 user nova-compute[75229]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 14 09:46:35 user nova-compute[75229]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 14 09:46:35 user nova-compute[75229]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 14 09:46:35 user nova-compute[75229]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 14 09:46:35 user nova-compute[75229]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 14 09:46:35 user nova-compute[75229]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 14 09:46:35 user nova-compute[75229]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 14 09:46:35 user nova-compute[75229]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 14 09:46:35 user nova-compute[75229]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 14 09:46:35 user nova-compute[75229]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 14 09:46:35 user nova-compute[75229]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 14 09:46:35 user nova-compute[75229]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 14 09:46:35 user nova-compute[75229]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 14 09:46:35 user nova-compute[75229]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 14 09:46:35 user nova-compute[75229]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot None could not be found.
Nov 14 09:46:35 user nova-compute[75229]: ERROR nova.virt.libvirt.driver 
Nov 14 09:46:35 user nova-compute[75229]: ERROR nova.virt.libvirt.driver [None req-68af3203-f01d-4f37-b9fb-ced68304d9db tempest-VolumesAssistedSnapshotsTest-54650267 tempest-VolumesAssistedSnapshotsTest-54650267-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot 5a12e48a-d3ad-4047-a836-1c6fc963ee2b could not be found.
Nov 14 09:46:35 user nova-compute[75229]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 14 09:46:35 user nova-compute[75229]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 14 09:46:35 user nova-compute[75229]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_create(context, instance, guest,
Nov 14 09:46:35 user nova-compute[75229]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 14 09:46:35 user nova-compute[75229]: ERROR nova.virt.libvirt.driver     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 14 09:46:35 user nova-compute[75229]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 14 09:46:35 user nova-compute[75229]: ERROR nova.virt.libvirt.driver     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 14 09:46:35 user nova-compute[75229]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 14 09:46:35 user nova-compute[75229]: ERROR nova.virt.libvirt.driver     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 14 09:46:35 user nova-compute[75229]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 14 09:46:35 user nova-compute[75229]: ERROR nova.virt.libvirt.driver     rv = execute(f, *args, **kwargs)
Nov 14 09:46:35 user nova-compute[75229]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 14 09:46:35 user nova-compute[75229]: ERROR nova.virt.libvirt.driver     six.reraise(c, e, tb)
Nov 14 09:46:35 user nova-compute[75229]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 14 09:46:35 user nova-compute[75229]: ERROR nova.virt.libvirt.driver     raise value
Nov 14 09:46:35 user nova-compute[75229]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 14 09:46:35 user nova-compute[75229]: ERROR nova.virt.libvirt.driver     rv = meth(*args, **kwargs)
Nov 14 09:46:35 user nova-compute[75229]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 14 09:46:35 user nova-compute[75229]: ERROR nova.virt.libvirt.driver     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 14 09:46:35 user nova-compute[75229]: ERROR nova.virt.libvirt.driver libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 14 09:46:35 user nova-compute[75229]: ERROR nova.virt.libvirt.driver 
Nov 14 09:46:35 user nova-compute[75229]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 14 09:46:35 user nova-compute[75229]: ERROR nova.virt.libvirt.driver 
Nov 14 09:46:35 user nova-compute[75229]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 14 09:46:35 user nova-compute[75229]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 14 09:46:35 user nova-compute[75229]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 14 09:46:35 user nova-compute[75229]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 14 09:46:35 user nova-compute[75229]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 14 09:46:35 user nova-compute[75229]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 14 09:46:35 user nova-compute[75229]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 14 09:46:35 user nova-compute[75229]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 14 09:46:35 user nova-compute[75229]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 14 09:46:35 user nova-compute[75229]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 14 09:46:35 user nova-compute[75229]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 14 09:46:35 user nova-compute[75229]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 14 09:46:35 user nova-compute[75229]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 14 09:46:35 user nova-compute[75229]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 14 09:46:35 user nova-compute[75229]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 14 09:46:35 user nova-compute[75229]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot 5a12e48a-d3ad-4047-a836-1c6fc963ee2b could not be found. (HTTP 404) (Request-ID: req-aa71b4f2-0e82-4e5a-b55b-896fcc01e661)
Nov 14 09:46:35 user nova-compute[75229]: ERROR nova.virt.libvirt.driver 
Nov 14 09:46:35 user nova-compute[75229]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 14 09:46:35 user nova-compute[75229]: ERROR nova.virt.libvirt.driver 
Nov 14 09:46:35 user nova-compute[75229]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 14 09:46:35 user nova-compute[75229]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3416, in _volume_snapshot_update_status
Nov 14 09:46:35 user nova-compute[75229]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Nov 14 09:46:35 user nova-compute[75229]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 14 09:46:35 user nova-compute[75229]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Nov 14 09:46:35 user nova-compute[75229]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Nov 14 09:46:35 user nova-compute[75229]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Nov 14 09:46:35 user nova-compute[75229]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Nov 14 09:46:35 user nova-compute[75229]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Nov 14 09:46:35 user nova-compute[75229]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 14 09:46:35 user nova-compute[75229]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 14 09:46:35 user nova-compute[75229]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 14 09:46:35 user nova-compute[75229]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 14 09:46:35 user nova-compute[75229]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 14 09:46:35 user nova-compute[75229]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 14 09:46:35 user nova-compute[75229]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 14 09:46:35 user nova-compute[75229]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 14 09:46:35 user nova-compute[75229]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 14 09:46:35 user nova-compute[75229]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 14 09:46:35 user nova-compute[75229]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 14 09:46:35 user nova-compute[75229]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 14 09:46:35 user nova-compute[75229]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 14 09:46:35 user nova-compute[75229]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 14 09:46:35 user nova-compute[75229]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot 5a12e48a-d3ad-4047-a836-1c6fc963ee2b could not be found.
Nov 14 09:46:35 user nova-compute[75229]: ERROR nova.virt.libvirt.driver 
Nov 14 09:46:35 user nova-compute[75229]: ERROR oslo_messaging.rpc.server [None req-8edba405-3926-48bf-97a4-600c61741ef7 tempest-VolumesAssistedSnapshotsTest-54650267 tempest-VolumesAssistedSnapshotsTest-54650267-project] Exception during message handling: KeyError: 'type'
Nov 14 09:46:35 user nova-compute[75229]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 14 09:46:35 user nova-compute[75229]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 14 09:46:35 user nova-compute[75229]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 14 09:46:35 user nova-compute[75229]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 14 09:46:35 user nova-compute[75229]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 14 09:46:35 user nova-compute[75229]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 14 09:46:35 user nova-compute[75229]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 14 09:46:35 user nova-compute[75229]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Nov 14 09:46:35 user nova-compute[75229]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Nov 14 09:46:35 user nova-compute[75229]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 14 09:46:35 user nova-compute[75229]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 14 09:46:35 user nova-compute[75229]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 14 09:46:35 user nova-compute[75229]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 14 09:46:35 user nova-compute[75229]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 14 09:46:35 user nova-compute[75229]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 14 09:46:35 user nova-compute[75229]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 14 09:46:35 user nova-compute[75229]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 14 09:46:35 user nova-compute[75229]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4517, in volume_snapshot_delete
Nov 14 09:46:35 user nova-compute[75229]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_delete(context, instance, volume_id,
Nov 14 09:46:35 user nova-compute[75229]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3853, in volume_snapshot_delete
Nov 14 09:46:35 user nova-compute[75229]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 14 09:46:35 user nova-compute[75229]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 14 09:46:35 user nova-compute[75229]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 14 09:46:35 user nova-compute[75229]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 14 09:46:35 user nova-compute[75229]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 14 09:46:35 user nova-compute[75229]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 14 09:46:35 user nova-compute[75229]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_delete(context, instance, volume_id,
Nov 14 09:46:35 user nova-compute[75229]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 14 09:46:35 user nova-compute[75229]: ERROR oslo_messaging.rpc.server     if delete_info['type'] != 'qcow2':
Nov 14 09:46:35 user nova-compute[75229]: ERROR oslo_messaging.rpc.server KeyError: 'type'
Nov 14 09:46:35 user nova-compute[75229]: ERROR oslo_messaging.rpc.server 
Nov 14 09:46:35 user nova-compute[75229]: ERROR oslo_messaging.rpc.server [None req-68af3203-f01d-4f37-b9fb-ced68304d9db tempest-VolumesAssistedSnapshotsTest-54650267 tempest-VolumesAssistedSnapshotsTest-54650267-project] Exception during message handling: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 14 09:46:35 user nova-compute[75229]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 14 09:46:35 user nova-compute[75229]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 14 09:46:35 user nova-compute[75229]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 14 09:46:35 user nova-compute[75229]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 14 09:46:35 user nova-compute[75229]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 14 09:46:35 user nova-compute[75229]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 14 09:46:35 user nova-compute[75229]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 14 09:46:35 user nova-compute[75229]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Nov 14 09:46:35 user nova-compute[75229]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Nov 14 09:46:35 user nova-compute[75229]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 14 09:46:35 user nova-compute[75229]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 14 09:46:35 user nova-compute[75229]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 14 09:46:35 user nova-compute[75229]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 14 09:46:35 user nova-compute[75229]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 14 09:46:35 user nova-compute[75229]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 14 09:46:35 user nova-compute[75229]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 14 09:46:35 user nova-compute[75229]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 14 09:46:35 user nova-compute[75229]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4505, in volume_snapshot_create
Nov 14 09:46:35 user nova-compute[75229]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_create(context, instance, volume_id,
Nov 14 09:46:35 user nova-compute[75229]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3597, in volume_snapshot_create
Nov 14 09:46:35 user nova-compute[75229]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 14 09:46:35 user nova-compute[75229]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 14 09:46:35 user nova-compute[75229]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 14 09:46:35 user nova-compute[75229]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 14 09:46:35 user nova-compute[75229]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 14 09:46:35 user nova-compute[75229]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 14 09:46:35 user nova-compute[75229]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_create(context, instance, guest,
Nov 14 09:46:35 user nova-compute[75229]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 14 09:46:35 user nova-compute[75229]: ERROR oslo_messaging.rpc.server     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 14 09:46:35 user nova-compute[75229]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 14 09:46:35 user nova-compute[75229]: ERROR oslo_messaging.rpc.server     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 14 09:46:35 user nova-compute[75229]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 14 09:46:35 user nova-compute[75229]: ERROR oslo_messaging.rpc.server     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 14 09:46:35 user nova-compute[75229]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 14 09:46:35 user nova-compute[75229]: ERROR oslo_messaging.rpc.server     rv = execute(f, *args, **kwargs)
Nov 14 09:46:35 user nova-compute[75229]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 14 09:46:35 user nova-compute[75229]: ERROR oslo_messaging.rpc.server     six.reraise(c, e, tb)
Nov 14 09:46:35 user nova-compute[75229]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 14 09:46:35 user nova-compute[75229]: ERROR oslo_messaging.rpc.server     raise value
Nov 14 09:46:35 user nova-compute[75229]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 14 09:46:35 user nova-compute[75229]: ERROR oslo_messaging.rpc.server     rv = meth(*args, **kwargs)
Nov 14 09:46:35 user nova-compute[75229]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 14 09:46:35 user nova-compute[75229]: ERROR oslo_messaging.rpc.server     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 14 09:46:35 user nova-compute[75229]: ERROR oslo_messaging.rpc.server libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 14 09:46:35 user nova-compute[75229]: ERROR oslo_messaging.rpc.server 
Nov 14 09:46:35 user nova-compute[75229]: DEBUG nova.virt.libvirt.guest [None req-46a6734f-557c-4e1b-a94f-736be046e361 tempest-TestVolumeSwap-1816306665 tempest-TestVolumeSwap-1816306665-project-admin] COPY block job progress, current cursor: 900726784 final cursor: 1073741824 {{(pid=75229) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 09:46:35 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-e7c66110-060e-47d3-82eb-fc9dcb9a28c8 tempest-VolumesAssistedSnapshotsTest-1584778058 tempest-VolumesAssistedSnapshotsTest-1584778058-project-admin] Acquiring lock "8623fdcc-99b7-44d6-ad81-dada5ba83a88" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:46:35 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-e7c66110-060e-47d3-82eb-fc9dcb9a28c8 tempest-VolumesAssistedSnapshotsTest-1584778058 tempest-VolumesAssistedSnapshotsTest-1584778058-project-admin] Lock "8623fdcc-99b7-44d6-ad81-dada5ba83a88" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:46:35 user nova-compute[75229]: INFO nova.compute.manager [None req-e7c66110-060e-47d3-82eb-fc9dcb9a28c8 tempest-VolumesAssistedSnapshotsTest-1584778058 tempest-VolumesAssistedSnapshotsTest-1584778058-project-admin] [instance: 8623fdcc-99b7-44d6-ad81-dada5ba83a88] Detaching volume c7022511-a003-46d5-bcc1-064be770a829
Nov 14 09:46:35 user nova-compute[75229]: DEBUG nova.objects.instance [None req-1a874eb1-bc94-4d89-bceb-f6525a412799 tempest-AttachSCSIVolumeTestJSON-982350058 tempest-AttachSCSIVolumeTestJSON-982350058-project-member] Lazy-loading 'flavor' on Instance uuid 37e63bd9-44fc-4d07-b31b-570f69d7bc8a {{(pid=75229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 09:46:35 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-1a874eb1-bc94-4d89-bceb-f6525a412799 tempest-AttachSCSIVolumeTestJSON-982350058 tempest-AttachSCSIVolumeTestJSON-982350058-project-member] Lock "37e63bd9-44fc-4d07-b31b-570f69d7bc8a" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.161s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:46:35 user nova-compute[75229]: INFO nova.virt.block_device [None req-e7c66110-060e-47d3-82eb-fc9dcb9a28c8 tempest-VolumesAssistedSnapshotsTest-1584778058 tempest-VolumesAssistedSnapshotsTest-1584778058-project-admin] [instance: 8623fdcc-99b7-44d6-ad81-dada5ba83a88] Attempting to driver detach volume c7022511-a003-46d5-bcc1-064be770a829 from mountpoint /dev/vdb
Nov 14 09:46:35 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-e7c66110-060e-47d3-82eb-fc9dcb9a28c8 tempest-VolumesAssistedSnapshotsTest-1584778058 tempest-VolumesAssistedSnapshotsTest-1584778058-project-admin] Attempting to detach device vdb from instance 8623fdcc-99b7-44d6-ad81-dada5ba83a88 from the persistent domain config. {{(pid=75229) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 09:46:35 user nova-compute[75229]: DEBUG nova.virt.libvirt.guest [None req-e7c66110-060e-47d3-82eb-fc9dcb9a28c8 tempest-VolumesAssistedSnapshotsTest-1584778058 tempest-VolumesAssistedSnapshotsTest-1584778058-project-admin] detach device xml: <disk type="block" device="disk">
Nov 14 09:46:35 user nova-compute[75229]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 09:46:35 user nova-compute[75229]:   <source dev="/dev/sdi"/>
Nov 14 09:46:35 user nova-compute[75229]:   <target dev="vdb" bus="virtio"/>
Nov 14 09:46:35 user nova-compute[75229]:   <serial>c7022511-a003-46d5-bcc1-064be770a829</serial>
Nov 14 09:46:35 user nova-compute[75229]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 09:46:35 user nova-compute[75229]: </disk>
Nov 14 09:46:35 user nova-compute[75229]:  {{(pid=75229) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 09:46:35 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-e7c66110-060e-47d3-82eb-fc9dcb9a28c8 tempest-VolumesAssistedSnapshotsTest-1584778058 tempest-VolumesAssistedSnapshotsTest-1584778058-project-admin] Successfully detached device vdb from instance 8623fdcc-99b7-44d6-ad81-dada5ba83a88 from the persistent domain config.
Nov 14 09:46:35 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-e7c66110-060e-47d3-82eb-fc9dcb9a28c8 tempest-VolumesAssistedSnapshotsTest-1584778058 tempest-VolumesAssistedSnapshotsTest-1584778058-project-admin] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 8623fdcc-99b7-44d6-ad81-dada5ba83a88 from the live domain config. {{(pid=75229) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 09:46:35 user nova-compute[75229]: DEBUG nova.virt.libvirt.guest [None req-e7c66110-060e-47d3-82eb-fc9dcb9a28c8 tempest-VolumesAssistedSnapshotsTest-1584778058 tempest-VolumesAssistedSnapshotsTest-1584778058-project-admin] detach device xml: <disk type="block" device="disk">
Nov 14 09:46:35 user nova-compute[75229]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 09:46:35 user nova-compute[75229]:   <source dev="/dev/sdi"/>
Nov 14 09:46:35 user nova-compute[75229]:   <target dev="vdb" bus="virtio"/>
Nov 14 09:46:35 user nova-compute[75229]:   <serial>c7022511-a003-46d5-bcc1-064be770a829</serial>
Nov 14 09:46:35 user nova-compute[75229]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 09:46:35 user nova-compute[75229]: </disk>
Nov 14 09:46:35 user nova-compute[75229]:  {{(pid=75229) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 09:46:35 user nova-compute[75229]: DEBUG nova.virt.libvirt.guest [None req-46a6734f-557c-4e1b-a94f-736be046e361 tempest-TestVolumeSwap-1816306665 tempest-TestVolumeSwap-1816306665-project-admin] COPY block job progress, current cursor: 1050673152 final cursor: 1073741824 {{(pid=75229) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 09:46:36 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-e7c66110-060e-47d3-82eb-fc9dcb9a28c8 tempest-VolumesAssistedSnapshotsTest-1584778058 tempest-VolumesAssistedSnapshotsTest-1584778058-project-admin] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 8623fdcc-99b7-44d6-ad81-dada5ba83a88 {{(pid=75229) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 09:46:36 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-4a0ee55e-dfe7-41d5-8099-87bd9047f2f1 tempest-AttachSCSIVolumeTestJSON-982350058 tempest-AttachSCSIVolumeTestJSON-982350058-project-member] Acquiring lock "37e63bd9-44fc-4d07-b31b-570f69d7bc8a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:46:36 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-4a0ee55e-dfe7-41d5-8099-87bd9047f2f1 tempest-AttachSCSIVolumeTestJSON-982350058 tempest-AttachSCSIVolumeTestJSON-982350058-project-member] Lock "37e63bd9-44fc-4d07-b31b-570f69d7bc8a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:46:36 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-4a0ee55e-dfe7-41d5-8099-87bd9047f2f1 tempest-AttachSCSIVolumeTestJSON-982350058 tempest-AttachSCSIVolumeTestJSON-982350058-project-member] Acquiring lock "37e63bd9-44fc-4d07-b31b-570f69d7bc8a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:46:36 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-4a0ee55e-dfe7-41d5-8099-87bd9047f2f1 tempest-AttachSCSIVolumeTestJSON-982350058 tempest-AttachSCSIVolumeTestJSON-982350058-project-member] Lock "37e63bd9-44fc-4d07-b31b-570f69d7bc8a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:46:36 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-4a0ee55e-dfe7-41d5-8099-87bd9047f2f1 tempest-AttachSCSIVolumeTestJSON-982350058 tempest-AttachSCSIVolumeTestJSON-982350058-project-member] Lock "37e63bd9-44fc-4d07-b31b-570f69d7bc8a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:46:36 user nova-compute[75229]: INFO nova.compute.manager [None req-4a0ee55e-dfe7-41d5-8099-87bd9047f2f1 tempest-AttachSCSIVolumeTestJSON-982350058 tempest-AttachSCSIVolumeTestJSON-982350058-project-member] [instance: 37e63bd9-44fc-4d07-b31b-570f69d7bc8a] Terminating instance
Nov 14 09:46:36 user nova-compute[75229]: DEBUG nova.compute.manager [None req-4a0ee55e-dfe7-41d5-8099-87bd9047f2f1 tempest-AttachSCSIVolumeTestJSON-982350058 tempest-AttachSCSIVolumeTestJSON-982350058-project-member] [instance: 37e63bd9-44fc-4d07-b31b-570f69d7bc8a] Start destroying the instance on the hypervisor. {{(pid=75229) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 09:46:36 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:46:36 user nova-compute[75229]: DEBUG nova.virt.libvirt.guest [None req-46a6734f-557c-4e1b-a94f-736be046e361 tempest-TestVolumeSwap-1816306665 tempest-TestVolumeSwap-1816306665-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=75229) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 09:46:36 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:46:36 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:46:36 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:46:36 user nova-compute[75229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-46a6734f-557c-4e1b-a94f-736be046e361 tempest-TestVolumeSwap-1816306665 tempest-TestVolumeSwap-1816306665-project-admin] [instance: c307660b-01bb-471b-9e2e-5c2aaca65287] calling os-brick to detach iSCSI Volume {{(pid=75229) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 09:46:36 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-46a6734f-557c-4e1b-a94f-736be046e361 tempest-TestVolumeSwap-1816306665 tempest-TestVolumeSwap-1816306665-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f73f85151b0>, {'target_iqn': 'iqn.2010-10.org.openstack:52ae1fea-5339-4958-88ae-d103080e7743', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xkXQEUcf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': False}}" {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 09:46:36 user nova-compute[75229]: WARNING os_brick.initiator.connectors.base [None req-46a6734f-557c-4e1b-a94f-736be046e361 tempest-TestVolumeSwap-1816306665 tempest-TestVolumeSwap-1816306665-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 09:46:36 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-46a6734f-557c-4e1b-a94f-736be046e361 tempest-TestVolumeSwap-1816306665 tempest-TestVolumeSwap-1816306665-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 09:46:36 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-46a6734f-557c-4e1b-a94f-736be046e361 tempest-TestVolumeSwap-1816306665 tempest-TestVolumeSwap-1816306665-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 09:46:36 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:46:36 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:46:36 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[410623ea-06c1-49a0-b17f-331610a343ae]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c2324d4e-6e60-47fd-b536-144a7ea32dce\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:52ae1fea-5339-4958-88ae-d103080e7743\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:97f588de-32d5-4d48-9c06-5925263ba117\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:18a1e95e-5df1-4db1-92bc-6cd67729c7a7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c7022511-a003-46d5-bcc1-064be770a829\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e2472759-033a-4051-9dec-4516d0aef07d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7144f229-1f5e-4155-aba1-ab44218df41a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:46:36 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-46a6734f-557c-4e1b-a94f-736be046e361 tempest-TestVolumeSwap-1816306665 tempest-TestVolumeSwap-1816306665-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 09:46:36 user nova-compute[75229]: No targets found.
Nov 14 09:46:36 user nova-compute[75229]: iSNS:
Nov 14 09:46:36 user nova-compute[75229]: No targets found.
Nov 14 09:46:36 user nova-compute[75229]: STATIC:
Nov 14 09:46:36 user nova-compute[75229]: Target: iqn.2010-10.org.openstack:c2324d4e-6e60-47fd-b536-144a7ea32dce
Nov 14 09:46:36 user nova-compute[75229]:         Portal: 172.16.0.220:3260,-1
Nov 14 09:46:36 user nova-compute[75229]:                 Iface Name: default
Nov 14 09:46:36 user nova-compute[75229]: Target: iqn.2010-10.org.openstack:52ae1fea-5339-4958-88ae-d103080e7743
Nov 14 09:46:36 user nova-compute[75229]:         Portal: 172.16.0.220:3260,-1
Nov 14 09:46:36 user nova-compute[75229]:                 Iface Name: default
Nov 14 09:46:36 user nova-compute[75229]: Target: iqn.2010-10.org.openstack:97f588de-32d5-4d48-9c06-5925263ba117
Nov 14 09:46:36 user nova-compute[75229]:         Portal: 172.16.0.220:3260,-1
Nov 14 09:46:36 user nova-compute[75229]:                 Iface Name: default
Nov 14 09:46:36 user nova-compute[75229]: Target: iqn.2010-10.org.openstack:18a1e95e-5df1-4db1-92bc-6cd67729c7a7
Nov 14 09:46:36 user nova-compute[75229]:         Portal: 172.16.0.220:3260,-1
Nov 14 09:46:36 user nova-compute[75229]:                 Iface Name: default
Nov 14 09:46:36 user nova-compute[75229]: Target: iqn.2010-10.org.openstack:c7022511-a003-46d5-bcc1-064be770a829
Nov 14 09:46:36 user nova-compute[75229]:         Portal: 172.16.0.220:3260,-1
Nov 14 09:46:36 user nova-compute[75229]:                 Iface Name: default
Nov 14 09:46:36 user nova-compute[75229]: Target: iqn.2010-10.org.openstack:e2472759-033a-4051-9dec-4516d0aef07d
Nov 14 09:46:36 user nova-compute[75229]:         Portal: 172.16.0.220:3260,-1
Nov 14 09:46:36 user nova-compute[75229]:                 Iface Name: default
Nov 14 09:46:36 user nova-compute[75229]: Target: iqn.2010-10.org.openstack:7144f229-1f5e-4155-aba1-ab44218df41a
Nov 14 09:46:36 user nova-compute[75229]:         Portal: 172.16.0.220:3260,-1
Nov 14 09:46:36 user nova-compute[75229]:                 Iface Name: default
Nov 14 09:46:36 user nova-compute[75229]: FIRMWARE:
Nov 14 09:46:36 user nova-compute[75229]: No targets found.
Nov 14 09:46:36 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 09:46:36 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-46a6734f-557c-4e1b-a94f-736be046e361 tempest-TestVolumeSwap-1816306665 tempest-TestVolumeSwap-1816306665-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 09:46:36 user nova-compute[75229]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 09:46:36 user nova-compute[75229]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75229) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 09:46:36 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-46a6734f-557c-4e1b-a94f-736be046e361 tempest-TestVolumeSwap-1816306665 tempest-TestVolumeSwap-1816306665-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:52ae1fea-5339-4958-88ae-d103080e7743', 0)] {{(pid=75229) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 09:46:36 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:46:36 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:46:36 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dc575d8-39d8-48f2-a212-921e3a591045]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:18a1e95e-5df1-4db1-92bc-6cd67729c7a7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:52ae1fea-5339-4958-88ae-d103080e7743\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7144f229-1f5e-4155-aba1-ab44218df41a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:97f588de-32d5-4d48-9c06-5925263ba117\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c2324d4e-6e60-47fd-b536-144a7ea32dce\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c7022511-a003-46d5-bcc1-064be770a829\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e2472759-033a-4051-9dec-4516d0aef07d\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:46:36 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:46:36 user nova-compute[75229]: DEBUG nova.compute.manager [req-46759baa-c075-47f4-aa5e-05b4c63517bb req-7620c900-d32f-4bac-82a6-1d7f510a48ad service nova] [instance: 37e63bd9-44fc-4d07-b31b-570f69d7bc8a] Received event network-vif-unplugged-22c0a013-145e-46f8-ab59-f883d51567e6 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:46:36 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-46759baa-c075-47f4-aa5e-05b4c63517bb req-7620c900-d32f-4bac-82a6-1d7f510a48ad service nova] Acquiring lock "37e63bd9-44fc-4d07-b31b-570f69d7bc8a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:46:36 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-46759baa-c075-47f4-aa5e-05b4c63517bb req-7620c900-d32f-4bac-82a6-1d7f510a48ad service nova] Lock "37e63bd9-44fc-4d07-b31b-570f69d7bc8a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:46:36 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-46759baa-c075-47f4-aa5e-05b4c63517bb req-7620c900-d32f-4bac-82a6-1d7f510a48ad service nova] Lock "37e63bd9-44fc-4d07-b31b-570f69d7bc8a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:46:36 user nova-compute[75229]: DEBUG nova.compute.manager [req-46759baa-c075-47f4-aa5e-05b4c63517bb req-7620c900-d32f-4bac-82a6-1d7f510a48ad service nova] [instance: 37e63bd9-44fc-4d07-b31b-570f69d7bc8a] No waiting events found dispatching network-vif-unplugged-22c0a013-145e-46f8-ab59-f883d51567e6 {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 09:46:36 user nova-compute[75229]: DEBUG nova.compute.manager [req-46759baa-c075-47f4-aa5e-05b4c63517bb req-7620c900-d32f-4bac-82a6-1d7f510a48ad service nova] [instance: 37e63bd9-44fc-4d07-b31b-570f69d7bc8a] Received event network-vif-unplugged-22c0a013-145e-46f8-ab59-f883d51567e6 for instance with task_state deleting. {{(pid=75229) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 09:46:36 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:46:36 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[662948e7-b82c-4a25-bc33-5df6521733cc]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2472759-033a-4051-9dec-4516d0aef07d (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7022511-a003-46d5-bcc1-064be770a829 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2324d4e-6e60-47fd-b536-144a7ea32dce (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18a1e95e-5df1-4db1-92bc-6cd67729c7a7 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97f588de-32d5-4d48-9c06-5925263ba117 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7144f229-1f5e-4155-aba1-ab44218df41a (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52ae1fea-5339-4958-88ae-d103080e7743 (non-flash)\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:46:36 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-46a6734f-557c-4e1b-a94f-736be046e361 tempest-TestVolumeSwap-1816306665 tempest-TestVolumeSwap-1816306665-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2472759-033a-4051-9dec-4516d0aef07d (non-flash)
Nov 14 09:46:36 user nova-compute[75229]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7022511-a003-46d5-bcc1-064be770a829 (non-flash)
Nov 14 09:46:36 user nova-compute[75229]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2324d4e-6e60-47fd-b536-144a7ea32dce (non-flash)
Nov 14 09:46:36 user nova-compute[75229]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18a1e95e-5df1-4db1-92bc-6cd67729c7a7 (non-flash)
Nov 14 09:46:36 user nova-compute[75229]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97f588de-32d5-4d48-9c06-5925263ba117 (non-flash)
Nov 14 09:46:36 user nova-compute[75229]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7144f229-1f5e-4155-aba1-ab44218df41a (non-flash)
Nov 14 09:46:36 user nova-compute[75229]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52ae1fea-5339-4958-88ae-d103080e7743 (non-flash)
Nov 14 09:46:36 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 09:46:36 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-46a6734f-557c-4e1b-a94f-736be046e361 tempest-TestVolumeSwap-1816306665 tempest-TestVolumeSwap-1816306665-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2472759-033a-4051-9dec-4516d0aef07d (non-flash)
Nov 14 09:46:36 user nova-compute[75229]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7022511-a003-46d5-bcc1-064be770a829 (non-flash)
Nov 14 09:46:36 user nova-compute[75229]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2324d4e-6e60-47fd-b536-144a7ea32dce (non-flash)
Nov 14 09:46:36 user nova-compute[75229]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18a1e95e-5df1-4db1-92bc-6cd67729c7a7 (non-flash)
Nov 14 09:46:36 user nova-compute[75229]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97f588de-32d5-4d48-9c06-5925263ba117 (non-flash)
Nov 14 09:46:36 user nova-compute[75229]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7144f229-1f5e-4155-aba1-ab44218df41a (non-flash)
Nov 14 09:46:36 user nova-compute[75229]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52ae1fea-5339-4958-88ae-d103080e7743 (non-flash)
Nov 14 09:46:36 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 09:46:36 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-46a6734f-557c-4e1b-a94f-736be046e361 tempest-TestVolumeSwap-1816306665 tempest-TestVolumeSwap-1816306665-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f73d4f5c9d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:52ae1fea-5339-4958-88ae-d103080e7743'): ({'sdh'}, set())}) {{(pid=75229) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 09:46:36 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-46a6734f-557c-4e1b-a94f-736be046e361 tempest-TestVolumeSwap-1816306665 tempest-TestVolumeSwap-1816306665-project-admin] Removing single pathed devices sdh {{(pid=75229) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 09:46:36 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:46:36 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:46:36 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[7486a111-297c-4f8d-b475-71a0db60cd6b]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:46:36 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:46:36 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.021s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:46:36 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba2404af-643a-4caa-afe0-0928bdec36aa]: (4, ('ok\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:46:36 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-46a6734f-557c-4e1b-a94f-736be046e361 tempest-TestVolumeSwap-1816306665 tempest-TestVolumeSwap-1816306665-project-admin] Flushing IO for device /dev/sdh {{(pid=75229) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 09:46:36 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:46:36 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.013s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:46:36 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[85302a5c-9752-4edc-9e3d-84a1000b63bd]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:46:36 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-46a6734f-557c-4e1b-a94f-736be046e361 tempest-TestVolumeSwap-1816306665 tempest-TestVolumeSwap-1816306665-project-admin] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=75229) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 09:46:36 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:46:36 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.043s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:46:36 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[4aea1ad5-8c84-4910-bc7c-807ce1e97d55]: (4, ('1', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:46:36 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-46a6734f-557c-4e1b-a94f-736be046e361 tempest-TestVolumeSwap-1816306665 tempest-TestVolumeSwap-1816306665-project-admin] Checking to see if SCSI volumes sdh have been removed. {{(pid=75229) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 09:46:36 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-46a6734f-557c-4e1b-a94f-736be046e361 tempest-TestVolumeSwap-1816306665 tempest-TestVolumeSwap-1816306665-project-admin] SCSI volumes sdh have been removed. {{(pid=75229) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 09:46:36 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-46a6734f-557c-4e1b-a94f-736be046e361 tempest-TestVolumeSwap-1816306665 tempest-TestVolumeSwap-1816306665-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:52ae1fea-5339-4958-88ae-d103080e7743')] {{(pid=75229) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 09:46:36 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52ae1fea-5339-4958-88ae-d103080e7743 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:46:36 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52ae1fea-5339-4958-88ae-d103080e7743 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:46:36 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f553c12-1acb-47db-b8be-0e1b27adcd8e]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:46:36 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-46a6734f-557c-4e1b-a94f-736be046e361 tempest-TestVolumeSwap-1816306665 tempest-TestVolumeSwap-1816306665-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:46:36 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52ae1fea-5339-4958-88ae-d103080e7743 -p 172.16.0.220:3260 --logout {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:46:36 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52ae1fea-5339-4958-88ae-d103080e7743 -p 172.16.0.220:3260 --logout" returned: 0 in 0.091s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:46:36 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdc1f0af-96a7-4c67-971c-f3ca8df69a1f]: (4, ('Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:52ae1fea-5339-4958-88ae-d103080e7743, portal: 172.16.0.220,3260]\nLogout of [sid: 9, target: iqn.2010-10.org.openstack:52ae1fea-5339-4958-88ae-d103080e7743, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:46:36 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-46a6734f-557c-4e1b-a94f-736be046e361 tempest-TestVolumeSwap-1816306665 tempest-TestVolumeSwap-1816306665-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:52ae1fea-5339-4958-88ae-d103080e7743, portal: 172.16.0.220,3260]
Nov 14 09:46:36 user nova-compute[75229]: Logout of [sid: 9, target: iqn.2010-10.org.openstack:52ae1fea-5339-4958-88ae-d103080e7743, portal: 172.16.0.220,3260] successful.
Nov 14 09:46:36 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:46:36 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52ae1fea-5339-4958-88ae-d103080e7743 -p 172.16.0.220:3260 --op delete {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:46:36 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52ae1fea-5339-4958-88ae-d103080e7743 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:46:36 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[13c98036-4380-4bc8-8fbe-9b13162643b0]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:46:36 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-46a6734f-557c-4e1b-a94f-736be046e361 tempest-TestVolumeSwap-1816306665 tempest-TestVolumeSwap-1816306665-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:46:36 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-46a6734f-557c-4e1b-a94f-736be046e361 tempest-TestVolumeSwap-1816306665 tempest-TestVolumeSwap-1816306665-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.348s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 09:46:36 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-46a6734f-557c-4e1b-a94f-736be046e361 tempest-TestVolumeSwap-1816306665 tempest-TestVolumeSwap-1816306665-project-admin] <== disconnect_volume: return (349ms) None {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 09:46:36 user nova-compute[75229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-46a6734f-557c-4e1b-a94f-736be046e361 tempest-TestVolumeSwap-1816306665 tempest-TestVolumeSwap-1816306665-project-admin] [instance: c307660b-01bb-471b-9e2e-5c2aaca65287] Disconnected iSCSI Volume {{(pid=75229) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 09:46:36 user nova-compute[75229]: DEBUG nova.compute.manager [None req-46a6734f-557c-4e1b-a94f-736be046e361 tempest-TestVolumeSwap-1816306665 tempest-TestVolumeSwap-1816306665-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:e2472759-033a-4051-9dec-4516d0aef07d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JCKHSoDN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, 'status': 'reserved', 'instance': 'c307660b-01bb-471b-9e2e-5c2aaca65287', 'attached_at': '', 'detached_at': '', 'volume_id': 'e2472759-033a-4051-9dec-4516d0aef07d', 'serial'} {{(pid=75229) _swap_volume /opt/stack/nova/nova/compute/manager.py:7791}}
Nov 14 09:46:36 user nova-compute[75229]: DEBUG nova.compute.manager [None req-46a6734f-557c-4e1b-a94f-736be046e361 tempest-TestVolumeSwap-1816306665 tempest-TestVolumeSwap-1816306665-project-admin] [instance: c307660b-01bb-471b-9e2e-5c2aaca65287] swap_volume: removing Cinder connection for volume 52ae1fea-5339-4958-88ae-d103080e7743 {{(pid=75229) _swap_volume /opt/stack/nova/nova/compute/manager.py:7836}}
Nov 14 09:46:36 user nova-compute[75229]: INFO nova.virt.libvirt.driver [-] [instance: 37e63bd9-44fc-4d07-b31b-570f69d7bc8a] Instance destroyed successfully.
Nov 14 09:46:36 user nova-compute[75229]: DEBUG nova.objects.instance [None req-4a0ee55e-dfe7-41d5-8099-87bd9047f2f1 tempest-AttachSCSIVolumeTestJSON-982350058 tempest-AttachSCSIVolumeTestJSON-982350058-project-member] Lazy-loading 'resources' on Instance uuid 37e63bd9-44fc-4d07-b31b-570f69d7bc8a {{(pid=75229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 09:46:36 user nova-compute[75229]: DEBUG nova.virt.libvirt.vif [None req-4a0ee55e-dfe7-41d5-8099-87bd9047f2f1 tempest-AttachSCSIVolumeTestJSON-982350058 tempest-AttachSCSIVolumeTestJSON-982350058-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T09:44:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1278987485',display_name='tempest-AttachSCSIVolumeTestJSON-server-1278987485',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1278987485',id=7,image_ref='9baffe73-1dea-4547-b030-c3877c548cb7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAvwF3/nF/oHteQ5rKMukokUZtat53J3Dz6NQfXHwPIOFeU1ZhP3BjU/ay7ASLhg/tBOR3mcaesog2ve6fU3jAU4rLQ0DRB/6uvR3LQned4BF77zC6x6KGk60toGket/XQ==',key_name='tempest-keypair-1064628259',keypairs=<?>,launch_index=0,launched_at=2023-11-14T09:44:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b6cef322ee4d4353bf72c6ede953e1bb',ramdisk_id='',reservation_id='r-oyqi7dpr',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9baffe73-1dea-4547-b030-c3877c548cb7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_scsi_model='virtio-scsi',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-AttachSCSIVolumeTestJSON-982350058',owner_user_name='tempest-AttachSCSIVolumeTestJSON-982350058-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T09:44:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='baf7fbd1437042dc80b48263e32513d0',uuid=37e63bd9-44fc-4d07-b31b-570f69d7bc8a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "22c0a013-145e-46f8-ab59-f883d51567e6", "address": "fa:16:3e:4f:33:04", "network": {"id": "7141cb71-7f74-4de2-93a0-c94b9c8630fd", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1370522646-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.45", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6cef322ee4d4353bf72c6ede953e1bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22c0a013-14", "ovs_interfaceid": "22c0a013-145e-46f8-ab59-f883d51567e6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 09:46:36 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-4a0ee55e-dfe7-41d5-8099-87bd9047f2f1 tempest-AttachSCSIVolumeTestJSON-982350058 tempest-AttachSCSIVolumeTestJSON-982350058-project-member] Converting VIF {"id": "22c0a013-145e-46f8-ab59-f883d51567e6", "address": "fa:16:3e:4f:33:04", "network": {"id": "7141cb71-7f74-4de2-93a0-c94b9c8630fd", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1370522646-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.45", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6cef322ee4d4353bf72c6ede953e1bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22c0a013-14", "ovs_interfaceid": "22c0a013-145e-46f8-ab59-f883d51567e6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 09:46:36 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-4a0ee55e-dfe7-41d5-8099-87bd9047f2f1 tempest-AttachSCSIVolumeTestJSON-982350058 tempest-AttachSCSIVolumeTestJSON-982350058-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4f:33:04,bridge_name='br-int',has_traffic_filtering=True,id=22c0a013-145e-46f8-ab59-f883d51567e6,network=Network(7141cb71-7f74-4de2-93a0-c94b9c8630fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22c0a013-14') {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 09:46:36 user nova-compute[75229]: DEBUG os_vif [None req-4a0ee55e-dfe7-41d5-8099-87bd9047f2f1 tempest-AttachSCSIVolumeTestJSON-982350058 tempest-AttachSCSIVolumeTestJSON-982350058-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4f:33:04,bridge_name='br-int',has_traffic_filtering=True,id=22c0a013-145e-46f8-ab59-f883d51567e6,network=Network(7141cb71-7f74-4de2-93a0-c94b9c8630fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22c0a013-14') {{(pid=75229) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 09:46:36 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:46:36 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap22c0a013-14, bridge=br-int, if_exists=True) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:46:36 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:46:36 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 09:46:36 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:46:36 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=be74a15e-7b35-4651-a008-1fc0f43279f1) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:46:36 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:46:36 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 09:46:36 user nova-compute[75229]: INFO os_vif [None req-4a0ee55e-dfe7-41d5-8099-87bd9047f2f1 tempest-AttachSCSIVolumeTestJSON-982350058 tempest-AttachSCSIVolumeTestJSON-982350058-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4f:33:04,bridge_name='br-int',has_traffic_filtering=True,id=22c0a013-145e-46f8-ab59-f883d51567e6,network=Network(7141cb71-7f74-4de2-93a0-c94b9c8630fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22c0a013-14')
Nov 14 09:46:36 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-4a0ee55e-dfe7-41d5-8099-87bd9047f2f1 tempest-AttachSCSIVolumeTestJSON-982350058 tempest-AttachSCSIVolumeTestJSON-982350058-project-member] [instance: 37e63bd9-44fc-4d07-b31b-570f69d7bc8a] Deleting instance files /opt/stack/data/nova/instances/37e63bd9-44fc-4d07-b31b-570f69d7bc8a_del
Nov 14 09:46:36 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-4a0ee55e-dfe7-41d5-8099-87bd9047f2f1 tempest-AttachSCSIVolumeTestJSON-982350058 tempest-AttachSCSIVolumeTestJSON-982350058-project-member] [instance: 37e63bd9-44fc-4d07-b31b-570f69d7bc8a] Deletion of /opt/stack/data/nova/instances/37e63bd9-44fc-4d07-b31b-570f69d7bc8a_del complete
Nov 14 09:46:37 user nova-compute[75229]: INFO nova.compute.manager [None req-4a0ee55e-dfe7-41d5-8099-87bd9047f2f1 tempest-AttachSCSIVolumeTestJSON-982350058 tempest-AttachSCSIVolumeTestJSON-982350058-project-member] [instance: 37e63bd9-44fc-4d07-b31b-570f69d7bc8a] Took 0.89 seconds to destroy the instance on the hypervisor.
Nov 14 09:46:37 user nova-compute[75229]: DEBUG oslo.service.loopingcall [None req-4a0ee55e-dfe7-41d5-8099-87bd9047f2f1 tempest-AttachSCSIVolumeTestJSON-982350058 tempest-AttachSCSIVolumeTestJSON-982350058-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75229) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 09:46:37 user nova-compute[75229]: DEBUG nova.compute.manager [-] [instance: 37e63bd9-44fc-4d07-b31b-570f69d7bc8a] Deallocating network for instance {{(pid=75229) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 09:46:37 user nova-compute[75229]: DEBUG nova.network.neutron [-] [instance: 37e63bd9-44fc-4d07-b31b-570f69d7bc8a] deallocate_for_instance() {{(pid=75229) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 09:46:37 user nova-compute[75229]: DEBUG nova.compute.manager [None req-46a6734f-557c-4e1b-a94f-736be046e361 tempest-TestVolumeSwap-1816306665 tempest-TestVolumeSwap-1816306665-project-admin] [instance: c307660b-01bb-471b-9e2e-5c2aaca65287] swap_volume: Updating volume 52ae1fea-5339-4958-88ae-d103080e7743 BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:e2472759-033a-4051-9dec-4516d0aef07d", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "JCKHSoDN", "auth_password": "CNKwRQdIsnqLxP", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sde", "volume_id": "e2472759-033a-4051-9dec-4516d0aef07d"}, "status": "reserved", "instance": "c307660b-01bb-471b-9e2e-5c2aaca65287", "attached_at": "", "detached_at": "", "volume_id": "e2472759-033a-4051-9dec-4516d0aef07d", "serial": "e2472759-033a-4051-9dec-4516d0aef07d"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': 'e2472759-033a-4051-9dec-4516d0aef07d', 'no_device': None, 'attachment_id': '275fc899-3cde-4a86-a47d-4ac8f3d0e12b'} {{(pid=75229) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7984}}
Nov 14 09:46:37 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-46a6734f-557c-4e1b-a94f-736be046e361 tempest-TestVolumeSwap-1816306665 tempest-TestVolumeSwap-1816306665-project-admin] Lock "c307660b-01bb-471b-9e2e-5c2aaca65287" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 12.533s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:46:37 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:46:37 user nova-compute[75229]: DEBUG nova.network.neutron [-] [instance: 37e63bd9-44fc-4d07-b31b-570f69d7bc8a] Updating instance_info_cache with network_info: [] {{(pid=75229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 09:46:37 user nova-compute[75229]: INFO nova.compute.manager [-] [instance: 37e63bd9-44fc-4d07-b31b-570f69d7bc8a] Took 0.79 seconds to deallocate network for instance.
Nov 14 09:46:37 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-4a0ee55e-dfe7-41d5-8099-87bd9047f2f1 tempest-AttachSCSIVolumeTestJSON-982350058 tempest-AttachSCSIVolumeTestJSON-982350058-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:46:37 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-4a0ee55e-dfe7-41d5-8099-87bd9047f2f1 tempest-AttachSCSIVolumeTestJSON-982350058 tempest-AttachSCSIVolumeTestJSON-982350058-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:46:37 user nova-compute[75229]: DEBUG nova.compute.manager [req-3a9e3d3c-648f-4167-a104-168cc1931b80 req-82ebfb28-700d-4972-be52-691ba7a8b053 service nova] [instance: af5fd5af-63a6-4eee-a4ef-6088a3713214] Received event network-changed-a1999f33-4f1d-47b0-a91a-48bce4600e9b {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:46:37 user nova-compute[75229]: DEBUG nova.compute.manager [req-3a9e3d3c-648f-4167-a104-168cc1931b80 req-82ebfb28-700d-4972-be52-691ba7a8b053 service nova] [instance: af5fd5af-63a6-4eee-a4ef-6088a3713214] Refreshing instance network info cache due to event network-changed-a1999f33-4f1d-47b0-a91a-48bce4600e9b. {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 09:46:37 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-3a9e3d3c-648f-4167-a104-168cc1931b80 req-82ebfb28-700d-4972-be52-691ba7a8b053 service nova] Acquiring lock "refresh_cache-af5fd5af-63a6-4eee-a4ef-6088a3713214" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 09:46:37 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-3a9e3d3c-648f-4167-a104-168cc1931b80 req-82ebfb28-700d-4972-be52-691ba7a8b053 service nova] Acquired lock "refresh_cache-af5fd5af-63a6-4eee-a4ef-6088a3713214" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 09:46:37 user nova-compute[75229]: DEBUG nova.network.neutron [req-3a9e3d3c-648f-4167-a104-168cc1931b80 req-82ebfb28-700d-4972-be52-691ba7a8b053 service nova] [instance: af5fd5af-63a6-4eee-a4ef-6088a3713214] Refreshing network info cache for port a1999f33-4f1d-47b0-a91a-48bce4600e9b {{(pid=75229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 09:46:38 user nova-compute[75229]: DEBUG nova.compute.provider_tree [None req-4a0ee55e-dfe7-41d5-8099-87bd9047f2f1 tempest-AttachSCSIVolumeTestJSON-982350058 tempest-AttachSCSIVolumeTestJSON-982350058-project-member] Inventory has not changed in ProviderTree for provider: d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 {{(pid=75229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 09:46:38 user nova-compute[75229]: DEBUG nova.scheduler.client.report [None req-4a0ee55e-dfe7-41d5-8099-87bd9047f2f1 tempest-AttachSCSIVolumeTestJSON-982350058 tempest-AttachSCSIVolumeTestJSON-982350058-project-member] Inventory has not changed for provider d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 09:46:38 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-4a0ee55e-dfe7-41d5-8099-87bd9047f2f1 tempest-AttachSCSIVolumeTestJSON-982350058 tempest-AttachSCSIVolumeTestJSON-982350058-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.307s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:46:38 user nova-compute[75229]: INFO nova.scheduler.client.report [None req-4a0ee55e-dfe7-41d5-8099-87bd9047f2f1 tempest-AttachSCSIVolumeTestJSON-982350058 tempest-AttachSCSIVolumeTestJSON-982350058-project-member] Deleted allocations for instance 37e63bd9-44fc-4d07-b31b-570f69d7bc8a
Nov 14 09:46:38 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-4a0ee55e-dfe7-41d5-8099-87bd9047f2f1 tempest-AttachSCSIVolumeTestJSON-982350058 tempest-AttachSCSIVolumeTestJSON-982350058-project-member] Lock "37e63bd9-44fc-4d07-b31b-570f69d7bc8a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.181s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:46:38 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-14541822-20a0-4fb4-a231-073f47febc6d tempest-TestVolumeSwap-1816306665 tempest-TestVolumeSwap-1816306665-project-admin] Acquiring lock "c307660b-01bb-471b-9e2e-5c2aaca65287" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:46:38 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-14541822-20a0-4fb4-a231-073f47febc6d tempest-TestVolumeSwap-1816306665 tempest-TestVolumeSwap-1816306665-project-admin] Lock "c307660b-01bb-471b-9e2e-5c2aaca65287" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:46:38 user nova-compute[75229]: DEBUG os_brick.utils [None req-14541822-20a0-4fb4-a231-073f47febc6d tempest-TestVolumeSwap-1816306665 tempest-TestVolumeSwap-1816306665-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 09:46:38 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:46:38 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:46:38 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[84bc86b4-8447-4311-8316-12457d685b8f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f1154031c835\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:46:38 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:46:38 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:46:38 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[adcb6c02-a2f1-46f0-bf77-1dca73a3dcaf]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:46:38 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:46:38 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:46:38 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f869692-9476-4d6a-b678-b0c008df216d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:46:38 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[45cb3e19-14be-4a67-ba9a-d57c31d194bd]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:46:38 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-14541822-20a0-4fb4-a231-073f47febc6d tempest-TestVolumeSwap-1816306665 tempest-TestVolumeSwap-1816306665-project-admin] Running cmd (subprocess): nvme version {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:46:38 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-14541822-20a0-4fb4-a231-073f47febc6d tempest-TestVolumeSwap-1816306665 tempest-TestVolumeSwap-1816306665-project-admin] 'nvme version' failed. Not Retrying. {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 09:46:38 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.nvmeof [None req-14541822-20a0-4fb4-a231-073f47febc6d tempest-TestVolumeSwap-1816306665 tempest-TestVolumeSwap-1816306665-project-admin] nvme not present on system {{(pid=75229) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 09:46:38 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:46:38 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 09:46:38 user nova-compute[75229]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 09:46:38 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[420fedd6-abb4-4e1e-9121-b7e00302afa3]: (4, '') {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:46:38 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.lightos [None req-14541822-20a0-4fb4-a231-073f47febc6d tempest-TestVolumeSwap-1816306665 tempest-TestVolumeSwap-1816306665-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75229) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 09:46:38 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.lightos [None req-14541822-20a0-4fb4-a231-073f47febc6d tempest-TestVolumeSwap-1816306665 tempest-TestVolumeSwap-1816306665-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75229) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 09:46:38 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.lightos [None req-14541822-20a0-4fb4-a231-073f47febc6d tempest-TestVolumeSwap-1816306665 tempest-TestVolumeSwap-1816306665-project-admin] LIGHTOS: no hostnqn found. {{(pid=75229) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 09:46:38 user nova-compute[75229]: DEBUG os_brick.utils [None req-14541822-20a0-4fb4-a231-073f47febc6d tempest-TestVolumeSwap-1816306665 tempest-TestVolumeSwap-1816306665-project-admin] <== get_connector_properties: return (105ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f1154031c835', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 09:46:38 user nova-compute[75229]: INFO nova.compute.manager [None req-14541822-20a0-4fb4-a231-073f47febc6d tempest-TestVolumeSwap-1816306665 tempest-TestVolumeSwap-1816306665-project-admin] [instance: c307660b-01bb-471b-9e2e-5c2aaca65287] Swapping volume e2472759-033a-4051-9dec-4516d0aef07d for 52ae1fea-5339-4958-88ae-d103080e7743
Nov 14 09:46:38 user nova-compute[75229]: DEBUG nova.compute.manager [req-90bf0ccc-34bd-4445-98fc-bc52da74820f req-42dbc077-cdaf-4daf-900a-69c56017a546 service nova] [instance: 37e63bd9-44fc-4d07-b31b-570f69d7bc8a] Received event network-vif-plugged-22c0a013-145e-46f8-ab59-f883d51567e6 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:46:38 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-90bf0ccc-34bd-4445-98fc-bc52da74820f req-42dbc077-cdaf-4daf-900a-69c56017a546 service nova] Acquiring lock "37e63bd9-44fc-4d07-b31b-570f69d7bc8a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:46:38 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-90bf0ccc-34bd-4445-98fc-bc52da74820f req-42dbc077-cdaf-4daf-900a-69c56017a546 service nova] Lock "37e63bd9-44fc-4d07-b31b-570f69d7bc8a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:46:38 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-90bf0ccc-34bd-4445-98fc-bc52da74820f req-42dbc077-cdaf-4daf-900a-69c56017a546 service nova] Lock "37e63bd9-44fc-4d07-b31b-570f69d7bc8a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:46:38 user nova-compute[75229]: DEBUG nova.compute.manager [req-90bf0ccc-34bd-4445-98fc-bc52da74820f req-42dbc077-cdaf-4daf-900a-69c56017a546 service nova] [instance: 37e63bd9-44fc-4d07-b31b-570f69d7bc8a] No waiting events found dispatching network-vif-plugged-22c0a013-145e-46f8-ab59-f883d51567e6 {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 09:46:38 user nova-compute[75229]: WARNING nova.compute.manager [req-90bf0ccc-34bd-4445-98fc-bc52da74820f req-42dbc077-cdaf-4daf-900a-69c56017a546 service nova] [instance: 37e63bd9-44fc-4d07-b31b-570f69d7bc8a] Received unexpected event network-vif-plugged-22c0a013-145e-46f8-ab59-f883d51567e6 for instance with vm_state deleted and task_state None.
Nov 14 09:46:38 user nova-compute[75229]: DEBUG nova.compute.manager [req-90bf0ccc-34bd-4445-98fc-bc52da74820f req-42dbc077-cdaf-4daf-900a-69c56017a546 service nova] [instance: 37e63bd9-44fc-4d07-b31b-570f69d7bc8a] Received event network-vif-deleted-22c0a013-145e-46f8-ab59-f883d51567e6 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:46:38 user nova-compute[75229]: DEBUG nova.network.neutron [req-3a9e3d3c-648f-4167-a104-168cc1931b80 req-82ebfb28-700d-4972-be52-691ba7a8b053 service nova] [instance: af5fd5af-63a6-4eee-a4ef-6088a3713214] Updated VIF entry in instance network info cache for port a1999f33-4f1d-47b0-a91a-48bce4600e9b. {{(pid=75229) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 09:46:38 user nova-compute[75229]: DEBUG nova.network.neutron [req-3a9e3d3c-648f-4167-a104-168cc1931b80 req-82ebfb28-700d-4972-be52-691ba7a8b053 service nova] [instance: af5fd5af-63a6-4eee-a4ef-6088a3713214] Updating instance_info_cache with network_info: [{"id": "a1999f33-4f1d-47b0-a91a-48bce4600e9b", "address": "fa:16:3e:d9:f9:d0", "network": {"id": "a4d3d0e0-1dec-40de-a03f-4241b910cf16", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-380540777-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a9197db757f4a1cafd571eef8d47b15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1999f33-4f", "ovs_interfaceid": "a1999f33-4f1d-47b0-a91a-48bce4600e9b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2f37eb91-97ea-477b-b6c1-933b50ccfca6", "address": "fa:16:3e:1b:33:6b", "network": {"id": "4176f9ca-0910-416d-99e3-a8156bd87229", "bridge": "br-int", "label": "tempest-device-tagging-net1-45180450", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.34", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6a9197db757f4a1cafd571eef8d47b15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f37eb91-97", "ovs_interfaceid": "2f37eb91-97ea-477b-b6c1-933b50ccfca6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f8dc5389-6e53-421a-9a3a-6c90a89a6eb2", "address": "fa:16:3e:69:0d:d2", "network": {"id": "4176f9ca-0910-416d-99e3-a8156bd87229", "bridge": "br-int", "label": "tempest-device-tagging-net1-45180450", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.210", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6a9197db757f4a1cafd571eef8d47b15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8dc5389-6e", "ovs_interfaceid": "f8dc5389-6e53-421a-9a3a-6c90a89a6eb2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0979136b-2418-4434-9466-75d116e8c780", "address": "fa:16:3e:4d:a2:e0", "network": {"id": "4176f9ca-0910-416d-99e3-a8156bd87229", "bridge": "br-int", "label": "tempest-device-tagging-net1-45180450", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.156", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6a9197db757f4a1cafd571eef8d47b15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0979136b-24", "ovs_interfaceid": "0979136b-2418-4434-9466-75d116e8c780", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1f37d277-e3ac-48ca-b618-27b872f41824", "address": "fa:16:3e:c0:9e:a0", "network": {"id": "4176f9ca-0910-416d-99e3-a8156bd87229", "bridge": "br-int", "label": "tempest-device-tagging-net1-45180450", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.24", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6a9197db757f4a1cafd571eef8d47b15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f37d277-e3", "ovs_interfaceid": "1f37d277-e3ac-48ca-b618-27b872f41824", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "768a662a-4bcd-4844-a9ed-f8b8f6b8aa0d", "address": "fa:16:3e:10:aa:95", "network": {"id": "0f777eef-d2ac-43b9-bbef-4f075e98903f", "bridge": "br-int", "label": "tempest-device-tagging-net2-1010361890", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "6a9197db757f4a1cafd571eef8d47b15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap768a662a-4b", "ovs_interfaceid": "768a662a-4bcd-4844-a9ed-f8b8f6b8aa0d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b7fff2b1-9f14-4632-83e2-3f0a8e4c788b", "address": "fa:16:3e:68:f2:55", "network": {"id": "0f777eef-d2ac-43b9-bbef-4f075e98903f", "bridge": "br-int", "label": "tempest-device-tagging-net2-1010361890", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "6a9197db757f4a1cafd571eef8d47b15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7fff2b1-9f", "ovs_interfaceid": "b7fff2b1-9f14-4632-83e2-3f0a8e4c788b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 09:46:38 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-3a9e3d3c-648f-4167-a104-168cc1931b80 req-82ebfb28-700d-4972-be52-691ba7a8b053 service nova] Releasing lock "refresh_cache-af5fd5af-63a6-4eee-a4ef-6088a3713214" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 09:46:40 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-94b99e34-7e1e-4194-ac1b-f55d4c3c730d tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] Acquiring lock "af5fd5af-63a6-4eee-a4ef-6088a3713214" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:46:40 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-94b99e34-7e1e-4194-ac1b-f55d4c3c730d tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] Lock "af5fd5af-63a6-4eee-a4ef-6088a3713214" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:46:40 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-94b99e34-7e1e-4194-ac1b-f55d4c3c730d tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] Acquiring lock "af5fd5af-63a6-4eee-a4ef-6088a3713214-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:46:40 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-94b99e34-7e1e-4194-ac1b-f55d4c3c730d tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] Lock "af5fd5af-63a6-4eee-a4ef-6088a3713214-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:46:40 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-94b99e34-7e1e-4194-ac1b-f55d4c3c730d tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] Lock "af5fd5af-63a6-4eee-a4ef-6088a3713214-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:46:40 user nova-compute[75229]: INFO nova.compute.manager [None req-94b99e34-7e1e-4194-ac1b-f55d4c3c730d tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] [instance: af5fd5af-63a6-4eee-a4ef-6088a3713214] Terminating instance
Nov 14 09:46:40 user nova-compute[75229]: DEBUG nova.compute.manager [None req-94b99e34-7e1e-4194-ac1b-f55d4c3c730d tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] [instance: af5fd5af-63a6-4eee-a4ef-6088a3713214] Start destroying the instance on the hypervisor. {{(pid=75229) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 09:46:40 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:46:40 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:46:40 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:46:41 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:46:41 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:46:41 user nova-compute[75229]: DEBUG nova.compute.manager [req-8b688fe0-16b3-491c-8720-d79bdb2bdc91 req-11c4a29a-920c-4ad5-986f-879fad00e458 service nova] [instance: af5fd5af-63a6-4eee-a4ef-6088a3713214] Received event network-vif-unplugged-a1999f33-4f1d-47b0-a91a-48bce4600e9b {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:46:41 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-8b688fe0-16b3-491c-8720-d79bdb2bdc91 req-11c4a29a-920c-4ad5-986f-879fad00e458 service nova] Acquiring lock "af5fd5af-63a6-4eee-a4ef-6088a3713214-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:46:41 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-8b688fe0-16b3-491c-8720-d79bdb2bdc91 req-11c4a29a-920c-4ad5-986f-879fad00e458 service nova] Lock "af5fd5af-63a6-4eee-a4ef-6088a3713214-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:46:41 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-8b688fe0-16b3-491c-8720-d79bdb2bdc91 req-11c4a29a-920c-4ad5-986f-879fad00e458 service nova] Lock "af5fd5af-63a6-4eee-a4ef-6088a3713214-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:46:41 user nova-compute[75229]: DEBUG nova.compute.manager [req-8b688fe0-16b3-491c-8720-d79bdb2bdc91 req-11c4a29a-920c-4ad5-986f-879fad00e458 service nova] [instance: af5fd5af-63a6-4eee-a4ef-6088a3713214] No waiting events found dispatching network-vif-unplugged-a1999f33-4f1d-47b0-a91a-48bce4600e9b {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 09:46:41 user nova-compute[75229]: DEBUG nova.compute.manager [req-8b688fe0-16b3-491c-8720-d79bdb2bdc91 req-11c4a29a-920c-4ad5-986f-879fad00e458 service nova] [instance: af5fd5af-63a6-4eee-a4ef-6088a3713214] Received event network-vif-unplugged-a1999f33-4f1d-47b0-a91a-48bce4600e9b for instance with task_state deleting. {{(pid=75229) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 09:46:41 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:46:41 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:46:41 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:46:41 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:46:41 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:46:41 user nova-compute[75229]: DEBUG nova.compute.manager [req-1ddf6342-cc12-49ce-a09e-9ec0c8e044b0 req-f4ac70e8-8860-4ff4-81c1-d6064bb2630a service nova] [instance: af5fd5af-63a6-4eee-a4ef-6088a3713214] Received event network-vif-unplugged-2f37eb91-97ea-477b-b6c1-933b50ccfca6 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:46:41 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-1ddf6342-cc12-49ce-a09e-9ec0c8e044b0 req-f4ac70e8-8860-4ff4-81c1-d6064bb2630a service nova] Acquiring lock "af5fd5af-63a6-4eee-a4ef-6088a3713214-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:46:41 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-1ddf6342-cc12-49ce-a09e-9ec0c8e044b0 req-f4ac70e8-8860-4ff4-81c1-d6064bb2630a service nova] Lock "af5fd5af-63a6-4eee-a4ef-6088a3713214-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:46:41 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-1ddf6342-cc12-49ce-a09e-9ec0c8e044b0 req-f4ac70e8-8860-4ff4-81c1-d6064bb2630a service nova] Lock "af5fd5af-63a6-4eee-a4ef-6088a3713214-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:46:41 user nova-compute[75229]: DEBUG nova.compute.manager [req-1ddf6342-cc12-49ce-a09e-9ec0c8e044b0 req-f4ac70e8-8860-4ff4-81c1-d6064bb2630a service nova] [instance: af5fd5af-63a6-4eee-a4ef-6088a3713214] No waiting events found dispatching network-vif-unplugged-2f37eb91-97ea-477b-b6c1-933b50ccfca6 {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 09:46:41 user nova-compute[75229]: DEBUG nova.compute.manager [req-1ddf6342-cc12-49ce-a09e-9ec0c8e044b0 req-f4ac70e8-8860-4ff4-81c1-d6064bb2630a service nova] [instance: af5fd5af-63a6-4eee-a4ef-6088a3713214] Received event network-vif-unplugged-2f37eb91-97ea-477b-b6c1-933b50ccfca6 for instance with task_state deleting. {{(pid=75229) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 09:46:41 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:46:41 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:46:41 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:46:41 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:46:41 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:46:41 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:46:41 user nova-compute[75229]: DEBUG nova.compute.manager [req-14e225da-8b9b-4d0d-85b3-4d693d28e346 req-caef3a60-f4d6-4063-b749-b62fd3da82ac service nova] [instance: af5fd5af-63a6-4eee-a4ef-6088a3713214] Received event network-vif-unplugged-1f37d277-e3ac-48ca-b618-27b872f41824 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:46:41 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-14e225da-8b9b-4d0d-85b3-4d693d28e346 req-caef3a60-f4d6-4063-b749-b62fd3da82ac service nova] Acquiring lock "af5fd5af-63a6-4eee-a4ef-6088a3713214-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:46:41 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-14e225da-8b9b-4d0d-85b3-4d693d28e346 req-caef3a60-f4d6-4063-b749-b62fd3da82ac service nova] Lock "af5fd5af-63a6-4eee-a4ef-6088a3713214-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:46:41 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-14e225da-8b9b-4d0d-85b3-4d693d28e346 req-caef3a60-f4d6-4063-b749-b62fd3da82ac service nova] Lock "af5fd5af-63a6-4eee-a4ef-6088a3713214-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:46:41 user nova-compute[75229]: DEBUG nova.compute.manager [req-14e225da-8b9b-4d0d-85b3-4d693d28e346 req-caef3a60-f4d6-4063-b749-b62fd3da82ac service nova] [instance: af5fd5af-63a6-4eee-a4ef-6088a3713214] No waiting events found dispatching network-vif-unplugged-1f37d277-e3ac-48ca-b618-27b872f41824 {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 09:46:41 user nova-compute[75229]: DEBUG nova.compute.manager [req-14e225da-8b9b-4d0d-85b3-4d693d28e346 req-caef3a60-f4d6-4063-b749-b62fd3da82ac service nova] [instance: af5fd5af-63a6-4eee-a4ef-6088a3713214] Received event network-vif-unplugged-1f37d277-e3ac-48ca-b618-27b872f41824 for instance with task_state deleting. {{(pid=75229) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 09:46:41 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:46:41 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:46:41 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:46:41 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:46:41 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:46:42 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:46:42 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:46:42 user nova-compute[75229]: INFO nova.virt.libvirt.driver [-] [instance: af5fd5af-63a6-4eee-a4ef-6088a3713214] Instance destroyed successfully.
Nov 14 09:46:42 user nova-compute[75229]: DEBUG nova.objects.instance [None req-94b99e34-7e1e-4194-ac1b-f55d4c3c730d tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] Lazy-loading 'resources' on Instance uuid af5fd5af-63a6-4eee-a4ef-6088a3713214 {{(pid=75229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 09:46:42 user nova-compute[75229]: DEBUG nova.virt.libvirt.vif [None req-94b99e34-7e1e-4194-ac1b-f55d4c3c730d tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T09:44:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-552825535',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-552825535',id=12,image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMcZzdcOYH5cGR1627n6lcQmf726zLltPq4eG5lA89YeaaRpoKefjSoTcpxyVE/DVVi6OLlkF5TWRyNz2Wsn2gQ3fyLDODqgBhgcWeknmoj7yj+as0ZGoZ7gmrjVqaQkQw==',key_name='tempest-keypair-1600873511',keypairs=<?>,launch_index=0,launched_at=2023-11-14T09:45:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6a9197db757f4a1cafd571eef8d47b15',ramdisk_id='',reservation_id='r-k72il8ne',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-818020951',owner_user_name='tempest-TaggedBootDevicesTest-818020951-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T09:45:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b040ec7bb6eb42ee9d25a5333297bfee',uuid=af5fd5af-63a6-4eee-a4ef-6088a3713214,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a1999f33-4f1d-47b0-a91a-48bce4600e9b", "address": "fa:16:3e:d9:f9:d0", "network": {"id": "a4d3d0e0-1dec-40de-a03f-4241b910cf16", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-380540777-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a9197db757f4a1cafd571eef8d47b15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1999f33-4f", "ovs_interfaceid": "a1999f33-4f1d-47b0-a91a-48bce4600e9b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 09:46:42 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-94b99e34-7e1e-4194-ac1b-f55d4c3c730d tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] Converting VIF {"id": "a1999f33-4f1d-47b0-a91a-48bce4600e9b", "address": "fa:16:3e:d9:f9:d0", "network": {"id": "a4d3d0e0-1dec-40de-a03f-4241b910cf16", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-380540777-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a9197db757f4a1cafd571eef8d47b15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1999f33-4f", "ovs_interfaceid": "a1999f33-4f1d-47b0-a91a-48bce4600e9b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 09:46:42 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-94b99e34-7e1e-4194-ac1b-f55d4c3c730d tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d9:f9:d0,bridge_name='br-int',has_traffic_filtering=True,id=a1999f33-4f1d-47b0-a91a-48bce4600e9b,network=Network(a4d3d0e0-1dec-40de-a03f-4241b910cf16),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa1999f33-4f') {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 09:46:42 user nova-compute[75229]: DEBUG os_vif [None req-94b99e34-7e1e-4194-ac1b-f55d4c3c730d tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d9:f9:d0,bridge_name='br-int',has_traffic_filtering=True,id=a1999f33-4f1d-47b0-a91a-48bce4600e9b,network=Network(a4d3d0e0-1dec-40de-a03f-4241b910cf16),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa1999f33-4f') {{(pid=75229) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 09:46:42 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:46:42 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa1999f33-4f, bridge=br-int, if_exists=True) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:46:42 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 09:46:42 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:46:42 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:46:42 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ece33c38-8f93-43aa-a66b-8fcded9a2da4) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:46:42 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 09:46:42 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:46:42 user nova-compute[75229]: INFO os_vif [None req-94b99e34-7e1e-4194-ac1b-f55d4c3c730d tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d9:f9:d0,bridge_name='br-int',has_traffic_filtering=True,id=a1999f33-4f1d-47b0-a91a-48bce4600e9b,network=Network(a4d3d0e0-1dec-40de-a03f-4241b910cf16),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa1999f33-4f')
Nov 14 09:46:42 user nova-compute[75229]: DEBUG nova.virt.libvirt.vif [None req-94b99e34-7e1e-4194-ac1b-f55d4c3c730d tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T09:44:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-552825535',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-552825535',id=12,image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMcZzdcOYH5cGR1627n6lcQmf726zLltPq4eG5lA89YeaaRpoKefjSoTcpxyVE/DVVi6OLlkF5TWRyNz2Wsn2gQ3fyLDODqgBhgcWeknmoj7yj+as0ZGoZ7gmrjVqaQkQw==',key_name='tempest-keypair-1600873511',keypairs=<?>,launch_index=0,launched_at=2023-11-14T09:45:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6a9197db757f4a1cafd571eef8d47b15',ramdisk_id='',reservation_id='r-k72il8ne',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-818020951',owner_user_name='tempest-TaggedBootDevicesTest-818020951-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T09:45:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b040ec7bb6eb42ee9d25a5333297bfee',uuid=af5fd5af-63a6-4eee-a4ef-6088a3713214,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2f37eb91-97ea-477b-b6c1-933b50ccfca6", "address": "fa:16:3e:1b:33:6b", "network": {"id": "4176f9ca-0910-416d-99e3-a8156bd87229", "bridge": "br-int", "label": "tempest-device-tagging-net1-45180450", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.34", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6a9197db757f4a1cafd571eef8d47b15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f37eb91-97", "ovs_interfaceid": "2f37eb91-97ea-477b-b6c1-933b50ccfca6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75229) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 09:46:42 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-94b99e34-7e1e-4194-ac1b-f55d4c3c730d tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] Converting VIF {"id": "2f37eb91-97ea-477b-b6c1-933b50ccfca6", "address": "fa:16:3e:1b:33:6b", "network": {"id": "4176f9ca-0910-416d-99e3-a8156bd87229", "bridge": "br-int", "label": "tempest-device-tagging-net1-45180450", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.34", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6a9197db757f4a1cafd571eef8d47b15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f37eb91-97", "ovs_interfaceid": "2f37eb91-97ea-477b-b6c1-933b50ccfca6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 09:46:42 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-94b99e34-7e1e-4194-ac1b-f55d4c3c730d tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1b:33:6b,bridge_name='br-int',has_traffic_filtering=True,id=2f37eb91-97ea-477b-b6c1-933b50ccfca6,network=Network(4176f9ca-0910-416d-99e3-a8156bd87229),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap2f37eb91-97') {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 09:46:42 user nova-compute[75229]: DEBUG os_vif [None req-94b99e34-7e1e-4194-ac1b-f55d4c3c730d tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1b:33:6b,bridge_name='br-int',has_traffic_filtering=True,id=2f37eb91-97ea-477b-b6c1-933b50ccfca6,network=Network(4176f9ca-0910-416d-99e3-a8156bd87229),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap2f37eb91-97') {{(pid=75229) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 09:46:42 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:46:42 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2f37eb91-97, bridge=br-int, if_exists=True) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:46:42 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:46:42 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 09:46:42 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:46:42 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:46:42 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d285989f-d07e-4a33-87da-12b2265aed2a) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:46:42 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:46:42 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 09:46:42 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:46:42 user nova-compute[75229]: INFO os_vif [None req-94b99e34-7e1e-4194-ac1b-f55d4c3c730d tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1b:33:6b,bridge_name='br-int',has_traffic_filtering=True,id=2f37eb91-97ea-477b-b6c1-933b50ccfca6,network=Network(4176f9ca-0910-416d-99e3-a8156bd87229),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap2f37eb91-97')
Nov 14 09:46:42 user nova-compute[75229]: DEBUG nova.virt.libvirt.vif [None req-94b99e34-7e1e-4194-ac1b-f55d4c3c730d tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T09:44:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-552825535',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-552825535',id=12,image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMcZzdcOYH5cGR1627n6lcQmf726zLltPq4eG5lA89YeaaRpoKefjSoTcpxyVE/DVVi6OLlkF5TWRyNz2Wsn2gQ3fyLDODqgBhgcWeknmoj7yj+as0ZGoZ7gmrjVqaQkQw==',key_name='tempest-keypair-1600873511',keypairs=<?>,launch_index=0,launched_at=2023-11-14T09:45:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6a9197db757f4a1cafd571eef8d47b15',ramdisk_id='',reservation_id='r-k72il8ne',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-818020951',owner_user_name='tempest-TaggedBootDevicesTest-818020951-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T09:45:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b040ec7bb6eb42ee9d25a5333297bfee',uuid=af5fd5af-63a6-4eee-a4ef-6088a3713214,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f8dc5389-6e53-421a-9a3a-6c90a89a6eb2", "address": "fa:16:3e:69:0d:d2", "network": {"id": "4176f9ca-0910-416d-99e3-a8156bd87229", "bridge": "br-int", "label": "tempest-device-tagging-net1-45180450", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.210", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6a9197db757f4a1cafd571eef8d47b15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8dc5389-6e", "ovs_interfaceid": "f8dc5389-6e53-421a-9a3a-6c90a89a6eb2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75229) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 09:46:42 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-94b99e34-7e1e-4194-ac1b-f55d4c3c730d tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] Converting VIF {"id": "f8dc5389-6e53-421a-9a3a-6c90a89a6eb2", "address": "fa:16:3e:69:0d:d2", "network": {"id": "4176f9ca-0910-416d-99e3-a8156bd87229", "bridge": "br-int", "label": "tempest-device-tagging-net1-45180450", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.210", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6a9197db757f4a1cafd571eef8d47b15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8dc5389-6e", "ovs_interfaceid": "f8dc5389-6e53-421a-9a3a-6c90a89a6eb2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 09:46:42 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-94b99e34-7e1e-4194-ac1b-f55d4c3c730d tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:69:0d:d2,bridge_name='br-int',has_traffic_filtering=True,id=f8dc5389-6e53-421a-9a3a-6c90a89a6eb2,network=Network(4176f9ca-0910-416d-99e3-a8156bd87229),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf8dc5389-6e') {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 09:46:42 user nova-compute[75229]: DEBUG os_vif [None req-94b99e34-7e1e-4194-ac1b-f55d4c3c730d tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:69:0d:d2,bridge_name='br-int',has_traffic_filtering=True,id=f8dc5389-6e53-421a-9a3a-6c90a89a6eb2,network=Network(4176f9ca-0910-416d-99e3-a8156bd87229),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf8dc5389-6e') {{(pid=75229) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 09:46:42 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:46:42 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf8dc5389-6e, bridge=br-int, if_exists=True) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:46:42 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:46:42 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 09:46:42 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:46:42 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:46:42 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8bdbb8eb-8ad1-4ec4-aa65-ccc301c1c5b1) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:46:42 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 09:46:42 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:46:42 user nova-compute[75229]: INFO os_vif [None req-94b99e34-7e1e-4194-ac1b-f55d4c3c730d tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:69:0d:d2,bridge_name='br-int',has_traffic_filtering=True,id=f8dc5389-6e53-421a-9a3a-6c90a89a6eb2,network=Network(4176f9ca-0910-416d-99e3-a8156bd87229),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf8dc5389-6e')
Nov 14 09:46:42 user nova-compute[75229]: DEBUG nova.virt.libvirt.vif [None req-94b99e34-7e1e-4194-ac1b-f55d4c3c730d tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T09:44:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-552825535',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-552825535',id=12,image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMcZzdcOYH5cGR1627n6lcQmf726zLltPq4eG5lA89YeaaRpoKefjSoTcpxyVE/DVVi6OLlkF5TWRyNz2Wsn2gQ3fyLDODqgBhgcWeknmoj7yj+as0ZGoZ7gmrjVqaQkQw==',key_name='tempest-keypair-1600873511',keypairs=<?>,launch_index=0,launched_at=2023-11-14T09:45:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6a9197db757f4a1cafd571eef8d47b15',ramdisk_id='',reservation_id='r-k72il8ne',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-818020951',owner_user_name='tempest-TaggedBootDevicesTest-818020951-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T09:45:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b040ec7bb6eb42ee9d25a5333297bfee',uuid=af5fd5af-63a6-4eee-a4ef-6088a3713214,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0979136b-2418-4434-9466-75d116e8c780", "address": "fa:16:3e:4d:a2:e0", "network": {"id": "4176f9ca-0910-416d-99e3-a8156bd87229", "bridge": "br-int", "label": "tempest-device-tagging-net1-45180450", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.156", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6a9197db757f4a1cafd571eef8d47b15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0979136b-24", "ovs_interfaceid": "0979136b-2418-4434-9466-75d116e8c780", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 09:46:42 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-94b99e34-7e1e-4194-ac1b-f55d4c3c730d tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] Converting VIF {"id": "0979136b-2418-4434-9466-75d116e8c780", "address": "fa:16:3e:4d:a2:e0", "network": {"id": "4176f9ca-0910-416d-99e3-a8156bd87229", "bridge": "br-int", "label": "tempest-device-tagging-net1-45180450", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.156", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6a9197db757f4a1cafd571eef8d47b15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0979136b-24", "ovs_interfaceid": "0979136b-2418-4434-9466-75d116e8c780", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 09:46:42 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-94b99e34-7e1e-4194-ac1b-f55d4c3c730d tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4d:a2:e0,bridge_name='br-int',has_traffic_filtering=True,id=0979136b-2418-4434-9466-75d116e8c780,network=Network(4176f9ca-0910-416d-99e3-a8156bd87229),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0979136b-24') {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 09:46:42 user nova-compute[75229]: DEBUG os_vif [None req-94b99e34-7e1e-4194-ac1b-f55d4c3c730d tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4d:a2:e0,bridge_name='br-int',has_traffic_filtering=True,id=0979136b-2418-4434-9466-75d116e8c780,network=Network(4176f9ca-0910-416d-99e3-a8156bd87229),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0979136b-24') {{(pid=75229) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 09:46:42 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:46:42 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0979136b-24, bridge=br-int, if_exists=True) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:46:42 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 09:46:43 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:46:43 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:46:43 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=13abf746-d2f5-47f4-98dd-ede214f9e2f3) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:46:43 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:46:43 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 09:46:43 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:46:43 user nova-compute[75229]: INFO os_vif [None req-94b99e34-7e1e-4194-ac1b-f55d4c3c730d tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4d:a2:e0,bridge_name='br-int',has_traffic_filtering=True,id=0979136b-2418-4434-9466-75d116e8c780,network=Network(4176f9ca-0910-416d-99e3-a8156bd87229),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0979136b-24')
Nov 14 09:46:43 user nova-compute[75229]: DEBUG nova.virt.libvirt.vif [None req-94b99e34-7e1e-4194-ac1b-f55d4c3c730d tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T09:44:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-552825535',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-552825535',id=12,image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMcZzdcOYH5cGR1627n6lcQmf726zLltPq4eG5lA89YeaaRpoKefjSoTcpxyVE/DVVi6OLlkF5TWRyNz2Wsn2gQ3fyLDODqgBhgcWeknmoj7yj+as0ZGoZ7gmrjVqaQkQw==',key_name='tempest-keypair-1600873511',keypairs=<?>,launch_index=0,launched_at=2023-11-14T09:45:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6a9197db757f4a1cafd571eef8d47b15',ramdisk_id='',reservation_id='r-k72il8ne',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-818020951',owner_user_name='tempest-TaggedBootDevicesTest-818020951-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T09:45:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b040ec7bb6eb42ee9d25a5333297bfee',uuid=af5fd5af-63a6-4eee-a4ef-6088a3713214,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1f37d277-e3ac-48ca-b618-27b872f41824", "address": "fa:16:3e:c0:9e:a0", "network": {"id": "4176f9ca-0910-416d-99e3-a8156bd87229", "bridge": "br-int", "label": "tempest-device-tagging-net1-45180450", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.24", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6a9197db757f4a1cafd571eef8d47b15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f37d277-e3", "ovs_interfaceid": "1f37d277-e3ac-48ca-b618-27b872f41824", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 09:46:43 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-94b99e34-7e1e-4194-ac1b-f55d4c3c730d tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] Converting VIF {"id": "1f37d277-e3ac-48ca-b618-27b872f41824", "address": "fa:16:3e:c0:9e:a0", "network": {"id": "4176f9ca-0910-416d-99e3-a8156bd87229", "bridge": "br-int", "label": "tempest-device-tagging-net1-45180450", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.24", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6a9197db757f4a1cafd571eef8d47b15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f37d277-e3", "ovs_interfaceid": "1f37d277-e3ac-48ca-b618-27b872f41824", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 09:46:43 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-94b99e34-7e1e-4194-ac1b-f55d4c3c730d tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c0:9e:a0,bridge_name='br-int',has_traffic_filtering=True,id=1f37d277-e3ac-48ca-b618-27b872f41824,network=Network(4176f9ca-0910-416d-99e3-a8156bd87229),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f37d277-e3') {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 09:46:43 user nova-compute[75229]: DEBUG os_vif [None req-94b99e34-7e1e-4194-ac1b-f55d4c3c730d tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c0:9e:a0,bridge_name='br-int',has_traffic_filtering=True,id=1f37d277-e3ac-48ca-b618-27b872f41824,network=Network(4176f9ca-0910-416d-99e3-a8156bd87229),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f37d277-e3') {{(pid=75229) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 09:46:43 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:46:43 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1f37d277-e3, bridge=br-int, if_exists=True) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:46:43 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:46:43 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 09:46:43 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:46:43 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:46:43 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7581c0e0-fba1-4d66-b6e1-2b607d30c438) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:46:43 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:46:43 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 09:46:43 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:46:43 user nova-compute[75229]: INFO os_vif [None req-94b99e34-7e1e-4194-ac1b-f55d4c3c730d tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c0:9e:a0,bridge_name='br-int',has_traffic_filtering=True,id=1f37d277-e3ac-48ca-b618-27b872f41824,network=Network(4176f9ca-0910-416d-99e3-a8156bd87229),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f37d277-e3')
Nov 14 09:46:43 user nova-compute[75229]: DEBUG nova.virt.libvirt.vif [None req-94b99e34-7e1e-4194-ac1b-f55d4c3c730d tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T09:44:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-552825535',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-552825535',id=12,image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMcZzdcOYH5cGR1627n6lcQmf726zLltPq4eG5lA89YeaaRpoKefjSoTcpxyVE/DVVi6OLlkF5TWRyNz2Wsn2gQ3fyLDODqgBhgcWeknmoj7yj+as0ZGoZ7gmrjVqaQkQw==',key_name='tempest-keypair-1600873511',keypairs=<?>,launch_index=0,launched_at=2023-11-14T09:45:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6a9197db757f4a1cafd571eef8d47b15',ramdisk_id='',reservation_id='r-k72il8ne',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-818020951',owner_user_name='tempest-TaggedBootDevicesTest-818020951-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T09:45:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b040ec7bb6eb42ee9d25a5333297bfee',uuid=af5fd5af-63a6-4eee-a4ef-6088a3713214,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "768a662a-4bcd-4844-a9ed-f8b8f6b8aa0d", "address": "fa:16:3e:10:aa:95", "network": {"id": "0f777eef-d2ac-43b9-bbef-4f075e98903f", "bridge": "br-int", "label": "tempest-device-tagging-net2-1010361890", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "6a9197db757f4a1cafd571eef8d47b15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap768a662a-4b", "ovs_interfaceid": "768a662a-4bcd-4844-a9ed-f8b8f6b8aa0d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 09:46:43 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-94b99e34-7e1e-4194-ac1b-f55d4c3c730d tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] Converting VIF {"id": "768a662a-4bcd-4844-a9ed-f8b8f6b8aa0d", "address": "fa:16:3e:10:aa:95", "network": {"id": "0f777eef-d2ac-43b9-bbef-4f075e98903f", "bridge": "br-int", "label": "tempest-device-tagging-net2-1010361890", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "6a9197db757f4a1cafd571eef8d47b15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap768a662a-4b", "ovs_interfaceid": "768a662a-4bcd-4844-a9ed-f8b8f6b8aa0d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 09:46:43 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-94b99e34-7e1e-4194-ac1b-f55d4c3c730d tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:10:aa:95,bridge_name='br-int',has_traffic_filtering=True,id=768a662a-4bcd-4844-a9ed-f8b8f6b8aa0d,network=Network(0f777eef-d2ac-43b9-bbef-4f075e98903f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap768a662a-4b') {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 09:46:43 user nova-compute[75229]: DEBUG os_vif [None req-94b99e34-7e1e-4194-ac1b-f55d4c3c730d tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:10:aa:95,bridge_name='br-int',has_traffic_filtering=True,id=768a662a-4bcd-4844-a9ed-f8b8f6b8aa0d,network=Network(0f777eef-d2ac-43b9-bbef-4f075e98903f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap768a662a-4b') {{(pid=75229) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 09:46:43 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:46:43 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap768a662a-4b, bridge=br-int, if_exists=True) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:46:43 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:46:43 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 09:46:43 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:46:43 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:46:43 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=13e57b8f-f40b-411a-aea6-bbb708b961c1) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:46:43 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:46:43 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 09:46:43 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:46:43 user nova-compute[75229]: INFO os_vif [None req-94b99e34-7e1e-4194-ac1b-f55d4c3c730d tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:10:aa:95,bridge_name='br-int',has_traffic_filtering=True,id=768a662a-4bcd-4844-a9ed-f8b8f6b8aa0d,network=Network(0f777eef-d2ac-43b9-bbef-4f075e98903f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap768a662a-4b')
Nov 14 09:46:43 user nova-compute[75229]: DEBUG nova.virt.libvirt.vif [None req-94b99e34-7e1e-4194-ac1b-f55d4c3c730d tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T09:44:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-552825535',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-552825535',id=12,image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMcZzdcOYH5cGR1627n6lcQmf726zLltPq4eG5lA89YeaaRpoKefjSoTcpxyVE/DVVi6OLlkF5TWRyNz2Wsn2gQ3fyLDODqgBhgcWeknmoj7yj+as0ZGoZ7gmrjVqaQkQw==',key_name='tempest-keypair-1600873511',keypairs=<?>,launch_index=0,launched_at=2023-11-14T09:45:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6a9197db757f4a1cafd571eef8d47b15',ramdisk_id='',reservation_id='r-k72il8ne',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-818020951',owner_user_name='tempest-TaggedBootDevicesTest-818020951-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T09:45:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b040ec7bb6eb42ee9d25a5333297bfee',uuid=af5fd5af-63a6-4eee-a4ef-6088a3713214,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b7fff2b1-9f14-4632-83e2-3f0a8e4c788b", "address": "fa:16:3e:68:f2:55", "network": {"id": "0f777eef-d2ac-43b9-bbef-4f075e98903f", "bridge": "br-int", "label": "tempest-device-tagging-net2-1010361890", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "6a9197db757f4a1cafd571eef8d47b15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7fff2b1-9f", "ovs_interfaceid": "b7fff2b1-9f14-4632-83e2-3f0a8e4c788b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 09:46:43 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-94b99e34-7e1e-4194-ac1b-f55d4c3c730d tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] Converting VIF {"id": "b7fff2b1-9f14-4632-83e2-3f0a8e4c788b", "address": "fa:16:3e:68:f2:55", "network": {"id": "0f777eef-d2ac-43b9-bbef-4f075e98903f", "bridge": "br-int", "label": "tempest-device-tagging-net2-1010361890", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "6a9197db757f4a1cafd571eef8d47b15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7fff2b1-9f", "ovs_interfaceid": "b7fff2b1-9f14-4632-83e2-3f0a8e4c788b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 09:46:43 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-94b99e34-7e1e-4194-ac1b-f55d4c3c730d tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:68:f2:55,bridge_name='br-int',has_traffic_filtering=True,id=b7fff2b1-9f14-4632-83e2-3f0a8e4c788b,network=Network(0f777eef-d2ac-43b9-bbef-4f075e98903f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7fff2b1-9f') {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 09:46:43 user nova-compute[75229]: DEBUG os_vif [None req-94b99e34-7e1e-4194-ac1b-f55d4c3c730d tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:68:f2:55,bridge_name='br-int',has_traffic_filtering=True,id=b7fff2b1-9f14-4632-83e2-3f0a8e4c788b,network=Network(0f777eef-d2ac-43b9-bbef-4f075e98903f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7fff2b1-9f') {{(pid=75229) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 09:46:43 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:46:43 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb7fff2b1-9f, bridge=br-int, if_exists=True) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:46:43 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:46:43 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 09:46:43 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:46:43 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=df7aacb5-8b47-4664-a4a3-bd80c7d6c78c) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:46:43 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:46:43 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:46:43 user nova-compute[75229]: DEBUG nova.compute.manager [req-b4ff9695-f9b3-41e9-bba5-937dd5288156 req-25af0cc4-aa76-4e43-9dcf-0b7420f55b9c service nova] [instance: af5fd5af-63a6-4eee-a4ef-6088a3713214] Received event network-vif-plugged-a1999f33-4f1d-47b0-a91a-48bce4600e9b {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:46:43 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-b4ff9695-f9b3-41e9-bba5-937dd5288156 req-25af0cc4-aa76-4e43-9dcf-0b7420f55b9c service nova] Acquiring lock "af5fd5af-63a6-4eee-a4ef-6088a3713214-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:46:43 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-b4ff9695-f9b3-41e9-bba5-937dd5288156 req-25af0cc4-aa76-4e43-9dcf-0b7420f55b9c service nova] Lock "af5fd5af-63a6-4eee-a4ef-6088a3713214-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:46:43 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-b4ff9695-f9b3-41e9-bba5-937dd5288156 req-25af0cc4-aa76-4e43-9dcf-0b7420f55b9c service nova] Lock "af5fd5af-63a6-4eee-a4ef-6088a3713214-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:46:43 user nova-compute[75229]: DEBUG nova.compute.manager [req-b4ff9695-f9b3-41e9-bba5-937dd5288156 req-25af0cc4-aa76-4e43-9dcf-0b7420f55b9c service nova] [instance: af5fd5af-63a6-4eee-a4ef-6088a3713214] No waiting events found dispatching network-vif-plugged-a1999f33-4f1d-47b0-a91a-48bce4600e9b {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 09:46:43 user nova-compute[75229]: WARNING nova.compute.manager [req-b4ff9695-f9b3-41e9-bba5-937dd5288156 req-25af0cc4-aa76-4e43-9dcf-0b7420f55b9c service nova] [instance: af5fd5af-63a6-4eee-a4ef-6088a3713214] Received unexpected event network-vif-plugged-a1999f33-4f1d-47b0-a91a-48bce4600e9b for instance with vm_state active and task_state deleting.
Nov 14 09:46:43 user nova-compute[75229]: INFO os_vif [None req-94b99e34-7e1e-4194-ac1b-f55d4c3c730d tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:68:f2:55,bridge_name='br-int',has_traffic_filtering=True,id=b7fff2b1-9f14-4632-83e2-3f0a8e4c788b,network=Network(0f777eef-d2ac-43b9-bbef-4f075e98903f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7fff2b1-9f')
Nov 14 09:46:43 user nova-compute[75229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-94b99e34-7e1e-4194-ac1b-f55d4c3c730d tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] [instance: af5fd5af-63a6-4eee-a4ef-6088a3713214] calling os-brick to detach iSCSI Volume {{(pid=75229) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 09:46:43 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-94b99e34-7e1e-4194-ac1b-f55d4c3c730d tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f73f85151b0>, {'target_iqn': 'iqn.2010-10.org.openstack:18a1e95e-5df1-4db1-92bc-6cd67729c7a7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'quUPbjLv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 09:46:43 user nova-compute[75229]: WARNING os_brick.initiator.connectors.base [None req-94b99e34-7e1e-4194-ac1b-f55d4c3c730d tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 09:46:43 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-94b99e34-7e1e-4194-ac1b-f55d4c3c730d tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 09:46:43 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-94b99e34-7e1e-4194-ac1b-f55d4c3c730d tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 09:46:43 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:46:43 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:46:43 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff1f8d2a-43ec-4453-903d-6601087d2a83]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c2324d4e-6e60-47fd-b536-144a7ea32dce\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:97f588de-32d5-4d48-9c06-5925263ba117\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:18a1e95e-5df1-4db1-92bc-6cd67729c7a7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c7022511-a003-46d5-bcc1-064be770a829\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e2472759-033a-4051-9dec-4516d0aef07d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7144f229-1f5e-4155-aba1-ab44218df41a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:46:43 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-94b99e34-7e1e-4194-ac1b-f55d4c3c730d tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 09:46:43 user nova-compute[75229]: No targets found.
Nov 14 09:46:43 user nova-compute[75229]: iSNS:
Nov 14 09:46:43 user nova-compute[75229]: No targets found.
Nov 14 09:46:43 user nova-compute[75229]: STATIC:
Nov 14 09:46:43 user nova-compute[75229]: Target: iqn.2010-10.org.openstack:c2324d4e-6e60-47fd-b536-144a7ea32dce
Nov 14 09:46:43 user nova-compute[75229]:         Portal: 172.16.0.220:3260,-1
Nov 14 09:46:43 user nova-compute[75229]:                 Iface Name: default
Nov 14 09:46:43 user nova-compute[75229]: Target: iqn.2010-10.org.openstack:97f588de-32d5-4d48-9c06-5925263ba117
Nov 14 09:46:43 user nova-compute[75229]:         Portal: 172.16.0.220:3260,-1
Nov 14 09:46:43 user nova-compute[75229]:                 Iface Name: default
Nov 14 09:46:43 user nova-compute[75229]: Target: iqn.2010-10.org.openstack:18a1e95e-5df1-4db1-92bc-6cd67729c7a7
Nov 14 09:46:43 user nova-compute[75229]:         Portal: 172.16.0.220:3260,-1
Nov 14 09:46:43 user nova-compute[75229]:                 Iface Name: default
Nov 14 09:46:43 user nova-compute[75229]: Target: iqn.2010-10.org.openstack:c7022511-a003-46d5-bcc1-064be770a829
Nov 14 09:46:43 user nova-compute[75229]:         Portal: 172.16.0.220:3260,-1
Nov 14 09:46:43 user nova-compute[75229]:                 Iface Name: default
Nov 14 09:46:43 user nova-compute[75229]: Target: iqn.2010-10.org.openstack:e2472759-033a-4051-9dec-4516d0aef07d
Nov 14 09:46:43 user nova-compute[75229]:         Portal: 172.16.0.220:3260,-1
Nov 14 09:46:43 user nova-compute[75229]:                 Iface Name: default
Nov 14 09:46:43 user nova-compute[75229]: Target: iqn.2010-10.org.openstack:7144f229-1f5e-4155-aba1-ab44218df41a
Nov 14 09:46:43 user nova-compute[75229]:         Portal: 172.16.0.220:3260,-1
Nov 14 09:46:43 user nova-compute[75229]:                 Iface Name: default
Nov 14 09:46:43 user nova-compute[75229]: FIRMWARE:
Nov 14 09:46:43 user nova-compute[75229]: No targets found.
Nov 14 09:46:43 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 09:46:43 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-94b99e34-7e1e-4194-ac1b-f55d4c3c730d tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 09:46:43 user nova-compute[75229]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 09:46:43 user nova-compute[75229]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75229) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 09:46:43 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-94b99e34-7e1e-4194-ac1b-f55d4c3c730d tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:18a1e95e-5df1-4db1-92bc-6cd67729c7a7', 0)] {{(pid=75229) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 09:46:43 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:46:43 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:46:43 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[d79d99f6-4dc6-48e5-b359-c778d47aa0e6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:18a1e95e-5df1-4db1-92bc-6cd67729c7a7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7144f229-1f5e-4155-aba1-ab44218df41a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:97f588de-32d5-4d48-9c06-5925263ba117\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c2324d4e-6e60-47fd-b536-144a7ea32dce\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c7022511-a003-46d5-bcc1-064be770a829\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e2472759-033a-4051-9dec-4516d0aef07d\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:46:43 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:46:43 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:46:43 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[72670546-3213-4f80-8e79-f5ad81895ccb]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2472759-033a-4051-9dec-4516d0aef07d (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7022511-a003-46d5-bcc1-064be770a829 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2324d4e-6e60-47fd-b536-144a7ea32dce (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18a1e95e-5df1-4db1-92bc-6cd67729c7a7 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97f588de-32d5-4d48-9c06-5925263ba117 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7144f229-1f5e-4155-aba1-ab44218df41a (non-flash)\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:46:43 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-94b99e34-7e1e-4194-ac1b-f55d4c3c730d tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2472759-033a-4051-9dec-4516d0aef07d (non-flash)
Nov 14 09:46:43 user nova-compute[75229]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7022511-a003-46d5-bcc1-064be770a829 (non-flash)
Nov 14 09:46:43 user nova-compute[75229]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2324d4e-6e60-47fd-b536-144a7ea32dce (non-flash)
Nov 14 09:46:43 user nova-compute[75229]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18a1e95e-5df1-4db1-92bc-6cd67729c7a7 (non-flash)
Nov 14 09:46:43 user nova-compute[75229]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97f588de-32d5-4d48-9c06-5925263ba117 (non-flash)
Nov 14 09:46:43 user nova-compute[75229]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7144f229-1f5e-4155-aba1-ab44218df41a (non-flash)
Nov 14 09:46:43 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 09:46:43 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-94b99e34-7e1e-4194-ac1b-f55d4c3c730d tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2472759-033a-4051-9dec-4516d0aef07d (non-flash)
Nov 14 09:46:43 user nova-compute[75229]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7022511-a003-46d5-bcc1-064be770a829 (non-flash)
Nov 14 09:46:43 user nova-compute[75229]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2324d4e-6e60-47fd-b536-144a7ea32dce (non-flash)
Nov 14 09:46:43 user nova-compute[75229]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18a1e95e-5df1-4db1-92bc-6cd67729c7a7 (non-flash)
Nov 14 09:46:43 user nova-compute[75229]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97f588de-32d5-4d48-9c06-5925263ba117 (non-flash)
Nov 14 09:46:43 user nova-compute[75229]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7144f229-1f5e-4155-aba1-ab44218df41a (non-flash)
Nov 14 09:46:43 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 09:46:43 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-94b99e34-7e1e-4194-ac1b-f55d4c3c730d tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f73d4f5dd80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:18a1e95e-5df1-4db1-92bc-6cd67729c7a7'): ({'sdc'}, set())}) {{(pid=75229) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 09:46:43 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-94b99e34-7e1e-4194-ac1b-f55d4c3c730d tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] Removing single pathed devices sdc {{(pid=75229) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 09:46:43 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:46:43 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:46:43 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[9af7013c-9c91-4f66-a271-bc318f724346]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:46:43 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:46:43 user nova-compute[75229]: DEBUG nova.compute.manager [None req-14541822-20a0-4fb4-a231-073f47febc6d tempest-TestVolumeSwap-1816306665 tempest-TestVolumeSwap-1816306665-project-admin] [instance: c307660b-01bb-471b-9e2e-5c2aaca65287] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:52ae1fea-5339-4958-88ae-d103080e7743', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xkXQEUcf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'c307660b-01bb-471b-9e2e-5c2aaca65287', 'attached_at': '', 'detached_at': '', 'volume_id': '52ae1fea-5339-4958-88ae-d103080e7743', 'serial': '52ae1fea-5339-4958-88ae-d103080e7743'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:e2472759-033a-4051-9dec-4516d0aef07d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JCKHSoDN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde', 'volume_id': 'e2472759-033a-4051-9dec-4516d0aef07d'}, 'status': 'reserved', 'instance': 'c307660b-01bb-471b-9e2e-5c2aaca65287', 'attached_at': '', 'detached_at': '', 'volume_id': 'e2472759-033a-4051-9dec-4516d0aef07d', 'serial'} {{(pid=75229) _swap_volume /opt/stack/nova/nova/compute/manager.py:7782}}
Nov 14 09:46:43 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:46:43 user nova-compute[75229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-14541822-20a0-4fb4-a231-073f47febc6d tempest-TestVolumeSwap-1816306665 tempest-TestVolumeSwap-1816306665-project-admin] [instance: c307660b-01bb-471b-9e2e-5c2aaca65287] Calling os-brick to attach iSCSI Volume {{(pid=75229) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 09:46:43 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-14541822-20a0-4fb4-a231-073f47febc6d tempest-TestVolumeSwap-1816306665 tempest-TestVolumeSwap-1816306665-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f73f85151b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:52ae1fea-5339-4958-88ae-d103080e7743', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xkXQEUcf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 09:46:43 user nova-compute[75229]: WARNING os_brick.initiator.connectors.base [None req-14541822-20a0-4fb4-a231-073f47febc6d tempest-TestVolumeSwap-1816306665 tempest-TestVolumeSwap-1816306665-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 09:46:43 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-14541822-20a0-4fb4-a231-073f47febc6d tempest-TestVolumeSwap-1816306665 tempest-TestVolumeSwap-1816306665-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 09:46:43 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[795bd47f-d5f7-4ff2-b087-7003a2e131ed]: (4, ('ok\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:46:43 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-94b99e34-7e1e-4194-ac1b-f55d4c3c730d tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] Flushing IO for device /dev/sdc {{(pid=75229) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 09:46:43 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:46:43 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:46:43 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[97475c25-37c2-4882-9912-8544d7db938b]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:46:43 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-94b99e34-7e1e-4194-ac1b-f55d4c3c730d tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75229) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 09:46:43 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:46:43 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.031s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:46:43 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[d30b4830-20e8-45d3-8a4c-835988a601ef]: (4, ('1', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:46:43 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-94b99e34-7e1e-4194-ac1b-f55d4c3c730d tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75229) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 09:46:43 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-94b99e34-7e1e-4194-ac1b-f55d4c3c730d tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] SCSI volumes sdc have been removed. {{(pid=75229) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 09:46:43 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-94b99e34-7e1e-4194-ac1b-f55d4c3c730d tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:18a1e95e-5df1-4db1-92bc-6cd67729c7a7')] {{(pid=75229) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 09:46:43 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:18a1e95e-5df1-4db1-92bc-6cd67729c7a7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:46:43 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:18a1e95e-5df1-4db1-92bc-6cd67729c7a7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:46:43 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdef6b7e-7d31-4a70-a4e3-f67ec831ab14]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:46:43 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-94b99e34-7e1e-4194-ac1b-f55d4c3c730d tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:46:43 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:18a1e95e-5df1-4db1-92bc-6cd67729c7a7 -p 172.16.0.220:3260 --logout {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:46:43 user nova-compute[75229]: DEBUG nova.compute.manager [req-d304633c-16bc-438d-b4f7-065ee75cb6d0 req-7b1cd792-68e3-4997-929c-6ef31048f927 service nova] [instance: af5fd5af-63a6-4eee-a4ef-6088a3713214] Received event network-vif-plugged-2f37eb91-97ea-477b-b6c1-933b50ccfca6 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:46:43 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-d304633c-16bc-438d-b4f7-065ee75cb6d0 req-7b1cd792-68e3-4997-929c-6ef31048f927 service nova] Acquiring lock "af5fd5af-63a6-4eee-a4ef-6088a3713214-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:46:43 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-d304633c-16bc-438d-b4f7-065ee75cb6d0 req-7b1cd792-68e3-4997-929c-6ef31048f927 service nova] Lock "af5fd5af-63a6-4eee-a4ef-6088a3713214-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:46:43 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-d304633c-16bc-438d-b4f7-065ee75cb6d0 req-7b1cd792-68e3-4997-929c-6ef31048f927 service nova] Lock "af5fd5af-63a6-4eee-a4ef-6088a3713214-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:46:43 user nova-compute[75229]: DEBUG nova.compute.manager [req-d304633c-16bc-438d-b4f7-065ee75cb6d0 req-7b1cd792-68e3-4997-929c-6ef31048f927 service nova] [instance: af5fd5af-63a6-4eee-a4ef-6088a3713214] No waiting events found dispatching network-vif-plugged-2f37eb91-97ea-477b-b6c1-933b50ccfca6 {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 09:46:43 user nova-compute[75229]: WARNING nova.compute.manager [req-d304633c-16bc-438d-b4f7-065ee75cb6d0 req-7b1cd792-68e3-4997-929c-6ef31048f927 service nova] [instance: af5fd5af-63a6-4eee-a4ef-6088a3713214] Received unexpected event network-vif-plugged-2f37eb91-97ea-477b-b6c1-933b50ccfca6 for instance with vm_state active and task_state deleting.
Nov 14 09:46:43 user nova-compute[75229]: DEBUG nova.compute.manager [req-d304633c-16bc-438d-b4f7-065ee75cb6d0 req-7b1cd792-68e3-4997-929c-6ef31048f927 service nova] [instance: af5fd5af-63a6-4eee-a4ef-6088a3713214] Received event network-vif-unplugged-f8dc5389-6e53-421a-9a3a-6c90a89a6eb2 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:46:43 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-d304633c-16bc-438d-b4f7-065ee75cb6d0 req-7b1cd792-68e3-4997-929c-6ef31048f927 service nova] Acquiring lock "af5fd5af-63a6-4eee-a4ef-6088a3713214-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:46:43 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-d304633c-16bc-438d-b4f7-065ee75cb6d0 req-7b1cd792-68e3-4997-929c-6ef31048f927 service nova] Lock "af5fd5af-63a6-4eee-a4ef-6088a3713214-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:46:43 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-d304633c-16bc-438d-b4f7-065ee75cb6d0 req-7b1cd792-68e3-4997-929c-6ef31048f927 service nova] Lock "af5fd5af-63a6-4eee-a4ef-6088a3713214-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:46:43 user nova-compute[75229]: DEBUG nova.compute.manager [req-d304633c-16bc-438d-b4f7-065ee75cb6d0 req-7b1cd792-68e3-4997-929c-6ef31048f927 service nova] [instance: af5fd5af-63a6-4eee-a4ef-6088a3713214] No waiting events found dispatching network-vif-unplugged-f8dc5389-6e53-421a-9a3a-6c90a89a6eb2 {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 09:46:43 user nova-compute[75229]: DEBUG nova.compute.manager [req-d304633c-16bc-438d-b4f7-065ee75cb6d0 req-7b1cd792-68e3-4997-929c-6ef31048f927 service nova] [instance: af5fd5af-63a6-4eee-a4ef-6088a3713214] Received event network-vif-unplugged-f8dc5389-6e53-421a-9a3a-6c90a89a6eb2 for instance with task_state deleting. {{(pid=75229) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 09:46:43 user nova-compute[75229]: DEBUG nova.compute.manager [req-d304633c-16bc-438d-b4f7-065ee75cb6d0 req-7b1cd792-68e3-4997-929c-6ef31048f927 service nova] [instance: af5fd5af-63a6-4eee-a4ef-6088a3713214] Received event network-vif-plugged-f8dc5389-6e53-421a-9a3a-6c90a89a6eb2 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:46:43 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-d304633c-16bc-438d-b4f7-065ee75cb6d0 req-7b1cd792-68e3-4997-929c-6ef31048f927 service nova] Acquiring lock "af5fd5af-63a6-4eee-a4ef-6088a3713214-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:46:43 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-d304633c-16bc-438d-b4f7-065ee75cb6d0 req-7b1cd792-68e3-4997-929c-6ef31048f927 service nova] Lock "af5fd5af-63a6-4eee-a4ef-6088a3713214-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:46:43 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-d304633c-16bc-438d-b4f7-065ee75cb6d0 req-7b1cd792-68e3-4997-929c-6ef31048f927 service nova] Lock "af5fd5af-63a6-4eee-a4ef-6088a3713214-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:46:43 user nova-compute[75229]: DEBUG nova.compute.manager [req-d304633c-16bc-438d-b4f7-065ee75cb6d0 req-7b1cd792-68e3-4997-929c-6ef31048f927 service nova] [instance: af5fd5af-63a6-4eee-a4ef-6088a3713214] No waiting events found dispatching network-vif-plugged-f8dc5389-6e53-421a-9a3a-6c90a89a6eb2 {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 09:46:43 user nova-compute[75229]: WARNING nova.compute.manager [req-d304633c-16bc-438d-b4f7-065ee75cb6d0 req-7b1cd792-68e3-4997-929c-6ef31048f927 service nova] [instance: af5fd5af-63a6-4eee-a4ef-6088a3713214] Received unexpected event network-vif-plugged-f8dc5389-6e53-421a-9a3a-6c90a89a6eb2 for instance with vm_state active and task_state deleting.
Nov 14 09:46:43 user nova-compute[75229]: DEBUG nova.compute.manager [req-d304633c-16bc-438d-b4f7-065ee75cb6d0 req-7b1cd792-68e3-4997-929c-6ef31048f927 service nova] [instance: af5fd5af-63a6-4eee-a4ef-6088a3713214] Received event network-vif-unplugged-0979136b-2418-4434-9466-75d116e8c780 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:46:43 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-d304633c-16bc-438d-b4f7-065ee75cb6d0 req-7b1cd792-68e3-4997-929c-6ef31048f927 service nova] Acquiring lock "af5fd5af-63a6-4eee-a4ef-6088a3713214-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:46:43 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-d304633c-16bc-438d-b4f7-065ee75cb6d0 req-7b1cd792-68e3-4997-929c-6ef31048f927 service nova] Lock "af5fd5af-63a6-4eee-a4ef-6088a3713214-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:46:43 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-d304633c-16bc-438d-b4f7-065ee75cb6d0 req-7b1cd792-68e3-4997-929c-6ef31048f927 service nova] Lock "af5fd5af-63a6-4eee-a4ef-6088a3713214-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:46:43 user nova-compute[75229]: DEBUG nova.compute.manager [req-d304633c-16bc-438d-b4f7-065ee75cb6d0 req-7b1cd792-68e3-4997-929c-6ef31048f927 service nova] [instance: af5fd5af-63a6-4eee-a4ef-6088a3713214] No waiting events found dispatching network-vif-unplugged-0979136b-2418-4434-9466-75d116e8c780 {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 09:46:43 user nova-compute[75229]: DEBUG nova.compute.manager [req-d304633c-16bc-438d-b4f7-065ee75cb6d0 req-7b1cd792-68e3-4997-929c-6ef31048f927 service nova] [instance: af5fd5af-63a6-4eee-a4ef-6088a3713214] Received event network-vif-unplugged-0979136b-2418-4434-9466-75d116e8c780 for instance with task_state deleting. {{(pid=75229) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 09:46:43 user nova-compute[75229]: DEBUG nova.compute.manager [req-d304633c-16bc-438d-b4f7-065ee75cb6d0 req-7b1cd792-68e3-4997-929c-6ef31048f927 service nova] [instance: af5fd5af-63a6-4eee-a4ef-6088a3713214] Received event network-vif-plugged-0979136b-2418-4434-9466-75d116e8c780 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:46:43 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-d304633c-16bc-438d-b4f7-065ee75cb6d0 req-7b1cd792-68e3-4997-929c-6ef31048f927 service nova] Acquiring lock "af5fd5af-63a6-4eee-a4ef-6088a3713214-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:46:43 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-d304633c-16bc-438d-b4f7-065ee75cb6d0 req-7b1cd792-68e3-4997-929c-6ef31048f927 service nova] Lock "af5fd5af-63a6-4eee-a4ef-6088a3713214-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:46:43 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-d304633c-16bc-438d-b4f7-065ee75cb6d0 req-7b1cd792-68e3-4997-929c-6ef31048f927 service nova] Lock "af5fd5af-63a6-4eee-a4ef-6088a3713214-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:46:43 user nova-compute[75229]: DEBUG nova.compute.manager [req-d304633c-16bc-438d-b4f7-065ee75cb6d0 req-7b1cd792-68e3-4997-929c-6ef31048f927 service nova] [instance: af5fd5af-63a6-4eee-a4ef-6088a3713214] No waiting events found dispatching network-vif-plugged-0979136b-2418-4434-9466-75d116e8c780 {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 09:46:43 user nova-compute[75229]: WARNING nova.compute.manager [req-d304633c-16bc-438d-b4f7-065ee75cb6d0 req-7b1cd792-68e3-4997-929c-6ef31048f927 service nova] [instance: af5fd5af-63a6-4eee-a4ef-6088a3713214] Received unexpected event network-vif-plugged-0979136b-2418-4434-9466-75d116e8c780 for instance with vm_state active and task_state deleting.
Nov 14 09:46:43 user nova-compute[75229]: DEBUG nova.compute.manager [req-d304633c-16bc-438d-b4f7-065ee75cb6d0 req-7b1cd792-68e3-4997-929c-6ef31048f927 service nova] [instance: af5fd5af-63a6-4eee-a4ef-6088a3713214] Received event network-vif-unplugged-b7fff2b1-9f14-4632-83e2-3f0a8e4c788b {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:46:43 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-d304633c-16bc-438d-b4f7-065ee75cb6d0 req-7b1cd792-68e3-4997-929c-6ef31048f927 service nova] Acquiring lock "af5fd5af-63a6-4eee-a4ef-6088a3713214-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:46:43 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-d304633c-16bc-438d-b4f7-065ee75cb6d0 req-7b1cd792-68e3-4997-929c-6ef31048f927 service nova] Lock "af5fd5af-63a6-4eee-a4ef-6088a3713214-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:46:43 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-d304633c-16bc-438d-b4f7-065ee75cb6d0 req-7b1cd792-68e3-4997-929c-6ef31048f927 service nova] Lock "af5fd5af-63a6-4eee-a4ef-6088a3713214-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:46:43 user nova-compute[75229]: DEBUG nova.compute.manager [req-d304633c-16bc-438d-b4f7-065ee75cb6d0 req-7b1cd792-68e3-4997-929c-6ef31048f927 service nova] [instance: af5fd5af-63a6-4eee-a4ef-6088a3713214] No waiting events found dispatching network-vif-unplugged-b7fff2b1-9f14-4632-83e2-3f0a8e4c788b {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 09:46:43 user nova-compute[75229]: DEBUG nova.compute.manager [req-d304633c-16bc-438d-b4f7-065ee75cb6d0 req-7b1cd792-68e3-4997-929c-6ef31048f927 service nova] [instance: af5fd5af-63a6-4eee-a4ef-6088a3713214] Received event network-vif-unplugged-b7fff2b1-9f14-4632-83e2-3f0a8e4c788b for instance with task_state deleting. {{(pid=75229) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 09:46:43 user nova-compute[75229]: DEBUG nova.compute.manager [req-d304633c-16bc-438d-b4f7-065ee75cb6d0 req-7b1cd792-68e3-4997-929c-6ef31048f927 service nova] [instance: af5fd5af-63a6-4eee-a4ef-6088a3713214] Received event network-vif-plugged-b7fff2b1-9f14-4632-83e2-3f0a8e4c788b {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:46:43 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-d304633c-16bc-438d-b4f7-065ee75cb6d0 req-7b1cd792-68e3-4997-929c-6ef31048f927 service nova] Acquiring lock "af5fd5af-63a6-4eee-a4ef-6088a3713214-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:46:43 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-d304633c-16bc-438d-b4f7-065ee75cb6d0 req-7b1cd792-68e3-4997-929c-6ef31048f927 service nova] Lock "af5fd5af-63a6-4eee-a4ef-6088a3713214-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:46:43 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-d304633c-16bc-438d-b4f7-065ee75cb6d0 req-7b1cd792-68e3-4997-929c-6ef31048f927 service nova] Lock "af5fd5af-63a6-4eee-a4ef-6088a3713214-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:46:43 user nova-compute[75229]: DEBUG nova.compute.manager [req-d304633c-16bc-438d-b4f7-065ee75cb6d0 req-7b1cd792-68e3-4997-929c-6ef31048f927 service nova] [instance: af5fd5af-63a6-4eee-a4ef-6088a3713214] No waiting events found dispatching network-vif-plugged-b7fff2b1-9f14-4632-83e2-3f0a8e4c788b {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 09:46:43 user nova-compute[75229]: WARNING nova.compute.manager [req-d304633c-16bc-438d-b4f7-065ee75cb6d0 req-7b1cd792-68e3-4997-929c-6ef31048f927 service nova] [instance: af5fd5af-63a6-4eee-a4ef-6088a3713214] Received unexpected event network-vif-plugged-b7fff2b1-9f14-4632-83e2-3f0a8e4c788b for instance with vm_state active and task_state deleting.
Nov 14 09:46:43 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:18a1e95e-5df1-4db1-92bc-6cd67729c7a7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:46:43 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[cef797a7-6a3f-41fa-be13-0c617f4fae6f]: (4, ('Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:18a1e95e-5df1-4db1-92bc-6cd67729c7a7, portal: 172.16.0.220,3260]\nLogout of [sid: 3, target: iqn.2010-10.org.openstack:18a1e95e-5df1-4db1-92bc-6cd67729c7a7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:46:43 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-94b99e34-7e1e-4194-ac1b-f55d4c3c730d tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:18a1e95e-5df1-4db1-92bc-6cd67729c7a7, portal: 172.16.0.220,3260]
Nov 14 09:46:43 user nova-compute[75229]: Logout of [sid: 3, target: iqn.2010-10.org.openstack:18a1e95e-5df1-4db1-92bc-6cd67729c7a7, portal: 172.16.0.220,3260] successful.
Nov 14 09:46:43 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:46:43 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:18a1e95e-5df1-4db1-92bc-6cd67729c7a7 -p 172.16.0.220:3260 --op delete {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:46:43 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:18a1e95e-5df1-4db1-92bc-6cd67729c7a7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:46:43 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e35ca12-f6c6-49b1-ac6d-83d060fb1fd3]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:46:43 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-94b99e34-7e1e-4194-ac1b-f55d4c3c730d tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:46:43 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-94b99e34-7e1e-4194-ac1b-f55d4c3c730d tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.329s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 09:46:43 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-94b99e34-7e1e-4194-ac1b-f55d4c3c730d tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] <== disconnect_volume: return (331ms) None {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 09:46:43 user nova-compute[75229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-94b99e34-7e1e-4194-ac1b-f55d4c3c730d tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] [instance: af5fd5af-63a6-4eee-a4ef-6088a3713214] Disconnected iSCSI Volume {{(pid=75229) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 09:46:43 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-14541822-20a0-4fb4-a231-073f47febc6d tempest-TestVolumeSwap-1816306665 tempest-TestVolumeSwap-1816306665-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.201s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 09:46:43 user nova-compute[75229]: WARNING os_brick.initiator.connectors.base [None req-14541822-20a0-4fb4-a231-073f47febc6d tempest-TestVolumeSwap-1816306665 tempest-TestVolumeSwap-1816306665-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 09:46:43 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-14541822-20a0-4fb4-a231-073f47febc6d tempest-TestVolumeSwap-1816306665 tempest-TestVolumeSwap-1816306665-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:52ae1fea-5339-4958-88ae-d103080e7743" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 09:46:43 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-14541822-20a0-4fb4-a231-073f47febc6d tempest-TestVolumeSwap-1816306665 tempest-TestVolumeSwap-1816306665-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:52ae1fea-5339-4958-88ae-d103080e7743" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 09:46:43 user nova-compute[75229]: INFO os_brick.initiator.connectors.iscsi [None req-14541822-20a0-4fb4-a231-073f47febc6d tempest-TestVolumeSwap-1816306665 tempest-TestVolumeSwap-1816306665-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 09:46:43 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52ae1fea-5339-4958-88ae-d103080e7743 -p 172.16.0.220:3260 {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:46:43 user nova-compute[75229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-94b99e34-7e1e-4194-ac1b-f55d4c3c730d tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] [instance: af5fd5af-63a6-4eee-a4ef-6088a3713214] calling os-brick to detach iSCSI Volume {{(pid=75229) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 09:46:43 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-94b99e34-7e1e-4194-ac1b-f55d4c3c730d tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f73f85151b0>, {'target_iqn': 'iqn.2010-10.org.openstack:97f588de-32d5-4d48-9c06-5925263ba117', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qiIJvnPa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 09:46:43 user nova-compute[75229]: WARNING os_brick.initiator.connectors.base [None req-94b99e34-7e1e-4194-ac1b-f55d4c3c730d tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 09:46:43 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-94b99e34-7e1e-4194-ac1b-f55d4c3c730d tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 09:46:43 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52ae1fea-5339-4958-88ae-d103080e7743 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:46:43 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ada3b0c-8475-437c-9620-22a09905e63a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:46:43 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-14541822-20a0-4fb4-a231-073f47febc6d tempest-TestVolumeSwap-1816306665 tempest-TestVolumeSwap-1816306665-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 09:46:43 user nova-compute[75229]:  {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:46:43 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52ae1fea-5339-4958-88ae-d103080e7743 -p 172.16.0.220:3260 --interface default --op new {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:46:43 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52ae1fea-5339-4958-88ae-d103080e7743 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:46:43 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[372f9d7d-f352-4ce0-85c5-2dfe54876c24]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:52ae1fea-5339-4958-88ae-d103080e7743] added\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:46:43 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-14541822-20a0-4fb4-a231-073f47febc6d tempest-TestVolumeSwap-1816306665 tempest-TestVolumeSwap-1816306665-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:52ae1fea-5339-4958-88ae-d103080e7743] added
Nov 14 09:46:43 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:46:43 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52ae1fea-5339-4958-88ae-d103080e7743 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:46:43 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52ae1fea-5339-4958-88ae-d103080e7743 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:46:43 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c5b93be-95d2-4080-8407-1966cfc41697]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:46:43 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-14541822-20a0-4fb4-a231-073f47febc6d tempest-TestVolumeSwap-1816306665 tempest-TestVolumeSwap-1816306665-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:46:43 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52ae1fea-5339-4958-88ae-d103080e7743 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:46:43 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52ae1fea-5339-4958-88ae-d103080e7743 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:46:43 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dc12c59-69e9-476a-a00f-09d44e6a23d1]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:46:43 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-14541822-20a0-4fb4-a231-073f47febc6d tempest-TestVolumeSwap-1816306665 tempest-TestVolumeSwap-1816306665-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:46:43 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52ae1fea-5339-4958-88ae-d103080e7743 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xkXQEUcf {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:46:43 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52ae1fea-5339-4958-88ae-d103080e7743 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xkXQEUcf" returned: 0 in 0.017s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:46:43 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6e9047c-4f56-4574-966d-55b2070c0ab3]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:46:43 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-14541822-20a0-4fb4-a231-073f47febc6d tempest-TestVolumeSwap-1816306665 tempest-TestVolumeSwap-1816306665-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xkXQEUcf'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:46:43 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52ae1fea-5339-4958-88ae-d103080e7743 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:46:43 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52ae1fea-5339-4958-88ae-d103080e7743 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:46:43 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ea74d54-651c-44ab-a49c-d609640b7df8]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:46:43 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-14541822-20a0-4fb4-a231-073f47febc6d tempest-TestVolumeSwap-1816306665 tempest-TestVolumeSwap-1816306665-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:46:43 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:46:43 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:46:43 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[02707a60-b970-4b5f-bece-2bfb7e8df1f6]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2472759-033a-4051-9dec-4516d0aef07d (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7022511-a003-46d5-bcc1-064be770a829 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2324d4e-6e60-47fd-b536-144a7ea32dce (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97f588de-32d5-4d48-9c06-5925263ba117 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7144f229-1f5e-4155-aba1-ab44218df41a (non-flash)\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:46:43 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-14541822-20a0-4fb4-a231-073f47febc6d tempest-TestVolumeSwap-1816306665 tempest-TestVolumeSwap-1816306665-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2472759-033a-4051-9dec-4516d0aef07d (non-flash)
Nov 14 09:46:43 user nova-compute[75229]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7022511-a003-46d5-bcc1-064be770a829 (non-flash)
Nov 14 09:46:43 user nova-compute[75229]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2324d4e-6e60-47fd-b536-144a7ea32dce (non-flash)
Nov 14 09:46:43 user nova-compute[75229]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97f588de-32d5-4d48-9c06-5925263ba117 (non-flash)
Nov 14 09:46:43 user nova-compute[75229]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7144f229-1f5e-4155-aba1-ab44218df41a (non-flash)
Nov 14 09:46:43 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 09:46:43 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-14541822-20a0-4fb4-a231-073f47febc6d tempest-TestVolumeSwap-1816306665 tempest-TestVolumeSwap-1816306665-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2472759-033a-4051-9dec-4516d0aef07d (non-flash)
Nov 14 09:46:43 user nova-compute[75229]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7022511-a003-46d5-bcc1-064be770a829 (non-flash)
Nov 14 09:46:43 user nova-compute[75229]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2324d4e-6e60-47fd-b536-144a7ea32dce (non-flash)
Nov 14 09:46:43 user nova-compute[75229]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97f588de-32d5-4d48-9c06-5925263ba117 (non-flash)
Nov 14 09:46:43 user nova-compute[75229]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7144f229-1f5e-4155-aba1-ab44218df41a (non-flash)
Nov 14 09:46:43 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 09:46:43 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52ae1fea-5339-4958-88ae-d103080e7743 -p 172.16.0.220:3260 --login {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:46:43 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52ae1fea-5339-4958-88ae-d103080e7743 -p 172.16.0.220:3260 --login" returned: 0 in 0.077s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:46:43 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec4035b8-4b87-4a3a-b623-5dd3c0ed61f1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:52ae1fea-5339-4958-88ae-d103080e7743, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:52ae1fea-5339-4958-88ae-d103080e7743, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:46:43 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-14541822-20a0-4fb4-a231-073f47febc6d tempest-TestVolumeSwap-1816306665 tempest-TestVolumeSwap-1816306665-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:52ae1fea-5339-4958-88ae-d103080e7743, portal: 172.16.0.220,3260]
Nov 14 09:46:43 user nova-compute[75229]: Login to [iface: default, target: iqn.2010-10.org.openstack:52ae1fea-5339-4958-88ae-d103080e7743, portal: 172.16.0.220,3260] successful.
Nov 14 09:46:43 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:46:43 user nova-compute[75229]: DEBUG nova.compute.manager [req-cd7391af-a087-433d-8169-8384aa0541a9 req-cf1b4c41-126d-407c-87c7-5a42490ef1c1 service nova] [instance: af5fd5af-63a6-4eee-a4ef-6088a3713214] Received event network-vif-plugged-1f37d277-e3ac-48ca-b618-27b872f41824 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:46:43 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-cd7391af-a087-433d-8169-8384aa0541a9 req-cf1b4c41-126d-407c-87c7-5a42490ef1c1 service nova] Acquiring lock "af5fd5af-63a6-4eee-a4ef-6088a3713214-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:46:43 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-cd7391af-a087-433d-8169-8384aa0541a9 req-cf1b4c41-126d-407c-87c7-5a42490ef1c1 service nova] Lock "af5fd5af-63a6-4eee-a4ef-6088a3713214-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:46:43 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-cd7391af-a087-433d-8169-8384aa0541a9 req-cf1b4c41-126d-407c-87c7-5a42490ef1c1 service nova] Lock "af5fd5af-63a6-4eee-a4ef-6088a3713214-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:46:43 user nova-compute[75229]: DEBUG nova.compute.manager [req-cd7391af-a087-433d-8169-8384aa0541a9 req-cf1b4c41-126d-407c-87c7-5a42490ef1c1 service nova] [instance: af5fd5af-63a6-4eee-a4ef-6088a3713214] No waiting events found dispatching network-vif-plugged-1f37d277-e3ac-48ca-b618-27b872f41824 {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 09:46:43 user nova-compute[75229]: WARNING nova.compute.manager [req-cd7391af-a087-433d-8169-8384aa0541a9 req-cf1b4c41-126d-407c-87c7-5a42490ef1c1 service nova] [instance: af5fd5af-63a6-4eee-a4ef-6088a3713214] Received unexpected event network-vif-plugged-1f37d277-e3ac-48ca-b618-27b872f41824 for instance with vm_state active and task_state deleting.
Nov 14 09:46:43 user nova-compute[75229]: DEBUG nova.compute.manager [req-cd7391af-a087-433d-8169-8384aa0541a9 req-cf1b4c41-126d-407c-87c7-5a42490ef1c1 service nova] [instance: af5fd5af-63a6-4eee-a4ef-6088a3713214] Received event network-vif-unplugged-768a662a-4bcd-4844-a9ed-f8b8f6b8aa0d {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:46:43 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-cd7391af-a087-433d-8169-8384aa0541a9 req-cf1b4c41-126d-407c-87c7-5a42490ef1c1 service nova] Acquiring lock "af5fd5af-63a6-4eee-a4ef-6088a3713214-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:46:43 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-cd7391af-a087-433d-8169-8384aa0541a9 req-cf1b4c41-126d-407c-87c7-5a42490ef1c1 service nova] Lock "af5fd5af-63a6-4eee-a4ef-6088a3713214-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:46:43 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-cd7391af-a087-433d-8169-8384aa0541a9 req-cf1b4c41-126d-407c-87c7-5a42490ef1c1 service nova] Lock "af5fd5af-63a6-4eee-a4ef-6088a3713214-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:46:43 user nova-compute[75229]: DEBUG nova.compute.manager [req-cd7391af-a087-433d-8169-8384aa0541a9 req-cf1b4c41-126d-407c-87c7-5a42490ef1c1 service nova] [instance: af5fd5af-63a6-4eee-a4ef-6088a3713214] No waiting events found dispatching network-vif-unplugged-768a662a-4bcd-4844-a9ed-f8b8f6b8aa0d {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 09:46:43 user nova-compute[75229]: DEBUG nova.compute.manager [req-cd7391af-a087-433d-8169-8384aa0541a9 req-cf1b4c41-126d-407c-87c7-5a42490ef1c1 service nova] [instance: af5fd5af-63a6-4eee-a4ef-6088a3713214] Received event network-vif-unplugged-768a662a-4bcd-4844-a9ed-f8b8f6b8aa0d for instance with task_state deleting. {{(pid=75229) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 09:46:43 user nova-compute[75229]: DEBUG nova.compute.manager [req-cd7391af-a087-433d-8169-8384aa0541a9 req-cf1b4c41-126d-407c-87c7-5a42490ef1c1 service nova] [instance: af5fd5af-63a6-4eee-a4ef-6088a3713214] Received event network-vif-plugged-768a662a-4bcd-4844-a9ed-f8b8f6b8aa0d {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:46:43 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-cd7391af-a087-433d-8169-8384aa0541a9 req-cf1b4c41-126d-407c-87c7-5a42490ef1c1 service nova] Acquiring lock "af5fd5af-63a6-4eee-a4ef-6088a3713214-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:46:43 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-cd7391af-a087-433d-8169-8384aa0541a9 req-cf1b4c41-126d-407c-87c7-5a42490ef1c1 service nova] Lock "af5fd5af-63a6-4eee-a4ef-6088a3713214-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:46:43 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-cd7391af-a087-433d-8169-8384aa0541a9 req-cf1b4c41-126d-407c-87c7-5a42490ef1c1 service nova] Lock "af5fd5af-63a6-4eee-a4ef-6088a3713214-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:46:43 user nova-compute[75229]: DEBUG nova.compute.manager [req-cd7391af-a087-433d-8169-8384aa0541a9 req-cf1b4c41-126d-407c-87c7-5a42490ef1c1 service nova] [instance: af5fd5af-63a6-4eee-a4ef-6088a3713214] No waiting events found dispatching network-vif-plugged-768a662a-4bcd-4844-a9ed-f8b8f6b8aa0d {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 09:46:43 user nova-compute[75229]: WARNING nova.compute.manager [req-cd7391af-a087-433d-8169-8384aa0541a9 req-cf1b4c41-126d-407c-87c7-5a42490ef1c1 service nova] [instance: af5fd5af-63a6-4eee-a4ef-6088a3713214] Received unexpected event network-vif-plugged-768a662a-4bcd-4844-a9ed-f8b8f6b8aa0d for instance with vm_state active and task_state deleting.
Nov 14 09:46:43 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52ae1fea-5339-4958-88ae-d103080e7743 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:46:43 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52ae1fea-5339-4958-88ae-d103080e7743 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:46:43 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[100e9362-d870-402a-a667-c98575c27e54]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:46:43 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-14541822-20a0-4fb4-a231-073f47febc6d tempest-TestVolumeSwap-1816306665 tempest-TestVolumeSwap-1816306665-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:46:43 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:46:43 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:46:43 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[534b8632-2e8b-49f4-ba72-819f5b75e96e]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2472759-033a-4051-9dec-4516d0aef07d (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7022511-a003-46d5-bcc1-064be770a829 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52ae1fea-5339-4958-88ae-d103080e7743 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2324d4e-6e60-47fd-b536-144a7ea32dce (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97f588de-32d5-4d48-9c06-5925263ba117 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7144f229-1f5e-4155-aba1-ab44218df41a (non-flash)\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:46:43 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-14541822-20a0-4fb4-a231-073f47febc6d tempest-TestVolumeSwap-1816306665 tempest-TestVolumeSwap-1816306665-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2472759-033a-4051-9dec-4516d0aef07d (non-flash)
Nov 14 09:46:43 user nova-compute[75229]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7022511-a003-46d5-bcc1-064be770a829 (non-flash)
Nov 14 09:46:43 user nova-compute[75229]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52ae1fea-5339-4958-88ae-d103080e7743 (non-flash)
Nov 14 09:46:43 user nova-compute[75229]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2324d4e-6e60-47fd-b536-144a7ea32dce (non-flash)
Nov 14 09:46:43 user nova-compute[75229]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97f588de-32d5-4d48-9c06-5925263ba117 (non-flash)
Nov 14 09:46:43 user nova-compute[75229]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7144f229-1f5e-4155-aba1-ab44218df41a (non-flash)
Nov 14 09:46:43 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 09:46:43 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-14541822-20a0-4fb4-a231-073f47febc6d tempest-TestVolumeSwap-1816306665 tempest-TestVolumeSwap-1816306665-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2472759-033a-4051-9dec-4516d0aef07d (non-flash)
Nov 14 09:46:43 user nova-compute[75229]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7022511-a003-46d5-bcc1-064be770a829 (non-flash)
Nov 14 09:46:43 user nova-compute[75229]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52ae1fea-5339-4958-88ae-d103080e7743 (non-flash)
Nov 14 09:46:43 user nova-compute[75229]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2324d4e-6e60-47fd-b536-144a7ea32dce (non-flash)
Nov 14 09:46:43 user nova-compute[75229]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97f588de-32d5-4d48-9c06-5925263ba117 (non-flash)
Nov 14 09:46:43 user nova-compute[75229]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7144f229-1f5e-4155-aba1-ab44218df41a (non-flash)
Nov 14 09:46:43 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 09:46:43 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-14541822-20a0-4fb4-a231-073f47febc6d tempest-TestVolumeSwap-1816306665 tempest-TestVolumeSwap-1816306665-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:52ae1fea-5339-4958-88ae-d103080e7743" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.286s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 09:46:43 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-14541822-20a0-4fb4-a231-073f47febc6d tempest-TestVolumeSwap-1816306665 tempest-TestVolumeSwap-1816306665-project-admin] Connected to 172.16.0.220:3260 {{(pid=75229) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 09:46:43 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-14541822-20a0-4fb4-a231-073f47febc6d tempest-TestVolumeSwap-1816306665 tempest-TestVolumeSwap-1816306665-project-admin] HCTL ('34', '-', '-', 0) found on session 12 with lun 0 {{(pid=75229) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 09:46:43 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-14541822-20a0-4fb4-a231-073f47febc6d tempest-TestVolumeSwap-1816306665 tempest-TestVolumeSwap-1816306665-project-admin] Scanning host 34 c: -, t: -, l: 0) {{(pid=75229) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 09:46:43 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:46:43 user nova-compute[75229]: WARNING nova.virt.libvirt.driver [None req-afde6df1-6d68-4670-9fb4-d8da73363148 tempest-TaggedAttachmentsTest-294727221 tempest-TaggedAttachmentsTest-294727221-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance c6fa2298-7111-4660-a162-09269045d5e3 is timed out.
Nov 14 09:46:43 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-afde6df1-6d68-4670-9fb4-d8da73363148 tempest-TaggedAttachmentsTest-294727221 tempest-TaggedAttachmentsTest-294727221-project-member] Successfully detached device vdb from instance c6fa2298-7111-4660-a162-09269045d5e3 from the live domain config.
Nov 14 09:46:43 user nova-compute[75229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-afde6df1-6d68-4670-9fb4-d8da73363148 tempest-TaggedAttachmentsTest-294727221 tempest-TaggedAttachmentsTest-294727221-project-member] [instance: c6fa2298-7111-4660-a162-09269045d5e3] calling os-brick to detach iSCSI Volume {{(pid=75229) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 09:46:43 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-afde6df1-6d68-4670-9fb4-d8da73363148 tempest-TaggedAttachmentsTest-294727221 tempest-TaggedAttachmentsTest-294727221-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f73f85151b0>, {'target_iqn': 'iqn.2010-10.org.openstack:7144f229-1f5e-4155-aba1-ab44218df41a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PKNhXWaY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 09:46:43 user nova-compute[75229]: WARNING os_brick.initiator.connectors.base [None req-afde6df1-6d68-4670-9fb4-d8da73363148 tempest-TaggedAttachmentsTest-294727221 tempest-TaggedAttachmentsTest-294727221-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 09:46:43 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-afde6df1-6d68-4670-9fb4-d8da73363148 tempest-TaggedAttachmentsTest-294727221 tempest-TaggedAttachmentsTest-294727221-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 09:46:43 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:46:43 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[7251d6a5-0029-4f64-a197-f8cdad2fd47e]: (4, ('- - 0', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:46:43 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-14541822-20a0-4fb4-a231-073f47febc6d tempest-TestVolumeSwap-1816306665 tempest-TestVolumeSwap-1816306665-project-admin] Searching for a device in session 12 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75229) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 09:46:43 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-14541822-20a0-4fb4-a231-073f47febc6d tempest-TestVolumeSwap-1816306665 tempest-TestVolumeSwap-1816306665-project-admin] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:52ae1fea-5339-4958-88ae-d103080e7743', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xkXQEUcf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75229) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 09:46:44 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 09:46:44 user nova-compute[75229]: DEBUG nova.compute.manager [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Starting heal instance info cache {{(pid=75229) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 09:46:44 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-14541822-20a0-4fb4-a231-073f47febc6d tempest-TestVolumeSwap-1816306665 tempest-TestVolumeSwap-1816306665-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.321s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 09:46:44 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-14541822-20a0-4fb4-a231-073f47febc6d tempest-TestVolumeSwap-1816306665 tempest-TestVolumeSwap-1816306665-project-admin] <== connect_volume: return (1523ms) {'type': 'block', 'scsi_wwn': '26132343636646636', 'path': '/dev/sdc'} {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 09:46:44 user nova-compute[75229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-14541822-20a0-4fb4-a231-073f47febc6d tempest-TestVolumeSwap-1816306665 tempest-TestVolumeSwap-1816306665-project-admin] [instance: c307660b-01bb-471b-9e2e-5c2aaca65287] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26132343636646636', 'path': '/dev/sdc'} {{(pid=75229) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 09:46:44 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-94b99e34-7e1e-4194-ac1b-f55d4c3c730d tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.317s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 09:46:44 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:46:44 user nova-compute[75229]: DEBUG nova.objects.instance [None req-14541822-20a0-4fb4-a231-073f47febc6d tempest-TestVolumeSwap-1816306665 tempest-TestVolumeSwap-1816306665-project-admin] Lazy-loading 'flavor' on Instance uuid c307660b-01bb-471b-9e2e-5c2aaca65287 {{(pid=75229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 09:46:44 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:46:44 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[126b472f-2bd8-418c-82c7-debe180dba4a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c2324d4e-6e60-47fd-b536-144a7ea32dce\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:52ae1fea-5339-4958-88ae-d103080e7743\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:97f588de-32d5-4d48-9c06-5925263ba117\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c7022511-a003-46d5-bcc1-064be770a829\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e2472759-033a-4051-9dec-4516d0aef07d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7144f229-1f5e-4155-aba1-ab44218df41a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:46:44 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-94b99e34-7e1e-4194-ac1b-f55d4c3c730d tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 09:46:44 user nova-compute[75229]: No targets found.
Nov 14 09:46:44 user nova-compute[75229]: iSNS:
Nov 14 09:46:44 user nova-compute[75229]: No targets found.
Nov 14 09:46:44 user nova-compute[75229]: STATIC:
Nov 14 09:46:44 user nova-compute[75229]: Target: iqn.2010-10.org.openstack:c2324d4e-6e60-47fd-b536-144a7ea32dce
Nov 14 09:46:44 user nova-compute[75229]:         Portal: 172.16.0.220:3260,-1
Nov 14 09:46:44 user nova-compute[75229]:                 Iface Name: default
Nov 14 09:46:44 user nova-compute[75229]: Target: iqn.2010-10.org.openstack:52ae1fea-5339-4958-88ae-d103080e7743
Nov 14 09:46:44 user nova-compute[75229]:         Portal: 172.16.0.220:3260,-1
Nov 14 09:46:44 user nova-compute[75229]:                 Iface Name: default
Nov 14 09:46:44 user nova-compute[75229]: Target: iqn.2010-10.org.openstack:97f588de-32d5-4d48-9c06-5925263ba117
Nov 14 09:46:44 user nova-compute[75229]:         Portal: 172.16.0.220:3260,-1
Nov 14 09:46:44 user nova-compute[75229]:                 Iface Name: default
Nov 14 09:46:44 user nova-compute[75229]: Target: iqn.2010-10.org.openstack:c7022511-a003-46d5-bcc1-064be770a829
Nov 14 09:46:44 user nova-compute[75229]:         Portal: 172.16.0.220:3260,-1
Nov 14 09:46:44 user nova-compute[75229]:                 Iface Name: default
Nov 14 09:46:44 user nova-compute[75229]: Target: iqn.2010-10.org.openstack:e2472759-033a-4051-9dec-4516d0aef07d
Nov 14 09:46:44 user nova-compute[75229]:         Portal: 172.16.0.220:3260,-1
Nov 14 09:46:44 user nova-compute[75229]:                 Iface Name: default
Nov 14 09:46:44 user nova-compute[75229]: Target: iqn.2010-10.org.openstack:7144f229-1f5e-4155-aba1-ab44218df41a
Nov 14 09:46:44 user nova-compute[75229]:         Portal: 172.16.0.220:3260,-1
Nov 14 09:46:44 user nova-compute[75229]:                 Iface Name: default
Nov 14 09:46:44 user nova-compute[75229]: FIRMWARE:
Nov 14 09:46:44 user nova-compute[75229]: No targets found.
Nov 14 09:46:44 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 09:46:44 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-94b99e34-7e1e-4194-ac1b-f55d4c3c730d tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 09:46:44 user nova-compute[75229]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 09:46:44 user nova-compute[75229]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75229) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 09:46:44 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-94b99e34-7e1e-4194-ac1b-f55d4c3c730d tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:97f588de-32d5-4d48-9c06-5925263ba117', 0)] {{(pid=75229) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 09:46:44 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:46:44 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Acquiring lock "refresh_cache-a7750cbc-b3d0-44aa-8b88-c291ba007a8a" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 09:46:44 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Acquired lock "refresh_cache-a7750cbc-b3d0-44aa-8b88-c291ba007a8a" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 09:46:44 user nova-compute[75229]: DEBUG nova.network.neutron [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] [instance: a7750cbc-b3d0-44aa-8b88-c291ba007a8a] Forcefully refreshing network info cache for instance {{(pid=75229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 09:46:44 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:46:44 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[c950fa8d-0905-435d-927e-e7713f46ea9b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:52ae1fea-5339-4958-88ae-d103080e7743\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7144f229-1f5e-4155-aba1-ab44218df41a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:97f588de-32d5-4d48-9c06-5925263ba117\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c2324d4e-6e60-47fd-b536-144a7ea32dce\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c7022511-a003-46d5-bcc1-064be770a829\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e2472759-033a-4051-9dec-4516d0aef07d\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:46:44 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:46:44 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:46:44 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[35034179-aac1-4a18-8383-d50b81fe7b32]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2472759-033a-4051-9dec-4516d0aef07d (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7022511-a003-46d5-bcc1-064be770a829 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52ae1fea-5339-4958-88ae-d103080e7743 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2324d4e-6e60-47fd-b536-144a7ea32dce (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97f588de-32d5-4d48-9c06-5925263ba117 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7144f229-1f5e-4155-aba1-ab44218df41a (non-flash)\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:46:44 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-94b99e34-7e1e-4194-ac1b-f55d4c3c730d tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2472759-033a-4051-9dec-4516d0aef07d (non-flash)
Nov 14 09:46:44 user nova-compute[75229]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7022511-a003-46d5-bcc1-064be770a829 (non-flash)
Nov 14 09:46:44 user nova-compute[75229]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52ae1fea-5339-4958-88ae-d103080e7743 (non-flash)
Nov 14 09:46:44 user nova-compute[75229]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2324d4e-6e60-47fd-b536-144a7ea32dce (non-flash)
Nov 14 09:46:44 user nova-compute[75229]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97f588de-32d5-4d48-9c06-5925263ba117 (non-flash)
Nov 14 09:46:44 user nova-compute[75229]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7144f229-1f5e-4155-aba1-ab44218df41a (non-flash)
Nov 14 09:46:44 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 09:46:44 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-94b99e34-7e1e-4194-ac1b-f55d4c3c730d tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2472759-033a-4051-9dec-4516d0aef07d (non-flash)
Nov 14 09:46:44 user nova-compute[75229]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7022511-a003-46d5-bcc1-064be770a829 (non-flash)
Nov 14 09:46:44 user nova-compute[75229]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52ae1fea-5339-4958-88ae-d103080e7743 (non-flash)
Nov 14 09:46:44 user nova-compute[75229]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2324d4e-6e60-47fd-b536-144a7ea32dce (non-flash)
Nov 14 09:46:44 user nova-compute[75229]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97f588de-32d5-4d48-9c06-5925263ba117 (non-flash)
Nov 14 09:46:44 user nova-compute[75229]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7144f229-1f5e-4155-aba1-ab44218df41a (non-flash)
Nov 14 09:46:44 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 09:46:44 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-94b99e34-7e1e-4194-ac1b-f55d4c3c730d tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f73f8525630>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:97f588de-32d5-4d48-9c06-5925263ba117'): ({'sdd'}, set())}) {{(pid=75229) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 09:46:44 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-94b99e34-7e1e-4194-ac1b-f55d4c3c730d tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] Removing single pathed devices sdd {{(pid=75229) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 09:46:44 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:46:44 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:46:44 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c3e2641-3635-494b-8b29-6c34f4c3ea8e]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:46:44 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:46:44 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:46:44 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[e07cbdc1-5eea-41cd-973b-50acc683b20a]: (4, ('ok\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:46:44 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-94b99e34-7e1e-4194-ac1b-f55d4c3c730d tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] Flushing IO for device /dev/sdd {{(pid=75229) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 09:46:44 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:46:44 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:46:44 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[810ee3c0-5c4c-4e3d-8b02-ad6ffa034bc3]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:46:44 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-94b99e34-7e1e-4194-ac1b-f55d4c3c730d tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75229) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 09:46:44 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:46:45 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.046s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:46:45 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[927235f6-71c1-444d-a921-b20d45f80cc5]: (4, ('1', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:46:45 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-94b99e34-7e1e-4194-ac1b-f55d4c3c730d tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75229) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 09:46:45 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-94b99e34-7e1e-4194-ac1b-f55d4c3c730d tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] SCSI volumes sdd have been removed. {{(pid=75229) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 09:46:45 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-94b99e34-7e1e-4194-ac1b-f55d4c3c730d tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:97f588de-32d5-4d48-9c06-5925263ba117')] {{(pid=75229) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 09:46:45 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97f588de-32d5-4d48-9c06-5925263ba117 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:46:45 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97f588de-32d5-4d48-9c06-5925263ba117 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:46:45 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb4645ee-fc52-43a9-bf78-8345fe4aeb12]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:46:45 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-94b99e34-7e1e-4194-ac1b-f55d4c3c730d tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:46:45 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97f588de-32d5-4d48-9c06-5925263ba117 -p 172.16.0.220:3260 --logout {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:46:45 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97f588de-32d5-4d48-9c06-5925263ba117 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:46:45 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbc2bccd-dcf1-4c90-a0b4-db6ab0b6f0bb]: (4, ('Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:97f588de-32d5-4d48-9c06-5925263ba117, portal: 172.16.0.220,3260]\nLogout of [sid: 4, target: iqn.2010-10.org.openstack:97f588de-32d5-4d48-9c06-5925263ba117, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:46:45 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-94b99e34-7e1e-4194-ac1b-f55d4c3c730d tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:97f588de-32d5-4d48-9c06-5925263ba117, portal: 172.16.0.220,3260]
Nov 14 09:46:45 user nova-compute[75229]: Logout of [sid: 4, target: iqn.2010-10.org.openstack:97f588de-32d5-4d48-9c06-5925263ba117, portal: 172.16.0.220,3260] successful.
Nov 14 09:46:45 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:46:45 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97f588de-32d5-4d48-9c06-5925263ba117 -p 172.16.0.220:3260 --op delete {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:46:45 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97f588de-32d5-4d48-9c06-5925263ba117 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:46:45 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1349f3d-1b73-43f1-8d96-fbde7390039f]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:46:45 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-94b99e34-7e1e-4194-ac1b-f55d4c3c730d tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:46:45 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-94b99e34-7e1e-4194-ac1b-f55d4c3c730d tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.315s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 09:46:45 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-94b99e34-7e1e-4194-ac1b-f55d4c3c730d tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] <== disconnect_volume: return (1631ms) None {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 09:46:45 user nova-compute[75229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-94b99e34-7e1e-4194-ac1b-f55d4c3c730d tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] [instance: af5fd5af-63a6-4eee-a4ef-6088a3713214] Disconnected iSCSI Volume {{(pid=75229) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 09:46:45 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-afde6df1-6d68-4670-9fb4-d8da73363148 tempest-TaggedAttachmentsTest-294727221 tempest-TaggedAttachmentsTest-294727221-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.329s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 09:46:45 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:46:45 user nova-compute[75229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-94b99e34-7e1e-4194-ac1b-f55d4c3c730d tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] [instance: af5fd5af-63a6-4eee-a4ef-6088a3713214] calling os-brick to detach iSCSI Volume {{(pid=75229) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 09:46:45 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-94b99e34-7e1e-4194-ac1b-f55d4c3c730d tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f73f85151b0>, {'target_iqn': 'iqn.2010-10.org.openstack:c2324d4e-6e60-47fd-b536-144a7ea32dce', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OTmFoJDy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 09:46:45 user nova-compute[75229]: WARNING os_brick.initiator.connectors.base [None req-94b99e34-7e1e-4194-ac1b-f55d4c3c730d tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 09:46:45 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-94b99e34-7e1e-4194-ac1b-f55d4c3c730d tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 09:46:45 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:46:45 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[34e07a9c-98c8-456f-9191-90cb2ebafa40]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c2324d4e-6e60-47fd-b536-144a7ea32dce\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:52ae1fea-5339-4958-88ae-d103080e7743\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c7022511-a003-46d5-bcc1-064be770a829\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e2472759-033a-4051-9dec-4516d0aef07d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7144f229-1f5e-4155-aba1-ab44218df41a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:46:45 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-afde6df1-6d68-4670-9fb4-d8da73363148 tempest-TaggedAttachmentsTest-294727221 tempest-TaggedAttachmentsTest-294727221-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 09:46:45 user nova-compute[75229]: No targets found.
Nov 14 09:46:45 user nova-compute[75229]: iSNS:
Nov 14 09:46:45 user nova-compute[75229]: No targets found.
Nov 14 09:46:45 user nova-compute[75229]: STATIC:
Nov 14 09:46:45 user nova-compute[75229]: Target: iqn.2010-10.org.openstack:c2324d4e-6e60-47fd-b536-144a7ea32dce
Nov 14 09:46:45 user nova-compute[75229]:         Portal: 172.16.0.220:3260,-1
Nov 14 09:46:45 user nova-compute[75229]:                 Iface Name: default
Nov 14 09:46:45 user nova-compute[75229]: Target: iqn.2010-10.org.openstack:52ae1fea-5339-4958-88ae-d103080e7743
Nov 14 09:46:45 user nova-compute[75229]:         Portal: 172.16.0.220:3260,-1
Nov 14 09:46:45 user nova-compute[75229]:                 Iface Name: default
Nov 14 09:46:45 user nova-compute[75229]: Target: iqn.2010-10.org.openstack:c7022511-a003-46d5-bcc1-064be770a829
Nov 14 09:46:45 user nova-compute[75229]:         Portal: 172.16.0.220:3260,-1
Nov 14 09:46:45 user nova-compute[75229]:                 Iface Name: default
Nov 14 09:46:45 user nova-compute[75229]: Target: iqn.2010-10.org.openstack:e2472759-033a-4051-9dec-4516d0aef07d
Nov 14 09:46:45 user nova-compute[75229]:         Portal: 172.16.0.220:3260,-1
Nov 14 09:46:45 user nova-compute[75229]:                 Iface Name: default
Nov 14 09:46:45 user nova-compute[75229]: Target: iqn.2010-10.org.openstack:7144f229-1f5e-4155-aba1-ab44218df41a
Nov 14 09:46:45 user nova-compute[75229]:         Portal: 172.16.0.220:3260,-1
Nov 14 09:46:45 user nova-compute[75229]:                 Iface Name: default
Nov 14 09:46:45 user nova-compute[75229]: FIRMWARE:
Nov 14 09:46:45 user nova-compute[75229]: No targets found.
Nov 14 09:46:45 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 09:46:45 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-afde6df1-6d68-4670-9fb4-d8da73363148 tempest-TaggedAttachmentsTest-294727221 tempest-TaggedAttachmentsTest-294727221-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 09:46:45 user nova-compute[75229]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 09:46:45 user nova-compute[75229]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75229) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 09:46:45 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-afde6df1-6d68-4670-9fb4-d8da73363148 tempest-TaggedAttachmentsTest-294727221 tempest-TaggedAttachmentsTest-294727221-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7144f229-1f5e-4155-aba1-ab44218df41a', 0)] {{(pid=75229) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 09:46:45 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:46:45 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:46:45 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[d29cac9c-f013-4650-897b-2aaf59de719a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:52ae1fea-5339-4958-88ae-d103080e7743\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7144f229-1f5e-4155-aba1-ab44218df41a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c2324d4e-6e60-47fd-b536-144a7ea32dce\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c7022511-a003-46d5-bcc1-064be770a829\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e2472759-033a-4051-9dec-4516d0aef07d\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:46:45 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:46:45 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:46:45 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ee18479-3fbb-4521-beb4-3e721923caff]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2472759-033a-4051-9dec-4516d0aef07d (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7022511-a003-46d5-bcc1-064be770a829 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52ae1fea-5339-4958-88ae-d103080e7743 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2324d4e-6e60-47fd-b536-144a7ea32dce (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7144f229-1f5e-4155-aba1-ab44218df41a (non-flash)\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:46:45 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-afde6df1-6d68-4670-9fb4-d8da73363148 tempest-TaggedAttachmentsTest-294727221 tempest-TaggedAttachmentsTest-294727221-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2472759-033a-4051-9dec-4516d0aef07d (non-flash)
Nov 14 09:46:45 user nova-compute[75229]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7022511-a003-46d5-bcc1-064be770a829 (non-flash)
Nov 14 09:46:45 user nova-compute[75229]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52ae1fea-5339-4958-88ae-d103080e7743 (non-flash)
Nov 14 09:46:45 user nova-compute[75229]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2324d4e-6e60-47fd-b536-144a7ea32dce (non-flash)
Nov 14 09:46:45 user nova-compute[75229]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7144f229-1f5e-4155-aba1-ab44218df41a (non-flash)
Nov 14 09:46:45 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 09:46:45 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-afde6df1-6d68-4670-9fb4-d8da73363148 tempest-TaggedAttachmentsTest-294727221 tempest-TaggedAttachmentsTest-294727221-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2472759-033a-4051-9dec-4516d0aef07d (non-flash)
Nov 14 09:46:45 user nova-compute[75229]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7022511-a003-46d5-bcc1-064be770a829 (non-flash)
Nov 14 09:46:45 user nova-compute[75229]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52ae1fea-5339-4958-88ae-d103080e7743 (non-flash)
Nov 14 09:46:45 user nova-compute[75229]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2324d4e-6e60-47fd-b536-144a7ea32dce (non-flash)
Nov 14 09:46:45 user nova-compute[75229]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7144f229-1f5e-4155-aba1-ab44218df41a (non-flash)
Nov 14 09:46:45 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 09:46:45 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-afde6df1-6d68-4670-9fb4-d8da73363148 tempest-TaggedAttachmentsTest-294727221 tempest-TaggedAttachmentsTest-294727221-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f73d4f5db40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7144f229-1f5e-4155-aba1-ab44218df41a'): ({'sdg'}, set())}) {{(pid=75229) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 09:46:45 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-afde6df1-6d68-4670-9fb4-d8da73363148 tempest-TaggedAttachmentsTest-294727221 tempest-TaggedAttachmentsTest-294727221-project-member] Removing single pathed devices sdg {{(pid=75229) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 09:46:45 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:46:45 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:46:45 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[73a4e03e-4c72-4f89-8a8d-c40be33d1149]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:46:45 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:46:45 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.017s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:46:45 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[36ea99e8-291d-4670-a470-7abda53d2bee]: (4, ('ok\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:46:45 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-afde6df1-6d68-4670-9fb4-d8da73363148 tempest-TaggedAttachmentsTest-294727221 tempest-TaggedAttachmentsTest-294727221-project-member] Flushing IO for device /dev/sdg {{(pid=75229) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 09:46:45 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:46:45 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.015s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:46:45 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[093153bf-d40f-4762-b50d-ca655e606c75]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:46:45 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-afde6df1-6d68-4670-9fb4-d8da73363148 tempest-TaggedAttachmentsTest-294727221 tempest-TaggedAttachmentsTest-294727221-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=75229) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 09:46:45 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:46:45 user nova-compute[75229]: DEBUG nova.network.neutron [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] [instance: a7750cbc-b3d0-44aa-8b88-c291ba007a8a] Updating instance_info_cache with network_info: [{"id": "e5b20e94-618c-4c51-b20f-1d3f1fb921b6", "address": "fa:16:3e:e5:e8:ed", "network": {"id": "5dfc532f-3d5d-4342-b7f1-12c9c3992a54", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1457278473-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.147", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46e65cdd021f4a3db7c9254bb6d98b46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5b20e94-61", "ovs_interfaceid": "e5b20e94-618c-4c51-b20f-1d3f1fb921b6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 09:46:45 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.049s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:46:45 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[76de77a8-a829-424a-a75d-5d5f64efd2ac]: (4, ('1', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:46:45 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-afde6df1-6d68-4670-9fb4-d8da73363148 tempest-TaggedAttachmentsTest-294727221 tempest-TaggedAttachmentsTest-294727221-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=75229) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 09:46:45 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-afde6df1-6d68-4670-9fb4-d8da73363148 tempest-TaggedAttachmentsTest-294727221 tempest-TaggedAttachmentsTest-294727221-project-member] SCSI volumes sdg have been removed. {{(pid=75229) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 09:46:45 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-afde6df1-6d68-4670-9fb4-d8da73363148 tempest-TaggedAttachmentsTest-294727221 tempest-TaggedAttachmentsTest-294727221-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7144f229-1f5e-4155-aba1-ab44218df41a')] {{(pid=75229) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 09:46:45 user nova-compute[75229]: DEBUG nova.virt.libvirt.guest [None req-14541822-20a0-4fb4-a231-073f47febc6d tempest-TestVolumeSwap-1816306665 tempest-TestVolumeSwap-1816306665-project-admin] COPY block job progress, current cursor: 6291456 final cursor: 1073741824 {{(pid=75229) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 09:46:45 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7144f229-1f5e-4155-aba1-ab44218df41a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:46:45 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Releasing lock "refresh_cache-a7750cbc-b3d0-44aa-8b88-c291ba007a8a" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 09:46:45 user nova-compute[75229]: DEBUG nova.compute.manager [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] [instance: a7750cbc-b3d0-44aa-8b88-c291ba007a8a] Updated the network info_cache for instance {{(pid=75229) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 09:46:45 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 09:46:45 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7144f229-1f5e-4155-aba1-ab44218df41a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:46:45 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff9bdfa1-44b7-4066-9736-2b4ca10de5cb]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:46:45 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-afde6df1-6d68-4670-9fb4-d8da73363148 tempest-TaggedAttachmentsTest-294727221 tempest-TaggedAttachmentsTest-294727221-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:46:45 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7144f229-1f5e-4155-aba1-ab44218df41a -p 172.16.0.220:3260 --logout {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:46:45 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7144f229-1f5e-4155-aba1-ab44218df41a -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:46:45 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc06b401-1320-48b8-aef8-940ac02f5320]: (4, ('Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:7144f229-1f5e-4155-aba1-ab44218df41a, portal: 172.16.0.220,3260]\nLogout of [sid: 8, target: iqn.2010-10.org.openstack:7144f229-1f5e-4155-aba1-ab44218df41a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:46:45 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-afde6df1-6d68-4670-9fb4-d8da73363148 tempest-TaggedAttachmentsTest-294727221 tempest-TaggedAttachmentsTest-294727221-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:7144f229-1f5e-4155-aba1-ab44218df41a, portal: 172.16.0.220,3260]
Nov 14 09:46:45 user nova-compute[75229]: Logout of [sid: 8, target: iqn.2010-10.org.openstack:7144f229-1f5e-4155-aba1-ab44218df41a, portal: 172.16.0.220,3260] successful.
Nov 14 09:46:45 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:46:45 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7144f229-1f5e-4155-aba1-ab44218df41a -p 172.16.0.220:3260 --op delete {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:46:45 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:46:45 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:46:45 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:46:45 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Auditing locally available compute resources for user (node: user) {{(pid=75229) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 09:46:45 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7144f229-1f5e-4155-aba1-ab44218df41a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:46:45 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[b547bcd6-81f1-4d51-b9d6-0bfb03eda458]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:46:45 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-afde6df1-6d68-4670-9fb4-d8da73363148 tempest-TaggedAttachmentsTest-294727221 tempest-TaggedAttachmentsTest-294727221-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:46:45 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-afde6df1-6d68-4670-9fb4-d8da73363148 tempest-TaggedAttachmentsTest-294727221 tempest-TaggedAttachmentsTest-294727221-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.316s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 09:46:45 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-afde6df1-6d68-4670-9fb4-d8da73363148 tempest-TaggedAttachmentsTest-294727221 tempest-TaggedAttachmentsTest-294727221-project-member] <== disconnect_volume: return (1645ms) None {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 09:46:45 user nova-compute[75229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-afde6df1-6d68-4670-9fb4-d8da73363148 tempest-TaggedAttachmentsTest-294727221 tempest-TaggedAttachmentsTest-294727221-project-member] [instance: c6fa2298-7111-4660-a162-09269045d5e3] Disconnected iSCSI Volume {{(pid=75229) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 09:46:45 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-94b99e34-7e1e-4194-ac1b-f55d4c3c730d tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.316s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 09:46:45 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:46:45 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:46:45 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d079f70-bd00-4aec-8785-7e88ab77f13a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c2324d4e-6e60-47fd-b536-144a7ea32dce\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:52ae1fea-5339-4958-88ae-d103080e7743\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c7022511-a003-46d5-bcc1-064be770a829\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e2472759-033a-4051-9dec-4516d0aef07d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:46:45 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-94b99e34-7e1e-4194-ac1b-f55d4c3c730d tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 09:46:45 user nova-compute[75229]: No targets found.
Nov 14 09:46:45 user nova-compute[75229]: iSNS:
Nov 14 09:46:45 user nova-compute[75229]: No targets found.
Nov 14 09:46:45 user nova-compute[75229]: STATIC:
Nov 14 09:46:45 user nova-compute[75229]: Target: iqn.2010-10.org.openstack:c2324d4e-6e60-47fd-b536-144a7ea32dce
Nov 14 09:46:45 user nova-compute[75229]:         Portal: 172.16.0.220:3260,-1
Nov 14 09:46:45 user nova-compute[75229]:                 Iface Name: default
Nov 14 09:46:45 user nova-compute[75229]: Target: iqn.2010-10.org.openstack:52ae1fea-5339-4958-88ae-d103080e7743
Nov 14 09:46:45 user nova-compute[75229]:         Portal: 172.16.0.220:3260,-1
Nov 14 09:46:45 user nova-compute[75229]:                 Iface Name: default
Nov 14 09:46:45 user nova-compute[75229]: Target: iqn.2010-10.org.openstack:c7022511-a003-46d5-bcc1-064be770a829
Nov 14 09:46:45 user nova-compute[75229]:         Portal: 172.16.0.220:3260,-1
Nov 14 09:46:45 user nova-compute[75229]:                 Iface Name: default
Nov 14 09:46:45 user nova-compute[75229]: Target: iqn.2010-10.org.openstack:e2472759-033a-4051-9dec-4516d0aef07d
Nov 14 09:46:45 user nova-compute[75229]:         Portal: 172.16.0.220:3260,-1
Nov 14 09:46:45 user nova-compute[75229]:                 Iface Name: default
Nov 14 09:46:45 user nova-compute[75229]: FIRMWARE:
Nov 14 09:46:45 user nova-compute[75229]: No targets found.
Nov 14 09:46:45 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 09:46:45 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-94b99e34-7e1e-4194-ac1b-f55d4c3c730d tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 09:46:45 user nova-compute[75229]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 09:46:45 user nova-compute[75229]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75229) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 09:46:45 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-94b99e34-7e1e-4194-ac1b-f55d4c3c730d tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c2324d4e-6e60-47fd-b536-144a7ea32dce', 0)] {{(pid=75229) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 09:46:45 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:46:45 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.026s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:46:45 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1995689-341d-4ef1-b901-9b29f3f35e98]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:52ae1fea-5339-4958-88ae-d103080e7743\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c2324d4e-6e60-47fd-b536-144a7ea32dce\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c7022511-a003-46d5-bcc1-064be770a829\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e2472759-033a-4051-9dec-4516d0aef07d\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:46:45 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:46:45 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:46:45 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ae6fc6d-a9f7-4e56-a9af-beaff4d43378]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2472759-033a-4051-9dec-4516d0aef07d (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7022511-a003-46d5-bcc1-064be770a829 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52ae1fea-5339-4958-88ae-d103080e7743 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2324d4e-6e60-47fd-b536-144a7ea32dce (non-flash)\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:46:45 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-94b99e34-7e1e-4194-ac1b-f55d4c3c730d tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2472759-033a-4051-9dec-4516d0aef07d (non-flash)
Nov 14 09:46:45 user nova-compute[75229]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7022511-a003-46d5-bcc1-064be770a829 (non-flash)
Nov 14 09:46:45 user nova-compute[75229]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52ae1fea-5339-4958-88ae-d103080e7743 (non-flash)
Nov 14 09:46:45 user nova-compute[75229]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2324d4e-6e60-47fd-b536-144a7ea32dce (non-flash)
Nov 14 09:46:45 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 09:46:45 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-94b99e34-7e1e-4194-ac1b-f55d4c3c730d tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2472759-033a-4051-9dec-4516d0aef07d (non-flash)
Nov 14 09:46:45 user nova-compute[75229]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7022511-a003-46d5-bcc1-064be770a829 (non-flash)
Nov 14 09:46:45 user nova-compute[75229]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52ae1fea-5339-4958-88ae-d103080e7743 (non-flash)
Nov 14 09:46:45 user nova-compute[75229]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2324d4e-6e60-47fd-b536-144a7ea32dce (non-flash)
Nov 14 09:46:45 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 09:46:45 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-94b99e34-7e1e-4194-ac1b-f55d4c3c730d tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f74182da8c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c2324d4e-6e60-47fd-b536-144a7ea32dce'): ({'sdb'}, set())}) {{(pid=75229) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 09:46:45 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-94b99e34-7e1e-4194-ac1b-f55d4c3c730d tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] Removing single pathed devices sdb {{(pid=75229) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 09:46:45 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:46:45 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:46:45 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fe54826-bf24-445a-ac7b-9f9ad658f80c]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:46:45 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:46:45 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:46:45 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[c012af19-38de-4ffd-947a-336f54b88e26]: (4, ('ok\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:46:45 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-94b99e34-7e1e-4194-ac1b-f55d4c3c730d tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] Flushing IO for device /dev/sdb {{(pid=75229) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 09:46:45 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:46:45 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:46:45 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[e233f6cc-b56a-47b1-a50f-670bf4cb3cbd]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:46:45 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-94b99e34-7e1e-4194-ac1b-f55d4c3c730d tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75229) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 09:46:45 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:46:45 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.043s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:46:45 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d0cd478-6dd0-4d6d-afaa-a09812ee9ebf]: (4, ('1', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:46:45 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-94b99e34-7e1e-4194-ac1b-f55d4c3c730d tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75229) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 09:46:45 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-94b99e34-7e1e-4194-ac1b-f55d4c3c730d tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] SCSI volumes sdb have been removed. {{(pid=75229) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 09:46:45 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-94b99e34-7e1e-4194-ac1b-f55d4c3c730d tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c2324d4e-6e60-47fd-b536-144a7ea32dce')] {{(pid=75229) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 09:46:45 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb53ba25-d865-41ae-90f3-6e154e2778ba/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:46:45 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2324d4e-6e60-47fd-b536-144a7ea32dce -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:46:45 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2324d4e-6e60-47fd-b536-144a7ea32dce -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:46:45 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[70594294-32b7-4ecb-ab9e-a0b2d4724428]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:46:45 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-94b99e34-7e1e-4194-ac1b-f55d4c3c730d tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:46:45 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2324d4e-6e60-47fd-b536-144a7ea32dce -p 172.16.0.220:3260 --logout {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:46:45 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:46:45 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2324d4e-6e60-47fd-b536-144a7ea32dce -p 172.16.0.220:3260 --logout" returned: 0 in 0.080s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:46:45 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cb95359-b226-47be-a104-986b6954be0e]: (4, ('Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:c2324d4e-6e60-47fd-b536-144a7ea32dce, portal: 172.16.0.220,3260]\nLogout of [sid: 2, target: iqn.2010-10.org.openstack:c2324d4e-6e60-47fd-b536-144a7ea32dce, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:46:45 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-94b99e34-7e1e-4194-ac1b-f55d4c3c730d tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:c2324d4e-6e60-47fd-b536-144a7ea32dce, portal: 172.16.0.220,3260]
Nov 14 09:46:45 user nova-compute[75229]: Logout of [sid: 2, target: iqn.2010-10.org.openstack:c2324d4e-6e60-47fd-b536-144a7ea32dce, portal: 172.16.0.220,3260] successful.
Nov 14 09:46:45 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:46:45 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2324d4e-6e60-47fd-b536-144a7ea32dce -p 172.16.0.220:3260 --op delete {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:46:45 user nova-compute[75229]: DEBUG nova.virt.libvirt.guest [None req-14541822-20a0-4fb4-a231-073f47febc6d tempest-TestVolumeSwap-1816306665 tempest-TestVolumeSwap-1816306665-project-admin] COPY block job progress, current cursor: 176160768 final cursor: 1073741824 {{(pid=75229) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 09:46:45 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2324d4e-6e60-47fd-b536-144a7ea32dce -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:46:45 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[d93c3b78-4c1e-4380-8cea-b4c146b37115]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:46:45 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-94b99e34-7e1e-4194-ac1b-f55d4c3c730d tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:46:45 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-94b99e34-7e1e-4194-ac1b-f55d4c3c730d tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.396s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 09:46:45 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-94b99e34-7e1e-4194-ac1b-f55d4c3c730d tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] <== disconnect_volume: return (713ms) None {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 09:46:45 user nova-compute[75229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-94b99e34-7e1e-4194-ac1b-f55d4c3c730d tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] [instance: af5fd5af-63a6-4eee-a4ef-6088a3713214] Disconnected iSCSI Volume {{(pid=75229) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 09:46:45 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-94b99e34-7e1e-4194-ac1b-f55d4c3c730d tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] [instance: af5fd5af-63a6-4eee-a4ef-6088a3713214] Deleting instance files /opt/stack/data/nova/instances/af5fd5af-63a6-4eee-a4ef-6088a3713214_del
Nov 14 09:46:45 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-94b99e34-7e1e-4194-ac1b-f55d4c3c730d tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] [instance: af5fd5af-63a6-4eee-a4ef-6088a3713214] Deletion of /opt/stack/data/nova/instances/af5fd5af-63a6-4eee-a4ef-6088a3713214_del complete
Nov 14 09:46:45 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb53ba25-d865-41ae-90f3-6e154e2778ba/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:46:45 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb53ba25-d865-41ae-90f3-6e154e2778ba/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:46:45 user nova-compute[75229]: INFO nova.compute.manager [None req-94b99e34-7e1e-4194-ac1b-f55d4c3c730d tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] [instance: af5fd5af-63a6-4eee-a4ef-6088a3713214] Took 5.15 seconds to destroy the instance on the hypervisor.
Nov 14 09:46:45 user nova-compute[75229]: DEBUG oslo.service.loopingcall [None req-94b99e34-7e1e-4194-ac1b-f55d4c3c730d tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75229) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 09:46:45 user nova-compute[75229]: DEBUG nova.compute.manager [-] [instance: af5fd5af-63a6-4eee-a4ef-6088a3713214] Deallocating network for instance {{(pid=75229) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 09:46:45 user nova-compute[75229]: DEBUG nova.network.neutron [-] [instance: af5fd5af-63a6-4eee-a4ef-6088a3713214] deallocate_for_instance() {{(pid=75229) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 09:46:46 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb53ba25-d865-41ae-90f3-6e154e2778ba/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:46:46 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7750cbc-b3d0-44aa-8b88-c291ba007a8a/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:46:46 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:46:46 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7750cbc-b3d0-44aa-8b88-c291ba007a8a/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:46:46 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7750cbc-b3d0-44aa-8b88-c291ba007a8a/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:46:46 user nova-compute[75229]: DEBUG nova.virt.libvirt.guest [None req-14541822-20a0-4fb4-a231-073f47febc6d tempest-TestVolumeSwap-1816306665 tempest-TestVolumeSwap-1816306665-project-admin] COPY block job progress, current cursor: 316669952 final cursor: 1073741824 {{(pid=75229) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 09:46:46 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7750cbc-b3d0-44aa-8b88-c291ba007a8a/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:46:46 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a60d339f-e134-477c-8505-bf8c79d2a21c/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:46:46 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a60d339f-e134-477c-8505-bf8c79d2a21c/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:46:46 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a60d339f-e134-477c-8505-bf8c79d2a21c/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:46:46 user nova-compute[75229]: DEBUG nova.objects.instance [None req-afde6df1-6d68-4670-9fb4-d8da73363148 tempest-TaggedAttachmentsTest-294727221 tempest-TaggedAttachmentsTest-294727221-project-member] Lazy-loading 'flavor' on Instance uuid c6fa2298-7111-4660-a162-09269045d5e3 {{(pid=75229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 09:46:46 user nova-compute[75229]: DEBUG nova.virt.libvirt.guest [None req-14541822-20a0-4fb4-a231-073f47febc6d tempest-TestVolumeSwap-1816306665 tempest-TestVolumeSwap-1816306665-project-admin] COPY block job progress, current cursor: 469762048 final cursor: 1073741824 {{(pid=75229) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 09:46:46 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a60d339f-e134-477c-8505-bf8c79d2a21c/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:46:46 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6fa2298-7111-4660-a162-09269045d5e3/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:46:47 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-afde6df1-6d68-4670-9fb4-d8da73363148 tempest-TaggedAttachmentsTest-294727221 tempest-TaggedAttachmentsTest-294727221-project-member] Lock "c6fa2298-7111-4660-a162-09269045d5e3" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 23.851s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:46:47 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6fa2298-7111-4660-a162-09269045d5e3/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:46:47 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6fa2298-7111-4660-a162-09269045d5e3/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:46:47 user nova-compute[75229]: DEBUG nova.virt.libvirt.guest [None req-14541822-20a0-4fb4-a231-073f47febc6d tempest-TestVolumeSwap-1816306665 tempest-TestVolumeSwap-1816306665-project-admin] COPY block job progress, current cursor: 654311424 final cursor: 1073741824 {{(pid=75229) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 09:46:47 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6fa2298-7111-4660-a162-09269045d5e3/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:46:47 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e09b3809-2e23-401c-9a72-88feb2bb657c/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:46:47 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e09b3809-2e23-401c-9a72-88feb2bb657c/disk --force-share --output=json" returned: 0 in 0.239s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:46:47 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e09b3809-2e23-401c-9a72-88feb2bb657c/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:46:47 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:46:47 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-8878bf82-dd59-4b10-948d-38eefab3cf0d tempest-TaggedAttachmentsTest-294727221 tempest-TaggedAttachmentsTest-294727221-project-member] Acquiring lock "interface-c6fa2298-7111-4660-a162-09269045d5e3-1c95e48f-ad0e-41b2-8638-ddefc9360154" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:46:47 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-8878bf82-dd59-4b10-948d-38eefab3cf0d tempest-TaggedAttachmentsTest-294727221 tempest-TaggedAttachmentsTest-294727221-project-member] Lock "interface-c6fa2298-7111-4660-a162-09269045d5e3-1c95e48f-ad0e-41b2-8638-ddefc9360154" acquired by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:46:47 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e09b3809-2e23-401c-9a72-88feb2bb657c/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:46:47 user nova-compute[75229]: DEBUG nova.virt.libvirt.guest [None req-14541822-20a0-4fb4-a231-073f47febc6d tempest-TestVolumeSwap-1816306665 tempest-TestVolumeSwap-1816306665-project-admin] COPY block job progress, current cursor: 824180736 final cursor: 1073741824 {{(pid=75229) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 09:46:47 user nova-compute[75229]: DEBUG nova.objects.instance [None req-8878bf82-dd59-4b10-948d-38eefab3cf0d tempest-TaggedAttachmentsTest-294727221 tempest-TaggedAttachmentsTest-294727221-project-member] Lazy-loading 'flavor' on Instance uuid c6fa2298-7111-4660-a162-09269045d5e3 {{(pid=75229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 09:46:47 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8623fdcc-99b7-44d6-ad81-dada5ba83a88/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:46:47 user nova-compute[75229]: DEBUG nova.virt.libvirt.vif [None req-8878bf82-dd59-4b10-948d-38eefab3cf0d tempest-TaggedAttachmentsTest-294727221 tempest-TaggedAttachmentsTest-294727221-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T09:44:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-685697079',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-685697079',id=8,image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAifCLOp7slCaJ90vuibP3D+iXI5GZCQPZCKwFW7R+vCvd5TEqQRxmD+LKPc4egtvjclTc91I+Ts0vc0Y63gnivit1SN7n4OIcVVjbAdupwqjax2fqD52aMGKY+5S2775A==',key_name='tempest-keypair-1995790410',keypairs=<?>,launch_index=0,launched_at=2023-11-14T09:44:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='48b5edeee7494b6e94135faaab6afd50',ramdisk_id='',reservation_id='r-xsfhi8mn',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-294727221',owner_user_name='tempest-TaggedAttachmentsTest-294727221-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T09:44:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3c818850ce5c41b5b978031cdedfea65',uuid=c6fa2298-7111-4660-a162-09269045d5e3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1c95e48f-ad0e-41b2-8638-ddefc9360154", "address": "fa:16:3e:64:36:66", "network": {"id": "843bda3e-9929-4282-9fa6-ed93ebd7afcd", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1455996506", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.228", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "48b5edeee7494b6e94135faaab6afd50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c95e48f-ad", "ovs_interfaceid": "1c95e48f-ad0e-41b2-8638-ddefc9360154", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75229) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 09:46:47 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-8878bf82-dd59-4b10-948d-38eefab3cf0d tempest-TaggedAttachmentsTest-294727221 tempest-TaggedAttachmentsTest-294727221-project-member] Converting VIF {"id": "1c95e48f-ad0e-41b2-8638-ddefc9360154", "address": "fa:16:3e:64:36:66", "network": {"id": "843bda3e-9929-4282-9fa6-ed93ebd7afcd", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1455996506", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.228", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "48b5edeee7494b6e94135faaab6afd50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c95e48f-ad", "ovs_interfaceid": "1c95e48f-ad0e-41b2-8638-ddefc9360154", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 09:46:47 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-8878bf82-dd59-4b10-948d-38eefab3cf0d tempest-TaggedAttachmentsTest-294727221 tempest-TaggedAttachmentsTest-294727221-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:64:36:66,bridge_name='br-int',has_traffic_filtering=True,id=1c95e48f-ad0e-41b2-8638-ddefc9360154,network=Network(843bda3e-9929-4282-9fa6-ed93ebd7afcd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1c95e48f-ad') {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 09:46:48 user nova-compute[75229]: DEBUG nova.virt.libvirt.guest [None req-8878bf82-dd59-4b10-948d-38eefab3cf0d tempest-TaggedAttachmentsTest-294727221 tempest-TaggedAttachmentsTest-294727221-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:64:36:66"/><model type="virtio"/><mtu size="1442"/><target dev="tap1c95e48f-ad"/></interface> {{(pid=75229) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 14 09:46:48 user nova-compute[75229]: DEBUG nova.virt.libvirt.guest [None req-8878bf82-dd59-4b10-948d-38eefab3cf0d tempest-TaggedAttachmentsTest-294727221 tempest-TaggedAttachmentsTest-294727221-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:64:36:66"/><model type="virtio"/><mtu size="1442"/><target dev="tap1c95e48f-ad"/></interface> {{(pid=75229) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 14 09:46:48 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-8878bf82-dd59-4b10-948d-38eefab3cf0d tempest-TaggedAttachmentsTest-294727221 tempest-TaggedAttachmentsTest-294727221-project-member] Attempting to detach device tap1c95e48f-ad from instance c6fa2298-7111-4660-a162-09269045d5e3 from the persistent domain config. {{(pid=75229) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 09:46:48 user nova-compute[75229]: DEBUG nova.virt.libvirt.guest [None req-8878bf82-dd59-4b10-948d-38eefab3cf0d tempest-TaggedAttachmentsTest-294727221 tempest-TaggedAttachmentsTest-294727221-project-member] detach device xml: <interface type="ethernet">
Nov 14 09:46:48 user nova-compute[75229]:   <mac address="fa:16:3e:64:36:66"/>
Nov 14 09:46:48 user nova-compute[75229]:   <model type="virtio"/>
Nov 14 09:46:48 user nova-compute[75229]:   <mtu size="1442"/>
Nov 14 09:46:48 user nova-compute[75229]:   <target dev="tap1c95e48f-ad"/>
Nov 14 09:46:48 user nova-compute[75229]: </interface>
Nov 14 09:46:48 user nova-compute[75229]:  {{(pid=75229) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 09:46:48 user nova-compute[75229]: DEBUG nova.virt.libvirt.guest [None req-8878bf82-dd59-4b10-948d-38eefab3cf0d tempest-TaggedAttachmentsTest-294727221 tempest-TaggedAttachmentsTest-294727221-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:64:36:66"/><model type="virtio"/><mtu size="1442"/><target dev="tap1c95e48f-ad"/></interface> {{(pid=75229) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 14 09:46:48 user nova-compute[75229]: DEBUG nova.virt.libvirt.guest [None req-8878bf82-dd59-4b10-948d-38eefab3cf0d tempest-TaggedAttachmentsTest-294727221 tempest-TaggedAttachmentsTest-294727221-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:64:36:66"/><model type="virtio"/><mtu size="1442"/><target dev="tap1c95e48f-ad"/></interface>not found in domain: <domain type='kvm' id='8'>
Nov 14 09:46:48 user nova-compute[75229]:   <name>instance-00000008</name>
Nov 14 09:46:48 user nova-compute[75229]:   <uuid>c6fa2298-7111-4660-a162-09269045d5e3</uuid>
Nov 14 09:46:48 user nova-compute[75229]:   <metadata>
Nov 14 09:46:48 user nova-compute[75229]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 09:46:48 user nova-compute[75229]:   <nova:package version="0.0.0"/>
Nov 14 09:46:48 user nova-compute[75229]:   <nova:name>tempest-device-tagging-server-685697079</nova:name>
Nov 14 09:46:48 user nova-compute[75229]:   <nova:creationTime>2023-11-14 09:46:15</nova:creationTime>
Nov 14 09:46:48 user nova-compute[75229]:   <nova:flavor name="m1.tiny">
Nov 14 09:46:48 user nova-compute[75229]:     <nova:memory>512</nova:memory>
Nov 14 09:46:48 user nova-compute[75229]:     <nova:disk>1</nova:disk>
Nov 14 09:46:48 user nova-compute[75229]:     <nova:swap>0</nova:swap>
Nov 14 09:46:48 user nova-compute[75229]:     <nova:ephemeral>0</nova:ephemeral>
Nov 14 09:46:48 user nova-compute[75229]:     <nova:vcpus>1</nova:vcpus>
Nov 14 09:46:48 user nova-compute[75229]:   </nova:flavor>
Nov 14 09:46:48 user nova-compute[75229]:   <nova:owner>
Nov 14 09:46:48 user nova-compute[75229]:     <nova:user uuid="3c818850ce5c41b5b978031cdedfea65">tempest-TaggedAttachmentsTest-294727221-project-member</nova:user>
Nov 14 09:46:48 user nova-compute[75229]:     <nova:project uuid="48b5edeee7494b6e94135faaab6afd50">tempest-TaggedAttachmentsTest-294727221</nova:project>
Nov 14 09:46:48 user nova-compute[75229]:   </nova:owner>
Nov 14 09:46:48 user nova-compute[75229]:   <nova:root type="image" uuid="3bef8470-ecc7-40e3-95d4-9254348ea72d"/>
Nov 14 09:46:48 user nova-compute[75229]:   <nova:ports>
Nov 14 09:46:48 user nova-compute[75229]:     <nova:port uuid="b310b3f2-f842-4918-8540-f9803e259b31">
Nov 14 09:46:48 user nova-compute[75229]:       <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 14 09:46:48 user nova-compute[75229]:     </nova:port>
Nov 14 09:46:48 user nova-compute[75229]:     <nova:port uuid="1c95e48f-ad0e-41b2-8638-ddefc9360154">
Nov 14 09:46:48 user nova-compute[75229]:       <nova:ip type="fixed" address="10.10.10.228" ipVersion="4"/>
Nov 14 09:46:48 user nova-compute[75229]:     </nova:port>
Nov 14 09:46:48 user nova-compute[75229]:   </nova:ports>
Nov 14 09:46:48 user nova-compute[75229]: </nova:instance>
Nov 14 09:46:48 user nova-compute[75229]:   </metadata>
Nov 14 09:46:48 user nova-compute[75229]:   <memory unit='KiB'>524288</memory>
Nov 14 09:46:48 user nova-compute[75229]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 14 09:46:48 user nova-compute[75229]:   <vcpu placement='static'>1</vcpu>
Nov 14 09:46:48 user nova-compute[75229]:   <resource>
Nov 14 09:46:48 user nova-compute[75229]:     <partition>/machine</partition>
Nov 14 09:46:48 user nova-compute[75229]:   </resource>
Nov 14 09:46:48 user nova-compute[75229]:   <sysinfo type='smbios'>
Nov 14 09:46:48 user nova-compute[75229]:     <system>
Nov 14 09:46:48 user nova-compute[75229]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 14 09:46:48 user nova-compute[75229]:       <entry name='product'>OpenStack Nova</entry>
Nov 14 09:46:48 user nova-compute[75229]:       <entry name='version'>0.0.0</entry>
Nov 14 09:46:48 user nova-compute[75229]:       <entry name='serial'>c6fa2298-7111-4660-a162-09269045d5e3</entry>
Nov 14 09:46:48 user nova-compute[75229]:       <entry name='uuid'>c6fa2298-7111-4660-a162-09269045d5e3</entry>
Nov 14 09:46:48 user nova-compute[75229]:       <entry name='family'>Virtual Machine</entry>
Nov 14 09:46:48 user nova-compute[75229]:     </system>
Nov 14 09:46:48 user nova-compute[75229]:   </sysinfo>
Nov 14 09:46:48 user nova-compute[75229]:   <os>
Nov 14 09:46:48 user nova-compute[75229]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 14 09:46:48 user nova-compute[75229]:     <boot dev='hd'/>
Nov 14 09:46:48 user nova-compute[75229]:     <smbios mode='sysinfo'/>
Nov 14 09:46:48 user nova-compute[75229]:   </os>
Nov 14 09:46:48 user nova-compute[75229]:   <features>
Nov 14 09:46:48 user nova-compute[75229]:     <acpi/>
Nov 14 09:46:48 user nova-compute[75229]:     <apic/>
Nov 14 09:46:48 user nova-compute[75229]:     <vmcoreinfo state='on'/>
Nov 14 09:46:48 user nova-compute[75229]:   </features>
Nov 14 09:46:48 user nova-compute[75229]:   <cpu mode='custom' match='exact' check='full'>
Nov 14 09:46:48 user nova-compute[75229]:     <model fallback='forbid'>Nehalem</model>
Nov 14 09:46:48 user nova-compute[75229]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 14 09:46:48 user nova-compute[75229]:     <feature policy='require' name='vme'/>
Nov 14 09:46:48 user nova-compute[75229]:     <feature policy='require' name='x2apic'/>
Nov 14 09:46:48 user nova-compute[75229]:     <feature policy='require' name='hypervisor'/>
Nov 14 09:46:48 user nova-compute[75229]:   </cpu>
Nov 14 09:46:48 user nova-compute[75229]:   <clock offset='utc'>
Nov 14 09:46:48 user nova-compute[75229]:     <timer name='pit' tickpolicy='delay'/>
Nov 14 09:46:48 user nova-compute[75229]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 14 09:46:48 user nova-compute[75229]:     <timer name='hpet' present='no'/>
Nov 14 09:46:48 user nova-compute[75229]:   </clock>
Nov 14 09:46:48 user nova-compute[75229]:   <on_poweroff>destroy</on_poweroff>
Nov 14 09:46:48 user nova-compute[75229]:   <on_reboot>restart</on_reboot>
Nov 14 09:46:48 user nova-compute[75229]:   <on_crash>destroy</on_crash>
Nov 14 09:46:48 user nova-compute[75229]:   <devices>
Nov 14 09:46:48 user nova-compute[75229]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 14 09:46:48 user nova-compute[75229]:     <disk type='file' device='disk'>
Nov 14 09:46:48 user nova-compute[75229]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 14 09:46:48 user nova-compute[75229]:       <source file='/opt/stack/data/nova/instances/c6fa2298-7111-4660-a162-09269045d5e3/disk' index='2'/>
Nov 14 09:46:48 user nova-compute[75229]:       <backingStore type='file' index='3'>
Nov 14 09:46:48 user nova-compute[75229]:         <format type='raw'/>
Nov 14 09:46:48 user nova-compute[75229]:         <source file='/opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6'/>
Nov 14 09:46:48 user nova-compute[75229]:         <backingStore/>
Nov 14 09:46:48 user nova-compute[75229]:       </backingStore>
Nov 14 09:46:48 user nova-compute[75229]:       <target dev='vda' bus='virtio'/>
Nov 14 09:46:48 user nova-compute[75229]:       <alias name='virtio-disk0'/>
Nov 14 09:46:48 user nova-compute[75229]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 14 09:46:48 user nova-compute[75229]:     </disk>
Nov 14 09:46:48 user nova-compute[75229]:     <disk type='file' device='cdrom'>
Nov 14 09:46:48 user nova-compute[75229]:       <driver name='qemu' type='raw' cache='none'/>
Nov 14 09:46:48 user nova-compute[75229]:       <source file='/opt/stack/data/nova/instances/c6fa2298-7111-4660-a162-09269045d5e3/disk.config' index='1'/>
Nov 14 09:46:48 user nova-compute[75229]:       <backingStore/>
Nov 14 09:46:48 user nova-compute[75229]:       <target dev='hda' bus='ide'/>
Nov 14 09:46:48 user nova-compute[75229]:       <readonly/>
Nov 14 09:46:48 user nova-compute[75229]:       <alias name='ide0-0-0'/>
Nov 14 09:46:48 user nova-compute[75229]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 14 09:46:48 user nova-compute[75229]:     </disk>
Nov 14 09:46:48 user nova-compute[75229]:     <controller type='usb' index='0' model='none'>
Nov 14 09:46:48 user nova-compute[75229]:       <alias name='usb'/>
Nov 14 09:46:48 user nova-compute[75229]:     </controller>
Nov 14 09:46:48 user nova-compute[75229]:     <controller type='pci' index='0' model='pci-root'>
Nov 14 09:46:48 user nova-compute[75229]:       <alias name='pci.0'/>
Nov 14 09:46:48 user nova-compute[75229]:     </controller>
Nov 14 09:46:48 user nova-compute[75229]:     <controller type='ide' index='0'>
Nov 14 09:46:48 user nova-compute[75229]:       <alias name='ide'/>
Nov 14 09:46:48 user nova-compute[75229]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 14 09:46:48 user nova-compute[75229]:     </controller>
Nov 14 09:46:48 user nova-compute[75229]:     <interface type='ethernet'>
Nov 14 09:46:48 user nova-compute[75229]:       <mac address='fa:16:3e:90:0c:ec'/>
Nov 14 09:46:48 user nova-compute[75229]:       <target dev='tapb310b3f2-f8'/>
Nov 14 09:46:48 user nova-compute[75229]:       <model type='virtio'/>
Nov 14 09:46:48 user nova-compute[75229]:       <mtu size='1442'/>
Nov 14 09:46:48 user nova-compute[75229]:       <alias name='net0'/>
Nov 14 09:46:48 user nova-compute[75229]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 14 09:46:48 user nova-compute[75229]:     </interface>
Nov 14 09:46:48 user nova-compute[75229]:     <interface type='ethernet'>
Nov 14 09:46:48 user nova-compute[75229]:       <mac address='fa:16:3e:64:36:66'/>
Nov 14 09:46:48 user nova-compute[75229]:       <target dev='tap1c95e48f-ad'/>
Nov 14 09:46:48 user nova-compute[75229]:       <model type='virtio'/>
Nov 14 09:46:48 user nova-compute[75229]:       <mtu size='1442'/>
Nov 14 09:46:48 user nova-compute[75229]:       <alias name='net1'/>
Nov 14 09:46:48 user nova-compute[75229]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/>
Nov 14 09:46:48 user nova-compute[75229]:     </interface>
Nov 14 09:46:48 user nova-compute[75229]:     <serial type='pty'>
Nov 14 09:46:48 user nova-compute[75229]:       <source path='/dev/pts/7'/>
Nov 14 09:46:48 user nova-compute[75229]:       <log file='/opt/stack/data/nova/instances/c6fa2298-7111-4660-a162-09269045d5e3/console.log' append='off'/>
Nov 14 09:46:48 user nova-compute[75229]:       <target type='isa-serial' port='0'>
Nov 14 09:46:48 user nova-compute[75229]:         <model name='isa-serial'/>
Nov 14 09:46:48 user nova-compute[75229]:       </target>
Nov 14 09:46:48 user nova-compute[75229]:       <alias name='serial0'/>
Nov 14 09:46:48 user nova-compute[75229]:     </serial>
Nov 14 09:46:48 user nova-compute[75229]:     <console type='pty' tty='/dev/pts/7'>
Nov 14 09:46:48 user nova-compute[75229]:       <source path='/dev/pts/7'/>
Nov 14 09:46:48 user nova-compute[75229]:       <log file='/opt/stack/data/nova/instances/c6fa2298-7111-4660-a162-09269045d5e3/console.log' append='off'/>
Nov 14 09:46:48 user nova-compute[75229]:       <target type='serial' port='0'/>
Nov 14 09:46:48 user nova-compute[75229]:       <alias name='serial0'/>
Nov 14 09:46:48 user nova-compute[75229]:     </console>
Nov 14 09:46:48 user nova-compute[75229]:     <input type='mouse' bus='ps2'>
Nov 14 09:46:48 user nova-compute[75229]:       <alias name='input0'/>
Nov 14 09:46:48 user nova-compute[75229]:     </input>
Nov 14 09:46:48 user nova-compute[75229]:     <input type='keyboard' bus='ps2'>
Nov 14 09:46:48 user nova-compute[75229]:       <alias name='input1'/>
Nov 14 09:46:48 user nova-compute[75229]:     </input>
Nov 14 09:46:48 user nova-compute[75229]:     <graphics type='vnc' port='5907' autoport='yes' listen='0.0.0.0'>
Nov 14 09:46:48 user nova-compute[75229]:       <listen type='address' address='0.0.0.0'/>
Nov 14 09:46:48 user nova-compute[75229]:     </graphics>
Nov 14 09:46:48 user nova-compute[75229]:     <audio id='1' type='none'/>
Nov 14 09:46:48 user nova-compute[75229]:     <video>
Nov 14 09:46:48 user nova-compute[75229]:       <model type='virtio' heads='1' primary='yes'/>
Nov 14 09:46:48 user nova-compute[75229]:       <alias name='video0'/>
Nov 14 09:46:48 user nova-compute[75229]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 14 09:46:48 user nova-compute[75229]:     </video>
Nov 14 09:46:48 user nova-compute[75229]:     <memballoon model='virtio'>
Nov 14 09:46:48 user nova-compute[75229]:       <stats period='10'/>
Nov 14 09:46:48 user nova-compute[75229]:       <alias name='balloon0'/>
Nov 14 09:46:48 user nova-compute[75229]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 14 09:46:48 user nova-compute[75229]:     </memballoon>
Nov 14 09:46:48 user nova-compute[75229]:     <rng model='virtio'>
Nov 14 09:46:48 user nova-compute[75229]:       <backend model='random'>/dev/urandom</backend>
Nov 14 09:46:48 user nova-compute[75229]:       <alias name='rng0'/>
Nov 14 09:46:48 user nova-compute[75229]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 14 09:46:48 user nova-compute[75229]:     </rng>
Nov 14 09:46:48 user nova-compute[75229]:   </devices>
Nov 14 09:46:48 user nova-compute[75229]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 14 09:46:48 user nova-compute[75229]:     <label>libvirt-c6fa2298-7111-4660-a162-09269045d5e3</label>
Nov 14 09:46:48 user nova-compute[75229]:     <imagelabel>libvirt-c6fa2298-7111-4660-a162-09269045d5e3</imagelabel>
Nov 14 09:46:48 user nova-compute[75229]:   </seclabel>
Nov 14 09:46:48 user nova-compute[75229]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 14 09:46:48 user nova-compute[75229]:     <label>+64055:+108</label>
Nov 14 09:46:48 user nova-compute[75229]:     <imagelabel>+64055:+108</imagelabel>
Nov 14 09:46:48 user nova-compute[75229]:   </seclabel>
Nov 14 09:46:48 user nova-compute[75229]: </domain>
Nov 14 09:46:48 user nova-compute[75229]:  {{(pid=75229) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 14 09:46:48 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-8878bf82-dd59-4b10-948d-38eefab3cf0d tempest-TaggedAttachmentsTest-294727221 tempest-TaggedAttachmentsTest-294727221-project-member] Successfully detached device tap1c95e48f-ad from instance c6fa2298-7111-4660-a162-09269045d5e3 from the persistent domain config.
Nov 14 09:46:48 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-8878bf82-dd59-4b10-948d-38eefab3cf0d tempest-TaggedAttachmentsTest-294727221 tempest-TaggedAttachmentsTest-294727221-project-member] (1/8): Attempting to detach device tap1c95e48f-ad with device alias net1 from instance c6fa2298-7111-4660-a162-09269045d5e3 from the live domain config. {{(pid=75229) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 09:46:48 user nova-compute[75229]: DEBUG nova.virt.libvirt.guest [None req-8878bf82-dd59-4b10-948d-38eefab3cf0d tempest-TaggedAttachmentsTest-294727221 tempest-TaggedAttachmentsTest-294727221-project-member] detach device xml: <interface type="ethernet">
Nov 14 09:46:48 user nova-compute[75229]:   <mac address="fa:16:3e:64:36:66"/>
Nov 14 09:46:48 user nova-compute[75229]:   <model type="virtio"/>
Nov 14 09:46:48 user nova-compute[75229]:   <mtu size="1442"/>
Nov 14 09:46:48 user nova-compute[75229]:   <target dev="tap1c95e48f-ad"/>
Nov 14 09:46:48 user nova-compute[75229]: </interface>
Nov 14 09:46:48 user nova-compute[75229]:  {{(pid=75229) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 09:46:48 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:46:48 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8623fdcc-99b7-44d6-ad81-dada5ba83a88/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:46:48 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8623fdcc-99b7-44d6-ad81-dada5ba83a88/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:46:48 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:46:48 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:46:48 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8623fdcc-99b7-44d6-ad81-dada5ba83a88/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:46:48 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-8878bf82-dd59-4b10-948d-38eefab3cf0d tempest-TaggedAttachmentsTest-294727221 tempest-TaggedAttachmentsTest-294727221-project-member] Start waiting for the detach event from libvirt for device tap1c95e48f-ad with device alias net1 for instance c6fa2298-7111-4660-a162-09269045d5e3 {{(pid=75229) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 09:46:48 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c307660b-01bb-471b-9e2e-5c2aaca65287/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:46:48 user nova-compute[75229]: DEBUG nova.compute.manager [req-b107708b-df4c-4d43-9c7e-af8628cdab99 req-0459687a-d61f-447a-a446-6ade0038846a service nova] [instance: af5fd5af-63a6-4eee-a4ef-6088a3713214] Received event network-vif-deleted-1f37d277-e3ac-48ca-b618-27b872f41824 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:46:48 user nova-compute[75229]: INFO nova.compute.manager [req-b107708b-df4c-4d43-9c7e-af8628cdab99 req-0459687a-d61f-447a-a446-6ade0038846a service nova] [instance: af5fd5af-63a6-4eee-a4ef-6088a3713214] Neutron deleted interface 1f37d277-e3ac-48ca-b618-27b872f41824; detaching it from the instance and deleting it from the info cache
Nov 14 09:46:48 user nova-compute[75229]: DEBUG nova.network.neutron [req-b107708b-df4c-4d43-9c7e-af8628cdab99 req-0459687a-d61f-447a-a446-6ade0038846a service nova] [instance: af5fd5af-63a6-4eee-a4ef-6088a3713214] Updating instance_info_cache with network_info: [{"id": "a1999f33-4f1d-47b0-a91a-48bce4600e9b", "address": "fa:16:3e:d9:f9:d0", "network": {"id": "a4d3d0e0-1dec-40de-a03f-4241b910cf16", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-380540777-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a9197db757f4a1cafd571eef8d47b15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1999f33-4f", "ovs_interfaceid": "a1999f33-4f1d-47b0-a91a-48bce4600e9b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2f37eb91-97ea-477b-b6c1-933b50ccfca6", "address": "fa:16:3e:1b:33:6b", "network": {"id": "4176f9ca-0910-416d-99e3-a8156bd87229", "bridge": "br-int", "label": "tempest-device-tagging-net1-45180450", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.34", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6a9197db757f4a1cafd571eef8d47b15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f37eb91-97", "ovs_interfaceid": "2f37eb91-97ea-477b-b6c1-933b50ccfca6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f8dc5389-6e53-421a-9a3a-6c90a89a6eb2", "address": "fa:16:3e:69:0d:d2", "network": {"id": "4176f9ca-0910-416d-99e3-a8156bd87229", "bridge": "br-int", "label": "tempest-device-tagging-net1-45180450", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.210", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6a9197db757f4a1cafd571eef8d47b15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8dc5389-6e", "ovs_interfaceid": "f8dc5389-6e53-421a-9a3a-6c90a89a6eb2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0979136b-2418-4434-9466-75d116e8c780", "address": "fa:16:3e:4d:a2:e0", "network": {"id": "4176f9ca-0910-416d-99e3-a8156bd87229", "bridge": "br-int", "label": "tempest-device-tagging-net1-45180450", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.156", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6a9197db757f4a1cafd571eef8d47b15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0979136b-24", "ovs_interfaceid": "0979136b-2418-4434-9466-75d116e8c780", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "768a662a-4bcd-4844-a9ed-f8b8f6b8aa0d", "address": "fa:16:3e:10:aa:95", "network": {"id": "0f777eef-d2ac-43b9-bbef-4f075e98903f", "bridge": "br-int", "label": "tempest-device-tagging-net2-1010361890", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "6a9197db757f4a1cafd571eef8d47b15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap768a662a-4b", "ovs_interfaceid": "768a662a-4bcd-4844-a9ed-f8b8f6b8aa0d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b7fff2b1-9f14-4632-83e2-3f0a8e4c788b", "address": "fa:16:3e:68:f2:55", "network": {"id": "0f777eef-d2ac-43b9-bbef-4f075e98903f", "bridge": "br-int", "label": "tempest-device-tagging-net2-1010361890", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "6a9197db757f4a1cafd571eef8d47b15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7fff2b1-9f", "ovs_interfaceid": "b7fff2b1-9f14-4632-83e2-3f0a8e4c788b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 09:46:48 user nova-compute[75229]: DEBUG nova.virt.libvirt.guest [None req-14541822-20a0-4fb4-a231-073f47febc6d tempest-TestVolumeSwap-1816306665 tempest-TestVolumeSwap-1816306665-project-admin] COPY block job progress, current cursor: 1001390080 final cursor: 1073741824 {{(pid=75229) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 09:46:48 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:46:48 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:46:48 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:46:48 user nova-compute[75229]: DEBUG nova.compute.manager [req-b107708b-df4c-4d43-9c7e-af8628cdab99 req-0459687a-d61f-447a-a446-6ade0038846a service nova] [instance: af5fd5af-63a6-4eee-a4ef-6088a3713214] Detach interface failed, port_id=1f37d277-e3ac-48ca-b618-27b872f41824, reason: Instance af5fd5af-63a6-4eee-a4ef-6088a3713214 could not be found. {{(pid=75229) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 14 09:46:48 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c307660b-01bb-471b-9e2e-5c2aaca65287/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:46:48 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c307660b-01bb-471b-9e2e-5c2aaca65287/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:46:48 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c307660b-01bb-471b-9e2e-5c2aaca65287/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:46:48 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75229) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 09:46:48 user nova-compute[75229]: WARNING nova.virt.libvirt.driver [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Error from libvirt while getting description of instance-0000000c: [Error Code 42] Domain not found: no domain with matching uuid 'af5fd5af-63a6-4eee-a4ef-6088a3713214' (instance-0000000c): libvirt.libvirtError: Domain not found: no domain with matching uuid 'af5fd5af-63a6-4eee-a4ef-6088a3713214' (instance-0000000c)
Nov 14 09:46:49 user nova-compute[75229]: DEBUG nova.virt.libvirt.guest [None req-14541822-20a0-4fb4-a231-073f47febc6d tempest-TestVolumeSwap-1816306665 tempest-TestVolumeSwap-1816306665-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=75229) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 09:46:49 user nova-compute[75229]: WARNING nova.virt.libvirt.driver [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 09:46:49 user nova-compute[75229]: WARNING nova.virt.libvirt.driver [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 09:46:49 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Hypervisor/Node resource view: name=user free_ram=7611MB free_disk=25.54345703125GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75229) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 09:46:49 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:46:49 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:46:49 user nova-compute[75229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-14541822-20a0-4fb4-a231-073f47febc6d tempest-TestVolumeSwap-1816306665 tempest-TestVolumeSwap-1816306665-project-admin] [instance: c307660b-01bb-471b-9e2e-5c2aaca65287] calling os-brick to detach iSCSI Volume {{(pid=75229) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 09:46:49 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-14541822-20a0-4fb4-a231-073f47febc6d tempest-TestVolumeSwap-1816306665 tempest-TestVolumeSwap-1816306665-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f73f85151b0>, {'target_iqn': 'iqn.2010-10.org.openstack:e2472759-033a-4051-9dec-4516d0aef07d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JCKHSoDN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde', 'volume_id': 'e2472759-033a-4051-9dec-4516d0aef07d'}, None), 'kwargs': False}}" {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 09:46:49 user nova-compute[75229]: WARNING os_brick.initiator.connectors.base [None req-14541822-20a0-4fb4-a231-073f47febc6d tempest-TestVolumeSwap-1816306665 tempest-TestVolumeSwap-1816306665-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 09:46:49 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-14541822-20a0-4fb4-a231-073f47febc6d tempest-TestVolumeSwap-1816306665 tempest-TestVolumeSwap-1816306665-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 09:46:49 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-14541822-20a0-4fb4-a231-073f47febc6d tempest-TestVolumeSwap-1816306665 tempest-TestVolumeSwap-1816306665-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 09:46:49 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:46:49 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:46:49 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[20011c39-39c4-4f4a-a73a-b191e30bd85d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:52ae1fea-5339-4958-88ae-d103080e7743\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c7022511-a003-46d5-bcc1-064be770a829\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e2472759-033a-4051-9dec-4516d0aef07d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:46:49 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-14541822-20a0-4fb4-a231-073f47febc6d tempest-TestVolumeSwap-1816306665 tempest-TestVolumeSwap-1816306665-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 09:46:49 user nova-compute[75229]: No targets found.
Nov 14 09:46:49 user nova-compute[75229]: iSNS:
Nov 14 09:46:49 user nova-compute[75229]: No targets found.
Nov 14 09:46:49 user nova-compute[75229]: STATIC:
Nov 14 09:46:49 user nova-compute[75229]: Target: iqn.2010-10.org.openstack:52ae1fea-5339-4958-88ae-d103080e7743
Nov 14 09:46:49 user nova-compute[75229]:         Portal: 172.16.0.220:3260,-1
Nov 14 09:46:49 user nova-compute[75229]:                 Iface Name: default
Nov 14 09:46:49 user nova-compute[75229]: Target: iqn.2010-10.org.openstack:c7022511-a003-46d5-bcc1-064be770a829
Nov 14 09:46:49 user nova-compute[75229]:         Portal: 172.16.0.220:3260,-1
Nov 14 09:46:49 user nova-compute[75229]:                 Iface Name: default
Nov 14 09:46:49 user nova-compute[75229]: Target: iqn.2010-10.org.openstack:e2472759-033a-4051-9dec-4516d0aef07d
Nov 14 09:46:49 user nova-compute[75229]:         Portal: 172.16.0.220:3260,-1
Nov 14 09:46:49 user nova-compute[75229]:                 Iface Name: default
Nov 14 09:46:49 user nova-compute[75229]: FIRMWARE:
Nov 14 09:46:49 user nova-compute[75229]: No targets found.
Nov 14 09:46:49 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 09:46:49 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-14541822-20a0-4fb4-a231-073f47febc6d tempest-TestVolumeSwap-1816306665 tempest-TestVolumeSwap-1816306665-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 09:46:49 user nova-compute[75229]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 09:46:49 user nova-compute[75229]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75229) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 09:46:49 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-14541822-20a0-4fb4-a231-073f47febc6d tempest-TestVolumeSwap-1816306665 tempest-TestVolumeSwap-1816306665-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e2472759-033a-4051-9dec-4516d0aef07d', 0)] {{(pid=75229) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 09:46:49 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:46:49 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:46:49 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f4346be-6d30-4b4c-a0c0-3ca8ea8b7eed]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:52ae1fea-5339-4958-88ae-d103080e7743\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c7022511-a003-46d5-bcc1-064be770a829\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e2472759-033a-4051-9dec-4516d0aef07d\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:46:49 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:46:49 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Instance a7750cbc-b3d0-44aa-8b88-c291ba007a8a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 09:46:49 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Instance e09b3809-2e23-401c-9a72-88feb2bb657c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 09:46:49 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Instance a60d339f-e134-477c-8505-bf8c79d2a21c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 09:46:49 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Instance eb53ba25-d865-41ae-90f3-6e154e2778ba actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 09:46:49 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Instance c6fa2298-7111-4660-a162-09269045d5e3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 09:46:49 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Instance c307660b-01bb-471b-9e2e-5c2aaca65287 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 09:46:49 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Instance 8623fdcc-99b7-44d6-ad81-dada5ba83a88 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 09:46:49 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Instance af5fd5af-63a6-4eee-a4ef-6088a3713214 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 09:46:49 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=75229) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 09:46:49 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=75229) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 09:46:49 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:46:49 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[11bf89c6-ec62-40f2-9605-2ed70a666514]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2472759-033a-4051-9dec-4516d0aef07d (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7022511-a003-46d5-bcc1-064be770a829 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52ae1fea-5339-4958-88ae-d103080e7743 (non-flash)\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:46:49 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-14541822-20a0-4fb4-a231-073f47febc6d tempest-TestVolumeSwap-1816306665 tempest-TestVolumeSwap-1816306665-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2472759-033a-4051-9dec-4516d0aef07d (non-flash)
Nov 14 09:46:49 user nova-compute[75229]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7022511-a003-46d5-bcc1-064be770a829 (non-flash)
Nov 14 09:46:49 user nova-compute[75229]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52ae1fea-5339-4958-88ae-d103080e7743 (non-flash)
Nov 14 09:46:49 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 09:46:49 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-14541822-20a0-4fb4-a231-073f47febc6d tempest-TestVolumeSwap-1816306665 tempest-TestVolumeSwap-1816306665-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2472759-033a-4051-9dec-4516d0aef07d (non-flash)
Nov 14 09:46:49 user nova-compute[75229]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7022511-a003-46d5-bcc1-064be770a829 (non-flash)
Nov 14 09:46:49 user nova-compute[75229]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52ae1fea-5339-4958-88ae-d103080e7743 (non-flash)
Nov 14 09:46:49 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 09:46:49 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-14541822-20a0-4fb4-a231-073f47febc6d tempest-TestVolumeSwap-1816306665 tempest-TestVolumeSwap-1816306665-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f73d4ebe9e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e2472759-033a-4051-9dec-4516d0aef07d'): ({'sde'}, set())}) {{(pid=75229) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 09:46:49 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-14541822-20a0-4fb4-a231-073f47febc6d tempest-TestVolumeSwap-1816306665 tempest-TestVolumeSwap-1816306665-project-admin] Removing single pathed devices sde {{(pid=75229) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 09:46:49 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:46:49 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:46:49 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[486f2122-2ee9-44ff-8147-8b6b1f6a4145]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:46:49 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:46:49 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.021s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:46:49 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[34d8eeae-4bd5-4af5-b764-33630851dd8c]: (4, ('ok\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:46:49 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-14541822-20a0-4fb4-a231-073f47febc6d tempest-TestVolumeSwap-1816306665 tempest-TestVolumeSwap-1816306665-project-admin] Flushing IO for device /dev/sde {{(pid=75229) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 09:46:49 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:46:49 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:46:49 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[77e6ea10-5283-484b-9d96-0e1adf8ff8b9]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:46:49 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-14541822-20a0-4fb4-a231-073f47febc6d tempest-TestVolumeSwap-1816306665 tempest-TestVolumeSwap-1816306665-project-admin] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75229) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 09:46:49 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:46:49 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.081s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:46:49 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[d16ce857-8e57-4424-a7e1-add777d0d9df]: (4, ('1', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:46:49 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-14541822-20a0-4fb4-a231-073f47febc6d tempest-TestVolumeSwap-1816306665 tempest-TestVolumeSwap-1816306665-project-admin] Checking to see if SCSI volumes sde have been removed. {{(pid=75229) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 09:46:49 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-14541822-20a0-4fb4-a231-073f47febc6d tempest-TestVolumeSwap-1816306665 tempest-TestVolumeSwap-1816306665-project-admin] SCSI volumes sde have been removed. {{(pid=75229) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 09:46:49 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-14541822-20a0-4fb4-a231-073f47febc6d tempest-TestVolumeSwap-1816306665 tempest-TestVolumeSwap-1816306665-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e2472759-033a-4051-9dec-4516d0aef07d')] {{(pid=75229) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 09:46:49 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2472759-033a-4051-9dec-4516d0aef07d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:46:49 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2472759-033a-4051-9dec-4516d0aef07d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.033s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:46:49 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[04aed051-999d-4ec1-b8cf-8655c662354d]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:46:49 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-14541822-20a0-4fb4-a231-073f47febc6d tempest-TestVolumeSwap-1816306665 tempest-TestVolumeSwap-1816306665-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:46:49 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2472759-033a-4051-9dec-4516d0aef07d -p 172.16.0.220:3260 --logout {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:46:49 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2472759-033a-4051-9dec-4516d0aef07d -p 172.16.0.220:3260 --logout" returned: 0 in 0.046s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:46:49 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d593ce6-bc61-4f38-9a27-931fc9a0dc97]: (4, ('Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:e2472759-033a-4051-9dec-4516d0aef07d, portal: 172.16.0.220,3260]\nLogout of [sid: 10, target: iqn.2010-10.org.openstack:e2472759-033a-4051-9dec-4516d0aef07d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:46:49 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-14541822-20a0-4fb4-a231-073f47febc6d tempest-TestVolumeSwap-1816306665 tempest-TestVolumeSwap-1816306665-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:e2472759-033a-4051-9dec-4516d0aef07d, portal: 172.16.0.220,3260]
Nov 14 09:46:49 user nova-compute[75229]: Logout of [sid: 10, target: iqn.2010-10.org.openstack:e2472759-033a-4051-9dec-4516d0aef07d, portal: 172.16.0.220,3260] successful.
Nov 14 09:46:49 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:46:49 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2472759-033a-4051-9dec-4516d0aef07d -p 172.16.0.220:3260 --op delete {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:46:49 user nova-compute[75229]: DEBUG nova.compute.provider_tree [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Inventory has not changed in ProviderTree for provider: d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 {{(pid=75229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 09:46:49 user nova-compute[75229]: DEBUG nova.scheduler.client.report [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Inventory has not changed for provider d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 09:46:49 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2472759-033a-4051-9dec-4516d0aef07d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:46:49 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1ffeb5c-ab19-4ff4-a7cb-e4e1a7fb476a]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:46:49 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-14541822-20a0-4fb4-a231-073f47febc6d tempest-TestVolumeSwap-1816306665 tempest-TestVolumeSwap-1816306665-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:46:49 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-14541822-20a0-4fb4-a231-073f47febc6d tempest-TestVolumeSwap-1816306665 tempest-TestVolumeSwap-1816306665-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.438s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 09:46:49 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-14541822-20a0-4fb4-a231-073f47febc6d tempest-TestVolumeSwap-1816306665 tempest-TestVolumeSwap-1816306665-project-admin] <== disconnect_volume: return (439ms) None {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 09:46:49 user nova-compute[75229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-14541822-20a0-4fb4-a231-073f47febc6d tempest-TestVolumeSwap-1816306665 tempest-TestVolumeSwap-1816306665-project-admin] [instance: c307660b-01bb-471b-9e2e-5c2aaca65287] Disconnected iSCSI Volume {{(pid=75229) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 09:46:49 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Compute_service record updated for user:user {{(pid=75229) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 09:46:49 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.589s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:46:49 user nova-compute[75229]: DEBUG nova.compute.manager [None req-14541822-20a0-4fb4-a231-073f47febc6d tempest-TestVolumeSwap-1816306665 tempest-TestVolumeSwap-1816306665-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:52ae1fea-5339-4958-88ae-d103080e7743', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xkXQEUcf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': 'c307660b-01bb-471b-9e2e-5c2aaca65287', 'attached_at': '', 'detached_at': '', 'volume_id': '52ae1fea-5339-4958-88ae-d103080e7743', 'serial'} {{(pid=75229) _swap_volume /opt/stack/nova/nova/compute/manager.py:7791}}
Nov 14 09:46:49 user nova-compute[75229]: DEBUG nova.compute.manager [None req-14541822-20a0-4fb4-a231-073f47febc6d tempest-TestVolumeSwap-1816306665 tempest-TestVolumeSwap-1816306665-project-admin] [instance: c307660b-01bb-471b-9e2e-5c2aaca65287] swap_volume: removing Cinder connection for volume e2472759-033a-4051-9dec-4516d0aef07d {{(pid=75229) _swap_volume /opt/stack/nova/nova/compute/manager.py:7836}}
Nov 14 09:46:50 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 09:46:50 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 09:46:50 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 09:46:50 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 09:46:50 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 09:46:50 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 09:46:50 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 09:46:50 user nova-compute[75229]: DEBUG nova.compute.manager [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75229) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 09:46:50 user nova-compute[75229]: DEBUG nova.compute.manager [req-ed27311f-8f0b-467e-93b9-3a6e742533cb req-cd84dc60-000a-4c15-8843-87039d40e995 service nova] [instance: c6fa2298-7111-4660-a162-09269045d5e3] Received event network-vif-unplugged-1c95e48f-ad0e-41b2-8638-ddefc9360154 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:46:50 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-ed27311f-8f0b-467e-93b9-3a6e742533cb req-cd84dc60-000a-4c15-8843-87039d40e995 service nova] Acquiring lock "c6fa2298-7111-4660-a162-09269045d5e3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:46:50 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-ed27311f-8f0b-467e-93b9-3a6e742533cb req-cd84dc60-000a-4c15-8843-87039d40e995 service nova] Lock "c6fa2298-7111-4660-a162-09269045d5e3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:46:50 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-ed27311f-8f0b-467e-93b9-3a6e742533cb req-cd84dc60-000a-4c15-8843-87039d40e995 service nova] Lock "c6fa2298-7111-4660-a162-09269045d5e3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:46:50 user nova-compute[75229]: DEBUG nova.compute.manager [req-ed27311f-8f0b-467e-93b9-3a6e742533cb req-cd84dc60-000a-4c15-8843-87039d40e995 service nova] [instance: c6fa2298-7111-4660-a162-09269045d5e3] No waiting events found dispatching network-vif-unplugged-1c95e48f-ad0e-41b2-8638-ddefc9360154 {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 09:46:50 user nova-compute[75229]: WARNING nova.compute.manager [req-ed27311f-8f0b-467e-93b9-3a6e742533cb req-cd84dc60-000a-4c15-8843-87039d40e995 service nova] [instance: c6fa2298-7111-4660-a162-09269045d5e3] Received unexpected event network-vif-unplugged-1c95e48f-ad0e-41b2-8638-ddefc9360154 for instance with vm_state active and task_state None.
Nov 14 09:46:50 user nova-compute[75229]: DEBUG nova.compute.manager [req-ed27311f-8f0b-467e-93b9-3a6e742533cb req-cd84dc60-000a-4c15-8843-87039d40e995 service nova] [instance: c6fa2298-7111-4660-a162-09269045d5e3] Received event network-vif-plugged-1c95e48f-ad0e-41b2-8638-ddefc9360154 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:46:50 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-ed27311f-8f0b-467e-93b9-3a6e742533cb req-cd84dc60-000a-4c15-8843-87039d40e995 service nova] Acquiring lock "c6fa2298-7111-4660-a162-09269045d5e3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:46:50 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-ed27311f-8f0b-467e-93b9-3a6e742533cb req-cd84dc60-000a-4c15-8843-87039d40e995 service nova] Lock "c6fa2298-7111-4660-a162-09269045d5e3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:46:50 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-ed27311f-8f0b-467e-93b9-3a6e742533cb req-cd84dc60-000a-4c15-8843-87039d40e995 service nova] Lock "c6fa2298-7111-4660-a162-09269045d5e3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:46:50 user nova-compute[75229]: DEBUG nova.compute.manager [req-ed27311f-8f0b-467e-93b9-3a6e742533cb req-cd84dc60-000a-4c15-8843-87039d40e995 service nova] [instance: c6fa2298-7111-4660-a162-09269045d5e3] No waiting events found dispatching network-vif-plugged-1c95e48f-ad0e-41b2-8638-ddefc9360154 {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 09:46:50 user nova-compute[75229]: WARNING nova.compute.manager [req-ed27311f-8f0b-467e-93b9-3a6e742533cb req-cd84dc60-000a-4c15-8843-87039d40e995 service nova] [instance: c6fa2298-7111-4660-a162-09269045d5e3] Received unexpected event network-vif-plugged-1c95e48f-ad0e-41b2-8638-ddefc9360154 for instance with vm_state active and task_state None.
Nov 14 09:46:50 user nova-compute[75229]: DEBUG nova.compute.manager [req-ed27311f-8f0b-467e-93b9-3a6e742533cb req-cd84dc60-000a-4c15-8843-87039d40e995 service nova] [instance: af5fd5af-63a6-4eee-a4ef-6088a3713214] Received event network-vif-deleted-b7fff2b1-9f14-4632-83e2-3f0a8e4c788b {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:46:50 user nova-compute[75229]: INFO nova.compute.manager [req-ed27311f-8f0b-467e-93b9-3a6e742533cb req-cd84dc60-000a-4c15-8843-87039d40e995 service nova] [instance: af5fd5af-63a6-4eee-a4ef-6088a3713214] Neutron deleted interface b7fff2b1-9f14-4632-83e2-3f0a8e4c788b; detaching it from the instance and deleting it from the info cache
Nov 14 09:46:50 user nova-compute[75229]: DEBUG nova.network.neutron [req-ed27311f-8f0b-467e-93b9-3a6e742533cb req-cd84dc60-000a-4c15-8843-87039d40e995 service nova] [instance: af5fd5af-63a6-4eee-a4ef-6088a3713214] Updating instance_info_cache with network_info: [{"id": "a1999f33-4f1d-47b0-a91a-48bce4600e9b", "address": "fa:16:3e:d9:f9:d0", "network": {"id": "a4d3d0e0-1dec-40de-a03f-4241b910cf16", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-380540777-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a9197db757f4a1cafd571eef8d47b15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1999f33-4f", "ovs_interfaceid": "a1999f33-4f1d-47b0-a91a-48bce4600e9b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2f37eb91-97ea-477b-b6c1-933b50ccfca6", "address": "fa:16:3e:1b:33:6b", "network": {"id": "4176f9ca-0910-416d-99e3-a8156bd87229", "bridge": "br-int", "label": "tempest-device-tagging-net1-45180450", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.34", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6a9197db757f4a1cafd571eef8d47b15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f37eb91-97", "ovs_interfaceid": "2f37eb91-97ea-477b-b6c1-933b50ccfca6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f8dc5389-6e53-421a-9a3a-6c90a89a6eb2", "address": "fa:16:3e:69:0d:d2", "network": {"id": "4176f9ca-0910-416d-99e3-a8156bd87229", "bridge": "br-int", "label": "tempest-device-tagging-net1-45180450", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.210", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6a9197db757f4a1cafd571eef8d47b15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8dc5389-6e", "ovs_interfaceid": "f8dc5389-6e53-421a-9a3a-6c90a89a6eb2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0979136b-2418-4434-9466-75d116e8c780", "address": "fa:16:3e:4d:a2:e0", "network": {"id": "4176f9ca-0910-416d-99e3-a8156bd87229", "bridge": "br-int", "label": "tempest-device-tagging-net1-45180450", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.156", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6a9197db757f4a1cafd571eef8d47b15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0979136b-24", "ovs_interfaceid": "0979136b-2418-4434-9466-75d116e8c780", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "768a662a-4bcd-4844-a9ed-f8b8f6b8aa0d", "address": "fa:16:3e:10:aa:95", "network": {"id": "0f777eef-d2ac-43b9-bbef-4f075e98903f", "bridge": "br-int", "label": "tempest-device-tagging-net2-1010361890", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "6a9197db757f4a1cafd571eef8d47b15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap768a662a-4b", "ovs_interfaceid": "768a662a-4bcd-4844-a9ed-f8b8f6b8aa0d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 09:46:50 user nova-compute[75229]: DEBUG nova.compute.manager [req-ed27311f-8f0b-467e-93b9-3a6e742533cb req-cd84dc60-000a-4c15-8843-87039d40e995 service nova] [instance: af5fd5af-63a6-4eee-a4ef-6088a3713214] Detach interface failed, port_id=b7fff2b1-9f14-4632-83e2-3f0a8e4c788b, reason: Instance af5fd5af-63a6-4eee-a4ef-6088a3713214 could not be found. {{(pid=75229) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 14 09:46:50 user nova-compute[75229]: DEBUG nova.compute.manager [req-ed27311f-8f0b-467e-93b9-3a6e742533cb req-cd84dc60-000a-4c15-8843-87039d40e995 service nova] [instance: af5fd5af-63a6-4eee-a4ef-6088a3713214] Received event network-vif-deleted-0979136b-2418-4434-9466-75d116e8c780 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:46:50 user nova-compute[75229]: INFO nova.compute.manager [req-ed27311f-8f0b-467e-93b9-3a6e742533cb req-cd84dc60-000a-4c15-8843-87039d40e995 service nova] [instance: af5fd5af-63a6-4eee-a4ef-6088a3713214] Neutron deleted interface 0979136b-2418-4434-9466-75d116e8c780; detaching it from the instance and deleting it from the info cache
Nov 14 09:46:50 user nova-compute[75229]: DEBUG nova.network.neutron [req-ed27311f-8f0b-467e-93b9-3a6e742533cb req-cd84dc60-000a-4c15-8843-87039d40e995 service nova] [instance: af5fd5af-63a6-4eee-a4ef-6088a3713214] Updating instance_info_cache with network_info: [{"id": "a1999f33-4f1d-47b0-a91a-48bce4600e9b", "address": "fa:16:3e:d9:f9:d0", "network": {"id": "a4d3d0e0-1dec-40de-a03f-4241b910cf16", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-380540777-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a9197db757f4a1cafd571eef8d47b15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1999f33-4f", "ovs_interfaceid": "a1999f33-4f1d-47b0-a91a-48bce4600e9b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2f37eb91-97ea-477b-b6c1-933b50ccfca6", "address": "fa:16:3e:1b:33:6b", "network": {"id": "4176f9ca-0910-416d-99e3-a8156bd87229", "bridge": "br-int", "label": "tempest-device-tagging-net1-45180450", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.34", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6a9197db757f4a1cafd571eef8d47b15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f37eb91-97", "ovs_interfaceid": "2f37eb91-97ea-477b-b6c1-933b50ccfca6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f8dc5389-6e53-421a-9a3a-6c90a89a6eb2", "address": "fa:16:3e:69:0d:d2", "network": {"id": "4176f9ca-0910-416d-99e3-a8156bd87229", "bridge": "br-int", "label": "tempest-device-tagging-net1-45180450", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.210", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6a9197db757f4a1cafd571eef8d47b15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8dc5389-6e", "ovs_interfaceid": "f8dc5389-6e53-421a-9a3a-6c90a89a6eb2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "768a662a-4bcd-4844-a9ed-f8b8f6b8aa0d", "address": "fa:16:3e:10:aa:95", "network": {"id": "0f777eef-d2ac-43b9-bbef-4f075e98903f", "bridge": "br-int", "label": "tempest-device-tagging-net2-1010361890", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "6a9197db757f4a1cafd571eef8d47b15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap768a662a-4b", "ovs_interfaceid": "768a662a-4bcd-4844-a9ed-f8b8f6b8aa0d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 09:46:50 user nova-compute[75229]: DEBUG nova.compute.manager [req-ed27311f-8f0b-467e-93b9-3a6e742533cb req-cd84dc60-000a-4c15-8843-87039d40e995 service nova] [instance: af5fd5af-63a6-4eee-a4ef-6088a3713214] Detach interface failed, port_id=0979136b-2418-4434-9466-75d116e8c780, reason: Instance af5fd5af-63a6-4eee-a4ef-6088a3713214 could not be found. {{(pid=75229) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 14 09:46:50 user nova-compute[75229]: DEBUG nova.compute.manager [req-ed27311f-8f0b-467e-93b9-3a6e742533cb req-cd84dc60-000a-4c15-8843-87039d40e995 service nova] [instance: af5fd5af-63a6-4eee-a4ef-6088a3713214] Received event network-vif-deleted-a1999f33-4f1d-47b0-a91a-48bce4600e9b {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:46:50 user nova-compute[75229]: INFO nova.compute.manager [req-ed27311f-8f0b-467e-93b9-3a6e742533cb req-cd84dc60-000a-4c15-8843-87039d40e995 service nova] [instance: af5fd5af-63a6-4eee-a4ef-6088a3713214] Neutron deleted interface a1999f33-4f1d-47b0-a91a-48bce4600e9b; detaching it from the instance and deleting it from the info cache
Nov 14 09:46:50 user nova-compute[75229]: DEBUG nova.network.neutron [req-ed27311f-8f0b-467e-93b9-3a6e742533cb req-cd84dc60-000a-4c15-8843-87039d40e995 service nova] [instance: af5fd5af-63a6-4eee-a4ef-6088a3713214] Updating instance_info_cache with network_info: [{"id": "2f37eb91-97ea-477b-b6c1-933b50ccfca6", "address": "fa:16:3e:1b:33:6b", "network": {"id": "4176f9ca-0910-416d-99e3-a8156bd87229", "bridge": "br-int", "label": "tempest-device-tagging-net1-45180450", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.34", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6a9197db757f4a1cafd571eef8d47b15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f37eb91-97", "ovs_interfaceid": "2f37eb91-97ea-477b-b6c1-933b50ccfca6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f8dc5389-6e53-421a-9a3a-6c90a89a6eb2", "address": "fa:16:3e:69:0d:d2", "network": {"id": "4176f9ca-0910-416d-99e3-a8156bd87229", "bridge": "br-int", "label": "tempest-device-tagging-net1-45180450", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.210", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6a9197db757f4a1cafd571eef8d47b15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8dc5389-6e", "ovs_interfaceid": "f8dc5389-6e53-421a-9a3a-6c90a89a6eb2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "768a662a-4bcd-4844-a9ed-f8b8f6b8aa0d", "address": "fa:16:3e:10:aa:95", "network": {"id": "0f777eef-d2ac-43b9-bbef-4f075e98903f", "bridge": "br-int", "label": "tempest-device-tagging-net2-1010361890", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "6a9197db757f4a1cafd571eef8d47b15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap768a662a-4b", "ovs_interfaceid": "768a662a-4bcd-4844-a9ed-f8b8f6b8aa0d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 09:46:50 user nova-compute[75229]: DEBUG nova.compute.manager [req-ed27311f-8f0b-467e-93b9-3a6e742533cb req-cd84dc60-000a-4c15-8843-87039d40e995 service nova] [instance: af5fd5af-63a6-4eee-a4ef-6088a3713214] Detach interface failed, port_id=a1999f33-4f1d-47b0-a91a-48bce4600e9b, reason: Instance af5fd5af-63a6-4eee-a4ef-6088a3713214 could not be found. {{(pid=75229) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 14 09:46:50 user nova-compute[75229]: DEBUG nova.compute.manager [None req-14541822-20a0-4fb4-a231-073f47febc6d tempest-TestVolumeSwap-1816306665 tempest-TestVolumeSwap-1816306665-project-admin] [instance: c307660b-01bb-471b-9e2e-5c2aaca65287] swap_volume: Updating volume e2472759-033a-4051-9dec-4516d0aef07d BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:52ae1fea-5339-4958-88ae-d103080e7743", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "xkXQEUcf", "auth_password": "6GJZAkrzgjcWdw", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdc", "volume_id": "52ae1fea-5339-4958-88ae-d103080e7743"}, "status": "reserved", "instance": "c307660b-01bb-471b-9e2e-5c2aaca65287", "attached_at": "", "detached_at": "", "volume_id": "52ae1fea-5339-4958-88ae-d103080e7743", "serial": "52ae1fea-5339-4958-88ae-d103080e7743"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': '52ae1fea-5339-4958-88ae-d103080e7743', 'no_device': None, 'attachment_id': 'aac7dbf5-b4da-43b3-bc3a-44029128ff1d'} {{(pid=75229) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7984}}
Nov 14 09:46:50 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-14541822-20a0-4fb4-a231-073f47febc6d tempest-TestVolumeSwap-1816306665 tempest-TestVolumeSwap-1816306665-project-admin] Lock "c307660b-01bb-471b-9e2e-5c2aaca65287" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 12.235s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:46:50 user nova-compute[75229]: DEBUG nova.network.neutron [-] [instance: af5fd5af-63a6-4eee-a4ef-6088a3713214] Updating instance_info_cache with network_info: [] {{(pid=75229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 09:46:50 user nova-compute[75229]: INFO nova.compute.manager [-] [instance: af5fd5af-63a6-4eee-a4ef-6088a3713214] Took 4.83 seconds to deallocate network for instance.
Nov 14 09:46:51 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-6d2edeb1-ab23-4001-aaba-925e1cc21884 tempest-TestVolumeSwap-528292061 tempest-TestVolumeSwap-528292061-project-member] Acquiring lock "c307660b-01bb-471b-9e2e-5c2aaca65287" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:46:51 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-6d2edeb1-ab23-4001-aaba-925e1cc21884 tempest-TestVolumeSwap-528292061 tempest-TestVolumeSwap-528292061-project-member] Lock "c307660b-01bb-471b-9e2e-5c2aaca65287" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:46:51 user nova-compute[75229]: INFO nova.compute.manager [None req-6d2edeb1-ab23-4001-aaba-925e1cc21884 tempest-TestVolumeSwap-528292061 tempest-TestVolumeSwap-528292061-project-member] [instance: c307660b-01bb-471b-9e2e-5c2aaca65287] Detaching volume 52ae1fea-5339-4958-88ae-d103080e7743
Nov 14 09:46:51 user nova-compute[75229]: INFO nova.virt.block_device [None req-6d2edeb1-ab23-4001-aaba-925e1cc21884 tempest-TestVolumeSwap-528292061 tempest-TestVolumeSwap-528292061-project-member] [instance: c307660b-01bb-471b-9e2e-5c2aaca65287] Attempting to driver detach volume 52ae1fea-5339-4958-88ae-d103080e7743 from mountpoint /dev/vdb
Nov 14 09:46:51 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-6d2edeb1-ab23-4001-aaba-925e1cc21884 tempest-TestVolumeSwap-528292061 tempest-TestVolumeSwap-528292061-project-member] Attempting to detach device vdb from instance c307660b-01bb-471b-9e2e-5c2aaca65287 from the persistent domain config. {{(pid=75229) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 09:46:51 user nova-compute[75229]: DEBUG nova.virt.libvirt.guest [None req-6d2edeb1-ab23-4001-aaba-925e1cc21884 tempest-TestVolumeSwap-528292061 tempest-TestVolumeSwap-528292061-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 09:46:51 user nova-compute[75229]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 09:46:51 user nova-compute[75229]:   <source dev="/dev/sdc"/>
Nov 14 09:46:51 user nova-compute[75229]:   <target dev="vdb" bus="virtio"/>
Nov 14 09:46:51 user nova-compute[75229]:   <serial>52ae1fea-5339-4958-88ae-d103080e7743</serial>
Nov 14 09:46:51 user nova-compute[75229]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 09:46:51 user nova-compute[75229]: </disk>
Nov 14 09:46:51 user nova-compute[75229]:  {{(pid=75229) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 09:46:51 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-6d2edeb1-ab23-4001-aaba-925e1cc21884 tempest-TestVolumeSwap-528292061 tempest-TestVolumeSwap-528292061-project-member] Successfully detached device vdb from instance c307660b-01bb-471b-9e2e-5c2aaca65287 from the persistent domain config.
Nov 14 09:46:51 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-6d2edeb1-ab23-4001-aaba-925e1cc21884 tempest-TestVolumeSwap-528292061 tempest-TestVolumeSwap-528292061-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance c307660b-01bb-471b-9e2e-5c2aaca65287 from the live domain config. {{(pid=75229) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 09:46:51 user nova-compute[75229]: DEBUG nova.virt.libvirt.guest [None req-6d2edeb1-ab23-4001-aaba-925e1cc21884 tempest-TestVolumeSwap-528292061 tempest-TestVolumeSwap-528292061-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 09:46:51 user nova-compute[75229]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 09:46:51 user nova-compute[75229]:   <source dev="/dev/sdc"/>
Nov 14 09:46:51 user nova-compute[75229]:   <target dev="vdb" bus="virtio"/>
Nov 14 09:46:51 user nova-compute[75229]:   <serial>52ae1fea-5339-4958-88ae-d103080e7743</serial>
Nov 14 09:46:51 user nova-compute[75229]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 09:46:51 user nova-compute[75229]: </disk>
Nov 14 09:46:51 user nova-compute[75229]:  {{(pid=75229) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 09:46:52 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:46:52 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-6d2edeb1-ab23-4001-aaba-925e1cc21884 tempest-TestVolumeSwap-528292061 tempest-TestVolumeSwap-528292061-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance c307660b-01bb-471b-9e2e-5c2aaca65287 {{(pid=75229) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 09:46:52 user nova-compute[75229]: DEBUG nova.compute.manager [req-df336d19-0523-445e-9734-6b7a510385a7 req-1eab346f-71a4-4ed0-a343-5b7eb2eb2285 service nova] [instance: af5fd5af-63a6-4eee-a4ef-6088a3713214] Received event network-vif-deleted-768a662a-4bcd-4844-a9ed-f8b8f6b8aa0d {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:46:53 user nova-compute[75229]: INFO nova.compute.manager [None req-94b99e34-7e1e-4194-ac1b-f55d4c3c730d tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] [instance: af5fd5af-63a6-4eee-a4ef-6088a3713214] Took 2.24 seconds to detach 3 volumes for instance.
Nov 14 09:46:53 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-94b99e34-7e1e-4194-ac1b-f55d4c3c730d tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:46:53 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-94b99e34-7e1e-4194-ac1b-f55d4c3c730d tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:46:53 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:46:53 user nova-compute[75229]: DEBUG nova.compute.provider_tree [None req-94b99e34-7e1e-4194-ac1b-f55d4c3c730d tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] Inventory has not changed in ProviderTree for provider: d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 {{(pid=75229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 09:46:53 user nova-compute[75229]: DEBUG nova.scheduler.client.report [None req-94b99e34-7e1e-4194-ac1b-f55d4c3c730d tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] Inventory has not changed for provider d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 09:46:53 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-94b99e34-7e1e-4194-ac1b-f55d4c3c730d tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.285s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:46:53 user nova-compute[75229]: INFO nova.scheduler.client.report [None req-94b99e34-7e1e-4194-ac1b-f55d4c3c730d tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] Deleted allocations for instance af5fd5af-63a6-4eee-a4ef-6088a3713214
Nov 14 09:46:53 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-94b99e34-7e1e-4194-ac1b-f55d4c3c730d tempest-TaggedBootDevicesTest-818020951 tempest-TaggedBootDevicesTest-818020951-project-member] Lock "af5fd5af-63a6-4eee-a4ef-6088a3713214" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 12.709s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:46:53 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:46:56 user nova-compute[75229]: WARNING nova.virt.libvirt.driver [None req-e7c66110-060e-47d3-82eb-fc9dcb9a28c8 tempest-VolumesAssistedSnapshotsTest-1584778058 tempest-VolumesAssistedSnapshotsTest-1584778058-project-admin] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 8623fdcc-99b7-44d6-ad81-dada5ba83a88 is timed out.
Nov 14 09:46:56 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-e7c66110-060e-47d3-82eb-fc9dcb9a28c8 tempest-VolumesAssistedSnapshotsTest-1584778058 tempest-VolumesAssistedSnapshotsTest-1584778058-project-admin] Successfully detached device vdb from instance 8623fdcc-99b7-44d6-ad81-dada5ba83a88 from the live domain config.
Nov 14 09:46:56 user nova-compute[75229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e7c66110-060e-47d3-82eb-fc9dcb9a28c8 tempest-VolumesAssistedSnapshotsTest-1584778058 tempest-VolumesAssistedSnapshotsTest-1584778058-project-admin] [instance: 8623fdcc-99b7-44d6-ad81-dada5ba83a88] calling os-brick to detach iSCSI Volume {{(pid=75229) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 09:46:56 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7c66110-060e-47d3-82eb-fc9dcb9a28c8 tempest-VolumesAssistedSnapshotsTest-1584778058 tempest-VolumesAssistedSnapshotsTest-1584778058-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f73f85151b0>, {'target_iqn': 'iqn.2010-10.org.openstack:c7022511-a003-46d5-bcc1-064be770a829', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uzVNLYUt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, None), 'kwargs': False}}" {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 09:46:56 user nova-compute[75229]: WARNING os_brick.initiator.connectors.base [None req-e7c66110-060e-47d3-82eb-fc9dcb9a28c8 tempest-VolumesAssistedSnapshotsTest-1584778058 tempest-VolumesAssistedSnapshotsTest-1584778058-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 09:46:56 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-e7c66110-060e-47d3-82eb-fc9dcb9a28c8 tempest-VolumesAssistedSnapshotsTest-1584778058 tempest-VolumesAssistedSnapshotsTest-1584778058-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 09:46:56 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-e7c66110-060e-47d3-82eb-fc9dcb9a28c8 tempest-VolumesAssistedSnapshotsTest-1584778058 tempest-VolumesAssistedSnapshotsTest-1584778058-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 09:46:56 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:46:56 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:46:56 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[4968b15a-1cd2-4179-870a-a6b840f3d729]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:52ae1fea-5339-4958-88ae-d103080e7743\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c7022511-a003-46d5-bcc1-064be770a829\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:46:56 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7c66110-060e-47d3-82eb-fc9dcb9a28c8 tempest-VolumesAssistedSnapshotsTest-1584778058 tempest-VolumesAssistedSnapshotsTest-1584778058-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 09:46:56 user nova-compute[75229]: No targets found.
Nov 14 09:46:56 user nova-compute[75229]: iSNS:
Nov 14 09:46:56 user nova-compute[75229]: No targets found.
Nov 14 09:46:56 user nova-compute[75229]: STATIC:
Nov 14 09:46:56 user nova-compute[75229]: Target: iqn.2010-10.org.openstack:52ae1fea-5339-4958-88ae-d103080e7743
Nov 14 09:46:56 user nova-compute[75229]:         Portal: 172.16.0.220:3260,-1
Nov 14 09:46:56 user nova-compute[75229]:                 Iface Name: default
Nov 14 09:46:56 user nova-compute[75229]: Target: iqn.2010-10.org.openstack:c7022511-a003-46d5-bcc1-064be770a829
Nov 14 09:46:56 user nova-compute[75229]:         Portal: 172.16.0.220:3260,-1
Nov 14 09:46:56 user nova-compute[75229]:                 Iface Name: default
Nov 14 09:46:56 user nova-compute[75229]: FIRMWARE:
Nov 14 09:46:56 user nova-compute[75229]: No targets found.
Nov 14 09:46:56 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 09:46:56 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7c66110-060e-47d3-82eb-fc9dcb9a28c8 tempest-VolumesAssistedSnapshotsTest-1584778058 tempest-VolumesAssistedSnapshotsTest-1584778058-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 09:46:56 user nova-compute[75229]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 09:46:56 user nova-compute[75229]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75229) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 09:46:56 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7c66110-060e-47d3-82eb-fc9dcb9a28c8 tempest-VolumesAssistedSnapshotsTest-1584778058 tempest-VolumesAssistedSnapshotsTest-1584778058-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c7022511-a003-46d5-bcc1-064be770a829', 0)] {{(pid=75229) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 09:46:56 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:46:56 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:46:56 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[bab06d39-9b42-461a-af27-ba1d92ea777e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:52ae1fea-5339-4958-88ae-d103080e7743\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c7022511-a003-46d5-bcc1-064be770a829\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:46:56 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:46:56 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:46:56 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[8787fe19-f96b-46b5-82a2-4bc237dbd47f]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7022511-a003-46d5-bcc1-064be770a829 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52ae1fea-5339-4958-88ae-d103080e7743 (non-flash)\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:46:56 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7c66110-060e-47d3-82eb-fc9dcb9a28c8 tempest-VolumesAssistedSnapshotsTest-1584778058 tempest-VolumesAssistedSnapshotsTest-1584778058-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7022511-a003-46d5-bcc1-064be770a829 (non-flash)
Nov 14 09:46:56 user nova-compute[75229]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52ae1fea-5339-4958-88ae-d103080e7743 (non-flash)
Nov 14 09:46:56 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 09:46:56 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7c66110-060e-47d3-82eb-fc9dcb9a28c8 tempest-VolumesAssistedSnapshotsTest-1584778058 tempest-VolumesAssistedSnapshotsTest-1584778058-project-admin] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7022511-a003-46d5-bcc1-064be770a829 (non-flash)
Nov 14 09:46:56 user nova-compute[75229]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52ae1fea-5339-4958-88ae-d103080e7743 (non-flash)
Nov 14 09:46:56 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 09:46:56 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7c66110-060e-47d3-82eb-fc9dcb9a28c8 tempest-VolumesAssistedSnapshotsTest-1584778058 tempest-VolumesAssistedSnapshotsTest-1584778058-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f73d4ebe8c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c7022511-a003-46d5-bcc1-064be770a829'): ({'sdi'}, set())}) {{(pid=75229) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 09:46:56 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-e7c66110-060e-47d3-82eb-fc9dcb9a28c8 tempest-VolumesAssistedSnapshotsTest-1584778058 tempest-VolumesAssistedSnapshotsTest-1584778058-project-admin] Removing single pathed devices sdi {{(pid=75229) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 09:46:56 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:46:56 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:46:56 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ba541f6-2b37-427c-8f39-6cc10d00449b]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:46:56 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:46:56 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.017s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:46:56 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[14a115b8-5726-4c7d-a677-379638548af3]: (4, ('ok\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:46:56 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-e7c66110-060e-47d3-82eb-fc9dcb9a28c8 tempest-VolumesAssistedSnapshotsTest-1584778058 tempest-VolumesAssistedSnapshotsTest-1584778058-project-admin] Flushing IO for device /dev/sdi {{(pid=75229) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 09:46:56 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:46:56 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.011s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:46:56 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cc176b1-7396-4aaf-86cc-49e77fd2b4b6]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:46:56 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-e7c66110-060e-47d3-82eb-fc9dcb9a28c8 tempest-VolumesAssistedSnapshotsTest-1584778058 tempest-VolumesAssistedSnapshotsTest-1584778058-project-admin] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=75229) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 09:46:56 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:46:56 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.045s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:46:56 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[19525371-398f-478e-94af-4886380b2356]: (4, ('1', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:46:56 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-e7c66110-060e-47d3-82eb-fc9dcb9a28c8 tempest-VolumesAssistedSnapshotsTest-1584778058 tempest-VolumesAssistedSnapshotsTest-1584778058-project-admin] Checking to see if SCSI volumes sdi have been removed. {{(pid=75229) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 09:46:56 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-e7c66110-060e-47d3-82eb-fc9dcb9a28c8 tempest-VolumesAssistedSnapshotsTest-1584778058 tempest-VolumesAssistedSnapshotsTest-1584778058-project-admin] SCSI volumes sdi have been removed. {{(pid=75229) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 09:46:56 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7c66110-060e-47d3-82eb-fc9dcb9a28c8 tempest-VolumesAssistedSnapshotsTest-1584778058 tempest-VolumesAssistedSnapshotsTest-1584778058-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c7022511-a003-46d5-bcc1-064be770a829')] {{(pid=75229) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 09:46:56 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7022511-a003-46d5-bcc1-064be770a829 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:46:56 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7022511-a003-46d5-bcc1-064be770a829 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:46:56 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[2df75e6d-af6f-4cac-b0e4-5a0a69b46c67]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:46:56 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7c66110-060e-47d3-82eb-fc9dcb9a28c8 tempest-VolumesAssistedSnapshotsTest-1584778058 tempest-VolumesAssistedSnapshotsTest-1584778058-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:46:56 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7022511-a003-46d5-bcc1-064be770a829 -p 172.16.0.220:3260 --logout {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:46:56 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7022511-a003-46d5-bcc1-064be770a829 -p 172.16.0.220:3260 --logout" returned: 0 in 0.044s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:46:56 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[44176b18-4484-493a-a3dd-012138add34c]: (4, ('Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:c7022511-a003-46d5-bcc1-064be770a829, portal: 172.16.0.220,3260]\nLogout of [sid: 11, target: iqn.2010-10.org.openstack:c7022511-a003-46d5-bcc1-064be770a829, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:46:56 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7c66110-060e-47d3-82eb-fc9dcb9a28c8 tempest-VolumesAssistedSnapshotsTest-1584778058 tempest-VolumesAssistedSnapshotsTest-1584778058-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:c7022511-a003-46d5-bcc1-064be770a829, portal: 172.16.0.220,3260]
Nov 14 09:46:56 user nova-compute[75229]: Logout of [sid: 11, target: iqn.2010-10.org.openstack:c7022511-a003-46d5-bcc1-064be770a829, portal: 172.16.0.220,3260] successful.
Nov 14 09:46:56 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:46:56 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7022511-a003-46d5-bcc1-064be770a829 -p 172.16.0.220:3260 --op delete {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:46:56 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7022511-a003-46d5-bcc1-064be770a829 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:46:56 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[e658fabe-7223-41f6-961a-b88c516ea3f4]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:46:56 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7c66110-060e-47d3-82eb-fc9dcb9a28c8 tempest-VolumesAssistedSnapshotsTest-1584778058 tempest-VolumesAssistedSnapshotsTest-1584778058-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:46:56 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-e7c66110-060e-47d3-82eb-fc9dcb9a28c8 tempest-VolumesAssistedSnapshotsTest-1584778058 tempest-VolumesAssistedSnapshotsTest-1584778058-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.270s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 09:46:56 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7c66110-060e-47d3-82eb-fc9dcb9a28c8 tempest-VolumesAssistedSnapshotsTest-1584778058 tempest-VolumesAssistedSnapshotsTest-1584778058-project-admin] <== disconnect_volume: return (271ms) None {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 09:46:56 user nova-compute[75229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e7c66110-060e-47d3-82eb-fc9dcb9a28c8 tempest-VolumesAssistedSnapshotsTest-1584778058 tempest-VolumesAssistedSnapshotsTest-1584778058-project-admin] [instance: 8623fdcc-99b7-44d6-ad81-dada5ba83a88] Disconnected iSCSI Volume {{(pid=75229) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 09:46:57 user nova-compute[75229]: DEBUG nova.objects.instance [None req-e7c66110-060e-47d3-82eb-fc9dcb9a28c8 tempest-VolumesAssistedSnapshotsTest-1584778058 tempest-VolumesAssistedSnapshotsTest-1584778058-project-admin] Lazy-loading 'flavor' on Instance uuid 8623fdcc-99b7-44d6-ad81-dada5ba83a88 {{(pid=75229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 09:46:57 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-e7c66110-060e-47d3-82eb-fc9dcb9a28c8 tempest-VolumesAssistedSnapshotsTest-1584778058 tempest-VolumesAssistedSnapshotsTest-1584778058-project-admin] Lock "8623fdcc-99b7-44d6-ad81-dada5ba83a88" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.598s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:46:57 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:46:57 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:46:58 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:46:58 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-eb918dde-e7e0-4f7e-b75e-b509fdba5631 tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] Acquiring lock "38f30682-2278-40aa-914e-2867e771eb19" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:46:58 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-eb918dde-e7e0-4f7e-b75e-b509fdba5631 tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] Lock "38f30682-2278-40aa-914e-2867e771eb19" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:46:58 user nova-compute[75229]: DEBUG nova.compute.manager [None req-eb918dde-e7e0-4f7e-b75e-b509fdba5631 tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] [instance: 38f30682-2278-40aa-914e-2867e771eb19] Starting instance... {{(pid=75229) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 09:46:58 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-eb918dde-e7e0-4f7e-b75e-b509fdba5631 tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:46:58 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-eb918dde-e7e0-4f7e-b75e-b509fdba5631 tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:46:58 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-eb918dde-e7e0-4f7e-b75e-b509fdba5631 tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75229) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 09:46:58 user nova-compute[75229]: INFO nova.compute.claims [None req-eb918dde-e7e0-4f7e-b75e-b509fdba5631 tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] [instance: 38f30682-2278-40aa-914e-2867e771eb19] Claim successful on node user
Nov 14 09:46:58 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:46:59 user nova-compute[75229]: DEBUG nova.compute.provider_tree [None req-eb918dde-e7e0-4f7e-b75e-b509fdba5631 tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] Inventory has not changed in ProviderTree for provider: d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 {{(pid=75229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 09:46:59 user nova-compute[75229]: DEBUG nova.scheduler.client.report [None req-eb918dde-e7e0-4f7e-b75e-b509fdba5631 tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] Inventory has not changed for provider d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 09:46:59 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-eb918dde-e7e0-4f7e-b75e-b509fdba5631 tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.386s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:46:59 user nova-compute[75229]: DEBUG nova.compute.manager [None req-eb918dde-e7e0-4f7e-b75e-b509fdba5631 tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] [instance: 38f30682-2278-40aa-914e-2867e771eb19] Start building networks asynchronously for instance. {{(pid=75229) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 09:46:59 user nova-compute[75229]: DEBUG nova.compute.manager [None req-eb918dde-e7e0-4f7e-b75e-b509fdba5631 tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] [instance: 38f30682-2278-40aa-914e-2867e771eb19] Allocating IP information in the background. {{(pid=75229) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 09:46:59 user nova-compute[75229]: DEBUG nova.network.neutron [None req-eb918dde-e7e0-4f7e-b75e-b509fdba5631 tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] [instance: 38f30682-2278-40aa-914e-2867e771eb19] allocate_for_instance() {{(pid=75229) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 09:46:59 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-eb918dde-e7e0-4f7e-b75e-b509fdba5631 tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] [instance: 38f30682-2278-40aa-914e-2867e771eb19] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 09:46:59 user nova-compute[75229]: DEBUG nova.compute.manager [None req-eb918dde-e7e0-4f7e-b75e-b509fdba5631 tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] [instance: 38f30682-2278-40aa-914e-2867e771eb19] Start building block device mappings for instance. {{(pid=75229) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 09:46:59 user nova-compute[75229]: DEBUG nova.policy [None req-eb918dde-e7e0-4f7e-b75e-b509fdba5631 tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ce091bb40ce04afeb988be064cbe673a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6026f6867f00423283219da921bef367', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75229) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 09:46:59 user nova-compute[75229]: DEBUG nova.compute.manager [None req-eb918dde-e7e0-4f7e-b75e-b509fdba5631 tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] [instance: 38f30682-2278-40aa-914e-2867e771eb19] Start spawning the instance on the hypervisor. {{(pid=75229) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 09:46:59 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-eb918dde-e7e0-4f7e-b75e-b509fdba5631 tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] [instance: 38f30682-2278-40aa-914e-2867e771eb19] Creating instance directory {{(pid=75229) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 09:46:59 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-eb918dde-e7e0-4f7e-b75e-b509fdba5631 tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] [instance: 38f30682-2278-40aa-914e-2867e771eb19] Creating image(s)
Nov 14 09:46:59 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-eb918dde-e7e0-4f7e-b75e-b509fdba5631 tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] Acquiring lock "/opt/stack/data/nova/instances/38f30682-2278-40aa-914e-2867e771eb19/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:46:59 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-eb918dde-e7e0-4f7e-b75e-b509fdba5631 tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] Lock "/opt/stack/data/nova/instances/38f30682-2278-40aa-914e-2867e771eb19/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:46:59 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-eb918dde-e7e0-4f7e-b75e-b509fdba5631 tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] Lock "/opt/stack/data/nova/instances/38f30682-2278-40aa-914e-2867e771eb19/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:46:59 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-eb918dde-e7e0-4f7e-b75e-b509fdba5631 tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6 --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:46:59 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-eb918dde-e7e0-4f7e-b75e-b509fdba5631 tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6 --force-share --output=json" returned: 0 in 0.185s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:46:59 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-eb918dde-e7e0-4f7e-b75e-b509fdba5631 tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] Acquiring lock "4f30e3fe703d2381679612a57b1fb80a467f60b6" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:46:59 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-eb918dde-e7e0-4f7e-b75e-b509fdba5631 tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] Lock "4f30e3fe703d2381679612a57b1fb80a467f60b6" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:46:59 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-eb918dde-e7e0-4f7e-b75e-b509fdba5631 tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6 --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:46:59 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-eb918dde-e7e0-4f7e-b75e-b509fdba5631 tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6 --force-share --output=json" returned: 0 in 0.202s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:46:59 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-eb918dde-e7e0-4f7e-b75e-b509fdba5631 tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6,backing_fmt=raw /opt/stack/data/nova/instances/38f30682-2278-40aa-914e-2867e771eb19/disk 1073741824 {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:46:59 user nova-compute[75229]: DEBUG nova.network.neutron [None req-eb918dde-e7e0-4f7e-b75e-b509fdba5631 tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] [instance: 38f30682-2278-40aa-914e-2867e771eb19] Successfully created port: 68bf11fd-3f67-41f3-a6c8-b6ef1bbfd979 {{(pid=75229) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 09:46:59 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-eb918dde-e7e0-4f7e-b75e-b509fdba5631 tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6,backing_fmt=raw /opt/stack/data/nova/instances/38f30682-2278-40aa-914e-2867e771eb19/disk 1073741824" returned: 0 in 0.062s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:46:59 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-eb918dde-e7e0-4f7e-b75e-b509fdba5631 tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] Lock "4f30e3fe703d2381679612a57b1fb80a467f60b6" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.271s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:46:59 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-eb918dde-e7e0-4f7e-b75e-b509fdba5631 tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6 --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:46:59 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-eb918dde-e7e0-4f7e-b75e-b509fdba5631 tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6 --force-share --output=json" returned: 0 in 0.174s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:46:59 user nova-compute[75229]: DEBUG nova.virt.disk.api [None req-eb918dde-e7e0-4f7e-b75e-b509fdba5631 tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] Checking if we can resize image /opt/stack/data/nova/instances/38f30682-2278-40aa-914e-2867e771eb19/disk. size=1073741824 {{(pid=75229) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 09:46:59 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-eb918dde-e7e0-4f7e-b75e-b509fdba5631 tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38f30682-2278-40aa-914e-2867e771eb19/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:47:00 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-eb918dde-e7e0-4f7e-b75e-b509fdba5631 tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38f30682-2278-40aa-914e-2867e771eb19/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:47:00 user nova-compute[75229]: DEBUG nova.virt.disk.api [None req-eb918dde-e7e0-4f7e-b75e-b509fdba5631 tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] Cannot resize image /opt/stack/data/nova/instances/38f30682-2278-40aa-914e-2867e771eb19/disk to a smaller size. {{(pid=75229) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 09:47:00 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-eb918dde-e7e0-4f7e-b75e-b509fdba5631 tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] [instance: 38f30682-2278-40aa-914e-2867e771eb19] Created local disks {{(pid=75229) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 09:47:00 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-eb918dde-e7e0-4f7e-b75e-b509fdba5631 tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] [instance: 38f30682-2278-40aa-914e-2867e771eb19] Ensure instance console log exists: /opt/stack/data/nova/instances/38f30682-2278-40aa-914e-2867e771eb19/console.log {{(pid=75229) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 09:47:00 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-eb918dde-e7e0-4f7e-b75e-b509fdba5631 tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:47:00 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-eb918dde-e7e0-4f7e-b75e-b509fdba5631 tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:47:00 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-eb918dde-e7e0-4f7e-b75e-b509fdba5631 tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:47:00 user nova-compute[75229]: DEBUG nova.network.neutron [None req-eb918dde-e7e0-4f7e-b75e-b509fdba5631 tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] [instance: 38f30682-2278-40aa-914e-2867e771eb19] Successfully updated port: 68bf11fd-3f67-41f3-a6c8-b6ef1bbfd979 {{(pid=75229) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 09:47:00 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-eb918dde-e7e0-4f7e-b75e-b509fdba5631 tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] Acquiring lock "refresh_cache-38f30682-2278-40aa-914e-2867e771eb19" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 09:47:00 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-eb918dde-e7e0-4f7e-b75e-b509fdba5631 tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] Acquired lock "refresh_cache-38f30682-2278-40aa-914e-2867e771eb19" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 09:47:00 user nova-compute[75229]: DEBUG nova.network.neutron [None req-eb918dde-e7e0-4f7e-b75e-b509fdba5631 tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] [instance: 38f30682-2278-40aa-914e-2867e771eb19] Building network info cache for instance {{(pid=75229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 09:47:00 user nova-compute[75229]: DEBUG nova.compute.manager [req-065864e7-8ccf-4715-bc6f-3029116846dc req-11fd85bc-44f8-49e3-823e-15ad5f6fab63 service nova] [instance: 38f30682-2278-40aa-914e-2867e771eb19] Received event network-changed-68bf11fd-3f67-41f3-a6c8-b6ef1bbfd979 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:47:00 user nova-compute[75229]: DEBUG nova.compute.manager [req-065864e7-8ccf-4715-bc6f-3029116846dc req-11fd85bc-44f8-49e3-823e-15ad5f6fab63 service nova] [instance: 38f30682-2278-40aa-914e-2867e771eb19] Refreshing instance network info cache due to event network-changed-68bf11fd-3f67-41f3-a6c8-b6ef1bbfd979. {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 09:47:00 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-065864e7-8ccf-4715-bc6f-3029116846dc req-11fd85bc-44f8-49e3-823e-15ad5f6fab63 service nova] Acquiring lock "refresh_cache-38f30682-2278-40aa-914e-2867e771eb19" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 09:47:00 user nova-compute[75229]: DEBUG nova.network.neutron [None req-eb918dde-e7e0-4f7e-b75e-b509fdba5631 tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] [instance: 38f30682-2278-40aa-914e-2867e771eb19] Instance cache missing network info. {{(pid=75229) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 09:47:00 user nova-compute[75229]: DEBUG nova.network.neutron [None req-eb918dde-e7e0-4f7e-b75e-b509fdba5631 tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] [instance: 38f30682-2278-40aa-914e-2867e771eb19] Updating instance_info_cache with network_info: [{"id": "68bf11fd-3f67-41f3-a6c8-b6ef1bbfd979", "address": "fa:16:3e:3c:89:4e", "network": {"id": "9ace077c-6658-4348-ac9b-f6be125b4f0f", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1010403250-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6026f6867f00423283219da921bef367", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68bf11fd-3f", "ovs_interfaceid": "68bf11fd-3f67-41f3-a6c8-b6ef1bbfd979", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 09:47:00 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-eb918dde-e7e0-4f7e-b75e-b509fdba5631 tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] Releasing lock "refresh_cache-38f30682-2278-40aa-914e-2867e771eb19" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 09:47:00 user nova-compute[75229]: DEBUG nova.compute.manager [None req-eb918dde-e7e0-4f7e-b75e-b509fdba5631 tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] [instance: 38f30682-2278-40aa-914e-2867e771eb19] Instance network_info: |[{"id": "68bf11fd-3f67-41f3-a6c8-b6ef1bbfd979", "address": "fa:16:3e:3c:89:4e", "network": {"id": "9ace077c-6658-4348-ac9b-f6be125b4f0f", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1010403250-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6026f6867f00423283219da921bef367", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68bf11fd-3f", "ovs_interfaceid": "68bf11fd-3f67-41f3-a6c8-b6ef1bbfd979", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75229) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 09:47:00 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-065864e7-8ccf-4715-bc6f-3029116846dc req-11fd85bc-44f8-49e3-823e-15ad5f6fab63 service nova] Acquired lock "refresh_cache-38f30682-2278-40aa-914e-2867e771eb19" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 09:47:00 user nova-compute[75229]: DEBUG nova.network.neutron [req-065864e7-8ccf-4715-bc6f-3029116846dc req-11fd85bc-44f8-49e3-823e-15ad5f6fab63 service nova] [instance: 38f30682-2278-40aa-914e-2867e771eb19] Refreshing network info cache for port 68bf11fd-3f67-41f3-a6c8-b6ef1bbfd979 {{(pid=75229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 09:47:00 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-eb918dde-e7e0-4f7e-b75e-b509fdba5631 tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] [instance: 38f30682-2278-40aa-914e-2867e771eb19] Start _get_guest_xml network_info=[{"id": "68bf11fd-3f67-41f3-a6c8-b6ef1bbfd979", "address": "fa:16:3e:3c:89:4e", "network": {"id": "9ace077c-6658-4348-ac9b-f6be125b4f0f", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1010403250-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6026f6867f00423283219da921bef367", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68bf11fd-3f", "ovs_interfaceid": "68bf11fd-3f67-41f3-a6c8-b6ef1bbfd979", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T09:40:10Z,direct_url=<?>,disk_format='qcow2',id=3bef8470-ecc7-40e3-95d4-9254348ea72d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='de5a91106b6948ed937a7178ff9464c4',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T09:40:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'disk_bus': 'virtio', 'guest_format': None, 'encryption_secret_uuid': None, 'size': 0, 'device_type': 'disk', 'image_id': '3bef8470-ecc7-40e3-95d4-9254348ea72d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75229) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 09:47:00 user nova-compute[75229]: WARNING nova.virt.libvirt.driver [None req-eb918dde-e7e0-4f7e-b75e-b509fdba5631 tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 09:47:00 user nova-compute[75229]: WARNING nova.virt.libvirt.driver [None req-eb918dde-e7e0-4f7e-b75e-b509fdba5631 tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 09:47:00 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-eb918dde-e7e0-4f7e-b75e-b509fdba5631 tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75229) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 09:47:00 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-eb918dde-e7e0-4f7e-b75e-b509fdba5631 tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] CPU controller missing on host. {{(pid=75229) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 09:47:00 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-eb918dde-e7e0-4f7e-b75e-b509fdba5631 tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75229) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 09:47:00 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-eb918dde-e7e0-4f7e-b75e-b509fdba5631 tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] CPU controller found on host. {{(pid=75229) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 09:47:00 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-eb918dde-e7e0-4f7e-b75e-b509fdba5631 tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75229) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 09:47:00 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-eb918dde-e7e0-4f7e-b75e-b509fdba5631 tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T09:39:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T09:40:10Z,direct_url=<?>,disk_format='qcow2',id=3bef8470-ecc7-40e3-95d4-9254348ea72d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='de5a91106b6948ed937a7178ff9464c4',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T09:40:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 09:47:00 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-eb918dde-e7e0-4f7e-b75e-b509fdba5631 tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] Flavor limits 0:0:0 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 09:47:00 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-eb918dde-e7e0-4f7e-b75e-b509fdba5631 tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] Image limits 0:0:0 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 09:47:00 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-eb918dde-e7e0-4f7e-b75e-b509fdba5631 tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] Flavor pref 0:0:0 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 09:47:00 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-eb918dde-e7e0-4f7e-b75e-b509fdba5631 tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] Image pref 0:0:0 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 09:47:00 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-eb918dde-e7e0-4f7e-b75e-b509fdba5631 tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 09:47:00 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-eb918dde-e7e0-4f7e-b75e-b509fdba5631 tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 09:47:00 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-eb918dde-e7e0-4f7e-b75e-b509fdba5631 tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75229) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 09:47:00 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-eb918dde-e7e0-4f7e-b75e-b509fdba5631 tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] Got 1 possible topologies {{(pid=75229) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 09:47:00 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-eb918dde-e7e0-4f7e-b75e-b509fdba5631 tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 09:47:00 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-eb918dde-e7e0-4f7e-b75e-b509fdba5631 tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 09:47:01 user nova-compute[75229]: DEBUG nova.virt.libvirt.vif [None req-eb918dde-e7e0-4f7e-b75e-b509fdba5631 tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T09:46:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1066646083',display_name='tempest-VolumesAdminNegativeTest-server-1066646083',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1066646083',id=13,image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6026f6867f00423283219da921bef367',ramdisk_id='',reservation_id='r-ney68s17',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-333811129',owner_user_name='tempest-VolumesAdminNegativeTest-333811129-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T09:46:59Z,user_data=None,user_id='ce091bb40ce04afeb988be064cbe673a',uuid=38f30682-2278-40aa-914e-2867e771eb19,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "68bf11fd-3f67-41f3-a6c8-b6ef1bbfd979", "address": "fa:16:3e:3c:89:4e", "network": {"id": "9ace077c-6658-4348-ac9b-f6be125b4f0f", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1010403250-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6026f6867f00423283219da921bef367", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68bf11fd-3f", "ovs_interfaceid": "68bf11fd-3f67-41f3-a6c8-b6ef1bbfd979", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75229) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 09:47:01 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-eb918dde-e7e0-4f7e-b75e-b509fdba5631 tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] Converting VIF {"id": "68bf11fd-3f67-41f3-a6c8-b6ef1bbfd979", "address": "fa:16:3e:3c:89:4e", "network": {"id": "9ace077c-6658-4348-ac9b-f6be125b4f0f", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1010403250-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6026f6867f00423283219da921bef367", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68bf11fd-3f", "ovs_interfaceid": "68bf11fd-3f67-41f3-a6c8-b6ef1bbfd979", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 09:47:01 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-eb918dde-e7e0-4f7e-b75e-b509fdba5631 tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3c:89:4e,bridge_name='br-int',has_traffic_filtering=True,id=68bf11fd-3f67-41f3-a6c8-b6ef1bbfd979,network=Network(9ace077c-6658-4348-ac9b-f6be125b4f0f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68bf11fd-3f') {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 09:47:01 user nova-compute[75229]: DEBUG nova.objects.instance [None req-eb918dde-e7e0-4f7e-b75e-b509fdba5631 tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] Lazy-loading 'pci_devices' on Instance uuid 38f30682-2278-40aa-914e-2867e771eb19 {{(pid=75229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 09:47:01 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-eb918dde-e7e0-4f7e-b75e-b509fdba5631 tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] [instance: 38f30682-2278-40aa-914e-2867e771eb19] End _get_guest_xml xml=<domain type="kvm">
Nov 14 09:47:01 user nova-compute[75229]:   <uuid>38f30682-2278-40aa-914e-2867e771eb19</uuid>
Nov 14 09:47:01 user nova-compute[75229]:   <name>instance-0000000d</name>
Nov 14 09:47:01 user nova-compute[75229]:   <memory>524288</memory>
Nov 14 09:47:01 user nova-compute[75229]:   <vcpu>1</vcpu>
Nov 14 09:47:01 user nova-compute[75229]:   <metadata>
Nov 14 09:47:01 user nova-compute[75229]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 09:47:01 user nova-compute[75229]:       <nova:package version="0.0.0"/>
Nov 14 09:47:01 user nova-compute[75229]:       <nova:name>tempest-VolumesAdminNegativeTest-server-1066646083</nova:name>
Nov 14 09:47:01 user nova-compute[75229]:       <nova:creationTime>2023-11-14 09:47:00</nova:creationTime>
Nov 14 09:47:01 user nova-compute[75229]:       <nova:flavor name="m1.tiny">
Nov 14 09:47:01 user nova-compute[75229]:         <nova:memory>512</nova:memory>
Nov 14 09:47:01 user nova-compute[75229]:         <nova:disk>1</nova:disk>
Nov 14 09:47:01 user nova-compute[75229]:         <nova:swap>0</nova:swap>
Nov 14 09:47:01 user nova-compute[75229]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 09:47:01 user nova-compute[75229]:         <nova:vcpus>1</nova:vcpus>
Nov 14 09:47:01 user nova-compute[75229]:       </nova:flavor>
Nov 14 09:47:01 user nova-compute[75229]:       <nova:owner>
Nov 14 09:47:01 user nova-compute[75229]:         <nova:user uuid="ce091bb40ce04afeb988be064cbe673a">tempest-VolumesAdminNegativeTest-333811129-project-member</nova:user>
Nov 14 09:47:01 user nova-compute[75229]:         <nova:project uuid="6026f6867f00423283219da921bef367">tempest-VolumesAdminNegativeTest-333811129</nova:project>
Nov 14 09:47:01 user nova-compute[75229]:       </nova:owner>
Nov 14 09:47:01 user nova-compute[75229]:       <nova:root type="image" uuid="3bef8470-ecc7-40e3-95d4-9254348ea72d"/>
Nov 14 09:47:01 user nova-compute[75229]:       <nova:ports>
Nov 14 09:47:01 user nova-compute[75229]:         <nova:port uuid="68bf11fd-3f67-41f3-a6c8-b6ef1bbfd979">
Nov 14 09:47:01 user nova-compute[75229]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 14 09:47:01 user nova-compute[75229]:         </nova:port>
Nov 14 09:47:01 user nova-compute[75229]:       </nova:ports>
Nov 14 09:47:01 user nova-compute[75229]:     </nova:instance>
Nov 14 09:47:01 user nova-compute[75229]:   </metadata>
Nov 14 09:47:01 user nova-compute[75229]:   <sysinfo type="smbios">
Nov 14 09:47:01 user nova-compute[75229]:     <system>
Nov 14 09:47:01 user nova-compute[75229]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 09:47:01 user nova-compute[75229]:       <entry name="product">OpenStack Nova</entry>
Nov 14 09:47:01 user nova-compute[75229]:       <entry name="version">0.0.0</entry>
Nov 14 09:47:01 user nova-compute[75229]:       <entry name="serial">38f30682-2278-40aa-914e-2867e771eb19</entry>
Nov 14 09:47:01 user nova-compute[75229]:       <entry name="uuid">38f30682-2278-40aa-914e-2867e771eb19</entry>
Nov 14 09:47:01 user nova-compute[75229]:       <entry name="family">Virtual Machine</entry>
Nov 14 09:47:01 user nova-compute[75229]:     </system>
Nov 14 09:47:01 user nova-compute[75229]:   </sysinfo>
Nov 14 09:47:01 user nova-compute[75229]:   <os>
Nov 14 09:47:01 user nova-compute[75229]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 09:47:01 user nova-compute[75229]:     <boot dev="hd"/>
Nov 14 09:47:01 user nova-compute[75229]:     <smbios mode="sysinfo"/>
Nov 14 09:47:01 user nova-compute[75229]:   </os>
Nov 14 09:47:01 user nova-compute[75229]:   <features>
Nov 14 09:47:01 user nova-compute[75229]:     <acpi/>
Nov 14 09:47:01 user nova-compute[75229]:     <apic/>
Nov 14 09:47:01 user nova-compute[75229]:     <vmcoreinfo/>
Nov 14 09:47:01 user nova-compute[75229]:   </features>
Nov 14 09:47:01 user nova-compute[75229]:   <clock offset="utc">
Nov 14 09:47:01 user nova-compute[75229]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 09:47:01 user nova-compute[75229]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 09:47:01 user nova-compute[75229]:     <timer name="hpet" present="no"/>
Nov 14 09:47:01 user nova-compute[75229]:   </clock>
Nov 14 09:47:01 user nova-compute[75229]:   <cpu mode="custom" match="exact">
Nov 14 09:47:01 user nova-compute[75229]:     <model>Nehalem</model>
Nov 14 09:47:01 user nova-compute[75229]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 09:47:01 user nova-compute[75229]:   </cpu>
Nov 14 09:47:01 user nova-compute[75229]:   <devices>
Nov 14 09:47:01 user nova-compute[75229]:     <disk type="file" device="disk">
Nov 14 09:47:01 user nova-compute[75229]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 09:47:01 user nova-compute[75229]:       <source file="/opt/stack/data/nova/instances/38f30682-2278-40aa-914e-2867e771eb19/disk"/>
Nov 14 09:47:01 user nova-compute[75229]:       <target dev="vda" bus="virtio"/>
Nov 14 09:47:01 user nova-compute[75229]:     </disk>
Nov 14 09:47:01 user nova-compute[75229]:     <interface type="ethernet">
Nov 14 09:47:01 user nova-compute[75229]:       <mac address="fa:16:3e:3c:89:4e"/>
Nov 14 09:47:01 user nova-compute[75229]:       <model type="virtio"/>
Nov 14 09:47:01 user nova-compute[75229]:       <mtu size="1442"/>
Nov 14 09:47:01 user nova-compute[75229]:       <target dev="tap68bf11fd-3f"/>
Nov 14 09:47:01 user nova-compute[75229]:     </interface>
Nov 14 09:47:01 user nova-compute[75229]:     <serial type="pty">
Nov 14 09:47:01 user nova-compute[75229]:       <log file="/opt/stack/data/nova/instances/38f30682-2278-40aa-914e-2867e771eb19/console.log" append="off"/>
Nov 14 09:47:01 user nova-compute[75229]:     </serial>
Nov 14 09:47:01 user nova-compute[75229]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 09:47:01 user nova-compute[75229]:     <video>
Nov 14 09:47:01 user nova-compute[75229]:       <model type="virtio"/>
Nov 14 09:47:01 user nova-compute[75229]:     </video>
Nov 14 09:47:01 user nova-compute[75229]:     <rng model="virtio">
Nov 14 09:47:01 user nova-compute[75229]:       <backend model="random">/dev/urandom</backend>
Nov 14 09:47:01 user nova-compute[75229]:     </rng>
Nov 14 09:47:01 user nova-compute[75229]:     <controller type="usb" index="0" model="none"/>
Nov 14 09:47:01 user nova-compute[75229]:     <memballoon model="virtio">
Nov 14 09:47:01 user nova-compute[75229]:       <stats period="10"/>
Nov 14 09:47:01 user nova-compute[75229]:     </memballoon>
Nov 14 09:47:01 user nova-compute[75229]:   </devices>
Nov 14 09:47:01 user nova-compute[75229]: </domain>
Nov 14 09:47:01 user nova-compute[75229]:  {{(pid=75229) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 09:47:01 user nova-compute[75229]: DEBUG nova.virt.libvirt.vif [None req-eb918dde-e7e0-4f7e-b75e-b509fdba5631 tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T09:46:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1066646083',display_name='tempest-VolumesAdminNegativeTest-server-1066646083',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1066646083',id=13,image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6026f6867f00423283219da921bef367',ramdisk_id='',reservation_id='r-ney68s17',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-333811129',owner_user_name='tempest-VolumesAdminNegativeTest-333811129-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T09:46:59Z,user_data=None,user_id='ce091bb40ce04afeb988be064cbe673a',uuid=38f30682-2278-40aa-914e-2867e771eb19,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "68bf11fd-3f67-41f3-a6c8-b6ef1bbfd979", "address": "fa:16:3e:3c:89:4e", "network": {"id": "9ace077c-6658-4348-ac9b-f6be125b4f0f", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1010403250-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6026f6867f00423283219da921bef367", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68bf11fd-3f", "ovs_interfaceid": "68bf11fd-3f67-41f3-a6c8-b6ef1bbfd979", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 09:47:01 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-eb918dde-e7e0-4f7e-b75e-b509fdba5631 tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] Converting VIF {"id": "68bf11fd-3f67-41f3-a6c8-b6ef1bbfd979", "address": "fa:16:3e:3c:89:4e", "network": {"id": "9ace077c-6658-4348-ac9b-f6be125b4f0f", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1010403250-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6026f6867f00423283219da921bef367", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68bf11fd-3f", "ovs_interfaceid": "68bf11fd-3f67-41f3-a6c8-b6ef1bbfd979", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 09:47:01 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-eb918dde-e7e0-4f7e-b75e-b509fdba5631 tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3c:89:4e,bridge_name='br-int',has_traffic_filtering=True,id=68bf11fd-3f67-41f3-a6c8-b6ef1bbfd979,network=Network(9ace077c-6658-4348-ac9b-f6be125b4f0f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68bf11fd-3f') {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 09:47:01 user nova-compute[75229]: DEBUG os_vif [None req-eb918dde-e7e0-4f7e-b75e-b509fdba5631 tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3c:89:4e,bridge_name='br-int',has_traffic_filtering=True,id=68bf11fd-3f67-41f3-a6c8-b6ef1bbfd979,network=Network(9ace077c-6658-4348-ac9b-f6be125b4f0f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68bf11fd-3f') {{(pid=75229) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 09:47:01 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:47:01 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:47:01 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 09:47:01 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:47:01 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5c55e0ed-b2f5-540c-a625-107eb50ecaf2', '_type': 'linux-noop'}}, row=False) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:47:01 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 09:47:01 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:47:01 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:47:01 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap68bf11fd-3f, may_exist=True, interface_attrs={}) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:47:01 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap68bf11fd-3f, col_values=(('qos', UUID('76a2d398-27c9-4d19-8581-d9cc451b65af')),), if_exists=True) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:47:01 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap68bf11fd-3f, col_values=(('external_ids', {'iface-id': '68bf11fd-3f67-41f3-a6c8-b6ef1bbfd979', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3c:89:4e', 'vm-uuid': '38f30682-2278-40aa-914e-2867e771eb19'}),), if_exists=True) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:47:01 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 09:47:01 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:47:01 user nova-compute[75229]: INFO os_vif [None req-eb918dde-e7e0-4f7e-b75e-b509fdba5631 tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3c:89:4e,bridge_name='br-int',has_traffic_filtering=True,id=68bf11fd-3f67-41f3-a6c8-b6ef1bbfd979,network=Network(9ace077c-6658-4348-ac9b-f6be125b4f0f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68bf11fd-3f')
Nov 14 09:47:01 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-eb918dde-e7e0-4f7e-b75e-b509fdba5631 tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] No BDM found with device name vda, not building metadata. {{(pid=75229) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 09:47:01 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-eb918dde-e7e0-4f7e-b75e-b509fdba5631 tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] No VIF found with MAC fa:16:3e:3c:89:4e, not building metadata {{(pid=75229) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 09:47:01 user nova-compute[75229]: DEBUG nova.network.neutron [req-065864e7-8ccf-4715-bc6f-3029116846dc req-11fd85bc-44f8-49e3-823e-15ad5f6fab63 service nova] [instance: 38f30682-2278-40aa-914e-2867e771eb19] Updated VIF entry in instance network info cache for port 68bf11fd-3f67-41f3-a6c8-b6ef1bbfd979. {{(pid=75229) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 09:47:01 user nova-compute[75229]: DEBUG nova.network.neutron [req-065864e7-8ccf-4715-bc6f-3029116846dc req-11fd85bc-44f8-49e3-823e-15ad5f6fab63 service nova] [instance: 38f30682-2278-40aa-914e-2867e771eb19] Updating instance_info_cache with network_info: [{"id": "68bf11fd-3f67-41f3-a6c8-b6ef1bbfd979", "address": "fa:16:3e:3c:89:4e", "network": {"id": "9ace077c-6658-4348-ac9b-f6be125b4f0f", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1010403250-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6026f6867f00423283219da921bef367", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68bf11fd-3f", "ovs_interfaceid": "68bf11fd-3f67-41f3-a6c8-b6ef1bbfd979", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 09:47:01 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-065864e7-8ccf-4715-bc6f-3029116846dc req-11fd85bc-44f8-49e3-823e-15ad5f6fab63 service nova] Releasing lock "refresh_cache-38f30682-2278-40aa-914e-2867e771eb19" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 09:47:02 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:47:02 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:47:02 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:47:02 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:47:02 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:47:02 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:47:02 user nova-compute[75229]: DEBUG nova.compute.manager [req-c1246254-1b03-4ccb-bfac-1213a54eeff5 req-098a148e-c61b-41b5-8579-7492e2e7933a service nova] [instance: 38f30682-2278-40aa-914e-2867e771eb19] Received event network-vif-plugged-68bf11fd-3f67-41f3-a6c8-b6ef1bbfd979 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:47:02 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-c1246254-1b03-4ccb-bfac-1213a54eeff5 req-098a148e-c61b-41b5-8579-7492e2e7933a service nova] Acquiring lock "38f30682-2278-40aa-914e-2867e771eb19-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:47:02 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-c1246254-1b03-4ccb-bfac-1213a54eeff5 req-098a148e-c61b-41b5-8579-7492e2e7933a service nova] Lock "38f30682-2278-40aa-914e-2867e771eb19-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:47:02 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-c1246254-1b03-4ccb-bfac-1213a54eeff5 req-098a148e-c61b-41b5-8579-7492e2e7933a service nova] Lock "38f30682-2278-40aa-914e-2867e771eb19-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:47:02 user nova-compute[75229]: DEBUG nova.compute.manager [req-c1246254-1b03-4ccb-bfac-1213a54eeff5 req-098a148e-c61b-41b5-8579-7492e2e7933a service nova] [instance: 38f30682-2278-40aa-914e-2867e771eb19] No waiting events found dispatching network-vif-plugged-68bf11fd-3f67-41f3-a6c8-b6ef1bbfd979 {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 09:47:02 user nova-compute[75229]: WARNING nova.compute.manager [req-c1246254-1b03-4ccb-bfac-1213a54eeff5 req-098a148e-c61b-41b5-8579-7492e2e7933a service nova] [instance: 38f30682-2278-40aa-914e-2867e771eb19] Received unexpected event network-vif-plugged-68bf11fd-3f67-41f3-a6c8-b6ef1bbfd979 for instance with vm_state building and task_state spawning.
Nov 14 09:47:02 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:47:04 user nova-compute[75229]: DEBUG nova.compute.manager [None req-eb918dde-e7e0-4f7e-b75e-b509fdba5631 tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] [instance: 38f30682-2278-40aa-914e-2867e771eb19] Instance event wait completed in 0 seconds for  {{(pid=75229) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 09:47:04 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-eb918dde-e7e0-4f7e-b75e-b509fdba5631 tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] [instance: 38f30682-2278-40aa-914e-2867e771eb19] Guest created on hypervisor {{(pid=75229) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 09:47:04 user nova-compute[75229]: INFO nova.virt.libvirt.driver [-] [instance: 38f30682-2278-40aa-914e-2867e771eb19] Instance spawned successfully.
Nov 14 09:47:04 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-eb918dde-e7e0-4f7e-b75e-b509fdba5631 tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] [instance: 38f30682-2278-40aa-914e-2867e771eb19] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 09:47:04 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-eb918dde-e7e0-4f7e-b75e-b509fdba5631 tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] [instance: 38f30682-2278-40aa-914e-2867e771eb19] Found default for hw_cdrom_bus of ide {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 09:47:04 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-eb918dde-e7e0-4f7e-b75e-b509fdba5631 tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] [instance: 38f30682-2278-40aa-914e-2867e771eb19] Found default for hw_disk_bus of virtio {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 09:47:04 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-eb918dde-e7e0-4f7e-b75e-b509fdba5631 tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] [instance: 38f30682-2278-40aa-914e-2867e771eb19] Found default for hw_input_bus of None {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 09:47:04 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-eb918dde-e7e0-4f7e-b75e-b509fdba5631 tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] [instance: 38f30682-2278-40aa-914e-2867e771eb19] Found default for hw_pointer_model of None {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 09:47:04 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-eb918dde-e7e0-4f7e-b75e-b509fdba5631 tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] [instance: 38f30682-2278-40aa-914e-2867e771eb19] Found default for hw_video_model of virtio {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 09:47:04 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-eb918dde-e7e0-4f7e-b75e-b509fdba5631 tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] [instance: 38f30682-2278-40aa-914e-2867e771eb19] Found default for hw_vif_model of virtio {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 09:47:04 user nova-compute[75229]: INFO nova.compute.manager [None req-eb918dde-e7e0-4f7e-b75e-b509fdba5631 tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] [instance: 38f30682-2278-40aa-914e-2867e771eb19] Took 5.22 seconds to spawn the instance on the hypervisor.
Nov 14 09:47:04 user nova-compute[75229]: DEBUG nova.compute.manager [None req-eb918dde-e7e0-4f7e-b75e-b509fdba5631 tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] [instance: 38f30682-2278-40aa-914e-2867e771eb19] Checking state {{(pid=75229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 09:47:04 user nova-compute[75229]: INFO nova.compute.manager [None req-eb918dde-e7e0-4f7e-b75e-b509fdba5631 tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] [instance: 38f30682-2278-40aa-914e-2867e771eb19] Took 5.92 seconds to build instance.
Nov 14 09:47:04 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-eb918dde-e7e0-4f7e-b75e-b509fdba5631 tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] Lock "38f30682-2278-40aa-914e-2867e771eb19" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.014s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:47:04 user nova-compute[75229]: DEBUG nova.compute.manager [req-9e78d060-bfc3-4951-82f6-9171d14392df req-77e485d4-d754-4685-9be3-3d9d6a2601a1 service nova] [instance: 38f30682-2278-40aa-914e-2867e771eb19] Received event network-vif-plugged-68bf11fd-3f67-41f3-a6c8-b6ef1bbfd979 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:47:04 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-9e78d060-bfc3-4951-82f6-9171d14392df req-77e485d4-d754-4685-9be3-3d9d6a2601a1 service nova] Acquiring lock "38f30682-2278-40aa-914e-2867e771eb19-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:47:04 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-9e78d060-bfc3-4951-82f6-9171d14392df req-77e485d4-d754-4685-9be3-3d9d6a2601a1 service nova] Lock "38f30682-2278-40aa-914e-2867e771eb19-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:47:04 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-9e78d060-bfc3-4951-82f6-9171d14392df req-77e485d4-d754-4685-9be3-3d9d6a2601a1 service nova] Lock "38f30682-2278-40aa-914e-2867e771eb19-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:47:04 user nova-compute[75229]: DEBUG nova.compute.manager [req-9e78d060-bfc3-4951-82f6-9171d14392df req-77e485d4-d754-4685-9be3-3d9d6a2601a1 service nova] [instance: 38f30682-2278-40aa-914e-2867e771eb19] No waiting events found dispatching network-vif-plugged-68bf11fd-3f67-41f3-a6c8-b6ef1bbfd979 {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 09:47:04 user nova-compute[75229]: WARNING nova.compute.manager [req-9e78d060-bfc3-4951-82f6-9171d14392df req-77e485d4-d754-4685-9be3-3d9d6a2601a1 service nova] [instance: 38f30682-2278-40aa-914e-2867e771eb19] Received unexpected event network-vif-plugged-68bf11fd-3f67-41f3-a6c8-b6ef1bbfd979 for instance with vm_state active and task_state None.
Nov 14 09:47:06 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:47:07 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:47:08 user nova-compute[75229]: WARNING nova.virt.libvirt.driver [None req-8878bf82-dd59-4b10-948d-38eefab3cf0d tempest-TaggedAttachmentsTest-294727221 tempest-TaggedAttachmentsTest-294727221-project-member] Waiting for libvirt event about the detach of device tap1c95e48f-ad with device alias net1 from instance c6fa2298-7111-4660-a162-09269045d5e3 is timed out.
Nov 14 09:47:08 user nova-compute[75229]: DEBUG nova.virt.libvirt.guest [None req-8878bf82-dd59-4b10-948d-38eefab3cf0d tempest-TaggedAttachmentsTest-294727221 tempest-TaggedAttachmentsTest-294727221-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:64:36:66"/><model type="virtio"/><mtu size="1442"/><target dev="tap1c95e48f-ad"/></interface> {{(pid=75229) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 14 09:47:08 user nova-compute[75229]: DEBUG nova.virt.libvirt.guest [None req-8878bf82-dd59-4b10-948d-38eefab3cf0d tempest-TaggedAttachmentsTest-294727221 tempest-TaggedAttachmentsTest-294727221-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:64:36:66"/><model type="virtio"/><mtu size="1442"/><target dev="tap1c95e48f-ad"/></interface>not found in domain: <domain type='kvm' id='8'>
Nov 14 09:47:08 user nova-compute[75229]:   <name>instance-00000008</name>
Nov 14 09:47:08 user nova-compute[75229]:   <uuid>c6fa2298-7111-4660-a162-09269045d5e3</uuid>
Nov 14 09:47:08 user nova-compute[75229]:   <metadata>
Nov 14 09:47:08 user nova-compute[75229]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 09:47:08 user nova-compute[75229]:   <nova:package version="0.0.0"/>
Nov 14 09:47:08 user nova-compute[75229]:   <nova:name>tempest-device-tagging-server-685697079</nova:name>
Nov 14 09:47:08 user nova-compute[75229]:   <nova:creationTime>2023-11-14 09:46:15</nova:creationTime>
Nov 14 09:47:08 user nova-compute[75229]:   <nova:flavor name="m1.tiny">
Nov 14 09:47:08 user nova-compute[75229]:     <nova:memory>512</nova:memory>
Nov 14 09:47:08 user nova-compute[75229]:     <nova:disk>1</nova:disk>
Nov 14 09:47:08 user nova-compute[75229]:     <nova:swap>0</nova:swap>
Nov 14 09:47:08 user nova-compute[75229]:     <nova:ephemeral>0</nova:ephemeral>
Nov 14 09:47:08 user nova-compute[75229]:     <nova:vcpus>1</nova:vcpus>
Nov 14 09:47:08 user nova-compute[75229]:   </nova:flavor>
Nov 14 09:47:08 user nova-compute[75229]:   <nova:owner>
Nov 14 09:47:08 user nova-compute[75229]:     <nova:user uuid="3c818850ce5c41b5b978031cdedfea65">tempest-TaggedAttachmentsTest-294727221-project-member</nova:user>
Nov 14 09:47:08 user nova-compute[75229]:     <nova:project uuid="48b5edeee7494b6e94135faaab6afd50">tempest-TaggedAttachmentsTest-294727221</nova:project>
Nov 14 09:47:08 user nova-compute[75229]:   </nova:owner>
Nov 14 09:47:08 user nova-compute[75229]:   <nova:root type="image" uuid="3bef8470-ecc7-40e3-95d4-9254348ea72d"/>
Nov 14 09:47:08 user nova-compute[75229]:   <nova:ports>
Nov 14 09:47:08 user nova-compute[75229]:     <nova:port uuid="b310b3f2-f842-4918-8540-f9803e259b31">
Nov 14 09:47:08 user nova-compute[75229]:       <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 14 09:47:08 user nova-compute[75229]:     </nova:port>
Nov 14 09:47:08 user nova-compute[75229]:     <nova:port uuid="1c95e48f-ad0e-41b2-8638-ddefc9360154">
Nov 14 09:47:08 user nova-compute[75229]:       <nova:ip type="fixed" address="10.10.10.228" ipVersion="4"/>
Nov 14 09:47:08 user nova-compute[75229]:     </nova:port>
Nov 14 09:47:08 user nova-compute[75229]:   </nova:ports>
Nov 14 09:47:08 user nova-compute[75229]: </nova:instance>
Nov 14 09:47:08 user nova-compute[75229]:   </metadata>
Nov 14 09:47:08 user nova-compute[75229]:   <memory unit='KiB'>524288</memory>
Nov 14 09:47:08 user nova-compute[75229]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 14 09:47:08 user nova-compute[75229]:   <vcpu placement='static'>1</vcpu>
Nov 14 09:47:08 user nova-compute[75229]:   <resource>
Nov 14 09:47:08 user nova-compute[75229]:     <partition>/machine</partition>
Nov 14 09:47:08 user nova-compute[75229]:   </resource>
Nov 14 09:47:08 user nova-compute[75229]:   <sysinfo type='smbios'>
Nov 14 09:47:08 user nova-compute[75229]:     <system>
Nov 14 09:47:08 user nova-compute[75229]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 14 09:47:08 user nova-compute[75229]:       <entry name='product'>OpenStack Nova</entry>
Nov 14 09:47:08 user nova-compute[75229]:       <entry name='version'>0.0.0</entry>
Nov 14 09:47:08 user nova-compute[75229]:       <entry name='serial'>c6fa2298-7111-4660-a162-09269045d5e3</entry>
Nov 14 09:47:08 user nova-compute[75229]:       <entry name='uuid'>c6fa2298-7111-4660-a162-09269045d5e3</entry>
Nov 14 09:47:08 user nova-compute[75229]:       <entry name='family'>Virtual Machine</entry>
Nov 14 09:47:08 user nova-compute[75229]:     </system>
Nov 14 09:47:08 user nova-compute[75229]:   </sysinfo>
Nov 14 09:47:08 user nova-compute[75229]:   <os>
Nov 14 09:47:08 user nova-compute[75229]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 14 09:47:08 user nova-compute[75229]:     <boot dev='hd'/>
Nov 14 09:47:08 user nova-compute[75229]:     <smbios mode='sysinfo'/>
Nov 14 09:47:08 user nova-compute[75229]:   </os>
Nov 14 09:47:08 user nova-compute[75229]:   <features>
Nov 14 09:47:08 user nova-compute[75229]:     <acpi/>
Nov 14 09:47:08 user nova-compute[75229]:     <apic/>
Nov 14 09:47:08 user nova-compute[75229]:     <vmcoreinfo state='on'/>
Nov 14 09:47:08 user nova-compute[75229]:   </features>
Nov 14 09:47:08 user nova-compute[75229]:   <cpu mode='custom' match='exact' check='full'>
Nov 14 09:47:08 user nova-compute[75229]:     <model fallback='forbid'>Nehalem</model>
Nov 14 09:47:08 user nova-compute[75229]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 14 09:47:08 user nova-compute[75229]:     <feature policy='require' name='vme'/>
Nov 14 09:47:08 user nova-compute[75229]:     <feature policy='require' name='x2apic'/>
Nov 14 09:47:08 user nova-compute[75229]:     <feature policy='require' name='hypervisor'/>
Nov 14 09:47:08 user nova-compute[75229]:   </cpu>
Nov 14 09:47:08 user nova-compute[75229]:   <clock offset='utc'>
Nov 14 09:47:08 user nova-compute[75229]:     <timer name='pit' tickpolicy='delay'/>
Nov 14 09:47:08 user nova-compute[75229]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 14 09:47:08 user nova-compute[75229]:     <timer name='hpet' present='no'/>
Nov 14 09:47:08 user nova-compute[75229]:   </clock>
Nov 14 09:47:08 user nova-compute[75229]:   <on_poweroff>destroy</on_poweroff>
Nov 14 09:47:08 user nova-compute[75229]:   <on_reboot>restart</on_reboot>
Nov 14 09:47:08 user nova-compute[75229]:   <on_crash>destroy</on_crash>
Nov 14 09:47:08 user nova-compute[75229]:   <devices>
Nov 14 09:47:08 user nova-compute[75229]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 14 09:47:08 user nova-compute[75229]:     <disk type='file' device='disk'>
Nov 14 09:47:08 user nova-compute[75229]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 14 09:47:08 user nova-compute[75229]:       <source file='/opt/stack/data/nova/instances/c6fa2298-7111-4660-a162-09269045d5e3/disk' index='2'/>
Nov 14 09:47:08 user nova-compute[75229]:       <backingStore type='file' index='3'>
Nov 14 09:47:08 user nova-compute[75229]:         <format type='raw'/>
Nov 14 09:47:08 user nova-compute[75229]:         <source file='/opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6'/>
Nov 14 09:47:08 user nova-compute[75229]:         <backingStore/>
Nov 14 09:47:08 user nova-compute[75229]:       </backingStore>
Nov 14 09:47:08 user nova-compute[75229]:       <target dev='vda' bus='virtio'/>
Nov 14 09:47:08 user nova-compute[75229]:       <alias name='virtio-disk0'/>
Nov 14 09:47:08 user nova-compute[75229]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 14 09:47:08 user nova-compute[75229]:     </disk>
Nov 14 09:47:08 user nova-compute[75229]:     <disk type='file' device='cdrom'>
Nov 14 09:47:08 user nova-compute[75229]:       <driver name='qemu' type='raw' cache='none'/>
Nov 14 09:47:08 user nova-compute[75229]:       <source file='/opt/stack/data/nova/instances/c6fa2298-7111-4660-a162-09269045d5e3/disk.config' index='1'/>
Nov 14 09:47:08 user nova-compute[75229]:       <backingStore/>
Nov 14 09:47:08 user nova-compute[75229]:       <target dev='hda' bus='ide'/>
Nov 14 09:47:08 user nova-compute[75229]:       <readonly/>
Nov 14 09:47:08 user nova-compute[75229]:       <alias name='ide0-0-0'/>
Nov 14 09:47:08 user nova-compute[75229]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 14 09:47:08 user nova-compute[75229]:     </disk>
Nov 14 09:47:08 user nova-compute[75229]:     <controller type='usb' index='0' model='none'>
Nov 14 09:47:08 user nova-compute[75229]:       <alias name='usb'/>
Nov 14 09:47:08 user nova-compute[75229]:     </controller>
Nov 14 09:47:08 user nova-compute[75229]:     <controller type='pci' index='0' model='pci-root'>
Nov 14 09:47:08 user nova-compute[75229]:       <alias name='pci.0'/>
Nov 14 09:47:08 user nova-compute[75229]:     </controller>
Nov 14 09:47:08 user nova-compute[75229]:     <controller type='ide' index='0'>
Nov 14 09:47:08 user nova-compute[75229]:       <alias name='ide'/>
Nov 14 09:47:08 user nova-compute[75229]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 14 09:47:08 user nova-compute[75229]:     </controller>
Nov 14 09:47:08 user nova-compute[75229]:     <interface type='ethernet'>
Nov 14 09:47:08 user nova-compute[75229]:       <mac address='fa:16:3e:90:0c:ec'/>
Nov 14 09:47:08 user nova-compute[75229]:       <target dev='tapb310b3f2-f8'/>
Nov 14 09:47:08 user nova-compute[75229]:       <model type='virtio'/>
Nov 14 09:47:08 user nova-compute[75229]:       <mtu size='1442'/>
Nov 14 09:47:08 user nova-compute[75229]:       <alias name='net0'/>
Nov 14 09:47:08 user nova-compute[75229]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 14 09:47:08 user nova-compute[75229]:     </interface>
Nov 14 09:47:08 user nova-compute[75229]:     <serial type='pty'>
Nov 14 09:47:08 user nova-compute[75229]:       <source path='/dev/pts/7'/>
Nov 14 09:47:08 user nova-compute[75229]:       <log file='/opt/stack/data/nova/instances/c6fa2298-7111-4660-a162-09269045d5e3/console.log' append='off'/>
Nov 14 09:47:08 user nova-compute[75229]:       <target type='isa-serial' port='0'>
Nov 14 09:47:08 user nova-compute[75229]:         <model name='isa-serial'/>
Nov 14 09:47:08 user nova-compute[75229]:       </target>
Nov 14 09:47:08 user nova-compute[75229]:       <alias name='serial0'/>
Nov 14 09:47:08 user nova-compute[75229]:     </serial>
Nov 14 09:47:08 user nova-compute[75229]:     <console type='pty' tty='/dev/pts/7'>
Nov 14 09:47:08 user nova-compute[75229]:       <source path='/dev/pts/7'/>
Nov 14 09:47:08 user nova-compute[75229]:       <log file='/opt/stack/data/nova/instances/c6fa2298-7111-4660-a162-09269045d5e3/console.log' append='off'/>
Nov 14 09:47:08 user nova-compute[75229]:       <target type='serial' port='0'/>
Nov 14 09:47:08 user nova-compute[75229]:       <alias name='serial0'/>
Nov 14 09:47:08 user nova-compute[75229]:     </console>
Nov 14 09:47:08 user nova-compute[75229]:     <input type='mouse' bus='ps2'>
Nov 14 09:47:08 user nova-compute[75229]:       <alias name='input0'/>
Nov 14 09:47:08 user nova-compute[75229]:     </input>
Nov 14 09:47:08 user nova-compute[75229]:     <input type='keyboard' bus='ps2'>
Nov 14 09:47:08 user nova-compute[75229]:       <alias name='input1'/>
Nov 14 09:47:08 user nova-compute[75229]:     </input>
Nov 14 09:47:08 user nova-compute[75229]:     <graphics type='vnc' port='5907' autoport='yes' listen='0.0.0.0'>
Nov 14 09:47:08 user nova-compute[75229]:       <listen type='address' address='0.0.0.0'/>
Nov 14 09:47:08 user nova-compute[75229]:     </graphics>
Nov 14 09:47:08 user nova-compute[75229]:     <audio id='1' type='none'/>
Nov 14 09:47:08 user nova-compute[75229]:     <video>
Nov 14 09:47:08 user nova-compute[75229]:       <model type='virtio' heads='1' primary='yes'/>
Nov 14 09:47:08 user nova-compute[75229]:       <alias name='video0'/>
Nov 14 09:47:08 user nova-compute[75229]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 14 09:47:08 user nova-compute[75229]:     </video>
Nov 14 09:47:08 user nova-compute[75229]:     <memballoon model='virtio'>
Nov 14 09:47:08 user nova-compute[75229]:       <stats period='10'/>
Nov 14 09:47:08 user nova-compute[75229]:       <alias name='balloon0'/>
Nov 14 09:47:08 user nova-compute[75229]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 14 09:47:08 user nova-compute[75229]:     </memballoon>
Nov 14 09:47:08 user nova-compute[75229]:     <rng model='virtio'>
Nov 14 09:47:08 user nova-compute[75229]:       <backend model='random'>/dev/urandom</backend>
Nov 14 09:47:08 user nova-compute[75229]:       <alias name='rng0'/>
Nov 14 09:47:08 user nova-compute[75229]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 14 09:47:08 user nova-compute[75229]:     </rng>
Nov 14 09:47:08 user nova-compute[75229]:   </devices>
Nov 14 09:47:08 user nova-compute[75229]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 14 09:47:08 user nova-compute[75229]:     <label>libvirt-c6fa2298-7111-4660-a162-09269045d5e3</label>
Nov 14 09:47:08 user nova-compute[75229]:     <imagelabel>libvirt-c6fa2298-7111-4660-a162-09269045d5e3</imagelabel>
Nov 14 09:47:08 user nova-compute[75229]:   </seclabel>
Nov 14 09:47:08 user nova-compute[75229]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 14 09:47:08 user nova-compute[75229]:     <label>+64055:+108</label>
Nov 14 09:47:08 user nova-compute[75229]:     <imagelabel>+64055:+108</imagelabel>
Nov 14 09:47:08 user nova-compute[75229]:   </seclabel>
Nov 14 09:47:08 user nova-compute[75229]: </domain>
Nov 14 09:47:08 user nova-compute[75229]:  {{(pid=75229) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 14 09:47:08 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-8878bf82-dd59-4b10-948d-38eefab3cf0d tempest-TaggedAttachmentsTest-294727221 tempest-TaggedAttachmentsTest-294727221-project-member] Successfully detached device tap1c95e48f-ad from instance c6fa2298-7111-4660-a162-09269045d5e3 from the live domain config.
Nov 14 09:47:08 user nova-compute[75229]: DEBUG nova.virt.libvirt.vif [None req-8878bf82-dd59-4b10-948d-38eefab3cf0d tempest-TaggedAttachmentsTest-294727221 tempest-TaggedAttachmentsTest-294727221-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T09:44:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-685697079',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-685697079',id=8,image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAifCLOp7slCaJ90vuibP3D+iXI5GZCQPZCKwFW7R+vCvd5TEqQRxmD+LKPc4egtvjclTc91I+Ts0vc0Y63gnivit1SN7n4OIcVVjbAdupwqjax2fqD52aMGKY+5S2775A==',key_name='tempest-keypair-1995790410',keypairs=<?>,launch_index=0,launched_at=2023-11-14T09:44:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='48b5edeee7494b6e94135faaab6afd50',ramdisk_id='',reservation_id='r-xsfhi8mn',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-294727221',owner_user_name='tempest-TaggedAttachmentsTest-294727221-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T09:44:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3c818850ce5c41b5b978031cdedfea65',uuid=c6fa2298-7111-4660-a162-09269045d5e3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1c95e48f-ad0e-41b2-8638-ddefc9360154", "address": "fa:16:3e:64:36:66", "network": {"id": "843bda3e-9929-4282-9fa6-ed93ebd7afcd", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1455996506", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.228", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "48b5edeee7494b6e94135faaab6afd50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c95e48f-ad", "ovs_interfaceid": "1c95e48f-ad0e-41b2-8638-ddefc9360154", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 09:47:08 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-8878bf82-dd59-4b10-948d-38eefab3cf0d tempest-TaggedAttachmentsTest-294727221 tempest-TaggedAttachmentsTest-294727221-project-member] Converting VIF {"id": "1c95e48f-ad0e-41b2-8638-ddefc9360154", "address": "fa:16:3e:64:36:66", "network": {"id": "843bda3e-9929-4282-9fa6-ed93ebd7afcd", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1455996506", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.228", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "48b5edeee7494b6e94135faaab6afd50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c95e48f-ad", "ovs_interfaceid": "1c95e48f-ad0e-41b2-8638-ddefc9360154", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 09:47:08 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-8878bf82-dd59-4b10-948d-38eefab3cf0d tempest-TaggedAttachmentsTest-294727221 tempest-TaggedAttachmentsTest-294727221-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:64:36:66,bridge_name='br-int',has_traffic_filtering=True,id=1c95e48f-ad0e-41b2-8638-ddefc9360154,network=Network(843bda3e-9929-4282-9fa6-ed93ebd7afcd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1c95e48f-ad') {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 09:47:08 user nova-compute[75229]: DEBUG os_vif [None req-8878bf82-dd59-4b10-948d-38eefab3cf0d tempest-TaggedAttachmentsTest-294727221 tempest-TaggedAttachmentsTest-294727221-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:64:36:66,bridge_name='br-int',has_traffic_filtering=True,id=1c95e48f-ad0e-41b2-8638-ddefc9360154,network=Network(843bda3e-9929-4282-9fa6-ed93ebd7afcd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1c95e48f-ad') {{(pid=75229) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 09:47:08 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:47:08 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1c95e48f-ad, bridge=br-int, if_exists=True) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:47:08 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:47:08 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 09:47:08 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:47:08 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=729c19d4-99d8-49ab-8658-23c9742dbbc5) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:47:08 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:47:08 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:47:08 user nova-compute[75229]: INFO os_vif [None req-8878bf82-dd59-4b10-948d-38eefab3cf0d tempest-TaggedAttachmentsTest-294727221 tempest-TaggedAttachmentsTest-294727221-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:64:36:66,bridge_name='br-int',has_traffic_filtering=True,id=1c95e48f-ad0e-41b2-8638-ddefc9360154,network=Network(843bda3e-9929-4282-9fa6-ed93ebd7afcd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1c95e48f-ad')
Nov 14 09:47:08 user nova-compute[75229]: DEBUG nova.virt.libvirt.guest [None req-8878bf82-dd59-4b10-948d-38eefab3cf0d tempest-TaggedAttachmentsTest-294727221 tempest-TaggedAttachmentsTest-294727221-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 09:47:08 user nova-compute[75229]:   <nova:package version="0.0.0"/>
Nov 14 09:47:08 user nova-compute[75229]:   <nova:name>tempest-device-tagging-server-685697079</nova:name>
Nov 14 09:47:08 user nova-compute[75229]:   <nova:creationTime>2023-11-14 09:47:08</nova:creationTime>
Nov 14 09:47:08 user nova-compute[75229]:   <nova:flavor name="m1.tiny">
Nov 14 09:47:08 user nova-compute[75229]:     <nova:memory>512</nova:memory>
Nov 14 09:47:08 user nova-compute[75229]:     <nova:disk>1</nova:disk>
Nov 14 09:47:08 user nova-compute[75229]:     <nova:swap>0</nova:swap>
Nov 14 09:47:08 user nova-compute[75229]:     <nova:ephemeral>0</nova:ephemeral>
Nov 14 09:47:08 user nova-compute[75229]:     <nova:vcpus>1</nova:vcpus>
Nov 14 09:47:08 user nova-compute[75229]:   </nova:flavor>
Nov 14 09:47:08 user nova-compute[75229]:   <nova:owner>
Nov 14 09:47:08 user nova-compute[75229]:     <nova:user uuid="3c818850ce5c41b5b978031cdedfea65">tempest-TaggedAttachmentsTest-294727221-project-member</nova:user>
Nov 14 09:47:08 user nova-compute[75229]:     <nova:project uuid="48b5edeee7494b6e94135faaab6afd50">tempest-TaggedAttachmentsTest-294727221</nova:project>
Nov 14 09:47:08 user nova-compute[75229]:   </nova:owner>
Nov 14 09:47:08 user nova-compute[75229]:   <nova:root type="image" uuid="3bef8470-ecc7-40e3-95d4-9254348ea72d"/>
Nov 14 09:47:08 user nova-compute[75229]:   <nova:ports>
Nov 14 09:47:08 user nova-compute[75229]:     <nova:port uuid="b310b3f2-f842-4918-8540-f9803e259b31">
Nov 14 09:47:08 user nova-compute[75229]:       <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 14 09:47:08 user nova-compute[75229]:     </nova:port>
Nov 14 09:47:08 user nova-compute[75229]:   </nova:ports>
Nov 14 09:47:08 user nova-compute[75229]: </nova:instance>
Nov 14 09:47:08 user nova-compute[75229]:  {{(pid=75229) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 14 09:47:08 user nova-compute[75229]: DEBUG nova.compute.manager [req-4275d07a-fa76-4829-a82c-1a1cf9f898c1 req-18f9f5c1-8fcd-4be0-a0d1-b888bc654577 service nova] [instance: c6fa2298-7111-4660-a162-09269045d5e3] Received event network-vif-deleted-1c95e48f-ad0e-41b2-8638-ddefc9360154 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:47:08 user nova-compute[75229]: INFO nova.compute.manager [req-4275d07a-fa76-4829-a82c-1a1cf9f898c1 req-18f9f5c1-8fcd-4be0-a0d1-b888bc654577 service nova] [instance: c6fa2298-7111-4660-a162-09269045d5e3] Neutron deleted interface 1c95e48f-ad0e-41b2-8638-ddefc9360154; detaching it from the instance and deleting it from the info cache
Nov 14 09:47:08 user nova-compute[75229]: DEBUG nova.network.neutron [req-4275d07a-fa76-4829-a82c-1a1cf9f898c1 req-18f9f5c1-8fcd-4be0-a0d1-b888bc654577 service nova] [instance: c6fa2298-7111-4660-a162-09269045d5e3] Updating instance_info_cache with network_info: [{"id": "b310b3f2-f842-4918-8540-f9803e259b31", "address": "fa:16:3e:90:0c:ec", "network": {"id": "35508221-011f-4deb-81a1-6dfdae3f2375", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-827518066-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.156", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48b5edeee7494b6e94135faaab6afd50", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb310b3f2-f8", "ovs_interfaceid": "b310b3f2-f842-4918-8540-f9803e259b31", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 09:47:08 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-8878bf82-dd59-4b10-948d-38eefab3cf0d tempest-TaggedAttachmentsTest-294727221 tempest-TaggedAttachmentsTest-294727221-project-member] Acquiring lock "refresh_cache-c6fa2298-7111-4660-a162-09269045d5e3" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 09:47:08 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-8878bf82-dd59-4b10-948d-38eefab3cf0d tempest-TaggedAttachmentsTest-294727221 tempest-TaggedAttachmentsTest-294727221-project-member] Acquired lock "refresh_cache-c6fa2298-7111-4660-a162-09269045d5e3" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 09:47:08 user nova-compute[75229]: DEBUG nova.network.neutron [None req-8878bf82-dd59-4b10-948d-38eefab3cf0d tempest-TaggedAttachmentsTest-294727221 tempest-TaggedAttachmentsTest-294727221-project-member] [instance: c6fa2298-7111-4660-a162-09269045d5e3] Building network info cache for instance {{(pid=75229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 09:47:09 user nova-compute[75229]: DEBUG nova.objects.instance [req-4275d07a-fa76-4829-a82c-1a1cf9f898c1 req-18f9f5c1-8fcd-4be0-a0d1-b888bc654577 service nova] Lazy-loading 'system_metadata' on Instance uuid c6fa2298-7111-4660-a162-09269045d5e3 {{(pid=75229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 09:47:09 user nova-compute[75229]: DEBUG nova.objects.instance [req-4275d07a-fa76-4829-a82c-1a1cf9f898c1 req-18f9f5c1-8fcd-4be0-a0d1-b888bc654577 service nova] Lazy-loading 'flavor' on Instance uuid c6fa2298-7111-4660-a162-09269045d5e3 {{(pid=75229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 09:47:09 user nova-compute[75229]: DEBUG nova.objects.base [req-4275d07a-fa76-4829-a82c-1a1cf9f898c1 req-18f9f5c1-8fcd-4be0-a0d1-b888bc654577 service nova] Object Instance<c6fa2298-7111-4660-a162-09269045d5e3> lazy-loaded attributes: system_metadata,flavor {{(pid=75229) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 09:47:09 user nova-compute[75229]: DEBUG nova.virt.libvirt.vif [req-4275d07a-fa76-4829-a82c-1a1cf9f898c1 req-18f9f5c1-8fcd-4be0-a0d1-b888bc654577 service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T09:44:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-685697079',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-685697079',id=8,image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAifCLOp7slCaJ90vuibP3D+iXI5GZCQPZCKwFW7R+vCvd5TEqQRxmD+LKPc4egtvjclTc91I+Ts0vc0Y63gnivit1SN7n4OIcVVjbAdupwqjax2fqD52aMGKY+5S2775A==',key_name='tempest-keypair-1995790410',keypairs=<?>,launch_index=0,launched_at=2023-11-14T09:44:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='48b5edeee7494b6e94135faaab6afd50',ramdisk_id='',reservation_id='r-xsfhi8mn',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-294727221',owner_user_name='tempest-TaggedAttachmentsTest-294727221-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T09:44:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3c818850ce5c41b5b978031cdedfea65',uuid=c6fa2298-7111-4660-a162-09269045d5e3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1c95e48f-ad0e-41b2-8638-ddefc9360154", "address": "fa:16:3e:64:36:66", "network": {"id": "843bda3e-9929-4282-9fa6-ed93ebd7afcd", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1455996506", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.228", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "48b5edeee7494b6e94135faaab6afd50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c95e48f-ad", "ovs_interfaceid": "1c95e48f-ad0e-41b2-8638-ddefc9360154", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75229) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 09:47:09 user nova-compute[75229]: DEBUG nova.network.os_vif_util [req-4275d07a-fa76-4829-a82c-1a1cf9f898c1 req-18f9f5c1-8fcd-4be0-a0d1-b888bc654577 service nova] Converting VIF {"id": "1c95e48f-ad0e-41b2-8638-ddefc9360154", "address": "fa:16:3e:64:36:66", "network": {"id": "843bda3e-9929-4282-9fa6-ed93ebd7afcd", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1455996506", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.228", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "48b5edeee7494b6e94135faaab6afd50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c95e48f-ad", "ovs_interfaceid": "1c95e48f-ad0e-41b2-8638-ddefc9360154", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 09:47:09 user nova-compute[75229]: DEBUG nova.network.os_vif_util [req-4275d07a-fa76-4829-a82c-1a1cf9f898c1 req-18f9f5c1-8fcd-4be0-a0d1-b888bc654577 service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:64:36:66,bridge_name='br-int',has_traffic_filtering=True,id=1c95e48f-ad0e-41b2-8638-ddefc9360154,network=Network(843bda3e-9929-4282-9fa6-ed93ebd7afcd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1c95e48f-ad') {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 09:47:09 user nova-compute[75229]: DEBUG nova.virt.libvirt.guest [req-4275d07a-fa76-4829-a82c-1a1cf9f898c1 req-18f9f5c1-8fcd-4be0-a0d1-b888bc654577 service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:64:36:66"/><model type="virtio"/><mtu size="1442"/><target dev="tap1c95e48f-ad"/></interface> {{(pid=75229) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 14 09:47:09 user nova-compute[75229]: DEBUG nova.virt.libvirt.guest [req-4275d07a-fa76-4829-a82c-1a1cf9f898c1 req-18f9f5c1-8fcd-4be0-a0d1-b888bc654577 service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:64:36:66"/><model type="virtio"/><mtu size="1442"/><target dev="tap1c95e48f-ad"/></interface>not found in domain: <domain type='kvm' id='8'>
Nov 14 09:47:09 user nova-compute[75229]:   <name>instance-00000008</name>
Nov 14 09:47:09 user nova-compute[75229]:   <uuid>c6fa2298-7111-4660-a162-09269045d5e3</uuid>
Nov 14 09:47:09 user nova-compute[75229]:   <metadata>
Nov 14 09:47:09 user nova-compute[75229]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 09:47:09 user nova-compute[75229]:   <nova:package version="0.0.0"/>
Nov 14 09:47:09 user nova-compute[75229]:   <nova:name>tempest-device-tagging-server-685697079</nova:name>
Nov 14 09:47:09 user nova-compute[75229]:   <nova:creationTime>2023-11-14 09:47:08</nova:creationTime>
Nov 14 09:47:09 user nova-compute[75229]:   <nova:flavor name="m1.tiny">
Nov 14 09:47:09 user nova-compute[75229]:     <nova:memory>512</nova:memory>
Nov 14 09:47:09 user nova-compute[75229]:     <nova:disk>1</nova:disk>
Nov 14 09:47:09 user nova-compute[75229]:     <nova:swap>0</nova:swap>
Nov 14 09:47:09 user nova-compute[75229]:     <nova:ephemeral>0</nova:ephemeral>
Nov 14 09:47:09 user nova-compute[75229]:     <nova:vcpus>1</nova:vcpus>
Nov 14 09:47:09 user nova-compute[75229]:   </nova:flavor>
Nov 14 09:47:09 user nova-compute[75229]:   <nova:owner>
Nov 14 09:47:09 user nova-compute[75229]:     <nova:user uuid="3c818850ce5c41b5b978031cdedfea65">tempest-TaggedAttachmentsTest-294727221-project-member</nova:user>
Nov 14 09:47:09 user nova-compute[75229]:     <nova:project uuid="48b5edeee7494b6e94135faaab6afd50">tempest-TaggedAttachmentsTest-294727221</nova:project>
Nov 14 09:47:09 user nova-compute[75229]:   </nova:owner>
Nov 14 09:47:09 user nova-compute[75229]:   <nova:root type="image" uuid="3bef8470-ecc7-40e3-95d4-9254348ea72d"/>
Nov 14 09:47:09 user nova-compute[75229]:   <nova:ports>
Nov 14 09:47:09 user nova-compute[75229]:     <nova:port uuid="b310b3f2-f842-4918-8540-f9803e259b31">
Nov 14 09:47:09 user nova-compute[75229]:       <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 14 09:47:09 user nova-compute[75229]:     </nova:port>
Nov 14 09:47:09 user nova-compute[75229]:   </nova:ports>
Nov 14 09:47:09 user nova-compute[75229]: </nova:instance>
Nov 14 09:47:09 user nova-compute[75229]:   </metadata>
Nov 14 09:47:09 user nova-compute[75229]:   <memory unit='KiB'>524288</memory>
Nov 14 09:47:09 user nova-compute[75229]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 14 09:47:09 user nova-compute[75229]:   <vcpu placement='static'>1</vcpu>
Nov 14 09:47:09 user nova-compute[75229]:   <resource>
Nov 14 09:47:09 user nova-compute[75229]:     <partition>/machine</partition>
Nov 14 09:47:09 user nova-compute[75229]:   </resource>
Nov 14 09:47:09 user nova-compute[75229]:   <sysinfo type='smbios'>
Nov 14 09:47:09 user nova-compute[75229]:     <system>
Nov 14 09:47:09 user nova-compute[75229]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 14 09:47:09 user nova-compute[75229]:       <entry name='product'>OpenStack Nova</entry>
Nov 14 09:47:09 user nova-compute[75229]:       <entry name='version'>0.0.0</entry>
Nov 14 09:47:09 user nova-compute[75229]:       <entry name='serial'>c6fa2298-7111-4660-a162-09269045d5e3</entry>
Nov 14 09:47:09 user nova-compute[75229]:       <entry name='uuid'>c6fa2298-7111-4660-a162-09269045d5e3</entry>
Nov 14 09:47:09 user nova-compute[75229]:       <entry name='family'>Virtual Machine</entry>
Nov 14 09:47:09 user nova-compute[75229]:     </system>
Nov 14 09:47:09 user nova-compute[75229]:   </sysinfo>
Nov 14 09:47:09 user nova-compute[75229]:   <os>
Nov 14 09:47:09 user nova-compute[75229]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 14 09:47:09 user nova-compute[75229]:     <boot dev='hd'/>
Nov 14 09:47:09 user nova-compute[75229]:     <smbios mode='sysinfo'/>
Nov 14 09:47:09 user nova-compute[75229]:   </os>
Nov 14 09:47:09 user nova-compute[75229]:   <features>
Nov 14 09:47:09 user nova-compute[75229]:     <acpi/>
Nov 14 09:47:09 user nova-compute[75229]:     <apic/>
Nov 14 09:47:09 user nova-compute[75229]:     <vmcoreinfo state='on'/>
Nov 14 09:47:09 user nova-compute[75229]:   </features>
Nov 14 09:47:09 user nova-compute[75229]:   <cpu mode='custom' match='exact' check='full'>
Nov 14 09:47:09 user nova-compute[75229]:     <model fallback='forbid'>Nehalem</model>
Nov 14 09:47:09 user nova-compute[75229]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 14 09:47:09 user nova-compute[75229]:     <feature policy='require' name='vme'/>
Nov 14 09:47:09 user nova-compute[75229]:     <feature policy='require' name='x2apic'/>
Nov 14 09:47:09 user nova-compute[75229]:     <feature policy='require' name='hypervisor'/>
Nov 14 09:47:09 user nova-compute[75229]:   </cpu>
Nov 14 09:47:09 user nova-compute[75229]:   <clock offset='utc'>
Nov 14 09:47:09 user nova-compute[75229]:     <timer name='pit' tickpolicy='delay'/>
Nov 14 09:47:09 user nova-compute[75229]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 14 09:47:09 user nova-compute[75229]:     <timer name='hpet' present='no'/>
Nov 14 09:47:09 user nova-compute[75229]:   </clock>
Nov 14 09:47:09 user nova-compute[75229]:   <on_poweroff>destroy</on_poweroff>
Nov 14 09:47:09 user nova-compute[75229]:   <on_reboot>restart</on_reboot>
Nov 14 09:47:09 user nova-compute[75229]:   <on_crash>destroy</on_crash>
Nov 14 09:47:09 user nova-compute[75229]:   <devices>
Nov 14 09:47:09 user nova-compute[75229]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 14 09:47:09 user nova-compute[75229]:     <disk type='file' device='disk'>
Nov 14 09:47:09 user nova-compute[75229]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 14 09:47:09 user nova-compute[75229]:       <source file='/opt/stack/data/nova/instances/c6fa2298-7111-4660-a162-09269045d5e3/disk' index='2'/>
Nov 14 09:47:09 user nova-compute[75229]:       <backingStore type='file' index='3'>
Nov 14 09:47:09 user nova-compute[75229]:         <format type='raw'/>
Nov 14 09:47:09 user nova-compute[75229]:         <source file='/opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6'/>
Nov 14 09:47:09 user nova-compute[75229]:         <backingStore/>
Nov 14 09:47:09 user nova-compute[75229]:       </backingStore>
Nov 14 09:47:09 user nova-compute[75229]:       <target dev='vda' bus='virtio'/>
Nov 14 09:47:09 user nova-compute[75229]:       <alias name='virtio-disk0'/>
Nov 14 09:47:09 user nova-compute[75229]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 14 09:47:09 user nova-compute[75229]:     </disk>
Nov 14 09:47:09 user nova-compute[75229]:     <disk type='file' device='cdrom'>
Nov 14 09:47:09 user nova-compute[75229]:       <driver name='qemu' type='raw' cache='none'/>
Nov 14 09:47:09 user nova-compute[75229]:       <source file='/opt/stack/data/nova/instances/c6fa2298-7111-4660-a162-09269045d5e3/disk.config' index='1'/>
Nov 14 09:47:09 user nova-compute[75229]:       <backingStore/>
Nov 14 09:47:09 user nova-compute[75229]:       <target dev='hda' bus='ide'/>
Nov 14 09:47:09 user nova-compute[75229]:       <readonly/>
Nov 14 09:47:09 user nova-compute[75229]:       <alias name='ide0-0-0'/>
Nov 14 09:47:09 user nova-compute[75229]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 14 09:47:09 user nova-compute[75229]:     </disk>
Nov 14 09:47:09 user nova-compute[75229]:     <controller type='usb' index='0' model='none'>
Nov 14 09:47:09 user nova-compute[75229]:       <alias name='usb'/>
Nov 14 09:47:09 user nova-compute[75229]:     </controller>
Nov 14 09:47:09 user nova-compute[75229]:     <controller type='pci' index='0' model='pci-root'>
Nov 14 09:47:09 user nova-compute[75229]:       <alias name='pci.0'/>
Nov 14 09:47:09 user nova-compute[75229]:     </controller>
Nov 14 09:47:09 user nova-compute[75229]:     <controller type='ide' index='0'>
Nov 14 09:47:09 user nova-compute[75229]:       <alias name='ide'/>
Nov 14 09:47:09 user nova-compute[75229]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 14 09:47:09 user nova-compute[75229]:     </controller>
Nov 14 09:47:09 user nova-compute[75229]:     <interface type='ethernet'>
Nov 14 09:47:09 user nova-compute[75229]:       <mac address='fa:16:3e:90:0c:ec'/>
Nov 14 09:47:09 user nova-compute[75229]:       <target dev='tapb310b3f2-f8'/>
Nov 14 09:47:09 user nova-compute[75229]:       <model type='virtio'/>
Nov 14 09:47:09 user nova-compute[75229]:       <mtu size='1442'/>
Nov 14 09:47:09 user nova-compute[75229]:       <alias name='net0'/>
Nov 14 09:47:09 user nova-compute[75229]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 14 09:47:09 user nova-compute[75229]:     </interface>
Nov 14 09:47:09 user nova-compute[75229]:     <serial type='pty'>
Nov 14 09:47:09 user nova-compute[75229]:       <source path='/dev/pts/7'/>
Nov 14 09:47:09 user nova-compute[75229]:       <log file='/opt/stack/data/nova/instances/c6fa2298-7111-4660-a162-09269045d5e3/console.log' append='off'/>
Nov 14 09:47:09 user nova-compute[75229]:       <target type='isa-serial' port='0'>
Nov 14 09:47:09 user nova-compute[75229]:         <model name='isa-serial'/>
Nov 14 09:47:09 user nova-compute[75229]:       </target>
Nov 14 09:47:09 user nova-compute[75229]:       <alias name='serial0'/>
Nov 14 09:47:09 user nova-compute[75229]:     </serial>
Nov 14 09:47:09 user nova-compute[75229]:     <console type='pty' tty='/dev/pts/7'>
Nov 14 09:47:09 user nova-compute[75229]:       <source path='/dev/pts/7'/>
Nov 14 09:47:09 user nova-compute[75229]:       <log file='/opt/stack/data/nova/instances/c6fa2298-7111-4660-a162-09269045d5e3/console.log' append='off'/>
Nov 14 09:47:09 user nova-compute[75229]:       <target type='serial' port='0'/>
Nov 14 09:47:09 user nova-compute[75229]:       <alias name='serial0'/>
Nov 14 09:47:09 user nova-compute[75229]:     </console>
Nov 14 09:47:09 user nova-compute[75229]:     <input type='mouse' bus='ps2'>
Nov 14 09:47:09 user nova-compute[75229]:       <alias name='input0'/>
Nov 14 09:47:09 user nova-compute[75229]:     </input>
Nov 14 09:47:09 user nova-compute[75229]:     <input type='keyboard' bus='ps2'>
Nov 14 09:47:09 user nova-compute[75229]:       <alias name='input1'/>
Nov 14 09:47:09 user nova-compute[75229]:     </input>
Nov 14 09:47:09 user nova-compute[75229]:     <graphics type='vnc' port='5907' autoport='yes' listen='0.0.0.0'>
Nov 14 09:47:09 user nova-compute[75229]:       <listen type='address' address='0.0.0.0'/>
Nov 14 09:47:09 user nova-compute[75229]:     </graphics>
Nov 14 09:47:09 user nova-compute[75229]:     <audio id='1' type='none'/>
Nov 14 09:47:09 user nova-compute[75229]:     <video>
Nov 14 09:47:09 user nova-compute[75229]:       <model type='virtio' heads='1' primary='yes'/>
Nov 14 09:47:09 user nova-compute[75229]:       <alias name='video0'/>
Nov 14 09:47:09 user nova-compute[75229]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 14 09:47:09 user nova-compute[75229]:     </video>
Nov 14 09:47:09 user nova-compute[75229]:     <memballoon model='virtio'>
Nov 14 09:47:09 user nova-compute[75229]:       <stats period='10'/>
Nov 14 09:47:09 user nova-compute[75229]:       <alias name='balloon0'/>
Nov 14 09:47:09 user nova-compute[75229]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 14 09:47:09 user nova-compute[75229]:     </memballoon>
Nov 14 09:47:09 user nova-compute[75229]:     <rng model='virtio'>
Nov 14 09:47:09 user nova-compute[75229]:       <backend model='random'>/dev/urandom</backend>
Nov 14 09:47:09 user nova-compute[75229]:       <alias name='rng0'/>
Nov 14 09:47:09 user nova-compute[75229]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 14 09:47:09 user nova-compute[75229]:     </rng>
Nov 14 09:47:09 user nova-compute[75229]:   </devices>
Nov 14 09:47:09 user nova-compute[75229]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 14 09:47:09 user nova-compute[75229]:     <label>libvirt-c6fa2298-7111-4660-a162-09269045d5e3</label>
Nov 14 09:47:09 user nova-compute[75229]:     <imagelabel>libvirt-c6fa2298-7111-4660-a162-09269045d5e3</imagelabel>
Nov 14 09:47:09 user nova-compute[75229]:   </seclabel>
Nov 14 09:47:09 user nova-compute[75229]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 14 09:47:09 user nova-compute[75229]:     <label>+64055:+108</label>
Nov 14 09:47:09 user nova-compute[75229]:     <imagelabel>+64055:+108</imagelabel>
Nov 14 09:47:09 user nova-compute[75229]:   </seclabel>
Nov 14 09:47:09 user nova-compute[75229]: </domain>
Nov 14 09:47:09 user nova-compute[75229]:  {{(pid=75229) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 14 09:47:09 user nova-compute[75229]: DEBUG nova.virt.libvirt.guest [req-4275d07a-fa76-4829-a82c-1a1cf9f898c1 req-18f9f5c1-8fcd-4be0-a0d1-b888bc654577 service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:64:36:66"/><model type="virtio"/><mtu size="1442"/><target dev="tap1c95e48f-ad"/></interface> {{(pid=75229) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 14 09:47:09 user nova-compute[75229]: DEBUG nova.virt.libvirt.guest [req-4275d07a-fa76-4829-a82c-1a1cf9f898c1 req-18f9f5c1-8fcd-4be0-a0d1-b888bc654577 service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:64:36:66"/><model type="virtio"/><mtu size="1442"/><target dev="tap1c95e48f-ad"/></interface>not found in domain: <domain type='kvm' id='8'>
Nov 14 09:47:09 user nova-compute[75229]:   <name>instance-00000008</name>
Nov 14 09:47:09 user nova-compute[75229]:   <uuid>c6fa2298-7111-4660-a162-09269045d5e3</uuid>
Nov 14 09:47:09 user nova-compute[75229]:   <metadata>
Nov 14 09:47:09 user nova-compute[75229]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 09:47:09 user nova-compute[75229]:   <nova:package version="0.0.0"/>
Nov 14 09:47:09 user nova-compute[75229]:   <nova:name>tempest-device-tagging-server-685697079</nova:name>
Nov 14 09:47:09 user nova-compute[75229]:   <nova:creationTime>2023-11-14 09:47:08</nova:creationTime>
Nov 14 09:47:09 user nova-compute[75229]:   <nova:flavor name="m1.tiny">
Nov 14 09:47:09 user nova-compute[75229]:     <nova:memory>512</nova:memory>
Nov 14 09:47:09 user nova-compute[75229]:     <nova:disk>1</nova:disk>
Nov 14 09:47:09 user nova-compute[75229]:     <nova:swap>0</nova:swap>
Nov 14 09:47:09 user nova-compute[75229]:     <nova:ephemeral>0</nova:ephemeral>
Nov 14 09:47:09 user nova-compute[75229]:     <nova:vcpus>1</nova:vcpus>
Nov 14 09:47:09 user nova-compute[75229]:   </nova:flavor>
Nov 14 09:47:09 user nova-compute[75229]:   <nova:owner>
Nov 14 09:47:09 user nova-compute[75229]:     <nova:user uuid="3c818850ce5c41b5b978031cdedfea65">tempest-TaggedAttachmentsTest-294727221-project-member</nova:user>
Nov 14 09:47:09 user nova-compute[75229]:     <nova:project uuid="48b5edeee7494b6e94135faaab6afd50">tempest-TaggedAttachmentsTest-294727221</nova:project>
Nov 14 09:47:09 user nova-compute[75229]:   </nova:owner>
Nov 14 09:47:09 user nova-compute[75229]:   <nova:root type="image" uuid="3bef8470-ecc7-40e3-95d4-9254348ea72d"/>
Nov 14 09:47:09 user nova-compute[75229]:   <nova:ports>
Nov 14 09:47:09 user nova-compute[75229]:     <nova:port uuid="b310b3f2-f842-4918-8540-f9803e259b31">
Nov 14 09:47:09 user nova-compute[75229]:       <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 14 09:47:09 user nova-compute[75229]:     </nova:port>
Nov 14 09:47:09 user nova-compute[75229]:   </nova:ports>
Nov 14 09:47:09 user nova-compute[75229]: </nova:instance>
Nov 14 09:47:09 user nova-compute[75229]:   </metadata>
Nov 14 09:47:09 user nova-compute[75229]:   <memory unit='KiB'>524288</memory>
Nov 14 09:47:09 user nova-compute[75229]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 14 09:47:09 user nova-compute[75229]:   <vcpu placement='static'>1</vcpu>
Nov 14 09:47:09 user nova-compute[75229]:   <resource>
Nov 14 09:47:09 user nova-compute[75229]:     <partition>/machine</partition>
Nov 14 09:47:09 user nova-compute[75229]:   </resource>
Nov 14 09:47:09 user nova-compute[75229]:   <sysinfo type='smbios'>
Nov 14 09:47:09 user nova-compute[75229]:     <system>
Nov 14 09:47:09 user nova-compute[75229]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 14 09:47:09 user nova-compute[75229]:       <entry name='product'>OpenStack Nova</entry>
Nov 14 09:47:09 user nova-compute[75229]:       <entry name='version'>0.0.0</entry>
Nov 14 09:47:09 user nova-compute[75229]:       <entry name='serial'>c6fa2298-7111-4660-a162-09269045d5e3</entry>
Nov 14 09:47:09 user nova-compute[75229]:       <entry name='uuid'>c6fa2298-7111-4660-a162-09269045d5e3</entry>
Nov 14 09:47:09 user nova-compute[75229]:       <entry name='family'>Virtual Machine</entry>
Nov 14 09:47:09 user nova-compute[75229]:     </system>
Nov 14 09:47:09 user nova-compute[75229]:   </sysinfo>
Nov 14 09:47:09 user nova-compute[75229]:   <os>
Nov 14 09:47:09 user nova-compute[75229]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 14 09:47:09 user nova-compute[75229]:     <boot dev='hd'/>
Nov 14 09:47:09 user nova-compute[75229]:     <smbios mode='sysinfo'/>
Nov 14 09:47:09 user nova-compute[75229]:   </os>
Nov 14 09:47:09 user nova-compute[75229]:   <features>
Nov 14 09:47:09 user nova-compute[75229]:     <acpi/>
Nov 14 09:47:09 user nova-compute[75229]:     <apic/>
Nov 14 09:47:09 user nova-compute[75229]:     <vmcoreinfo state='on'/>
Nov 14 09:47:09 user nova-compute[75229]:   </features>
Nov 14 09:47:09 user nova-compute[75229]:   <cpu mode='custom' match='exact' check='full'>
Nov 14 09:47:09 user nova-compute[75229]:     <model fallback='forbid'>Nehalem</model>
Nov 14 09:47:09 user nova-compute[75229]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 14 09:47:09 user nova-compute[75229]:     <feature policy='require' name='vme'/>
Nov 14 09:47:09 user nova-compute[75229]:     <feature policy='require' name='x2apic'/>
Nov 14 09:47:09 user nova-compute[75229]:     <feature policy='require' name='hypervisor'/>
Nov 14 09:47:09 user nova-compute[75229]:   </cpu>
Nov 14 09:47:09 user nova-compute[75229]:   <clock offset='utc'>
Nov 14 09:47:09 user nova-compute[75229]:     <timer name='pit' tickpolicy='delay'/>
Nov 14 09:47:09 user nova-compute[75229]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 14 09:47:09 user nova-compute[75229]:     <timer name='hpet' present='no'/>
Nov 14 09:47:09 user nova-compute[75229]:   </clock>
Nov 14 09:47:09 user nova-compute[75229]:   <on_poweroff>destroy</on_poweroff>
Nov 14 09:47:09 user nova-compute[75229]:   <on_reboot>restart</on_reboot>
Nov 14 09:47:09 user nova-compute[75229]:   <on_crash>destroy</on_crash>
Nov 14 09:47:09 user nova-compute[75229]:   <devices>
Nov 14 09:47:09 user nova-compute[75229]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 14 09:47:09 user nova-compute[75229]:     <disk type='file' device='disk'>
Nov 14 09:47:09 user nova-compute[75229]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 14 09:47:09 user nova-compute[75229]:       <source file='/opt/stack/data/nova/instances/c6fa2298-7111-4660-a162-09269045d5e3/disk' index='2'/>
Nov 14 09:47:09 user nova-compute[75229]:       <backingStore type='file' index='3'>
Nov 14 09:47:09 user nova-compute[75229]:         <format type='raw'/>
Nov 14 09:47:09 user nova-compute[75229]:         <source file='/opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6'/>
Nov 14 09:47:09 user nova-compute[75229]:         <backingStore/>
Nov 14 09:47:09 user nova-compute[75229]:       </backingStore>
Nov 14 09:47:09 user nova-compute[75229]:       <target dev='vda' bus='virtio'/>
Nov 14 09:47:09 user nova-compute[75229]:       <alias name='virtio-disk0'/>
Nov 14 09:47:09 user nova-compute[75229]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 14 09:47:09 user nova-compute[75229]:     </disk>
Nov 14 09:47:09 user nova-compute[75229]:     <disk type='file' device='cdrom'>
Nov 14 09:47:09 user nova-compute[75229]:       <driver name='qemu' type='raw' cache='none'/>
Nov 14 09:47:09 user nova-compute[75229]:       <source file='/opt/stack/data/nova/instances/c6fa2298-7111-4660-a162-09269045d5e3/disk.config' index='1'/>
Nov 14 09:47:09 user nova-compute[75229]:       <backingStore/>
Nov 14 09:47:09 user nova-compute[75229]:       <target dev='hda' bus='ide'/>
Nov 14 09:47:09 user nova-compute[75229]:       <readonly/>
Nov 14 09:47:09 user nova-compute[75229]:       <alias name='ide0-0-0'/>
Nov 14 09:47:09 user nova-compute[75229]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 14 09:47:09 user nova-compute[75229]:     </disk>
Nov 14 09:47:09 user nova-compute[75229]:     <controller type='usb' index='0' model='none'>
Nov 14 09:47:09 user nova-compute[75229]:       <alias name='usb'/>
Nov 14 09:47:09 user nova-compute[75229]:     </controller>
Nov 14 09:47:09 user nova-compute[75229]:     <controller type='pci' index='0' model='pci-root'>
Nov 14 09:47:09 user nova-compute[75229]:       <alias name='pci.0'/>
Nov 14 09:47:09 user nova-compute[75229]:     </controller>
Nov 14 09:47:09 user nova-compute[75229]:     <controller type='ide' index='0'>
Nov 14 09:47:09 user nova-compute[75229]:       <alias name='ide'/>
Nov 14 09:47:09 user nova-compute[75229]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 14 09:47:09 user nova-compute[75229]:     </controller>
Nov 14 09:47:09 user nova-compute[75229]:     <interface type='ethernet'>
Nov 14 09:47:09 user nova-compute[75229]:       <mac address='fa:16:3e:90:0c:ec'/>
Nov 14 09:47:09 user nova-compute[75229]:       <target dev='tapb310b3f2-f8'/>
Nov 14 09:47:09 user nova-compute[75229]:       <model type='virtio'/>
Nov 14 09:47:09 user nova-compute[75229]:       <mtu size='1442'/>
Nov 14 09:47:09 user nova-compute[75229]:       <alias name='net0'/>
Nov 14 09:47:09 user nova-compute[75229]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 14 09:47:09 user nova-compute[75229]:     </interface>
Nov 14 09:47:09 user nova-compute[75229]:     <serial type='pty'>
Nov 14 09:47:09 user nova-compute[75229]:       <source path='/dev/pts/7'/>
Nov 14 09:47:09 user nova-compute[75229]:       <log file='/opt/stack/data/nova/instances/c6fa2298-7111-4660-a162-09269045d5e3/console.log' append='off'/>
Nov 14 09:47:09 user nova-compute[75229]:       <target type='isa-serial' port='0'>
Nov 14 09:47:09 user nova-compute[75229]:         <model name='isa-serial'/>
Nov 14 09:47:09 user nova-compute[75229]:       </target>
Nov 14 09:47:09 user nova-compute[75229]:       <alias name='serial0'/>
Nov 14 09:47:09 user nova-compute[75229]:     </serial>
Nov 14 09:47:09 user nova-compute[75229]:     <console type='pty' tty='/dev/pts/7'>
Nov 14 09:47:09 user nova-compute[75229]:       <source path='/dev/pts/7'/>
Nov 14 09:47:09 user nova-compute[75229]:       <log file='/opt/stack/data/nova/instances/c6fa2298-7111-4660-a162-09269045d5e3/console.log' append='off'/>
Nov 14 09:47:09 user nova-compute[75229]:       <target type='serial' port='0'/>
Nov 14 09:47:09 user nova-compute[75229]:       <alias name='serial0'/>
Nov 14 09:47:09 user nova-compute[75229]:     </console>
Nov 14 09:47:09 user nova-compute[75229]:     <input type='mouse' bus='ps2'>
Nov 14 09:47:09 user nova-compute[75229]:       <alias name='input0'/>
Nov 14 09:47:09 user nova-compute[75229]:     </input>
Nov 14 09:47:09 user nova-compute[75229]:     <input type='keyboard' bus='ps2'>
Nov 14 09:47:09 user nova-compute[75229]:       <alias name='input1'/>
Nov 14 09:47:09 user nova-compute[75229]:     </input>
Nov 14 09:47:09 user nova-compute[75229]:     <graphics type='vnc' port='5907' autoport='yes' listen='0.0.0.0'>
Nov 14 09:47:09 user nova-compute[75229]:       <listen type='address' address='0.0.0.0'/>
Nov 14 09:47:09 user nova-compute[75229]:     </graphics>
Nov 14 09:47:09 user nova-compute[75229]:     <audio id='1' type='none'/>
Nov 14 09:47:09 user nova-compute[75229]:     <video>
Nov 14 09:47:09 user nova-compute[75229]:       <model type='virtio' heads='1' primary='yes'/>
Nov 14 09:47:09 user nova-compute[75229]:       <alias name='video0'/>
Nov 14 09:47:09 user nova-compute[75229]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 14 09:47:09 user nova-compute[75229]:     </video>
Nov 14 09:47:09 user nova-compute[75229]:     <memballoon model='virtio'>
Nov 14 09:47:09 user nova-compute[75229]:       <stats period='10'/>
Nov 14 09:47:09 user nova-compute[75229]:       <alias name='balloon0'/>
Nov 14 09:47:09 user nova-compute[75229]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 14 09:47:09 user nova-compute[75229]:     </memballoon>
Nov 14 09:47:09 user nova-compute[75229]:     <rng model='virtio'>
Nov 14 09:47:09 user nova-compute[75229]:       <backend model='random'>/dev/urandom</backend>
Nov 14 09:47:09 user nova-compute[75229]:       <alias name='rng0'/>
Nov 14 09:47:09 user nova-compute[75229]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 14 09:47:09 user nova-compute[75229]:     </rng>
Nov 14 09:47:09 user nova-compute[75229]:   </devices>
Nov 14 09:47:09 user nova-compute[75229]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 14 09:47:09 user nova-compute[75229]:     <label>libvirt-c6fa2298-7111-4660-a162-09269045d5e3</label>
Nov 14 09:47:09 user nova-compute[75229]:     <imagelabel>libvirt-c6fa2298-7111-4660-a162-09269045d5e3</imagelabel>
Nov 14 09:47:09 user nova-compute[75229]:   </seclabel>
Nov 14 09:47:09 user nova-compute[75229]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 14 09:47:09 user nova-compute[75229]:     <label>+64055:+108</label>
Nov 14 09:47:09 user nova-compute[75229]:     <imagelabel>+64055:+108</imagelabel>
Nov 14 09:47:09 user nova-compute[75229]:   </seclabel>
Nov 14 09:47:09 user nova-compute[75229]: </domain>
Nov 14 09:47:09 user nova-compute[75229]:  {{(pid=75229) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 14 09:47:09 user nova-compute[75229]: WARNING nova.virt.libvirt.driver [req-4275d07a-fa76-4829-a82c-1a1cf9f898c1 req-18f9f5c1-8fcd-4be0-a0d1-b888bc654577 service nova] [instance: c6fa2298-7111-4660-a162-09269045d5e3] Detaching interface fa:16:3e:64:36:66 failed because the device is no longer found on the guest.: nova.exception.DeviceNotFound: Device 'tap1c95e48f-ad' not found.
Nov 14 09:47:09 user nova-compute[75229]: DEBUG nova.virt.libvirt.vif [req-4275d07a-fa76-4829-a82c-1a1cf9f898c1 req-18f9f5c1-8fcd-4be0-a0d1-b888bc654577 service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T09:44:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-685697079',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-685697079',id=8,image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAifCLOp7slCaJ90vuibP3D+iXI5GZCQPZCKwFW7R+vCvd5TEqQRxmD+LKPc4egtvjclTc91I+Ts0vc0Y63gnivit1SN7n4OIcVVjbAdupwqjax2fqD52aMGKY+5S2775A==',key_name='tempest-keypair-1995790410',keypairs=<?>,launch_index=0,launched_at=2023-11-14T09:44:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='48b5edeee7494b6e94135faaab6afd50',ramdisk_id='',reservation_id='r-xsfhi8mn',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-294727221',owner_user_name='tempest-TaggedAttachmentsTest-294727221-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T09:44:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3c818850ce5c41b5b978031cdedfea65',uuid=c6fa2298-7111-4660-a162-09269045d5e3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1c95e48f-ad0e-41b2-8638-ddefc9360154", "address": "fa:16:3e:64:36:66", "network": {"id": "843bda3e-9929-4282-9fa6-ed93ebd7afcd", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1455996506", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.228", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "48b5edeee7494b6e94135faaab6afd50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c95e48f-ad", "ovs_interfaceid": "1c95e48f-ad0e-41b2-8638-ddefc9360154", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 09:47:09 user nova-compute[75229]: DEBUG nova.network.os_vif_util [req-4275d07a-fa76-4829-a82c-1a1cf9f898c1 req-18f9f5c1-8fcd-4be0-a0d1-b888bc654577 service nova] Converting VIF {"id": "1c95e48f-ad0e-41b2-8638-ddefc9360154", "address": "fa:16:3e:64:36:66", "network": {"id": "843bda3e-9929-4282-9fa6-ed93ebd7afcd", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1455996506", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.228", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "48b5edeee7494b6e94135faaab6afd50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c95e48f-ad", "ovs_interfaceid": "1c95e48f-ad0e-41b2-8638-ddefc9360154", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 09:47:09 user nova-compute[75229]: DEBUG nova.network.os_vif_util [req-4275d07a-fa76-4829-a82c-1a1cf9f898c1 req-18f9f5c1-8fcd-4be0-a0d1-b888bc654577 service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:64:36:66,bridge_name='br-int',has_traffic_filtering=True,id=1c95e48f-ad0e-41b2-8638-ddefc9360154,network=Network(843bda3e-9929-4282-9fa6-ed93ebd7afcd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1c95e48f-ad') {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 09:47:09 user nova-compute[75229]: DEBUG os_vif [req-4275d07a-fa76-4829-a82c-1a1cf9f898c1 req-18f9f5c1-8fcd-4be0-a0d1-b888bc654577 service nova] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:64:36:66,bridge_name='br-int',has_traffic_filtering=True,id=1c95e48f-ad0e-41b2-8638-ddefc9360154,network=Network(843bda3e-9929-4282-9fa6-ed93ebd7afcd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1c95e48f-ad') {{(pid=75229) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 09:47:09 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:47:09 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1c95e48f-ad, bridge=br-int, if_exists=True) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:47:09 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 09:47:09 user nova-compute[75229]: INFO os_vif [req-4275d07a-fa76-4829-a82c-1a1cf9f898c1 req-18f9f5c1-8fcd-4be0-a0d1-b888bc654577 service nova] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:64:36:66,bridge_name='br-int',has_traffic_filtering=True,id=1c95e48f-ad0e-41b2-8638-ddefc9360154,network=Network(843bda3e-9929-4282-9fa6-ed93ebd7afcd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1c95e48f-ad')
Nov 14 09:47:09 user nova-compute[75229]: DEBUG nova.virt.libvirt.guest [req-4275d07a-fa76-4829-a82c-1a1cf9f898c1 req-18f9f5c1-8fcd-4be0-a0d1-b888bc654577 service nova] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 09:47:09 user nova-compute[75229]:   <nova:package version="0.0.0"/>
Nov 14 09:47:09 user nova-compute[75229]:   <nova:name>tempest-device-tagging-server-685697079</nova:name>
Nov 14 09:47:09 user nova-compute[75229]:   <nova:creationTime>2023-11-14 09:47:09</nova:creationTime>
Nov 14 09:47:09 user nova-compute[75229]:   <nova:flavor name="m1.tiny">
Nov 14 09:47:09 user nova-compute[75229]:     <nova:memory>512</nova:memory>
Nov 14 09:47:09 user nova-compute[75229]:     <nova:disk>1</nova:disk>
Nov 14 09:47:09 user nova-compute[75229]:     <nova:swap>0</nova:swap>
Nov 14 09:47:09 user nova-compute[75229]:     <nova:ephemeral>0</nova:ephemeral>
Nov 14 09:47:09 user nova-compute[75229]:     <nova:vcpus>1</nova:vcpus>
Nov 14 09:47:09 user nova-compute[75229]:   </nova:flavor>
Nov 14 09:47:09 user nova-compute[75229]:   <nova:owner>
Nov 14 09:47:09 user nova-compute[75229]:     <nova:user uuid="3c818850ce5c41b5b978031cdedfea65">tempest-TaggedAttachmentsTest-294727221-project-member</nova:user>
Nov 14 09:47:09 user nova-compute[75229]:     <nova:project uuid="48b5edeee7494b6e94135faaab6afd50">tempest-TaggedAttachmentsTest-294727221</nova:project>
Nov 14 09:47:09 user nova-compute[75229]:   </nova:owner>
Nov 14 09:47:09 user nova-compute[75229]:   <nova:root type="image" uuid="3bef8470-ecc7-40e3-95d4-9254348ea72d"/>
Nov 14 09:47:09 user nova-compute[75229]:   <nova:ports>
Nov 14 09:47:09 user nova-compute[75229]:     <nova:port uuid="b310b3f2-f842-4918-8540-f9803e259b31">
Nov 14 09:47:09 user nova-compute[75229]:       <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 14 09:47:09 user nova-compute[75229]:     </nova:port>
Nov 14 09:47:09 user nova-compute[75229]:   </nova:ports>
Nov 14 09:47:09 user nova-compute[75229]: </nova:instance>
Nov 14 09:47:09 user nova-compute[75229]:  {{(pid=75229) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 14 09:47:09 user nova-compute[75229]: INFO nova.network.neutron [None req-8878bf82-dd59-4b10-948d-38eefab3cf0d tempest-TaggedAttachmentsTest-294727221 tempest-TaggedAttachmentsTest-294727221-project-member] [instance: c6fa2298-7111-4660-a162-09269045d5e3] Port 1c95e48f-ad0e-41b2-8638-ddefc9360154 from network info_cache is no longer associated with instance in Neutron. Removing from network info_cache.
Nov 14 09:47:09 user nova-compute[75229]: DEBUG nova.network.neutron [None req-8878bf82-dd59-4b10-948d-38eefab3cf0d tempest-TaggedAttachmentsTest-294727221 tempest-TaggedAttachmentsTest-294727221-project-member] [instance: c6fa2298-7111-4660-a162-09269045d5e3] Updating instance_info_cache with network_info: [{"id": "b310b3f2-f842-4918-8540-f9803e259b31", "address": "fa:16:3e:90:0c:ec", "network": {"id": "35508221-011f-4deb-81a1-6dfdae3f2375", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-827518066-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.156", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48b5edeee7494b6e94135faaab6afd50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb310b3f2-f8", "ovs_interfaceid": "b310b3f2-f842-4918-8540-f9803e259b31", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 09:47:09 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-8878bf82-dd59-4b10-948d-38eefab3cf0d tempest-TaggedAttachmentsTest-294727221 tempest-TaggedAttachmentsTest-294727221-project-member] Releasing lock "refresh_cache-c6fa2298-7111-4660-a162-09269045d5e3" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 09:47:09 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-8878bf82-dd59-4b10-948d-38eefab3cf0d tempest-TaggedAttachmentsTest-294727221 tempest-TaggedAttachmentsTest-294727221-project-member] Lock "interface-c6fa2298-7111-4660-a162-09269045d5e3-1c95e48f-ad0e-41b2-8638-ddefc9360154" "released" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: held 21.561s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:47:12 user nova-compute[75229]: WARNING nova.virt.libvirt.driver [None req-6d2edeb1-ab23-4001-aaba-925e1cc21884 tempest-TestVolumeSwap-528292061 tempest-TestVolumeSwap-528292061-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance c307660b-01bb-471b-9e2e-5c2aaca65287 is timed out.
Nov 14 09:47:12 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-6d2edeb1-ab23-4001-aaba-925e1cc21884 tempest-TestVolumeSwap-528292061 tempest-TestVolumeSwap-528292061-project-member] Successfully detached device vdb from instance c307660b-01bb-471b-9e2e-5c2aaca65287 from the live domain config.
Nov 14 09:47:12 user nova-compute[75229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6d2edeb1-ab23-4001-aaba-925e1cc21884 tempest-TestVolumeSwap-528292061 tempest-TestVolumeSwap-528292061-project-member] [instance: c307660b-01bb-471b-9e2e-5c2aaca65287] calling os-brick to detach iSCSI Volume {{(pid=75229) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 09:47:12 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d2edeb1-ab23-4001-aaba-925e1cc21884 tempest-TestVolumeSwap-528292061 tempest-TestVolumeSwap-528292061-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f73f85151b0>, {'target_iqn': 'iqn.2010-10.org.openstack:52ae1fea-5339-4958-88ae-d103080e7743', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xkXQEUcf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc', 'volume_id': '52ae1fea-5339-4958-88ae-d103080e7743'}, None), 'kwargs': False}}" {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 09:47:12 user nova-compute[75229]: WARNING os_brick.initiator.connectors.base [None req-6d2edeb1-ab23-4001-aaba-925e1cc21884 tempest-TestVolumeSwap-528292061 tempest-TestVolumeSwap-528292061-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 09:47:12 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-6d2edeb1-ab23-4001-aaba-925e1cc21884 tempest-TestVolumeSwap-528292061 tempest-TestVolumeSwap-528292061-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 09:47:12 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-6d2edeb1-ab23-4001-aaba-925e1cc21884 tempest-TestVolumeSwap-528292061 tempest-TestVolumeSwap-528292061-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 09:47:12 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:47:12 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:47:12 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d0a57fe-2eb6-4946-b484-4e6d782ef04e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:52ae1fea-5339-4958-88ae-d103080e7743\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:47:12 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d2edeb1-ab23-4001-aaba-925e1cc21884 tempest-TestVolumeSwap-528292061 tempest-TestVolumeSwap-528292061-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 09:47:12 user nova-compute[75229]: No targets found.
Nov 14 09:47:12 user nova-compute[75229]: iSNS:
Nov 14 09:47:12 user nova-compute[75229]: No targets found.
Nov 14 09:47:12 user nova-compute[75229]: STATIC:
Nov 14 09:47:12 user nova-compute[75229]: Target: iqn.2010-10.org.openstack:52ae1fea-5339-4958-88ae-d103080e7743
Nov 14 09:47:12 user nova-compute[75229]:         Portal: 172.16.0.220:3260,-1
Nov 14 09:47:12 user nova-compute[75229]:                 Iface Name: default
Nov 14 09:47:12 user nova-compute[75229]: FIRMWARE:
Nov 14 09:47:12 user nova-compute[75229]: No targets found.
Nov 14 09:47:12 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 09:47:12 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d2edeb1-ab23-4001-aaba-925e1cc21884 tempest-TestVolumeSwap-528292061 tempest-TestVolumeSwap-528292061-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 09:47:12 user nova-compute[75229]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 09:47:12 user nova-compute[75229]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75229) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 09:47:12 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d2edeb1-ab23-4001-aaba-925e1cc21884 tempest-TestVolumeSwap-528292061 tempest-TestVolumeSwap-528292061-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:52ae1fea-5339-4958-88ae-d103080e7743', 0)] {{(pid=75229) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 09:47:12 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:47:12 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:47:12 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[10859649-ca39-4568-90d7-180647c01a76]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:52ae1fea-5339-4958-88ae-d103080e7743\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:47:12 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:47:12 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:47:12 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[07d0ceab-fc3a-4357-bb54-463e5c5ed762]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52ae1fea-5339-4958-88ae-d103080e7743 (non-flash)\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:47:12 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d2edeb1-ab23-4001-aaba-925e1cc21884 tempest-TestVolumeSwap-528292061 tempest-TestVolumeSwap-528292061-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52ae1fea-5339-4958-88ae-d103080e7743 (non-flash)
Nov 14 09:47:12 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 09:47:12 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d2edeb1-ab23-4001-aaba-925e1cc21884 tempest-TestVolumeSwap-528292061 tempest-TestVolumeSwap-528292061-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52ae1fea-5339-4958-88ae-d103080e7743 (non-flash)
Nov 14 09:47:12 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 09:47:12 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d2edeb1-ab23-4001-aaba-925e1cc21884 tempest-TestVolumeSwap-528292061 tempest-TestVolumeSwap-528292061-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f73d4ecab00>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:52ae1fea-5339-4958-88ae-d103080e7743'): ({'sdc'}, set())}) {{(pid=75229) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 09:47:12 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-6d2edeb1-ab23-4001-aaba-925e1cc21884 tempest-TestVolumeSwap-528292061 tempest-TestVolumeSwap-528292061-project-member] Removing single pathed devices sdc {{(pid=75229) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 09:47:12 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:47:12 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:47:12 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0bff77b-5388-4aad-a181-329da94a9950]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:47:12 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:47:12 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.017s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:47:12 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[68185ce4-8581-4daa-b78e-27bb38228c0f]: (4, ('ok\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:47:12 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-6d2edeb1-ab23-4001-aaba-925e1cc21884 tempest-TestVolumeSwap-528292061 tempest-TestVolumeSwap-528292061-project-member] Flushing IO for device /dev/sdc {{(pid=75229) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 09:47:12 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:47:12 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:47:12 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[95755490-cde8-4c30-87a1-38ed9e7b383e]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:47:12 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-6d2edeb1-ab23-4001-aaba-925e1cc21884 tempest-TestVolumeSwap-528292061 tempest-TestVolumeSwap-528292061-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75229) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 09:47:12 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:47:12 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.045s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:47:12 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a41b4a6-d061-43b9-957b-f9d11b9922d5]: (4, ('1', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:47:12 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-6d2edeb1-ab23-4001-aaba-925e1cc21884 tempest-TestVolumeSwap-528292061 tempest-TestVolumeSwap-528292061-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75229) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 09:47:12 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-6d2edeb1-ab23-4001-aaba-925e1cc21884 tempest-TestVolumeSwap-528292061 tempest-TestVolumeSwap-528292061-project-member] SCSI volumes sdc have been removed. {{(pid=75229) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 09:47:12 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d2edeb1-ab23-4001-aaba-925e1cc21884 tempest-TestVolumeSwap-528292061 tempest-TestVolumeSwap-528292061-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:52ae1fea-5339-4958-88ae-d103080e7743')] {{(pid=75229) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 09:47:12 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52ae1fea-5339-4958-88ae-d103080e7743 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:47:12 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52ae1fea-5339-4958-88ae-d103080e7743 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:47:12 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[69ebc385-dc8e-4567-8621-b38a6b1bb41c]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:47:12 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d2edeb1-ab23-4001-aaba-925e1cc21884 tempest-TestVolumeSwap-528292061 tempest-TestVolumeSwap-528292061-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:47:12 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52ae1fea-5339-4958-88ae-d103080e7743 -p 172.16.0.220:3260 --logout {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:47:12 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52ae1fea-5339-4958-88ae-d103080e7743 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:47:12 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e925802-4c33-4409-a3e8-20f76820d872]: (4, ('Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:52ae1fea-5339-4958-88ae-d103080e7743, portal: 172.16.0.220,3260]\nLogout of [sid: 12, target: iqn.2010-10.org.openstack:52ae1fea-5339-4958-88ae-d103080e7743, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:47:12 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d2edeb1-ab23-4001-aaba-925e1cc21884 tempest-TestVolumeSwap-528292061 tempest-TestVolumeSwap-528292061-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:52ae1fea-5339-4958-88ae-d103080e7743, portal: 172.16.0.220,3260]
Nov 14 09:47:12 user nova-compute[75229]: Logout of [sid: 12, target: iqn.2010-10.org.openstack:52ae1fea-5339-4958-88ae-d103080e7743, portal: 172.16.0.220,3260] successful.
Nov 14 09:47:12 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:47:12 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52ae1fea-5339-4958-88ae-d103080e7743 -p 172.16.0.220:3260 --op delete {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:47:12 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52ae1fea-5339-4958-88ae-d103080e7743 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:47:12 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[4be03a47-7385-4e2b-a6bd-b0222e4e14b8]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:47:12 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d2edeb1-ab23-4001-aaba-925e1cc21884 tempest-TestVolumeSwap-528292061 tempest-TestVolumeSwap-528292061-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:47:12 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-6d2edeb1-ab23-4001-aaba-925e1cc21884 tempest-TestVolumeSwap-528292061 tempest-TestVolumeSwap-528292061-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.285s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 09:47:12 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d2edeb1-ab23-4001-aaba-925e1cc21884 tempest-TestVolumeSwap-528292061 tempest-TestVolumeSwap-528292061-project-member] <== disconnect_volume: return (287ms) None {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 09:47:12 user nova-compute[75229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6d2edeb1-ab23-4001-aaba-925e1cc21884 tempest-TestVolumeSwap-528292061 tempest-TestVolumeSwap-528292061-project-member] [instance: c307660b-01bb-471b-9e2e-5c2aaca65287] Disconnected iSCSI Volume {{(pid=75229) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 09:47:12 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:47:12 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-4b32d31a-8a07-4ad8-94d2-11d60dde24da tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] Acquiring lock "9bcd05e7-481c-4ee9-953d-2873e6aa849d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:47:12 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-4b32d31a-8a07-4ad8-94d2-11d60dde24da tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] Lock "9bcd05e7-481c-4ee9-953d-2873e6aa849d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:47:12 user nova-compute[75229]: DEBUG nova.compute.manager [None req-4b32d31a-8a07-4ad8-94d2-11d60dde24da tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] [instance: 9bcd05e7-481c-4ee9-953d-2873e6aa849d] Starting instance... {{(pid=75229) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 09:47:13 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-4b32d31a-8a07-4ad8-94d2-11d60dde24da tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:47:13 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-4b32d31a-8a07-4ad8-94d2-11d60dde24da tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:47:13 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-4b32d31a-8a07-4ad8-94d2-11d60dde24da tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75229) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 09:47:13 user nova-compute[75229]: INFO nova.compute.claims [None req-4b32d31a-8a07-4ad8-94d2-11d60dde24da tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] [instance: 9bcd05e7-481c-4ee9-953d-2873e6aa849d] Claim successful on node user
Nov 14 09:47:13 user nova-compute[75229]: DEBUG nova.compute.provider_tree [None req-4b32d31a-8a07-4ad8-94d2-11d60dde24da tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] Inventory has not changed in ProviderTree for provider: d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 {{(pid=75229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 09:47:13 user nova-compute[75229]: DEBUG nova.scheduler.client.report [None req-4b32d31a-8a07-4ad8-94d2-11d60dde24da tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] Inventory has not changed for provider d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 09:47:13 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-4b32d31a-8a07-4ad8-94d2-11d60dde24da tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.368s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:47:13 user nova-compute[75229]: DEBUG nova.compute.manager [None req-4b32d31a-8a07-4ad8-94d2-11d60dde24da tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] [instance: 9bcd05e7-481c-4ee9-953d-2873e6aa849d] Start building networks asynchronously for instance. {{(pid=75229) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 09:47:13 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:47:13 user nova-compute[75229]: DEBUG nova.objects.instance [None req-6d2edeb1-ab23-4001-aaba-925e1cc21884 tempest-TestVolumeSwap-528292061 tempest-TestVolumeSwap-528292061-project-member] Lazy-loading 'flavor' on Instance uuid c307660b-01bb-471b-9e2e-5c2aaca65287 {{(pid=75229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 09:47:13 user nova-compute[75229]: DEBUG nova.compute.manager [None req-4b32d31a-8a07-4ad8-94d2-11d60dde24da tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] [instance: 9bcd05e7-481c-4ee9-953d-2873e6aa849d] Allocating IP information in the background. {{(pid=75229) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 09:47:13 user nova-compute[75229]: DEBUG nova.network.neutron [None req-4b32d31a-8a07-4ad8-94d2-11d60dde24da tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] [instance: 9bcd05e7-481c-4ee9-953d-2873e6aa849d] allocate_for_instance() {{(pid=75229) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 09:47:13 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-6d2edeb1-ab23-4001-aaba-925e1cc21884 tempest-TestVolumeSwap-528292061 tempest-TestVolumeSwap-528292061-project-member] Lock "c307660b-01bb-471b-9e2e-5c2aaca65287" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.770s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:47:13 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-4b32d31a-8a07-4ad8-94d2-11d60dde24da tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] [instance: 9bcd05e7-481c-4ee9-953d-2873e6aa849d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 09:47:13 user nova-compute[75229]: DEBUG nova.compute.manager [None req-4b32d31a-8a07-4ad8-94d2-11d60dde24da tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] [instance: 9bcd05e7-481c-4ee9-953d-2873e6aa849d] Start building block device mappings for instance. {{(pid=75229) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 09:47:13 user nova-compute[75229]: INFO nova.virt.block_device [None req-4b32d31a-8a07-4ad8-94d2-11d60dde24da tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] [instance: 9bcd05e7-481c-4ee9-953d-2873e6aa849d] Booting with volume db131665-6ac2-437a-8adf-23593475a8aa at /dev/vda
Nov 14 09:47:13 user nova-compute[75229]: DEBUG nova.policy [None req-4b32d31a-8a07-4ad8-94d2-11d60dde24da tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f24bad24bb284d15bf2ef1f4fa211389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '703b87f76dd845e4846d746bbf3dbb6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75229) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 09:47:13 user nova-compute[75229]: DEBUG os_brick.utils [None req-4b32d31a-8a07-4ad8-94d2-11d60dde24da tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 09:47:13 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:47:13 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:47:13 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[be27932c-e166-4d79-8015-ea7549abd3e0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f1154031c835\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:47:13 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:47:13 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:47:13 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce74a078-92fb-4f3b-ae9c-d040be5aa131]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:47:13 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:47:13 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:47:13 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[a039f690-bf8c-4e61-b096-f6e8a47dbb4d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:47:13 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[1720da80-c60e-45aa-b85b-829b3b03a440]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:47:13 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-4b32d31a-8a07-4ad8-94d2-11d60dde24da tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] Running cmd (subprocess): nvme version {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:47:13 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-4b32d31a-8a07-4ad8-94d2-11d60dde24da tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] 'nvme version' failed. Not Retrying. {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 09:47:13 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4b32d31a-8a07-4ad8-94d2-11d60dde24da tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] nvme not present on system {{(pid=75229) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 09:47:13 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:47:13 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 09:47:13 user nova-compute[75229]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 09:47:13 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff0785cf-b5c3-421b-924b-7a424cd1a985]: (4, '') {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:47:13 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.lightos [None req-4b32d31a-8a07-4ad8-94d2-11d60dde24da tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75229) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 09:47:13 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.lightos [None req-4b32d31a-8a07-4ad8-94d2-11d60dde24da tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75229) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 09:47:13 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.lightos [None req-4b32d31a-8a07-4ad8-94d2-11d60dde24da tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] LIGHTOS: no hostnqn found. {{(pid=75229) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 09:47:13 user nova-compute[75229]: DEBUG os_brick.utils [None req-4b32d31a-8a07-4ad8-94d2-11d60dde24da tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f1154031c835', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 09:47:13 user nova-compute[75229]: DEBUG nova.virt.block_device [None req-4b32d31a-8a07-4ad8-94d2-11d60dde24da tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] [instance: 9bcd05e7-481c-4ee9-953d-2873e6aa849d] Updating existing volume attachment record: 5073b076-8f8d-41f4-82e5-a3746edbe63e {{(pid=75229) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 09:47:14 user nova-compute[75229]: DEBUG nova.network.neutron [None req-4b32d31a-8a07-4ad8-94d2-11d60dde24da tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] [instance: 9bcd05e7-481c-4ee9-953d-2873e6aa849d] Successfully created port: 71040f8f-3771-47df-a138-07571bf3eb9b {{(pid=75229) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 09:47:14 user nova-compute[75229]: DEBUG nova.network.neutron [None req-4b32d31a-8a07-4ad8-94d2-11d60dde24da tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] [instance: 9bcd05e7-481c-4ee9-953d-2873e6aa849d] Successfully created port: 7363cfca-de5d-4f2f-b467-752de544bc21 {{(pid=75229) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 09:47:15 user nova-compute[75229]: DEBUG nova.network.neutron [None req-4b32d31a-8a07-4ad8-94d2-11d60dde24da tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] [instance: 9bcd05e7-481c-4ee9-953d-2873e6aa849d] Successfully created port: fccc2ab0-7340-4ab5-be12-dd7b08c0cc72 {{(pid=75229) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 09:47:15 user nova-compute[75229]: DEBUG nova.network.neutron [None req-4b32d31a-8a07-4ad8-94d2-11d60dde24da tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] [instance: 9bcd05e7-481c-4ee9-953d-2873e6aa849d] Successfully created port: 1766a369-08d0-4fc1-b0b3-fc8e3c6a051f {{(pid=75229) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 09:47:16 user nova-compute[75229]: DEBUG nova.network.neutron [None req-4b32d31a-8a07-4ad8-94d2-11d60dde24da tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] [instance: 9bcd05e7-481c-4ee9-953d-2873e6aa849d] Successfully created port: 94fc3f23-6f54-4e7c-815d-bf0c53245856 {{(pid=75229) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 09:47:17 user nova-compute[75229]: DEBUG nova.network.neutron [None req-4b32d31a-8a07-4ad8-94d2-11d60dde24da tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] [instance: 9bcd05e7-481c-4ee9-953d-2873e6aa849d] Successfully updated port: 71040f8f-3771-47df-a138-07571bf3eb9b {{(pid=75229) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 09:47:17 user nova-compute[75229]: DEBUG nova.compute.manager [req-f1460c90-4aa7-4e73-8eb4-eaf80fdfed26 req-a1cdfeae-519d-4353-87fd-2a8d2b9fdad4 service nova] [instance: 9bcd05e7-481c-4ee9-953d-2873e6aa849d] Received event network-changed-71040f8f-3771-47df-a138-07571bf3eb9b {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:47:17 user nova-compute[75229]: DEBUG nova.compute.manager [req-f1460c90-4aa7-4e73-8eb4-eaf80fdfed26 req-a1cdfeae-519d-4353-87fd-2a8d2b9fdad4 service nova] [instance: 9bcd05e7-481c-4ee9-953d-2873e6aa849d] Refreshing instance network info cache due to event network-changed-71040f8f-3771-47df-a138-07571bf3eb9b. {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 09:47:17 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-f1460c90-4aa7-4e73-8eb4-eaf80fdfed26 req-a1cdfeae-519d-4353-87fd-2a8d2b9fdad4 service nova] Acquiring lock "refresh_cache-9bcd05e7-481c-4ee9-953d-2873e6aa849d" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 09:47:17 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-f1460c90-4aa7-4e73-8eb4-eaf80fdfed26 req-a1cdfeae-519d-4353-87fd-2a8d2b9fdad4 service nova] Acquired lock "refresh_cache-9bcd05e7-481c-4ee9-953d-2873e6aa849d" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 09:47:17 user nova-compute[75229]: DEBUG nova.network.neutron [req-f1460c90-4aa7-4e73-8eb4-eaf80fdfed26 req-a1cdfeae-519d-4353-87fd-2a8d2b9fdad4 service nova] [instance: 9bcd05e7-481c-4ee9-953d-2873e6aa849d] Refreshing network info cache for port 71040f8f-3771-47df-a138-07571bf3eb9b {{(pid=75229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 09:47:17 user nova-compute[75229]: DEBUG nova.network.neutron [req-f1460c90-4aa7-4e73-8eb4-eaf80fdfed26 req-a1cdfeae-519d-4353-87fd-2a8d2b9fdad4 service nova] [instance: 9bcd05e7-481c-4ee9-953d-2873e6aa849d] Instance cache missing network info. {{(pid=75229) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 09:47:17 user nova-compute[75229]: DEBUG nova.network.neutron [req-f1460c90-4aa7-4e73-8eb4-eaf80fdfed26 req-a1cdfeae-519d-4353-87fd-2a8d2b9fdad4 service nova] [instance: 9bcd05e7-481c-4ee9-953d-2873e6aa849d] Updating instance_info_cache with network_info: [] {{(pid=75229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 09:47:17 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-f1460c90-4aa7-4e73-8eb4-eaf80fdfed26 req-a1cdfeae-519d-4353-87fd-2a8d2b9fdad4 service nova] Releasing lock "refresh_cache-9bcd05e7-481c-4ee9-953d-2873e6aa849d" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 09:47:17 user nova-compute[75229]: DEBUG nova.network.neutron [None req-4b32d31a-8a07-4ad8-94d2-11d60dde24da tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] [instance: 9bcd05e7-481c-4ee9-953d-2873e6aa849d] Successfully updated port: ddcf0922-99ea-4e9f-8fe3-61df68231a99 {{(pid=75229) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 09:47:18 user nova-compute[75229]: INFO nova.virt.block_device [None req-4b32d31a-8a07-4ad8-94d2-11d60dde24da tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] [instance: 9bcd05e7-481c-4ee9-953d-2873e6aa849d] Booting with volume b0433e38-fa42-4cff-af48-8cb5da297597 at /dev/vdb
Nov 14 09:47:18 user nova-compute[75229]: DEBUG os_brick.utils [None req-4b32d31a-8a07-4ad8-94d2-11d60dde24da tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 09:47:18 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:47:18 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:47:18 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[28f682b8-5cfd-4225-b78c-0ba2d1c43224]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f1154031c835\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:47:18 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:47:18 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 09:47:18 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 09:47:18 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75229) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 09:47:18 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75229) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 09:47:18 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:47:18 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[64c35a86-e958-48f6-8d3d-0e2f493e223a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:47:18 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:47:18 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:47:18 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75229) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 09:47:18 user nova-compute[75229]: DEBUG nova.network.neutron [None req-4b32d31a-8a07-4ad8-94d2-11d60dde24da tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] [instance: 9bcd05e7-481c-4ee9-953d-2873e6aa849d] Successfully updated port: db5f7129-8708-4f26-9975-c462270d47f3 {{(pid=75229) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 09:47:18 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.106s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:47:18 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[598050df-a21d-42be-a4e3-1b5acba29b94]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:47:18 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5ee7f75-831c-4e52-b574-d3ff02d2a504]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:47:18 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-4b32d31a-8a07-4ad8-94d2-11d60dde24da tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] Running cmd (subprocess): nvme version {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:47:18 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-4b32d31a-8a07-4ad8-94d2-11d60dde24da tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] 'nvme version' failed. Not Retrying. {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 09:47:18 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4b32d31a-8a07-4ad8-94d2-11d60dde24da tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] nvme not present on system {{(pid=75229) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 09:47:18 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:47:18 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 09:47:18 user nova-compute[75229]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 09:47:18 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[6164358b-cdf4-4841-ba04-ee8ee55302b5]: (4, '') {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:47:18 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.lightos [None req-4b32d31a-8a07-4ad8-94d2-11d60dde24da tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75229) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 09:47:18 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.lightos [None req-4b32d31a-8a07-4ad8-94d2-11d60dde24da tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75229) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 09:47:18 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.lightos [None req-4b32d31a-8a07-4ad8-94d2-11d60dde24da tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] LIGHTOS: no hostnqn found. {{(pid=75229) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 09:47:18 user nova-compute[75229]: DEBUG os_brick.utils [None req-4b32d31a-8a07-4ad8-94d2-11d60dde24da tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] <== get_connector_properties: return (207ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f1154031c835', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 09:47:18 user nova-compute[75229]: DEBUG nova.virt.block_device [None req-4b32d31a-8a07-4ad8-94d2-11d60dde24da tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] [instance: 9bcd05e7-481c-4ee9-953d-2873e6aa849d] Updating existing volume attachment record: 2a9e65ed-ba4d-4653-81f6-db722f0c556b {{(pid=75229) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 09:47:19 user nova-compute[75229]: DEBUG nova.network.neutron [None req-4b32d31a-8a07-4ad8-94d2-11d60dde24da tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] [instance: 9bcd05e7-481c-4ee9-953d-2873e6aa849d] Successfully updated port: 7363cfca-de5d-4f2f-b467-752de544bc21 {{(pid=75229) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 09:47:19 user nova-compute[75229]: DEBUG nova.compute.manager [req-6e8462de-26a6-4565-a123-1b1693791c10 req-d637abc4-c741-49b2-8a7f-2c55cd33e704 service nova] [instance: 9bcd05e7-481c-4ee9-953d-2873e6aa849d] Received event network-changed-ddcf0922-99ea-4e9f-8fe3-61df68231a99 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:47:19 user nova-compute[75229]: DEBUG nova.compute.manager [req-6e8462de-26a6-4565-a123-1b1693791c10 req-d637abc4-c741-49b2-8a7f-2c55cd33e704 service nova] [instance: 9bcd05e7-481c-4ee9-953d-2873e6aa849d] Refreshing instance network info cache due to event network-changed-ddcf0922-99ea-4e9f-8fe3-61df68231a99. {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 09:47:19 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-6e8462de-26a6-4565-a123-1b1693791c10 req-d637abc4-c741-49b2-8a7f-2c55cd33e704 service nova] Acquiring lock "refresh_cache-9bcd05e7-481c-4ee9-953d-2873e6aa849d" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 09:47:19 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-6e8462de-26a6-4565-a123-1b1693791c10 req-d637abc4-c741-49b2-8a7f-2c55cd33e704 service nova] Acquired lock "refresh_cache-9bcd05e7-481c-4ee9-953d-2873e6aa849d" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 09:47:19 user nova-compute[75229]: DEBUG nova.network.neutron [req-6e8462de-26a6-4565-a123-1b1693791c10 req-d637abc4-c741-49b2-8a7f-2c55cd33e704 service nova] [instance: 9bcd05e7-481c-4ee9-953d-2873e6aa849d] Refreshing network info cache for port ddcf0922-99ea-4e9f-8fe3-61df68231a99 {{(pid=75229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 09:47:19 user nova-compute[75229]: DEBUG nova.network.neutron [req-6e8462de-26a6-4565-a123-1b1693791c10 req-d637abc4-c741-49b2-8a7f-2c55cd33e704 service nova] [instance: 9bcd05e7-481c-4ee9-953d-2873e6aa849d] Instance cache missing network info. {{(pid=75229) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 09:47:19 user nova-compute[75229]: DEBUG nova.network.neutron [req-6e8462de-26a6-4565-a123-1b1693791c10 req-d637abc4-c741-49b2-8a7f-2c55cd33e704 service nova] [instance: 9bcd05e7-481c-4ee9-953d-2873e6aa849d] Updating instance_info_cache with network_info: [] {{(pid=75229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 09:47:19 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-6e8462de-26a6-4565-a123-1b1693791c10 req-d637abc4-c741-49b2-8a7f-2c55cd33e704 service nova] Releasing lock "refresh_cache-9bcd05e7-481c-4ee9-953d-2873e6aa849d" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 09:47:19 user nova-compute[75229]: DEBUG nova.compute.manager [req-6e8462de-26a6-4565-a123-1b1693791c10 req-d637abc4-c741-49b2-8a7f-2c55cd33e704 service nova] [instance: 9bcd05e7-481c-4ee9-953d-2873e6aa849d] Received event network-changed-db5f7129-8708-4f26-9975-c462270d47f3 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:47:19 user nova-compute[75229]: DEBUG nova.compute.manager [req-6e8462de-26a6-4565-a123-1b1693791c10 req-d637abc4-c741-49b2-8a7f-2c55cd33e704 service nova] [instance: 9bcd05e7-481c-4ee9-953d-2873e6aa849d] Refreshing instance network info cache due to event network-changed-db5f7129-8708-4f26-9975-c462270d47f3. {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 09:47:19 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-6e8462de-26a6-4565-a123-1b1693791c10 req-d637abc4-c741-49b2-8a7f-2c55cd33e704 service nova] Acquiring lock "refresh_cache-9bcd05e7-481c-4ee9-953d-2873e6aa849d" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 09:47:19 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-6e8462de-26a6-4565-a123-1b1693791c10 req-d637abc4-c741-49b2-8a7f-2c55cd33e704 service nova] Acquired lock "refresh_cache-9bcd05e7-481c-4ee9-953d-2873e6aa849d" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 09:47:19 user nova-compute[75229]: DEBUG nova.network.neutron [req-6e8462de-26a6-4565-a123-1b1693791c10 req-d637abc4-c741-49b2-8a7f-2c55cd33e704 service nova] [instance: 9bcd05e7-481c-4ee9-953d-2873e6aa849d] Refreshing network info cache for port db5f7129-8708-4f26-9975-c462270d47f3 {{(pid=75229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 09:47:19 user nova-compute[75229]: DEBUG nova.network.neutron [req-6e8462de-26a6-4565-a123-1b1693791c10 req-d637abc4-c741-49b2-8a7f-2c55cd33e704 service nova] [instance: 9bcd05e7-481c-4ee9-953d-2873e6aa849d] Instance cache missing network info. {{(pid=75229) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 09:47:19 user nova-compute[75229]: DEBUG nova.network.neutron [None req-4b32d31a-8a07-4ad8-94d2-11d60dde24da tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] [instance: 9bcd05e7-481c-4ee9-953d-2873e6aa849d] Successfully updated port: fccc2ab0-7340-4ab5-be12-dd7b08c0cc72 {{(pid=75229) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 09:47:19 user nova-compute[75229]: DEBUG nova.network.neutron [req-6e8462de-26a6-4565-a123-1b1693791c10 req-d637abc4-c741-49b2-8a7f-2c55cd33e704 service nova] [instance: 9bcd05e7-481c-4ee9-953d-2873e6aa849d] Updating instance_info_cache with network_info: [] {{(pid=75229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 09:47:19 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-6e8462de-26a6-4565-a123-1b1693791c10 req-d637abc4-c741-49b2-8a7f-2c55cd33e704 service nova] Releasing lock "refresh_cache-9bcd05e7-481c-4ee9-953d-2873e6aa849d" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 09:47:19 user nova-compute[75229]: DEBUG nova.compute.manager [req-6e8462de-26a6-4565-a123-1b1693791c10 req-d637abc4-c741-49b2-8a7f-2c55cd33e704 service nova] [instance: 9bcd05e7-481c-4ee9-953d-2873e6aa849d] Received event network-changed-7363cfca-de5d-4f2f-b467-752de544bc21 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:47:19 user nova-compute[75229]: DEBUG nova.compute.manager [req-6e8462de-26a6-4565-a123-1b1693791c10 req-d637abc4-c741-49b2-8a7f-2c55cd33e704 service nova] [instance: 9bcd05e7-481c-4ee9-953d-2873e6aa849d] Refreshing instance network info cache due to event network-changed-7363cfca-de5d-4f2f-b467-752de544bc21. {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 09:47:19 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-6e8462de-26a6-4565-a123-1b1693791c10 req-d637abc4-c741-49b2-8a7f-2c55cd33e704 service nova] Acquiring lock "refresh_cache-9bcd05e7-481c-4ee9-953d-2873e6aa849d" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 09:47:19 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-6e8462de-26a6-4565-a123-1b1693791c10 req-d637abc4-c741-49b2-8a7f-2c55cd33e704 service nova] Acquired lock "refresh_cache-9bcd05e7-481c-4ee9-953d-2873e6aa849d" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 09:47:19 user nova-compute[75229]: DEBUG nova.network.neutron [req-6e8462de-26a6-4565-a123-1b1693791c10 req-d637abc4-c741-49b2-8a7f-2c55cd33e704 service nova] [instance: 9bcd05e7-481c-4ee9-953d-2873e6aa849d] Refreshing network info cache for port 7363cfca-de5d-4f2f-b467-752de544bc21 {{(pid=75229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 09:47:19 user nova-compute[75229]: DEBUG nova.network.neutron [req-6e8462de-26a6-4565-a123-1b1693791c10 req-d637abc4-c741-49b2-8a7f-2c55cd33e704 service nova] [instance: 9bcd05e7-481c-4ee9-953d-2873e6aa849d] Instance cache missing network info. {{(pid=75229) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 09:47:20 user nova-compute[75229]: DEBUG nova.network.neutron [req-6e8462de-26a6-4565-a123-1b1693791c10 req-d637abc4-c741-49b2-8a7f-2c55cd33e704 service nova] [instance: 9bcd05e7-481c-4ee9-953d-2873e6aa849d] Updating instance_info_cache with network_info: [] {{(pid=75229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 09:47:20 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-6e8462de-26a6-4565-a123-1b1693791c10 req-d637abc4-c741-49b2-8a7f-2c55cd33e704 service nova] Releasing lock "refresh_cache-9bcd05e7-481c-4ee9-953d-2873e6aa849d" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 09:47:20 user nova-compute[75229]: DEBUG nova.network.neutron [None req-4b32d31a-8a07-4ad8-94d2-11d60dde24da tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] [instance: 9bcd05e7-481c-4ee9-953d-2873e6aa849d] Successfully updated port: 1766a369-08d0-4fc1-b0b3-fc8e3c6a051f {{(pid=75229) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 09:47:20 user nova-compute[75229]: DEBUG nova.network.neutron [None req-4b32d31a-8a07-4ad8-94d2-11d60dde24da tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] [instance: 9bcd05e7-481c-4ee9-953d-2873e6aa849d] Successfully updated port: 94fc3f23-6f54-4e7c-815d-bf0c53245856 {{(pid=75229) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 09:47:20 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-4b32d31a-8a07-4ad8-94d2-11d60dde24da tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] Acquiring lock "refresh_cache-9bcd05e7-481c-4ee9-953d-2873e6aa849d" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 09:47:20 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-4b32d31a-8a07-4ad8-94d2-11d60dde24da tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] Acquired lock "refresh_cache-9bcd05e7-481c-4ee9-953d-2873e6aa849d" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 09:47:20 user nova-compute[75229]: DEBUG nova.network.neutron [None req-4b32d31a-8a07-4ad8-94d2-11d60dde24da tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] [instance: 9bcd05e7-481c-4ee9-953d-2873e6aa849d] Building network info cache for instance {{(pid=75229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 09:47:20 user nova-compute[75229]: DEBUG nova.network.neutron [None req-4b32d31a-8a07-4ad8-94d2-11d60dde24da tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] [instance: 9bcd05e7-481c-4ee9-953d-2873e6aa849d] Instance cache missing network info. {{(pid=75229) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 09:47:21 user nova-compute[75229]: DEBUG nova.compute.manager [req-e52fc1b3-06e3-4400-a0df-d10e8c838467 req-61441b25-d202-4348-bb81-b079c885006f service nova] [instance: 9bcd05e7-481c-4ee9-953d-2873e6aa849d] Received event network-changed-fccc2ab0-7340-4ab5-be12-dd7b08c0cc72 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:47:21 user nova-compute[75229]: DEBUG nova.compute.manager [req-e52fc1b3-06e3-4400-a0df-d10e8c838467 req-61441b25-d202-4348-bb81-b079c885006f service nova] [instance: 9bcd05e7-481c-4ee9-953d-2873e6aa849d] Refreshing instance network info cache due to event network-changed-fccc2ab0-7340-4ab5-be12-dd7b08c0cc72. {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 09:47:21 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-e52fc1b3-06e3-4400-a0df-d10e8c838467 req-61441b25-d202-4348-bb81-b079c885006f service nova] Acquiring lock "refresh_cache-9bcd05e7-481c-4ee9-953d-2873e6aa849d" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 09:47:22 user nova-compute[75229]: DEBUG nova.network.neutron [None req-4b32d31a-8a07-4ad8-94d2-11d60dde24da tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] [instance: 9bcd05e7-481c-4ee9-953d-2873e6aa849d] Updating instance_info_cache with network_info: [{"id": "71040f8f-3771-47df-a138-07571bf3eb9b", "address": "fa:16:3e:76:1c:74", "network": {"id": "8efb8df0-c10e-46aa-b2e0-bb03cfeb00e8", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-2058178363-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "703b87f76dd845e4846d746bbf3dbb6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71040f8f-37", "ovs_interfaceid": "71040f8f-3771-47df-a138-07571bf3eb9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ddcf0922-99ea-4e9f-8fe3-61df68231a99", "address": "fa:16:3e:2d:60:2c", "network": {"id": "cd9117eb-aeb0-4c47-b450-2286d1680ed3", "bridge": "br-int", "label": "tempest-device-tagging-net1-1915364084", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.144", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "703b87f76dd845e4846d746bbf3dbb6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapddcf0922-99", "ovs_interfaceid": "ddcf0922-99ea-4e9f-8fe3-61df68231a99", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "db5f7129-8708-4f26-9975-c462270d47f3", "address": "fa:16:3e:6a:77:bd", "network": {"id": "cd9117eb-aeb0-4c47-b450-2286d1680ed3", "bridge": "br-int", "label": "tempest-device-tagging-net1-1915364084", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.33", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "703b87f76dd845e4846d746bbf3dbb6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb5f7129-87", "ovs_interfaceid": "db5f7129-8708-4f26-9975-c462270d47f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7363cfca-de5d-4f2f-b467-752de544bc21", "address": "fa:16:3e:f9:0c:a4", "network": {"id": "cd9117eb-aeb0-4c47-b450-2286d1680ed3", "bridge": "br-int", "label": "tempest-device-tagging-net1-1915364084", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.239", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "703b87f76dd845e4846d746bbf3dbb6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7363cfca-de", "ovs_interfaceid": "7363cfca-de5d-4f2f-b467-752de544bc21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "fccc2ab0-7340-4ab5-be12-dd7b08c0cc72", "address": "fa:16:3e:bf:7e:6f", "network": {"id": "cd9117eb-aeb0-4c47-b450-2286d1680ed3", "bridge": "br-int", "label": "tempest-device-tagging-net1-1915364084", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.125", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "703b87f76dd845e4846d746bbf3dbb6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfccc2ab0-73", "ovs_interfaceid": "fccc2ab0-7340-4ab5-be12-dd7b08c0cc72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1766a369-08d0-4fc1-b0b3-fc8e3c6a051f", "address": "fa:16:3e:9e:05:3c", "network": {"id": "5584ce2f-1d94-4822-b275-d059d121bea5", "bridge": "br-int", "label": "tempest-device-tagging-net2-310256364", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "703b87f76dd845e4846d746bbf3dbb6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1766a369-08", "ovs_interfaceid": "1766a369-08d0-4fc1-b0b3-fc8e3c6a051f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "94fc3f23-6f54-4e7c-815d-bf0c53245856", "address": "fa:16:3e:51:94:fa", "network": {"id": "5584ce2f-1d94-4822-b275-d059d121bea5", "bridge": "br-int", "label": "tempest-device-tagging-net2-310256364", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "703b87f76dd845e4846d746bbf3dbb6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94fc3f23-6f", "ovs_interfaceid": "94fc3f23-6f54-4e7c-815d-bf0c53245856", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 09:47:22 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-4b32d31a-8a07-4ad8-94d2-11d60dde24da tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] Releasing lock "refresh_cache-9bcd05e7-481c-4ee9-953d-2873e6aa849d" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 09:47:22 user nova-compute[75229]: DEBUG nova.compute.manager [None req-4b32d31a-8a07-4ad8-94d2-11d60dde24da tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] [instance: 9bcd05e7-481c-4ee9-953d-2873e6aa849d] Instance network_info: |[{"id": "71040f8f-3771-47df-a138-07571bf3eb9b", "address": "fa:16:3e:76:1c:74", "network": {"id": "8efb8df0-c10e-46aa-b2e0-bb03cfeb00e8", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-2058178363-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "703b87f76dd845e4846d746bbf3dbb6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71040f8f-37", "ovs_interfaceid": "71040f8f-3771-47df-a138-07571bf3eb9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ddcf0922-99ea-4e9f-8fe3-61df68231a99", "address": "fa:16:3e:2d:60:2c", "network": {"id": "cd9117eb-aeb0-4c47-b450-2286d1680ed3", "bridge": "br-int", "label": "tempest-device-tagging-net1-1915364084", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.144", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "703b87f76dd845e4846d746bbf3dbb6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapddcf0922-99", "ovs_interfaceid": "ddcf0922-99ea-4e9f-8fe3-61df68231a99", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "db5f7129-8708-4f26-9975-c462270d47f3", "address": "fa:16:3e:6a:77:bd", "network": {"id": "cd9117eb-aeb0-4c47-b450-2286d1680ed3", "bridge": "br-int", "label": "tempest-device-tagging-net1-1915364084", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.33", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "703b87f76dd845e4846d746bbf3dbb6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb5f7129-87", "ovs_interfaceid": "db5f7129-8708-4f26-9975-c462270d47f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7363cfca-de5d-4f2f-b467-752de544bc21", "address": "fa:16:3e:f9:0c:a4", "network": {"id": "cd9117eb-aeb0-4c47-b450-2286d1680ed3", "bridge": "br-int", "label": "tempest-device-tagging-net1-1915364084", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.239", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "703b87f76dd845e4846d746bbf3dbb6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7363cfca-de", "ovs_interfaceid": "7363cfca-de5d-4f2f-b467-752de544bc21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "fccc2ab0-7340-4ab5-be12-dd7b08c0cc72", "address": "fa:16:3e:bf:7e:6f", "network": {"id": "cd9117eb-aeb0-4c47-b450-2286d1680ed3", "bridge": "br-int", "label": "tempest-device-tagging-net1-1915364084", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.125", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "703b87f76dd845e4846d746bbf3dbb6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfccc2ab0-73", "ovs_interfaceid": "fccc2ab0-7340-4ab5-be12-dd7b08c0cc72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1766a369-08d0-4fc1-b0b3-fc8e3c6a051f", "address": "fa:16:3e:9e:05:3c", "network": {"id": "5584ce2f-1d94-4822-b275-d059d121bea5", "bridge": "br-int", "label": "tempest-device-tagging-net2-310256364", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "703b87f76dd845e4846d746bbf3dbb6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1766a369-08", "ovs_interfaceid": "1766a369-08d0-4fc1-b0b3-fc8e3c6a051f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "94fc3f23-6f54-4e7c-815d-bf0c53245856", "address": "fa:16:3e:51:94:fa", "network": {"id": "5584ce2f-1d94-4822-b275-d059d121bea5", "bridge": "br-int", "label": "tempest-device-tagging-net2-310256364", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "703b87f76dd845e4846d746bbf3dbb6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94fc3f23-6f", "ovs_interfaceid": "94fc3f23-6f54-4e7c-815d-bf0c53245856", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75229) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 09:47:22 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-e52fc1b3-06e3-4400-a0df-d10e8c838467 req-61441b25-d202-4348-bb81-b079c885006f service nova] Acquired lock "refresh_cache-9bcd05e7-481c-4ee9-953d-2873e6aa849d" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 09:47:22 user nova-compute[75229]: DEBUG nova.network.neutron [req-e52fc1b3-06e3-4400-a0df-d10e8c838467 req-61441b25-d202-4348-bb81-b079c885006f service nova] [instance: 9bcd05e7-481c-4ee9-953d-2873e6aa849d] Refreshing network info cache for port fccc2ab0-7340-4ab5-be12-dd7b08c0cc72 {{(pid=75229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 09:47:22 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:47:23 user nova-compute[75229]: INFO nova.virt.block_device [None req-4b32d31a-8a07-4ad8-94d2-11d60dde24da tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] [instance: 9bcd05e7-481c-4ee9-953d-2873e6aa849d] Booting with volume 13c53511-ea64-4896-b325-504ce58d7895 at /dev/vdc
Nov 14 09:47:23 user nova-compute[75229]: DEBUG nova.network.neutron [req-e52fc1b3-06e3-4400-a0df-d10e8c838467 req-61441b25-d202-4348-bb81-b079c885006f service nova] [instance: 9bcd05e7-481c-4ee9-953d-2873e6aa849d] Updated VIF entry in instance network info cache for port fccc2ab0-7340-4ab5-be12-dd7b08c0cc72. {{(pid=75229) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 09:47:23 user nova-compute[75229]: DEBUG nova.network.neutron [req-e52fc1b3-06e3-4400-a0df-d10e8c838467 req-61441b25-d202-4348-bb81-b079c885006f service nova] [instance: 9bcd05e7-481c-4ee9-953d-2873e6aa849d] Updating instance_info_cache with network_info: [{"id": "71040f8f-3771-47df-a138-07571bf3eb9b", "address": "fa:16:3e:76:1c:74", "network": {"id": "8efb8df0-c10e-46aa-b2e0-bb03cfeb00e8", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-2058178363-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "703b87f76dd845e4846d746bbf3dbb6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71040f8f-37", "ovs_interfaceid": "71040f8f-3771-47df-a138-07571bf3eb9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ddcf0922-99ea-4e9f-8fe3-61df68231a99", "address": "fa:16:3e:2d:60:2c", "network": {"id": "cd9117eb-aeb0-4c47-b450-2286d1680ed3", "bridge": "br-int", "label": "tempest-device-tagging-net1-1915364084", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.144", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "703b87f76dd845e4846d746bbf3dbb6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapddcf0922-99", "ovs_interfaceid": "ddcf0922-99ea-4e9f-8fe3-61df68231a99", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "db5f7129-8708-4f26-9975-c462270d47f3", "address": "fa:16:3e:6a:77:bd", "network": {"id": "cd9117eb-aeb0-4c47-b450-2286d1680ed3", "bridge": "br-int", "label": "tempest-device-tagging-net1-1915364084", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.33", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "703b87f76dd845e4846d746bbf3dbb6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb5f7129-87", "ovs_interfaceid": "db5f7129-8708-4f26-9975-c462270d47f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7363cfca-de5d-4f2f-b467-752de544bc21", "address": "fa:16:3e:f9:0c:a4", "network": {"id": "cd9117eb-aeb0-4c47-b450-2286d1680ed3", "bridge": "br-int", "label": "tempest-device-tagging-net1-1915364084", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.239", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "703b87f76dd845e4846d746bbf3dbb6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7363cfca-de", "ovs_interfaceid": "7363cfca-de5d-4f2f-b467-752de544bc21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "fccc2ab0-7340-4ab5-be12-dd7b08c0cc72", "address": "fa:16:3e:bf:7e:6f", "network": {"id": "cd9117eb-aeb0-4c47-b450-2286d1680ed3", "bridge": "br-int", "label": "tempest-device-tagging-net1-1915364084", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.125", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "703b87f76dd845e4846d746bbf3dbb6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfccc2ab0-73", "ovs_interfaceid": "fccc2ab0-7340-4ab5-be12-dd7b08c0cc72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1766a369-08d0-4fc1-b0b3-fc8e3c6a051f", "address": "fa:16:3e:9e:05:3c", "network": {"id": "5584ce2f-1d94-4822-b275-d059d121bea5", "bridge": "br-int", "label": "tempest-device-tagging-net2-310256364", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "703b87f76dd845e4846d746bbf3dbb6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1766a369-08", "ovs_interfaceid": "1766a369-08d0-4fc1-b0b3-fc8e3c6a051f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "94fc3f23-6f54-4e7c-815d-bf0c53245856", "address": "fa:16:3e:51:94:fa", "network": {"id": "5584ce2f-1d94-4822-b275-d059d121bea5", "bridge": "br-int", "label": "tempest-device-tagging-net2-310256364", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "703b87f76dd845e4846d746bbf3dbb6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94fc3f23-6f", "ovs_interfaceid": "94fc3f23-6f54-4e7c-815d-bf0c53245856", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 09:47:23 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-e52fc1b3-06e3-4400-a0df-d10e8c838467 req-61441b25-d202-4348-bb81-b079c885006f service nova] Releasing lock "refresh_cache-9bcd05e7-481c-4ee9-953d-2873e6aa849d" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 09:47:23 user nova-compute[75229]: DEBUG nova.compute.manager [req-e52fc1b3-06e3-4400-a0df-d10e8c838467 req-61441b25-d202-4348-bb81-b079c885006f service nova] [instance: 9bcd05e7-481c-4ee9-953d-2873e6aa849d] Received event network-changed-1766a369-08d0-4fc1-b0b3-fc8e3c6a051f {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:47:23 user nova-compute[75229]: DEBUG nova.compute.manager [req-e52fc1b3-06e3-4400-a0df-d10e8c838467 req-61441b25-d202-4348-bb81-b079c885006f service nova] [instance: 9bcd05e7-481c-4ee9-953d-2873e6aa849d] Refreshing instance network info cache due to event network-changed-1766a369-08d0-4fc1-b0b3-fc8e3c6a051f. {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 09:47:23 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-e52fc1b3-06e3-4400-a0df-d10e8c838467 req-61441b25-d202-4348-bb81-b079c885006f service nova] Acquiring lock "refresh_cache-9bcd05e7-481c-4ee9-953d-2873e6aa849d" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 09:47:23 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-e52fc1b3-06e3-4400-a0df-d10e8c838467 req-61441b25-d202-4348-bb81-b079c885006f service nova] Acquired lock "refresh_cache-9bcd05e7-481c-4ee9-953d-2873e6aa849d" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 09:47:23 user nova-compute[75229]: DEBUG nova.network.neutron [req-e52fc1b3-06e3-4400-a0df-d10e8c838467 req-61441b25-d202-4348-bb81-b079c885006f service nova] [instance: 9bcd05e7-481c-4ee9-953d-2873e6aa849d] Refreshing network info cache for port 1766a369-08d0-4fc1-b0b3-fc8e3c6a051f {{(pid=75229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 09:47:23 user nova-compute[75229]: DEBUG os_brick.utils [None req-4b32d31a-8a07-4ad8-94d2-11d60dde24da tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 09:47:23 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:47:23 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:47:23 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[09e0912e-263e-420d-ae65-6b1d603a02c5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f1154031c835\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:47:23 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:47:23 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:47:23 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:47:23 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cba9df1-ef7d-46fa-affa-ad2df2464991]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:47:23 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:47:23 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:47:23 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fcb46b4-77f7-4648-b91e-4d79f504d96a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:47:23 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[96b311d3-7241-4a9d-b085-a5d722e0acfb]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:47:23 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-4b32d31a-8a07-4ad8-94d2-11d60dde24da tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] Running cmd (subprocess): nvme version {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:47:23 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-4b32d31a-8a07-4ad8-94d2-11d60dde24da tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] 'nvme version' failed. Not Retrying. {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 09:47:23 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4b32d31a-8a07-4ad8-94d2-11d60dde24da tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] nvme not present on system {{(pid=75229) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 09:47:23 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:47:23 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 09:47:23 user nova-compute[75229]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 09:47:23 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d67c9e5-8150-4ae1-b588-f9fff4ea338d]: (4, '') {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:47:23 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.lightos [None req-4b32d31a-8a07-4ad8-94d2-11d60dde24da tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75229) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 09:47:23 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.lightos [None req-4b32d31a-8a07-4ad8-94d2-11d60dde24da tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75229) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 09:47:23 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.lightos [None req-4b32d31a-8a07-4ad8-94d2-11d60dde24da tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] LIGHTOS: no hostnqn found. {{(pid=75229) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 09:47:23 user nova-compute[75229]: DEBUG os_brick.utils [None req-4b32d31a-8a07-4ad8-94d2-11d60dde24da tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f1154031c835', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 09:47:23 user nova-compute[75229]: DEBUG nova.virt.block_device [None req-4b32d31a-8a07-4ad8-94d2-11d60dde24da tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] [instance: 9bcd05e7-481c-4ee9-953d-2873e6aa849d] Updating existing volume attachment record: 9518cc06-9d40-4e89-8aa2-84fd69a7a029 {{(pid=75229) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 09:47:23 user nova-compute[75229]: DEBUG nova.network.neutron [req-e52fc1b3-06e3-4400-a0df-d10e8c838467 req-61441b25-d202-4348-bb81-b079c885006f service nova] [instance: 9bcd05e7-481c-4ee9-953d-2873e6aa849d] Updated VIF entry in instance network info cache for port 1766a369-08d0-4fc1-b0b3-fc8e3c6a051f. {{(pid=75229) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 09:47:23 user nova-compute[75229]: DEBUG nova.network.neutron [req-e52fc1b3-06e3-4400-a0df-d10e8c838467 req-61441b25-d202-4348-bb81-b079c885006f service nova] [instance: 9bcd05e7-481c-4ee9-953d-2873e6aa849d] Updating instance_info_cache with network_info: [{"id": "71040f8f-3771-47df-a138-07571bf3eb9b", "address": "fa:16:3e:76:1c:74", "network": {"id": "8efb8df0-c10e-46aa-b2e0-bb03cfeb00e8", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-2058178363-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "703b87f76dd845e4846d746bbf3dbb6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71040f8f-37", "ovs_interfaceid": "71040f8f-3771-47df-a138-07571bf3eb9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ddcf0922-99ea-4e9f-8fe3-61df68231a99", "address": "fa:16:3e:2d:60:2c", "network": {"id": "cd9117eb-aeb0-4c47-b450-2286d1680ed3", "bridge": "br-int", "label": "tempest-device-tagging-net1-1915364084", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.144", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "703b87f76dd845e4846d746bbf3dbb6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapddcf0922-99", "ovs_interfaceid": "ddcf0922-99ea-4e9f-8fe3-61df68231a99", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "db5f7129-8708-4f26-9975-c462270d47f3", "address": "fa:16:3e:6a:77:bd", "network": {"id": "cd9117eb-aeb0-4c47-b450-2286d1680ed3", "bridge": "br-int", "label": "tempest-device-tagging-net1-1915364084", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.33", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "703b87f76dd845e4846d746bbf3dbb6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb5f7129-87", "ovs_interfaceid": "db5f7129-8708-4f26-9975-c462270d47f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7363cfca-de5d-4f2f-b467-752de544bc21", "address": "fa:16:3e:f9:0c:a4", "network": {"id": "cd9117eb-aeb0-4c47-b450-2286d1680ed3", "bridge": "br-int", "label": "tempest-device-tagging-net1-1915364084", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.239", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "703b87f76dd845e4846d746bbf3dbb6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7363cfca-de", "ovs_interfaceid": "7363cfca-de5d-4f2f-b467-752de544bc21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "fccc2ab0-7340-4ab5-be12-dd7b08c0cc72", "address": "fa:16:3e:bf:7e:6f", "network": {"id": "cd9117eb-aeb0-4c47-b450-2286d1680ed3", "bridge": "br-int", "label": "tempest-device-tagging-net1-1915364084", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.125", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "703b87f76dd845e4846d746bbf3dbb6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfccc2ab0-73", "ovs_interfaceid": "fccc2ab0-7340-4ab5-be12-dd7b08c0cc72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1766a369-08d0-4fc1-b0b3-fc8e3c6a051f", "address": "fa:16:3e:9e:05:3c", "network": {"id": "5584ce2f-1d94-4822-b275-d059d121bea5", "bridge": "br-int", "label": "tempest-device-tagging-net2-310256364", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "703b87f76dd845e4846d746bbf3dbb6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1766a369-08", "ovs_interfaceid": "1766a369-08d0-4fc1-b0b3-fc8e3c6a051f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "94fc3f23-6f54-4e7c-815d-bf0c53245856", "address": "fa:16:3e:51:94:fa", "network": {"id": "5584ce2f-1d94-4822-b275-d059d121bea5", "bridge": "br-int", "label": "tempest-device-tagging-net2-310256364", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "703b87f76dd845e4846d746bbf3dbb6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94fc3f23-6f", "ovs_interfaceid": "94fc3f23-6f54-4e7c-815d-bf0c53245856", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 09:47:23 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-e52fc1b3-06e3-4400-a0df-d10e8c838467 req-61441b25-d202-4348-bb81-b079c885006f service nova] Releasing lock "refresh_cache-9bcd05e7-481c-4ee9-953d-2873e6aa849d" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 09:47:23 user nova-compute[75229]: DEBUG nova.compute.manager [req-e52fc1b3-06e3-4400-a0df-d10e8c838467 req-61441b25-d202-4348-bb81-b079c885006f service nova] [instance: 9bcd05e7-481c-4ee9-953d-2873e6aa849d] Received event network-changed-94fc3f23-6f54-4e7c-815d-bf0c53245856 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:47:23 user nova-compute[75229]: DEBUG nova.compute.manager [req-e52fc1b3-06e3-4400-a0df-d10e8c838467 req-61441b25-d202-4348-bb81-b079c885006f service nova] [instance: 9bcd05e7-481c-4ee9-953d-2873e6aa849d] Refreshing instance network info cache due to event network-changed-94fc3f23-6f54-4e7c-815d-bf0c53245856. {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 09:47:23 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-e52fc1b3-06e3-4400-a0df-d10e8c838467 req-61441b25-d202-4348-bb81-b079c885006f service nova] Acquiring lock "refresh_cache-9bcd05e7-481c-4ee9-953d-2873e6aa849d" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 09:47:23 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-e52fc1b3-06e3-4400-a0df-d10e8c838467 req-61441b25-d202-4348-bb81-b079c885006f service nova] Acquired lock "refresh_cache-9bcd05e7-481c-4ee9-953d-2873e6aa849d" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 09:47:23 user nova-compute[75229]: DEBUG nova.network.neutron [req-e52fc1b3-06e3-4400-a0df-d10e8c838467 req-61441b25-d202-4348-bb81-b079c885006f service nova] [instance: 9bcd05e7-481c-4ee9-953d-2873e6aa849d] Refreshing network info cache for port 94fc3f23-6f54-4e7c-815d-bf0c53245856 {{(pid=75229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 09:47:24 user nova-compute[75229]: DEBUG nova.network.neutron [req-e52fc1b3-06e3-4400-a0df-d10e8c838467 req-61441b25-d202-4348-bb81-b079c885006f service nova] [instance: 9bcd05e7-481c-4ee9-953d-2873e6aa849d] Updated VIF entry in instance network info cache for port 94fc3f23-6f54-4e7c-815d-bf0c53245856. {{(pid=75229) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 09:47:24 user nova-compute[75229]: DEBUG nova.network.neutron [req-e52fc1b3-06e3-4400-a0df-d10e8c838467 req-61441b25-d202-4348-bb81-b079c885006f service nova] [instance: 9bcd05e7-481c-4ee9-953d-2873e6aa849d] Updating instance_info_cache with network_info: [{"id": "71040f8f-3771-47df-a138-07571bf3eb9b", "address": "fa:16:3e:76:1c:74", "network": {"id": "8efb8df0-c10e-46aa-b2e0-bb03cfeb00e8", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-2058178363-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "703b87f76dd845e4846d746bbf3dbb6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71040f8f-37", "ovs_interfaceid": "71040f8f-3771-47df-a138-07571bf3eb9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ddcf0922-99ea-4e9f-8fe3-61df68231a99", "address": "fa:16:3e:2d:60:2c", "network": {"id": "cd9117eb-aeb0-4c47-b450-2286d1680ed3", "bridge": "br-int", "label": "tempest-device-tagging-net1-1915364084", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.144", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "703b87f76dd845e4846d746bbf3dbb6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapddcf0922-99", "ovs_interfaceid": "ddcf0922-99ea-4e9f-8fe3-61df68231a99", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "db5f7129-8708-4f26-9975-c462270d47f3", "address": "fa:16:3e:6a:77:bd", "network": {"id": "cd9117eb-aeb0-4c47-b450-2286d1680ed3", "bridge": "br-int", "label": "tempest-device-tagging-net1-1915364084", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.33", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "703b87f76dd845e4846d746bbf3dbb6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb5f7129-87", "ovs_interfaceid": "db5f7129-8708-4f26-9975-c462270d47f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7363cfca-de5d-4f2f-b467-752de544bc21", "address": "fa:16:3e:f9:0c:a4", "network": {"id": "cd9117eb-aeb0-4c47-b450-2286d1680ed3", "bridge": "br-int", "label": "tempest-device-tagging-net1-1915364084", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.239", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "703b87f76dd845e4846d746bbf3dbb6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7363cfca-de", "ovs_interfaceid": "7363cfca-de5d-4f2f-b467-752de544bc21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "fccc2ab0-7340-4ab5-be12-dd7b08c0cc72", "address": "fa:16:3e:bf:7e:6f", "network": {"id": "cd9117eb-aeb0-4c47-b450-2286d1680ed3", "bridge": "br-int", "label": "tempest-device-tagging-net1-1915364084", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.125", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "703b87f76dd845e4846d746bbf3dbb6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfccc2ab0-73", "ovs_interfaceid": "fccc2ab0-7340-4ab5-be12-dd7b08c0cc72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1766a369-08d0-4fc1-b0b3-fc8e3c6a051f", "address": "fa:16:3e:9e:05:3c", "network": {"id": "5584ce2f-1d94-4822-b275-d059d121bea5", "bridge": "br-int", "label": "tempest-device-tagging-net2-310256364", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "703b87f76dd845e4846d746bbf3dbb6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1766a369-08", "ovs_interfaceid": "1766a369-08d0-4fc1-b0b3-fc8e3c6a051f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "94fc3f23-6f54-4e7c-815d-bf0c53245856", "address": "fa:16:3e:51:94:fa", "network": {"id": "5584ce2f-1d94-4822-b275-d059d121bea5", "bridge": "br-int", "label": "tempest-device-tagging-net2-310256364", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "703b87f76dd845e4846d746bbf3dbb6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94fc3f23-6f", "ovs_interfaceid": "94fc3f23-6f54-4e7c-815d-bf0c53245856", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 09:47:24 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-e52fc1b3-06e3-4400-a0df-d10e8c838467 req-61441b25-d202-4348-bb81-b079c885006f service nova] Releasing lock "refresh_cache-9bcd05e7-481c-4ee9-953d-2873e6aa849d" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 09:47:27 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:47:28 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-472f0e44-9ddb-4f12-92ab-2ba1064b803f tempest-VolumesAssistedSnapshotsTest-596152604 tempest-VolumesAssistedSnapshotsTest-596152604-project-member] Acquiring lock "8623fdcc-99b7-44d6-ad81-dada5ba83a88" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:47:28 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-472f0e44-9ddb-4f12-92ab-2ba1064b803f tempest-VolumesAssistedSnapshotsTest-596152604 tempest-VolumesAssistedSnapshotsTest-596152604-project-member] Lock "8623fdcc-99b7-44d6-ad81-dada5ba83a88" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:47:28 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-472f0e44-9ddb-4f12-92ab-2ba1064b803f tempest-VolumesAssistedSnapshotsTest-596152604 tempest-VolumesAssistedSnapshotsTest-596152604-project-member] Acquiring lock "8623fdcc-99b7-44d6-ad81-dada5ba83a88-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:47:28 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-472f0e44-9ddb-4f12-92ab-2ba1064b803f tempest-VolumesAssistedSnapshotsTest-596152604 tempest-VolumesAssistedSnapshotsTest-596152604-project-member] Lock "8623fdcc-99b7-44d6-ad81-dada5ba83a88-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:47:28 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-472f0e44-9ddb-4f12-92ab-2ba1064b803f tempest-VolumesAssistedSnapshotsTest-596152604 tempest-VolumesAssistedSnapshotsTest-596152604-project-member] Lock "8623fdcc-99b7-44d6-ad81-dada5ba83a88-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:47:28 user nova-compute[75229]: INFO nova.compute.manager [None req-472f0e44-9ddb-4f12-92ab-2ba1064b803f tempest-VolumesAssistedSnapshotsTest-596152604 tempest-VolumesAssistedSnapshotsTest-596152604-project-member] [instance: 8623fdcc-99b7-44d6-ad81-dada5ba83a88] Terminating instance
Nov 14 09:47:28 user nova-compute[75229]: DEBUG nova.compute.manager [None req-472f0e44-9ddb-4f12-92ab-2ba1064b803f tempest-VolumesAssistedSnapshotsTest-596152604 tempest-VolumesAssistedSnapshotsTest-596152604-project-member] [instance: 8623fdcc-99b7-44d6-ad81-dada5ba83a88] Start destroying the instance on the hypervisor. {{(pid=75229) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 09:47:28 user nova-compute[75229]: DEBUG nova.compute.manager [None req-4b32d31a-8a07-4ad8-94d2-11d60dde24da tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] [instance: 9bcd05e7-481c-4ee9-953d-2873e6aa849d] Start spawning the instance on the hypervisor. {{(pid=75229) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 09:47:28 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-4b32d31a-8a07-4ad8-94d2-11d60dde24da tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] [instance: 9bcd05e7-481c-4ee9-953d-2873e6aa849d] Creating instance directory {{(pid=75229) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 09:47:28 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-4b32d31a-8a07-4ad8-94d2-11d60dde24da tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] [instance: 9bcd05e7-481c-4ee9-953d-2873e6aa849d] Creating image(s)
Nov 14 09:47:28 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-4b32d31a-8a07-4ad8-94d2-11d60dde24da tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] [instance: 9bcd05e7-481c-4ee9-953d-2873e6aa849d] Did not create local disks {{(pid=75229) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 14 09:47:28 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-4b32d31a-8a07-4ad8-94d2-11d60dde24da tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] [instance: 9bcd05e7-481c-4ee9-953d-2873e6aa849d] Ensure instance console log exists: /opt/stack/data/nova/instances/9bcd05e7-481c-4ee9-953d-2873e6aa849d/console.log {{(pid=75229) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 09:47:28 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-4b32d31a-8a07-4ad8-94d2-11d60dde24da tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:47:28 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-4b32d31a-8a07-4ad8-94d2-11d60dde24da tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:47:28 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-4b32d31a-8a07-4ad8-94d2-11d60dde24da tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:47:28 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-4b32d31a-8a07-4ad8-94d2-11d60dde24da tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] [instance: 9bcd05e7-481c-4ee9-953d-2873e6aa849d] Start _get_guest_xml network_info=[{"id": "71040f8f-3771-47df-a138-07571bf3eb9b", "address": "fa:16:3e:76:1c:74", "network": {"id": "8efb8df0-c10e-46aa-b2e0-bb03cfeb00e8", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-2058178363-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "703b87f76dd845e4846d746bbf3dbb6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71040f8f-37", "ovs_interfaceid": "71040f8f-3771-47df-a138-07571bf3eb9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ddcf0922-99ea-4e9f-8fe3-61df68231a99", "address": "fa:16:3e:2d:60:2c", "network": {"id": "cd9117eb-aeb0-4c47-b450-2286d1680ed3", "bridge": "br-int", "label": "tempest-device-tagging-net1-1915364084", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.144", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "703b87f76dd845e4846d746bbf3dbb6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapddcf0922-99", "ovs_interfaceid": "ddcf0922-99ea-4e9f-8fe3-61df68231a99", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "db5f7129-8708-4f26-9975-c462270d47f3", "address": "fa:16:3e:6a:77:bd", "network": {"id": "cd9117eb-aeb0-4c47-b450-2286d1680ed3", "bridge": "br-int", "label": "tempest-device-tagging-net1-1915364084", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.33", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "703b87f76dd845e4846d746bbf3dbb6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb5f7129-87", "ovs_interfaceid": "db5f7129-8708-4f26-9975-c462270d47f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7363cfca-de5d-4f2f-b467-752de544bc21", "address": "fa:16:3e:f9:0c:a4", "network": {"id": "cd9117eb-aeb0-4c47-b450-2286d1680ed3", "bridge": "br-int", "label": "tempest-device-tagging-net1-1915364084", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.239", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "703b87f76dd845e4846d746bbf3dbb6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7363cfca-de", "ovs_interfaceid": "7363cfca-de5d-4f2f-b467-752de544bc21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "fccc2ab0-7340-4ab5-be12-dd7b08c0cc72", "address": "fa:16:3e:bf:7e:6f", "network": {"id": "cd9117eb-aeb0-4c47-b450-2286d1680ed3", "bridge": "br-int", "label": "tempest-device-tagging-net1-1915364084", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.125", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "703b87f76dd845e4846d746bbf3dbb6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfccc2ab0-73", "ovs_interfaceid": "fccc2ab0-7340-4ab5-be12-dd7b08c0cc72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1766a369-08d0-4fc1-b0b3-fc8e3c6a051f", "address": "fa:16:3e:9e:05:3c", "network": {"id": "5584ce2f-1d94-4822-b275-d059d121bea5", "bridge": "br-int", "label": "tempest-device-tagging-net2-310256364", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "703b87f76dd845e4846d746bbf3dbb6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1766a369-08", "ovs_interfaceid": "1766a369-08d0-4fc1-b0b3-fc8e3c6a051f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "94fc3f23-6f54-4e7c-815d-bf0c53245856", "address": "fa:16:3e:51:94:fa", "network": {"id": "5584ce2f-1d94-4822-b275-d059d121bea5", "bridge": "br-int", "label": "tempest-device-tagging-net2-310256364", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "703b87f76dd845e4846d746bbf3dbb6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94fc3f23-6f", "ovs_interfaceid": "94fc3f23-6f54-4e7c-815d-bf0c53245856", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T09:40:10Z,direct_url=<?>,disk_format='qcow2',id=3bef8470-ecc7-40e3-95d4-9254348ea72d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='de5a91106b6948ed937a7178ff9464c4',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T09:40:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:db131665-6ac2-437a-8adf-23593475a8aa', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TsGBKMaX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '9bcd05e7-481c-4ee9-953d-2873e6aa849d', 'attached_at': '', 'detached_at': '', 'volume_id': 'db131665-6ac2-437a-8adf-23593475a8aa', 'serial': 'db131665-6ac2-437a-8adf-23593475a8aa'}, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'attachment_id': '5073b076-8f8d-41f4-82e5-a3746edbe63e', 'guest_format': None, 'device_type': 'disk', 'volume_type': None}, {'boot_index': 1, 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:b0433e38-fa42-4cff-af48-8cb5da297597', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xaKMoEBs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '9bcd05e7-481c-4ee9-953d-2873e6aa849d', 'attached_at': '', 'detached_at': '', 'volume_id': 'b0433e38-fa42-4cff-af48-8cb5da297597', 'serial': 'b0433e38-fa42-4cff-af48-8cb5da297597'}, 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'attachment_id': '2a9e65ed-ba4d-4653-81f6-db722f0c556b', 'guest_format': None, 'device_type': 'disk', 'volume_type': None}, {'boot_index': 2, 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:13c53511-ea64-4896-b325-504ce58d7895', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vWuhixRB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '9bcd05e7-481c-4ee9-953d-2873e6aa849d', 'attached_at': '', 'detached_at': '', 'volume_id': '13c53511-ea64-4896-b325-504ce58d7895', 'serial': '13c53511-ea64-4896-b325-504ce58d7895'}, 'disk_bus': 'virtio', 'mount_device': '/dev/vdc', 'attachment_id': '9518cc06-9d40-4e89-8aa2-84fd69a7a029', 'guest_format': None, 'device_type': 'disk', 'volume_type': None} {{(pid=75229) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 09:47:28 user nova-compute[75229]: WARNING nova.virt.libvirt.driver [None req-4b32d31a-8a07-4ad8-94d2-11d60dde24da tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 09:47:28 user nova-compute[75229]: WARNING nova.virt.libvirt.driver [None req-4b32d31a-8a07-4ad8-94d2-11d60dde24da tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 09:47:28 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-4b32d31a-8a07-4ad8-94d2-11d60dde24da tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75229) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 09:47:28 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-4b32d31a-8a07-4ad8-94d2-11d60dde24da tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] CPU controller missing on host. {{(pid=75229) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 09:47:28 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-4b32d31a-8a07-4ad8-94d2-11d60dde24da tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75229) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 09:47:28 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-4b32d31a-8a07-4ad8-94d2-11d60dde24da tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] CPU controller found on host. {{(pid=75229) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 09:47:28 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-4b32d31a-8a07-4ad8-94d2-11d60dde24da tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75229) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 09:47:28 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-4b32d31a-8a07-4ad8-94d2-11d60dde24da tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T09:39:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T09:40:10Z,direct_url=<?>,disk_format='qcow2',id=3bef8470-ecc7-40e3-95d4-9254348ea72d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='de5a91106b6948ed937a7178ff9464c4',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T09:40:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 09:47:28 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-4b32d31a-8a07-4ad8-94d2-11d60dde24da tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] Flavor limits 0:0:0 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 09:47:28 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-4b32d31a-8a07-4ad8-94d2-11d60dde24da tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] Image limits 0:0:0 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 09:47:28 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-4b32d31a-8a07-4ad8-94d2-11d60dde24da tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] Flavor pref 0:0:0 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 09:47:28 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-4b32d31a-8a07-4ad8-94d2-11d60dde24da tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] Image pref 0:0:0 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 09:47:28 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-4b32d31a-8a07-4ad8-94d2-11d60dde24da tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 09:47:28 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-4b32d31a-8a07-4ad8-94d2-11d60dde24da tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 09:47:28 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-4b32d31a-8a07-4ad8-94d2-11d60dde24da tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75229) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 09:47:28 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-4b32d31a-8a07-4ad8-94d2-11d60dde24da tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] Got 1 possible topologies {{(pid=75229) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 09:47:28 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-4b32d31a-8a07-4ad8-94d2-11d60dde24da tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 09:47:28 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-4b32d31a-8a07-4ad8-94d2-11d60dde24da tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 09:47:28 user nova-compute[75229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4b32d31a-8a07-4ad8-94d2-11d60dde24da tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] [instance: 9bcd05e7-481c-4ee9-953d-2873e6aa849d] Calling os-brick to attach iSCSI Volume {{(pid=75229) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 09:47:28 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b32d31a-8a07-4ad8-94d2-11d60dde24da tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f73f85151b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:db131665-6ac2-437a-8adf-23593475a8aa', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TsGBKMaX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 09:47:28 user nova-compute[75229]: WARNING os_brick.initiator.connectors.base [None req-4b32d31a-8a07-4ad8-94d2-11d60dde24da tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 09:47:28 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-4b32d31a-8a07-4ad8-94d2-11d60dde24da tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 09:47:28 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-4b32d31a-8a07-4ad8-94d2-11d60dde24da tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 09:47:28 user nova-compute[75229]: WARNING os_brick.initiator.connectors.base [None req-4b32d31a-8a07-4ad8-94d2-11d60dde24da tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 09:47:28 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-4b32d31a-8a07-4ad8-94d2-11d60dde24da tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:db131665-6ac2-437a-8adf-23593475a8aa" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 09:47:28 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-4b32d31a-8a07-4ad8-94d2-11d60dde24da tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:db131665-6ac2-437a-8adf-23593475a8aa" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 09:47:28 user nova-compute[75229]: INFO os_brick.initiator.connectors.iscsi [None req-4b32d31a-8a07-4ad8-94d2-11d60dde24da tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 09:47:28 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:47:28 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db131665-6ac2-437a-8adf-23593475a8aa -p 172.16.0.220:3260 {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:47:28 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:47:28 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db131665-6ac2-437a-8adf-23593475a8aa -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:47:28 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a7454f2-dbce-4ae3-8676-24a782d6327a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:47:28 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b32d31a-8a07-4ad8-94d2-11d60dde24da tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 09:47:28 user nova-compute[75229]:  {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:47:28 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db131665-6ac2-437a-8adf-23593475a8aa -p 172.16.0.220:3260 --interface default --op new {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:47:28 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:47:28 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db131665-6ac2-437a-8adf-23593475a8aa -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:47:28 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd4e7daa-bf68-412c-9970-7467efa408bd]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:db131665-6ac2-437a-8adf-23593475a8aa] added\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:47:28 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b32d31a-8a07-4ad8-94d2-11d60dde24da tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:db131665-6ac2-437a-8adf-23593475a8aa] added
Nov 14 09:47:28 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:47:28 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db131665-6ac2-437a-8adf-23593475a8aa -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:47:28 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:47:28 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db131665-6ac2-437a-8adf-23593475a8aa -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:47:28 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[251a6e34-7402-4e90-b24d-cc037987e10e]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:47:28 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b32d31a-8a07-4ad8-94d2-11d60dde24da tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:47:28 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db131665-6ac2-437a-8adf-23593475a8aa -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:47:28 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db131665-6ac2-437a-8adf-23593475a8aa -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:47:28 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[e585b4bd-99cb-438d-b3c3-8fc02c070286]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:47:28 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b32d31a-8a07-4ad8-94d2-11d60dde24da tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:47:28 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db131665-6ac2-437a-8adf-23593475a8aa -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TsGBKMaX {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:47:28 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db131665-6ac2-437a-8adf-23593475a8aa -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TsGBKMaX" returned: 0 in 0.018s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:47:28 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9f42b47-4dd5-409b-8863-bb7cafa77c73]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:47:28 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b32d31a-8a07-4ad8-94d2-11d60dde24da tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'TsGBKMaX'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:47:28 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db131665-6ac2-437a-8adf-23593475a8aa -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:47:28 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db131665-6ac2-437a-8adf-23593475a8aa -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.030s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:47:28 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[b69d6b61-e82f-4159-a945-6c3438b5ccee]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:47:28 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b32d31a-8a07-4ad8-94d2-11d60dde24da tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:47:28 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:47:28 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.028s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:47:28 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[37b974f8-61bd-460f-864c-651afe36460f]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:47:28 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b32d31a-8a07-4ad8-94d2-11d60dde24da tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 14 09:47:28 user nova-compute[75229]:  {{(pid=75229) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 09:47:28 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b32d31a-8a07-4ad8-94d2-11d60dde24da tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 14 09:47:28 user nova-compute[75229]:  {{(pid=75229) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 09:47:28 user nova-compute[75229]: WARNING os_brick.initiator.connectors.iscsi [None req-4b32d31a-8a07-4ad8-94d2-11d60dde24da tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 14 09:47:28 user nova-compute[75229]: 
Nov 14 09:47:28 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db131665-6ac2-437a-8adf-23593475a8aa -p 172.16.0.220:3260 --login {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:47:28 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:47:28 user nova-compute[75229]: DEBUG nova.compute.manager [req-0da96a8a-329d-4592-9b34-566f1fe8ce05 req-06e36cd5-10fb-4d23-a049-9a23ce8377d9 service nova] [instance: 8623fdcc-99b7-44d6-ad81-dada5ba83a88] Received event network-vif-unplugged-30dd46f1-cc37-46dd-a47e-0bc23a724804 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:47:28 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-0da96a8a-329d-4592-9b34-566f1fe8ce05 req-06e36cd5-10fb-4d23-a049-9a23ce8377d9 service nova] Acquiring lock "8623fdcc-99b7-44d6-ad81-dada5ba83a88-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:47:28 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-0da96a8a-329d-4592-9b34-566f1fe8ce05 req-06e36cd5-10fb-4d23-a049-9a23ce8377d9 service nova] Lock "8623fdcc-99b7-44d6-ad81-dada5ba83a88-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:47:28 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-0da96a8a-329d-4592-9b34-566f1fe8ce05 req-06e36cd5-10fb-4d23-a049-9a23ce8377d9 service nova] Lock "8623fdcc-99b7-44d6-ad81-dada5ba83a88-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:47:28 user nova-compute[75229]: DEBUG nova.compute.manager [req-0da96a8a-329d-4592-9b34-566f1fe8ce05 req-06e36cd5-10fb-4d23-a049-9a23ce8377d9 service nova] [instance: 8623fdcc-99b7-44d6-ad81-dada5ba83a88] No waiting events found dispatching network-vif-unplugged-30dd46f1-cc37-46dd-a47e-0bc23a724804 {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 09:47:28 user nova-compute[75229]: DEBUG nova.compute.manager [req-0da96a8a-329d-4592-9b34-566f1fe8ce05 req-06e36cd5-10fb-4d23-a049-9a23ce8377d9 service nova] [instance: 8623fdcc-99b7-44d6-ad81-dada5ba83a88] Received event network-vif-unplugged-30dd46f1-cc37-46dd-a47e-0bc23a724804 for instance with task_state deleting. {{(pid=75229) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 09:47:28 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db131665-6ac2-437a-8adf-23593475a8aa -p 172.16.0.220:3260 --login" returned: 0 in 0.096s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:47:28 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[2169b081-ae8a-4055-ac10-8b979d16efc4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:db131665-6ac2-437a-8adf-23593475a8aa, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:db131665-6ac2-437a-8adf-23593475a8aa, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:47:28 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b32d31a-8a07-4ad8-94d2-11d60dde24da tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:db131665-6ac2-437a-8adf-23593475a8aa, portal: 172.16.0.220,3260]
Nov 14 09:47:28 user nova-compute[75229]: Login to [iface: default, target: iqn.2010-10.org.openstack:db131665-6ac2-437a-8adf-23593475a8aa, portal: 172.16.0.220,3260] successful.
Nov 14 09:47:28 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:47:28 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db131665-6ac2-437a-8adf-23593475a8aa -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:47:28 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db131665-6ac2-437a-8adf-23593475a8aa -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:47:28 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[36f1e56f-63e2-4d13-be6d-1c654e59d1ab]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:47:28 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b32d31a-8a07-4ad8-94d2-11d60dde24da tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:47:28 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:47:28 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:47:28 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[52c5c70f-3811-4e95-bd42-0bd289ee4fee]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db131665-6ac2-437a-8adf-23593475a8aa (non-flash)\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:47:28 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b32d31a-8a07-4ad8-94d2-11d60dde24da tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db131665-6ac2-437a-8adf-23593475a8aa (non-flash)
Nov 14 09:47:28 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 09:47:28 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b32d31a-8a07-4ad8-94d2-11d60dde24da tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db131665-6ac2-437a-8adf-23593475a8aa (non-flash)
Nov 14 09:47:28 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 09:47:28 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-4b32d31a-8a07-4ad8-94d2-11d60dde24da tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:db131665-6ac2-437a-8adf-23593475a8aa" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.369s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 09:47:28 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b32d31a-8a07-4ad8-94d2-11d60dde24da tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] Connected to 172.16.0.220:3260 {{(pid=75229) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 09:47:28 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-4b32d31a-8a07-4ad8-94d2-11d60dde24da tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] HCTL ('33', '-', '-', 0) found on session 13 with lun 0 {{(pid=75229) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 09:47:28 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-4b32d31a-8a07-4ad8-94d2-11d60dde24da tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75229) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 09:47:28 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:47:28 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:47:28 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[04c7e991-019d-495d-97da-1809e8ffc9c9]: (4, ('- - 0', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:47:28 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-4b32d31a-8a07-4ad8-94d2-11d60dde24da tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] Searching for a device in session 13 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75229) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 09:47:28 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b32d31a-8a07-4ad8-94d2-11d60dde24da tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:db131665-6ac2-437a-8adf-23593475a8aa', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TsGBKMaX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75229) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 09:47:28 user nova-compute[75229]: INFO nova.virt.libvirt.driver [-] [instance: 8623fdcc-99b7-44d6-ad81-dada5ba83a88] Instance destroyed successfully.
Nov 14 09:47:28 user nova-compute[75229]: DEBUG nova.objects.instance [None req-472f0e44-9ddb-4f12-92ab-2ba1064b803f tempest-VolumesAssistedSnapshotsTest-596152604 tempest-VolumesAssistedSnapshotsTest-596152604-project-member] Lazy-loading 'resources' on Instance uuid 8623fdcc-99b7-44d6-ad81-dada5ba83a88 {{(pid=75229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 09:47:28 user nova-compute[75229]: DEBUG nova.virt.libvirt.vif [None req-472f0e44-9ddb-4f12-92ab-2ba1064b803f tempest-VolumesAssistedSnapshotsTest-596152604 tempest-VolumesAssistedSnapshotsTest-596152604-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T09:44:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1700226473',display_name='tempest-VolumesAssistedSnapshotsTest-server-1700226473',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1700226473',id=11,image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNHzbrGhIKRryEAooEFrmdhtpTP105NCjCp0wjXFAhS3+1eN0KDVHL1g8f26q5PeHJwM45sTS1o4N05nvewb+OVnWKy7+WvkXlCnjHvd6JW1dZm5rcuYMXoWX0+jgnpPdA==',key_name='tempest-keypair-2054757497',keypairs=<?>,launch_index=0,launched_at=2023-11-14T09:44:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7e2a5354424047a8a460451f7fd08233',ramdisk_id='',reservation_id='r-7blmt5mz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAssistedSnapshotsTest-596152604',owner_user_name='tempest-VolumesAssistedSnapshotsTest-596152604-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T09:44:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='95d8d6147d9245a1925bd5d4129a1719',uuid=8623fdcc-99b7-44d6-ad81-dada5ba83a88,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "30dd46f1-cc37-46dd-a47e-0bc23a724804", "address": "fa:16:3e:86:32:73", "network": {"id": "6c0e2cbe-bbea-4552-a531-80981937bc7d", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-995922753-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7e2a5354424047a8a460451f7fd08233", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30dd46f1-cc", "ovs_interfaceid": "30dd46f1-cc37-46dd-a47e-0bc23a724804", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 09:47:28 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-472f0e44-9ddb-4f12-92ab-2ba1064b803f tempest-VolumesAssistedSnapshotsTest-596152604 tempest-VolumesAssistedSnapshotsTest-596152604-project-member] Converting VIF {"id": "30dd46f1-cc37-46dd-a47e-0bc23a724804", "address": "fa:16:3e:86:32:73", "network": {"id": "6c0e2cbe-bbea-4552-a531-80981937bc7d", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-995922753-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7e2a5354424047a8a460451f7fd08233", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30dd46f1-cc", "ovs_interfaceid": "30dd46f1-cc37-46dd-a47e-0bc23a724804", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 09:47:28 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-472f0e44-9ddb-4f12-92ab-2ba1064b803f tempest-VolumesAssistedSnapshotsTest-596152604 tempest-VolumesAssistedSnapshotsTest-596152604-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:86:32:73,bridge_name='br-int',has_traffic_filtering=True,id=30dd46f1-cc37-46dd-a47e-0bc23a724804,network=Network(6c0e2cbe-bbea-4552-a531-80981937bc7d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap30dd46f1-cc') {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 09:47:28 user nova-compute[75229]: DEBUG os_vif [None req-472f0e44-9ddb-4f12-92ab-2ba1064b803f tempest-VolumesAssistedSnapshotsTest-596152604 tempest-VolumesAssistedSnapshotsTest-596152604-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:86:32:73,bridge_name='br-int',has_traffic_filtering=True,id=30dd46f1-cc37-46dd-a47e-0bc23a724804,network=Network(6c0e2cbe-bbea-4552-a531-80981937bc7d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap30dd46f1-cc') {{(pid=75229) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 09:47:28 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:47:28 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap30dd46f1-cc, bridge=br-int, if_exists=True) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:47:28 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:47:28 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 09:47:28 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:47:28 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=36eba990-ec1d-4e68-88ce-7092864be8af) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:47:28 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:47:28 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:47:28 user nova-compute[75229]: INFO os_vif [None req-472f0e44-9ddb-4f12-92ab-2ba1064b803f tempest-VolumesAssistedSnapshotsTest-596152604 tempest-VolumesAssistedSnapshotsTest-596152604-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:86:32:73,bridge_name='br-int',has_traffic_filtering=True,id=30dd46f1-cc37-46dd-a47e-0bc23a724804,network=Network(6c0e2cbe-bbea-4552-a531-80981937bc7d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap30dd46f1-cc')
Nov 14 09:47:28 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-472f0e44-9ddb-4f12-92ab-2ba1064b803f tempest-VolumesAssistedSnapshotsTest-596152604 tempest-VolumesAssistedSnapshotsTest-596152604-project-member] [instance: 8623fdcc-99b7-44d6-ad81-dada5ba83a88] Deleting instance files /opt/stack/data/nova/instances/8623fdcc-99b7-44d6-ad81-dada5ba83a88_del
Nov 14 09:47:28 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-472f0e44-9ddb-4f12-92ab-2ba1064b803f tempest-VolumesAssistedSnapshotsTest-596152604 tempest-VolumesAssistedSnapshotsTest-596152604-project-member] [instance: 8623fdcc-99b7-44d6-ad81-dada5ba83a88] Deletion of /opt/stack/data/nova/instances/8623fdcc-99b7-44d6-ad81-dada5ba83a88_del complete
Nov 14 09:47:29 user nova-compute[75229]: INFO nova.compute.manager [None req-472f0e44-9ddb-4f12-92ab-2ba1064b803f tempest-VolumesAssistedSnapshotsTest-596152604 tempest-VolumesAssistedSnapshotsTest-596152604-project-member] [instance: 8623fdcc-99b7-44d6-ad81-dada5ba83a88] Took 0.89 seconds to destroy the instance on the hypervisor.
Nov 14 09:47:29 user nova-compute[75229]: DEBUG oslo.service.loopingcall [None req-472f0e44-9ddb-4f12-92ab-2ba1064b803f tempest-VolumesAssistedSnapshotsTest-596152604 tempest-VolumesAssistedSnapshotsTest-596152604-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75229) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 09:47:29 user nova-compute[75229]: DEBUG nova.compute.manager [-] [instance: 8623fdcc-99b7-44d6-ad81-dada5ba83a88] Deallocating network for instance {{(pid=75229) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 09:47:29 user nova-compute[75229]: DEBUG nova.network.neutron [-] [instance: 8623fdcc-99b7-44d6-ad81-dada5ba83a88] deallocate_for_instance() {{(pid=75229) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 09:47:29 user nova-compute[75229]: DEBUG nova.network.neutron [-] [instance: 8623fdcc-99b7-44d6-ad81-dada5ba83a88] Updating instance_info_cache with network_info: [] {{(pid=75229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 09:47:29 user nova-compute[75229]: INFO nova.compute.manager [-] [instance: 8623fdcc-99b7-44d6-ad81-dada5ba83a88] Took 0.62 seconds to deallocate network for instance.
Nov 14 09:47:29 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-4b32d31a-8a07-4ad8-94d2-11d60dde24da tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.401s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 09:47:29 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b32d31a-8a07-4ad8-94d2-11d60dde24da tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] <== connect_volume: return (1402ms) {'type': 'block', 'scsi_wwn': '23861663531346635', 'path': '/dev/sdb'} {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 09:47:29 user nova-compute[75229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4b32d31a-8a07-4ad8-94d2-11d60dde24da tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] [instance: 9bcd05e7-481c-4ee9-953d-2873e6aa849d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23861663531346635', 'path': '/dev/sdb'} {{(pid=75229) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 09:47:29 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-472f0e44-9ddb-4f12-92ab-2ba1064b803f tempest-VolumesAssistedSnapshotsTest-596152604 tempest-VolumesAssistedSnapshotsTest-596152604-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:47:29 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-472f0e44-9ddb-4f12-92ab-2ba1064b803f tempest-VolumesAssistedSnapshotsTest-596152604 tempest-VolumesAssistedSnapshotsTest-596152604-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:47:29 user nova-compute[75229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4b32d31a-8a07-4ad8-94d2-11d60dde24da tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] [instance: 9bcd05e7-481c-4ee9-953d-2873e6aa849d] Calling os-brick to attach iSCSI Volume {{(pid=75229) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 09:47:29 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b32d31a-8a07-4ad8-94d2-11d60dde24da tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f73f85151b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b0433e38-fa42-4cff-af48-8cb5da297597', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xaKMoEBs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 09:47:29 user nova-compute[75229]: WARNING os_brick.initiator.connectors.base [None req-4b32d31a-8a07-4ad8-94d2-11d60dde24da tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 09:47:29 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-4b32d31a-8a07-4ad8-94d2-11d60dde24da tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 09:47:29 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-4b32d31a-8a07-4ad8-94d2-11d60dde24da tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 09:47:29 user nova-compute[75229]: WARNING os_brick.initiator.connectors.base [None req-4b32d31a-8a07-4ad8-94d2-11d60dde24da tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 09:47:29 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-4b32d31a-8a07-4ad8-94d2-11d60dde24da tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b0433e38-fa42-4cff-af48-8cb5da297597" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 09:47:29 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-4b32d31a-8a07-4ad8-94d2-11d60dde24da tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b0433e38-fa42-4cff-af48-8cb5da297597" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 09:47:29 user nova-compute[75229]: INFO os_brick.initiator.connectors.iscsi [None req-4b32d31a-8a07-4ad8-94d2-11d60dde24da tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 09:47:29 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0433e38-fa42-4cff-af48-8cb5da297597 -p 172.16.0.220:3260 {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:47:29 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0433e38-fa42-4cff-af48-8cb5da297597 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:47:29 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[56820d5c-ca9a-4b94-9476-8742eadbc6a0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:47:29 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b32d31a-8a07-4ad8-94d2-11d60dde24da tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 09:47:29 user nova-compute[75229]:  {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:47:29 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0433e38-fa42-4cff-af48-8cb5da297597 -p 172.16.0.220:3260 --interface default --op new {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:47:29 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0433e38-fa42-4cff-af48-8cb5da297597 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:47:29 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[e60aee2c-de01-4122-83bb-ae0e64936c85]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b0433e38-fa42-4cff-af48-8cb5da297597] added\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:47:29 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b32d31a-8a07-4ad8-94d2-11d60dde24da tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b0433e38-fa42-4cff-af48-8cb5da297597] added
Nov 14 09:47:29 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:47:29 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0433e38-fa42-4cff-af48-8cb5da297597 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:47:29 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0433e38-fa42-4cff-af48-8cb5da297597 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:47:29 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[dde35906-0b34-442e-b3ef-83867b5bf64e]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:47:29 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b32d31a-8a07-4ad8-94d2-11d60dde24da tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:47:29 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0433e38-fa42-4cff-af48-8cb5da297597 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:47:29 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0433e38-fa42-4cff-af48-8cb5da297597 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:47:29 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[0913034a-542c-4ece-a5e8-962ac3358fba]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:47:29 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b32d31a-8a07-4ad8-94d2-11d60dde24da tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:47:29 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0433e38-fa42-4cff-af48-8cb5da297597 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xaKMoEBs {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:47:29 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0433e38-fa42-4cff-af48-8cb5da297597 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xaKMoEBs" returned: 0 in 0.020s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:47:29 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f405141-b587-4853-8cc0-968974e498ba]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:47:29 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b32d31a-8a07-4ad8-94d2-11d60dde24da tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xaKMoEBs'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:47:29 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0433e38-fa42-4cff-af48-8cb5da297597 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:47:29 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0433e38-fa42-4cff-af48-8cb5da297597 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:47:29 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fe063b6-0685-4e33-93d9-e37dd8e29b21]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:47:29 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b32d31a-8a07-4ad8-94d2-11d60dde24da tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:47:29 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:47:29 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:47:29 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[c79e03bb-f8d5-402e-a1bd-b94b91d470cd]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db131665-6ac2-437a-8adf-23593475a8aa (non-flash)\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:47:29 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b32d31a-8a07-4ad8-94d2-11d60dde24da tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db131665-6ac2-437a-8adf-23593475a8aa (non-flash)
Nov 14 09:47:29 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 09:47:29 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b32d31a-8a07-4ad8-94d2-11d60dde24da tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db131665-6ac2-437a-8adf-23593475a8aa (non-flash)
Nov 14 09:47:29 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 09:47:29 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0433e38-fa42-4cff-af48-8cb5da297597 -p 172.16.0.220:3260 --login {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:47:29 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0433e38-fa42-4cff-af48-8cb5da297597 -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:47:29 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a4d8bf5-9362-4965-850f-1323cfde0306]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b0433e38-fa42-4cff-af48-8cb5da297597, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b0433e38-fa42-4cff-af48-8cb5da297597, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:47:29 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b32d31a-8a07-4ad8-94d2-11d60dde24da tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b0433e38-fa42-4cff-af48-8cb5da297597, portal: 172.16.0.220,3260]
Nov 14 09:47:29 user nova-compute[75229]: Login to [iface: default, target: iqn.2010-10.org.openstack:b0433e38-fa42-4cff-af48-8cb5da297597, portal: 172.16.0.220,3260] successful.
Nov 14 09:47:29 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:47:29 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0433e38-fa42-4cff-af48-8cb5da297597 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:47:29 user nova-compute[75229]: DEBUG nova.compute.provider_tree [None req-472f0e44-9ddb-4f12-92ab-2ba1064b803f tempest-VolumesAssistedSnapshotsTest-596152604 tempest-VolumesAssistedSnapshotsTest-596152604-project-member] Inventory has not changed in ProviderTree for provider: d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 {{(pid=75229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 09:47:29 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0433e38-fa42-4cff-af48-8cb5da297597 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:47:29 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[979c8450-fcae-45bd-89a4-ef8aa46b823c]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:47:29 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b32d31a-8a07-4ad8-94d2-11d60dde24da tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:47:29 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:47:29 user nova-compute[75229]: DEBUG nova.scheduler.client.report [None req-472f0e44-9ddb-4f12-92ab-2ba1064b803f tempest-VolumesAssistedSnapshotsTest-596152604 tempest-VolumesAssistedSnapshotsTest-596152604-project-member] Inventory has not changed for provider d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 09:47:29 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:47:29 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebf94612-0095-43d5-a6aa-8849d7eb61a9]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db131665-6ac2-437a-8adf-23593475a8aa (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0433e38-fa42-4cff-af48-8cb5da297597 (non-flash)\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:47:29 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b32d31a-8a07-4ad8-94d2-11d60dde24da tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db131665-6ac2-437a-8adf-23593475a8aa (non-flash)
Nov 14 09:47:29 user nova-compute[75229]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0433e38-fa42-4cff-af48-8cb5da297597 (non-flash)
Nov 14 09:47:29 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 09:47:30 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b32d31a-8a07-4ad8-94d2-11d60dde24da tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db131665-6ac2-437a-8adf-23593475a8aa (non-flash)
Nov 14 09:47:30 user nova-compute[75229]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0433e38-fa42-4cff-af48-8cb5da297597 (non-flash)
Nov 14 09:47:30 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 09:47:30 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-4b32d31a-8a07-4ad8-94d2-11d60dde24da tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b0433e38-fa42-4cff-af48-8cb5da297597" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.275s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 09:47:30 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b32d31a-8a07-4ad8-94d2-11d60dde24da tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] Connected to 172.16.0.220:3260 {{(pid=75229) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 09:47:30 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-4b32d31a-8a07-4ad8-94d2-11d60dde24da tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] HCTL ('34', '-', '-', 0) found on session 14 with lun 0 {{(pid=75229) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 09:47:30 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-4b32d31a-8a07-4ad8-94d2-11d60dde24da tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75229) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 09:47:30 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:47:30 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-472f0e44-9ddb-4f12-92ab-2ba1064b803f tempest-VolumesAssistedSnapshotsTest-596152604 tempest-VolumesAssistedSnapshotsTest-596152604-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.315s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:47:30 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.021s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:47:30 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b620897-78ed-41e7-b3e9-6098b7c7ce02]: (4, ('- - 0', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:47:30 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-4b32d31a-8a07-4ad8-94d2-11d60dde24da tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] Searching for a device in session 14 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75229) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 09:47:30 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b32d31a-8a07-4ad8-94d2-11d60dde24da tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:b0433e38-fa42-4cff-af48-8cb5da297597', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xaKMoEBs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75229) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 09:47:30 user nova-compute[75229]: INFO nova.scheduler.client.report [None req-472f0e44-9ddb-4f12-92ab-2ba1064b803f tempest-VolumesAssistedSnapshotsTest-596152604 tempest-VolumesAssistedSnapshotsTest-596152604-project-member] Deleted allocations for instance 8623fdcc-99b7-44d6-ad81-dada5ba83a88
Nov 14 09:47:30 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-472f0e44-9ddb-4f12-92ab-2ba1064b803f tempest-VolumesAssistedSnapshotsTest-596152604 tempest-VolumesAssistedSnapshotsTest-596152604-project-member] Lock "8623fdcc-99b7-44d6-ad81-dada5ba83a88" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.054s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:47:30 user nova-compute[75229]: DEBUG nova.compute.manager [req-b813a67c-6c21-4eb2-91bc-377fc658921c req-9ca663b0-d2a4-4945-9399-39e48390f4a7 service nova] [instance: 8623fdcc-99b7-44d6-ad81-dada5ba83a88] Received event network-vif-plugged-30dd46f1-cc37-46dd-a47e-0bc23a724804 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:47:30 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-b813a67c-6c21-4eb2-91bc-377fc658921c req-9ca663b0-d2a4-4945-9399-39e48390f4a7 service nova] Acquiring lock "8623fdcc-99b7-44d6-ad81-dada5ba83a88-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:47:30 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-b813a67c-6c21-4eb2-91bc-377fc658921c req-9ca663b0-d2a4-4945-9399-39e48390f4a7 service nova] Lock "8623fdcc-99b7-44d6-ad81-dada5ba83a88-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:47:30 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-b813a67c-6c21-4eb2-91bc-377fc658921c req-9ca663b0-d2a4-4945-9399-39e48390f4a7 service nova] Lock "8623fdcc-99b7-44d6-ad81-dada5ba83a88-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:47:30 user nova-compute[75229]: DEBUG nova.compute.manager [req-b813a67c-6c21-4eb2-91bc-377fc658921c req-9ca663b0-d2a4-4945-9399-39e48390f4a7 service nova] [instance: 8623fdcc-99b7-44d6-ad81-dada5ba83a88] No waiting events found dispatching network-vif-plugged-30dd46f1-cc37-46dd-a47e-0bc23a724804 {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 09:47:30 user nova-compute[75229]: WARNING nova.compute.manager [req-b813a67c-6c21-4eb2-91bc-377fc658921c req-9ca663b0-d2a4-4945-9399-39e48390f4a7 service nova] [instance: 8623fdcc-99b7-44d6-ad81-dada5ba83a88] Received unexpected event network-vif-plugged-30dd46f1-cc37-46dd-a47e-0bc23a724804 for instance with vm_state deleted and task_state None.
Nov 14 09:47:30 user nova-compute[75229]: DEBUG nova.compute.manager [req-b813a67c-6c21-4eb2-91bc-377fc658921c req-9ca663b0-d2a4-4945-9399-39e48390f4a7 service nova] [instance: 8623fdcc-99b7-44d6-ad81-dada5ba83a88] Received event network-vif-deleted-30dd46f1-cc37-46dd-a47e-0bc23a724804 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:47:31 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-4b32d31a-8a07-4ad8-94d2-11d60dde24da tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.316s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 09:47:31 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b32d31a-8a07-4ad8-94d2-11d60dde24da tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] <== connect_volume: return (1318ms) {'type': 'block', 'scsi_wwn': '26663386364633137', 'path': '/dev/sdc'} {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 09:47:31 user nova-compute[75229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4b32d31a-8a07-4ad8-94d2-11d60dde24da tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] [instance: 9bcd05e7-481c-4ee9-953d-2873e6aa849d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26663386364633137', 'path': '/dev/sdc'} {{(pid=75229) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 09:47:31 user nova-compute[75229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4b32d31a-8a07-4ad8-94d2-11d60dde24da tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] [instance: 9bcd05e7-481c-4ee9-953d-2873e6aa849d] Calling os-brick to attach iSCSI Volume {{(pid=75229) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 09:47:31 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b32d31a-8a07-4ad8-94d2-11d60dde24da tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f73f85151b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:13c53511-ea64-4896-b325-504ce58d7895', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vWuhixRB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 09:47:31 user nova-compute[75229]: WARNING os_brick.initiator.connectors.base [None req-4b32d31a-8a07-4ad8-94d2-11d60dde24da tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 09:47:31 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-4b32d31a-8a07-4ad8-94d2-11d60dde24da tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 09:47:31 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-4b32d31a-8a07-4ad8-94d2-11d60dde24da tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 09:47:31 user nova-compute[75229]: WARNING os_brick.initiator.connectors.base [None req-4b32d31a-8a07-4ad8-94d2-11d60dde24da tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 09:47:31 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-4b32d31a-8a07-4ad8-94d2-11d60dde24da tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:13c53511-ea64-4896-b325-504ce58d7895" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 09:47:31 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-4b32d31a-8a07-4ad8-94d2-11d60dde24da tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:13c53511-ea64-4896-b325-504ce58d7895" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 09:47:31 user nova-compute[75229]: INFO os_brick.initiator.connectors.iscsi [None req-4b32d31a-8a07-4ad8-94d2-11d60dde24da tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 09:47:31 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13c53511-ea64-4896-b325-504ce58d7895 -p 172.16.0.220:3260 {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:47:31 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13c53511-ea64-4896-b325-504ce58d7895 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:47:31 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc0cc033-daf5-4099-86b6-c2c0b613388b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:47:31 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b32d31a-8a07-4ad8-94d2-11d60dde24da tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 09:47:31 user nova-compute[75229]:  {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:47:31 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13c53511-ea64-4896-b325-504ce58d7895 -p 172.16.0.220:3260 --interface default --op new {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:47:31 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13c53511-ea64-4896-b325-504ce58d7895 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:47:31 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[504bef2a-977e-4605-9024-61bd24fabe03]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:13c53511-ea64-4896-b325-504ce58d7895] added\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:47:31 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b32d31a-8a07-4ad8-94d2-11d60dde24da tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:13c53511-ea64-4896-b325-504ce58d7895] added
Nov 14 09:47:31 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:47:31 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13c53511-ea64-4896-b325-504ce58d7895 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:47:31 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13c53511-ea64-4896-b325-504ce58d7895 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:47:31 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d2b1c57-795d-41f3-9f91-ff44a54b37df]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:47:31 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b32d31a-8a07-4ad8-94d2-11d60dde24da tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:47:31 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13c53511-ea64-4896-b325-504ce58d7895 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:47:31 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13c53511-ea64-4896-b325-504ce58d7895 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:47:31 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca637bf3-c63f-4268-b8d0-9f79dda9c987]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:47:31 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b32d31a-8a07-4ad8-94d2-11d60dde24da tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:47:31 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13c53511-ea64-4896-b325-504ce58d7895 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vWuhixRB {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:47:31 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13c53511-ea64-4896-b325-504ce58d7895 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vWuhixRB" returned: 0 in 0.020s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:47:31 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[3540e5b2-1ea9-459f-8cd8-780a5d7ac007]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:47:31 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b32d31a-8a07-4ad8-94d2-11d60dde24da tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vWuhixRB'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:47:31 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13c53511-ea64-4896-b325-504ce58d7895 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:47:31 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13c53511-ea64-4896-b325-504ce58d7895 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:47:31 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[5415eb13-39a8-4124-ba3b-986bf77b431f]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:47:31 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b32d31a-8a07-4ad8-94d2-11d60dde24da tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:47:31 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:47:31 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:47:31 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[16551287-0f53-462f-881a-fd4efe8842f2]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db131665-6ac2-437a-8adf-23593475a8aa (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0433e38-fa42-4cff-af48-8cb5da297597 (non-flash)\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:47:31 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b32d31a-8a07-4ad8-94d2-11d60dde24da tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db131665-6ac2-437a-8adf-23593475a8aa (non-flash)
Nov 14 09:47:31 user nova-compute[75229]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0433e38-fa42-4cff-af48-8cb5da297597 (non-flash)
Nov 14 09:47:31 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 09:47:31 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b32d31a-8a07-4ad8-94d2-11d60dde24da tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db131665-6ac2-437a-8adf-23593475a8aa (non-flash)
Nov 14 09:47:31 user nova-compute[75229]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0433e38-fa42-4cff-af48-8cb5da297597 (non-flash)
Nov 14 09:47:31 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 09:47:31 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13c53511-ea64-4896-b325-504ce58d7895 -p 172.16.0.220:3260 --login {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:47:31 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13c53511-ea64-4896-b325-504ce58d7895 -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:47:31 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[71cb7cdb-abf5-4788-9bf9-4342ed259900]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:13c53511-ea64-4896-b325-504ce58d7895, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:13c53511-ea64-4896-b325-504ce58d7895, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:47:31 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b32d31a-8a07-4ad8-94d2-11d60dde24da tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:13c53511-ea64-4896-b325-504ce58d7895, portal: 172.16.0.220,3260]
Nov 14 09:47:31 user nova-compute[75229]: Login to [iface: default, target: iqn.2010-10.org.openstack:13c53511-ea64-4896-b325-504ce58d7895, portal: 172.16.0.220,3260] successful.
Nov 14 09:47:31 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:47:31 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13c53511-ea64-4896-b325-504ce58d7895 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:47:31 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13c53511-ea64-4896-b325-504ce58d7895 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:47:31 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[198c087f-d955-46b2-8b55-5d32f9389d5f]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:47:31 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b32d31a-8a07-4ad8-94d2-11d60dde24da tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:47:31 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:47:31 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:47:31 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[f528e3e6-0de5-4260-b66f-cbacdc5de4cf]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db131665-6ac2-437a-8adf-23593475a8aa (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0433e38-fa42-4cff-af48-8cb5da297597 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13c53511-ea64-4896-b325-504ce58d7895 (non-flash)\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:47:31 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b32d31a-8a07-4ad8-94d2-11d60dde24da tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db131665-6ac2-437a-8adf-23593475a8aa (non-flash)
Nov 14 09:47:31 user nova-compute[75229]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0433e38-fa42-4cff-af48-8cb5da297597 (non-flash)
Nov 14 09:47:31 user nova-compute[75229]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13c53511-ea64-4896-b325-504ce58d7895 (non-flash)
Nov 14 09:47:31 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 09:47:31 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b32d31a-8a07-4ad8-94d2-11d60dde24da tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db131665-6ac2-437a-8adf-23593475a8aa (non-flash)
Nov 14 09:47:31 user nova-compute[75229]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0433e38-fa42-4cff-af48-8cb5da297597 (non-flash)
Nov 14 09:47:31 user nova-compute[75229]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13c53511-ea64-4896-b325-504ce58d7895 (non-flash)
Nov 14 09:47:31 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 09:47:31 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-4b32d31a-8a07-4ad8-94d2-11d60dde24da tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:13c53511-ea64-4896-b325-504ce58d7895" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.301s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 09:47:31 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b32d31a-8a07-4ad8-94d2-11d60dde24da tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] Connected to 172.16.0.220:3260 {{(pid=75229) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 09:47:31 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-4b32d31a-8a07-4ad8-94d2-11d60dde24da tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] HCTL ('35', '-', '-', 0) found on session 15 with lun 0 {{(pid=75229) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 09:47:31 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-4b32d31a-8a07-4ad8-94d2-11d60dde24da tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75229) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 09:47:31 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:47:31 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.029s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:47:31 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb0862ce-9f6c-4d4b-9406-d9f8489ce5a3]: (4, ('- - 0', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:47:31 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-4b32d31a-8a07-4ad8-94d2-11d60dde24da tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] Searching for a device in session 15 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75229) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 09:47:31 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b32d31a-8a07-4ad8-94d2-11d60dde24da tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:13c53511-ea64-4896-b325-504ce58d7895', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vWuhixRB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75229) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 09:47:32 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-4b32d31a-8a07-4ad8-94d2-11d60dde24da tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.348s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 09:47:32 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b32d31a-8a07-4ad8-94d2-11d60dde24da tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] <== connect_volume: return (1351ms) {'type': 'block', 'scsi_wwn': '23562353565393236', 'path': '/dev/sdd'} {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 09:47:32 user nova-compute[75229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4b32d31a-8a07-4ad8-94d2-11d60dde24da tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] [instance: 9bcd05e7-481c-4ee9-953d-2873e6aa849d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23562353565393236', 'path': '/dev/sdd'} {{(pid=75229) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 09:47:32 user nova-compute[75229]: DEBUG nova.virt.libvirt.vif [None req-4b32d31a-8a07-4ad8-94d2-11d60dde24da tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T09:47:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1344448520',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1344448520',id=14,image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJA+mbW53CYPI09BJIYFnLrEotoFcZVkgH+GWeiBg0GW7ir0gJlqKnbnYK0AWdLlotPNpYiaLOq+gZ7eeixO/d6vHaXAxAISIFWGg7b0SpDRPk8D4ksykF7CXaWbd/kgfA==',key_name='tempest-keypair-2078999652',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='703b87f76dd845e4846d746bbf3dbb6c',ramdisk_id='',reservation_id='r-u2q5b3ln',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1091422151',owner_user_name='tempest-TaggedBootDevicesTest_v242-1091422151-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T09:47:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f24bad24bb284d15bf2ef1f4fa211389',uuid=9bcd05e7-481c-4ee9-953d-2873e6aa849d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "71040f8f-3771-47df-a138-07571bf3eb9b", "address": "fa:16:3e:76:1c:74", "network": {"id": "8efb8df0-c10e-46aa-b2e0-bb03cfeb00e8", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-2058178363-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "703b87f76dd845e4846d746bbf3dbb6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71040f8f-37", "ovs_interfaceid": "71040f8f-3771-47df-a138-07571bf3eb9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75229) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 09:47:32 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-4b32d31a-8a07-4ad8-94d2-11d60dde24da tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] Converting VIF {"id": "71040f8f-3771-47df-a138-07571bf3eb9b", "address": "fa:16:3e:76:1c:74", "network": {"id": "8efb8df0-c10e-46aa-b2e0-bb03cfeb00e8", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-2058178363-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "703b87f76dd845e4846d746bbf3dbb6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71040f8f-37", "ovs_interfaceid": "71040f8f-3771-47df-a138-07571bf3eb9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 09:47:32 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-4b32d31a-8a07-4ad8-94d2-11d60dde24da tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:76:1c:74,bridge_name='br-int',has_traffic_filtering=True,id=71040f8f-3771-47df-a138-07571bf3eb9b,network=Network(8efb8df0-c10e-46aa-b2e0-bb03cfeb00e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71040f8f-37') {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 09:47:32 user nova-compute[75229]: DEBUG nova.virt.libvirt.vif [None req-4b32d31a-8a07-4ad8-94d2-11d60dde24da tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T09:47:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1344448520',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1344448520',id=14,image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJA+mbW53CYPI09BJIYFnLrEotoFcZVkgH+GWeiBg0GW7ir0gJlqKnbnYK0AWdLlotPNpYiaLOq+gZ7eeixO/d6vHaXAxAISIFWGg7b0SpDRPk8D4ksykF7CXaWbd/kgfA==',key_name='tempest-keypair-2078999652',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='703b87f76dd845e4846d746bbf3dbb6c',ramdisk_id='',reservation_id='r-u2q5b3ln',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1091422151',owner_user_name='tempest-TaggedBootDevicesTest_v242-1091422151-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T09:47:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f24bad24bb284d15bf2ef1f4fa211389',uuid=9bcd05e7-481c-4ee9-953d-2873e6aa849d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ddcf0922-99ea-4e9f-8fe3-61df68231a99", "address": "fa:16:3e:2d:60:2c", "network": {"id": "cd9117eb-aeb0-4c47-b450-2286d1680ed3", "bridge": "br-int", "label": "tempest-device-tagging-net1-1915364084", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.144", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "703b87f76dd845e4846d746bbf3dbb6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapddcf0922-99", "ovs_interfaceid": "ddcf0922-99ea-4e9f-8fe3-61df68231a99", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75229) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 09:47:32 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-4b32d31a-8a07-4ad8-94d2-11d60dde24da tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] Converting VIF {"id": "ddcf0922-99ea-4e9f-8fe3-61df68231a99", "address": "fa:16:3e:2d:60:2c", "network": {"id": "cd9117eb-aeb0-4c47-b450-2286d1680ed3", "bridge": "br-int", "label": "tempest-device-tagging-net1-1915364084", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.144", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "703b87f76dd845e4846d746bbf3dbb6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapddcf0922-99", "ovs_interfaceid": "ddcf0922-99ea-4e9f-8fe3-61df68231a99", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 09:47:32 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-4b32d31a-8a07-4ad8-94d2-11d60dde24da tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2d:60:2c,bridge_name='br-int',has_traffic_filtering=True,id=ddcf0922-99ea-4e9f-8fe3-61df68231a99,network=Network(cd9117eb-aeb0-4c47-b450-2286d1680ed3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapddcf0922-99') {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 09:47:32 user nova-compute[75229]: DEBUG nova.virt.libvirt.vif [None req-4b32d31a-8a07-4ad8-94d2-11d60dde24da tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T09:47:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1344448520',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1344448520',id=14,image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJA+mbW53CYPI09BJIYFnLrEotoFcZVkgH+GWeiBg0GW7ir0gJlqKnbnYK0AWdLlotPNpYiaLOq+gZ7eeixO/d6vHaXAxAISIFWGg7b0SpDRPk8D4ksykF7CXaWbd/kgfA==',key_name='tempest-keypair-2078999652',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='703b87f76dd845e4846d746bbf3dbb6c',ramdisk_id='',reservation_id='r-u2q5b3ln',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1091422151',owner_user_name='tempest-TaggedBootDevicesTest_v242-1091422151-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T09:47:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f24bad24bb284d15bf2ef1f4fa211389',uuid=9bcd05e7-481c-4ee9-953d-2873e6aa849d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "db5f7129-8708-4f26-9975-c462270d47f3", "address": "fa:16:3e:6a:77:bd", "network": {"id": "cd9117eb-aeb0-4c47-b450-2286d1680ed3", "bridge": "br-int", "label": "tempest-device-tagging-net1-1915364084", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.33", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "703b87f76dd845e4846d746bbf3dbb6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb5f7129-87", "ovs_interfaceid": "db5f7129-8708-4f26-9975-c462270d47f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75229) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 09:47:32 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-4b32d31a-8a07-4ad8-94d2-11d60dde24da tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] Converting VIF {"id": "db5f7129-8708-4f26-9975-c462270d47f3", "address": "fa:16:3e:6a:77:bd", "network": {"id": "cd9117eb-aeb0-4c47-b450-2286d1680ed3", "bridge": "br-int", "label": "tempest-device-tagging-net1-1915364084", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.33", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "703b87f76dd845e4846d746bbf3dbb6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb5f7129-87", "ovs_interfaceid": "db5f7129-8708-4f26-9975-c462270d47f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 09:47:32 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-4b32d31a-8a07-4ad8-94d2-11d60dde24da tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6a:77:bd,bridge_name='br-int',has_traffic_filtering=True,id=db5f7129-8708-4f26-9975-c462270d47f3,network=Network(cd9117eb-aeb0-4c47-b450-2286d1680ed3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapdb5f7129-87') {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 09:47:32 user nova-compute[75229]: DEBUG nova.virt.libvirt.vif [None req-4b32d31a-8a07-4ad8-94d2-11d60dde24da tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T09:47:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1344448520',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1344448520',id=14,image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJA+mbW53CYPI09BJIYFnLrEotoFcZVkgH+GWeiBg0GW7ir0gJlqKnbnYK0AWdLlotPNpYiaLOq+gZ7eeixO/d6vHaXAxAISIFWGg7b0SpDRPk8D4ksykF7CXaWbd/kgfA==',key_name='tempest-keypair-2078999652',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='703b87f76dd845e4846d746bbf3dbb6c',ramdisk_id='',reservation_id='r-u2q5b3ln',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1091422151',owner_user_name='tempest-TaggedBootDevicesTest_v242-1091422151-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T09:47:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f24bad24bb284d15bf2ef1f4fa211389',uuid=9bcd05e7-481c-4ee9-953d-2873e6aa849d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7363cfca-de5d-4f2f-b467-752de544bc21", "address": "fa:16:3e:f9:0c:a4", "network": {"id": "cd9117eb-aeb0-4c47-b450-2286d1680ed3", "bridge": "br-int", "label": "tempest-device-tagging-net1-1915364084", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.239", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "703b87f76dd845e4846d746bbf3dbb6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7363cfca-de", "ovs_interfaceid": "7363cfca-de5d-4f2f-b467-752de544bc21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75229) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 09:47:32 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-4b32d31a-8a07-4ad8-94d2-11d60dde24da tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] Converting VIF {"id": "7363cfca-de5d-4f2f-b467-752de544bc21", "address": "fa:16:3e:f9:0c:a4", "network": {"id": "cd9117eb-aeb0-4c47-b450-2286d1680ed3", "bridge": "br-int", "label": "tempest-device-tagging-net1-1915364084", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.239", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "703b87f76dd845e4846d746bbf3dbb6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7363cfca-de", "ovs_interfaceid": "7363cfca-de5d-4f2f-b467-752de544bc21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 09:47:32 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-4b32d31a-8a07-4ad8-94d2-11d60dde24da tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f9:0c:a4,bridge_name='br-int',has_traffic_filtering=True,id=7363cfca-de5d-4f2f-b467-752de544bc21,network=Network(cd9117eb-aeb0-4c47-b450-2286d1680ed3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7363cfca-de') {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 09:47:32 user nova-compute[75229]: DEBUG nova.virt.libvirt.vif [None req-4b32d31a-8a07-4ad8-94d2-11d60dde24da tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T09:47:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1344448520',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1344448520',id=14,image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJA+mbW53CYPI09BJIYFnLrEotoFcZVkgH+GWeiBg0GW7ir0gJlqKnbnYK0AWdLlotPNpYiaLOq+gZ7eeixO/d6vHaXAxAISIFWGg7b0SpDRPk8D4ksykF7CXaWbd/kgfA==',key_name='tempest-keypair-2078999652',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='703b87f76dd845e4846d746bbf3dbb6c',ramdisk_id='',reservation_id='r-u2q5b3ln',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1091422151',owner_user_name='tempest-TaggedBootDevicesTest_v242-1091422151-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T09:47:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f24bad24bb284d15bf2ef1f4fa211389',uuid=9bcd05e7-481c-4ee9-953d-2873e6aa849d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fccc2ab0-7340-4ab5-be12-dd7b08c0cc72", "address": "fa:16:3e:bf:7e:6f", "network": {"id": "cd9117eb-aeb0-4c47-b450-2286d1680ed3", "bridge": "br-int", "label": "tempest-device-tagging-net1-1915364084", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.125", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "703b87f76dd845e4846d746bbf3dbb6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfccc2ab0-73", "ovs_interfaceid": "fccc2ab0-7340-4ab5-be12-dd7b08c0cc72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75229) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 09:47:32 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-4b32d31a-8a07-4ad8-94d2-11d60dde24da tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] Converting VIF {"id": "fccc2ab0-7340-4ab5-be12-dd7b08c0cc72", "address": "fa:16:3e:bf:7e:6f", "network": {"id": "cd9117eb-aeb0-4c47-b450-2286d1680ed3", "bridge": "br-int", "label": "tempest-device-tagging-net1-1915364084", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.125", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "703b87f76dd845e4846d746bbf3dbb6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfccc2ab0-73", "ovs_interfaceid": "fccc2ab0-7340-4ab5-be12-dd7b08c0cc72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 09:47:32 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-4b32d31a-8a07-4ad8-94d2-11d60dde24da tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bf:7e:6f,bridge_name='br-int',has_traffic_filtering=True,id=fccc2ab0-7340-4ab5-be12-dd7b08c0cc72,network=Network(cd9117eb-aeb0-4c47-b450-2286d1680ed3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfccc2ab0-73') {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 09:47:32 user nova-compute[75229]: DEBUG nova.virt.libvirt.vif [None req-4b32d31a-8a07-4ad8-94d2-11d60dde24da tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T09:47:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1344448520',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1344448520',id=14,image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJA+mbW53CYPI09BJIYFnLrEotoFcZVkgH+GWeiBg0GW7ir0gJlqKnbnYK0AWdLlotPNpYiaLOq+gZ7eeixO/d6vHaXAxAISIFWGg7b0SpDRPk8D4ksykF7CXaWbd/kgfA==',key_name='tempest-keypair-2078999652',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='703b87f76dd845e4846d746bbf3dbb6c',ramdisk_id='',reservation_id='r-u2q5b3ln',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1091422151',owner_user_name='tempest-TaggedBootDevicesTest_v242-1091422151-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T09:47:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f24bad24bb284d15bf2ef1f4fa211389',uuid=9bcd05e7-481c-4ee9-953d-2873e6aa849d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1766a369-08d0-4fc1-b0b3-fc8e3c6a051f", "address": "fa:16:3e:9e:05:3c", "network": {"id": "5584ce2f-1d94-4822-b275-d059d121bea5", "bridge": "br-int", "label": "tempest-device-tagging-net2-310256364", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "703b87f76dd845e4846d746bbf3dbb6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1766a369-08", "ovs_interfaceid": "1766a369-08d0-4fc1-b0b3-fc8e3c6a051f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75229) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 09:47:32 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-4b32d31a-8a07-4ad8-94d2-11d60dde24da tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] Converting VIF {"id": "1766a369-08d0-4fc1-b0b3-fc8e3c6a051f", "address": "fa:16:3e:9e:05:3c", "network": {"id": "5584ce2f-1d94-4822-b275-d059d121bea5", "bridge": "br-int", "label": "tempest-device-tagging-net2-310256364", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "703b87f76dd845e4846d746bbf3dbb6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1766a369-08", "ovs_interfaceid": "1766a369-08d0-4fc1-b0b3-fc8e3c6a051f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 09:47:32 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-4b32d31a-8a07-4ad8-94d2-11d60dde24da tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9e:05:3c,bridge_name='br-int',has_traffic_filtering=True,id=1766a369-08d0-4fc1-b0b3-fc8e3c6a051f,network=Network(5584ce2f-1d94-4822-b275-d059d121bea5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1766a369-08') {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 09:47:32 user nova-compute[75229]: DEBUG nova.virt.libvirt.vif [None req-4b32d31a-8a07-4ad8-94d2-11d60dde24da tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T09:47:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1344448520',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1344448520',id=14,image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJA+mbW53CYPI09BJIYFnLrEotoFcZVkgH+GWeiBg0GW7ir0gJlqKnbnYK0AWdLlotPNpYiaLOq+gZ7eeixO/d6vHaXAxAISIFWGg7b0SpDRPk8D4ksykF7CXaWbd/kgfA==',key_name='tempest-keypair-2078999652',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='703b87f76dd845e4846d746bbf3dbb6c',ramdisk_id='',reservation_id='r-u2q5b3ln',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1091422151',owner_user_name='tempest-TaggedBootDevicesTest_v242-1091422151-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T09:47:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f24bad24bb284d15bf2ef1f4fa211389',uuid=9bcd05e7-481c-4ee9-953d-2873e6aa849d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "94fc3f23-6f54-4e7c-815d-bf0c53245856", "address": "fa:16:3e:51:94:fa", "network": {"id": "5584ce2f-1d94-4822-b275-d059d121bea5", "bridge": "br-int", "label": "tempest-device-tagging-net2-310256364", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "703b87f76dd845e4846d746bbf3dbb6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94fc3f23-6f", "ovs_interfaceid": "94fc3f23-6f54-4e7c-815d-bf0c53245856", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75229) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 09:47:32 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-4b32d31a-8a07-4ad8-94d2-11d60dde24da tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] Converting VIF {"id": "94fc3f23-6f54-4e7c-815d-bf0c53245856", "address": "fa:16:3e:51:94:fa", "network": {"id": "5584ce2f-1d94-4822-b275-d059d121bea5", "bridge": "br-int", "label": "tempest-device-tagging-net2-310256364", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "703b87f76dd845e4846d746bbf3dbb6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94fc3f23-6f", "ovs_interfaceid": "94fc3f23-6f54-4e7c-815d-bf0c53245856", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 09:47:32 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-4b32d31a-8a07-4ad8-94d2-11d60dde24da tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:51:94:fa,bridge_name='br-int',has_traffic_filtering=True,id=94fc3f23-6f54-4e7c-815d-bf0c53245856,network=Network(5584ce2f-1d94-4822-b275-d059d121bea5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94fc3f23-6f') {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 09:47:32 user nova-compute[75229]: DEBUG nova.objects.instance [None req-4b32d31a-8a07-4ad8-94d2-11d60dde24da tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] Lazy-loading 'pci_devices' on Instance uuid 9bcd05e7-481c-4ee9-953d-2873e6aa849d {{(pid=75229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 09:47:32 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-4b32d31a-8a07-4ad8-94d2-11d60dde24da tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] [instance: 9bcd05e7-481c-4ee9-953d-2873e6aa849d] End _get_guest_xml xml=<domain type="kvm">
Nov 14 09:47:32 user nova-compute[75229]:   <uuid>9bcd05e7-481c-4ee9-953d-2873e6aa849d</uuid>
Nov 14 09:47:32 user nova-compute[75229]:   <name>instance-0000000e</name>
Nov 14 09:47:32 user nova-compute[75229]:   <memory>524288</memory>
Nov 14 09:47:32 user nova-compute[75229]:   <vcpu>1</vcpu>
Nov 14 09:47:32 user nova-compute[75229]:   <metadata>
Nov 14 09:47:32 user nova-compute[75229]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 09:47:32 user nova-compute[75229]:       <nova:package version="0.0.0"/>
Nov 14 09:47:32 user nova-compute[75229]:       <nova:name>tempest-device-tagging-server-1344448520</nova:name>
Nov 14 09:47:32 user nova-compute[75229]:       <nova:creationTime>2023-11-14 09:47:28</nova:creationTime>
Nov 14 09:47:32 user nova-compute[75229]:       <nova:flavor name="m1.tiny">
Nov 14 09:47:32 user nova-compute[75229]:         <nova:memory>512</nova:memory>
Nov 14 09:47:32 user nova-compute[75229]:         <nova:disk>1</nova:disk>
Nov 14 09:47:32 user nova-compute[75229]:         <nova:swap>0</nova:swap>
Nov 14 09:47:32 user nova-compute[75229]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 09:47:32 user nova-compute[75229]:         <nova:vcpus>1</nova:vcpus>
Nov 14 09:47:32 user nova-compute[75229]:       </nova:flavor>
Nov 14 09:47:32 user nova-compute[75229]:       <nova:owner>
Nov 14 09:47:32 user nova-compute[75229]:         <nova:user uuid="f24bad24bb284d15bf2ef1f4fa211389">tempest-TaggedBootDevicesTest_v242-1091422151-project-member</nova:user>
Nov 14 09:47:32 user nova-compute[75229]:         <nova:project uuid="703b87f76dd845e4846d746bbf3dbb6c">tempest-TaggedBootDevicesTest_v242-1091422151</nova:project>
Nov 14 09:47:32 user nova-compute[75229]:       </nova:owner>
Nov 14 09:47:32 user nova-compute[75229]:       <nova:root type="image" uuid="3bef8470-ecc7-40e3-95d4-9254348ea72d"/>
Nov 14 09:47:32 user nova-compute[75229]:       <nova:ports>
Nov 14 09:47:32 user nova-compute[75229]:         <nova:port uuid="71040f8f-3771-47df-a138-07571bf3eb9b">
Nov 14 09:47:32 user nova-compute[75229]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 14 09:47:32 user nova-compute[75229]:         </nova:port>
Nov 14 09:47:32 user nova-compute[75229]:         <nova:port uuid="ddcf0922-99ea-4e9f-8fe3-61df68231a99">
Nov 14 09:47:32 user nova-compute[75229]:           <nova:ip type="fixed" address="10.1.1.144" ipVersion="4"/>
Nov 14 09:47:32 user nova-compute[75229]:         </nova:port>
Nov 14 09:47:32 user nova-compute[75229]:         <nova:port uuid="db5f7129-8708-4f26-9975-c462270d47f3">
Nov 14 09:47:32 user nova-compute[75229]:           <nova:ip type="fixed" address="10.1.1.33" ipVersion="4"/>
Nov 14 09:47:32 user nova-compute[75229]:         </nova:port>
Nov 14 09:47:32 user nova-compute[75229]:         <nova:port uuid="7363cfca-de5d-4f2f-b467-752de544bc21">
Nov 14 09:47:32 user nova-compute[75229]:           <nova:ip type="fixed" address="10.1.1.239" ipVersion="4"/>
Nov 14 09:47:32 user nova-compute[75229]:         </nova:port>
Nov 14 09:47:32 user nova-compute[75229]:         <nova:port uuid="fccc2ab0-7340-4ab5-be12-dd7b08c0cc72">
Nov 14 09:47:32 user nova-compute[75229]:           <nova:ip type="fixed" address="10.1.1.125" ipVersion="4"/>
Nov 14 09:47:32 user nova-compute[75229]:         </nova:port>
Nov 14 09:47:32 user nova-compute[75229]:         <nova:port uuid="1766a369-08d0-4fc1-b0b3-fc8e3c6a051f">
Nov 14 09:47:32 user nova-compute[75229]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Nov 14 09:47:32 user nova-compute[75229]:         </nova:port>
Nov 14 09:47:32 user nova-compute[75229]:         <nova:port uuid="94fc3f23-6f54-4e7c-815d-bf0c53245856">
Nov 14 09:47:32 user nova-compute[75229]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Nov 14 09:47:32 user nova-compute[75229]:         </nova:port>
Nov 14 09:47:32 user nova-compute[75229]:       </nova:ports>
Nov 14 09:47:32 user nova-compute[75229]:     </nova:instance>
Nov 14 09:47:32 user nova-compute[75229]:   </metadata>
Nov 14 09:47:32 user nova-compute[75229]:   <sysinfo type="smbios">
Nov 14 09:47:32 user nova-compute[75229]:     <system>
Nov 14 09:47:32 user nova-compute[75229]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 09:47:32 user nova-compute[75229]:       <entry name="product">OpenStack Nova</entry>
Nov 14 09:47:32 user nova-compute[75229]:       <entry name="version">0.0.0</entry>
Nov 14 09:47:32 user nova-compute[75229]:       <entry name="serial">9bcd05e7-481c-4ee9-953d-2873e6aa849d</entry>
Nov 14 09:47:32 user nova-compute[75229]:       <entry name="uuid">9bcd05e7-481c-4ee9-953d-2873e6aa849d</entry>
Nov 14 09:47:32 user nova-compute[75229]:       <entry name="family">Virtual Machine</entry>
Nov 14 09:47:32 user nova-compute[75229]:     </system>
Nov 14 09:47:32 user nova-compute[75229]:   </sysinfo>
Nov 14 09:47:32 user nova-compute[75229]:   <os>
Nov 14 09:47:32 user nova-compute[75229]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 09:47:32 user nova-compute[75229]:     <boot dev="hd"/>
Nov 14 09:47:32 user nova-compute[75229]:     <smbios mode="sysinfo"/>
Nov 14 09:47:32 user nova-compute[75229]:   </os>
Nov 14 09:47:32 user nova-compute[75229]:   <features>
Nov 14 09:47:32 user nova-compute[75229]:     <acpi/>
Nov 14 09:47:32 user nova-compute[75229]:     <apic/>
Nov 14 09:47:32 user nova-compute[75229]:     <vmcoreinfo/>
Nov 14 09:47:32 user nova-compute[75229]:   </features>
Nov 14 09:47:32 user nova-compute[75229]:   <clock offset="utc">
Nov 14 09:47:32 user nova-compute[75229]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 09:47:32 user nova-compute[75229]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 09:47:32 user nova-compute[75229]:     <timer name="hpet" present="no"/>
Nov 14 09:47:32 user nova-compute[75229]:   </clock>
Nov 14 09:47:32 user nova-compute[75229]:   <cpu mode="custom" match="exact">
Nov 14 09:47:32 user nova-compute[75229]:     <model>Nehalem</model>
Nov 14 09:47:32 user nova-compute[75229]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 09:47:32 user nova-compute[75229]:   </cpu>
Nov 14 09:47:32 user nova-compute[75229]:   <devices>
Nov 14 09:47:32 user nova-compute[75229]:     <disk type="file" device="cdrom">
Nov 14 09:47:32 user nova-compute[75229]:       <driver name="qemu" type="raw" cache="none"/>
Nov 14 09:47:32 user nova-compute[75229]:       <source file="/opt/stack/data/nova/instances/9bcd05e7-481c-4ee9-953d-2873e6aa849d/disk.config"/>
Nov 14 09:47:32 user nova-compute[75229]:       <target dev="hda" bus="ide"/>
Nov 14 09:47:32 user nova-compute[75229]:     </disk>
Nov 14 09:47:32 user nova-compute[75229]:     <disk type="block" device="disk">
Nov 14 09:47:32 user nova-compute[75229]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 09:47:32 user nova-compute[75229]:       <source dev="/dev/sdb"/>
Nov 14 09:47:32 user nova-compute[75229]:       <target dev="vda" bus="virtio"/>
Nov 14 09:47:32 user nova-compute[75229]:       <serial>db131665-6ac2-437a-8adf-23593475a8aa</serial>
Nov 14 09:47:32 user nova-compute[75229]:     </disk>
Nov 14 09:47:32 user nova-compute[75229]:     <disk type="block" device="disk">
Nov 14 09:47:32 user nova-compute[75229]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 09:47:32 user nova-compute[75229]:       <source dev="/dev/sdc"/>
Nov 14 09:47:32 user nova-compute[75229]:       <target dev="vdb" bus="virtio"/>
Nov 14 09:47:32 user nova-compute[75229]:       <serial>b0433e38-fa42-4cff-af48-8cb5da297597</serial>
Nov 14 09:47:32 user nova-compute[75229]:     </disk>
Nov 14 09:47:32 user nova-compute[75229]:     <disk type="block" device="disk">
Nov 14 09:47:32 user nova-compute[75229]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 09:47:32 user nova-compute[75229]:       <source dev="/dev/sdd"/>
Nov 14 09:47:32 user nova-compute[75229]:       <target dev="vdc" bus="virtio"/>
Nov 14 09:47:32 user nova-compute[75229]:       <serial>13c53511-ea64-4896-b325-504ce58d7895</serial>
Nov 14 09:47:32 user nova-compute[75229]:     </disk>
Nov 14 09:47:32 user nova-compute[75229]:     <interface type="ethernet">
Nov 14 09:47:32 user nova-compute[75229]:       <mac address="fa:16:3e:76:1c:74"/>
Nov 14 09:47:32 user nova-compute[75229]:       <model type="virtio"/>
Nov 14 09:47:32 user nova-compute[75229]:       <mtu size="1442"/>
Nov 14 09:47:32 user nova-compute[75229]:       <target dev="tap71040f8f-37"/>
Nov 14 09:47:32 user nova-compute[75229]:     </interface>
Nov 14 09:47:32 user nova-compute[75229]:     <interface type="ethernet">
Nov 14 09:47:32 user nova-compute[75229]:       <mac address="fa:16:3e:2d:60:2c"/>
Nov 14 09:47:32 user nova-compute[75229]:       <model type="virtio"/>
Nov 14 09:47:32 user nova-compute[75229]:       <mtu size="1442"/>
Nov 14 09:47:32 user nova-compute[75229]:       <target dev="tapddcf0922-99"/>
Nov 14 09:47:32 user nova-compute[75229]:     </interface>
Nov 14 09:47:32 user nova-compute[75229]:     <interface type="ethernet">
Nov 14 09:47:32 user nova-compute[75229]:       <mac address="fa:16:3e:6a:77:bd"/>
Nov 14 09:47:32 user nova-compute[75229]:       <model type="virtio"/>
Nov 14 09:47:32 user nova-compute[75229]:       <mtu size="1442"/>
Nov 14 09:47:32 user nova-compute[75229]:       <target dev="tapdb5f7129-87"/>
Nov 14 09:47:32 user nova-compute[75229]:     </interface>
Nov 14 09:47:32 user nova-compute[75229]:     <interface type="ethernet">
Nov 14 09:47:32 user nova-compute[75229]:       <mac address="fa:16:3e:f9:0c:a4"/>
Nov 14 09:47:32 user nova-compute[75229]:       <model type="virtio"/>
Nov 14 09:47:32 user nova-compute[75229]:       <mtu size="1442"/>
Nov 14 09:47:32 user nova-compute[75229]:       <target dev="tap7363cfca-de"/>
Nov 14 09:47:32 user nova-compute[75229]:     </interface>
Nov 14 09:47:32 user nova-compute[75229]:     <interface type="ethernet">
Nov 14 09:47:32 user nova-compute[75229]:       <mac address="fa:16:3e:bf:7e:6f"/>
Nov 14 09:47:32 user nova-compute[75229]:       <model type="virtio"/>
Nov 14 09:47:32 user nova-compute[75229]:       <mtu size="1442"/>
Nov 14 09:47:32 user nova-compute[75229]:       <target dev="tapfccc2ab0-73"/>
Nov 14 09:47:32 user nova-compute[75229]:     </interface>
Nov 14 09:47:32 user nova-compute[75229]:     <interface type="ethernet">
Nov 14 09:47:32 user nova-compute[75229]:       <mac address="fa:16:3e:9e:05:3c"/>
Nov 14 09:47:32 user nova-compute[75229]:       <model type="virtio"/>
Nov 14 09:47:32 user nova-compute[75229]:       <mtu size="1442"/>
Nov 14 09:47:32 user nova-compute[75229]:       <target dev="tap1766a369-08"/>
Nov 14 09:47:32 user nova-compute[75229]:     </interface>
Nov 14 09:47:32 user nova-compute[75229]:     <interface type="ethernet">
Nov 14 09:47:32 user nova-compute[75229]:       <mac address="fa:16:3e:51:94:fa"/>
Nov 14 09:47:32 user nova-compute[75229]:       <model type="virtio"/>
Nov 14 09:47:32 user nova-compute[75229]:       <mtu size="1442"/>
Nov 14 09:47:32 user nova-compute[75229]:       <target dev="tap94fc3f23-6f"/>
Nov 14 09:47:32 user nova-compute[75229]:     </interface>
Nov 14 09:47:32 user nova-compute[75229]:     <serial type="pty">
Nov 14 09:47:32 user nova-compute[75229]:       <log file="/opt/stack/data/nova/instances/9bcd05e7-481c-4ee9-953d-2873e6aa849d/console.log" append="off"/>
Nov 14 09:47:32 user nova-compute[75229]:     </serial>
Nov 14 09:47:32 user nova-compute[75229]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 09:47:32 user nova-compute[75229]:     <video>
Nov 14 09:47:32 user nova-compute[75229]:       <model type="virtio"/>
Nov 14 09:47:32 user nova-compute[75229]:     </video>
Nov 14 09:47:32 user nova-compute[75229]:     <rng model="virtio">
Nov 14 09:47:32 user nova-compute[75229]:       <backend model="random">/dev/urandom</backend>
Nov 14 09:47:32 user nova-compute[75229]:     </rng>
Nov 14 09:47:32 user nova-compute[75229]:     <controller type="usb" index="0" model="none"/>
Nov 14 09:47:32 user nova-compute[75229]:     <memballoon model="virtio">
Nov 14 09:47:32 user nova-compute[75229]:       <stats period="10"/>
Nov 14 09:47:32 user nova-compute[75229]:     </memballoon>
Nov 14 09:47:32 user nova-compute[75229]:   </devices>
Nov 14 09:47:32 user nova-compute[75229]: </domain>
Nov 14 09:47:32 user nova-compute[75229]:  {{(pid=75229) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 09:47:32 user nova-compute[75229]: DEBUG nova.virt.libvirt.vif [None req-4b32d31a-8a07-4ad8-94d2-11d60dde24da tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T09:47:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1344448520',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1344448520',id=14,image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJA+mbW53CYPI09BJIYFnLrEotoFcZVkgH+GWeiBg0GW7ir0gJlqKnbnYK0AWdLlotPNpYiaLOq+gZ7eeixO/d6vHaXAxAISIFWGg7b0SpDRPk8D4ksykF7CXaWbd/kgfA==',key_name='tempest-keypair-2078999652',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='703b87f76dd845e4846d746bbf3dbb6c',ramdisk_id='',reservation_id='r-u2q5b3ln',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1091422151',owner_user_name='tempest-TaggedBootDevicesTest_v242-1091422151-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T09:47:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f24bad24bb284d15bf2ef1f4fa211389',uuid=9bcd05e7-481c-4ee9-953d-2873e6aa849d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "71040f8f-3771-47df-a138-07571bf3eb9b", "address": "fa:16:3e:76:1c:74", "network": {"id": "8efb8df0-c10e-46aa-b2e0-bb03cfeb00e8", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-2058178363-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "703b87f76dd845e4846d746bbf3dbb6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71040f8f-37", "ovs_interfaceid": "71040f8f-3771-47df-a138-07571bf3eb9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 09:47:32 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-4b32d31a-8a07-4ad8-94d2-11d60dde24da tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] Converting VIF {"id": "71040f8f-3771-47df-a138-07571bf3eb9b", "address": "fa:16:3e:76:1c:74", "network": {"id": "8efb8df0-c10e-46aa-b2e0-bb03cfeb00e8", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-2058178363-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "703b87f76dd845e4846d746bbf3dbb6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71040f8f-37", "ovs_interfaceid": "71040f8f-3771-47df-a138-07571bf3eb9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 09:47:32 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-4b32d31a-8a07-4ad8-94d2-11d60dde24da tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:76:1c:74,bridge_name='br-int',has_traffic_filtering=True,id=71040f8f-3771-47df-a138-07571bf3eb9b,network=Network(8efb8df0-c10e-46aa-b2e0-bb03cfeb00e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71040f8f-37') {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 09:47:32 user nova-compute[75229]: DEBUG os_vif [None req-4b32d31a-8a07-4ad8-94d2-11d60dde24da tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:76:1c:74,bridge_name='br-int',has_traffic_filtering=True,id=71040f8f-3771-47df-a138-07571bf3eb9b,network=Network(8efb8df0-c10e-46aa-b2e0-bb03cfeb00e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71040f8f-37') {{(pid=75229) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 09:47:32 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:47:32 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:47:32 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 09:47:32 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:47:32 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3afebe8b-0c55-5663-928b-a5a9a2377c43', '_type': 'linux-noop'}}, row=False) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:47:32 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:47:32 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 09:47:32 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:47:32 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:47:32 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap71040f8f-37, may_exist=True, interface_attrs={}) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:47:32 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap71040f8f-37, col_values=(('qos', UUID('c6dd845d-1750-454e-9070-1e9b368021b2')),), if_exists=True) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:47:32 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap71040f8f-37, col_values=(('external_ids', {'iface-id': '71040f8f-3771-47df-a138-07571bf3eb9b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:76:1c:74', 'vm-uuid': '9bcd05e7-481c-4ee9-953d-2873e6aa849d'}),), if_exists=True) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:47:32 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:47:32 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 09:47:32 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:47:32 user nova-compute[75229]: INFO os_vif [None req-4b32d31a-8a07-4ad8-94d2-11d60dde24da tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:76:1c:74,bridge_name='br-int',has_traffic_filtering=True,id=71040f8f-3771-47df-a138-07571bf3eb9b,network=Network(8efb8df0-c10e-46aa-b2e0-bb03cfeb00e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71040f8f-37')
Nov 14 09:47:32 user nova-compute[75229]: DEBUG nova.virt.libvirt.vif [None req-4b32d31a-8a07-4ad8-94d2-11d60dde24da tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T09:47:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1344448520',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1344448520',id=14,image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJA+mbW53CYPI09BJIYFnLrEotoFcZVkgH+GWeiBg0GW7ir0gJlqKnbnYK0AWdLlotPNpYiaLOq+gZ7eeixO/d6vHaXAxAISIFWGg7b0SpDRPk8D4ksykF7CXaWbd/kgfA==',key_name='tempest-keypair-2078999652',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='703b87f76dd845e4846d746bbf3dbb6c',ramdisk_id='',reservation_id='r-u2q5b3ln',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1091422151',owner_user_name='tempest-TaggedBootDevicesTest_v242-1091422151-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T09:47:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f24bad24bb284d15bf2ef1f4fa211389',uuid=9bcd05e7-481c-4ee9-953d-2873e6aa849d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ddcf0922-99ea-4e9f-8fe3-61df68231a99", "address": "fa:16:3e:2d:60:2c", "network": {"id": "cd9117eb-aeb0-4c47-b450-2286d1680ed3", "bridge": "br-int", "label": "tempest-device-tagging-net1-1915364084", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.144", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "703b87f76dd845e4846d746bbf3dbb6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapddcf0922-99", "ovs_interfaceid": "ddcf0922-99ea-4e9f-8fe3-61df68231a99", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75229) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 09:47:32 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-4b32d31a-8a07-4ad8-94d2-11d60dde24da tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] Converting VIF {"id": "ddcf0922-99ea-4e9f-8fe3-61df68231a99", "address": "fa:16:3e:2d:60:2c", "network": {"id": "cd9117eb-aeb0-4c47-b450-2286d1680ed3", "bridge": "br-int", "label": "tempest-device-tagging-net1-1915364084", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.144", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "703b87f76dd845e4846d746bbf3dbb6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapddcf0922-99", "ovs_interfaceid": "ddcf0922-99ea-4e9f-8fe3-61df68231a99", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 09:47:32 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-4b32d31a-8a07-4ad8-94d2-11d60dde24da tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2d:60:2c,bridge_name='br-int',has_traffic_filtering=True,id=ddcf0922-99ea-4e9f-8fe3-61df68231a99,network=Network(cd9117eb-aeb0-4c47-b450-2286d1680ed3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapddcf0922-99') {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 09:47:32 user nova-compute[75229]: DEBUG os_vif [None req-4b32d31a-8a07-4ad8-94d2-11d60dde24da tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2d:60:2c,bridge_name='br-int',has_traffic_filtering=True,id=ddcf0922-99ea-4e9f-8fe3-61df68231a99,network=Network(cd9117eb-aeb0-4c47-b450-2286d1680ed3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapddcf0922-99') {{(pid=75229) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 09:47:32 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:47:32 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:47:32 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 09:47:32 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:47:32 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7214ba50-672c-5ac6-b97b-7a8913adcc91', '_type': 'linux-noop'}}, row=False) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:47:32 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:47:32 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 09:47:32 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:47:32 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:47:32 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapddcf0922-99, may_exist=True, interface_attrs={}) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:47:32 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapddcf0922-99, col_values=(('qos', UUID('916d39de-08b8-45cb-a18e-a26f44f869b3')),), if_exists=True) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:47:32 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapddcf0922-99, col_values=(('external_ids', {'iface-id': 'ddcf0922-99ea-4e9f-8fe3-61df68231a99', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2d:60:2c', 'vm-uuid': '9bcd05e7-481c-4ee9-953d-2873e6aa849d'}),), if_exists=True) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:47:32 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:47:32 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 09:47:32 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:47:32 user nova-compute[75229]: INFO os_vif [None req-4b32d31a-8a07-4ad8-94d2-11d60dde24da tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2d:60:2c,bridge_name='br-int',has_traffic_filtering=True,id=ddcf0922-99ea-4e9f-8fe3-61df68231a99,network=Network(cd9117eb-aeb0-4c47-b450-2286d1680ed3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapddcf0922-99')
Nov 14 09:47:32 user nova-compute[75229]: DEBUG nova.virt.libvirt.vif [None req-4b32d31a-8a07-4ad8-94d2-11d60dde24da tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T09:47:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1344448520',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1344448520',id=14,image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJA+mbW53CYPI09BJIYFnLrEotoFcZVkgH+GWeiBg0GW7ir0gJlqKnbnYK0AWdLlotPNpYiaLOq+gZ7eeixO/d6vHaXAxAISIFWGg7b0SpDRPk8D4ksykF7CXaWbd/kgfA==',key_name='tempest-keypair-2078999652',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='703b87f76dd845e4846d746bbf3dbb6c',ramdisk_id='',reservation_id='r-u2q5b3ln',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1091422151',owner_user_name='tempest-TaggedBootDevicesTest_v242-1091422151-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T09:47:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f24bad24bb284d15bf2ef1f4fa211389',uuid=9bcd05e7-481c-4ee9-953d-2873e6aa849d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "db5f7129-8708-4f26-9975-c462270d47f3", "address": "fa:16:3e:6a:77:bd", "network": {"id": "cd9117eb-aeb0-4c47-b450-2286d1680ed3", "bridge": "br-int", "label": "tempest-device-tagging-net1-1915364084", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.33", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "703b87f76dd845e4846d746bbf3dbb6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb5f7129-87", "ovs_interfaceid": "db5f7129-8708-4f26-9975-c462270d47f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75229) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 09:47:32 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-4b32d31a-8a07-4ad8-94d2-11d60dde24da tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] Converting VIF {"id": "db5f7129-8708-4f26-9975-c462270d47f3", "address": "fa:16:3e:6a:77:bd", "network": {"id": "cd9117eb-aeb0-4c47-b450-2286d1680ed3", "bridge": "br-int", "label": "tempest-device-tagging-net1-1915364084", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.33", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "703b87f76dd845e4846d746bbf3dbb6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb5f7129-87", "ovs_interfaceid": "db5f7129-8708-4f26-9975-c462270d47f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 09:47:32 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-4b32d31a-8a07-4ad8-94d2-11d60dde24da tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6a:77:bd,bridge_name='br-int',has_traffic_filtering=True,id=db5f7129-8708-4f26-9975-c462270d47f3,network=Network(cd9117eb-aeb0-4c47-b450-2286d1680ed3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapdb5f7129-87') {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 09:47:32 user nova-compute[75229]: DEBUG os_vif [None req-4b32d31a-8a07-4ad8-94d2-11d60dde24da tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6a:77:bd,bridge_name='br-int',has_traffic_filtering=True,id=db5f7129-8708-4f26-9975-c462270d47f3,network=Network(cd9117eb-aeb0-4c47-b450-2286d1680ed3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapdb5f7129-87') {{(pid=75229) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 09:47:32 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:47:32 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:47:32 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 09:47:32 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:47:32 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '70bd9145-db05-5846-9b1f-3347ba6fa93d', '_type': 'linux-noop'}}, row=False) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:47:32 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:47:32 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 09:47:32 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:47:32 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:47:32 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdb5f7129-87, may_exist=True, interface_attrs={}) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:47:32 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapdb5f7129-87, col_values=(('qos', UUID('a9539fc0-7981-4b6a-8bb5-1427be6c962a')),), if_exists=True) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:47:32 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapdb5f7129-87, col_values=(('external_ids', {'iface-id': 'db5f7129-8708-4f26-9975-c462270d47f3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6a:77:bd', 'vm-uuid': '9bcd05e7-481c-4ee9-953d-2873e6aa849d'}),), if_exists=True) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:47:32 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:47:32 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 09:47:32 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:47:32 user nova-compute[75229]: INFO os_vif [None req-4b32d31a-8a07-4ad8-94d2-11d60dde24da tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6a:77:bd,bridge_name='br-int',has_traffic_filtering=True,id=db5f7129-8708-4f26-9975-c462270d47f3,network=Network(cd9117eb-aeb0-4c47-b450-2286d1680ed3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapdb5f7129-87')
Nov 14 09:47:32 user nova-compute[75229]: DEBUG nova.virt.libvirt.vif [None req-4b32d31a-8a07-4ad8-94d2-11d60dde24da tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T09:47:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1344448520',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1344448520',id=14,image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJA+mbW53CYPI09BJIYFnLrEotoFcZVkgH+GWeiBg0GW7ir0gJlqKnbnYK0AWdLlotPNpYiaLOq+gZ7eeixO/d6vHaXAxAISIFWGg7b0SpDRPk8D4ksykF7CXaWbd/kgfA==',key_name='tempest-keypair-2078999652',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='703b87f76dd845e4846d746bbf3dbb6c',ramdisk_id='',reservation_id='r-u2q5b3ln',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1091422151',owner_user_name='tempest-TaggedBootDevicesTest_v242-1091422151-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T09:47:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f24bad24bb284d15bf2ef1f4fa211389',uuid=9bcd05e7-481c-4ee9-953d-2873e6aa849d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7363cfca-de5d-4f2f-b467-752de544bc21", "address": "fa:16:3e:f9:0c:a4", "network": {"id": "cd9117eb-aeb0-4c47-b450-2286d1680ed3", "bridge": "br-int", "label": "tempest-device-tagging-net1-1915364084", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.239", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "703b87f76dd845e4846d746bbf3dbb6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7363cfca-de", "ovs_interfaceid": "7363cfca-de5d-4f2f-b467-752de544bc21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 09:47:32 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-4b32d31a-8a07-4ad8-94d2-11d60dde24da tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] Converting VIF {"id": "7363cfca-de5d-4f2f-b467-752de544bc21", "address": "fa:16:3e:f9:0c:a4", "network": {"id": "cd9117eb-aeb0-4c47-b450-2286d1680ed3", "bridge": "br-int", "label": "tempest-device-tagging-net1-1915364084", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.239", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "703b87f76dd845e4846d746bbf3dbb6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7363cfca-de", "ovs_interfaceid": "7363cfca-de5d-4f2f-b467-752de544bc21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 09:47:32 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-4b32d31a-8a07-4ad8-94d2-11d60dde24da tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f9:0c:a4,bridge_name='br-int',has_traffic_filtering=True,id=7363cfca-de5d-4f2f-b467-752de544bc21,network=Network(cd9117eb-aeb0-4c47-b450-2286d1680ed3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7363cfca-de') {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 09:47:32 user nova-compute[75229]: DEBUG os_vif [None req-4b32d31a-8a07-4ad8-94d2-11d60dde24da tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f9:0c:a4,bridge_name='br-int',has_traffic_filtering=True,id=7363cfca-de5d-4f2f-b467-752de544bc21,network=Network(cd9117eb-aeb0-4c47-b450-2286d1680ed3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7363cfca-de') {{(pid=75229) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 09:47:32 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:47:32 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:47:32 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 09:47:32 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:47:32 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd4f4a58a-a479-5494-bc73-8a3c7c749281', '_type': 'linux-noop'}}, row=False) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:47:32 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:47:32 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 09:47:32 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:47:32 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:47:32 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7363cfca-de, may_exist=True, interface_attrs={}) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:47:32 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7363cfca-de, col_values=(('qos', UUID('a348acee-7edd-4df9-b665-6c4f1744d53d')),), if_exists=True) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:47:32 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7363cfca-de, col_values=(('external_ids', {'iface-id': '7363cfca-de5d-4f2f-b467-752de544bc21', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f9:0c:a4', 'vm-uuid': '9bcd05e7-481c-4ee9-953d-2873e6aa849d'}),), if_exists=True) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:47:32 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:47:32 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 09:47:32 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:47:32 user nova-compute[75229]: INFO os_vif [None req-4b32d31a-8a07-4ad8-94d2-11d60dde24da tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f9:0c:a4,bridge_name='br-int',has_traffic_filtering=True,id=7363cfca-de5d-4f2f-b467-752de544bc21,network=Network(cd9117eb-aeb0-4c47-b450-2286d1680ed3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7363cfca-de')
Nov 14 09:47:32 user nova-compute[75229]: DEBUG nova.virt.libvirt.vif [None req-4b32d31a-8a07-4ad8-94d2-11d60dde24da tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T09:47:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1344448520',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1344448520',id=14,image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJA+mbW53CYPI09BJIYFnLrEotoFcZVkgH+GWeiBg0GW7ir0gJlqKnbnYK0AWdLlotPNpYiaLOq+gZ7eeixO/d6vHaXAxAISIFWGg7b0SpDRPk8D4ksykF7CXaWbd/kgfA==',key_name='tempest-keypair-2078999652',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='703b87f76dd845e4846d746bbf3dbb6c',ramdisk_id='',reservation_id='r-u2q5b3ln',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1091422151',owner_user_name='tempest-TaggedBootDevicesTest_v242-1091422151-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T09:47:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f24bad24bb284d15bf2ef1f4fa211389',uuid=9bcd05e7-481c-4ee9-953d-2873e6aa849d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fccc2ab0-7340-4ab5-be12-dd7b08c0cc72", "address": "fa:16:3e:bf:7e:6f", "network": {"id": "cd9117eb-aeb0-4c47-b450-2286d1680ed3", "bridge": "br-int", "label": "tempest-device-tagging-net1-1915364084", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.125", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "703b87f76dd845e4846d746bbf3dbb6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfccc2ab0-73", "ovs_interfaceid": "fccc2ab0-7340-4ab5-be12-dd7b08c0cc72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 09:47:32 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-4b32d31a-8a07-4ad8-94d2-11d60dde24da tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] Converting VIF {"id": "fccc2ab0-7340-4ab5-be12-dd7b08c0cc72", "address": "fa:16:3e:bf:7e:6f", "network": {"id": "cd9117eb-aeb0-4c47-b450-2286d1680ed3", "bridge": "br-int", "label": "tempest-device-tagging-net1-1915364084", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.125", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "703b87f76dd845e4846d746bbf3dbb6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfccc2ab0-73", "ovs_interfaceid": "fccc2ab0-7340-4ab5-be12-dd7b08c0cc72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 09:47:32 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-4b32d31a-8a07-4ad8-94d2-11d60dde24da tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bf:7e:6f,bridge_name='br-int',has_traffic_filtering=True,id=fccc2ab0-7340-4ab5-be12-dd7b08c0cc72,network=Network(cd9117eb-aeb0-4c47-b450-2286d1680ed3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfccc2ab0-73') {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 09:47:32 user nova-compute[75229]: DEBUG os_vif [None req-4b32d31a-8a07-4ad8-94d2-11d60dde24da tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bf:7e:6f,bridge_name='br-int',has_traffic_filtering=True,id=fccc2ab0-7340-4ab5-be12-dd7b08c0cc72,network=Network(cd9117eb-aeb0-4c47-b450-2286d1680ed3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfccc2ab0-73') {{(pid=75229) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 09:47:32 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:47:32 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:47:32 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 09:47:32 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:47:32 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7950f038-23c6-52b3-9c39-48350c4bdf20', '_type': 'linux-noop'}}, row=False) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:47:32 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:47:32 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 09:47:32 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:47:32 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:47:32 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfccc2ab0-73, may_exist=True, interface_attrs={}) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:47:32 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapfccc2ab0-73, col_values=(('qos', UUID('a67a7fc1-7b6b-4f2c-9c5a-b573c1ab8b03')),), if_exists=True) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:47:32 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapfccc2ab0-73, col_values=(('external_ids', {'iface-id': 'fccc2ab0-7340-4ab5-be12-dd7b08c0cc72', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bf:7e:6f', 'vm-uuid': '9bcd05e7-481c-4ee9-953d-2873e6aa849d'}),), if_exists=True) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:47:32 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:47:32 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 09:47:32 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:47:32 user nova-compute[75229]: INFO os_vif [None req-4b32d31a-8a07-4ad8-94d2-11d60dde24da tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bf:7e:6f,bridge_name='br-int',has_traffic_filtering=True,id=fccc2ab0-7340-4ab5-be12-dd7b08c0cc72,network=Network(cd9117eb-aeb0-4c47-b450-2286d1680ed3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfccc2ab0-73')
Nov 14 09:47:32 user nova-compute[75229]: DEBUG nova.virt.libvirt.vif [None req-4b32d31a-8a07-4ad8-94d2-11d60dde24da tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T09:47:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1344448520',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1344448520',id=14,image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJA+mbW53CYPI09BJIYFnLrEotoFcZVkgH+GWeiBg0GW7ir0gJlqKnbnYK0AWdLlotPNpYiaLOq+gZ7eeixO/d6vHaXAxAISIFWGg7b0SpDRPk8D4ksykF7CXaWbd/kgfA==',key_name='tempest-keypair-2078999652',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='703b87f76dd845e4846d746bbf3dbb6c',ramdisk_id='',reservation_id='r-u2q5b3ln',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1091422151',owner_user_name='tempest-TaggedBootDevicesTest_v242-1091422151-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T09:47:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f24bad24bb284d15bf2ef1f4fa211389',uuid=9bcd05e7-481c-4ee9-953d-2873e6aa849d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1766a369-08d0-4fc1-b0b3-fc8e3c6a051f", "address": "fa:16:3e:9e:05:3c", "network": {"id": "5584ce2f-1d94-4822-b275-d059d121bea5", "bridge": "br-int", "label": "tempest-device-tagging-net2-310256364", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "703b87f76dd845e4846d746bbf3dbb6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1766a369-08", "ovs_interfaceid": "1766a369-08d0-4fc1-b0b3-fc8e3c6a051f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 09:47:32 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-4b32d31a-8a07-4ad8-94d2-11d60dde24da tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] Converting VIF {"id": "1766a369-08d0-4fc1-b0b3-fc8e3c6a051f", "address": "fa:16:3e:9e:05:3c", "network": {"id": "5584ce2f-1d94-4822-b275-d059d121bea5", "bridge": "br-int", "label": "tempest-device-tagging-net2-310256364", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "703b87f76dd845e4846d746bbf3dbb6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1766a369-08", "ovs_interfaceid": "1766a369-08d0-4fc1-b0b3-fc8e3c6a051f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 09:47:32 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-4b32d31a-8a07-4ad8-94d2-11d60dde24da tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9e:05:3c,bridge_name='br-int',has_traffic_filtering=True,id=1766a369-08d0-4fc1-b0b3-fc8e3c6a051f,network=Network(5584ce2f-1d94-4822-b275-d059d121bea5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1766a369-08') {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 09:47:32 user nova-compute[75229]: DEBUG os_vif [None req-4b32d31a-8a07-4ad8-94d2-11d60dde24da tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9e:05:3c,bridge_name='br-int',has_traffic_filtering=True,id=1766a369-08d0-4fc1-b0b3-fc8e3c6a051f,network=Network(5584ce2f-1d94-4822-b275-d059d121bea5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1766a369-08') {{(pid=75229) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 09:47:32 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:47:32 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:47:32 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 09:47:32 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:47:32 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9a2cda61-b459-55ef-a5ce-a05dd5902423', '_type': 'linux-noop'}}, row=False) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:47:32 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:47:32 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 09:47:33 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:47:33 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:47:33 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1766a369-08, may_exist=True, interface_attrs={}) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:47:33 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1766a369-08, col_values=(('qos', UUID('0d6f8da1-1ab3-45d3-92dd-4833b3e75d36')),), if_exists=True) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:47:33 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1766a369-08, col_values=(('external_ids', {'iface-id': '1766a369-08d0-4fc1-b0b3-fc8e3c6a051f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9e:05:3c', 'vm-uuid': '9bcd05e7-481c-4ee9-953d-2873e6aa849d'}),), if_exists=True) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:47:33 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:47:33 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 09:47:33 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:47:33 user nova-compute[75229]: INFO os_vif [None req-4b32d31a-8a07-4ad8-94d2-11d60dde24da tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9e:05:3c,bridge_name='br-int',has_traffic_filtering=True,id=1766a369-08d0-4fc1-b0b3-fc8e3c6a051f,network=Network(5584ce2f-1d94-4822-b275-d059d121bea5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1766a369-08')
Nov 14 09:47:33 user nova-compute[75229]: DEBUG nova.virt.libvirt.vif [None req-4b32d31a-8a07-4ad8-94d2-11d60dde24da tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T09:47:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1344448520',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1344448520',id=14,image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJA+mbW53CYPI09BJIYFnLrEotoFcZVkgH+GWeiBg0GW7ir0gJlqKnbnYK0AWdLlotPNpYiaLOq+gZ7eeixO/d6vHaXAxAISIFWGg7b0SpDRPk8D4ksykF7CXaWbd/kgfA==',key_name='tempest-keypair-2078999652',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='703b87f76dd845e4846d746bbf3dbb6c',ramdisk_id='',reservation_id='r-u2q5b3ln',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1091422151',owner_user_name='tempest-TaggedBootDevicesTest_v242-1091422151-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T09:47:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f24bad24bb284d15bf2ef1f4fa211389',uuid=9bcd05e7-481c-4ee9-953d-2873e6aa849d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "94fc3f23-6f54-4e7c-815d-bf0c53245856", "address": "fa:16:3e:51:94:fa", "network": {"id": "5584ce2f-1d94-4822-b275-d059d121bea5", "bridge": "br-int", "label": "tempest-device-tagging-net2-310256364", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "703b87f76dd845e4846d746bbf3dbb6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94fc3f23-6f", "ovs_interfaceid": "94fc3f23-6f54-4e7c-815d-bf0c53245856", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 09:47:33 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-4b32d31a-8a07-4ad8-94d2-11d60dde24da tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] Converting VIF {"id": "94fc3f23-6f54-4e7c-815d-bf0c53245856", "address": "fa:16:3e:51:94:fa", "network": {"id": "5584ce2f-1d94-4822-b275-d059d121bea5", "bridge": "br-int", "label": "tempest-device-tagging-net2-310256364", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "703b87f76dd845e4846d746bbf3dbb6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94fc3f23-6f", "ovs_interfaceid": "94fc3f23-6f54-4e7c-815d-bf0c53245856", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 09:47:33 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-4b32d31a-8a07-4ad8-94d2-11d60dde24da tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:51:94:fa,bridge_name='br-int',has_traffic_filtering=True,id=94fc3f23-6f54-4e7c-815d-bf0c53245856,network=Network(5584ce2f-1d94-4822-b275-d059d121bea5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94fc3f23-6f') {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 09:47:33 user nova-compute[75229]: DEBUG os_vif [None req-4b32d31a-8a07-4ad8-94d2-11d60dde24da tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:51:94:fa,bridge_name='br-int',has_traffic_filtering=True,id=94fc3f23-6f54-4e7c-815d-bf0c53245856,network=Network(5584ce2f-1d94-4822-b275-d059d121bea5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94fc3f23-6f') {{(pid=75229) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 09:47:33 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:47:33 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:47:33 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 09:47:33 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:47:33 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b7d10b55-c8bd-53b1-b877-2e794dbeabf6', '_type': 'linux-noop'}}, row=False) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:47:33 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:47:33 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 09:47:33 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:47:33 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:47:33 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap94fc3f23-6f, may_exist=True, interface_attrs={}) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:47:33 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap94fc3f23-6f, col_values=(('qos', UUID('f1b741ff-52c0-4eb2-8f37-28d4a27cc5ee')),), if_exists=True) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:47:33 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap94fc3f23-6f, col_values=(('external_ids', {'iface-id': '94fc3f23-6f54-4e7c-815d-bf0c53245856', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:51:94:fa', 'vm-uuid': '9bcd05e7-481c-4ee9-953d-2873e6aa849d'}),), if_exists=True) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:47:33 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:47:33 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 09:47:33 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:47:33 user nova-compute[75229]: INFO os_vif [None req-4b32d31a-8a07-4ad8-94d2-11d60dde24da tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:51:94:fa,bridge_name='br-int',has_traffic_filtering=True,id=94fc3f23-6f54-4e7c-815d-bf0c53245856,network=Network(5584ce2f-1d94-4822-b275-d059d121bea5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94fc3f23-6f')
Nov 14 09:47:33 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-4b32d31a-8a07-4ad8-94d2-11d60dde24da tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] No BDM found with device name hda, not building metadata. {{(pid=75229) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 09:47:33 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-4b32d31a-8a07-4ad8-94d2-11d60dde24da tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75229) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 09:47:33 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-4b32d31a-8a07-4ad8-94d2-11d60dde24da tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] No VIF found with MAC fa:16:3e:76:1c:74, not building metadata {{(pid=75229) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 09:47:33 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-4b32d31a-8a07-4ad8-94d2-11d60dde24da tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] No VIF found with MAC fa:16:3e:bf:7e:6f, not building metadata {{(pid=75229) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 09:47:33 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-4b32d31a-8a07-4ad8-94d2-11d60dde24da tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] [instance: 9bcd05e7-481c-4ee9-953d-2873e6aa849d] Using config drive
Nov 14 09:47:33 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-4b32d31a-8a07-4ad8-94d2-11d60dde24da tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] [instance: 9bcd05e7-481c-4ee9-953d-2873e6aa849d] Creating config drive at /opt/stack/data/nova/instances/9bcd05e7-481c-4ee9-953d-2873e6aa849d/disk.config
Nov 14 09:47:33 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-4b32d31a-8a07-4ad8-94d2-11d60dde24da tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/9bcd05e7-481c-4ee9-953d-2873e6aa849d/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpqpwknii9 {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:47:33 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-4b32d31a-8a07-4ad8-94d2-11d60dde24da tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/9bcd05e7-481c-4ee9-953d-2873e6aa849d/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpqpwknii9" returned: 0 in 0.054s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:47:35 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:47:35 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:47:35 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:47:35 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:47:35 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:47:35 user nova-compute[75229]: DEBUG nova.compute.manager [req-ba3a6ee5-3d31-4e0a-821b-58bc67fef7e8 req-9d5f86e0-fc18-42d3-90e2-ba613c65de67 service nova] [instance: 9bcd05e7-481c-4ee9-953d-2873e6aa849d] Received event network-vif-plugged-71040f8f-3771-47df-a138-07571bf3eb9b {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:47:35 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-ba3a6ee5-3d31-4e0a-821b-58bc67fef7e8 req-9d5f86e0-fc18-42d3-90e2-ba613c65de67 service nova] Acquiring lock "9bcd05e7-481c-4ee9-953d-2873e6aa849d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:47:35 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-ba3a6ee5-3d31-4e0a-821b-58bc67fef7e8 req-9d5f86e0-fc18-42d3-90e2-ba613c65de67 service nova] Lock "9bcd05e7-481c-4ee9-953d-2873e6aa849d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:47:35 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-ba3a6ee5-3d31-4e0a-821b-58bc67fef7e8 req-9d5f86e0-fc18-42d3-90e2-ba613c65de67 service nova] Lock "9bcd05e7-481c-4ee9-953d-2873e6aa849d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:47:35 user nova-compute[75229]: DEBUG nova.compute.manager [req-ba3a6ee5-3d31-4e0a-821b-58bc67fef7e8 req-9d5f86e0-fc18-42d3-90e2-ba613c65de67 service nova] [instance: 9bcd05e7-481c-4ee9-953d-2873e6aa849d] No waiting events found dispatching network-vif-plugged-71040f8f-3771-47df-a138-07571bf3eb9b {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 09:47:35 user nova-compute[75229]: WARNING nova.compute.manager [req-ba3a6ee5-3d31-4e0a-821b-58bc67fef7e8 req-9d5f86e0-fc18-42d3-90e2-ba613c65de67 service nova] [instance: 9bcd05e7-481c-4ee9-953d-2873e6aa849d] Received unexpected event network-vif-plugged-71040f8f-3771-47df-a138-07571bf3eb9b for instance with vm_state building and task_state spawning.
Nov 14 09:47:35 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:47:35 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:47:35 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:47:35 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:47:35 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:47:36 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:47:36 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:47:36 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:47:36 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:47:36 user nova-compute[75229]: DEBUG nova.compute.manager [req-0414893d-2fe5-412c-a414-8c78977ec352 req-7ac89ddf-b3bd-4811-9b43-99727110905c service nova] [instance: 9bcd05e7-481c-4ee9-953d-2873e6aa849d] Received event network-vif-plugged-db5f7129-8708-4f26-9975-c462270d47f3 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:47:36 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-0414893d-2fe5-412c-a414-8c78977ec352 req-7ac89ddf-b3bd-4811-9b43-99727110905c service nova] Acquiring lock "9bcd05e7-481c-4ee9-953d-2873e6aa849d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:47:36 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-0414893d-2fe5-412c-a414-8c78977ec352 req-7ac89ddf-b3bd-4811-9b43-99727110905c service nova] Lock "9bcd05e7-481c-4ee9-953d-2873e6aa849d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:47:36 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-0414893d-2fe5-412c-a414-8c78977ec352 req-7ac89ddf-b3bd-4811-9b43-99727110905c service nova] Lock "9bcd05e7-481c-4ee9-953d-2873e6aa849d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:47:36 user nova-compute[75229]: DEBUG nova.compute.manager [req-0414893d-2fe5-412c-a414-8c78977ec352 req-7ac89ddf-b3bd-4811-9b43-99727110905c service nova] [instance: 9bcd05e7-481c-4ee9-953d-2873e6aa849d] No waiting events found dispatching network-vif-plugged-db5f7129-8708-4f26-9975-c462270d47f3 {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 09:47:36 user nova-compute[75229]: WARNING nova.compute.manager [req-0414893d-2fe5-412c-a414-8c78977ec352 req-7ac89ddf-b3bd-4811-9b43-99727110905c service nova] [instance: 9bcd05e7-481c-4ee9-953d-2873e6aa849d] Received unexpected event network-vif-plugged-db5f7129-8708-4f26-9975-c462270d47f3 for instance with vm_state building and task_state spawning.
Nov 14 09:47:36 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:47:36 user nova-compute[75229]: DEBUG nova.compute.manager [req-647218ee-4d64-4e14-a393-e150c85788e6 req-51175b76-8aea-43fc-893e-6d8fd582fef4 service nova] [instance: 9bcd05e7-481c-4ee9-953d-2873e6aa849d] Received event network-vif-plugged-ddcf0922-99ea-4e9f-8fe3-61df68231a99 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:47:36 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-647218ee-4d64-4e14-a393-e150c85788e6 req-51175b76-8aea-43fc-893e-6d8fd582fef4 service nova] Acquiring lock "9bcd05e7-481c-4ee9-953d-2873e6aa849d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:47:36 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-647218ee-4d64-4e14-a393-e150c85788e6 req-51175b76-8aea-43fc-893e-6d8fd582fef4 service nova] Lock "9bcd05e7-481c-4ee9-953d-2873e6aa849d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:47:36 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-647218ee-4d64-4e14-a393-e150c85788e6 req-51175b76-8aea-43fc-893e-6d8fd582fef4 service nova] Lock "9bcd05e7-481c-4ee9-953d-2873e6aa849d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:47:36 user nova-compute[75229]: DEBUG nova.compute.manager [req-647218ee-4d64-4e14-a393-e150c85788e6 req-51175b76-8aea-43fc-893e-6d8fd582fef4 service nova] [instance: 9bcd05e7-481c-4ee9-953d-2873e6aa849d] No waiting events found dispatching network-vif-plugged-ddcf0922-99ea-4e9f-8fe3-61df68231a99 {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 09:47:36 user nova-compute[75229]: WARNING nova.compute.manager [req-647218ee-4d64-4e14-a393-e150c85788e6 req-51175b76-8aea-43fc-893e-6d8fd582fef4 service nova] [instance: 9bcd05e7-481c-4ee9-953d-2873e6aa849d] Received unexpected event network-vif-plugged-ddcf0922-99ea-4e9f-8fe3-61df68231a99 for instance with vm_state building and task_state spawning.
Nov 14 09:47:36 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:47:36 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:47:36 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:47:36 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:47:36 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:47:36 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:47:36 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:47:37 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:47:37 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:47:37 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:47:37 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:47:37 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:47:37 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:47:37 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:47:37 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:47:37 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:47:37 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-65cb7584-889d-4d19-9969-57c66dc18090 tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Acquiring lock "90bd76df-96cb-4bec-9862-853d94cdbaab" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:47:37 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-65cb7584-889d-4d19-9969-57c66dc18090 tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Lock "90bd76df-96cb-4bec-9862-853d94cdbaab" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:47:37 user nova-compute[75229]: INFO nova.compute.manager [None req-65cb7584-889d-4d19-9969-57c66dc18090 tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] [instance: 90bd76df-96cb-4bec-9862-853d94cdbaab] Unshelving
Nov 14 09:47:37 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:47:37 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:47:37 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:47:37 user nova-compute[75229]: DEBUG nova.compute.manager [req-f93881d3-2b50-4b02-974e-2b7881de366f req-e10f448d-ed2d-4aa0-88cc-613814ab81d8 service nova] [instance: 9bcd05e7-481c-4ee9-953d-2873e6aa849d] Received event network-vif-plugged-71040f8f-3771-47df-a138-07571bf3eb9b {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:47:37 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-f93881d3-2b50-4b02-974e-2b7881de366f req-e10f448d-ed2d-4aa0-88cc-613814ab81d8 service nova] Acquiring lock "9bcd05e7-481c-4ee9-953d-2873e6aa849d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:47:37 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-f93881d3-2b50-4b02-974e-2b7881de366f req-e10f448d-ed2d-4aa0-88cc-613814ab81d8 service nova] Lock "9bcd05e7-481c-4ee9-953d-2873e6aa849d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:47:37 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-f93881d3-2b50-4b02-974e-2b7881de366f req-e10f448d-ed2d-4aa0-88cc-613814ab81d8 service nova] Lock "9bcd05e7-481c-4ee9-953d-2873e6aa849d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:47:37 user nova-compute[75229]: DEBUG nova.compute.manager [req-f93881d3-2b50-4b02-974e-2b7881de366f req-e10f448d-ed2d-4aa0-88cc-613814ab81d8 service nova] [instance: 9bcd05e7-481c-4ee9-953d-2873e6aa849d] No waiting events found dispatching network-vif-plugged-71040f8f-3771-47df-a138-07571bf3eb9b {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 09:47:37 user nova-compute[75229]: WARNING nova.compute.manager [req-f93881d3-2b50-4b02-974e-2b7881de366f req-e10f448d-ed2d-4aa0-88cc-613814ab81d8 service nova] [instance: 9bcd05e7-481c-4ee9-953d-2873e6aa849d] Received unexpected event network-vif-plugged-71040f8f-3771-47df-a138-07571bf3eb9b for instance with vm_state building and task_state spawning.
Nov 14 09:47:37 user nova-compute[75229]: DEBUG nova.compute.manager [req-f93881d3-2b50-4b02-974e-2b7881de366f req-e10f448d-ed2d-4aa0-88cc-613814ab81d8 service nova] [instance: 9bcd05e7-481c-4ee9-953d-2873e6aa849d] Received event network-vif-plugged-7363cfca-de5d-4f2f-b467-752de544bc21 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:47:37 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-f93881d3-2b50-4b02-974e-2b7881de366f req-e10f448d-ed2d-4aa0-88cc-613814ab81d8 service nova] Acquiring lock "9bcd05e7-481c-4ee9-953d-2873e6aa849d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:47:37 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-f93881d3-2b50-4b02-974e-2b7881de366f req-e10f448d-ed2d-4aa0-88cc-613814ab81d8 service nova] Lock "9bcd05e7-481c-4ee9-953d-2873e6aa849d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:47:37 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-f93881d3-2b50-4b02-974e-2b7881de366f req-e10f448d-ed2d-4aa0-88cc-613814ab81d8 service nova] Lock "9bcd05e7-481c-4ee9-953d-2873e6aa849d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:47:37 user nova-compute[75229]: DEBUG nova.compute.manager [req-f93881d3-2b50-4b02-974e-2b7881de366f req-e10f448d-ed2d-4aa0-88cc-613814ab81d8 service nova] [instance: 9bcd05e7-481c-4ee9-953d-2873e6aa849d] No waiting events found dispatching network-vif-plugged-7363cfca-de5d-4f2f-b467-752de544bc21 {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 09:47:37 user nova-compute[75229]: WARNING nova.compute.manager [req-f93881d3-2b50-4b02-974e-2b7881de366f req-e10f448d-ed2d-4aa0-88cc-613814ab81d8 service nova] [instance: 9bcd05e7-481c-4ee9-953d-2873e6aa849d] Received unexpected event network-vif-plugged-7363cfca-de5d-4f2f-b467-752de544bc21 for instance with vm_state building and task_state spawning.
Nov 14 09:47:37 user nova-compute[75229]: DEBUG nova.compute.manager [req-f93881d3-2b50-4b02-974e-2b7881de366f req-e10f448d-ed2d-4aa0-88cc-613814ab81d8 service nova] [instance: 9bcd05e7-481c-4ee9-953d-2873e6aa849d] Received event network-vif-plugged-7363cfca-de5d-4f2f-b467-752de544bc21 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:47:37 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-f93881d3-2b50-4b02-974e-2b7881de366f req-e10f448d-ed2d-4aa0-88cc-613814ab81d8 service nova] Acquiring lock "9bcd05e7-481c-4ee9-953d-2873e6aa849d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:47:37 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-f93881d3-2b50-4b02-974e-2b7881de366f req-e10f448d-ed2d-4aa0-88cc-613814ab81d8 service nova] Lock "9bcd05e7-481c-4ee9-953d-2873e6aa849d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:47:37 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-f93881d3-2b50-4b02-974e-2b7881de366f req-e10f448d-ed2d-4aa0-88cc-613814ab81d8 service nova] Lock "9bcd05e7-481c-4ee9-953d-2873e6aa849d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:47:37 user nova-compute[75229]: DEBUG nova.compute.manager [req-f93881d3-2b50-4b02-974e-2b7881de366f req-e10f448d-ed2d-4aa0-88cc-613814ab81d8 service nova] [instance: 9bcd05e7-481c-4ee9-953d-2873e6aa849d] No waiting events found dispatching network-vif-plugged-7363cfca-de5d-4f2f-b467-752de544bc21 {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 09:47:37 user nova-compute[75229]: WARNING nova.compute.manager [req-f93881d3-2b50-4b02-974e-2b7881de366f req-e10f448d-ed2d-4aa0-88cc-613814ab81d8 service nova] [instance: 9bcd05e7-481c-4ee9-953d-2873e6aa849d] Received unexpected event network-vif-plugged-7363cfca-de5d-4f2f-b467-752de544bc21 for instance with vm_state building and task_state spawning.
Nov 14 09:47:37 user nova-compute[75229]: DEBUG nova.compute.manager [req-f93881d3-2b50-4b02-974e-2b7881de366f req-e10f448d-ed2d-4aa0-88cc-613814ab81d8 service nova] [instance: 9bcd05e7-481c-4ee9-953d-2873e6aa849d] Received event network-vif-plugged-1766a369-08d0-4fc1-b0b3-fc8e3c6a051f {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:47:37 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-f93881d3-2b50-4b02-974e-2b7881de366f req-e10f448d-ed2d-4aa0-88cc-613814ab81d8 service nova] Acquiring lock "9bcd05e7-481c-4ee9-953d-2873e6aa849d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:47:37 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-f93881d3-2b50-4b02-974e-2b7881de366f req-e10f448d-ed2d-4aa0-88cc-613814ab81d8 service nova] Lock "9bcd05e7-481c-4ee9-953d-2873e6aa849d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:47:37 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-f93881d3-2b50-4b02-974e-2b7881de366f req-e10f448d-ed2d-4aa0-88cc-613814ab81d8 service nova] Lock "9bcd05e7-481c-4ee9-953d-2873e6aa849d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:47:37 user nova-compute[75229]: DEBUG nova.compute.manager [req-f93881d3-2b50-4b02-974e-2b7881de366f req-e10f448d-ed2d-4aa0-88cc-613814ab81d8 service nova] [instance: 9bcd05e7-481c-4ee9-953d-2873e6aa849d] No waiting events found dispatching network-vif-plugged-1766a369-08d0-4fc1-b0b3-fc8e3c6a051f {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 09:47:37 user nova-compute[75229]: WARNING nova.compute.manager [req-f93881d3-2b50-4b02-974e-2b7881de366f req-e10f448d-ed2d-4aa0-88cc-613814ab81d8 service nova] [instance: 9bcd05e7-481c-4ee9-953d-2873e6aa849d] Received unexpected event network-vif-plugged-1766a369-08d0-4fc1-b0b3-fc8e3c6a051f for instance with vm_state building and task_state spawning.
Nov 14 09:47:37 user nova-compute[75229]: INFO nova.virt.block_device [None req-65cb7584-889d-4d19-9969-57c66dc18090 tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] [instance: 90bd76df-96cb-4bec-9862-853d94cdbaab] Booting with volume 5b54e594-ae66-4ba2-9bda-aa4431d31c3f at /dev/vdc
Nov 14 09:47:37 user nova-compute[75229]: DEBUG os_brick.utils [None req-65cb7584-889d-4d19-9969-57c66dc18090 tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 09:47:37 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:47:37 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:47:37 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[64f6420c-d305-44c3-96e4-8986a9bbd7b4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f1154031c835\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:47:37 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:47:37 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:47:37 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:47:37 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b8e4e1c-34f8-4906-99c8-8c0f9c1a2a81]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:47:37 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:47:37 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:47:37 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb3b2a03-7fcb-46c7-8786-321a892881b5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:47:37 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[d827e43f-164d-4c76-90b6-10f9d438d4a3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:47:37 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-65cb7584-889d-4d19-9969-57c66dc18090 tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Running cmd (subprocess): nvme version {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:47:37 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-65cb7584-889d-4d19-9969-57c66dc18090 tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] 'nvme version' failed. Not Retrying. {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 09:47:37 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:47:37 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.nvmeof [None req-65cb7584-889d-4d19-9969-57c66dc18090 tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] nvme not present on system {{(pid=75229) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 09:47:37 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:47:37 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 09:47:37 user nova-compute[75229]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 09:47:37 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[209577c4-7bf3-4eb5-a482-f0ea7bffcf50]: (4, '') {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:47:37 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.lightos [None req-65cb7584-889d-4d19-9969-57c66dc18090 tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75229) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 09:47:37 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.lightos [None req-65cb7584-889d-4d19-9969-57c66dc18090 tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75229) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 09:47:37 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.lightos [None req-65cb7584-889d-4d19-9969-57c66dc18090 tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] LIGHTOS: no hostnqn found. {{(pid=75229) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 09:47:37 user nova-compute[75229]: DEBUG os_brick.utils [None req-65cb7584-889d-4d19-9969-57c66dc18090 tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] <== get_connector_properties: return (178ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f1154031c835', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 09:47:37 user nova-compute[75229]: DEBUG nova.virt.block_device [None req-65cb7584-889d-4d19-9969-57c66dc18090 tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] [instance: 90bd76df-96cb-4bec-9862-853d94cdbaab] Updating existing volume attachment record: 6395e1ce-39ce-4b81-a075-19bcc25ce3f4 {{(pid=75229) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 09:47:38 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:47:38 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:47:38 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:47:38 user nova-compute[75229]: DEBUG nova.compute.manager [req-ec46d4a4-74f4-4913-b7b5-4bd61ba498e6 req-8d594d5e-6f50-489f-aa5b-4b6602a8b506 service nova] [instance: 9bcd05e7-481c-4ee9-953d-2873e6aa849d] Received event network-vif-plugged-db5f7129-8708-4f26-9975-c462270d47f3 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:47:38 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-ec46d4a4-74f4-4913-b7b5-4bd61ba498e6 req-8d594d5e-6f50-489f-aa5b-4b6602a8b506 service nova] Acquiring lock "9bcd05e7-481c-4ee9-953d-2873e6aa849d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:47:38 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-ec46d4a4-74f4-4913-b7b5-4bd61ba498e6 req-8d594d5e-6f50-489f-aa5b-4b6602a8b506 service nova] Lock "9bcd05e7-481c-4ee9-953d-2873e6aa849d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:47:38 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-ec46d4a4-74f4-4913-b7b5-4bd61ba498e6 req-8d594d5e-6f50-489f-aa5b-4b6602a8b506 service nova] Lock "9bcd05e7-481c-4ee9-953d-2873e6aa849d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:47:38 user nova-compute[75229]: DEBUG nova.compute.manager [req-ec46d4a4-74f4-4913-b7b5-4bd61ba498e6 req-8d594d5e-6f50-489f-aa5b-4b6602a8b506 service nova] [instance: 9bcd05e7-481c-4ee9-953d-2873e6aa849d] No waiting events found dispatching network-vif-plugged-db5f7129-8708-4f26-9975-c462270d47f3 {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 09:47:38 user nova-compute[75229]: WARNING nova.compute.manager [req-ec46d4a4-74f4-4913-b7b5-4bd61ba498e6 req-8d594d5e-6f50-489f-aa5b-4b6602a8b506 service nova] [instance: 9bcd05e7-481c-4ee9-953d-2873e6aa849d] Received unexpected event network-vif-plugged-db5f7129-8708-4f26-9975-c462270d47f3 for instance with vm_state building and task_state spawning.
Nov 14 09:47:38 user nova-compute[75229]: DEBUG nova.compute.manager [req-ae6f2e1f-f3d8-4019-991c-d99d6ff140c6 req-09a2f375-275a-43a3-a8a1-e24fef072ccf service nova] [instance: 9bcd05e7-481c-4ee9-953d-2873e6aa849d] Received event network-vif-plugged-ddcf0922-99ea-4e9f-8fe3-61df68231a99 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:47:38 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-ae6f2e1f-f3d8-4019-991c-d99d6ff140c6 req-09a2f375-275a-43a3-a8a1-e24fef072ccf service nova] Acquiring lock "9bcd05e7-481c-4ee9-953d-2873e6aa849d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:47:38 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-ae6f2e1f-f3d8-4019-991c-d99d6ff140c6 req-09a2f375-275a-43a3-a8a1-e24fef072ccf service nova] Lock "9bcd05e7-481c-4ee9-953d-2873e6aa849d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:47:38 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-ae6f2e1f-f3d8-4019-991c-d99d6ff140c6 req-09a2f375-275a-43a3-a8a1-e24fef072ccf service nova] Lock "9bcd05e7-481c-4ee9-953d-2873e6aa849d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:47:38 user nova-compute[75229]: DEBUG nova.compute.manager [req-ae6f2e1f-f3d8-4019-991c-d99d6ff140c6 req-09a2f375-275a-43a3-a8a1-e24fef072ccf service nova] [instance: 9bcd05e7-481c-4ee9-953d-2873e6aa849d] No waiting events found dispatching network-vif-plugged-ddcf0922-99ea-4e9f-8fe3-61df68231a99 {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 09:47:38 user nova-compute[75229]: WARNING nova.compute.manager [req-ae6f2e1f-f3d8-4019-991c-d99d6ff140c6 req-09a2f375-275a-43a3-a8a1-e24fef072ccf service nova] [instance: 9bcd05e7-481c-4ee9-953d-2873e6aa849d] Received unexpected event network-vif-plugged-ddcf0922-99ea-4e9f-8fe3-61df68231a99 for instance with vm_state building and task_state spawning.
Nov 14 09:47:38 user nova-compute[75229]: DEBUG nova.compute.manager [req-ae6f2e1f-f3d8-4019-991c-d99d6ff140c6 req-09a2f375-275a-43a3-a8a1-e24fef072ccf service nova] [instance: 9bcd05e7-481c-4ee9-953d-2873e6aa849d] Received event network-vif-plugged-fccc2ab0-7340-4ab5-be12-dd7b08c0cc72 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:47:38 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-ae6f2e1f-f3d8-4019-991c-d99d6ff140c6 req-09a2f375-275a-43a3-a8a1-e24fef072ccf service nova] Acquiring lock "9bcd05e7-481c-4ee9-953d-2873e6aa849d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:47:38 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-ae6f2e1f-f3d8-4019-991c-d99d6ff140c6 req-09a2f375-275a-43a3-a8a1-e24fef072ccf service nova] Lock "9bcd05e7-481c-4ee9-953d-2873e6aa849d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:47:38 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-ae6f2e1f-f3d8-4019-991c-d99d6ff140c6 req-09a2f375-275a-43a3-a8a1-e24fef072ccf service nova] Lock "9bcd05e7-481c-4ee9-953d-2873e6aa849d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:47:38 user nova-compute[75229]: DEBUG nova.compute.manager [req-ae6f2e1f-f3d8-4019-991c-d99d6ff140c6 req-09a2f375-275a-43a3-a8a1-e24fef072ccf service nova] [instance: 9bcd05e7-481c-4ee9-953d-2873e6aa849d] No waiting events found dispatching network-vif-plugged-fccc2ab0-7340-4ab5-be12-dd7b08c0cc72 {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 09:47:38 user nova-compute[75229]: WARNING nova.compute.manager [req-ae6f2e1f-f3d8-4019-991c-d99d6ff140c6 req-09a2f375-275a-43a3-a8a1-e24fef072ccf service nova] [instance: 9bcd05e7-481c-4ee9-953d-2873e6aa849d] Received unexpected event network-vif-plugged-fccc2ab0-7340-4ab5-be12-dd7b08c0cc72 for instance with vm_state building and task_state spawning.
Nov 14 09:47:38 user nova-compute[75229]: DEBUG nova.compute.manager [req-ae6f2e1f-f3d8-4019-991c-d99d6ff140c6 req-09a2f375-275a-43a3-a8a1-e24fef072ccf service nova] [instance: 9bcd05e7-481c-4ee9-953d-2873e6aa849d] Received event network-vif-plugged-fccc2ab0-7340-4ab5-be12-dd7b08c0cc72 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:47:38 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-ae6f2e1f-f3d8-4019-991c-d99d6ff140c6 req-09a2f375-275a-43a3-a8a1-e24fef072ccf service nova] Acquiring lock "9bcd05e7-481c-4ee9-953d-2873e6aa849d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:47:38 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-ae6f2e1f-f3d8-4019-991c-d99d6ff140c6 req-09a2f375-275a-43a3-a8a1-e24fef072ccf service nova] Lock "9bcd05e7-481c-4ee9-953d-2873e6aa849d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:47:38 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-ae6f2e1f-f3d8-4019-991c-d99d6ff140c6 req-09a2f375-275a-43a3-a8a1-e24fef072ccf service nova] Lock "9bcd05e7-481c-4ee9-953d-2873e6aa849d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:47:38 user nova-compute[75229]: DEBUG nova.compute.manager [req-ae6f2e1f-f3d8-4019-991c-d99d6ff140c6 req-09a2f375-275a-43a3-a8a1-e24fef072ccf service nova] [instance: 9bcd05e7-481c-4ee9-953d-2873e6aa849d] No waiting events found dispatching network-vif-plugged-fccc2ab0-7340-4ab5-be12-dd7b08c0cc72 {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 09:47:38 user nova-compute[75229]: WARNING nova.compute.manager [req-ae6f2e1f-f3d8-4019-991c-d99d6ff140c6 req-09a2f375-275a-43a3-a8a1-e24fef072ccf service nova] [instance: 9bcd05e7-481c-4ee9-953d-2873e6aa849d] Received unexpected event network-vif-plugged-fccc2ab0-7340-4ab5-be12-dd7b08c0cc72 for instance with vm_state building and task_state spawning.
Nov 14 09:47:38 user nova-compute[75229]: DEBUG nova.compute.manager [req-ae6f2e1f-f3d8-4019-991c-d99d6ff140c6 req-09a2f375-275a-43a3-a8a1-e24fef072ccf service nova] [instance: 9bcd05e7-481c-4ee9-953d-2873e6aa849d] Received event network-vif-plugged-94fc3f23-6f54-4e7c-815d-bf0c53245856 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:47:38 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-ae6f2e1f-f3d8-4019-991c-d99d6ff140c6 req-09a2f375-275a-43a3-a8a1-e24fef072ccf service nova] Acquiring lock "9bcd05e7-481c-4ee9-953d-2873e6aa849d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:47:38 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-ae6f2e1f-f3d8-4019-991c-d99d6ff140c6 req-09a2f375-275a-43a3-a8a1-e24fef072ccf service nova] Lock "9bcd05e7-481c-4ee9-953d-2873e6aa849d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:47:38 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-ae6f2e1f-f3d8-4019-991c-d99d6ff140c6 req-09a2f375-275a-43a3-a8a1-e24fef072ccf service nova] Lock "9bcd05e7-481c-4ee9-953d-2873e6aa849d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:47:38 user nova-compute[75229]: DEBUG nova.compute.manager [req-ae6f2e1f-f3d8-4019-991c-d99d6ff140c6 req-09a2f375-275a-43a3-a8a1-e24fef072ccf service nova] [instance: 9bcd05e7-481c-4ee9-953d-2873e6aa849d] No waiting events found dispatching network-vif-plugged-94fc3f23-6f54-4e7c-815d-bf0c53245856 {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 09:47:38 user nova-compute[75229]: WARNING nova.compute.manager [req-ae6f2e1f-f3d8-4019-991c-d99d6ff140c6 req-09a2f375-275a-43a3-a8a1-e24fef072ccf service nova] [instance: 9bcd05e7-481c-4ee9-953d-2873e6aa849d] Received unexpected event network-vif-plugged-94fc3f23-6f54-4e7c-815d-bf0c53245856 for instance with vm_state building and task_state spawning.
Nov 14 09:47:38 user nova-compute[75229]: DEBUG nova.compute.manager [req-ae6f2e1f-f3d8-4019-991c-d99d6ff140c6 req-09a2f375-275a-43a3-a8a1-e24fef072ccf service nova] [instance: 9bcd05e7-481c-4ee9-953d-2873e6aa849d] Received event network-vif-plugged-94fc3f23-6f54-4e7c-815d-bf0c53245856 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:47:38 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-ae6f2e1f-f3d8-4019-991c-d99d6ff140c6 req-09a2f375-275a-43a3-a8a1-e24fef072ccf service nova] Acquiring lock "9bcd05e7-481c-4ee9-953d-2873e6aa849d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:47:38 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-ae6f2e1f-f3d8-4019-991c-d99d6ff140c6 req-09a2f375-275a-43a3-a8a1-e24fef072ccf service nova] Lock "9bcd05e7-481c-4ee9-953d-2873e6aa849d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:47:38 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-ae6f2e1f-f3d8-4019-991c-d99d6ff140c6 req-09a2f375-275a-43a3-a8a1-e24fef072ccf service nova] Lock "9bcd05e7-481c-4ee9-953d-2873e6aa849d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:47:38 user nova-compute[75229]: DEBUG nova.compute.manager [req-ae6f2e1f-f3d8-4019-991c-d99d6ff140c6 req-09a2f375-275a-43a3-a8a1-e24fef072ccf service nova] [instance: 9bcd05e7-481c-4ee9-953d-2873e6aa849d] No waiting events found dispatching network-vif-plugged-94fc3f23-6f54-4e7c-815d-bf0c53245856 {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 09:47:38 user nova-compute[75229]: WARNING nova.compute.manager [req-ae6f2e1f-f3d8-4019-991c-d99d6ff140c6 req-09a2f375-275a-43a3-a8a1-e24fef072ccf service nova] [instance: 9bcd05e7-481c-4ee9-953d-2873e6aa849d] Received unexpected event network-vif-plugged-94fc3f23-6f54-4e7c-815d-bf0c53245856 for instance with vm_state building and task_state spawning.
Nov 14 09:47:38 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:47:38 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:47:38 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:47:38 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:47:39 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-27be1b8a-18f6-41f5-9d25-44c0efd3d3cc tempest-TaggedAttachmentsTest-294727221 tempest-TaggedAttachmentsTest-294727221-project-member] Acquiring lock "c6fa2298-7111-4660-a162-09269045d5e3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:47:39 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-27be1b8a-18f6-41f5-9d25-44c0efd3d3cc tempest-TaggedAttachmentsTest-294727221 tempest-TaggedAttachmentsTest-294727221-project-member] Lock "c6fa2298-7111-4660-a162-09269045d5e3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:47:39 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-27be1b8a-18f6-41f5-9d25-44c0efd3d3cc tempest-TaggedAttachmentsTest-294727221 tempest-TaggedAttachmentsTest-294727221-project-member] Acquiring lock "c6fa2298-7111-4660-a162-09269045d5e3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:47:39 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-27be1b8a-18f6-41f5-9d25-44c0efd3d3cc tempest-TaggedAttachmentsTest-294727221 tempest-TaggedAttachmentsTest-294727221-project-member] Lock "c6fa2298-7111-4660-a162-09269045d5e3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:47:39 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-27be1b8a-18f6-41f5-9d25-44c0efd3d3cc tempest-TaggedAttachmentsTest-294727221 tempest-TaggedAttachmentsTest-294727221-project-member] Lock "c6fa2298-7111-4660-a162-09269045d5e3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:47:39 user nova-compute[75229]: INFO nova.compute.manager [None req-27be1b8a-18f6-41f5-9d25-44c0efd3d3cc tempest-TaggedAttachmentsTest-294727221 tempest-TaggedAttachmentsTest-294727221-project-member] [instance: c6fa2298-7111-4660-a162-09269045d5e3] Terminating instance
Nov 14 09:47:39 user nova-compute[75229]: DEBUG nova.compute.manager [None req-27be1b8a-18f6-41f5-9d25-44c0efd3d3cc tempest-TaggedAttachmentsTest-294727221 tempest-TaggedAttachmentsTest-294727221-project-member] [instance: c6fa2298-7111-4660-a162-09269045d5e3] Start destroying the instance on the hypervisor. {{(pid=75229) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 09:47:39 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:47:39 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:47:39 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:47:39 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:47:39 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:47:39 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:47:39 user nova-compute[75229]: DEBUG nova.compute.manager [req-708ee832-8e2f-42e6-9051-28001e6423cc req-1391e439-960d-4881-b560-23bde26d2152 service nova] [instance: 9bcd05e7-481c-4ee9-953d-2873e6aa849d] Received event network-vif-plugged-1766a369-08d0-4fc1-b0b3-fc8e3c6a051f {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:47:39 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-708ee832-8e2f-42e6-9051-28001e6423cc req-1391e439-960d-4881-b560-23bde26d2152 service nova] Acquiring lock "9bcd05e7-481c-4ee9-953d-2873e6aa849d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:47:39 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-708ee832-8e2f-42e6-9051-28001e6423cc req-1391e439-960d-4881-b560-23bde26d2152 service nova] Lock "9bcd05e7-481c-4ee9-953d-2873e6aa849d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:47:39 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-708ee832-8e2f-42e6-9051-28001e6423cc req-1391e439-960d-4881-b560-23bde26d2152 service nova] Lock "9bcd05e7-481c-4ee9-953d-2873e6aa849d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.003s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:47:39 user nova-compute[75229]: DEBUG nova.compute.manager [req-708ee832-8e2f-42e6-9051-28001e6423cc req-1391e439-960d-4881-b560-23bde26d2152 service nova] [instance: 9bcd05e7-481c-4ee9-953d-2873e6aa849d] No waiting events found dispatching network-vif-plugged-1766a369-08d0-4fc1-b0b3-fc8e3c6a051f {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 09:47:39 user nova-compute[75229]: WARNING nova.compute.manager [req-708ee832-8e2f-42e6-9051-28001e6423cc req-1391e439-960d-4881-b560-23bde26d2152 service nova] [instance: 9bcd05e7-481c-4ee9-953d-2873e6aa849d] Received unexpected event network-vif-plugged-1766a369-08d0-4fc1-b0b3-fc8e3c6a051f for instance with vm_state building and task_state spawning.
Nov 14 09:47:39 user nova-compute[75229]: DEBUG nova.compute.manager [req-708ee832-8e2f-42e6-9051-28001e6423cc req-1391e439-960d-4881-b560-23bde26d2152 service nova] [instance: c6fa2298-7111-4660-a162-09269045d5e3] Received event network-vif-unplugged-b310b3f2-f842-4918-8540-f9803e259b31 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:47:39 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-708ee832-8e2f-42e6-9051-28001e6423cc req-1391e439-960d-4881-b560-23bde26d2152 service nova] Acquiring lock "c6fa2298-7111-4660-a162-09269045d5e3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:47:39 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-708ee832-8e2f-42e6-9051-28001e6423cc req-1391e439-960d-4881-b560-23bde26d2152 service nova] Lock "c6fa2298-7111-4660-a162-09269045d5e3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:47:39 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-708ee832-8e2f-42e6-9051-28001e6423cc req-1391e439-960d-4881-b560-23bde26d2152 service nova] Lock "c6fa2298-7111-4660-a162-09269045d5e3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:47:39 user nova-compute[75229]: DEBUG nova.compute.manager [req-708ee832-8e2f-42e6-9051-28001e6423cc req-1391e439-960d-4881-b560-23bde26d2152 service nova] [instance: c6fa2298-7111-4660-a162-09269045d5e3] No waiting events found dispatching network-vif-unplugged-b310b3f2-f842-4918-8540-f9803e259b31 {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 09:47:39 user nova-compute[75229]: DEBUG nova.compute.manager [req-708ee832-8e2f-42e6-9051-28001e6423cc req-1391e439-960d-4881-b560-23bde26d2152 service nova] [instance: c6fa2298-7111-4660-a162-09269045d5e3] Received event network-vif-unplugged-b310b3f2-f842-4918-8540-f9803e259b31 for instance with task_state deleting. {{(pid=75229) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 09:47:39 user nova-compute[75229]: DEBUG nova.compute.manager [None req-4b32d31a-8a07-4ad8-94d2-11d60dde24da tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] [instance: 9bcd05e7-481c-4ee9-953d-2873e6aa849d] Instance event wait completed in 0 seconds for  {{(pid=75229) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 09:47:39 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-4b32d31a-8a07-4ad8-94d2-11d60dde24da tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] [instance: 9bcd05e7-481c-4ee9-953d-2873e6aa849d] Guest created on hypervisor {{(pid=75229) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 09:47:39 user nova-compute[75229]: INFO nova.virt.libvirt.driver [-] [instance: 9bcd05e7-481c-4ee9-953d-2873e6aa849d] Instance spawned successfully.
Nov 14 09:47:39 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-4b32d31a-8a07-4ad8-94d2-11d60dde24da tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] [instance: 9bcd05e7-481c-4ee9-953d-2873e6aa849d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 09:47:39 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-4b32d31a-8a07-4ad8-94d2-11d60dde24da tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] [instance: 9bcd05e7-481c-4ee9-953d-2873e6aa849d] Found default for hw_cdrom_bus of ide {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 09:47:39 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-4b32d31a-8a07-4ad8-94d2-11d60dde24da tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] [instance: 9bcd05e7-481c-4ee9-953d-2873e6aa849d] Found default for hw_disk_bus of virtio {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 09:47:39 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-4b32d31a-8a07-4ad8-94d2-11d60dde24da tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] [instance: 9bcd05e7-481c-4ee9-953d-2873e6aa849d] Found default for hw_input_bus of None {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 09:47:39 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-4b32d31a-8a07-4ad8-94d2-11d60dde24da tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] [instance: 9bcd05e7-481c-4ee9-953d-2873e6aa849d] Found default for hw_pointer_model of None {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 09:47:39 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-4b32d31a-8a07-4ad8-94d2-11d60dde24da tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] [instance: 9bcd05e7-481c-4ee9-953d-2873e6aa849d] Found default for hw_video_model of virtio {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 09:47:39 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-4b32d31a-8a07-4ad8-94d2-11d60dde24da tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] [instance: 9bcd05e7-481c-4ee9-953d-2873e6aa849d] Found default for hw_vif_model of virtio {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 09:47:39 user nova-compute[75229]: INFO nova.virt.libvirt.driver [-] [instance: c6fa2298-7111-4660-a162-09269045d5e3] Instance destroyed successfully.
Nov 14 09:47:39 user nova-compute[75229]: DEBUG nova.objects.instance [None req-27be1b8a-18f6-41f5-9d25-44c0efd3d3cc tempest-TaggedAttachmentsTest-294727221 tempest-TaggedAttachmentsTest-294727221-project-member] Lazy-loading 'resources' on Instance uuid c6fa2298-7111-4660-a162-09269045d5e3 {{(pid=75229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 09:47:39 user nova-compute[75229]: DEBUG nova.virt.libvirt.vif [None req-27be1b8a-18f6-41f5-9d25-44c0efd3d3cc tempest-TaggedAttachmentsTest-294727221 tempest-TaggedAttachmentsTest-294727221-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T09:44:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-685697079',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-685697079',id=8,image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAifCLOp7slCaJ90vuibP3D+iXI5GZCQPZCKwFW7R+vCvd5TEqQRxmD+LKPc4egtvjclTc91I+Ts0vc0Y63gnivit1SN7n4OIcVVjbAdupwqjax2fqD52aMGKY+5S2775A==',key_name='tempest-keypair-1995790410',keypairs=<?>,launch_index=0,launched_at=2023-11-14T09:44:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='48b5edeee7494b6e94135faaab6afd50',ramdisk_id='',reservation_id='r-xsfhi8mn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-294727221',owner_user_name='tempest-TaggedAttachmentsTest-294727221-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T09:44:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3c818850ce5c41b5b978031cdedfea65',uuid=c6fa2298-7111-4660-a162-09269045d5e3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b310b3f2-f842-4918-8540-f9803e259b31", "address": "fa:16:3e:90:0c:ec", "network": {"id": "35508221-011f-4deb-81a1-6dfdae3f2375", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-827518066-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.156", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48b5edeee7494b6e94135faaab6afd50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb310b3f2-f8", "ovs_interfaceid": "b310b3f2-f842-4918-8540-f9803e259b31", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 09:47:39 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-27be1b8a-18f6-41f5-9d25-44c0efd3d3cc tempest-TaggedAttachmentsTest-294727221 tempest-TaggedAttachmentsTest-294727221-project-member] Converting VIF {"id": "b310b3f2-f842-4918-8540-f9803e259b31", "address": "fa:16:3e:90:0c:ec", "network": {"id": "35508221-011f-4deb-81a1-6dfdae3f2375", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-827518066-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.156", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48b5edeee7494b6e94135faaab6afd50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb310b3f2-f8", "ovs_interfaceid": "b310b3f2-f842-4918-8540-f9803e259b31", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 09:47:39 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-27be1b8a-18f6-41f5-9d25-44c0efd3d3cc tempest-TaggedAttachmentsTest-294727221 tempest-TaggedAttachmentsTest-294727221-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:90:0c:ec,bridge_name='br-int',has_traffic_filtering=True,id=b310b3f2-f842-4918-8540-f9803e259b31,network=Network(35508221-011f-4deb-81a1-6dfdae3f2375),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb310b3f2-f8') {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 09:47:39 user nova-compute[75229]: DEBUG os_vif [None req-27be1b8a-18f6-41f5-9d25-44c0efd3d3cc tempest-TaggedAttachmentsTest-294727221 tempest-TaggedAttachmentsTest-294727221-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:90:0c:ec,bridge_name='br-int',has_traffic_filtering=True,id=b310b3f2-f842-4918-8540-f9803e259b31,network=Network(35508221-011f-4deb-81a1-6dfdae3f2375),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb310b3f2-f8') {{(pid=75229) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 09:47:39 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:47:39 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb310b3f2-f8, bridge=br-int, if_exists=True) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:47:39 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:47:39 user nova-compute[75229]: INFO nova.compute.manager [None req-4b32d31a-8a07-4ad8-94d2-11d60dde24da tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] [instance: 9bcd05e7-481c-4ee9-953d-2873e6aa849d] Took 11.78 seconds to spawn the instance on the hypervisor.
Nov 14 09:47:39 user nova-compute[75229]: DEBUG nova.compute.manager [None req-4b32d31a-8a07-4ad8-94d2-11d60dde24da tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] [instance: 9bcd05e7-481c-4ee9-953d-2873e6aa849d] Checking state {{(pid=75229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 09:47:39 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 09:47:39 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:47:39 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3b8c85a3-d9d4-441c-b83e-26e98bd65996) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:47:40 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:47:40 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 09:47:40 user nova-compute[75229]: INFO os_vif [None req-27be1b8a-18f6-41f5-9d25-44c0efd3d3cc tempest-TaggedAttachmentsTest-294727221 tempest-TaggedAttachmentsTest-294727221-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:90:0c:ec,bridge_name='br-int',has_traffic_filtering=True,id=b310b3f2-f842-4918-8540-f9803e259b31,network=Network(35508221-011f-4deb-81a1-6dfdae3f2375),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb310b3f2-f8')
Nov 14 09:47:40 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-27be1b8a-18f6-41f5-9d25-44c0efd3d3cc tempest-TaggedAttachmentsTest-294727221 tempest-TaggedAttachmentsTest-294727221-project-member] [instance: c6fa2298-7111-4660-a162-09269045d5e3] Deleting instance files /opt/stack/data/nova/instances/c6fa2298-7111-4660-a162-09269045d5e3_del
Nov 14 09:47:40 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-27be1b8a-18f6-41f5-9d25-44c0efd3d3cc tempest-TaggedAttachmentsTest-294727221 tempest-TaggedAttachmentsTest-294727221-project-member] [instance: c6fa2298-7111-4660-a162-09269045d5e3] Deletion of /opt/stack/data/nova/instances/c6fa2298-7111-4660-a162-09269045d5e3_del complete
Nov 14 09:47:40 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-79ab6320-9154-4531-b273-2c0b172feae1 tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] Acquiring lock "e09b3809-2e23-401c-9a72-88feb2bb657c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:47:40 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-79ab6320-9154-4531-b273-2c0b172feae1 tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] Lock "e09b3809-2e23-401c-9a72-88feb2bb657c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:47:40 user nova-compute[75229]: INFO nova.compute.manager [None req-27be1b8a-18f6-41f5-9d25-44c0efd3d3cc tempest-TaggedAttachmentsTest-294727221 tempest-TaggedAttachmentsTest-294727221-project-member] [instance: c6fa2298-7111-4660-a162-09269045d5e3] Took 1.03 seconds to destroy the instance on the hypervisor.
Nov 14 09:47:40 user nova-compute[75229]: DEBUG oslo.service.loopingcall [None req-27be1b8a-18f6-41f5-9d25-44c0efd3d3cc tempest-TaggedAttachmentsTest-294727221 tempest-TaggedAttachmentsTest-294727221-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75229) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 09:47:40 user nova-compute[75229]: DEBUG nova.compute.manager [-] [instance: c6fa2298-7111-4660-a162-09269045d5e3] Deallocating network for instance {{(pid=75229) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 09:47:40 user nova-compute[75229]: DEBUG nova.network.neutron [-] [instance: c6fa2298-7111-4660-a162-09269045d5e3] deallocate_for_instance() {{(pid=75229) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 09:47:40 user nova-compute[75229]: DEBUG nova.objects.instance [None req-79ab6320-9154-4531-b273-2c0b172feae1 tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] Lazy-loading 'flavor' on Instance uuid e09b3809-2e23-401c-9a72-88feb2bb657c {{(pid=75229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 09:47:40 user nova-compute[75229]: INFO nova.compute.manager [None req-4b32d31a-8a07-4ad8-94d2-11d60dde24da tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] [instance: 9bcd05e7-481c-4ee9-953d-2873e6aa849d] Took 27.13 seconds to build instance.
Nov 14 09:47:40 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-4b32d31a-8a07-4ad8-94d2-11d60dde24da tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] Lock "9bcd05e7-481c-4ee9-953d-2873e6aa849d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 27.241s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:47:40 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-79ab6320-9154-4531-b273-2c0b172feae1 tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] Lock "e09b3809-2e23-401c-9a72-88feb2bb657c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.075s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:47:40 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-79ab6320-9154-4531-b273-2c0b172feae1 tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] Acquiring lock "e09b3809-2e23-401c-9a72-88feb2bb657c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:47:40 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-79ab6320-9154-4531-b273-2c0b172feae1 tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] Lock "e09b3809-2e23-401c-9a72-88feb2bb657c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:47:40 user nova-compute[75229]: INFO nova.compute.manager [None req-79ab6320-9154-4531-b273-2c0b172feae1 tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] [instance: e09b3809-2e23-401c-9a72-88feb2bb657c] Attaching volume 3fed285f-9be4-4601-8cb5-4329d7ebed8c to /dev/vdb
Nov 14 09:47:40 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:47:40 user nova-compute[75229]: DEBUG os_brick.utils [None req-79ab6320-9154-4531-b273-2c0b172feae1 tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 09:47:40 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:47:40 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:47:40 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[a259b422-e95d-4089-9e2b-6188fca65d89]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f1154031c835\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:47:40 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:47:40 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.022s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:47:40 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[7479d23e-9bf2-49fe-b2a1-6286e5c981e0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:47:40 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:47:40 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:47:40 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[322e4658-6267-4df6-8be4-0103dce3c259]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:47:40 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2f45835-6a28-4a3c-9154-6ccfd28b9b7e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:47:40 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-79ab6320-9154-4531-b273-2c0b172feae1 tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] Running cmd (subprocess): nvme version {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:47:40 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-79ab6320-9154-4531-b273-2c0b172feae1 tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] 'nvme version' failed. Not Retrying. {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 09:47:40 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.nvmeof [None req-79ab6320-9154-4531-b273-2c0b172feae1 tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] nvme not present on system {{(pid=75229) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 09:47:40 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:47:40 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 09:47:40 user nova-compute[75229]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 09:47:40 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[4706987f-16d0-43a2-b7bc-7e76c9c8e9c8]: (4, '') {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:47:40 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.lightos [None req-79ab6320-9154-4531-b273-2c0b172feae1 tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75229) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 09:47:40 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.lightos [None req-79ab6320-9154-4531-b273-2c0b172feae1 tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75229) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 09:47:40 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.lightos [None req-79ab6320-9154-4531-b273-2c0b172feae1 tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] LIGHTOS: no hostnqn found. {{(pid=75229) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 09:47:40 user nova-compute[75229]: DEBUG os_brick.utils [None req-79ab6320-9154-4531-b273-2c0b172feae1 tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] <== get_connector_properties: return (139ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f1154031c835', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 09:47:40 user nova-compute[75229]: DEBUG nova.virt.block_device [None req-79ab6320-9154-4531-b273-2c0b172feae1 tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] [instance: e09b3809-2e23-401c-9a72-88feb2bb657c] Updating existing volume attachment record: 0d04eaa8-0e5a-4727-99aa-231f91717147 {{(pid=75229) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 09:47:41 user nova-compute[75229]: DEBUG nova.network.neutron [-] [instance: c6fa2298-7111-4660-a162-09269045d5e3] Updating instance_info_cache with network_info: [] {{(pid=75229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 09:47:41 user nova-compute[75229]: INFO nova.compute.manager [-] [instance: c6fa2298-7111-4660-a162-09269045d5e3] Took 1.58 seconds to deallocate network for instance.
Nov 14 09:47:41 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-27be1b8a-18f6-41f5-9d25-44c0efd3d3cc tempest-TaggedAttachmentsTest-294727221 tempest-TaggedAttachmentsTest-294727221-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:47:41 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-27be1b8a-18f6-41f5-9d25-44c0efd3d3cc tempest-TaggedAttachmentsTest-294727221 tempest-TaggedAttachmentsTest-294727221-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:47:41 user nova-compute[75229]: DEBUG nova.compute.manager [req-7595020a-43cd-4238-9aac-f9a3be4e90a7 req-1004b564-a33d-40a9-a3c6-c0e5e333e80d service nova] [instance: c6fa2298-7111-4660-a162-09269045d5e3] Received event network-vif-plugged-b310b3f2-f842-4918-8540-f9803e259b31 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:47:41 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-7595020a-43cd-4238-9aac-f9a3be4e90a7 req-1004b564-a33d-40a9-a3c6-c0e5e333e80d service nova] Acquiring lock "c6fa2298-7111-4660-a162-09269045d5e3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:47:41 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-7595020a-43cd-4238-9aac-f9a3be4e90a7 req-1004b564-a33d-40a9-a3c6-c0e5e333e80d service nova] Lock "c6fa2298-7111-4660-a162-09269045d5e3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:47:41 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-7595020a-43cd-4238-9aac-f9a3be4e90a7 req-1004b564-a33d-40a9-a3c6-c0e5e333e80d service nova] Lock "c6fa2298-7111-4660-a162-09269045d5e3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:47:41 user nova-compute[75229]: DEBUG nova.compute.manager [req-7595020a-43cd-4238-9aac-f9a3be4e90a7 req-1004b564-a33d-40a9-a3c6-c0e5e333e80d service nova] [instance: c6fa2298-7111-4660-a162-09269045d5e3] No waiting events found dispatching network-vif-plugged-b310b3f2-f842-4918-8540-f9803e259b31 {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 09:47:41 user nova-compute[75229]: WARNING nova.compute.manager [req-7595020a-43cd-4238-9aac-f9a3be4e90a7 req-1004b564-a33d-40a9-a3c6-c0e5e333e80d service nova] [instance: c6fa2298-7111-4660-a162-09269045d5e3] Received unexpected event network-vif-plugged-b310b3f2-f842-4918-8540-f9803e259b31 for instance with vm_state deleted and task_state None.
Nov 14 09:47:41 user nova-compute[75229]: DEBUG nova.compute.manager [req-7595020a-43cd-4238-9aac-f9a3be4e90a7 req-1004b564-a33d-40a9-a3c6-c0e5e333e80d service nova] [instance: c6fa2298-7111-4660-a162-09269045d5e3] Received event network-vif-deleted-b310b3f2-f842-4918-8540-f9803e259b31 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:47:42 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-177d3f3f-cfbe-4a04-b5d0-187062f7bfef tempest-TestVolumeSwap-528292061 tempest-TestVolumeSwap-528292061-project-member] Acquiring lock "c307660b-01bb-471b-9e2e-5c2aaca65287" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:47:42 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-177d3f3f-cfbe-4a04-b5d0-187062f7bfef tempest-TestVolumeSwap-528292061 tempest-TestVolumeSwap-528292061-project-member] Lock "c307660b-01bb-471b-9e2e-5c2aaca65287" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:47:42 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-177d3f3f-cfbe-4a04-b5d0-187062f7bfef tempest-TestVolumeSwap-528292061 tempest-TestVolumeSwap-528292061-project-member] Acquiring lock "c307660b-01bb-471b-9e2e-5c2aaca65287-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:47:42 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-177d3f3f-cfbe-4a04-b5d0-187062f7bfef tempest-TestVolumeSwap-528292061 tempest-TestVolumeSwap-528292061-project-member] Lock "c307660b-01bb-471b-9e2e-5c2aaca65287-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:47:42 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-177d3f3f-cfbe-4a04-b5d0-187062f7bfef tempest-TestVolumeSwap-528292061 tempest-TestVolumeSwap-528292061-project-member] Lock "c307660b-01bb-471b-9e2e-5c2aaca65287-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:47:42 user nova-compute[75229]: INFO nova.compute.manager [None req-177d3f3f-cfbe-4a04-b5d0-187062f7bfef tempest-TestVolumeSwap-528292061 tempest-TestVolumeSwap-528292061-project-member] [instance: c307660b-01bb-471b-9e2e-5c2aaca65287] Terminating instance
Nov 14 09:47:42 user nova-compute[75229]: DEBUG nova.compute.manager [None req-177d3f3f-cfbe-4a04-b5d0-187062f7bfef tempest-TestVolumeSwap-528292061 tempest-TestVolumeSwap-528292061-project-member] [instance: c307660b-01bb-471b-9e2e-5c2aaca65287] Start destroying the instance on the hypervisor. {{(pid=75229) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 09:47:42 user nova-compute[75229]: DEBUG nova.compute.provider_tree [None req-27be1b8a-18f6-41f5-9d25-44c0efd3d3cc tempest-TaggedAttachmentsTest-294727221 tempest-TaggedAttachmentsTest-294727221-project-member] Inventory has not changed in ProviderTree for provider: d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 {{(pid=75229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 09:47:42 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-d15de80e-a866-48cd-b4e5-6701ac3009c4 tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] Acquiring lock "a60d339f-e134-477c-8505-bf8c79d2a21c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:47:42 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-d15de80e-a866-48cd-b4e5-6701ac3009c4 tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] Lock "a60d339f-e134-477c-8505-bf8c79d2a21c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:47:42 user nova-compute[75229]: DEBUG nova.scheduler.client.report [None req-27be1b8a-18f6-41f5-9d25-44c0efd3d3cc tempest-TaggedAttachmentsTest-294727221 tempest-TaggedAttachmentsTest-294727221-project-member] Inventory has not changed for provider d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 09:47:42 user nova-compute[75229]: DEBUG nova.objects.instance [None req-d15de80e-a866-48cd-b4e5-6701ac3009c4 tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] Lazy-loading 'flavor' on Instance uuid a60d339f-e134-477c-8505-bf8c79d2a21c {{(pid=75229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 09:47:42 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-27be1b8a-18f6-41f5-9d25-44c0efd3d3cc tempest-TaggedAttachmentsTest-294727221 tempest-TaggedAttachmentsTest-294727221-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.527s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:47:42 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-d15de80e-a866-48cd-b4e5-6701ac3009c4 tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] Lock "a60d339f-e134-477c-8505-bf8c79d2a21c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.107s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:47:42 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:47:42 user nova-compute[75229]: INFO nova.scheduler.client.report [None req-27be1b8a-18f6-41f5-9d25-44c0efd3d3cc tempest-TaggedAttachmentsTest-294727221 tempest-TaggedAttachmentsTest-294727221-project-member] Deleted allocations for instance c6fa2298-7111-4660-a162-09269045d5e3
Nov 14 09:47:42 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:47:42 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:47:42 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:47:42 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-27be1b8a-18f6-41f5-9d25-44c0efd3d3cc tempest-TaggedAttachmentsTest-294727221 tempest-TaggedAttachmentsTest-294727221-project-member] Lock "c6fa2298-7111-4660-a162-09269045d5e3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.513s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:47:42 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-b300c569-d116-479c-b966-439bddf95408 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Acquiring lock "be813b28-133f-416a-b2b5-dc0b9e4064b7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:47:42 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-b300c569-d116-479c-b966-439bddf95408 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Lock "be813b28-133f-416a-b2b5-dc0b9e4064b7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:47:42 user nova-compute[75229]: DEBUG nova.compute.manager [None req-b300c569-d116-479c-b966-439bddf95408 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] [instance: be813b28-133f-416a-b2b5-dc0b9e4064b7] Starting instance... {{(pid=75229) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 09:47:42 user nova-compute[75229]: DEBUG nova.compute.manager [req-0b8b4f4c-27cc-42a1-8a6b-a5446ddc08cb req-fcf290a8-97d5-45bc-aaab-19f2e62a5cdc service nova] [instance: c307660b-01bb-471b-9e2e-5c2aaca65287] Received event network-vif-unplugged-8e8a8e12-6ca8-4657-a4d4-e11c02ee8fa4 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:47:42 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-0b8b4f4c-27cc-42a1-8a6b-a5446ddc08cb req-fcf290a8-97d5-45bc-aaab-19f2e62a5cdc service nova] Acquiring lock "c307660b-01bb-471b-9e2e-5c2aaca65287-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:47:42 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-0b8b4f4c-27cc-42a1-8a6b-a5446ddc08cb req-fcf290a8-97d5-45bc-aaab-19f2e62a5cdc service nova] Lock "c307660b-01bb-471b-9e2e-5c2aaca65287-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:47:42 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-0b8b4f4c-27cc-42a1-8a6b-a5446ddc08cb req-fcf290a8-97d5-45bc-aaab-19f2e62a5cdc service nova] Lock "c307660b-01bb-471b-9e2e-5c2aaca65287-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:47:42 user nova-compute[75229]: DEBUG nova.compute.manager [req-0b8b4f4c-27cc-42a1-8a6b-a5446ddc08cb req-fcf290a8-97d5-45bc-aaab-19f2e62a5cdc service nova] [instance: c307660b-01bb-471b-9e2e-5c2aaca65287] No waiting events found dispatching network-vif-unplugged-8e8a8e12-6ca8-4657-a4d4-e11c02ee8fa4 {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 09:47:42 user nova-compute[75229]: DEBUG nova.compute.manager [req-0b8b4f4c-27cc-42a1-8a6b-a5446ddc08cb req-fcf290a8-97d5-45bc-aaab-19f2e62a5cdc service nova] [instance: c307660b-01bb-471b-9e2e-5c2aaca65287] Received event network-vif-unplugged-8e8a8e12-6ca8-4657-a4d4-e11c02ee8fa4 for instance with task_state deleting. {{(pid=75229) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 09:47:42 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-d15de80e-a866-48cd-b4e5-6701ac3009c4 tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] Acquiring lock "a60d339f-e134-477c-8505-bf8c79d2a21c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:47:42 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-d15de80e-a866-48cd-b4e5-6701ac3009c4 tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] Lock "a60d339f-e134-477c-8505-bf8c79d2a21c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:47:42 user nova-compute[75229]: INFO nova.compute.manager [None req-d15de80e-a866-48cd-b4e5-6701ac3009c4 tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] [instance: a60d339f-e134-477c-8505-bf8c79d2a21c] Attaching volume aca09258-022b-4f04-b418-f2a170332755 to /dev/vdb
Nov 14 09:47:42 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:47:42 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-b300c569-d116-479c-b966-439bddf95408 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:47:42 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-b300c569-d116-479c-b966-439bddf95408 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:47:42 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-b300c569-d116-479c-b966-439bddf95408 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75229) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 09:47:42 user nova-compute[75229]: INFO nova.compute.claims [None req-b300c569-d116-479c-b966-439bddf95408 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] [instance: be813b28-133f-416a-b2b5-dc0b9e4064b7] Claim successful on node user
Nov 14 09:47:42 user nova-compute[75229]: DEBUG os_brick.utils [None req-d15de80e-a866-48cd-b4e5-6701ac3009c4 tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 09:47:42 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:47:42 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.044s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:47:42 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[f53aeb27-863d-4786-8a8f-4994d7f98a9e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f1154031c835\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:47:42 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:47:42 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.029s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:47:42 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[b421b00f-58b8-41a0-973d-eb021c10bfcf]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:47:42 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:47:42 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.026s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:47:42 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5b42d2f-1653-4cbf-aebc-27aafdf48b97]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:47:42 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8534d76-1a08-41b7-8e91-645c3f6406b0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:47:42 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-d15de80e-a866-48cd-b4e5-6701ac3009c4 tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] Running cmd (subprocess): nvme version {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:47:43 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-d15de80e-a866-48cd-b4e5-6701ac3009c4 tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] 'nvme version' failed. Not Retrying. {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 09:47:43 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d15de80e-a866-48cd-b4e5-6701ac3009c4 tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] nvme not present on system {{(pid=75229) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 09:47:43 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:47:43 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 09:47:43 user nova-compute[75229]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 09:47:43 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4cd9786-b901-4b3c-8d27-b75df6b44900]: (4, '') {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:47:43 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.lightos [None req-d15de80e-a866-48cd-b4e5-6701ac3009c4 tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75229) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 09:47:43 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.lightos [None req-d15de80e-a866-48cd-b4e5-6701ac3009c4 tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75229) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 09:47:43 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.lightos [None req-d15de80e-a866-48cd-b4e5-6701ac3009c4 tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] LIGHTOS: no hostnqn found. {{(pid=75229) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 09:47:43 user nova-compute[75229]: DEBUG os_brick.utils [None req-d15de80e-a866-48cd-b4e5-6701ac3009c4 tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] <== get_connector_properties: return (201ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f1154031c835', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 09:47:43 user nova-compute[75229]: DEBUG nova.virt.block_device [None req-d15de80e-a866-48cd-b4e5-6701ac3009c4 tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] [instance: a60d339f-e134-477c-8505-bf8c79d2a21c] Updating existing volume attachment record: da7cbe23-8aca-4b4a-a67f-01f5d3b5c920 {{(pid=75229) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 09:47:43 user nova-compute[75229]: INFO nova.virt.libvirt.driver [-] [instance: c307660b-01bb-471b-9e2e-5c2aaca65287] Instance destroyed successfully.
Nov 14 09:47:43 user nova-compute[75229]: DEBUG nova.objects.instance [None req-177d3f3f-cfbe-4a04-b5d0-187062f7bfef tempest-TestVolumeSwap-528292061 tempest-TestVolumeSwap-528292061-project-member] Lazy-loading 'resources' on Instance uuid c307660b-01bb-471b-9e2e-5c2aaca65287 {{(pid=75229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 09:47:43 user nova-compute[75229]: DEBUG nova.virt.libvirt.vif [None req-177d3f3f-cfbe-4a04-b5d0-187062f7bfef tempest-TestVolumeSwap-528292061 tempest-TestVolumeSwap-528292061-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T09:44:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-922373847',display_name='tempest-TestVolumeSwap-server-922373847',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-922373847',id=9,image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB4nmno/8vn6yUbaWONTOhE7HhEu/oAqhAQITD0rFD19FekSXmzmcXifzJfm87fHntyCq/tU6IvKtRjyyVXhIy4dynTYhLMv9bafP6InQdaFmN/FXxKp3qYDCGjklanfhg==',key_name='tempest-keypair-37868600',keypairs=<?>,launch_index=0,launched_at=2023-11-14T09:44:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6f5ecf574b4a4b8bb0747c796c16e3e8',ramdisk_id='',reservation_id='r-r4fvm4ux',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeSwap-528292061',owner_user_name='tempest-TestVolumeSwap-528292061-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T09:44:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ef184ea38ecc4d9abe88fb7f6f79a1f7',uuid=c307660b-01bb-471b-9e2e-5c2aaca65287,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8e8a8e12-6ca8-4657-a4d4-e11c02ee8fa4", "address": "fa:16:3e:db:5c:48", "network": {"id": "57a65455-9929-439e-85a0-07a7a36dbd60", "bridge": "br-int", "label": "tempest-TestVolumeSwap-718745600-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.55", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f5ecf574b4a4b8bb0747c796c16e3e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e8a8e12-6c", "ovs_interfaceid": "8e8a8e12-6ca8-4657-a4d4-e11c02ee8fa4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 09:47:43 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-177d3f3f-cfbe-4a04-b5d0-187062f7bfef tempest-TestVolumeSwap-528292061 tempest-TestVolumeSwap-528292061-project-member] Converting VIF {"id": "8e8a8e12-6ca8-4657-a4d4-e11c02ee8fa4", "address": "fa:16:3e:db:5c:48", "network": {"id": "57a65455-9929-439e-85a0-07a7a36dbd60", "bridge": "br-int", "label": "tempest-TestVolumeSwap-718745600-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.55", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f5ecf574b4a4b8bb0747c796c16e3e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e8a8e12-6c", "ovs_interfaceid": "8e8a8e12-6ca8-4657-a4d4-e11c02ee8fa4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 09:47:43 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-177d3f3f-cfbe-4a04-b5d0-187062f7bfef tempest-TestVolumeSwap-528292061 tempest-TestVolumeSwap-528292061-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:db:5c:48,bridge_name='br-int',has_traffic_filtering=True,id=8e8a8e12-6ca8-4657-a4d4-e11c02ee8fa4,network=Network(57a65455-9929-439e-85a0-07a7a36dbd60),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e8a8e12-6c') {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 09:47:43 user nova-compute[75229]: DEBUG os_vif [None req-177d3f3f-cfbe-4a04-b5d0-187062f7bfef tempest-TestVolumeSwap-528292061 tempest-TestVolumeSwap-528292061-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:db:5c:48,bridge_name='br-int',has_traffic_filtering=True,id=8e8a8e12-6ca8-4657-a4d4-e11c02ee8fa4,network=Network(57a65455-9929-439e-85a0-07a7a36dbd60),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e8a8e12-6c') {{(pid=75229) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 09:47:43 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:47:43 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8e8a8e12-6c, bridge=br-int, if_exists=True) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:47:43 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:47:43 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 09:47:43 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:47:43 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d396a44a-2005-4d78-997b-4c8cfb33f5e7) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:47:43 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:47:43 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 09:47:43 user nova-compute[75229]: INFO os_vif [None req-177d3f3f-cfbe-4a04-b5d0-187062f7bfef tempest-TestVolumeSwap-528292061 tempest-TestVolumeSwap-528292061-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:db:5c:48,bridge_name='br-int',has_traffic_filtering=True,id=8e8a8e12-6ca8-4657-a4d4-e11c02ee8fa4,network=Network(57a65455-9929-439e-85a0-07a7a36dbd60),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e8a8e12-6c')
Nov 14 09:47:43 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-177d3f3f-cfbe-4a04-b5d0-187062f7bfef tempest-TestVolumeSwap-528292061 tempest-TestVolumeSwap-528292061-project-member] [instance: c307660b-01bb-471b-9e2e-5c2aaca65287] Deleting instance files /opt/stack/data/nova/instances/c307660b-01bb-471b-9e2e-5c2aaca65287_del
Nov 14 09:47:43 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-177d3f3f-cfbe-4a04-b5d0-187062f7bfef tempest-TestVolumeSwap-528292061 tempest-TestVolumeSwap-528292061-project-member] [instance: c307660b-01bb-471b-9e2e-5c2aaca65287] Deletion of /opt/stack/data/nova/instances/c307660b-01bb-471b-9e2e-5c2aaca65287_del complete
Nov 14 09:47:43 user nova-compute[75229]: INFO nova.compute.manager [None req-177d3f3f-cfbe-4a04-b5d0-187062f7bfef tempest-TestVolumeSwap-528292061 tempest-TestVolumeSwap-528292061-project-member] [instance: c307660b-01bb-471b-9e2e-5c2aaca65287] Took 1.14 seconds to destroy the instance on the hypervisor.
Nov 14 09:47:43 user nova-compute[75229]: DEBUG oslo.service.loopingcall [None req-177d3f3f-cfbe-4a04-b5d0-187062f7bfef tempest-TestVolumeSwap-528292061 tempest-TestVolumeSwap-528292061-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75229) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 09:47:43 user nova-compute[75229]: DEBUG nova.compute.manager [-] [instance: c307660b-01bb-471b-9e2e-5c2aaca65287] Deallocating network for instance {{(pid=75229) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 09:47:43 user nova-compute[75229]: DEBUG nova.network.neutron [-] [instance: c307660b-01bb-471b-9e2e-5c2aaca65287] deallocate_for_instance() {{(pid=75229) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 09:47:43 user nova-compute[75229]: DEBUG nova.compute.provider_tree [None req-b300c569-d116-479c-b966-439bddf95408 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Inventory has not changed in ProviderTree for provider: d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 {{(pid=75229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 09:47:43 user nova-compute[75229]: DEBUG nova.scheduler.client.report [None req-b300c569-d116-479c-b966-439bddf95408 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Inventory has not changed for provider d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 09:47:43 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-b300c569-d116-479c-b966-439bddf95408 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.753s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:47:43 user nova-compute[75229]: DEBUG nova.compute.manager [None req-b300c569-d116-479c-b966-439bddf95408 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] [instance: be813b28-133f-416a-b2b5-dc0b9e4064b7] Start building networks asynchronously for instance. {{(pid=75229) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 09:47:43 user nova-compute[75229]: DEBUG nova.compute.manager [None req-b300c569-d116-479c-b966-439bddf95408 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] [instance: be813b28-133f-416a-b2b5-dc0b9e4064b7] Allocating IP information in the background. {{(pid=75229) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 09:47:43 user nova-compute[75229]: DEBUG nova.network.neutron [None req-b300c569-d116-479c-b966-439bddf95408 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] [instance: be813b28-133f-416a-b2b5-dc0b9e4064b7] allocate_for_instance() {{(pid=75229) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 09:47:43 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-b300c569-d116-479c-b966-439bddf95408 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] [instance: be813b28-133f-416a-b2b5-dc0b9e4064b7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 09:47:43 user nova-compute[75229]: DEBUG nova.compute.manager [None req-b300c569-d116-479c-b966-439bddf95408 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] [instance: be813b28-133f-416a-b2b5-dc0b9e4064b7] Start building block device mappings for instance. {{(pid=75229) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 09:47:43 user nova-compute[75229]: DEBUG nova.policy [None req-b300c569-d116-479c-b966-439bddf95408 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c0c381a0f6124f1ca6ce85c057b9143a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46e65cdd021f4a3db7c9254bb6d98b46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75229) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 09:47:43 user nova-compute[75229]: DEBUG nova.compute.manager [None req-b300c569-d116-479c-b966-439bddf95408 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] [instance: be813b28-133f-416a-b2b5-dc0b9e4064b7] Start spawning the instance on the hypervisor. {{(pid=75229) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 09:47:43 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-b300c569-d116-479c-b966-439bddf95408 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] [instance: be813b28-133f-416a-b2b5-dc0b9e4064b7] Creating instance directory {{(pid=75229) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 09:47:43 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-b300c569-d116-479c-b966-439bddf95408 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] [instance: be813b28-133f-416a-b2b5-dc0b9e4064b7] Creating image(s)
Nov 14 09:47:43 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-b300c569-d116-479c-b966-439bddf95408 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Acquiring lock "/opt/stack/data/nova/instances/be813b28-133f-416a-b2b5-dc0b9e4064b7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:47:43 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-b300c569-d116-479c-b966-439bddf95408 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Lock "/opt/stack/data/nova/instances/be813b28-133f-416a-b2b5-dc0b9e4064b7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:47:43 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-b300c569-d116-479c-b966-439bddf95408 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Lock "/opt/stack/data/nova/instances/be813b28-133f-416a-b2b5-dc0b9e4064b7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:47:43 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-65cb7584-889d-4d19-9969-57c66dc18090 tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:47:43 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-65cb7584-889d-4d19-9969-57c66dc18090 tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:47:43 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-b300c569-d116-479c-b966-439bddf95408 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6 --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:47:44 user nova-compute[75229]: DEBUG nova.objects.instance [None req-65cb7584-889d-4d19-9969-57c66dc18090 tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Lazy-loading 'pci_requests' on Instance uuid 90bd76df-96cb-4bec-9862-853d94cdbaab {{(pid=75229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 09:47:44 user nova-compute[75229]: DEBUG nova.objects.instance [None req-65cb7584-889d-4d19-9969-57c66dc18090 tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Lazy-loading 'numa_topology' on Instance uuid 90bd76df-96cb-4bec-9862-853d94cdbaab {{(pid=75229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 09:47:44 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-65cb7584-889d-4d19-9969-57c66dc18090 tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75229) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 09:47:44 user nova-compute[75229]: INFO nova.compute.claims [None req-65cb7584-889d-4d19-9969-57c66dc18090 tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] [instance: 90bd76df-96cb-4bec-9862-853d94cdbaab] Claim successful on node user
Nov 14 09:47:44 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-b300c569-d116-479c-b966-439bddf95408 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6 --force-share --output=json" returned: 0 in 0.255s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:47:44 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-b300c569-d116-479c-b966-439bddf95408 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Acquiring lock "4f30e3fe703d2381679612a57b1fb80a467f60b6" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:47:44 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-b300c569-d116-479c-b966-439bddf95408 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Lock "4f30e3fe703d2381679612a57b1fb80a467f60b6" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:47:44 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-b300c569-d116-479c-b966-439bddf95408 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6 --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:47:44 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-b300c569-d116-479c-b966-439bddf95408 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6 --force-share --output=json" returned: 0 in 0.211s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:47:44 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-b300c569-d116-479c-b966-439bddf95408 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6,backing_fmt=raw /opt/stack/data/nova/instances/be813b28-133f-416a-b2b5-dc0b9e4064b7/disk 1073741824 {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:47:44 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-b300c569-d116-479c-b966-439bddf95408 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6,backing_fmt=raw /opt/stack/data/nova/instances/be813b28-133f-416a-b2b5-dc0b9e4064b7/disk 1073741824" returned: 0 in 0.070s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:47:44 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-b300c569-d116-479c-b966-439bddf95408 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Lock "4f30e3fe703d2381679612a57b1fb80a467f60b6" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.289s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:47:44 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-b300c569-d116-479c-b966-439bddf95408 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6 --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:47:44 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 09:47:44 user nova-compute[75229]: DEBUG nova.compute.manager [req-33502a7d-b28a-4d59-9334-14bff7d101fb req-9d611465-a585-47fc-93fb-a0173d0a89ff service nova] [instance: c307660b-01bb-471b-9e2e-5c2aaca65287] Received event network-vif-plugged-8e8a8e12-6ca8-4657-a4d4-e11c02ee8fa4 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:47:44 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-33502a7d-b28a-4d59-9334-14bff7d101fb req-9d611465-a585-47fc-93fb-a0173d0a89ff service nova] Acquiring lock "c307660b-01bb-471b-9e2e-5c2aaca65287-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:47:44 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-33502a7d-b28a-4d59-9334-14bff7d101fb req-9d611465-a585-47fc-93fb-a0173d0a89ff service nova] Lock "c307660b-01bb-471b-9e2e-5c2aaca65287-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:47:44 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-33502a7d-b28a-4d59-9334-14bff7d101fb req-9d611465-a585-47fc-93fb-a0173d0a89ff service nova] Lock "c307660b-01bb-471b-9e2e-5c2aaca65287-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:47:44 user nova-compute[75229]: DEBUG nova.compute.manager [req-33502a7d-b28a-4d59-9334-14bff7d101fb req-9d611465-a585-47fc-93fb-a0173d0a89ff service nova] [instance: c307660b-01bb-471b-9e2e-5c2aaca65287] No waiting events found dispatching network-vif-plugged-8e8a8e12-6ca8-4657-a4d4-e11c02ee8fa4 {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 09:47:44 user nova-compute[75229]: WARNING nova.compute.manager [req-33502a7d-b28a-4d59-9334-14bff7d101fb req-9d611465-a585-47fc-93fb-a0173d0a89ff service nova] [instance: c307660b-01bb-471b-9e2e-5c2aaca65287] Received unexpected event network-vif-plugged-8e8a8e12-6ca8-4657-a4d4-e11c02ee8fa4 for instance with vm_state active and task_state deleting.
Nov 14 09:47:44 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:47:44 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-b300c569-d116-479c-b966-439bddf95408 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6 --force-share --output=json" returned: 0 in 0.263s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:47:44 user nova-compute[75229]: DEBUG nova.virt.disk.api [None req-b300c569-d116-479c-b966-439bddf95408 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Checking if we can resize image /opt/stack/data/nova/instances/be813b28-133f-416a-b2b5-dc0b9e4064b7/disk. size=1073741824 {{(pid=75229) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 09:47:44 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-b300c569-d116-479c-b966-439bddf95408 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be813b28-133f-416a-b2b5-dc0b9e4064b7/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:47:44 user nova-compute[75229]: DEBUG nova.network.neutron [None req-b300c569-d116-479c-b966-439bddf95408 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] [instance: be813b28-133f-416a-b2b5-dc0b9e4064b7] Successfully created port: d9a42cb3-5297-4aaf-bf16-9e591cab2fdc {{(pid=75229) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 09:47:44 user nova-compute[75229]: DEBUG nova.compute.provider_tree [None req-65cb7584-889d-4d19-9969-57c66dc18090 tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Inventory has not changed in ProviderTree for provider: d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 {{(pid=75229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 09:47:44 user nova-compute[75229]: DEBUG nova.compute.manager [req-4f480994-1d9c-42d8-be58-f525c59a9442 req-938cb2ba-dfbe-4ea2-bca0-f0fe1a089582 service nova] [instance: c307660b-01bb-471b-9e2e-5c2aaca65287] Received event network-vif-deleted-8e8a8e12-6ca8-4657-a4d4-e11c02ee8fa4 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:47:44 user nova-compute[75229]: INFO nova.compute.manager [req-4f480994-1d9c-42d8-be58-f525c59a9442 req-938cb2ba-dfbe-4ea2-bca0-f0fe1a089582 service nova] [instance: c307660b-01bb-471b-9e2e-5c2aaca65287] Neutron deleted interface 8e8a8e12-6ca8-4657-a4d4-e11c02ee8fa4; detaching it from the instance and deleting it from the info cache
Nov 14 09:47:44 user nova-compute[75229]: DEBUG nova.network.neutron [req-4f480994-1d9c-42d8-be58-f525c59a9442 req-938cb2ba-dfbe-4ea2-bca0-f0fe1a089582 service nova] [instance: c307660b-01bb-471b-9e2e-5c2aaca65287] Updating instance_info_cache with network_info: [] {{(pid=75229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 09:47:44 user nova-compute[75229]: DEBUG nova.scheduler.client.report [None req-65cb7584-889d-4d19-9969-57c66dc18090 tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Inventory has not changed for provider d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 09:47:44 user nova-compute[75229]: DEBUG nova.compute.manager [req-4f480994-1d9c-42d8-be58-f525c59a9442 req-938cb2ba-dfbe-4ea2-bca0-f0fe1a089582 service nova] [instance: c307660b-01bb-471b-9e2e-5c2aaca65287] Detach interface failed, port_id=8e8a8e12-6ca8-4657-a4d4-e11c02ee8fa4, reason: Instance c307660b-01bb-471b-9e2e-5c2aaca65287 could not be found. {{(pid=75229) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 14 09:47:44 user nova-compute[75229]: DEBUG nova.network.neutron [-] [instance: c307660b-01bb-471b-9e2e-5c2aaca65287] Updating instance_info_cache with network_info: [] {{(pid=75229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 09:47:44 user nova-compute[75229]: INFO nova.compute.manager [-] [instance: c307660b-01bb-471b-9e2e-5c2aaca65287] Took 1.58 seconds to deallocate network for instance.
Nov 14 09:47:44 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-65cb7584-889d-4d19-9969-57c66dc18090 tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.999s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:47:44 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.205s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:47:44 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:47:44 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Auditing locally available compute resources for user (node: user) {{(pid=75229) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 09:47:45 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-b300c569-d116-479c-b966-439bddf95408 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be813b28-133f-416a-b2b5-dc0b9e4064b7/disk --force-share --output=json" returned: 0 in 0.272s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:47:45 user nova-compute[75229]: DEBUG nova.virt.disk.api [None req-b300c569-d116-479c-b966-439bddf95408 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Cannot resize image /opt/stack/data/nova/instances/be813b28-133f-416a-b2b5-dc0b9e4064b7/disk to a smaller size. {{(pid=75229) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 09:47:45 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-b300c569-d116-479c-b966-439bddf95408 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] [instance: be813b28-133f-416a-b2b5-dc0b9e4064b7] Created local disks {{(pid=75229) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 09:47:45 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-b300c569-d116-479c-b966-439bddf95408 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] [instance: be813b28-133f-416a-b2b5-dc0b9e4064b7] Ensure instance console log exists: /opt/stack/data/nova/instances/be813b28-133f-416a-b2b5-dc0b9e4064b7/console.log {{(pid=75229) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 09:47:45 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-b300c569-d116-479c-b966-439bddf95408 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:47:45 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-b300c569-d116-479c-b966-439bddf95408 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:47:45 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-b300c569-d116-479c-b966-439bddf95408 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:47:45 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-177d3f3f-cfbe-4a04-b5d0-187062f7bfef tempest-TestVolumeSwap-528292061 tempest-TestVolumeSwap-528292061-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:47:45 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-177d3f3f-cfbe-4a04-b5d0-187062f7bfef tempest-TestVolumeSwap-528292061 tempest-TestVolumeSwap-528292061-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:47:45 user nova-compute[75229]: INFO nova.network.neutron [None req-65cb7584-889d-4d19-9969-57c66dc18090 tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] [instance: 90bd76df-96cb-4bec-9862-853d94cdbaab] Updating port 3b9b5b2a-5b1b-4ec6-900d-c27e7c4a625e with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 14 09:47:45 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb53ba25-d865-41ae-90f3-6e154e2778ba/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:47:45 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb53ba25-d865-41ae-90f3-6e154e2778ba/disk --force-share --output=json" returned: 0 in 0.241s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:47:45 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb53ba25-d865-41ae-90f3-6e154e2778ba/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:47:45 user nova-compute[75229]: DEBUG nova.compute.provider_tree [None req-177d3f3f-cfbe-4a04-b5d0-187062f7bfef tempest-TestVolumeSwap-528292061 tempest-TestVolumeSwap-528292061-project-member] Inventory has not changed in ProviderTree for provider: d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 {{(pid=75229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 09:47:45 user nova-compute[75229]: DEBUG nova.scheduler.client.report [None req-177d3f3f-cfbe-4a04-b5d0-187062f7bfef tempest-TestVolumeSwap-528292061 tempest-TestVolumeSwap-528292061-project-member] Inventory has not changed for provider d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 09:47:45 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-177d3f3f-cfbe-4a04-b5d0-187062f7bfef tempest-TestVolumeSwap-528292061 tempest-TestVolumeSwap-528292061-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.537s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:47:45 user nova-compute[75229]: INFO nova.scheduler.client.report [None req-177d3f3f-cfbe-4a04-b5d0-187062f7bfef tempest-TestVolumeSwap-528292061 tempest-TestVolumeSwap-528292061-project-member] Deleted allocations for instance c307660b-01bb-471b-9e2e-5c2aaca65287
Nov 14 09:47:45 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb53ba25-d865-41ae-90f3-6e154e2778ba/disk --force-share --output=json" returned: 0 in 0.263s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:47:45 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7750cbc-b3d0-44aa-8b88-c291ba007a8a/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:47:45 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-177d3f3f-cfbe-4a04-b5d0-187062f7bfef tempest-TestVolumeSwap-528292061 tempest-TestVolumeSwap-528292061-project-member] Lock "c307660b-01bb-471b-9e2e-5c2aaca65287" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.562s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:47:45 user nova-compute[75229]: DEBUG nova.network.neutron [None req-b300c569-d116-479c-b966-439bddf95408 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] [instance: be813b28-133f-416a-b2b5-dc0b9e4064b7] Successfully updated port: d9a42cb3-5297-4aaf-bf16-9e591cab2fdc {{(pid=75229) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 09:47:45 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-b300c569-d116-479c-b966-439bddf95408 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Acquiring lock "refresh_cache-be813b28-133f-416a-b2b5-dc0b9e4064b7" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 09:47:45 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-b300c569-d116-479c-b966-439bddf95408 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Acquired lock "refresh_cache-be813b28-133f-416a-b2b5-dc0b9e4064b7" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 09:47:45 user nova-compute[75229]: DEBUG nova.network.neutron [None req-b300c569-d116-479c-b966-439bddf95408 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] [instance: be813b28-133f-416a-b2b5-dc0b9e4064b7] Building network info cache for instance {{(pid=75229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 09:47:45 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-65cb7584-889d-4d19-9969-57c66dc18090 tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Acquiring lock "refresh_cache-90bd76df-96cb-4bec-9862-853d94cdbaab" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 09:47:45 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-65cb7584-889d-4d19-9969-57c66dc18090 tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Acquired lock "refresh_cache-90bd76df-96cb-4bec-9862-853d94cdbaab" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 09:47:45 user nova-compute[75229]: DEBUG nova.network.neutron [None req-65cb7584-889d-4d19-9969-57c66dc18090 tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] [instance: 90bd76df-96cb-4bec-9862-853d94cdbaab] Building network info cache for instance {{(pid=75229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 09:47:45 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7750cbc-b3d0-44aa-8b88-c291ba007a8a/disk --force-share --output=json" returned: 0 in 0.262s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:47:45 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7750cbc-b3d0-44aa-8b88-c291ba007a8a/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:47:46 user nova-compute[75229]: DEBUG nova.network.neutron [None req-b300c569-d116-479c-b966-439bddf95408 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] [instance: be813b28-133f-416a-b2b5-dc0b9e4064b7] Instance cache missing network info. {{(pid=75229) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 09:47:46 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7750cbc-b3d0-44aa-8b88-c291ba007a8a/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:47:46 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38f30682-2278-40aa-914e-2867e771eb19/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:47:46 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:47:46 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38f30682-2278-40aa-914e-2867e771eb19/disk --force-share --output=json" returned: 0 in 0.292s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:47:46 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38f30682-2278-40aa-914e-2867e771eb19/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:47:46 user nova-compute[75229]: DEBUG nova.network.neutron [None req-65cb7584-889d-4d19-9969-57c66dc18090 tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] [instance: 90bd76df-96cb-4bec-9862-853d94cdbaab] Updating instance_info_cache with network_info: [{"id": "3b9b5b2a-5b1b-4ec6-900d-c27e7c4a625e", "address": "fa:16:3e:6e:aa:df", "network": {"id": "589aea41-545f-4875-ab56-b7aa273dad6f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-785276916-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee9447f169de43829fe3ed51592752e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b9b5b2a-5b", "ovs_interfaceid": "3b9b5b2a-5b1b-4ec6-900d-c27e7c4a625e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 09:47:46 user nova-compute[75229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-79ab6320-9154-4531-b273-2c0b172feae1 tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] [instance: e09b3809-2e23-401c-9a72-88feb2bb657c] Calling os-brick to attach iSCSI Volume {{(pid=75229) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 09:47:46 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-79ab6320-9154-4531-b273-2c0b172feae1 tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f73f85151b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3fed285f-9be4-4601-8cb5-4329d7ebed8c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NPZTmsSG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 09:47:46 user nova-compute[75229]: WARNING os_brick.initiator.connectors.base [None req-79ab6320-9154-4531-b273-2c0b172feae1 tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 09:47:46 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-79ab6320-9154-4531-b273-2c0b172feae1 tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 09:47:46 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-79ab6320-9154-4531-b273-2c0b172feae1 tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 09:47:46 user nova-compute[75229]: WARNING os_brick.initiator.connectors.base [None req-79ab6320-9154-4531-b273-2c0b172feae1 tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 09:47:46 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-79ab6320-9154-4531-b273-2c0b172feae1 tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3fed285f-9be4-4601-8cb5-4329d7ebed8c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 09:47:46 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-79ab6320-9154-4531-b273-2c0b172feae1 tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3fed285f-9be4-4601-8cb5-4329d7ebed8c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 09:47:46 user nova-compute[75229]: INFO os_brick.initiator.connectors.iscsi [None req-79ab6320-9154-4531-b273-2c0b172feae1 tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 09:47:46 user nova-compute[75229]: DEBUG nova.network.neutron [None req-b300c569-d116-479c-b966-439bddf95408 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] [instance: be813b28-133f-416a-b2b5-dc0b9e4064b7] Updating instance_info_cache with network_info: [{"id": "d9a42cb3-5297-4aaf-bf16-9e591cab2fdc", "address": "fa:16:3e:27:a8:b8", "network": {"id": "5dfc532f-3d5d-4342-b7f1-12c9c3992a54", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1457278473-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46e65cdd021f4a3db7c9254bb6d98b46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9a42cb3-52", "ovs_interfaceid": "d9a42cb3-5297-4aaf-bf16-9e591cab2fdc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 09:47:46 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-65cb7584-889d-4d19-9969-57c66dc18090 tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Releasing lock "refresh_cache-90bd76df-96cb-4bec-9862-853d94cdbaab" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 09:47:46 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-65cb7584-889d-4d19-9969-57c66dc18090 tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] [instance: 90bd76df-96cb-4bec-9862-853d94cdbaab] Creating instance directory {{(pid=75229) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 09:47:46 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-65cb7584-889d-4d19-9969-57c66dc18090 tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] [instance: 90bd76df-96cb-4bec-9862-853d94cdbaab] Creating image(s)
Nov 14 09:47:46 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-65cb7584-889d-4d19-9969-57c66dc18090 tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Acquiring lock "/opt/stack/data/nova/instances/90bd76df-96cb-4bec-9862-853d94cdbaab/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:47:46 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-65cb7584-889d-4d19-9969-57c66dc18090 tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Lock "/opt/stack/data/nova/instances/90bd76df-96cb-4bec-9862-853d94cdbaab/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.002s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:47:46 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-65cb7584-889d-4d19-9969-57c66dc18090 tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Lock "/opt/stack/data/nova/instances/90bd76df-96cb-4bec-9862-853d94cdbaab/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:47:46 user nova-compute[75229]: DEBUG nova.objects.instance [None req-65cb7584-889d-4d19-9969-57c66dc18090 tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Lazy-loading 'trusted_certs' on Instance uuid 90bd76df-96cb-4bec-9862-853d94cdbaab {{(pid=75229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 09:47:46 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3fed285f-9be4-4601-8cb5-4329d7ebed8c -p 172.16.0.220:3260 {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:47:46 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-b300c569-d116-479c-b966-439bddf95408 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Releasing lock "refresh_cache-be813b28-133f-416a-b2b5-dc0b9e4064b7" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 09:47:46 user nova-compute[75229]: DEBUG nova.compute.manager [None req-b300c569-d116-479c-b966-439bddf95408 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] [instance: be813b28-133f-416a-b2b5-dc0b9e4064b7] Instance network_info: |[{"id": "d9a42cb3-5297-4aaf-bf16-9e591cab2fdc", "address": "fa:16:3e:27:a8:b8", "network": {"id": "5dfc532f-3d5d-4342-b7f1-12c9c3992a54", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1457278473-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46e65cdd021f4a3db7c9254bb6d98b46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9a42cb3-52", "ovs_interfaceid": "d9a42cb3-5297-4aaf-bf16-9e591cab2fdc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75229) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 09:47:46 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-b300c569-d116-479c-b966-439bddf95408 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] [instance: be813b28-133f-416a-b2b5-dc0b9e4064b7] Start _get_guest_xml network_info=[{"id": "d9a42cb3-5297-4aaf-bf16-9e591cab2fdc", "address": "fa:16:3e:27:a8:b8", "network": {"id": "5dfc532f-3d5d-4342-b7f1-12c9c3992a54", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1457278473-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46e65cdd021f4a3db7c9254bb6d98b46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9a42cb3-52", "ovs_interfaceid": "d9a42cb3-5297-4aaf-bf16-9e591cab2fdc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T09:40:10Z,direct_url=<?>,disk_format='qcow2',id=3bef8470-ecc7-40e3-95d4-9254348ea72d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='de5a91106b6948ed937a7178ff9464c4',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T09:40:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'disk_bus': 'virtio', 'guest_format': None, 'encryption_secret_uuid': None, 'size': 0, 'device_type': 'disk', 'image_id': '3bef8470-ecc7-40e3-95d4-9254348ea72d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75229) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 09:47:46 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3fed285f-9be4-4601-8cb5-4329d7ebed8c -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:47:46 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfa077f2-d1c9-4708-99df-fc0a255b1323]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:47:46 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-79ab6320-9154-4531-b273-2c0b172feae1 tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 09:47:46 user nova-compute[75229]:  {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:47:46 user nova-compute[75229]: DEBUG nova.objects.base [None req-65cb7584-889d-4d19-9969-57c66dc18090 tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Object Instance<90bd76df-96cb-4bec-9862-853d94cdbaab> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=75229) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 09:47:46 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-65cb7584-889d-4d19-9969-57c66dc18090 tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Acquiring lock "f46cd2031cc9dbf9a98522f8247ea10806506aa8" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:47:46 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-65cb7584-889d-4d19-9969-57c66dc18090 tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Lock "f46cd2031cc9dbf9a98522f8247ea10806506aa8" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:47:46 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3fed285f-9be4-4601-8cb5-4329d7ebed8c -p 172.16.0.220:3260 --interface default --op new {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:47:46 user nova-compute[75229]: WARNING nova.virt.libvirt.driver [None req-b300c569-d116-479c-b966-439bddf95408 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 09:47:46 user nova-compute[75229]: WARNING nova.virt.libvirt.driver [None req-b300c569-d116-479c-b966-439bddf95408 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 09:47:46 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-b300c569-d116-479c-b966-439bddf95408 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75229) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 09:47:46 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-b300c569-d116-479c-b966-439bddf95408 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] CPU controller missing on host. {{(pid=75229) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 09:47:46 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-b300c569-d116-479c-b966-439bddf95408 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75229) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 09:47:46 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-b300c569-d116-479c-b966-439bddf95408 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] CPU controller found on host. {{(pid=75229) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 09:47:46 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-b300c569-d116-479c-b966-439bddf95408 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75229) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 09:47:46 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-b300c569-d116-479c-b966-439bddf95408 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T09:39:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T09:40:10Z,direct_url=<?>,disk_format='qcow2',id=3bef8470-ecc7-40e3-95d4-9254348ea72d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='de5a91106b6948ed937a7178ff9464c4',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T09:40:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 09:47:46 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-b300c569-d116-479c-b966-439bddf95408 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Flavor limits 0:0:0 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 09:47:46 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-b300c569-d116-479c-b966-439bddf95408 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Image limits 0:0:0 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 09:47:46 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-b300c569-d116-479c-b966-439bddf95408 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Flavor pref 0:0:0 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 09:47:46 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-b300c569-d116-479c-b966-439bddf95408 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Image pref 0:0:0 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 09:47:46 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-b300c569-d116-479c-b966-439bddf95408 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 09:47:46 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-b300c569-d116-479c-b966-439bddf95408 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 09:47:46 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-b300c569-d116-479c-b966-439bddf95408 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75229) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 09:47:46 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-b300c569-d116-479c-b966-439bddf95408 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Got 1 possible topologies {{(pid=75229) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 09:47:46 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-b300c569-d116-479c-b966-439bddf95408 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 09:47:46 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-b300c569-d116-479c-b966-439bddf95408 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 09:47:46 user nova-compute[75229]: DEBUG nova.virt.libvirt.vif [None req-b300c569-d116-479c-b966-439bddf95408 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T09:47:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-266135781',display_name='tempest-tempest.common.compute-instance-266135781',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-266135781',id=15,image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI5pWGQ4KaFZcOEff0OXqhHA6X74NcsQbIGrT1blkx1Y+aHHl7DvQb7afEPRDoAhltmJD8qcavQNRjJLbmHNs+eYeK4dOL8IJQfu1ghTHpot7XRacUK1z4qoyxfCdssM8g==',key_name='tempest-keypair-865166921',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='46e65cdd021f4a3db7c9254bb6d98b46',ramdisk_id='',reservation_id='r-0oyrmh9m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-280196295',owner_user_name='tempest-ServerActionsTestOtherA-280196295-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T09:47:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c0c381a0f6124f1ca6ce85c057b9143a',uuid=be813b28-133f-416a-b2b5-dc0b9e4064b7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d9a42cb3-5297-4aaf-bf16-9e591cab2fdc", "address": "fa:16:3e:27:a8:b8", "network": {"id": "5dfc532f-3d5d-4342-b7f1-12c9c3992a54", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1457278473-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46e65cdd021f4a3db7c9254bb6d98b46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9a42cb3-52", "ovs_interfaceid": "d9a42cb3-5297-4aaf-bf16-9e591cab2fdc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75229) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 09:47:46 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-b300c569-d116-479c-b966-439bddf95408 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Converting VIF {"id": "d9a42cb3-5297-4aaf-bf16-9e591cab2fdc", "address": "fa:16:3e:27:a8:b8", "network": {"id": "5dfc532f-3d5d-4342-b7f1-12c9c3992a54", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1457278473-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46e65cdd021f4a3db7c9254bb6d98b46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9a42cb3-52", "ovs_interfaceid": "d9a42cb3-5297-4aaf-bf16-9e591cab2fdc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 09:47:46 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-b300c569-d116-479c-b966-439bddf95408 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:27:a8:b8,bridge_name='br-int',has_traffic_filtering=True,id=d9a42cb3-5297-4aaf-bf16-9e591cab2fdc,network=Network(5dfc532f-3d5d-4342-b7f1-12c9c3992a54),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9a42cb3-52') {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 09:47:46 user nova-compute[75229]: DEBUG nova.objects.instance [None req-b300c569-d116-479c-b966-439bddf95408 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Lazy-loading 'pci_devices' on Instance uuid be813b28-133f-416a-b2b5-dc0b9e4064b7 {{(pid=75229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 09:47:46 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:47:46 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3fed285f-9be4-4601-8cb5-4329d7ebed8c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.027s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:47:46 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[74a47fc3-3e1f-4a55-8dd3-9e1b5e62917a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3fed285f-9be4-4601-8cb5-4329d7ebed8c] added\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:47:46 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-79ab6320-9154-4531-b273-2c0b172feae1 tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3fed285f-9be4-4601-8cb5-4329d7ebed8c] added
Nov 14 09:47:46 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:47:46 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-b300c569-d116-479c-b966-439bddf95408 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] [instance: be813b28-133f-416a-b2b5-dc0b9e4064b7] End _get_guest_xml xml=<domain type="kvm">
Nov 14 09:47:46 user nova-compute[75229]:   <uuid>be813b28-133f-416a-b2b5-dc0b9e4064b7</uuid>
Nov 14 09:47:46 user nova-compute[75229]:   <name>instance-0000000f</name>
Nov 14 09:47:46 user nova-compute[75229]:   <memory>524288</memory>
Nov 14 09:47:46 user nova-compute[75229]:   <vcpu>1</vcpu>
Nov 14 09:47:46 user nova-compute[75229]:   <metadata>
Nov 14 09:47:46 user nova-compute[75229]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 09:47:46 user nova-compute[75229]:       <nova:package version="0.0.0"/>
Nov 14 09:47:46 user nova-compute[75229]:       <nova:name>tempest-tempest.common.compute-instance-266135781</nova:name>
Nov 14 09:47:46 user nova-compute[75229]:       <nova:creationTime>2023-11-14 09:47:46</nova:creationTime>
Nov 14 09:47:46 user nova-compute[75229]:       <nova:flavor name="m1.tiny">
Nov 14 09:47:46 user nova-compute[75229]:         <nova:memory>512</nova:memory>
Nov 14 09:47:46 user nova-compute[75229]:         <nova:disk>1</nova:disk>
Nov 14 09:47:46 user nova-compute[75229]:         <nova:swap>0</nova:swap>
Nov 14 09:47:46 user nova-compute[75229]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 09:47:46 user nova-compute[75229]:         <nova:vcpus>1</nova:vcpus>
Nov 14 09:47:46 user nova-compute[75229]:       </nova:flavor>
Nov 14 09:47:46 user nova-compute[75229]:       <nova:owner>
Nov 14 09:47:46 user nova-compute[75229]:         <nova:user uuid="c0c381a0f6124f1ca6ce85c057b9143a">tempest-ServerActionsTestOtherA-280196295-project-member</nova:user>
Nov 14 09:47:46 user nova-compute[75229]:         <nova:project uuid="46e65cdd021f4a3db7c9254bb6d98b46">tempest-ServerActionsTestOtherA-280196295</nova:project>
Nov 14 09:47:46 user nova-compute[75229]:       </nova:owner>
Nov 14 09:47:46 user nova-compute[75229]:       <nova:root type="image" uuid="3bef8470-ecc7-40e3-95d4-9254348ea72d"/>
Nov 14 09:47:46 user nova-compute[75229]:       <nova:ports>
Nov 14 09:47:46 user nova-compute[75229]:         <nova:port uuid="d9a42cb3-5297-4aaf-bf16-9e591cab2fdc">
Nov 14 09:47:46 user nova-compute[75229]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 14 09:47:46 user nova-compute[75229]:         </nova:port>
Nov 14 09:47:46 user nova-compute[75229]:       </nova:ports>
Nov 14 09:47:46 user nova-compute[75229]:     </nova:instance>
Nov 14 09:47:46 user nova-compute[75229]:   </metadata>
Nov 14 09:47:46 user nova-compute[75229]:   <sysinfo type="smbios">
Nov 14 09:47:46 user nova-compute[75229]:     <system>
Nov 14 09:47:46 user nova-compute[75229]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 09:47:46 user nova-compute[75229]:       <entry name="product">OpenStack Nova</entry>
Nov 14 09:47:46 user nova-compute[75229]:       <entry name="version">0.0.0</entry>
Nov 14 09:47:46 user nova-compute[75229]:       <entry name="serial">be813b28-133f-416a-b2b5-dc0b9e4064b7</entry>
Nov 14 09:47:46 user nova-compute[75229]:       <entry name="uuid">be813b28-133f-416a-b2b5-dc0b9e4064b7</entry>
Nov 14 09:47:46 user nova-compute[75229]:       <entry name="family">Virtual Machine</entry>
Nov 14 09:47:46 user nova-compute[75229]:     </system>
Nov 14 09:47:46 user nova-compute[75229]:   </sysinfo>
Nov 14 09:47:46 user nova-compute[75229]:   <os>
Nov 14 09:47:46 user nova-compute[75229]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 09:47:46 user nova-compute[75229]:     <boot dev="hd"/>
Nov 14 09:47:46 user nova-compute[75229]:     <smbios mode="sysinfo"/>
Nov 14 09:47:46 user nova-compute[75229]:   </os>
Nov 14 09:47:46 user nova-compute[75229]:   <features>
Nov 14 09:47:46 user nova-compute[75229]:     <acpi/>
Nov 14 09:47:46 user nova-compute[75229]:     <apic/>
Nov 14 09:47:46 user nova-compute[75229]:     <vmcoreinfo/>
Nov 14 09:47:46 user nova-compute[75229]:   </features>
Nov 14 09:47:46 user nova-compute[75229]:   <clock offset="utc">
Nov 14 09:47:46 user nova-compute[75229]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 09:47:46 user nova-compute[75229]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 09:47:46 user nova-compute[75229]:     <timer name="hpet" present="no"/>
Nov 14 09:47:46 user nova-compute[75229]:   </clock>
Nov 14 09:47:46 user nova-compute[75229]:   <cpu mode="custom" match="exact">
Nov 14 09:47:46 user nova-compute[75229]:     <model>Nehalem</model>
Nov 14 09:47:46 user nova-compute[75229]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 09:47:46 user nova-compute[75229]:   </cpu>
Nov 14 09:47:46 user nova-compute[75229]:   <devices>
Nov 14 09:47:46 user nova-compute[75229]:     <disk type="file" device="disk">
Nov 14 09:47:46 user nova-compute[75229]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 09:47:46 user nova-compute[75229]:       <source file="/opt/stack/data/nova/instances/be813b28-133f-416a-b2b5-dc0b9e4064b7/disk"/>
Nov 14 09:47:46 user nova-compute[75229]:       <target dev="vda" bus="virtio"/>
Nov 14 09:47:46 user nova-compute[75229]:     </disk>
Nov 14 09:47:46 user nova-compute[75229]:     <interface type="ethernet">
Nov 14 09:47:46 user nova-compute[75229]:       <mac address="fa:16:3e:27:a8:b8"/>
Nov 14 09:47:46 user nova-compute[75229]:       <model type="virtio"/>
Nov 14 09:47:46 user nova-compute[75229]:       <mtu size="1442"/>
Nov 14 09:47:46 user nova-compute[75229]:       <target dev="tapd9a42cb3-52"/>
Nov 14 09:47:46 user nova-compute[75229]:     </interface>
Nov 14 09:47:46 user nova-compute[75229]:     <serial type="pty">
Nov 14 09:47:46 user nova-compute[75229]:       <log file="/opt/stack/data/nova/instances/be813b28-133f-416a-b2b5-dc0b9e4064b7/console.log" append="off"/>
Nov 14 09:47:46 user nova-compute[75229]:     </serial>
Nov 14 09:47:46 user nova-compute[75229]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 09:47:46 user nova-compute[75229]:     <video>
Nov 14 09:47:46 user nova-compute[75229]:       <model type="virtio"/>
Nov 14 09:47:46 user nova-compute[75229]:     </video>
Nov 14 09:47:46 user nova-compute[75229]:     <rng model="virtio">
Nov 14 09:47:46 user nova-compute[75229]:       <backend model="random">/dev/urandom</backend>
Nov 14 09:47:46 user nova-compute[75229]:     </rng>
Nov 14 09:47:46 user nova-compute[75229]:     <controller type="usb" index="0" model="none"/>
Nov 14 09:47:46 user nova-compute[75229]:     <memballoon model="virtio">
Nov 14 09:47:46 user nova-compute[75229]:       <stats period="10"/>
Nov 14 09:47:46 user nova-compute[75229]:     </memballoon>
Nov 14 09:47:46 user nova-compute[75229]:   </devices>
Nov 14 09:47:46 user nova-compute[75229]: </domain>
Nov 14 09:47:46 user nova-compute[75229]:  {{(pid=75229) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 09:47:46 user nova-compute[75229]: DEBUG nova.virt.libvirt.vif [None req-b300c569-d116-479c-b966-439bddf95408 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T09:47:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-266135781',display_name='tempest-tempest.common.compute-instance-266135781',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-266135781',id=15,image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI5pWGQ4KaFZcOEff0OXqhHA6X74NcsQbIGrT1blkx1Y+aHHl7DvQb7afEPRDoAhltmJD8qcavQNRjJLbmHNs+eYeK4dOL8IJQfu1ghTHpot7XRacUK1z4qoyxfCdssM8g==',key_name='tempest-keypair-865166921',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='46e65cdd021f4a3db7c9254bb6d98b46',ramdisk_id='',reservation_id='r-0oyrmh9m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-280196295',owner_user_name='tempest-ServerActionsTestOtherA-280196295-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T09:47:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c0c381a0f6124f1ca6ce85c057b9143a',uuid=be813b28-133f-416a-b2b5-dc0b9e4064b7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d9a42cb3-5297-4aaf-bf16-9e591cab2fdc", "address": "fa:16:3e:27:a8:b8", "network": {"id": "5dfc532f-3d5d-4342-b7f1-12c9c3992a54", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1457278473-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46e65cdd021f4a3db7c9254bb6d98b46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9a42cb3-52", "ovs_interfaceid": "d9a42cb3-5297-4aaf-bf16-9e591cab2fdc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 09:47:46 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-b300c569-d116-479c-b966-439bddf95408 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Converting VIF {"id": "d9a42cb3-5297-4aaf-bf16-9e591cab2fdc", "address": "fa:16:3e:27:a8:b8", "network": {"id": "5dfc532f-3d5d-4342-b7f1-12c9c3992a54", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1457278473-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46e65cdd021f4a3db7c9254bb6d98b46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9a42cb3-52", "ovs_interfaceid": "d9a42cb3-5297-4aaf-bf16-9e591cab2fdc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 09:47:46 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-b300c569-d116-479c-b966-439bddf95408 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:27:a8:b8,bridge_name='br-int',has_traffic_filtering=True,id=d9a42cb3-5297-4aaf-bf16-9e591cab2fdc,network=Network(5dfc532f-3d5d-4342-b7f1-12c9c3992a54),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9a42cb3-52') {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 09:47:46 user nova-compute[75229]: DEBUG os_vif [None req-b300c569-d116-479c-b966-439bddf95408 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:27:a8:b8,bridge_name='br-int',has_traffic_filtering=True,id=d9a42cb3-5297-4aaf-bf16-9e591cab2fdc,network=Network(5dfc532f-3d5d-4342-b7f1-12c9c3992a54),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9a42cb3-52') {{(pid=75229) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 09:47:46 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:47:46 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:47:46 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 09:47:46 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3fed285f-9be4-4601-8cb5-4329d7ebed8c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:47:46 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38f30682-2278-40aa-914e-2867e771eb19/disk --force-share --output=json" returned: 0 in 0.274s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:47:46 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:47:46 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '68779a89-3436-56cb-af29-e347c566d472', '_type': 'linux-noop'}}, row=False) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:47:46 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3fed285f-9be4-4601-8cb5-4329d7ebed8c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:47:46 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d812894-055e-4d22-9f08-9609a0256b31]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:47:46 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:47:46 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-79ab6320-9154-4531-b273-2c0b172feae1 tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:47:46 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 09:47:46 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3fed285f-9be4-4601-8cb5-4329d7ebed8c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:47:46 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:47:46 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd9a42cb3-52, may_exist=True, interface_attrs={}) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:47:46 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd9a42cb3-52, col_values=(('qos', UUID('dbe5d18c-5483-41a3-9e4b-278155ef1b0f')),), if_exists=True) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:47:46 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd9a42cb3-52, col_values=(('external_ids', {'iface-id': 'd9a42cb3-5297-4aaf-bf16-9e591cab2fdc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:27:a8:b8', 'vm-uuid': 'be813b28-133f-416a-b2b5-dc0b9e4064b7'}),), if_exists=True) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:47:46 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:47:48 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-65cb7584-889d-4d19-9969-57c66dc18090 tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f46cd2031cc9dbf9a98522f8247ea10806506aa8.part --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:47:48 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3fed285f-9be4-4601-8cb5-4329d7ebed8c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:47:48 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[77884e16-3009-43d9-974e-777f1f9681ad]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:47:48 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 09:47:48 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a60d339f-e134-477c-8505-bf8c79d2a21c/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:47:48 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-79ab6320-9154-4531-b273-2c0b172feae1 tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:47:48 user nova-compute[75229]: INFO os_vif [None req-b300c569-d116-479c-b966-439bddf95408 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:27:a8:b8,bridge_name='br-int',has_traffic_filtering=True,id=d9a42cb3-5297-4aaf-bf16-9e591cab2fdc,network=Network(5dfc532f-3d5d-4342-b7f1-12c9c3992a54),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9a42cb3-52')
Nov 14 09:47:48 user nova-compute[75229]: DEBUG nova.compute.manager [req-5b511e38-5481-47b1-a8a5-915b01547277 req-ea4976f6-3a9d-4608-b789-8eae284ae35b service nova] [instance: be813b28-133f-416a-b2b5-dc0b9e4064b7] Received event network-changed-d9a42cb3-5297-4aaf-bf16-9e591cab2fdc {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:47:48 user nova-compute[75229]: DEBUG nova.compute.manager [req-5b511e38-5481-47b1-a8a5-915b01547277 req-ea4976f6-3a9d-4608-b789-8eae284ae35b service nova] [instance: be813b28-133f-416a-b2b5-dc0b9e4064b7] Refreshing instance network info cache due to event network-changed-d9a42cb3-5297-4aaf-bf16-9e591cab2fdc. {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 09:47:48 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-5b511e38-5481-47b1-a8a5-915b01547277 req-ea4976f6-3a9d-4608-b789-8eae284ae35b service nova] Acquiring lock "refresh_cache-be813b28-133f-416a-b2b5-dc0b9e4064b7" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 09:47:48 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-5b511e38-5481-47b1-a8a5-915b01547277 req-ea4976f6-3a9d-4608-b789-8eae284ae35b service nova] Acquired lock "refresh_cache-be813b28-133f-416a-b2b5-dc0b9e4064b7" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 09:47:48 user nova-compute[75229]: DEBUG nova.network.neutron [req-5b511e38-5481-47b1-a8a5-915b01547277 req-ea4976f6-3a9d-4608-b789-8eae284ae35b service nova] [instance: be813b28-133f-416a-b2b5-dc0b9e4064b7] Refreshing network info cache for port d9a42cb3-5297-4aaf-bf16-9e591cab2fdc {{(pid=75229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 09:47:48 user nova-compute[75229]: DEBUG nova.compute.manager [req-1d8b63e8-c349-4e92-9537-92248899418b req-ca0fc5f0-adab-4e2a-9000-c45af7480687 service nova] [instance: 90bd76df-96cb-4bec-9862-853d94cdbaab] Received event network-changed-3b9b5b2a-5b1b-4ec6-900d-c27e7c4a625e {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:47:48 user nova-compute[75229]: DEBUG nova.compute.manager [req-1d8b63e8-c349-4e92-9537-92248899418b req-ca0fc5f0-adab-4e2a-9000-c45af7480687 service nova] [instance: 90bd76df-96cb-4bec-9862-853d94cdbaab] Refreshing instance network info cache due to event network-changed-3b9b5b2a-5b1b-4ec6-900d-c27e7c4a625e. {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 09:47:48 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-1d8b63e8-c349-4e92-9537-92248899418b req-ca0fc5f0-adab-4e2a-9000-c45af7480687 service nova] Acquiring lock "refresh_cache-90bd76df-96cb-4bec-9862-853d94cdbaab" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 09:47:48 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-1d8b63e8-c349-4e92-9537-92248899418b req-ca0fc5f0-adab-4e2a-9000-c45af7480687 service nova] Acquired lock "refresh_cache-90bd76df-96cb-4bec-9862-853d94cdbaab" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 09:47:48 user nova-compute[75229]: DEBUG nova.network.neutron [req-1d8b63e8-c349-4e92-9537-92248899418b req-ca0fc5f0-adab-4e2a-9000-c45af7480687 service nova] [instance: 90bd76df-96cb-4bec-9862-853d94cdbaab] Refreshing network info cache for port 3b9b5b2a-5b1b-4ec6-900d-c27e7c4a625e {{(pid=75229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 09:47:48 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3fed285f-9be4-4601-8cb5-4329d7ebed8c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NPZTmsSG {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:47:48 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3fed285f-9be4-4601-8cb5-4329d7ebed8c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NPZTmsSG" returned: 0 in 0.033s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:47:48 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6703ce8-244a-4041-b924-57b4adb65575]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:47:48 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-79ab6320-9154-4531-b273-2c0b172feae1 tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'NPZTmsSG'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:47:48 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3fed285f-9be4-4601-8cb5-4329d7ebed8c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:47:48 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3fed285f-9be4-4601-8cb5-4329d7ebed8c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:47:48 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b9d7e75-340f-4b76-a538-4f2e5e72a905]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:47:48 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-79ab6320-9154-4531-b273-2c0b172feae1 tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:47:48 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:47:48 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-65cb7584-889d-4d19-9969-57c66dc18090 tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f46cd2031cc9dbf9a98522f8247ea10806506aa8.part --force-share --output=json" returned: 0 in 0.209s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:47:48 user nova-compute[75229]: DEBUG nova.virt.images [None req-65cb7584-889d-4d19-9969-57c66dc18090 tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] 55b212ef-adfd-491b-9fbc-0043d02f3866 was qcow2, converting to raw {{(pid=75229) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 14 09:47:48 user nova-compute[75229]: DEBUG nova.privsep.utils [None req-65cb7584-889d-4d19-9969-57c66dc18090 tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75229) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 14 09:47:48 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-65cb7584-889d-4d19-9969-57c66dc18090 tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/f46cd2031cc9dbf9a98522f8247ea10806506aa8.part /opt/stack/data/nova/instances/_base/f46cd2031cc9dbf9a98522f8247ea10806506aa8.converted {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:47:48 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:47:48 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[95e779a9-f3c1-4f5c-b4d1-5061c45daea5]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db131665-6ac2-437a-8adf-23593475a8aa (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0433e38-fa42-4cff-af48-8cb5da297597 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13c53511-ea64-4896-b325-504ce58d7895 (non-flash)\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:47:48 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-79ab6320-9154-4531-b273-2c0b172feae1 tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db131665-6ac2-437a-8adf-23593475a8aa (non-flash)
Nov 14 09:47:48 user nova-compute[75229]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0433e38-fa42-4cff-af48-8cb5da297597 (non-flash)
Nov 14 09:47:48 user nova-compute[75229]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13c53511-ea64-4896-b325-504ce58d7895 (non-flash)
Nov 14 09:47:48 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 09:47:48 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-79ab6320-9154-4531-b273-2c0b172feae1 tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db131665-6ac2-437a-8adf-23593475a8aa (non-flash)
Nov 14 09:47:48 user nova-compute[75229]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0433e38-fa42-4cff-af48-8cb5da297597 (non-flash)
Nov 14 09:47:48 user nova-compute[75229]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13c53511-ea64-4896-b325-504ce58d7895 (non-flash)
Nov 14 09:47:48 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 09:47:48 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3fed285f-9be4-4601-8cb5-4329d7ebed8c -p 172.16.0.220:3260 --login {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:47:48 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a60d339f-e134-477c-8505-bf8c79d2a21c/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:47:48 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a60d339f-e134-477c-8505-bf8c79d2a21c/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:47:48 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-b300c569-d116-479c-b966-439bddf95408 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] No BDM found with device name vda, not building metadata. {{(pid=75229) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 09:47:48 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-b300c569-d116-479c-b966-439bddf95408 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] No VIF found with MAC fa:16:3e:27:a8:b8, not building metadata {{(pid=75229) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 09:47:48 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-65cb7584-889d-4d19-9969-57c66dc18090 tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/f46cd2031cc9dbf9a98522f8247ea10806506aa8.part /opt/stack/data/nova/instances/_base/f46cd2031cc9dbf9a98522f8247ea10806506aa8.converted" returned: 0 in 0.263s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:47:48 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-65cb7584-889d-4d19-9969-57c66dc18090 tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f46cd2031cc9dbf9a98522f8247ea10806506aa8.converted --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:47:48 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a60d339f-e134-477c-8505-bf8c79d2a21c/disk --force-share --output=json" returned: 0 in 0.302s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:47:48 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e09b3809-2e23-401c-9a72-88feb2bb657c/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:47:49 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-65cb7584-889d-4d19-9969-57c66dc18090 tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f46cd2031cc9dbf9a98522f8247ea10806506aa8.converted --force-share --output=json" returned: 0 in 0.239s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:47:49 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-65cb7584-889d-4d19-9969-57c66dc18090 tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Lock "f46cd2031cc9dbf9a98522f8247ea10806506aa8" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.474s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:47:49 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-65cb7584-889d-4d19-9969-57c66dc18090 tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f46cd2031cc9dbf9a98522f8247ea10806506aa8 --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:47:49 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e09b3809-2e23-401c-9a72-88feb2bb657c/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:47:49 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e09b3809-2e23-401c-9a72-88feb2bb657c/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:47:49 user nova-compute[75229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d15de80e-a866-48cd-b4e5-6701ac3009c4 tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] [instance: a60d339f-e134-477c-8505-bf8c79d2a21c] Calling os-brick to attach iSCSI Volume {{(pid=75229) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 09:47:49 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-d15de80e-a866-48cd-b4e5-6701ac3009c4 tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f73f85151b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:aca09258-022b-4f04-b418-f2a170332755', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BrhyGdAv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 09:47:49 user nova-compute[75229]: WARNING os_brick.initiator.connectors.base [None req-d15de80e-a866-48cd-b4e5-6701ac3009c4 tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 09:47:49 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-d15de80e-a866-48cd-b4e5-6701ac3009c4 tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 09:47:49 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-65cb7584-889d-4d19-9969-57c66dc18090 tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f46cd2031cc9dbf9a98522f8247ea10806506aa8 --force-share --output=json" returned: 0 in 0.219s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:47:49 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-65cb7584-889d-4d19-9969-57c66dc18090 tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Acquiring lock "f46cd2031cc9dbf9a98522f8247ea10806506aa8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:47:49 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-65cb7584-889d-4d19-9969-57c66dc18090 tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Lock "f46cd2031cc9dbf9a98522f8247ea10806506aa8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:47:49 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-65cb7584-889d-4d19-9969-57c66dc18090 tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f46cd2031cc9dbf9a98522f8247ea10806506aa8 --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:47:49 user nova-compute[75229]: DEBUG nova.network.neutron [req-1d8b63e8-c349-4e92-9537-92248899418b req-ca0fc5f0-adab-4e2a-9000-c45af7480687 service nova] [instance: 90bd76df-96cb-4bec-9862-853d94cdbaab] Updated VIF entry in instance network info cache for port 3b9b5b2a-5b1b-4ec6-900d-c27e7c4a625e. {{(pid=75229) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 09:47:49 user nova-compute[75229]: DEBUG nova.network.neutron [req-1d8b63e8-c349-4e92-9537-92248899418b req-ca0fc5f0-adab-4e2a-9000-c45af7480687 service nova] [instance: 90bd76df-96cb-4bec-9862-853d94cdbaab] Updating instance_info_cache with network_info: [{"id": "3b9b5b2a-5b1b-4ec6-900d-c27e7c4a625e", "address": "fa:16:3e:6e:aa:df", "network": {"id": "589aea41-545f-4875-ab56-b7aa273dad6f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-785276916-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee9447f169de43829fe3ed51592752e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b9b5b2a-5b", "ovs_interfaceid": "3b9b5b2a-5b1b-4ec6-900d-c27e7c4a625e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 09:47:49 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e09b3809-2e23-401c-9a72-88feb2bb657c/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:47:49 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75229) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 09:47:49 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75229) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 09:47:49 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] skipping disk /dev/sdd (vdc) as it is a volume {{(pid=75229) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 09:47:49 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-1d8b63e8-c349-4e92-9537-92248899418b req-ca0fc5f0-adab-4e2a-9000-c45af7480687 service nova] Releasing lock "refresh_cache-90bd76df-96cb-4bec-9862-853d94cdbaab" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 09:47:52 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3fed285f-9be4-4601-8cb5-4329d7ebed8c -p 172.16.0.220:3260 --login" returned: 0 in 1.090s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:47:52 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c5dd12a-b804-459b-a360-8f0b2156cba6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3fed285f-9be4-4601-8cb5-4329d7ebed8c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3fed285f-9be4-4601-8cb5-4329d7ebed8c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:47:52 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:47:52 user nova-compute[75229]: DEBUG nova.network.neutron [req-5b511e38-5481-47b1-a8a5-915b01547277 req-ea4976f6-3a9d-4608-b789-8eae284ae35b service nova] [instance: be813b28-133f-416a-b2b5-dc0b9e4064b7] Updated VIF entry in instance network info cache for port d9a42cb3-5297-4aaf-bf16-9e591cab2fdc. {{(pid=75229) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 09:47:52 user nova-compute[75229]: DEBUG nova.network.neutron [req-5b511e38-5481-47b1-a8a5-915b01547277 req-ea4976f6-3a9d-4608-b789-8eae284ae35b service nova] [instance: be813b28-133f-416a-b2b5-dc0b9e4064b7] Updating instance_info_cache with network_info: [{"id": "d9a42cb3-5297-4aaf-bf16-9e591cab2fdc", "address": "fa:16:3e:27:a8:b8", "network": {"id": "5dfc532f-3d5d-4342-b7f1-12c9c3992a54", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1457278473-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46e65cdd021f4a3db7c9254bb6d98b46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9a42cb3-52", "ovs_interfaceid": "d9a42cb3-5297-4aaf-bf16-9e591cab2fdc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 09:47:52 user nova-compute[75229]: DEBUG nova.compute.manager [req-509b8907-7e31-447f-b1d6-2f8abe33ae25 req-0a398ff3-a736-4798-8680-5ade88225446 service nova] [instance: be813b28-133f-416a-b2b5-dc0b9e4064b7] Received event network-vif-plugged-d9a42cb3-5297-4aaf-bf16-9e591cab2fdc {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:47:52 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-509b8907-7e31-447f-b1d6-2f8abe33ae25 req-0a398ff3-a736-4798-8680-5ade88225446 service nova] Acquiring lock "be813b28-133f-416a-b2b5-dc0b9e4064b7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:47:52 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-509b8907-7e31-447f-b1d6-2f8abe33ae25 req-0a398ff3-a736-4798-8680-5ade88225446 service nova] Lock "be813b28-133f-416a-b2b5-dc0b9e4064b7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:47:52 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-509b8907-7e31-447f-b1d6-2f8abe33ae25 req-0a398ff3-a736-4798-8680-5ade88225446 service nova] Lock "be813b28-133f-416a-b2b5-dc0b9e4064b7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:47:52 user nova-compute[75229]: DEBUG nova.compute.manager [req-509b8907-7e31-447f-b1d6-2f8abe33ae25 req-0a398ff3-a736-4798-8680-5ade88225446 service nova] [instance: be813b28-133f-416a-b2b5-dc0b9e4064b7] No waiting events found dispatching network-vif-plugged-d9a42cb3-5297-4aaf-bf16-9e591cab2fdc {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 09:47:52 user nova-compute[75229]: WARNING nova.compute.manager [req-509b8907-7e31-447f-b1d6-2f8abe33ae25 req-0a398ff3-a736-4798-8680-5ade88225446 service nova] [instance: be813b28-133f-416a-b2b5-dc0b9e4064b7] Received unexpected event network-vif-plugged-d9a42cb3-5297-4aaf-bf16-9e591cab2fdc for instance with vm_state building and task_state spawning.
Nov 14 09:47:52 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-79ab6320-9154-4531-b273-2c0b172feae1 tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3fed285f-9be4-4601-8cb5-4329d7ebed8c, portal: 172.16.0.220,3260]
Nov 14 09:47:52 user nova-compute[75229]: Login to [iface: default, target: iqn.2010-10.org.openstack:3fed285f-9be4-4601-8cb5-4329d7ebed8c, portal: 172.16.0.220,3260] successful.
Nov 14 09:47:52 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:47:52 user nova-compute[75229]: DEBUG nova.compute.manager [None req-b300c569-d116-479c-b966-439bddf95408 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] [instance: be813b28-133f-416a-b2b5-dc0b9e4064b7] Instance event wait completed in 0 seconds for  {{(pid=75229) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 09:47:52 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-b300c569-d116-479c-b966-439bddf95408 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] [instance: be813b28-133f-416a-b2b5-dc0b9e4064b7] Guest created on hypervisor {{(pid=75229) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 09:47:52 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-65cb7584-889d-4d19-9969-57c66dc18090 tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f46cd2031cc9dbf9a98522f8247ea10806506aa8 --force-share --output=json" returned: 0 in 3.415s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:47:52 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3fed285f-9be4-4601-8cb5-4329d7ebed8c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:47:52 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 09:47:52 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-65cb7584-889d-4d19-9969-57c66dc18090 tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f46cd2031cc9dbf9a98522f8247ea10806506aa8,backing_fmt=raw /opt/stack/data/nova/instances/90bd76df-96cb-4bec-9862-853d94cdbaab/disk 1073741824 {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:47:52 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3fed285f-9be4-4601-8cb5-4329d7ebed8c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:47:52 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[5acb4695-361a-411c-b361-af27fffb6dff]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:47:52 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-79ab6320-9154-4531-b273-2c0b172feae1 tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:47:52 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-5b511e38-5481-47b1-a8a5-915b01547277 req-ea4976f6-3a9d-4608-b789-8eae284ae35b service nova] Releasing lock "refresh_cache-be813b28-133f-416a-b2b5-dc0b9e4064b7" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 09:47:52 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:47:52 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:47:52 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-65cb7584-889d-4d19-9969-57c66dc18090 tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f46cd2031cc9dbf9a98522f8247ea10806506aa8,backing_fmt=raw /opt/stack/data/nova/instances/90bd76df-96cb-4bec-9862-853d94cdbaab/disk 1073741824" returned: 0 in 0.068s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:47:52 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-65cb7584-889d-4d19-9969-57c66dc18090 tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Lock "f46cd2031cc9dbf9a98522f8247ea10806506aa8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 3.490s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:47:52 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-65cb7584-889d-4d19-9969-57c66dc18090 tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f46cd2031cc9dbf9a98522f8247ea10806506aa8 --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:47:52 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:47:52 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[861ac374-0799-46eb-9dd9-eb2a49cb2257]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db131665-6ac2-437a-8adf-23593475a8aa (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0433e38-fa42-4cff-af48-8cb5da297597 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13c53511-ea64-4896-b325-504ce58d7895 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fed285f-9be4-4601-8cb5-4329d7ebed8c (non-flash)\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:47:52 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-79ab6320-9154-4531-b273-2c0b172feae1 tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db131665-6ac2-437a-8adf-23593475a8aa (non-flash)
Nov 14 09:47:52 user nova-compute[75229]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0433e38-fa42-4cff-af48-8cb5da297597 (non-flash)
Nov 14 09:47:52 user nova-compute[75229]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13c53511-ea64-4896-b325-504ce58d7895 (non-flash)
Nov 14 09:47:52 user nova-compute[75229]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fed285f-9be4-4601-8cb5-4329d7ebed8c (non-flash)
Nov 14 09:47:52 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 09:47:52 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-79ab6320-9154-4531-b273-2c0b172feae1 tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db131665-6ac2-437a-8adf-23593475a8aa (non-flash)
Nov 14 09:47:52 user nova-compute[75229]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0433e38-fa42-4cff-af48-8cb5da297597 (non-flash)
Nov 14 09:47:52 user nova-compute[75229]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13c53511-ea64-4896-b325-504ce58d7895 (non-flash)
Nov 14 09:47:52 user nova-compute[75229]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fed285f-9be4-4601-8cb5-4329d7ebed8c (non-flash)
Nov 14 09:47:52 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 09:47:52 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-79ab6320-9154-4531-b273-2c0b172feae1 tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3fed285f-9be4-4601-8cb5-4329d7ebed8c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 6.289s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 09:47:52 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-79ab6320-9154-4531-b273-2c0b172feae1 tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] Connected to 172.16.0.220:3260 {{(pid=75229) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 09:47:52 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-79ab6320-9154-4531-b273-2c0b172feae1 tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] HCTL ('36', '-', '-', 0) found on session 16 with lun 0 {{(pid=75229) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 09:47:52 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-79ab6320-9154-4531-b273-2c0b172feae1 tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75229) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 09:47:52 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:47:52 user nova-compute[75229]: WARNING nova.virt.libvirt.driver [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 09:47:52 user nova-compute[75229]: WARNING nova.virt.libvirt.driver [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 09:47:52 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Hypervisor/Node resource view: name=user free_ram=8124MB free_disk=25.597824096679688GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75229) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 09:47:52 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:47:52 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:47:52 user nova-compute[75229]: INFO nova.virt.libvirt.driver [-] [instance: be813b28-133f-416a-b2b5-dc0b9e4064b7] Instance spawned successfully.
Nov 14 09:47:52 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-b300c569-d116-479c-b966-439bddf95408 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] [instance: be813b28-133f-416a-b2b5-dc0b9e4064b7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 09:47:52 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.024s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:47:52 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c1a6914-f72c-48ef-9285-f0ab01858630]: (4, ('- - 0', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:47:52 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-79ab6320-9154-4531-b273-2c0b172feae1 tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] Searching for a device in session 16 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75229) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 09:47:52 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-79ab6320-9154-4531-b273-2c0b172feae1 tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:3fed285f-9be4-4601-8cb5-4329d7ebed8c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NPZTmsSG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75229) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 09:47:52 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-b300c569-d116-479c-b966-439bddf95408 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] [instance: be813b28-133f-416a-b2b5-dc0b9e4064b7] Found default for hw_cdrom_bus of ide {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 09:47:52 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-b300c569-d116-479c-b966-439bddf95408 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] [instance: be813b28-133f-416a-b2b5-dc0b9e4064b7] Found default for hw_disk_bus of virtio {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 09:47:52 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-b300c569-d116-479c-b966-439bddf95408 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] [instance: be813b28-133f-416a-b2b5-dc0b9e4064b7] Found default for hw_input_bus of None {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 09:47:52 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-b300c569-d116-479c-b966-439bddf95408 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] [instance: be813b28-133f-416a-b2b5-dc0b9e4064b7] Found default for hw_pointer_model of None {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 09:47:52 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-b300c569-d116-479c-b966-439bddf95408 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] [instance: be813b28-133f-416a-b2b5-dc0b9e4064b7] Found default for hw_video_model of virtio {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 09:47:52 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-b300c569-d116-479c-b966-439bddf95408 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] [instance: be813b28-133f-416a-b2b5-dc0b9e4064b7] Found default for hw_vif_model of virtio {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 09:47:53 user nova-compute[75229]: DEBUG nova.compute.manager [req-5c45e8e3-e849-438b-87f1-00e8fe0f8fa0 req-f5daa5f2-2c6f-482b-903a-40ef3c365aa6 service nova] [instance: be813b28-133f-416a-b2b5-dc0b9e4064b7] Received event network-vif-plugged-d9a42cb3-5297-4aaf-bf16-9e591cab2fdc {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:47:53 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-5c45e8e3-e849-438b-87f1-00e8fe0f8fa0 req-f5daa5f2-2c6f-482b-903a-40ef3c365aa6 service nova] Acquiring lock "be813b28-133f-416a-b2b5-dc0b9e4064b7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:47:53 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-5c45e8e3-e849-438b-87f1-00e8fe0f8fa0 req-f5daa5f2-2c6f-482b-903a-40ef3c365aa6 service nova] Lock "be813b28-133f-416a-b2b5-dc0b9e4064b7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:47:53 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-5c45e8e3-e849-438b-87f1-00e8fe0f8fa0 req-f5daa5f2-2c6f-482b-903a-40ef3c365aa6 service nova] Lock "be813b28-133f-416a-b2b5-dc0b9e4064b7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:47:53 user nova-compute[75229]: DEBUG nova.compute.manager [req-5c45e8e3-e849-438b-87f1-00e8fe0f8fa0 req-f5daa5f2-2c6f-482b-903a-40ef3c365aa6 service nova] [instance: be813b28-133f-416a-b2b5-dc0b9e4064b7] No waiting events found dispatching network-vif-plugged-d9a42cb3-5297-4aaf-bf16-9e591cab2fdc {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 09:47:53 user nova-compute[75229]: WARNING nova.compute.manager [req-5c45e8e3-e849-438b-87f1-00e8fe0f8fa0 req-f5daa5f2-2c6f-482b-903a-40ef3c365aa6 service nova] [instance: be813b28-133f-416a-b2b5-dc0b9e4064b7] Received unexpected event network-vif-plugged-d9a42cb3-5297-4aaf-bf16-9e591cab2fdc for instance with vm_state building and task_state spawning.
Nov 14 09:47:53 user nova-compute[75229]: INFO nova.compute.manager [None req-b300c569-d116-479c-b966-439bddf95408 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] [instance: be813b28-133f-416a-b2b5-dc0b9e4064b7] Took 9.15 seconds to spawn the instance on the hypervisor.
Nov 14 09:47:53 user nova-compute[75229]: DEBUG nova.compute.manager [None req-b300c569-d116-479c-b966-439bddf95408 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] [instance: be813b28-133f-416a-b2b5-dc0b9e4064b7] Checking state {{(pid=75229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 09:47:53 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-65cb7584-889d-4d19-9969-57c66dc18090 tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f46cd2031cc9dbf9a98522f8247ea10806506aa8 --force-share --output=json" returned: 0 in 0.286s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:47:53 user nova-compute[75229]: DEBUG nova.objects.instance [None req-65cb7584-889d-4d19-9969-57c66dc18090 tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Lazy-loading 'migration_context' on Instance uuid 90bd76df-96cb-4bec-9862-853d94cdbaab {{(pid=75229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 09:47:53 user nova-compute[75229]: DEBUG nova.objects.base [None req-65cb7584-889d-4d19-9969-57c66dc18090 tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Object Instance<90bd76df-96cb-4bec-9862-853d94cdbaab> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=75229) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 09:47:53 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-65cb7584-889d-4d19-9969-57c66dc18090 tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] [instance: 90bd76df-96cb-4bec-9862-853d94cdbaab] Rebasing disk image.
Nov 14 09:47:53 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-65cb7584-889d-4d19-9969-57c66dc18090 tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6 --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:47:53 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Instance a7750cbc-b3d0-44aa-8b88-c291ba007a8a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 09:47:53 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Instance e09b3809-2e23-401c-9a72-88feb2bb657c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 09:47:53 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Instance a60d339f-e134-477c-8505-bf8c79d2a21c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 09:47:53 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Instance eb53ba25-d865-41ae-90f3-6e154e2778ba actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 09:47:53 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Instance 38f30682-2278-40aa-914e-2867e771eb19 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 09:47:53 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Instance 9bcd05e7-481c-4ee9-953d-2873e6aa849d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 09:47:53 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] [instance: 90bd76df-96cb-4bec-9862-853d94cdbaab] Instance with task_state "spawning" is not being actively managed by this compute host but has allocations referencing this compute node (d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3): {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. Skipping heal of allocations during the task state transition. {{(pid=75229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1777}}
Nov 14 09:47:53 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Instance be813b28-133f-416a-b2b5-dc0b9e4064b7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 09:47:53 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=75229) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 09:47:53 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=75229) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 09:47:53 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-65cb7584-889d-4d19-9969-57c66dc18090 tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6 --force-share --output=json" returned: 0 in 0.211s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:47:53 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-65cb7584-889d-4d19-9969-57c66dc18090 tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6 -F raw /opt/stack/data/nova/instances/90bd76df-96cb-4bec-9862-853d94cdbaab/disk {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:47:53 user nova-compute[75229]: INFO nova.compute.manager [None req-b300c569-d116-479c-b966-439bddf95408 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] [instance: be813b28-133f-416a-b2b5-dc0b9e4064b7] Took 10.64 seconds to build instance.
Nov 14 09:47:53 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-b300c569-d116-479c-b966-439bddf95408 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Lock "be813b28-133f-416a-b2b5-dc0b9e4064b7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.887s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:47:53 user nova-compute[75229]: DEBUG nova.compute.provider_tree [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Inventory has not changed in ProviderTree for provider: d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 {{(pid=75229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 09:47:53 user nova-compute[75229]: DEBUG nova.scheduler.client.report [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Inventory has not changed for provider d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 09:47:53 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Compute_service record updated for user:user {{(pid=75229) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 09:47:53 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.914s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:47:53 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-79ab6320-9154-4531-b273-2c0b172feae1 tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 7.354s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 09:47:53 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-79ab6320-9154-4531-b273-2c0b172feae1 tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] <== connect_volume: return (7356ms) {'type': 'block', 'scsi_wwn': '26661303630626238', 'path': '/dev/sde'} {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 09:47:53 user nova-compute[75229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-79ab6320-9154-4531-b273-2c0b172feae1 tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] [instance: e09b3809-2e23-401c-9a72-88feb2bb657c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26661303630626238', 'path': '/dev/sde'} {{(pid=75229) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 09:47:53 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-d15de80e-a866-48cd-b4e5-6701ac3009c4 tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 4.712s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 09:47:53 user nova-compute[75229]: WARNING os_brick.initiator.connectors.base [None req-d15de80e-a866-48cd-b4e5-6701ac3009c4 tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 09:47:53 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-d15de80e-a866-48cd-b4e5-6701ac3009c4 tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:aca09258-022b-4f04-b418-f2a170332755" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 09:47:53 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-d15de80e-a866-48cd-b4e5-6701ac3009c4 tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:aca09258-022b-4f04-b418-f2a170332755" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 09:47:53 user nova-compute[75229]: INFO os_brick.initiator.connectors.iscsi [None req-d15de80e-a866-48cd-b4e5-6701ac3009c4 tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 09:47:53 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aca09258-022b-4f04-b418-f2a170332755 -p 172.16.0.220:3260 {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:47:53 user nova-compute[75229]: DEBUG nova.objects.instance [None req-79ab6320-9154-4531-b273-2c0b172feae1 tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] Lazy-loading 'flavor' on Instance uuid e09b3809-2e23-401c-9a72-88feb2bb657c {{(pid=75229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 09:47:53 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aca09258-022b-4f04-b418-f2a170332755 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:47:53 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[1168ec8d-c97e-4118-ae58-809d920e5b41]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:47:53 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-d15de80e-a866-48cd-b4e5-6701ac3009c4 tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 09:47:53 user nova-compute[75229]:  {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:47:53 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aca09258-022b-4f04-b418-f2a170332755 -p 172.16.0.220:3260 --interface default --op new {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:47:54 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aca09258-022b-4f04-b418-f2a170332755 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.027s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:47:54 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef7a3e6a-aa21-4cb8-b293-de3ed16d5ff1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:aca09258-022b-4f04-b418-f2a170332755] added\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:47:54 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-d15de80e-a866-48cd-b4e5-6701ac3009c4 tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:aca09258-022b-4f04-b418-f2a170332755] added
Nov 14 09:47:54 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:47:54 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aca09258-022b-4f04-b418-f2a170332755 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:47:54 user nova-compute[75229]: DEBUG nova.virt.libvirt.guest [None req-79ab6320-9154-4531-b273-2c0b172feae1 tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 09:47:54 user nova-compute[75229]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 09:47:54 user nova-compute[75229]:   <source dev="/dev/sde"/>
Nov 14 09:47:54 user nova-compute[75229]:   <target dev="vdb" bus="virtio"/>
Nov 14 09:47:54 user nova-compute[75229]:   <serial>3fed285f-9be4-4601-8cb5-4329d7ebed8c</serial>
Nov 14 09:47:54 user nova-compute[75229]: </disk>
Nov 14 09:47:54 user nova-compute[75229]:  {{(pid=75229) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 09:47:54 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aca09258-022b-4f04-b418-f2a170332755 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:47:54 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[78486931-40ad-423e-a3af-09af0fa509f0]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:47:54 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-d15de80e-a866-48cd-b4e5-6701ac3009c4 tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:47:54 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aca09258-022b-4f04-b418-f2a170332755 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:47:54 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aca09258-022b-4f04-b418-f2a170332755 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.035s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:47:54 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[3204ac9c-d238-46ae-8d0f-673036d5350a]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:47:54 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-d15de80e-a866-48cd-b4e5-6701ac3009c4 tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:47:54 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aca09258-022b-4f04-b418-f2a170332755 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BrhyGdAv {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:47:54 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aca09258-022b-4f04-b418-f2a170332755 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BrhyGdAv" returned: 0 in 0.022s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:47:54 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[285a60db-829a-48d2-98ee-c9a247858f87]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:47:54 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-d15de80e-a866-48cd-b4e5-6701ac3009c4 tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BrhyGdAv'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:47:54 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aca09258-022b-4f04-b418-f2a170332755 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:47:54 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aca09258-022b-4f04-b418-f2a170332755 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.029s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:47:54 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd1464b9-830a-42cf-b9d0-5baa5b71e142]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:47:54 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-d15de80e-a866-48cd-b4e5-6701ac3009c4 tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:47:54 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:47:54 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:47:54 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1694cb8-a64d-48a8-bef2-c1e6b3967647]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db131665-6ac2-437a-8adf-23593475a8aa (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0433e38-fa42-4cff-af48-8cb5da297597 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13c53511-ea64-4896-b325-504ce58d7895 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fed285f-9be4-4601-8cb5-4329d7ebed8c (non-flash)\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:47:54 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-d15de80e-a866-48cd-b4e5-6701ac3009c4 tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db131665-6ac2-437a-8adf-23593475a8aa (non-flash)
Nov 14 09:47:54 user nova-compute[75229]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0433e38-fa42-4cff-af48-8cb5da297597 (non-flash)
Nov 14 09:47:54 user nova-compute[75229]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13c53511-ea64-4896-b325-504ce58d7895 (non-flash)
Nov 14 09:47:54 user nova-compute[75229]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fed285f-9be4-4601-8cb5-4329d7ebed8c (non-flash)
Nov 14 09:47:54 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 09:47:54 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-d15de80e-a866-48cd-b4e5-6701ac3009c4 tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db131665-6ac2-437a-8adf-23593475a8aa (non-flash)
Nov 14 09:47:54 user nova-compute[75229]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0433e38-fa42-4cff-af48-8cb5da297597 (non-flash)
Nov 14 09:47:54 user nova-compute[75229]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13c53511-ea64-4896-b325-504ce58d7895 (non-flash)
Nov 14 09:47:54 user nova-compute[75229]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fed285f-9be4-4601-8cb5-4329d7ebed8c (non-flash)
Nov 14 09:47:54 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 09:47:54 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aca09258-022b-4f04-b418-f2a170332755 -p 172.16.0.220:3260 --login {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:47:54 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aca09258-022b-4f04-b418-f2a170332755 -p 172.16.0.220:3260 --login" returned: 0 in 0.084s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:47:54 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[437fa84c-2dff-4ece-a24d-0fade6b0aae1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:aca09258-022b-4f04-b418-f2a170332755, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:aca09258-022b-4f04-b418-f2a170332755, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:47:54 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-d15de80e-a866-48cd-b4e5-6701ac3009c4 tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:aca09258-022b-4f04-b418-f2a170332755, portal: 172.16.0.220,3260]
Nov 14 09:47:54 user nova-compute[75229]: Login to [iface: default, target: iqn.2010-10.org.openstack:aca09258-022b-4f04-b418-f2a170332755, portal: 172.16.0.220,3260] successful.
Nov 14 09:47:54 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:47:54 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aca09258-022b-4f04-b418-f2a170332755 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:47:54 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aca09258-022b-4f04-b418-f2a170332755 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.039s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:47:54 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[522099cc-f2e0-4b95-b362-b9375e6504a3]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:47:54 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-d15de80e-a866-48cd-b4e5-6701ac3009c4 tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:47:54 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:47:54 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:47:54 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[987c9d2f-b78e-47da-9f65-193c92352438]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db131665-6ac2-437a-8adf-23593475a8aa (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0433e38-fa42-4cff-af48-8cb5da297597 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13c53511-ea64-4896-b325-504ce58d7895 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fed285f-9be4-4601-8cb5-4329d7ebed8c (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aca09258-022b-4f04-b418-f2a170332755 (non-flash)\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:47:54 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-d15de80e-a866-48cd-b4e5-6701ac3009c4 tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db131665-6ac2-437a-8adf-23593475a8aa (non-flash)
Nov 14 09:47:54 user nova-compute[75229]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0433e38-fa42-4cff-af48-8cb5da297597 (non-flash)
Nov 14 09:47:54 user nova-compute[75229]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13c53511-ea64-4896-b325-504ce58d7895 (non-flash)
Nov 14 09:47:54 user nova-compute[75229]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fed285f-9be4-4601-8cb5-4329d7ebed8c (non-flash)
Nov 14 09:47:54 user nova-compute[75229]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aca09258-022b-4f04-b418-f2a170332755 (non-flash)
Nov 14 09:47:54 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 09:47:54 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-d15de80e-a866-48cd-b4e5-6701ac3009c4 tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db131665-6ac2-437a-8adf-23593475a8aa (non-flash)
Nov 14 09:47:54 user nova-compute[75229]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0433e38-fa42-4cff-af48-8cb5da297597 (non-flash)
Nov 14 09:47:54 user nova-compute[75229]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13c53511-ea64-4896-b325-504ce58d7895 (non-flash)
Nov 14 09:47:54 user nova-compute[75229]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fed285f-9be4-4601-8cb5-4329d7ebed8c (non-flash)
Nov 14 09:47:54 user nova-compute[75229]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aca09258-022b-4f04-b418-f2a170332755 (non-flash)
Nov 14 09:47:54 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 09:47:54 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-d15de80e-a866-48cd-b4e5-6701ac3009c4 tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:aca09258-022b-4f04-b418-f2a170332755" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.415s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 09:47:54 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-d15de80e-a866-48cd-b4e5-6701ac3009c4 tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] Connected to 172.16.0.220:3260 {{(pid=75229) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 09:47:54 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-d15de80e-a866-48cd-b4e5-6701ac3009c4 tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] HCTL ('37', '-', '-', 0) found on session 17 with lun 0 {{(pid=75229) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 09:47:54 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-d15de80e-a866-48cd-b4e5-6701ac3009c4 tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75229) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 09:47:54 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:47:54 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.030s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:47:54 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[c42ad040-76ce-438b-b923-9a3c202b0557]: (4, ('- - 0', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:47:54 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-d15de80e-a866-48cd-b4e5-6701ac3009c4 tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] Searching for a device in session 17 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75229) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 09:47:54 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-d15de80e-a866-48cd-b4e5-6701ac3009c4 tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:aca09258-022b-4f04-b418-f2a170332755', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BrhyGdAv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75229) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 09:47:54 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-79ab6320-9154-4531-b273-2c0b172feae1 tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] No BDM found with device name vda, not building metadata. {{(pid=75229) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 09:47:54 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-79ab6320-9154-4531-b273-2c0b172feae1 tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75229) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 09:47:54 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-79ab6320-9154-4531-b273-2c0b172feae1 tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] No VIF found with MAC fa:16:3e:9f:3a:e8, not building metadata {{(pid=75229) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 09:47:54 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:47:54 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-79ab6320-9154-4531-b273-2c0b172feae1 tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] Lock "e09b3809-2e23-401c-9a72-88feb2bb657c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 14.390s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:47:54 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 09:47:54 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 09:47:54 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 09:47:54 user nova-compute[75229]: DEBUG nova.compute.manager [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Starting heal instance info cache {{(pid=75229) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 09:47:54 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Acquiring lock "refresh_cache-e09b3809-2e23-401c-9a72-88feb2bb657c" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 09:47:54 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Acquired lock "refresh_cache-e09b3809-2e23-401c-9a72-88feb2bb657c" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 09:47:54 user nova-compute[75229]: DEBUG nova.network.neutron [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] [instance: e09b3809-2e23-401c-9a72-88feb2bb657c] Forcefully refreshing network info cache for instance {{(pid=75229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 09:47:55 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-d15de80e-a866-48cd-b4e5-6701ac3009c4 tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.475s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 09:47:55 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-d15de80e-a866-48cd-b4e5-6701ac3009c4 tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] <== connect_volume: return (6187ms) {'type': 'block', 'scsi_wwn': '23266303965393733', 'path': '/dev/sdf'} {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 09:47:55 user nova-compute[75229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d15de80e-a866-48cd-b4e5-6701ac3009c4 tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] [instance: a60d339f-e134-477c-8505-bf8c79d2a21c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23266303965393733', 'path': '/dev/sdf'} {{(pid=75229) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 09:47:55 user nova-compute[75229]: DEBUG nova.objects.instance [None req-d15de80e-a866-48cd-b4e5-6701ac3009c4 tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] Lazy-loading 'flavor' on Instance uuid a60d339f-e134-477c-8505-bf8c79d2a21c {{(pid=75229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 09:47:55 user nova-compute[75229]: DEBUG nova.virt.libvirt.guest [None req-d15de80e-a866-48cd-b4e5-6701ac3009c4 tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 09:47:55 user nova-compute[75229]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 09:47:55 user nova-compute[75229]:   <source dev="/dev/sdf"/>
Nov 14 09:47:55 user nova-compute[75229]:   <target dev="vdb" bus="virtio"/>
Nov 14 09:47:55 user nova-compute[75229]:   <serial>aca09258-022b-4f04-b418-f2a170332755</serial>
Nov 14 09:47:55 user nova-compute[75229]: </disk>
Nov 14 09:47:55 user nova-compute[75229]:  {{(pid=75229) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 09:47:55 user nova-compute[75229]: DEBUG nova.network.neutron [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] [instance: e09b3809-2e23-401c-9a72-88feb2bb657c] Updating instance_info_cache with network_info: [{"id": "472488d2-9453-4d74-a6b1-6966b835572d", "address": "fa:16:3e:9f:3a:e8", "network": {"id": "f5285ef5-fa74-4079-a8cd-f970d97c97c3", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-62550527-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.73", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54dca06fda8b43d5bc92fa7c97a872a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap472488d2-94", "ovs_interfaceid": "472488d2-9453-4d74-a6b1-6966b835572d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 09:47:55 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Releasing lock "refresh_cache-e09b3809-2e23-401c-9a72-88feb2bb657c" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 09:47:55 user nova-compute[75229]: DEBUG nova.compute.manager [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] [instance: e09b3809-2e23-401c-9a72-88feb2bb657c] Updated the network info_cache for instance {{(pid=75229) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 09:47:55 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 09:47:55 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 09:47:55 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 09:47:55 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 09:47:55 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 09:47:55 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 09:47:55 user nova-compute[75229]: DEBUG nova.compute.manager [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75229) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 09:47:55 user nova-compute[75229]: INFO nova.compute.manager [None req-4431daf5-21b2-4d0f-8867-50a609adbff9 tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] [instance: e09b3809-2e23-401c-9a72-88feb2bb657c] Rescuing
Nov 14 09:47:55 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-4431daf5-21b2-4d0f-8867-50a609adbff9 tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] Acquiring lock "refresh_cache-e09b3809-2e23-401c-9a72-88feb2bb657c" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 09:47:55 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-4431daf5-21b2-4d0f-8867-50a609adbff9 tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] Acquired lock "refresh_cache-e09b3809-2e23-401c-9a72-88feb2bb657c" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 09:47:55 user nova-compute[75229]: DEBUG nova.network.neutron [None req-4431daf5-21b2-4d0f-8867-50a609adbff9 tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] [instance: e09b3809-2e23-401c-9a72-88feb2bb657c] Building network info cache for instance {{(pid=75229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 09:47:56 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-d15de80e-a866-48cd-b4e5-6701ac3009c4 tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] No BDM found with device name vda, not building metadata. {{(pid=75229) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 09:47:56 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-d15de80e-a866-48cd-b4e5-6701ac3009c4 tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75229) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 09:47:56 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-d15de80e-a866-48cd-b4e5-6701ac3009c4 tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] No VIF found with MAC fa:16:3e:6c:f4:6d, not building metadata {{(pid=75229) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 09:47:56 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-65cb7584-889d-4d19-9969-57c66dc18090 tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6 -F raw /opt/stack/data/nova/instances/90bd76df-96cb-4bec-9862-853d94cdbaab/disk" returned: 0 in 2.709s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:47:56 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-65cb7584-889d-4d19-9969-57c66dc18090 tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] [instance: 90bd76df-96cb-4bec-9862-853d94cdbaab] Created local disks {{(pid=75229) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 09:47:56 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-65cb7584-889d-4d19-9969-57c66dc18090 tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] [instance: 90bd76df-96cb-4bec-9862-853d94cdbaab] Ensure instance console log exists: /opt/stack/data/nova/instances/90bd76df-96cb-4bec-9862-853d94cdbaab/console.log {{(pid=75229) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 09:47:56 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-65cb7584-889d-4d19-9969-57c66dc18090 tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:47:56 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-65cb7584-889d-4d19-9969-57c66dc18090 tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:47:56 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-65cb7584-889d-4d19-9969-57c66dc18090 tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:47:56 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-65cb7584-889d-4d19-9969-57c66dc18090 tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] [instance: 90bd76df-96cb-4bec-9862-853d94cdbaab] Start _get_guest_xml network_info=[{"id": "3b9b5b2a-5b1b-4ec6-900d-c27e7c4a625e", "address": "fa:16:3e:6e:aa:df", "network": {"id": "589aea41-545f-4875-ab56-b7aa273dad6f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-785276916-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee9447f169de43829fe3ed51592752e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b9b5b2a-5b", "ovs_interfaceid": "3b9b5b2a-5b1b-4ec6-900d-c27e7c4a625e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='50ce08d70d91e9a7f415d7a2bdfe8bda',container_format='bare',created_at=2023-11-14T09:45:45Z,direct_url=<?>,disk_format='qcow2',id=55b212ef-adfd-491b-9fbc-0043d02f3866,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-87180804-shelved',owner='ee9447f169de43829fe3ed51592752e9',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-11-14T09:45:50Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'disk_bus': 'virtio', 'guest_format': None, 'encryption_secret_uuid': None, 'size': 0, 'device_type': 'disk', 'image_id': '3bef8470-ecc7-40e3-95d4-9254348ea72d'}], 'ephemerals': [], 'block_device_mapping': [{'boot_index': None, 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:5b54e594-ae66-4ba2-9bda-aa4431d31c3f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fPmAiwBK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attached', 'instance': '90bd76df-96cb-4bec-9862-853d94cdbaab', 'attached_at': '', 'detached_at': '', 'volume_id': '5b54e594-ae66-4ba2-9bda-aa4431d31c3f', 'serial': '5b54e594-ae66-4ba2-9bda-aa4431d31c3f'}, 'disk_bus': 'virtio', 'mount_device': '/dev/vdc', 'attachment_id': '6395e1ce-39ce-4b81-a075-19bcc25ce3f4', 'guest_format': None, 'device_type': 'disk', 'volume_type': None} {{(pid=75229) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 09:47:56 user nova-compute[75229]: WARNING nova.virt.libvirt.driver [None req-65cb7584-889d-4d19-9969-57c66dc18090 tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 09:47:56 user nova-compute[75229]: WARNING nova.virt.libvirt.driver [None req-65cb7584-889d-4d19-9969-57c66dc18090 tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 09:47:56 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-65cb7584-889d-4d19-9969-57c66dc18090 tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75229) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 09:47:56 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-65cb7584-889d-4d19-9969-57c66dc18090 tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] CPU controller missing on host. {{(pid=75229) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 09:47:56 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-65cb7584-889d-4d19-9969-57c66dc18090 tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75229) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 09:47:56 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-65cb7584-889d-4d19-9969-57c66dc18090 tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] CPU controller found on host. {{(pid=75229) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 09:47:56 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-65cb7584-889d-4d19-9969-57c66dc18090 tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75229) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 09:47:56 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-65cb7584-889d-4d19-9969-57c66dc18090 tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T09:39:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='50ce08d70d91e9a7f415d7a2bdfe8bda',container_format='bare',created_at=2023-11-14T09:45:45Z,direct_url=<?>,disk_format='qcow2',id=55b212ef-adfd-491b-9fbc-0043d02f3866,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-87180804-shelved',owner='ee9447f169de43829fe3ed51592752e9',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-11-14T09:45:50Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 09:47:56 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-65cb7584-889d-4d19-9969-57c66dc18090 tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Flavor limits 0:0:0 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 09:47:56 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-65cb7584-889d-4d19-9969-57c66dc18090 tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Image limits 0:0:0 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 09:47:56 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-65cb7584-889d-4d19-9969-57c66dc18090 tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Flavor pref 0:0:0 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 09:47:56 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-65cb7584-889d-4d19-9969-57c66dc18090 tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Image pref 0:0:0 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 09:47:56 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-65cb7584-889d-4d19-9969-57c66dc18090 tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 09:47:56 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-65cb7584-889d-4d19-9969-57c66dc18090 tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 09:47:56 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-65cb7584-889d-4d19-9969-57c66dc18090 tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75229) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 09:47:56 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-65cb7584-889d-4d19-9969-57c66dc18090 tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Got 1 possible topologies {{(pid=75229) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 09:47:56 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-65cb7584-889d-4d19-9969-57c66dc18090 tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 09:47:56 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-65cb7584-889d-4d19-9969-57c66dc18090 tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 09:47:56 user nova-compute[75229]: DEBUG nova.objects.instance [None req-65cb7584-889d-4d19-9969-57c66dc18090 tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Lazy-loading 'vcpu_model' on Instance uuid 90bd76df-96cb-4bec-9862-853d94cdbaab {{(pid=75229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 09:47:56 user nova-compute[75229]: DEBUG nova.objects.base [None req-65cb7584-889d-4d19-9969-57c66dc18090 tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Object Instance<90bd76df-96cb-4bec-9862-853d94cdbaab> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=75229) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 09:47:56 user nova-compute[75229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-65cb7584-889d-4d19-9969-57c66dc18090 tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] [instance: 90bd76df-96cb-4bec-9862-853d94cdbaab] Calling os-brick to attach iSCSI Volume {{(pid=75229) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 09:47:56 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-65cb7584-889d-4d19-9969-57c66dc18090 tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f73f85151b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5b54e594-ae66-4ba2-9bda-aa4431d31c3f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fPmAiwBK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 09:47:56 user nova-compute[75229]: WARNING os_brick.initiator.connectors.base [None req-65cb7584-889d-4d19-9969-57c66dc18090 tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 09:47:56 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-65cb7584-889d-4d19-9969-57c66dc18090 tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 09:47:56 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-65cb7584-889d-4d19-9969-57c66dc18090 tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 09:47:56 user nova-compute[75229]: WARNING os_brick.initiator.connectors.base [None req-65cb7584-889d-4d19-9969-57c66dc18090 tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 09:47:56 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-65cb7584-889d-4d19-9969-57c66dc18090 tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5b54e594-ae66-4ba2-9bda-aa4431d31c3f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 09:47:56 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-65cb7584-889d-4d19-9969-57c66dc18090 tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5b54e594-ae66-4ba2-9bda-aa4431d31c3f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 09:47:56 user nova-compute[75229]: INFO os_brick.initiator.connectors.iscsi [None req-65cb7584-889d-4d19-9969-57c66dc18090 tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 09:47:56 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b54e594-ae66-4ba2-9bda-aa4431d31c3f -p 172.16.0.220:3260 {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:47:56 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b54e594-ae66-4ba2-9bda-aa4431d31c3f -p 172.16.0.220:3260" returned: 21 in 0.026s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:47:56 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[80f2c138-c7c9-454f-825f-5f81dd133474]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:47:56 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-65cb7584-889d-4d19-9969-57c66dc18090 tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 09:47:56 user nova-compute[75229]:  {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:47:56 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b54e594-ae66-4ba2-9bda-aa4431d31c3f -p 172.16.0.220:3260 --interface default --op new {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:47:56 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b54e594-ae66-4ba2-9bda-aa4431d31c3f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:47:56 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a57d34c-3eaa-45d5-9a6a-8bdb43efa24c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5b54e594-ae66-4ba2-9bda-aa4431d31c3f] added\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:47:56 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-65cb7584-889d-4d19-9969-57c66dc18090 tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5b54e594-ae66-4ba2-9bda-aa4431d31c3f] added
Nov 14 09:47:56 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:47:56 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b54e594-ae66-4ba2-9bda-aa4431d31c3f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:47:56 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b54e594-ae66-4ba2-9bda-aa4431d31c3f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:47:56 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ff3a1c6-19a7-4a9e-88fe-cdcae885a98a]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:47:56 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-65cb7584-889d-4d19-9969-57c66dc18090 tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:47:56 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b54e594-ae66-4ba2-9bda-aa4431d31c3f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:47:56 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b54e594-ae66-4ba2-9bda-aa4431d31c3f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:47:56 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7e20e47-df17-4eda-9e10-b8bca85f0169]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:47:56 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-65cb7584-889d-4d19-9969-57c66dc18090 tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:47:56 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-d15de80e-a866-48cd-b4e5-6701ac3009c4 tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] Lock "a60d339f-e134-477c-8505-bf8c79d2a21c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.632s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:47:56 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b54e594-ae66-4ba2-9bda-aa4431d31c3f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fPmAiwBK {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:47:56 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b54e594-ae66-4ba2-9bda-aa4431d31c3f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fPmAiwBK" returned: 0 in 0.028s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:47:56 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[03c5b276-7c62-47f9-a1ed-f42da7cfce1c]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:47:56 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-65cb7584-889d-4d19-9969-57c66dc18090 tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'fPmAiwBK'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:47:56 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b54e594-ae66-4ba2-9bda-aa4431d31c3f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:47:56 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b54e594-ae66-4ba2-9bda-aa4431d31c3f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:47:56 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa091fbc-83a7-414c-be57-ccfc610dc3a9]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:47:56 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-65cb7584-889d-4d19-9969-57c66dc18090 tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:47:56 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:47:56 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:47:56 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a346360-42a6-4906-b631-939db601f9a0]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db131665-6ac2-437a-8adf-23593475a8aa (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0433e38-fa42-4cff-af48-8cb5da297597 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13c53511-ea64-4896-b325-504ce58d7895 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fed285f-9be4-4601-8cb5-4329d7ebed8c (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aca09258-022b-4f04-b418-f2a170332755 (non-flash)\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:47:56 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-65cb7584-889d-4d19-9969-57c66dc18090 tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db131665-6ac2-437a-8adf-23593475a8aa (non-flash)
Nov 14 09:47:56 user nova-compute[75229]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0433e38-fa42-4cff-af48-8cb5da297597 (non-flash)
Nov 14 09:47:56 user nova-compute[75229]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13c53511-ea64-4896-b325-504ce58d7895 (non-flash)
Nov 14 09:47:56 user nova-compute[75229]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fed285f-9be4-4601-8cb5-4329d7ebed8c (non-flash)
Nov 14 09:47:56 user nova-compute[75229]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aca09258-022b-4f04-b418-f2a170332755 (non-flash)
Nov 14 09:47:56 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 09:47:56 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-65cb7584-889d-4d19-9969-57c66dc18090 tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db131665-6ac2-437a-8adf-23593475a8aa (non-flash)
Nov 14 09:47:56 user nova-compute[75229]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0433e38-fa42-4cff-af48-8cb5da297597 (non-flash)
Nov 14 09:47:56 user nova-compute[75229]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13c53511-ea64-4896-b325-504ce58d7895 (non-flash)
Nov 14 09:47:56 user nova-compute[75229]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fed285f-9be4-4601-8cb5-4329d7ebed8c (non-flash)
Nov 14 09:47:56 user nova-compute[75229]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aca09258-022b-4f04-b418-f2a170332755 (non-flash)
Nov 14 09:47:56 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 09:47:56 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b54e594-ae66-4ba2-9bda-aa4431d31c3f -p 172.16.0.220:3260 --login {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:47:56 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b54e594-ae66-4ba2-9bda-aa4431d31c3f -p 172.16.0.220:3260 --login" returned: 0 in 0.146s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:47:56 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd66b92e-456e-481d-9ca5-a2b4395503ac]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5b54e594-ae66-4ba2-9bda-aa4431d31c3f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5b54e594-ae66-4ba2-9bda-aa4431d31c3f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:47:56 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-65cb7584-889d-4d19-9969-57c66dc18090 tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5b54e594-ae66-4ba2-9bda-aa4431d31c3f, portal: 172.16.0.220,3260]
Nov 14 09:47:56 user nova-compute[75229]: Login to [iface: default, target: iqn.2010-10.org.openstack:5b54e594-ae66-4ba2-9bda-aa4431d31c3f, portal: 172.16.0.220,3260] successful.
Nov 14 09:47:56 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:47:56 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b54e594-ae66-4ba2-9bda-aa4431d31c3f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:47:56 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b54e594-ae66-4ba2-9bda-aa4431d31c3f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:47:56 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a61ab1d-cd51-49ea-a865-e73e0856a5f2]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:47:56 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-65cb7584-889d-4d19-9969-57c66dc18090 tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:47:56 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:47:56 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:47:56 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f7d8641-7148-428e-a3f3-7cd0137dd383]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db131665-6ac2-437a-8adf-23593475a8aa (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0433e38-fa42-4cff-af48-8cb5da297597 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13c53511-ea64-4896-b325-504ce58d7895 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fed285f-9be4-4601-8cb5-4329d7ebed8c (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aca09258-022b-4f04-b418-f2a170332755 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b54e594-ae66-4ba2-9bda-aa4431d31c3f (non-flash)\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:47:56 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-65cb7584-889d-4d19-9969-57c66dc18090 tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db131665-6ac2-437a-8adf-23593475a8aa (non-flash)
Nov 14 09:47:56 user nova-compute[75229]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0433e38-fa42-4cff-af48-8cb5da297597 (non-flash)
Nov 14 09:47:56 user nova-compute[75229]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13c53511-ea64-4896-b325-504ce58d7895 (non-flash)
Nov 14 09:47:56 user nova-compute[75229]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fed285f-9be4-4601-8cb5-4329d7ebed8c (non-flash)
Nov 14 09:47:56 user nova-compute[75229]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aca09258-022b-4f04-b418-f2a170332755 (non-flash)
Nov 14 09:47:56 user nova-compute[75229]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b54e594-ae66-4ba2-9bda-aa4431d31c3f (non-flash)
Nov 14 09:47:56 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 09:47:56 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-65cb7584-889d-4d19-9969-57c66dc18090 tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db131665-6ac2-437a-8adf-23593475a8aa (non-flash)
Nov 14 09:47:56 user nova-compute[75229]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0433e38-fa42-4cff-af48-8cb5da297597 (non-flash)
Nov 14 09:47:56 user nova-compute[75229]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13c53511-ea64-4896-b325-504ce58d7895 (non-flash)
Nov 14 09:47:56 user nova-compute[75229]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fed285f-9be4-4601-8cb5-4329d7ebed8c (non-flash)
Nov 14 09:47:56 user nova-compute[75229]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aca09258-022b-4f04-b418-f2a170332755 (non-flash)
Nov 14 09:47:56 user nova-compute[75229]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b54e594-ae66-4ba2-9bda-aa4431d31c3f (non-flash)
Nov 14 09:47:56 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 09:47:56 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-65cb7584-889d-4d19-9969-57c66dc18090 tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5b54e594-ae66-4ba2-9bda-aa4431d31c3f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.425s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 09:47:56 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-65cb7584-889d-4d19-9969-57c66dc18090 tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Connected to 172.16.0.220:3260 {{(pid=75229) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 09:47:56 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-65cb7584-889d-4d19-9969-57c66dc18090 tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] HCTL ('38', '-', '-', 0) found on session 18 with lun 0 {{(pid=75229) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 09:47:56 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-65cb7584-889d-4d19-9969-57c66dc18090 tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=75229) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 09:47:56 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:47:56 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.030s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:47:56 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7dbf70a-828a-43a5-a040-608c4b2667aa]: (4, ('- - 0', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:47:56 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-65cb7584-889d-4d19-9969-57c66dc18090 tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Searching for a device in session 18 and hctl ['38', '*', '*', 0] yield: None {{(pid=75229) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 09:47:56 user nova-compute[75229]: DEBUG nova.network.neutron [None req-4431daf5-21b2-4d0f-8867-50a609adbff9 tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] [instance: e09b3809-2e23-401c-9a72-88feb2bb657c] Updating instance_info_cache with network_info: [{"id": "472488d2-9453-4d74-a6b1-6966b835572d", "address": "fa:16:3e:9f:3a:e8", "network": {"id": "f5285ef5-fa74-4079-a8cd-f970d97c97c3", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-62550527-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.73", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54dca06fda8b43d5bc92fa7c97a872a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap472488d2-94", "ovs_interfaceid": "472488d2-9453-4d74-a6b1-6966b835572d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 09:47:56 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-4431daf5-21b2-4d0f-8867-50a609adbff9 tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] Releasing lock "refresh_cache-e09b3809-2e23-401c-9a72-88feb2bb657c" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 09:47:57 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:47:57 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:47:57 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:47:57 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:47:57 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-65cb7584-889d-4d19-9969-57c66dc18090 tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Searching for a device in session 18 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=75229) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 09:47:57 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-65cb7584-889d-4d19-9969-57c66dc18090 tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:5b54e594-ae66-4ba2-9bda-aa4431d31c3f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fPmAiwBK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75229) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 09:47:57 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-65cb7584-889d-4d19-9969-57c66dc18090 tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.468s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 09:47:57 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-65cb7584-889d-4d19-9969-57c66dc18090 tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] <== connect_volume: return (1470ms) {'type': 'block', 'scsi_wwn': '23239343330363537', 'path': '/dev/sdg'} {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 09:47:57 user nova-compute[75229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-65cb7584-889d-4d19-9969-57c66dc18090 tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] [instance: 90bd76df-96cb-4bec-9862-853d94cdbaab] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23239343330363537', 'path': '/dev/sdg'} {{(pid=75229) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 09:47:57 user nova-compute[75229]: DEBUG nova.virt.libvirt.vif [None req-65cb7584-889d-4d19-9969-57c66dc18090 tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-14T09:43:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-87180804',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-87180804',id=1,image_ref='55b212ef-adfd-491b-9fbc-0043d02f3866',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-454270943',keypairs=<?>,launch_index=0,launched_at=2023-11-14T09:44:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='ee9447f169de43829fe3ed51592752e9',ramdisk_id='',reservation_id='r-p5469a2c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-730167895',owner_user_name='tempest-AttachVolumeShelveTestJSON-730167895-project-member',shelved_at='2023-11-14T09:45:49.706176',shelved_host='user',shelved_image_id='55b212ef-adfd-491b-9fbc-0043d02f3866'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T09:47:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='319a0a5ee47a426799d40e0ebb62a3b0',uuid=90bd76df-96cb-4bec-9862-853d94cdbaab,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "3b9b5b2a-5b1b-4ec6-900d-c27e7c4a625e", "address": "fa:16:3e:6e:aa:df", "network": {"id": "589aea41-545f-4875-ab56-b7aa273dad6f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-785276916-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee9447f169de43829fe3ed51592752e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b9b5b2a-5b", "ovs_interfaceid": "3b9b5b2a-5b1b-4ec6-900d-c27e7c4a625e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75229) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 09:47:57 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-65cb7584-889d-4d19-9969-57c66dc18090 tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Converting VIF {"id": "3b9b5b2a-5b1b-4ec6-900d-c27e7c4a625e", "address": "fa:16:3e:6e:aa:df", "network": {"id": "589aea41-545f-4875-ab56-b7aa273dad6f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-785276916-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee9447f169de43829fe3ed51592752e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b9b5b2a-5b", "ovs_interfaceid": "3b9b5b2a-5b1b-4ec6-900d-c27e7c4a625e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 09:47:57 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-65cb7584-889d-4d19-9969-57c66dc18090 tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6e:aa:df,bridge_name='br-int',has_traffic_filtering=True,id=3b9b5b2a-5b1b-4ec6-900d-c27e7c4a625e,network=Network(589aea41-545f-4875-ab56-b7aa273dad6f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b9b5b2a-5b') {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 09:47:57 user nova-compute[75229]: DEBUG nova.objects.instance [None req-65cb7584-889d-4d19-9969-57c66dc18090 tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Lazy-loading 'pci_devices' on Instance uuid 90bd76df-96cb-4bec-9862-853d94cdbaab {{(pid=75229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 09:47:57 user nova-compute[75229]: DEBUG nova.objects.base [None req-65cb7584-889d-4d19-9969-57c66dc18090 tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Object Instance<90bd76df-96cb-4bec-9862-853d94cdbaab> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=75229) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 09:47:57 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-65cb7584-889d-4d19-9969-57c66dc18090 tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] [instance: 90bd76df-96cb-4bec-9862-853d94cdbaab] End _get_guest_xml xml=<domain type="kvm">
Nov 14 09:47:57 user nova-compute[75229]:   <uuid>90bd76df-96cb-4bec-9862-853d94cdbaab</uuid>
Nov 14 09:47:57 user nova-compute[75229]:   <name>instance-00000001</name>
Nov 14 09:47:57 user nova-compute[75229]:   <memory>524288</memory>
Nov 14 09:47:57 user nova-compute[75229]:   <vcpu>1</vcpu>
Nov 14 09:47:57 user nova-compute[75229]:   <metadata>
Nov 14 09:47:57 user nova-compute[75229]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 09:47:57 user nova-compute[75229]:       <nova:package version="0.0.0"/>
Nov 14 09:47:57 user nova-compute[75229]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-87180804</nova:name>
Nov 14 09:47:57 user nova-compute[75229]:       <nova:creationTime>2023-11-14 09:47:56</nova:creationTime>
Nov 14 09:47:57 user nova-compute[75229]:       <nova:flavor name="m1.tiny">
Nov 14 09:47:57 user nova-compute[75229]:         <nova:memory>512</nova:memory>
Nov 14 09:47:57 user nova-compute[75229]:         <nova:disk>1</nova:disk>
Nov 14 09:47:57 user nova-compute[75229]:         <nova:swap>0</nova:swap>
Nov 14 09:47:57 user nova-compute[75229]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 09:47:57 user nova-compute[75229]:         <nova:vcpus>1</nova:vcpus>
Nov 14 09:47:57 user nova-compute[75229]:       </nova:flavor>
Nov 14 09:47:57 user nova-compute[75229]:       <nova:owner>
Nov 14 09:47:57 user nova-compute[75229]:         <nova:user uuid="319a0a5ee47a426799d40e0ebb62a3b0">tempest-AttachVolumeShelveTestJSON-730167895-project-member</nova:user>
Nov 14 09:47:57 user nova-compute[75229]:         <nova:project uuid="ee9447f169de43829fe3ed51592752e9">tempest-AttachVolumeShelveTestJSON-730167895</nova:project>
Nov 14 09:47:57 user nova-compute[75229]:       </nova:owner>
Nov 14 09:47:57 user nova-compute[75229]:       <nova:root type="image" uuid="55b212ef-adfd-491b-9fbc-0043d02f3866"/>
Nov 14 09:47:57 user nova-compute[75229]:       <nova:ports>
Nov 14 09:47:57 user nova-compute[75229]:         <nova:port uuid="3b9b5b2a-5b1b-4ec6-900d-c27e7c4a625e">
Nov 14 09:47:57 user nova-compute[75229]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 14 09:47:57 user nova-compute[75229]:         </nova:port>
Nov 14 09:47:57 user nova-compute[75229]:       </nova:ports>
Nov 14 09:47:57 user nova-compute[75229]:     </nova:instance>
Nov 14 09:47:57 user nova-compute[75229]:   </metadata>
Nov 14 09:47:57 user nova-compute[75229]:   <sysinfo type="smbios">
Nov 14 09:47:57 user nova-compute[75229]:     <system>
Nov 14 09:47:57 user nova-compute[75229]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 09:47:57 user nova-compute[75229]:       <entry name="product">OpenStack Nova</entry>
Nov 14 09:47:57 user nova-compute[75229]:       <entry name="version">0.0.0</entry>
Nov 14 09:47:57 user nova-compute[75229]:       <entry name="serial">90bd76df-96cb-4bec-9862-853d94cdbaab</entry>
Nov 14 09:47:57 user nova-compute[75229]:       <entry name="uuid">90bd76df-96cb-4bec-9862-853d94cdbaab</entry>
Nov 14 09:47:57 user nova-compute[75229]:       <entry name="family">Virtual Machine</entry>
Nov 14 09:47:57 user nova-compute[75229]:     </system>
Nov 14 09:47:57 user nova-compute[75229]:   </sysinfo>
Nov 14 09:47:57 user nova-compute[75229]:   <os>
Nov 14 09:47:57 user nova-compute[75229]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 09:47:57 user nova-compute[75229]:     <boot dev="hd"/>
Nov 14 09:47:57 user nova-compute[75229]:     <smbios mode="sysinfo"/>
Nov 14 09:47:57 user nova-compute[75229]:   </os>
Nov 14 09:47:57 user nova-compute[75229]:   <features>
Nov 14 09:47:57 user nova-compute[75229]:     <acpi/>
Nov 14 09:47:57 user nova-compute[75229]:     <apic/>
Nov 14 09:47:57 user nova-compute[75229]:     <vmcoreinfo/>
Nov 14 09:47:57 user nova-compute[75229]:   </features>
Nov 14 09:47:57 user nova-compute[75229]:   <clock offset="utc">
Nov 14 09:47:57 user nova-compute[75229]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 09:47:57 user nova-compute[75229]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 09:47:57 user nova-compute[75229]:     <timer name="hpet" present="no"/>
Nov 14 09:47:57 user nova-compute[75229]:   </clock>
Nov 14 09:47:57 user nova-compute[75229]:   <cpu mode="custom" match="exact">
Nov 14 09:47:57 user nova-compute[75229]:     <model>Nehalem</model>
Nov 14 09:47:57 user nova-compute[75229]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 09:47:57 user nova-compute[75229]:   </cpu>
Nov 14 09:47:57 user nova-compute[75229]:   <devices>
Nov 14 09:47:57 user nova-compute[75229]:     <disk type="file" device="disk">
Nov 14 09:47:57 user nova-compute[75229]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 09:47:57 user nova-compute[75229]:       <source file="/opt/stack/data/nova/instances/90bd76df-96cb-4bec-9862-853d94cdbaab/disk"/>
Nov 14 09:47:57 user nova-compute[75229]:       <target dev="vda" bus="virtio"/>
Nov 14 09:47:57 user nova-compute[75229]:     </disk>
Nov 14 09:47:57 user nova-compute[75229]:     <disk type="block" device="disk">
Nov 14 09:47:57 user nova-compute[75229]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 09:47:57 user nova-compute[75229]:       <source dev="/dev/sdg"/>
Nov 14 09:47:57 user nova-compute[75229]:       <target dev="vdc" bus="virtio"/>
Nov 14 09:47:57 user nova-compute[75229]:       <serial>5b54e594-ae66-4ba2-9bda-aa4431d31c3f</serial>
Nov 14 09:47:57 user nova-compute[75229]:     </disk>
Nov 14 09:47:57 user nova-compute[75229]:     <interface type="ethernet">
Nov 14 09:47:57 user nova-compute[75229]:       <mac address="fa:16:3e:6e:aa:df"/>
Nov 14 09:47:57 user nova-compute[75229]:       <model type="virtio"/>
Nov 14 09:47:57 user nova-compute[75229]:       <mtu size="1442"/>
Nov 14 09:47:57 user nova-compute[75229]:       <target dev="tap3b9b5b2a-5b"/>
Nov 14 09:47:57 user nova-compute[75229]:     </interface>
Nov 14 09:47:57 user nova-compute[75229]:     <serial type="pty">
Nov 14 09:47:57 user nova-compute[75229]:       <log file="/opt/stack/data/nova/instances/90bd76df-96cb-4bec-9862-853d94cdbaab/console.log" append="off"/>
Nov 14 09:47:57 user nova-compute[75229]:     </serial>
Nov 14 09:47:57 user nova-compute[75229]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 09:47:57 user nova-compute[75229]:     <video>
Nov 14 09:47:57 user nova-compute[75229]:       <model type="virtio"/>
Nov 14 09:47:57 user nova-compute[75229]:     </video>
Nov 14 09:47:57 user nova-compute[75229]:     <rng model="virtio">
Nov 14 09:47:57 user nova-compute[75229]:       <backend model="random">/dev/urandom</backend>
Nov 14 09:47:57 user nova-compute[75229]:     </rng>
Nov 14 09:47:57 user nova-compute[75229]:     <controller type="usb" index="0" model="none"/>
Nov 14 09:47:57 user nova-compute[75229]:     <memballoon model="virtio">
Nov 14 09:47:57 user nova-compute[75229]:       <stats period="10"/>
Nov 14 09:47:57 user nova-compute[75229]:     </memballoon>
Nov 14 09:47:57 user nova-compute[75229]:   </devices>
Nov 14 09:47:57 user nova-compute[75229]: </domain>
Nov 14 09:47:57 user nova-compute[75229]:  {{(pid=75229) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 09:47:57 user nova-compute[75229]: DEBUG nova.virt.libvirt.vif [None req-65cb7584-889d-4d19-9969-57c66dc18090 tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-14T09:43:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-87180804',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-87180804',id=1,image_ref='55b212ef-adfd-491b-9fbc-0043d02f3866',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-454270943',keypairs=<?>,launch_index=0,launched_at=2023-11-14T09:44:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='ee9447f169de43829fe3ed51592752e9',ramdisk_id='',reservation_id='r-p5469a2c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-730167895',owner_user_name='tempest-AttachVolumeShelveTestJSON-730167895-project-member',shelved_at='2023-11-14T09:45:49.706176',shelved_host='user',shelved_image_id='55b212ef-adfd-491b-9fbc-0043d02f3866'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T09:47:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='319a0a5ee47a426799d40e0ebb62a3b0',uuid=90bd76df-96cb-4bec-9862-853d94cdbaab,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "3b9b5b2a-5b1b-4ec6-900d-c27e7c4a625e", "address": "fa:16:3e:6e:aa:df", "network": {"id": "589aea41-545f-4875-ab56-b7aa273dad6f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-785276916-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee9447f169de43829fe3ed51592752e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b9b5b2a-5b", "ovs_interfaceid": "3b9b5b2a-5b1b-4ec6-900d-c27e7c4a625e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 09:47:57 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-65cb7584-889d-4d19-9969-57c66dc18090 tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Converting VIF {"id": "3b9b5b2a-5b1b-4ec6-900d-c27e7c4a625e", "address": "fa:16:3e:6e:aa:df", "network": {"id": "589aea41-545f-4875-ab56-b7aa273dad6f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-785276916-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee9447f169de43829fe3ed51592752e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b9b5b2a-5b", "ovs_interfaceid": "3b9b5b2a-5b1b-4ec6-900d-c27e7c4a625e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 09:47:57 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-65cb7584-889d-4d19-9969-57c66dc18090 tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6e:aa:df,bridge_name='br-int',has_traffic_filtering=True,id=3b9b5b2a-5b1b-4ec6-900d-c27e7c4a625e,network=Network(589aea41-545f-4875-ab56-b7aa273dad6f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b9b5b2a-5b') {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 09:47:57 user nova-compute[75229]: DEBUG os_vif [None req-65cb7584-889d-4d19-9969-57c66dc18090 tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6e:aa:df,bridge_name='br-int',has_traffic_filtering=True,id=3b9b5b2a-5b1b-4ec6-900d-c27e7c4a625e,network=Network(589aea41-545f-4875-ab56-b7aa273dad6f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b9b5b2a-5b') {{(pid=75229) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 09:47:57 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:47:57 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:47:57 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 09:47:57 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:47:57 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:47:57 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '13b1311f-7462-5b00-8a0c-0f75f47a2f65', '_type': 'linux-noop'}}, row=False) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:47:57 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:47:57 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 09:47:57 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:47:57 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:47:57 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3b9b5b2a-5b, may_exist=True, interface_attrs={}) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:47:57 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3b9b5b2a-5b, col_values=(('qos', UUID('ddbe460e-a15f-412b-b1ac-ddc8277a1c81')),), if_exists=True) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:47:57 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3b9b5b2a-5b, col_values=(('external_ids', {'iface-id': '3b9b5b2a-5b1b-4ec6-900d-c27e7c4a625e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6e:aa:df', 'vm-uuid': '90bd76df-96cb-4bec-9862-853d94cdbaab'}),), if_exists=True) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:47:57 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:47:57 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 09:47:57 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:47:57 user nova-compute[75229]: INFO os_vif [None req-65cb7584-889d-4d19-9969-57c66dc18090 tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6e:aa:df,bridge_name='br-int',has_traffic_filtering=True,id=3b9b5b2a-5b1b-4ec6-900d-c27e7c4a625e,network=Network(589aea41-545f-4875-ab56-b7aa273dad6f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b9b5b2a-5b')
Nov 14 09:47:57 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:47:57 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-65cb7584-889d-4d19-9969-57c66dc18090 tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] No BDM found with device name vda, not building metadata. {{(pid=75229) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 09:47:57 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-65cb7584-889d-4d19-9969-57c66dc18090 tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75229) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 09:47:57 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-65cb7584-889d-4d19-9969-57c66dc18090 tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] No VIF found with MAC fa:16:3e:6e:aa:df, not building metadata {{(pid=75229) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 09:47:58 user nova-compute[75229]: INFO nova.virt.libvirt.driver [-] [instance: e09b3809-2e23-401c-9a72-88feb2bb657c] Instance destroyed successfully.
Nov 14 09:47:58 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-4431daf5-21b2-4d0f-8867-50a609adbff9 tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] [instance: e09b3809-2e23-401c-9a72-88feb2bb657c] Attempting a stable device rescue
Nov 14 09:47:58 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-4431daf5-21b2-4d0f-8867-50a609adbff9 tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} {{(pid=75229) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 14 09:47:58 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-4431daf5-21b2-4d0f-8867-50a609adbff9 tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] [instance: e09b3809-2e23-401c-9a72-88feb2bb657c] Instance directory exists: not creating {{(pid=75229) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 14 09:47:58 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-4431daf5-21b2-4d0f-8867-50a609adbff9 tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] [instance: e09b3809-2e23-401c-9a72-88feb2bb657c] Creating image(s)
Nov 14 09:47:58 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-4431daf5-21b2-4d0f-8867-50a609adbff9 tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] Acquiring lock "/opt/stack/data/nova/instances/e09b3809-2e23-401c-9a72-88feb2bb657c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:47:58 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-4431daf5-21b2-4d0f-8867-50a609adbff9 tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] Lock "/opt/stack/data/nova/instances/e09b3809-2e23-401c-9a72-88feb2bb657c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:47:58 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-4431daf5-21b2-4d0f-8867-50a609adbff9 tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] Lock "/opt/stack/data/nova/instances/e09b3809-2e23-401c-9a72-88feb2bb657c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:47:58 user nova-compute[75229]: DEBUG nova.objects.instance [None req-4431daf5-21b2-4d0f-8867-50a609adbff9 tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] Lazy-loading 'trusted_certs' on Instance uuid e09b3809-2e23-401c-9a72-88feb2bb657c {{(pid=75229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 09:47:58 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-4431daf5-21b2-4d0f-8867-50a609adbff9 tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] Acquiring lock "11c08b0840a02e1ecc0c553970e3c961b9b03482" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:47:58 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-4431daf5-21b2-4d0f-8867-50a609adbff9 tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] Lock "11c08b0840a02e1ecc0c553970e3c961b9b03482" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.002s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:48:00 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-4431daf5-21b2-4d0f-8867-50a609adbff9 tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/11c08b0840a02e1ecc0c553970e3c961b9b03482.part --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:48:00 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:48:00 user nova-compute[75229]: DEBUG nova.compute.manager [None req-3f7a76b1-7df1-476d-8de9-cc7e5ab78ca9 tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] [instance: a60d339f-e134-477c-8505-bf8c79d2a21c] Stashing vm_state: active {{(pid=75229) _prep_resize /opt/stack/nova/nova/compute/manager.py:5615}}
Nov 14 09:48:00 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-4431daf5-21b2-4d0f-8867-50a609adbff9 tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/11c08b0840a02e1ecc0c553970e3c961b9b03482.part --force-share --output=json" returned: 0 in 0.259s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:48:00 user nova-compute[75229]: DEBUG nova.virt.images [None req-4431daf5-21b2-4d0f-8867-50a609adbff9 tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] 18e0c61f-72f7-4725-a8c6-6bbfb37053e0 was qcow2, converting to raw {{(pid=75229) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 14 09:48:00 user nova-compute[75229]: DEBUG nova.privsep.utils [None req-4431daf5-21b2-4d0f-8867-50a609adbff9 tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75229) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 14 09:48:00 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-4431daf5-21b2-4d0f-8867-50a609adbff9 tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/11c08b0840a02e1ecc0c553970e3c961b9b03482.part /opt/stack/data/nova/instances/_base/11c08b0840a02e1ecc0c553970e3c961b9b03482.converted {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:48:00 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-3f7a76b1-7df1-476d-8de9-cc7e5ab78ca9 tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:48:00 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-3f7a76b1-7df1-476d-8de9-cc7e5ab78ca9 tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.003s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:48:01 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-3f7a76b1-7df1-476d-8de9-cc7e5ab78ca9 tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75229) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 09:48:01 user nova-compute[75229]: INFO nova.compute.claims [None req-3f7a76b1-7df1-476d-8de9-cc7e5ab78ca9 tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] [instance: a60d339f-e134-477c-8505-bf8c79d2a21c] Claim successful on node user
Nov 14 09:48:01 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:48:01 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-4431daf5-21b2-4d0f-8867-50a609adbff9 tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/11c08b0840a02e1ecc0c553970e3c961b9b03482.part /opt/stack/data/nova/instances/_base/11c08b0840a02e1ecc0c553970e3c961b9b03482.converted" returned: 0 in 0.378s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:48:01 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-4431daf5-21b2-4d0f-8867-50a609adbff9 tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/11c08b0840a02e1ecc0c553970e3c961b9b03482.converted --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:48:01 user nova-compute[75229]: INFO nova.compute.resource_tracker [None req-3f7a76b1-7df1-476d-8de9-cc7e5ab78ca9 tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] [instance: a60d339f-e134-477c-8505-bf8c79d2a21c] Updating resource usage from migration 2ccefcb8-9839-48e7-bdc8-dfbad0d1bf64
Nov 14 09:48:01 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:48:01 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:48:01 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:48:01 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:48:01 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-4431daf5-21b2-4d0f-8867-50a609adbff9 tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/11c08b0840a02e1ecc0c553970e3c961b9b03482.converted --force-share --output=json" returned: 0 in 0.246s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:48:01 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-4431daf5-21b2-4d0f-8867-50a609adbff9 tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] Lock "11c08b0840a02e1ecc0c553970e3c961b9b03482" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.647s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:48:01 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-4431daf5-21b2-4d0f-8867-50a609adbff9 tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] Acquiring lock "11c08b0840a02e1ecc0c553970e3c961b9b03482" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:48:01 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-4431daf5-21b2-4d0f-8867-50a609adbff9 tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] Lock "11c08b0840a02e1ecc0c553970e3c961b9b03482" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:48:01 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-4431daf5-21b2-4d0f-8867-50a609adbff9 tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/11c08b0840a02e1ecc0c553970e3c961b9b03482 --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:48:01 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-4431daf5-21b2-4d0f-8867-50a609adbff9 tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/11c08b0840a02e1ecc0c553970e3c961b9b03482 --force-share --output=json" returned: 0 in 0.217s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:48:01 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-4431daf5-21b2-4d0f-8867-50a609adbff9 tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/11c08b0840a02e1ecc0c553970e3c961b9b03482,backing_fmt=raw /opt/stack/data/nova/instances/e09b3809-2e23-401c-9a72-88feb2bb657c/disk.rescue {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:48:01 user nova-compute[75229]: DEBUG nova.compute.provider_tree [None req-3f7a76b1-7df1-476d-8de9-cc7e5ab78ca9 tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] Inventory has not changed in ProviderTree for provider: d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 {{(pid=75229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 09:48:01 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-4431daf5-21b2-4d0f-8867-50a609adbff9 tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/11c08b0840a02e1ecc0c553970e3c961b9b03482,backing_fmt=raw /opt/stack/data/nova/instances/e09b3809-2e23-401c-9a72-88feb2bb657c/disk.rescue" returned: 0 in 0.066s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:48:01 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-4431daf5-21b2-4d0f-8867-50a609adbff9 tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] Lock "11c08b0840a02e1ecc0c553970e3c961b9b03482" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.289s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:48:01 user nova-compute[75229]: DEBUG nova.objects.instance [None req-4431daf5-21b2-4d0f-8867-50a609adbff9 tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] Lazy-loading 'migration_context' on Instance uuid e09b3809-2e23-401c-9a72-88feb2bb657c {{(pid=75229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 09:48:01 user nova-compute[75229]: DEBUG nova.scheduler.client.report [None req-3f7a76b1-7df1-476d-8de9-cc7e5ab78ca9 tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] Inventory has not changed for provider d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 09:48:01 user nova-compute[75229]: DEBUG nova.objects.base [None req-4431daf5-21b2-4d0f-8867-50a609adbff9 tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] Object Instance<e09b3809-2e23-401c-9a72-88feb2bb657c> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75229) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 09:48:01 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-4431daf5-21b2-4d0f-8867-50a609adbff9 tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] [instance: e09b3809-2e23-401c-9a72-88feb2bb657c] Created local disks {{(pid=75229) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 09:48:01 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-4431daf5-21b2-4d0f-8867-50a609adbff9 tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] [instance: e09b3809-2e23-401c-9a72-88feb2bb657c] Start _get_guest_xml network_info=[{"id": "472488d2-9453-4d74-a6b1-6966b835572d", "address": "fa:16:3e:9f:3a:e8", "network": {"id": "f5285ef5-fa74-4079-a8cd-f970d97c97c3", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-62550527-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.73", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-62550527-network", "vif_mac": "fa:16:3e:9f:3a:e8"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54dca06fda8b43d5bc92fa7c97a872a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap472488d2-94", "ovs_interfaceid": "472488d2-9453-4d74-a6b1-6966b835572d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T09:40:10Z,direct_url=<?>,disk_format='qcow2',id=3bef8470-ecc7-40e3-95d4-9254348ea72d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='de5a91106b6948ed937a7178ff9464c4',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T09:40:12Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '18e0c61f-72f7-4725-a8c6-6bbfb37053e0', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'disk_bus': 'virtio', 'guest_format': None, 'encryption_secret_uuid': None, 'size': 0, 'device_type': 'disk', 'image_id': '3bef8470-ecc7-40e3-95d4-9254348ea72d'}], 'ephemerals': [], 'block_device_mapping': [{'boot_index': None, 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:3fed285f-9be4-4601-8cb5-4329d7ebed8c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NPZTmsSG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, 'status': 'reserved', 'instance': 'e09b3809-2e23-401c-9a72-88feb2bb657c', 'attached_at': '', 'detached_at': '', 'volume_id': '3fed285f-9be4-4601-8cb5-4329d7ebed8c', 'serial': '3fed285f-9be4-4601-8cb5-4329d7ebed8c'}, 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'attachment_id': '0d04eaa8-0e5a-4727-99aa-231f91717147', 'guest_format': None, 'device_type': 'disk', 'volume_type': None} {{(pid=75229) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 09:48:01 user nova-compute[75229]: DEBUG nova.objects.instance [None req-4431daf5-21b2-4d0f-8867-50a609adbff9 tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] Lazy-loading 'resources' on Instance uuid e09b3809-2e23-401c-9a72-88feb2bb657c {{(pid=75229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 09:48:01 user nova-compute[75229]: DEBUG nova.objects.base [None req-4431daf5-21b2-4d0f-8867-50a609adbff9 tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] Object Instance<e09b3809-2e23-401c-9a72-88feb2bb657c> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75229) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 09:48:01 user nova-compute[75229]: DEBUG nova.objects.instance [None req-4431daf5-21b2-4d0f-8867-50a609adbff9 tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] Lazy-loading 'numa_topology' on Instance uuid e09b3809-2e23-401c-9a72-88feb2bb657c {{(pid=75229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 09:48:01 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-3f7a76b1-7df1-476d-8de9-cc7e5ab78ca9 tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.889s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:48:01 user nova-compute[75229]: INFO nova.compute.manager [None req-3f7a76b1-7df1-476d-8de9-cc7e5ab78ca9 tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] [instance: a60d339f-e134-477c-8505-bf8c79d2a21c] Migrating
Nov 14 09:48:01 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-3f7a76b1-7df1-476d-8de9-cc7e5ab78ca9 tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] Acquiring lock "compute-rpcapi-router" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 09:48:01 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-3f7a76b1-7df1-476d-8de9-cc7e5ab78ca9 tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] Acquired lock "compute-rpcapi-router" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 09:48:01 user nova-compute[75229]: DEBUG nova.objects.base [None req-4431daf5-21b2-4d0f-8867-50a609adbff9 tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] Object Instance<e09b3809-2e23-401c-9a72-88feb2bb657c> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75229) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 09:48:01 user nova-compute[75229]: INFO nova.compute.rpcapi [None req-3f7a76b1-7df1-476d-8de9-cc7e5ab78ca9 tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] Automatically selected compute RPC version 6.2 from minimum service version 66
Nov 14 09:48:01 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-3f7a76b1-7df1-476d-8de9-cc7e5ab78ca9 tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] Releasing lock "compute-rpcapi-router" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 09:48:01 user nova-compute[75229]: DEBUG nova.compute.manager [req-89087f6a-c527-4324-9dc4-5a32a074db99 req-9b81f33e-877b-44d4-8f0e-818b92e47896 service nova] [instance: e09b3809-2e23-401c-9a72-88feb2bb657c] Received event network-vif-unplugged-472488d2-9453-4d74-a6b1-6966b835572d {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:48:01 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-89087f6a-c527-4324-9dc4-5a32a074db99 req-9b81f33e-877b-44d4-8f0e-818b92e47896 service nova] Acquiring lock "e09b3809-2e23-401c-9a72-88feb2bb657c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:48:01 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-89087f6a-c527-4324-9dc4-5a32a074db99 req-9b81f33e-877b-44d4-8f0e-818b92e47896 service nova] Lock "e09b3809-2e23-401c-9a72-88feb2bb657c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:48:01 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-89087f6a-c527-4324-9dc4-5a32a074db99 req-9b81f33e-877b-44d4-8f0e-818b92e47896 service nova] Lock "e09b3809-2e23-401c-9a72-88feb2bb657c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:48:01 user nova-compute[75229]: DEBUG nova.compute.manager [req-89087f6a-c527-4324-9dc4-5a32a074db99 req-9b81f33e-877b-44d4-8f0e-818b92e47896 service nova] [instance: e09b3809-2e23-401c-9a72-88feb2bb657c] No waiting events found dispatching network-vif-unplugged-472488d2-9453-4d74-a6b1-6966b835572d {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 09:48:01 user nova-compute[75229]: WARNING nova.compute.manager [req-89087f6a-c527-4324-9dc4-5a32a074db99 req-9b81f33e-877b-44d4-8f0e-818b92e47896 service nova] [instance: e09b3809-2e23-401c-9a72-88feb2bb657c] Received unexpected event network-vif-unplugged-472488d2-9453-4d74-a6b1-6966b835572d for instance with vm_state active and task_state rescuing.
Nov 14 09:48:01 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-3f7a76b1-7df1-476d-8de9-cc7e5ab78ca9 tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] Acquiring lock "refresh_cache-a60d339f-e134-477c-8505-bf8c79d2a21c" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 09:48:01 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-3f7a76b1-7df1-476d-8de9-cc7e5ab78ca9 tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] Acquired lock "refresh_cache-a60d339f-e134-477c-8505-bf8c79d2a21c" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 09:48:01 user nova-compute[75229]: DEBUG nova.network.neutron [None req-3f7a76b1-7df1-476d-8de9-cc7e5ab78ca9 tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] [instance: a60d339f-e134-477c-8505-bf8c79d2a21c] Building network info cache for instance {{(pid=75229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 09:48:01 user nova-compute[75229]: WARNING nova.virt.libvirt.driver [None req-4431daf5-21b2-4d0f-8867-50a609adbff9 tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 09:48:01 user nova-compute[75229]: WARNING nova.virt.libvirt.driver [None req-4431daf5-21b2-4d0f-8867-50a609adbff9 tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 09:48:01 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-4431daf5-21b2-4d0f-8867-50a609adbff9 tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75229) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 09:48:01 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-4431daf5-21b2-4d0f-8867-50a609adbff9 tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] CPU controller missing on host. {{(pid=75229) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 09:48:01 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-4431daf5-21b2-4d0f-8867-50a609adbff9 tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75229) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 09:48:01 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-4431daf5-21b2-4d0f-8867-50a609adbff9 tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] CPU controller found on host. {{(pid=75229) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 09:48:01 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-4431daf5-21b2-4d0f-8867-50a609adbff9 tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75229) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 09:48:01 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-4431daf5-21b2-4d0f-8867-50a609adbff9 tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T09:39:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T09:40:10Z,direct_url=<?>,disk_format='qcow2',id=3bef8470-ecc7-40e3-95d4-9254348ea72d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='de5a91106b6948ed937a7178ff9464c4',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T09:40:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 09:48:01 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-4431daf5-21b2-4d0f-8867-50a609adbff9 tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] Flavor limits 0:0:0 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 09:48:01 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-4431daf5-21b2-4d0f-8867-50a609adbff9 tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] Image limits 0:0:0 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 09:48:01 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-4431daf5-21b2-4d0f-8867-50a609adbff9 tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] Flavor pref 0:0:0 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 09:48:01 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-4431daf5-21b2-4d0f-8867-50a609adbff9 tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] Image pref 0:0:0 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 09:48:01 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-4431daf5-21b2-4d0f-8867-50a609adbff9 tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 09:48:01 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-4431daf5-21b2-4d0f-8867-50a609adbff9 tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 09:48:01 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-4431daf5-21b2-4d0f-8867-50a609adbff9 tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75229) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 09:48:01 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-4431daf5-21b2-4d0f-8867-50a609adbff9 tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] Got 1 possible topologies {{(pid=75229) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 09:48:01 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-4431daf5-21b2-4d0f-8867-50a609adbff9 tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 09:48:01 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-4431daf5-21b2-4d0f-8867-50a609adbff9 tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 09:48:01 user nova-compute[75229]: DEBUG nova.objects.instance [None req-4431daf5-21b2-4d0f-8867-50a609adbff9 tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] Lazy-loading 'vcpu_model' on Instance uuid e09b3809-2e23-401c-9a72-88feb2bb657c {{(pid=75229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 09:48:02 user nova-compute[75229]: DEBUG nova.objects.base [None req-4431daf5-21b2-4d0f-8867-50a609adbff9 tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] Object Instance<e09b3809-2e23-401c-9a72-88feb2bb657c> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75229) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 09:48:02 user nova-compute[75229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4431daf5-21b2-4d0f-8867-50a609adbff9 tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] [instance: e09b3809-2e23-401c-9a72-88feb2bb657c] Calling os-brick to attach iSCSI Volume {{(pid=75229) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 09:48:02 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-4431daf5-21b2-4d0f-8867-50a609adbff9 tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f73f85151b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3fed285f-9be4-4601-8cb5-4329d7ebed8c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NPZTmsSG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 09:48:02 user nova-compute[75229]: WARNING os_brick.initiator.connectors.base [None req-4431daf5-21b2-4d0f-8867-50a609adbff9 tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 09:48:02 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-4431daf5-21b2-4d0f-8867-50a609adbff9 tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 09:48:02 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-4431daf5-21b2-4d0f-8867-50a609adbff9 tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 09:48:02 user nova-compute[75229]: WARNING os_brick.initiator.connectors.base [None req-4431daf5-21b2-4d0f-8867-50a609adbff9 tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 09:48:02 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-4431daf5-21b2-4d0f-8867-50a609adbff9 tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3fed285f-9be4-4601-8cb5-4329d7ebed8c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 09:48:02 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-4431daf5-21b2-4d0f-8867-50a609adbff9 tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3fed285f-9be4-4601-8cb5-4329d7ebed8c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 09:48:02 user nova-compute[75229]: INFO os_brick.initiator.connectors.iscsi [None req-4431daf5-21b2-4d0f-8867-50a609adbff9 tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 09:48:02 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3fed285f-9be4-4601-8cb5-4329d7ebed8c -p 172.16.0.220:3260 {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:48:02 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3fed285f-9be4-4601-8cb5-4329d7ebed8c -p 172.16.0.220:3260" returned: 0 in 0.027s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:48:02 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[71fa2c4a-671e-4b44-84b7-a9858c43446a]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:3fed285f-9be4-4601-8cb5-4329d7ebed8c\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = NPZTmsSG\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:48:02 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-4431daf5-21b2-4d0f-8867-50a609adbff9 tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 14 09:48:02 user nova-compute[75229]: node.name = iqn.2010-10.org.openstack:3fed285f-9be4-4601-8cb5-4329d7ebed8c
Nov 14 09:48:02 user nova-compute[75229]: node.tpgt = -1
Nov 14 09:48:02 user nova-compute[75229]: node.startup = automatic
Nov 14 09:48:02 user nova-compute[75229]: node.leading_login = No
Nov 14 09:48:02 user nova-compute[75229]: iface.iscsi_ifacename = default
Nov 14 09:48:02 user nova-compute[75229]: iface.net_ifacename = <empty>
Nov 14 09:48:02 user nova-compute[75229]: iface.ipaddress = <empty>
Nov 14 09:48:02 user nova-compute[75229]: iface.prefix_len = 0
Nov 14 09:48:02 user nova-compute[75229]: iface.hwaddress = <empty>
Nov 14 09:48:02 user nova-compute[75229]: iface.transport_name = tcp
Nov 14 09:48:02 user nova-compute[75229]: iface.initiatorname = <empty>
Nov 14 09:48:02 user nova-compute[75229]: iface.state = <empty>
Nov 14 09:48:02 user nova-compute[75229]: iface.vlan_id = 0
Nov 14 09:48:02 user nova-compute[75229]: iface.vlan_priority = 0
Nov 14 09:48:02 user nova-compute[75229]: iface.vlan_state = <empty>
Nov 14 09:48:02 user nova-compute[75229]: iface.iface_num = 0
Nov 14 09:48:02 user nova-compute[75229]: iface.mtu = 0
Nov 14 09:48:02 user nova-compute[75229]: iface.port = 0
Nov 14 09:48:02 user nova-compute[75229]: iface.bootproto = <empty>
Nov 14 09:48:02 user nova-compute[75229]: iface.subnet_mask = <empty>
Nov 14 09:48:02 user nova-compute[75229]: iface.gateway = <empty>
Nov 14 09:48:02 user nova-compute[75229]: iface.dhcp_alt_client_id_state = <empty>
Nov 14 09:48:02 user nova-compute[75229]: iface.dhcp_alt_client_id = <empty>
Nov 14 09:48:02 user nova-compute[75229]: iface.dhcp_dns = <empty>
Nov 14 09:48:02 user nova-compute[75229]: iface.dhcp_learn_iqn = <empty>
Nov 14 09:48:02 user nova-compute[75229]: iface.dhcp_req_vendor_id_state = <empty>
Nov 14 09:48:02 user nova-compute[75229]: iface.dhcp_vendor_id_state = <empty>
Nov 14 09:48:02 user nova-compute[75229]: iface.dhcp_vendor_id = <empty>
Nov 14 09:48:02 user nova-compute[75229]: iface.dhcp_slp_da = <empty>
Nov 14 09:48:02 user nova-compute[75229]: iface.fragmentation = <empty>
Nov 14 09:48:02 user nova-compute[75229]: iface.gratuitous_arp = <empty>
Nov 14 09:48:02 user nova-compute[75229]: iface.incoming_forwarding = <empty>
Nov 14 09:48:02 user nova-compute[75229]: iface.tos_state = <empty>
Nov 14 09:48:02 user nova-compute[75229]: iface.tos = 0
Nov 14 09:48:02 user nova-compute[75229]: iface.ttl = 0
Nov 14 09:48:02 user nova-compute[75229]: iface.delayed_ack = <empty>
Nov 14 09:48:02 user nova-compute[75229]: iface.tcp_nagle = <empty>
Nov 14 09:48:02 user nova-compute[75229]: iface.tcp_wsf_state = <empty>
Nov 14 09:48:02 user nova-compute[75229]: iface.tcp_wsf = 0
Nov 14 09:48:02 user nova-compute[75229]: iface.tcp_timer_scale = 0
Nov 14 09:48:02 user nova-compute[75229]: iface.tcp_timestamp = <empty>
Nov 14 09:48:02 user nova-compute[75229]: iface.redirect = <empty>
Nov 14 09:48:02 user nova-compute[75229]: iface.def_task_mgmt_timeout = 0
Nov 14 09:48:02 user nova-compute[75229]: iface.header_digest = <empty>
Nov 14 09:48:02 user nova-compute[75229]: iface.data_digest = <empty>
Nov 14 09:48:02 user nova-compute[75229]: iface.immediate_data = <empty>
Nov 14 09:48:02 user nova-compute[75229]: iface.initial_r2t = <empty>
Nov 14 09:48:02 user nova-compute[75229]: iface.data_seq_inorder = <empty>
Nov 14 09:48:02 user nova-compute[75229]: iface.data_pdu_inorder = <empty>
Nov 14 09:48:02 user nova-compute[75229]: iface.erl = 0
Nov 14 09:48:02 user nova-compute[75229]: iface.max_receive_data_len = 0
Nov 14 09:48:02 user nova-compute[75229]: iface.first_burst_len = 0
Nov 14 09:48:02 user nova-compute[75229]: iface.max_outstanding_r2t = 0
Nov 14 09:48:02 user nova-compute[75229]: iface.max_burst_len = 0
Nov 14 09:48:02 user nova-compute[75229]: iface.chap_auth = <empty>
Nov 14 09:48:02 user nova-compute[75229]: iface.bidi_chap = <empty>
Nov 14 09:48:02 user nova-compute[75229]: iface.strict_login_compliance = <empty>
Nov 14 09:48:02 user nova-compute[75229]: iface.discovery_auth = <empty>
Nov 14 09:48:02 user nova-compute[75229]: iface.discovery_logout = <empty>
Nov 14 09:48:02 user nova-compute[75229]: node.discovery_address = <empty>
Nov 14 09:48:02 user nova-compute[75229]: node.discovery_port = 0
Nov 14 09:48:02 user nova-compute[75229]: node.discovery_type = static
Nov 14 09:48:02 user nova-compute[75229]: node.session.initial_cmdsn = 0
Nov 14 09:48:02 user nova-compute[75229]: node.session.initial_login_retry_max = 8
Nov 14 09:48:02 user nova-compute[75229]: node.session.xmit_thread_priority = -20
Nov 14 09:48:02 user nova-compute[75229]: node.session.cmds_max = 128
Nov 14 09:48:02 user nova-compute[75229]: node.session.queue_depth = 32
Nov 14 09:48:02 user nova-compute[75229]: node.session.nr_sessions = 1
Nov 14 09:48:02 user nova-compute[75229]: node.session.auth.authmethod = CHAP
Nov 14 09:48:02 user nova-compute[75229]: node.session.auth.username = NPZTmsSG
Nov 14 09:48:02 user nova-compute[75229]: node.session.auth.password = ***
Nov 14 09:48:02 user nova-compute[75229]: node.session.auth.username_in = <empty>
Nov 14 09:48:02 user nova-compute[75229]: node.session.auth.password_in = <empty>
Nov 14 09:48:02 user nova-compute[75229]: node.session.auth.chap_algs = MD5
Nov 14 09:48:02 user nova-compute[75229]: node.session.timeo.replacement_timeout = 120
Nov 14 09:48:02 user nova-compute[75229]: node.session.err_timeo.abort_timeout = 15
Nov 14 09:48:02 user nova-compute[75229]: node.session.err_timeo.lu_reset_timeout = 30
Nov 14 09:48:02 user nova-compute[75229]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 14 09:48:02 user nova-compute[75229]: node.session.err_timeo.host_reset_timeout = 60
Nov 14 09:48:02 user nova-compute[75229]: node.session.iscsi.FastAbort = Yes
Nov 14 09:48:02 user nova-compute[75229]: node.session.iscsi.InitialR2T = No
Nov 14 09:48:02 user nova-compute[75229]: node.session.iscsi.ImmediateData = Yes
Nov 14 09:48:02 user nova-compute[75229]: node.session.iscsi.FirstBurstLength = 262144
Nov 14 09:48:02 user nova-compute[75229]: node.session.iscsi.MaxBurstLength = 16776192
Nov 14 09:48:02 user nova-compute[75229]: node.session.iscsi.DefaultTime2Retain = 0
Nov 14 09:48:02 user nova-compute[75229]: node.session.iscsi.DefaultTime2Wait = 2
Nov 14 09:48:02 user nova-compute[75229]: node.session.iscsi.MaxConnections = 1
Nov 14 09:48:02 user nova-compute[75229]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 14 09:48:02 user nova-compute[75229]: node.session.iscsi.ERL = 0
Nov 14 09:48:02 user nova-compute[75229]: node.session.scan = manual
Nov 14 09:48:02 user nova-compute[75229]: node.session.reopen_max = 0
Nov 14 09:48:02 user nova-compute[75229]: node.conn[0].address = 172.16.0.220
Nov 14 09:48:02 user nova-compute[75229]: node.conn[0].port = 3260
Nov 14 09:48:02 user nova-compute[75229]: node.conn[0].startup = manual
Nov 14 09:48:02 user nova-compute[75229]: node.conn[0].tcp.window_size = 524288
Nov 14 09:48:02 user nova-compute[75229]: node.conn[0].tcp.type_of_service = 0
Nov 14 09:48:02 user nova-compute[75229]: node.conn[0].timeo.logout_timeout = 15
Nov 14 09:48:02 user nova-compute[75229]: node.conn[0].timeo.login_timeout = 15
Nov 14 09:48:02 user nova-compute[75229]: node.conn[0].timeo.auth_timeout = 45
Nov 14 09:48:02 user nova-compute[75229]: node.conn[0].timeo.noop_out_interval = 5
Nov 14 09:48:02 user nova-compute[75229]: node.conn[0].timeo.noop_out_timeout = 5
Nov 14 09:48:02 user nova-compute[75229]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 14 09:48:02 user nova-compute[75229]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 14 09:48:02 user nova-compute[75229]: node.conn[0].iscsi.HeaderDigest = None
Nov 14 09:48:02 user nova-compute[75229]: node.conn[0].iscsi.DataDigest = None
Nov 14 09:48:02 user nova-compute[75229]: node.conn[0].iscsi.IFMarker = No
Nov 14 09:48:02 user nova-compute[75229]: node.conn[0].iscsi.OFMarker = No
Nov 14 09:48:02 user nova-compute[75229]: # END RECORD
Nov 14 09:48:02 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:48:02 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3fed285f-9be4-4601-8cb5-4329d7ebed8c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:48:02 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3fed285f-9be4-4601-8cb5-4329d7ebed8c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:48:02 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[21323866-233e-4f70-b76e-8720a3b30f10]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:48:02 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-4431daf5-21b2-4d0f-8867-50a609adbff9 tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:48:02 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3fed285f-9be4-4601-8cb5-4329d7ebed8c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:48:02 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3fed285f-9be4-4601-8cb5-4329d7ebed8c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:48:02 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a0d223a-0126-4834-b47e-0b0979785c30]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:48:02 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-4431daf5-21b2-4d0f-8867-50a609adbff9 tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:48:02 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3fed285f-9be4-4601-8cb5-4329d7ebed8c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NPZTmsSG {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:48:02 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3fed285f-9be4-4601-8cb5-4329d7ebed8c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NPZTmsSG" returned: 0 in 0.033s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:48:02 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9605be6-de2e-427a-b85a-dd218c3a06dc]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:48:02 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-4431daf5-21b2-4d0f-8867-50a609adbff9 tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'NPZTmsSG'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:48:02 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3fed285f-9be4-4601-8cb5-4329d7ebed8c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:48:02 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3fed285f-9be4-4601-8cb5-4329d7ebed8c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.049s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:48:02 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[266a3bc7-157f-47c2-b35d-0b71fab19cac]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:48:02 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-4431daf5-21b2-4d0f-8867-50a609adbff9 tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:48:02 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:48:02 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.040s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:48:02 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[919eb7cf-e73f-4bfd-8880-0b1aa1afb4ca]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db131665-6ac2-437a-8adf-23593475a8aa (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0433e38-fa42-4cff-af48-8cb5da297597 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13c53511-ea64-4896-b325-504ce58d7895 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fed285f-9be4-4601-8cb5-4329d7ebed8c (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aca09258-022b-4f04-b418-f2a170332755 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b54e594-ae66-4ba2-9bda-aa4431d31c3f (non-flash)\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:48:02 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-4431daf5-21b2-4d0f-8867-50a609adbff9 tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db131665-6ac2-437a-8adf-23593475a8aa (non-flash)
Nov 14 09:48:02 user nova-compute[75229]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0433e38-fa42-4cff-af48-8cb5da297597 (non-flash)
Nov 14 09:48:02 user nova-compute[75229]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13c53511-ea64-4896-b325-504ce58d7895 (non-flash)
Nov 14 09:48:02 user nova-compute[75229]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fed285f-9be4-4601-8cb5-4329d7ebed8c (non-flash)
Nov 14 09:48:02 user nova-compute[75229]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aca09258-022b-4f04-b418-f2a170332755 (non-flash)
Nov 14 09:48:02 user nova-compute[75229]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b54e594-ae66-4ba2-9bda-aa4431d31c3f (non-flash)
Nov 14 09:48:02 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 09:48:02 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-4431daf5-21b2-4d0f-8867-50a609adbff9 tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db131665-6ac2-437a-8adf-23593475a8aa (non-flash)
Nov 14 09:48:02 user nova-compute[75229]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0433e38-fa42-4cff-af48-8cb5da297597 (non-flash)
Nov 14 09:48:02 user nova-compute[75229]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13c53511-ea64-4896-b325-504ce58d7895 (non-flash)
Nov 14 09:48:02 user nova-compute[75229]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fed285f-9be4-4601-8cb5-4329d7ebed8c (non-flash)
Nov 14 09:48:02 user nova-compute[75229]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aca09258-022b-4f04-b418-f2a170332755 (non-flash)
Nov 14 09:48:02 user nova-compute[75229]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b54e594-ae66-4ba2-9bda-aa4431d31c3f (non-flash)
Nov 14 09:48:02 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 09:48:02 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-4431daf5-21b2-4d0f-8867-50a609adbff9 tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3fed285f-9be4-4601-8cb5-4329d7ebed8c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.262s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 09:48:02 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-4431daf5-21b2-4d0f-8867-50a609adbff9 tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] Connected to 172.16.0.220:3260 {{(pid=75229) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 09:48:02 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-4431daf5-21b2-4d0f-8867-50a609adbff9 tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] HCTL ('36', '0', '0', 0) found on session 16 with lun 0 {{(pid=75229) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 09:48:02 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-4431daf5-21b2-4d0f-8867-50a609adbff9 tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] Scanning host 36 c: 0, t: 0, l: 0) {{(pid=75229) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 09:48:02 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:48:02 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.017s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:48:02 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[1646b77b-dfd5-48b3-bee5-802e533617bb]: (4, ('0 0 0', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:48:02 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-4431daf5-21b2-4d0f-8867-50a609adbff9 tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] Searching for a device in session 16 and hctl ('36', '0', '0', 0) yield: sde {{(pid=75229) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 09:48:02 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-4431daf5-21b2-4d0f-8867-50a609adbff9 tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:3fed285f-9be4-4601-8cb5-4329d7ebed8c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NPZTmsSG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75229) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 09:48:02 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-4431daf5-21b2-4d0f-8867-50a609adbff9 tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.290s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 09:48:02 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-4431daf5-21b2-4d0f-8867-50a609adbff9 tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] <== connect_volume: return (291ms) {'type': 'block', 'scsi_wwn': '26661303630626238', 'path': '/dev/sde'} {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 09:48:02 user nova-compute[75229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4431daf5-21b2-4d0f-8867-50a609adbff9 tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] [instance: e09b3809-2e23-401c-9a72-88feb2bb657c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26661303630626238', 'path': '/dev/sde'} {{(pid=75229) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 09:48:02 user nova-compute[75229]: DEBUG nova.virt.libvirt.vif [None req-4431daf5-21b2-4d0f-8867-50a609adbff9 tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T09:43:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1726752268',display_name='tempest-ServerStableDeviceRescueTest-server-1726752268',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1726752268',id=4,image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNm5isUaPy6aeQRy5OrjJxFeGvdR3hP9hNCaGuAFXcrDHTuZbYjZaj7/pLtpuIgJqJ91hnf0ENeQ3ZP5Dwi5b6SQ5W5TR5kgPoLnxRfcQmwE6thKL5eCNtvCvPLZ4XIdRw==',key_name='tempest-keypair-1926094689',keypairs=<?>,launch_index=0,launched_at=2023-11-14T09:44:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='54dca06fda8b43d5bc92fa7c97a872a7',ramdisk_id='',reservation_id='r-fl9qbxad',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-1482859960',owner_user_name='tempest-ServerStableDeviceRescueTest-1482859960-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T09:45:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fbe8d49b2c9e43cf98f14f49fa8de80c',uuid=e09b3809-2e23-401c-9a72-88feb2bb657c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "472488d2-9453-4d74-a6b1-6966b835572d", "address": "fa:16:3e:9f:3a:e8", "network": {"id": "f5285ef5-fa74-4079-a8cd-f970d97c97c3", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-62550527-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.73", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-62550527-network", "vif_mac": "fa:16:3e:9f:3a:e8"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54dca06fda8b43d5bc92fa7c97a872a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap472488d2-94", "ovs_interfaceid": "472488d2-9453-4d74-a6b1-6966b835572d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75229) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 09:48:02 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-4431daf5-21b2-4d0f-8867-50a609adbff9 tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] Converting VIF {"id": "472488d2-9453-4d74-a6b1-6966b835572d", "address": "fa:16:3e:9f:3a:e8", "network": {"id": "f5285ef5-fa74-4079-a8cd-f970d97c97c3", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-62550527-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.73", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-62550527-network", "vif_mac": "fa:16:3e:9f:3a:e8"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54dca06fda8b43d5bc92fa7c97a872a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap472488d2-94", "ovs_interfaceid": "472488d2-9453-4d74-a6b1-6966b835572d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 09:48:02 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-4431daf5-21b2-4d0f-8867-50a609adbff9 tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9f:3a:e8,bridge_name='br-int',has_traffic_filtering=True,id=472488d2-9453-4d74-a6b1-6966b835572d,network=Network(f5285ef5-fa74-4079-a8cd-f970d97c97c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap472488d2-94') {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 09:48:02 user nova-compute[75229]: DEBUG nova.objects.instance [None req-4431daf5-21b2-4d0f-8867-50a609adbff9 tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] Lazy-loading 'pci_devices' on Instance uuid e09b3809-2e23-401c-9a72-88feb2bb657c {{(pid=75229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 09:48:02 user nova-compute[75229]: DEBUG nova.objects.base [None req-4431daf5-21b2-4d0f-8867-50a609adbff9 tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] Object Instance<e09b3809-2e23-401c-9a72-88feb2bb657c> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75229) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 09:48:02 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-4431daf5-21b2-4d0f-8867-50a609adbff9 tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] [instance: e09b3809-2e23-401c-9a72-88feb2bb657c] End _get_guest_xml xml=<domain type="kvm">
Nov 14 09:48:02 user nova-compute[75229]:   <uuid>e09b3809-2e23-401c-9a72-88feb2bb657c</uuid>
Nov 14 09:48:02 user nova-compute[75229]:   <name>instance-00000004</name>
Nov 14 09:48:02 user nova-compute[75229]:   <memory>524288</memory>
Nov 14 09:48:02 user nova-compute[75229]:   <vcpu>1</vcpu>
Nov 14 09:48:02 user nova-compute[75229]:   <metadata>
Nov 14 09:48:02 user nova-compute[75229]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 09:48:02 user nova-compute[75229]:       <nova:package version="0.0.0"/>
Nov 14 09:48:02 user nova-compute[75229]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-1726752268</nova:name>
Nov 14 09:48:02 user nova-compute[75229]:       <nova:creationTime>2023-11-14 09:48:01</nova:creationTime>
Nov 14 09:48:02 user nova-compute[75229]:       <nova:flavor name="m1.tiny">
Nov 14 09:48:02 user nova-compute[75229]:         <nova:memory>512</nova:memory>
Nov 14 09:48:02 user nova-compute[75229]:         <nova:disk>1</nova:disk>
Nov 14 09:48:02 user nova-compute[75229]:         <nova:swap>0</nova:swap>
Nov 14 09:48:02 user nova-compute[75229]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 09:48:02 user nova-compute[75229]:         <nova:vcpus>1</nova:vcpus>
Nov 14 09:48:02 user nova-compute[75229]:       </nova:flavor>
Nov 14 09:48:02 user nova-compute[75229]:       <nova:owner>
Nov 14 09:48:02 user nova-compute[75229]:         <nova:user uuid="fbe8d49b2c9e43cf98f14f49fa8de80c">tempest-ServerStableDeviceRescueTest-1482859960-project-member</nova:user>
Nov 14 09:48:02 user nova-compute[75229]:         <nova:project uuid="54dca06fda8b43d5bc92fa7c97a872a7">tempest-ServerStableDeviceRescueTest-1482859960</nova:project>
Nov 14 09:48:02 user nova-compute[75229]:       </nova:owner>
Nov 14 09:48:02 user nova-compute[75229]:       <nova:root type="image" uuid="3bef8470-ecc7-40e3-95d4-9254348ea72d"/>
Nov 14 09:48:02 user nova-compute[75229]:       <nova:ports>
Nov 14 09:48:02 user nova-compute[75229]:         <nova:port uuid="472488d2-9453-4d74-a6b1-6966b835572d">
Nov 14 09:48:02 user nova-compute[75229]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 14 09:48:02 user nova-compute[75229]:         </nova:port>
Nov 14 09:48:02 user nova-compute[75229]:       </nova:ports>
Nov 14 09:48:02 user nova-compute[75229]:     </nova:instance>
Nov 14 09:48:02 user nova-compute[75229]:   </metadata>
Nov 14 09:48:02 user nova-compute[75229]:   <sysinfo type="smbios">
Nov 14 09:48:02 user nova-compute[75229]:     <system>
Nov 14 09:48:02 user nova-compute[75229]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 09:48:02 user nova-compute[75229]:       <entry name="product">OpenStack Nova</entry>
Nov 14 09:48:02 user nova-compute[75229]:       <entry name="version">0.0.0</entry>
Nov 14 09:48:02 user nova-compute[75229]:       <entry name="serial">e09b3809-2e23-401c-9a72-88feb2bb657c</entry>
Nov 14 09:48:02 user nova-compute[75229]:       <entry name="uuid">e09b3809-2e23-401c-9a72-88feb2bb657c</entry>
Nov 14 09:48:02 user nova-compute[75229]:       <entry name="family">Virtual Machine</entry>
Nov 14 09:48:02 user nova-compute[75229]:     </system>
Nov 14 09:48:02 user nova-compute[75229]:   </sysinfo>
Nov 14 09:48:02 user nova-compute[75229]:   <os>
Nov 14 09:48:02 user nova-compute[75229]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 09:48:02 user nova-compute[75229]:     <smbios mode="sysinfo"/>
Nov 14 09:48:02 user nova-compute[75229]:   </os>
Nov 14 09:48:02 user nova-compute[75229]:   <features>
Nov 14 09:48:02 user nova-compute[75229]:     <acpi/>
Nov 14 09:48:02 user nova-compute[75229]:     <apic/>
Nov 14 09:48:02 user nova-compute[75229]:     <vmcoreinfo/>
Nov 14 09:48:02 user nova-compute[75229]:   </features>
Nov 14 09:48:02 user nova-compute[75229]:   <clock offset="utc">
Nov 14 09:48:02 user nova-compute[75229]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 09:48:02 user nova-compute[75229]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 09:48:02 user nova-compute[75229]:     <timer name="hpet" present="no"/>
Nov 14 09:48:02 user nova-compute[75229]:   </clock>
Nov 14 09:48:02 user nova-compute[75229]:   <cpu mode="custom" match="exact">
Nov 14 09:48:02 user nova-compute[75229]:     <model>Nehalem</model>
Nov 14 09:48:02 user nova-compute[75229]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 09:48:02 user nova-compute[75229]:   </cpu>
Nov 14 09:48:02 user nova-compute[75229]:   <devices>
Nov 14 09:48:02 user nova-compute[75229]:     <disk type="file" device="disk">
Nov 14 09:48:02 user nova-compute[75229]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 09:48:02 user nova-compute[75229]:       <source file="/opt/stack/data/nova/instances/e09b3809-2e23-401c-9a72-88feb2bb657c/disk"/>
Nov 14 09:48:02 user nova-compute[75229]:       <target dev="vda" bus="virtio"/>
Nov 14 09:48:02 user nova-compute[75229]:     </disk>
Nov 14 09:48:02 user nova-compute[75229]:     <disk type="block" device="disk">
Nov 14 09:48:02 user nova-compute[75229]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 09:48:02 user nova-compute[75229]:       <source dev="/dev/sde"/>
Nov 14 09:48:02 user nova-compute[75229]:       <target dev="vdb" bus="virtio"/>
Nov 14 09:48:02 user nova-compute[75229]:       <serial>3fed285f-9be4-4601-8cb5-4329d7ebed8c</serial>
Nov 14 09:48:02 user nova-compute[75229]:     </disk>
Nov 14 09:48:02 user nova-compute[75229]:     <disk type="file" device="disk">
Nov 14 09:48:02 user nova-compute[75229]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 09:48:02 user nova-compute[75229]:       <source file="/opt/stack/data/nova/instances/e09b3809-2e23-401c-9a72-88feb2bb657c/disk.rescue"/>
Nov 14 09:48:02 user nova-compute[75229]:       <target dev="vdc" bus="virtio"/>
Nov 14 09:48:02 user nova-compute[75229]:       <boot order="1"/>
Nov 14 09:48:02 user nova-compute[75229]:     </disk>
Nov 14 09:48:02 user nova-compute[75229]:     <interface type="ethernet">
Nov 14 09:48:02 user nova-compute[75229]:       <mac address="fa:16:3e:9f:3a:e8"/>
Nov 14 09:48:02 user nova-compute[75229]:       <model type="virtio"/>
Nov 14 09:48:02 user nova-compute[75229]:       <mtu size="1442"/>
Nov 14 09:48:02 user nova-compute[75229]:       <target dev="tap472488d2-94"/>
Nov 14 09:48:02 user nova-compute[75229]:     </interface>
Nov 14 09:48:02 user nova-compute[75229]:     <serial type="pty">
Nov 14 09:48:02 user nova-compute[75229]:       <log file="/opt/stack/data/nova/instances/e09b3809-2e23-401c-9a72-88feb2bb657c/console.log" append="off"/>
Nov 14 09:48:02 user nova-compute[75229]:     </serial>
Nov 14 09:48:02 user nova-compute[75229]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 09:48:02 user nova-compute[75229]:     <video>
Nov 14 09:48:02 user nova-compute[75229]:       <model type="virtio"/>
Nov 14 09:48:02 user nova-compute[75229]:     </video>
Nov 14 09:48:02 user nova-compute[75229]:     <rng model="virtio">
Nov 14 09:48:02 user nova-compute[75229]:       <backend model="random">/dev/urandom</backend>
Nov 14 09:48:02 user nova-compute[75229]:     </rng>
Nov 14 09:48:02 user nova-compute[75229]:     <controller type="usb" index="0" model="none"/>
Nov 14 09:48:02 user nova-compute[75229]:     <memballoon model="virtio">
Nov 14 09:48:02 user nova-compute[75229]:       <stats period="10"/>
Nov 14 09:48:02 user nova-compute[75229]:     </memballoon>
Nov 14 09:48:02 user nova-compute[75229]:   </devices>
Nov 14 09:48:02 user nova-compute[75229]: </domain>
Nov 14 09:48:02 user nova-compute[75229]:  {{(pid=75229) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 09:48:02 user nova-compute[75229]: INFO nova.virt.libvirt.driver [-] [instance: e09b3809-2e23-401c-9a72-88feb2bb657c] Instance destroyed successfully.
Nov 14 09:48:02 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-4431daf5-21b2-4d0f-8867-50a609adbff9 tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] No BDM found with device name vda, not building metadata. {{(pid=75229) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 09:48:02 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-4431daf5-21b2-4d0f-8867-50a609adbff9 tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75229) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 09:48:02 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-4431daf5-21b2-4d0f-8867-50a609adbff9 tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75229) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 09:48:02 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-4431daf5-21b2-4d0f-8867-50a609adbff9 tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] No VIF found with MAC fa:16:3e:9f:3a:e8, not building metadata {{(pid=75229) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 09:48:02 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:48:02 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:48:02 user nova-compute[75229]: DEBUG nova.network.neutron [None req-3f7a76b1-7df1-476d-8de9-cc7e5ab78ca9 tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] [instance: a60d339f-e134-477c-8505-bf8c79d2a21c] Updating instance_info_cache with network_info: [{"id": "cb98fc47-7b69-4bde-9a4c-717cd44ba908", "address": "fa:16:3e:6c:f4:6d", "network": {"id": "2b667d50-4579-4453-b4d3-a818a0d2c6fc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1719812180-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.24", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32e17c7c586542139cdbc5bfda57e075", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb98fc47-7b", "ovs_interfaceid": "cb98fc47-7b69-4bde-9a4c-717cd44ba908", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 09:48:02 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-3f7a76b1-7df1-476d-8de9-cc7e5ab78ca9 tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] Releasing lock "refresh_cache-a60d339f-e134-477c-8505-bf8c79d2a21c" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 09:48:03 user nova-compute[75229]: DEBUG nova.compute.manager [None req-65cb7584-889d-4d19-9969-57c66dc18090 tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] [instance: 90bd76df-96cb-4bec-9862-853d94cdbaab] Instance event wait completed in 0 seconds for  {{(pid=75229) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 09:48:03 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-65cb7584-889d-4d19-9969-57c66dc18090 tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] [instance: 90bd76df-96cb-4bec-9862-853d94cdbaab] Guest created on hypervisor {{(pid=75229) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 09:48:03 user nova-compute[75229]: INFO nova.virt.libvirt.driver [-] [instance: 90bd76df-96cb-4bec-9862-853d94cdbaab] Instance spawned successfully.
Nov 14 09:48:03 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-3f7a76b1-7df1-476d-8de9-cc7e5ab78ca9 tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] [instance: a60d339f-e134-477c-8505-bf8c79d2a21c] Starting migrate_disk_and_power_off {{(pid=75229) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Nov 14 09:48:03 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:48:03 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:48:03 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:48:03 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:48:03 user nova-compute[75229]: DEBUG nova.compute.manager [None req-65cb7584-889d-4d19-9969-57c66dc18090 tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] [instance: 90bd76df-96cb-4bec-9862-853d94cdbaab] Checking state {{(pid=75229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 09:48:03 user nova-compute[75229]: DEBUG nova.compute.manager [req-528886e8-880a-4cf8-8256-eebfa902479d req-61c5839d-3080-4777-a020-a66a050ae5e4 service nova] [instance: a60d339f-e134-477c-8505-bf8c79d2a21c] Received event network-vif-unplugged-cb98fc47-7b69-4bde-9a4c-717cd44ba908 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:48:03 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-528886e8-880a-4cf8-8256-eebfa902479d req-61c5839d-3080-4777-a020-a66a050ae5e4 service nova] Acquiring lock "a60d339f-e134-477c-8505-bf8c79d2a21c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:48:03 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-528886e8-880a-4cf8-8256-eebfa902479d req-61c5839d-3080-4777-a020-a66a050ae5e4 service nova] Lock "a60d339f-e134-477c-8505-bf8c79d2a21c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:48:03 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-528886e8-880a-4cf8-8256-eebfa902479d req-61c5839d-3080-4777-a020-a66a050ae5e4 service nova] Lock "a60d339f-e134-477c-8505-bf8c79d2a21c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:48:03 user nova-compute[75229]: DEBUG nova.compute.manager [req-528886e8-880a-4cf8-8256-eebfa902479d req-61c5839d-3080-4777-a020-a66a050ae5e4 service nova] [instance: a60d339f-e134-477c-8505-bf8c79d2a21c] No waiting events found dispatching network-vif-unplugged-cb98fc47-7b69-4bde-9a4c-717cd44ba908 {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 09:48:03 user nova-compute[75229]: WARNING nova.compute.manager [req-528886e8-880a-4cf8-8256-eebfa902479d req-61c5839d-3080-4777-a020-a66a050ae5e4 service nova] [instance: a60d339f-e134-477c-8505-bf8c79d2a21c] Received unexpected event network-vif-unplugged-cb98fc47-7b69-4bde-9a4c-717cd44ba908 for instance with vm_state active and task_state resize_migrating.
Nov 14 09:48:03 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-65cb7584-889d-4d19-9969-57c66dc18090 tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Lock "90bd76df-96cb-4bec-9862-853d94cdbaab" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 26.221s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:48:04 user nova-compute[75229]: DEBUG nova.compute.manager [req-ff260018-1041-4fc4-af90-096513bfba40 req-a03265e3-9892-4c23-afee-1eea1532c8bd service nova] [instance: e09b3809-2e23-401c-9a72-88feb2bb657c] Received event network-vif-plugged-472488d2-9453-4d74-a6b1-6966b835572d {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:48:04 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-ff260018-1041-4fc4-af90-096513bfba40 req-a03265e3-9892-4c23-afee-1eea1532c8bd service nova] Acquiring lock "e09b3809-2e23-401c-9a72-88feb2bb657c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:48:04 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-ff260018-1041-4fc4-af90-096513bfba40 req-a03265e3-9892-4c23-afee-1eea1532c8bd service nova] Lock "e09b3809-2e23-401c-9a72-88feb2bb657c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.005s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:48:04 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-ff260018-1041-4fc4-af90-096513bfba40 req-a03265e3-9892-4c23-afee-1eea1532c8bd service nova] Lock "e09b3809-2e23-401c-9a72-88feb2bb657c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:48:04 user nova-compute[75229]: DEBUG nova.compute.manager [req-ff260018-1041-4fc4-af90-096513bfba40 req-a03265e3-9892-4c23-afee-1eea1532c8bd service nova] [instance: e09b3809-2e23-401c-9a72-88feb2bb657c] No waiting events found dispatching network-vif-plugged-472488d2-9453-4d74-a6b1-6966b835572d {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 09:48:04 user nova-compute[75229]: WARNING nova.compute.manager [req-ff260018-1041-4fc4-af90-096513bfba40 req-a03265e3-9892-4c23-afee-1eea1532c8bd service nova] [instance: e09b3809-2e23-401c-9a72-88feb2bb657c] Received unexpected event network-vif-plugged-472488d2-9453-4d74-a6b1-6966b835572d for instance with vm_state active and task_state rescuing.
Nov 14 09:48:04 user nova-compute[75229]: DEBUG nova.compute.manager [req-ff260018-1041-4fc4-af90-096513bfba40 req-a03265e3-9892-4c23-afee-1eea1532c8bd service nova] [instance: 90bd76df-96cb-4bec-9862-853d94cdbaab] Received event network-vif-plugged-3b9b5b2a-5b1b-4ec6-900d-c27e7c4a625e {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:48:04 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-ff260018-1041-4fc4-af90-096513bfba40 req-a03265e3-9892-4c23-afee-1eea1532c8bd service nova] Acquiring lock "90bd76df-96cb-4bec-9862-853d94cdbaab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:48:04 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-ff260018-1041-4fc4-af90-096513bfba40 req-a03265e3-9892-4c23-afee-1eea1532c8bd service nova] Lock "90bd76df-96cb-4bec-9862-853d94cdbaab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:48:04 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-ff260018-1041-4fc4-af90-096513bfba40 req-a03265e3-9892-4c23-afee-1eea1532c8bd service nova] Lock "90bd76df-96cb-4bec-9862-853d94cdbaab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:48:04 user nova-compute[75229]: DEBUG nova.compute.manager [req-ff260018-1041-4fc4-af90-096513bfba40 req-a03265e3-9892-4c23-afee-1eea1532c8bd service nova] [instance: 90bd76df-96cb-4bec-9862-853d94cdbaab] No waiting events found dispatching network-vif-plugged-3b9b5b2a-5b1b-4ec6-900d-c27e7c4a625e {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 09:48:04 user nova-compute[75229]: WARNING nova.compute.manager [req-ff260018-1041-4fc4-af90-096513bfba40 req-a03265e3-9892-4c23-afee-1eea1532c8bd service nova] [instance: 90bd76df-96cb-4bec-9862-853d94cdbaab] Received unexpected event network-vif-plugged-3b9b5b2a-5b1b-4ec6-900d-c27e7c4a625e for instance with vm_state active and task_state None.
Nov 14 09:48:04 user nova-compute[75229]: INFO nova.virt.libvirt.driver [-] [instance: a60d339f-e134-477c-8505-bf8c79d2a21c] Instance destroyed successfully.
Nov 14 09:48:04 user nova-compute[75229]: DEBUG nova.virt.libvirt.vif [None req-3f7a76b1-7df1-476d-8de9-cc7e5ab78ca9 tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T09:43:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-285833760',display_name='tempest-ServerActionsTestOtherB-server-285833760',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-285833760',id=5,image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLBqRiXBmoqcQBqBQflJnJ0Bni+p+JlFtve2BlM0X9wLvjWsKzu7TCQo3Ot5hzNFvzwCz/gEUspFHpyxxEkScMIm/fUvYWhxYR4DsojCDDatjjGg5V63rlfYUre+iymhFw==',key_name='tempest-keypair-1362974744',keypairs=<?>,launch_index=0,launched_at=2023-11-14T09:44:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='32e17c7c586542139cdbc5bfda57e075',ramdisk_id='',reservation_id='r-vw8kxtrn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-45710955',owner_user_name='tempest-ServerActionsTestOtherB-45710955-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T09:48:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='39c6903e2d154e838835eb5265776521',uuid=a60d339f-e134-477c-8505-bf8c79d2a21c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cb98fc47-7b69-4bde-9a4c-717cd44ba908", "address": "fa:16:3e:6c:f4:6d", "network": {"id": "2b667d50-4579-4453-b4d3-a818a0d2c6fc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1719812180-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.24", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1719812180-network", "vif_mac": "fa:16:3e:6c:f4:6d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32e17c7c586542139cdbc5bfda57e075", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb98fc47-7b", "ovs_interfaceid": "cb98fc47-7b69-4bde-9a4c-717cd44ba908", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 09:48:04 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-3f7a76b1-7df1-476d-8de9-cc7e5ab78ca9 tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] Converting VIF {"id": "cb98fc47-7b69-4bde-9a4c-717cd44ba908", "address": "fa:16:3e:6c:f4:6d", "network": {"id": "2b667d50-4579-4453-b4d3-a818a0d2c6fc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1719812180-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.24", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1719812180-network", "vif_mac": "fa:16:3e:6c:f4:6d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32e17c7c586542139cdbc5bfda57e075", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb98fc47-7b", "ovs_interfaceid": "cb98fc47-7b69-4bde-9a4c-717cd44ba908", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 09:48:04 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-3f7a76b1-7df1-476d-8de9-cc7e5ab78ca9 tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6c:f4:6d,bridge_name='br-int',has_traffic_filtering=True,id=cb98fc47-7b69-4bde-9a4c-717cd44ba908,network=Network(2b667d50-4579-4453-b4d3-a818a0d2c6fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb98fc47-7b') {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 09:48:04 user nova-compute[75229]: DEBUG os_vif [None req-3f7a76b1-7df1-476d-8de9-cc7e5ab78ca9 tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6c:f4:6d,bridge_name='br-int',has_traffic_filtering=True,id=cb98fc47-7b69-4bde-9a4c-717cd44ba908,network=Network(2b667d50-4579-4453-b4d3-a818a0d2c6fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb98fc47-7b') {{(pid=75229) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 09:48:04 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:48:04 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcb98fc47-7b, bridge=br-int, if_exists=True) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:48:04 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:48:04 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 09:48:04 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:48:04 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:48:04 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4ef27463-5349-4db0-85bc-39ad82899bfd) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:48:04 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:48:04 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 09:48:04 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:48:04 user nova-compute[75229]: INFO os_vif [None req-3f7a76b1-7df1-476d-8de9-cc7e5ab78ca9 tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6c:f4:6d,bridge_name='br-int',has_traffic_filtering=True,id=cb98fc47-7b69-4bde-9a4c-717cd44ba908,network=Network(2b667d50-4579-4453-b4d3-a818a0d2c6fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb98fc47-7b')
Nov 14 09:48:04 user nova-compute[75229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3f7a76b1-7df1-476d-8de9-cc7e5ab78ca9 tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] [instance: a60d339f-e134-477c-8505-bf8c79d2a21c] calling os-brick to detach iSCSI Volume {{(pid=75229) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 09:48:04 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f7a76b1-7df1-476d-8de9-cc7e5ab78ca9 tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f73f85151b0>, {'target_iqn': 'iqn.2010-10.org.openstack:aca09258-022b-4f04-b418-f2a170332755', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BrhyGdAv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 09:48:04 user nova-compute[75229]: WARNING os_brick.initiator.connectors.base [None req-3f7a76b1-7df1-476d-8de9-cc7e5ab78ca9 tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 09:48:04 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-3f7a76b1-7df1-476d-8de9-cc7e5ab78ca9 tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 09:48:04 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-3f7a76b1-7df1-476d-8de9-cc7e5ab78ca9 tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 09:48:04 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:48:04 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:48:04 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[3851fd07-6456-42f4-8060-b8388c5df9a5]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5b54e594-ae66-4ba2-9bda-aa4431d31c3f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:db131665-6ac2-437a-8adf-23593475a8aa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:aca09258-022b-4f04-b418-f2a170332755\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:13c53511-ea64-4896-b325-504ce58d7895\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3fed285f-9be4-4601-8cb5-4329d7ebed8c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b0433e38-fa42-4cff-af48-8cb5da297597\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:48:04 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f7a76b1-7df1-476d-8de9-cc7e5ab78ca9 tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 09:48:04 user nova-compute[75229]: No targets found.
Nov 14 09:48:04 user nova-compute[75229]: iSNS:
Nov 14 09:48:04 user nova-compute[75229]: No targets found.
Nov 14 09:48:04 user nova-compute[75229]: STATIC:
Nov 14 09:48:04 user nova-compute[75229]: Target: iqn.2010-10.org.openstack:5b54e594-ae66-4ba2-9bda-aa4431d31c3f
Nov 14 09:48:04 user nova-compute[75229]:         Portal: 172.16.0.220:3260,-1
Nov 14 09:48:04 user nova-compute[75229]:                 Iface Name: default
Nov 14 09:48:04 user nova-compute[75229]: Target: iqn.2010-10.org.openstack:db131665-6ac2-437a-8adf-23593475a8aa
Nov 14 09:48:04 user nova-compute[75229]:         Portal: 172.16.0.220:3260,-1
Nov 14 09:48:04 user nova-compute[75229]:                 Iface Name: default
Nov 14 09:48:04 user nova-compute[75229]: Target: iqn.2010-10.org.openstack:aca09258-022b-4f04-b418-f2a170332755
Nov 14 09:48:04 user nova-compute[75229]:         Portal: 172.16.0.220:3260,-1
Nov 14 09:48:04 user nova-compute[75229]:                 Iface Name: default
Nov 14 09:48:04 user nova-compute[75229]: Target: iqn.2010-10.org.openstack:13c53511-ea64-4896-b325-504ce58d7895
Nov 14 09:48:04 user nova-compute[75229]:         Portal: 172.16.0.220:3260,-1
Nov 14 09:48:04 user nova-compute[75229]:                 Iface Name: default
Nov 14 09:48:04 user nova-compute[75229]: Target: iqn.2010-10.org.openstack:3fed285f-9be4-4601-8cb5-4329d7ebed8c
Nov 14 09:48:04 user nova-compute[75229]:         Portal: 172.16.0.220:3260,-1
Nov 14 09:48:04 user nova-compute[75229]:                 Iface Name: default
Nov 14 09:48:04 user nova-compute[75229]: Target: iqn.2010-10.org.openstack:b0433e38-fa42-4cff-af48-8cb5da297597
Nov 14 09:48:04 user nova-compute[75229]:         Portal: 172.16.0.220:3260,-1
Nov 14 09:48:04 user nova-compute[75229]:                 Iface Name: default
Nov 14 09:48:04 user nova-compute[75229]: FIRMWARE:
Nov 14 09:48:04 user nova-compute[75229]: No targets found.
Nov 14 09:48:04 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 09:48:04 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f7a76b1-7df1-476d-8de9-cc7e5ab78ca9 tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 09:48:04 user nova-compute[75229]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 09:48:04 user nova-compute[75229]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75229) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 09:48:04 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f7a76b1-7df1-476d-8de9-cc7e5ab78ca9 tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:aca09258-022b-4f04-b418-f2a170332755', 0)] {{(pid=75229) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 09:48:04 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:48:04 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:48:04 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bb201af-6236-4436-8c2e-8f74ef87720d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:13c53511-ea64-4896-b325-504ce58d7895\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3fed285f-9be4-4601-8cb5-4329d7ebed8c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5b54e594-ae66-4ba2-9bda-aa4431d31c3f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aca09258-022b-4f04-b418-f2a170332755\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b0433e38-fa42-4cff-af48-8cb5da297597\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:db131665-6ac2-437a-8adf-23593475a8aa\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:48:04 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:48:04 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:48:04 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[91a74c04-4236-4512-81d7-c1f6a4546045]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db131665-6ac2-437a-8adf-23593475a8aa (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0433e38-fa42-4cff-af48-8cb5da297597 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13c53511-ea64-4896-b325-504ce58d7895 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fed285f-9be4-4601-8cb5-4329d7ebed8c (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aca09258-022b-4f04-b418-f2a170332755 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b54e594-ae66-4ba2-9bda-aa4431d31c3f (non-flash)\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:48:04 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f7a76b1-7df1-476d-8de9-cc7e5ab78ca9 tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db131665-6ac2-437a-8adf-23593475a8aa (non-flash)
Nov 14 09:48:04 user nova-compute[75229]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0433e38-fa42-4cff-af48-8cb5da297597 (non-flash)
Nov 14 09:48:04 user nova-compute[75229]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13c53511-ea64-4896-b325-504ce58d7895 (non-flash)
Nov 14 09:48:04 user nova-compute[75229]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fed285f-9be4-4601-8cb5-4329d7ebed8c (non-flash)
Nov 14 09:48:04 user nova-compute[75229]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aca09258-022b-4f04-b418-f2a170332755 (non-flash)
Nov 14 09:48:04 user nova-compute[75229]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b54e594-ae66-4ba2-9bda-aa4431d31c3f (non-flash)
Nov 14 09:48:04 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 09:48:04 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f7a76b1-7df1-476d-8de9-cc7e5ab78ca9 tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db131665-6ac2-437a-8adf-23593475a8aa (non-flash)
Nov 14 09:48:04 user nova-compute[75229]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0433e38-fa42-4cff-af48-8cb5da297597 (non-flash)
Nov 14 09:48:04 user nova-compute[75229]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13c53511-ea64-4896-b325-504ce58d7895 (non-flash)
Nov 14 09:48:04 user nova-compute[75229]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fed285f-9be4-4601-8cb5-4329d7ebed8c (non-flash)
Nov 14 09:48:04 user nova-compute[75229]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aca09258-022b-4f04-b418-f2a170332755 (non-flash)
Nov 14 09:48:04 user nova-compute[75229]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b54e594-ae66-4ba2-9bda-aa4431d31c3f (non-flash)
Nov 14 09:48:04 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 09:48:04 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f7a76b1-7df1-476d-8de9-cc7e5ab78ca9 tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f73d4d19b40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:aca09258-022b-4f04-b418-f2a170332755'): ({'sdf'}, set())}) {{(pid=75229) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 09:48:04 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-3f7a76b1-7df1-476d-8de9-cc7e5ab78ca9 tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] Removing single pathed devices sdf {{(pid=75229) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 09:48:04 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:48:04 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.047s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:48:04 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0284cf9-7d29-4bf3-8d2a-087ff9f2071a]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:48:04 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:48:04 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.019s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:48:04 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[78494673-a060-45dc-897c-fd00b235a771]: (4, ('ok\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:48:04 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-3f7a76b1-7df1-476d-8de9-cc7e5ab78ca9 tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] Flushing IO for device /dev/sdf {{(pid=75229) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 09:48:04 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:48:04 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.017s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:48:04 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd2e9ba2-6a65-4a96-8a93-fdd54dd9a42b]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:48:04 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-3f7a76b1-7df1-476d-8de9-cc7e5ab78ca9 tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75229) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 09:48:04 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:48:04 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.044s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:48:04 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[217fb3ba-84b1-4bb6-964a-2030e9c5ba8c]: (4, ('1', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:48:04 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-3f7a76b1-7df1-476d-8de9-cc7e5ab78ca9 tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75229) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 09:48:04 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-3f7a76b1-7df1-476d-8de9-cc7e5ab78ca9 tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] SCSI volumes sdf have been removed. {{(pid=75229) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 09:48:04 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f7a76b1-7df1-476d-8de9-cc7e5ab78ca9 tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:aca09258-022b-4f04-b418-f2a170332755')] {{(pid=75229) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 09:48:04 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aca09258-022b-4f04-b418-f2a170332755 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:48:04 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aca09258-022b-4f04-b418-f2a170332755 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:48:04 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2ceb742-2810-4ded-80da-7c7876138810]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:48:04 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f7a76b1-7df1-476d-8de9-cc7e5ab78ca9 tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:48:04 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aca09258-022b-4f04-b418-f2a170332755 -p 172.16.0.220:3260 --logout {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:48:04 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:48:04 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:48:04 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aca09258-022b-4f04-b418-f2a170332755 -p 172.16.0.220:3260 --logout" returned: 0 in 0.096s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:48:04 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffc5d2ab-bedd-4f16-b7b7-8f07fa8ef726]: (4, ('Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:aca09258-022b-4f04-b418-f2a170332755, portal: 172.16.0.220,3260]\nLogout of [sid: 17, target: iqn.2010-10.org.openstack:aca09258-022b-4f04-b418-f2a170332755, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:48:04 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f7a76b1-7df1-476d-8de9-cc7e5ab78ca9 tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:aca09258-022b-4f04-b418-f2a170332755, portal: 172.16.0.220,3260]
Nov 14 09:48:04 user nova-compute[75229]: Logout of [sid: 17, target: iqn.2010-10.org.openstack:aca09258-022b-4f04-b418-f2a170332755, portal: 172.16.0.220,3260] successful.
Nov 14 09:48:04 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:48:04 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aca09258-022b-4f04-b418-f2a170332755 -p 172.16.0.220:3260 --op delete {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:48:04 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:48:04 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:48:04 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aca09258-022b-4f04-b418-f2a170332755 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.043s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:48:04 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[93c0d727-5f5a-452b-9ccd-8289a6a5f2b7]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:48:04 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f7a76b1-7df1-476d-8de9-cc7e5ab78ca9 tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:48:04 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-3f7a76b1-7df1-476d-8de9-cc7e5ab78ca9 tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.425s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 09:48:04 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f7a76b1-7df1-476d-8de9-cc7e5ab78ca9 tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] <== disconnect_volume: return (426ms) None {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 09:48:04 user nova-compute[75229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3f7a76b1-7df1-476d-8de9-cc7e5ab78ca9 tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] [instance: a60d339f-e134-477c-8505-bf8c79d2a21c] Disconnected iSCSI Volume {{(pid=75229) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 09:48:04 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-3f7a76b1-7df1-476d-8de9-cc7e5ab78ca9 tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a60d339f-e134-477c-8505-bf8c79d2a21c/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:48:05 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-3f7a76b1-7df1-476d-8de9-cc7e5ab78ca9 tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a60d339f-e134-477c-8505-bf8c79d2a21c/disk --force-share --output=json" returned: 0 in 0.289s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:48:05 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-3f7a76b1-7df1-476d-8de9-cc7e5ab78ca9 tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a60d339f-e134-477c-8505-bf8c79d2a21c/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:48:05 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-3f7a76b1-7df1-476d-8de9-cc7e5ab78ca9 tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a60d339f-e134-477c-8505-bf8c79d2a21c/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:48:05 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-3f7a76b1-7df1-476d-8de9-cc7e5ab78ca9 tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=75229) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 09:48:05 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-3f7a76b1-7df1-476d-8de9-cc7e5ab78ca9 tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/a60d339f-e134-477c-8505-bf8c79d2a21c_resize/disk /opt/stack/data/nova/instances/a60d339f-e134-477c-8505-bf8c79d2a21c/disk {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:48:05 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-ed4a7950-6e03-4793-89a0-6118f000eacb tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] Acquiring lock "d6e2d77b-9894-4afa-8fa1-13a2842ba9a7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:48:05 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-ed4a7950-6e03-4793-89a0-6118f000eacb tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] Lock "d6e2d77b-9894-4afa-8fa1-13a2842ba9a7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:48:05 user nova-compute[75229]: DEBUG nova.compute.manager [None req-ed4a7950-6e03-4793-89a0-6118f000eacb tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] [instance: d6e2d77b-9894-4afa-8fa1-13a2842ba9a7] Starting instance... {{(pid=75229) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 09:48:05 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:48:05 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:48:05 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:48:05 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:48:05 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-ed4a7950-6e03-4793-89a0-6118f000eacb tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:48:05 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-ed4a7950-6e03-4793-89a0-6118f000eacb tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:48:05 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-ed4a7950-6e03-4793-89a0-6118f000eacb tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75229) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 09:48:05 user nova-compute[75229]: INFO nova.compute.claims [None req-ed4a7950-6e03-4793-89a0-6118f000eacb tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] [instance: d6e2d77b-9894-4afa-8fa1-13a2842ba9a7] Claim successful on node user
Nov 14 09:48:05 user nova-compute[75229]: DEBUG nova.compute.manager [req-27abc201-945b-499c-9b04-77e30c4af2e9 req-ab321e96-f48f-4283-84df-21aea068ceba service nova] [instance: a60d339f-e134-477c-8505-bf8c79d2a21c] Received event network-vif-plugged-cb98fc47-7b69-4bde-9a4c-717cd44ba908 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:48:05 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-27abc201-945b-499c-9b04-77e30c4af2e9 req-ab321e96-f48f-4283-84df-21aea068ceba service nova] Acquiring lock "a60d339f-e134-477c-8505-bf8c79d2a21c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:48:05 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-27abc201-945b-499c-9b04-77e30c4af2e9 req-ab321e96-f48f-4283-84df-21aea068ceba service nova] Lock "a60d339f-e134-477c-8505-bf8c79d2a21c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:48:05 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-27abc201-945b-499c-9b04-77e30c4af2e9 req-ab321e96-f48f-4283-84df-21aea068ceba service nova] Lock "a60d339f-e134-477c-8505-bf8c79d2a21c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:48:05 user nova-compute[75229]: DEBUG nova.compute.manager [req-27abc201-945b-499c-9b04-77e30c4af2e9 req-ab321e96-f48f-4283-84df-21aea068ceba service nova] [instance: a60d339f-e134-477c-8505-bf8c79d2a21c] No waiting events found dispatching network-vif-plugged-cb98fc47-7b69-4bde-9a4c-717cd44ba908 {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 09:48:05 user nova-compute[75229]: WARNING nova.compute.manager [req-27abc201-945b-499c-9b04-77e30c4af2e9 req-ab321e96-f48f-4283-84df-21aea068ceba service nova] [instance: a60d339f-e134-477c-8505-bf8c79d2a21c] Received unexpected event network-vif-plugged-cb98fc47-7b69-4bde-9a4c-717cd44ba908 for instance with vm_state active and task_state resize_migrating.
Nov 14 09:48:05 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-3f7a76b1-7df1-476d-8de9-cc7e5ab78ca9 tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] CMD "cp -r /opt/stack/data/nova/instances/a60d339f-e134-477c-8505-bf8c79d2a21c_resize/disk /opt/stack/data/nova/instances/a60d339f-e134-477c-8505-bf8c79d2a21c/disk" returned: 0 in 0.453s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:48:05 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-3f7a76b1-7df1-476d-8de9-cc7e5ab78ca9 tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/a60d339f-e134-477c-8505-bf8c79d2a21c_resize/disk.info /opt/stack/data/nova/instances/a60d339f-e134-477c-8505-bf8c79d2a21c/disk.info {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:48:05 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-3f7a76b1-7df1-476d-8de9-cc7e5ab78ca9 tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] CMD "cp -r /opt/stack/data/nova/instances/a60d339f-e134-477c-8505-bf8c79d2a21c_resize/disk.info /opt/stack/data/nova/instances/a60d339f-e134-477c-8505-bf8c79d2a21c/disk.info" returned: 0 in 0.055s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:48:06 user nova-compute[75229]: DEBUG nova.compute.provider_tree [None req-ed4a7950-6e03-4793-89a0-6118f000eacb tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] Inventory has not changed in ProviderTree for provider: d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 {{(pid=75229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 09:48:06 user nova-compute[75229]: DEBUG nova.scheduler.client.report [None req-ed4a7950-6e03-4793-89a0-6118f000eacb tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] Inventory has not changed for provider d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 09:48:06 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-ed4a7950-6e03-4793-89a0-6118f000eacb tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.547s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:48:06 user nova-compute[75229]: DEBUG nova.compute.manager [None req-ed4a7950-6e03-4793-89a0-6118f000eacb tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] [instance: d6e2d77b-9894-4afa-8fa1-13a2842ba9a7] Start building networks asynchronously for instance. {{(pid=75229) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 09:48:06 user nova-compute[75229]: DEBUG nova.compute.manager [req-e9795118-3c15-4201-87a4-c0088383a70e req-9e75b3f5-991c-444b-8847-861356ef509d service nova] [instance: 90bd76df-96cb-4bec-9862-853d94cdbaab] Received event network-vif-plugged-3b9b5b2a-5b1b-4ec6-900d-c27e7c4a625e {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:48:06 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-e9795118-3c15-4201-87a4-c0088383a70e req-9e75b3f5-991c-444b-8847-861356ef509d service nova] Acquiring lock "90bd76df-96cb-4bec-9862-853d94cdbaab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:48:06 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-e9795118-3c15-4201-87a4-c0088383a70e req-9e75b3f5-991c-444b-8847-861356ef509d service nova] Lock "90bd76df-96cb-4bec-9862-853d94cdbaab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:48:06 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-e9795118-3c15-4201-87a4-c0088383a70e req-9e75b3f5-991c-444b-8847-861356ef509d service nova] Lock "90bd76df-96cb-4bec-9862-853d94cdbaab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:48:06 user nova-compute[75229]: DEBUG nova.compute.manager [req-e9795118-3c15-4201-87a4-c0088383a70e req-9e75b3f5-991c-444b-8847-861356ef509d service nova] [instance: 90bd76df-96cb-4bec-9862-853d94cdbaab] No waiting events found dispatching network-vif-plugged-3b9b5b2a-5b1b-4ec6-900d-c27e7c4a625e {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 09:48:06 user nova-compute[75229]: WARNING nova.compute.manager [req-e9795118-3c15-4201-87a4-c0088383a70e req-9e75b3f5-991c-444b-8847-861356ef509d service nova] [instance: 90bd76df-96cb-4bec-9862-853d94cdbaab] Received unexpected event network-vif-plugged-3b9b5b2a-5b1b-4ec6-900d-c27e7c4a625e for instance with vm_state active and task_state None.
Nov 14 09:48:06 user nova-compute[75229]: DEBUG nova.compute.manager [req-e9795118-3c15-4201-87a4-c0088383a70e req-9e75b3f5-991c-444b-8847-861356ef509d service nova] [instance: e09b3809-2e23-401c-9a72-88feb2bb657c] Received event network-vif-plugged-472488d2-9453-4d74-a6b1-6966b835572d {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:48:06 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-e9795118-3c15-4201-87a4-c0088383a70e req-9e75b3f5-991c-444b-8847-861356ef509d service nova] Acquiring lock "e09b3809-2e23-401c-9a72-88feb2bb657c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:48:06 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-e9795118-3c15-4201-87a4-c0088383a70e req-9e75b3f5-991c-444b-8847-861356ef509d service nova] Lock "e09b3809-2e23-401c-9a72-88feb2bb657c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:48:06 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-e9795118-3c15-4201-87a4-c0088383a70e req-9e75b3f5-991c-444b-8847-861356ef509d service nova] Lock "e09b3809-2e23-401c-9a72-88feb2bb657c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.003s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:48:06 user nova-compute[75229]: DEBUG nova.compute.manager [req-e9795118-3c15-4201-87a4-c0088383a70e req-9e75b3f5-991c-444b-8847-861356ef509d service nova] [instance: e09b3809-2e23-401c-9a72-88feb2bb657c] No waiting events found dispatching network-vif-plugged-472488d2-9453-4d74-a6b1-6966b835572d {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 09:48:06 user nova-compute[75229]: WARNING nova.compute.manager [req-e9795118-3c15-4201-87a4-c0088383a70e req-9e75b3f5-991c-444b-8847-861356ef509d service nova] [instance: e09b3809-2e23-401c-9a72-88feb2bb657c] Received unexpected event network-vif-plugged-472488d2-9453-4d74-a6b1-6966b835572d for instance with vm_state active and task_state rescuing.
Nov 14 09:48:06 user nova-compute[75229]: DEBUG nova.compute.manager [req-e9795118-3c15-4201-87a4-c0088383a70e req-9e75b3f5-991c-444b-8847-861356ef509d service nova] [instance: e09b3809-2e23-401c-9a72-88feb2bb657c] Received event network-vif-plugged-472488d2-9453-4d74-a6b1-6966b835572d {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:48:06 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-e9795118-3c15-4201-87a4-c0088383a70e req-9e75b3f5-991c-444b-8847-861356ef509d service nova] Acquiring lock "e09b3809-2e23-401c-9a72-88feb2bb657c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:48:06 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-e9795118-3c15-4201-87a4-c0088383a70e req-9e75b3f5-991c-444b-8847-861356ef509d service nova] Lock "e09b3809-2e23-401c-9a72-88feb2bb657c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:48:06 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-e9795118-3c15-4201-87a4-c0088383a70e req-9e75b3f5-991c-444b-8847-861356ef509d service nova] Lock "e09b3809-2e23-401c-9a72-88feb2bb657c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:48:06 user nova-compute[75229]: DEBUG nova.compute.manager [req-e9795118-3c15-4201-87a4-c0088383a70e req-9e75b3f5-991c-444b-8847-861356ef509d service nova] [instance: e09b3809-2e23-401c-9a72-88feb2bb657c] No waiting events found dispatching network-vif-plugged-472488d2-9453-4d74-a6b1-6966b835572d {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 09:48:06 user nova-compute[75229]: WARNING nova.compute.manager [req-e9795118-3c15-4201-87a4-c0088383a70e req-9e75b3f5-991c-444b-8847-861356ef509d service nova] [instance: e09b3809-2e23-401c-9a72-88feb2bb657c] Received unexpected event network-vif-plugged-472488d2-9453-4d74-a6b1-6966b835572d for instance with vm_state active and task_state rescuing.
Nov 14 09:48:06 user nova-compute[75229]: DEBUG nova.compute.manager [None req-ed4a7950-6e03-4793-89a0-6118f000eacb tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] [instance: d6e2d77b-9894-4afa-8fa1-13a2842ba9a7] Allocating IP information in the background. {{(pid=75229) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 09:48:06 user nova-compute[75229]: DEBUG nova.network.neutron [None req-ed4a7950-6e03-4793-89a0-6118f000eacb tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] [instance: d6e2d77b-9894-4afa-8fa1-13a2842ba9a7] allocate_for_instance() {{(pid=75229) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 09:48:06 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-ed4a7950-6e03-4793-89a0-6118f000eacb tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] [instance: d6e2d77b-9894-4afa-8fa1-13a2842ba9a7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 09:48:06 user nova-compute[75229]: DEBUG nova.compute.manager [None req-ed4a7950-6e03-4793-89a0-6118f000eacb tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] [instance: d6e2d77b-9894-4afa-8fa1-13a2842ba9a7] Start building block device mappings for instance. {{(pid=75229) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 09:48:06 user nova-compute[75229]: DEBUG nova.policy [None req-ed4a7950-6e03-4793-89a0-6118f000eacb tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '915a9d3b56244777aba6ea938e150d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2e9dceab8a45eaa3adb619433b7cf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75229) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 09:48:06 user nova-compute[75229]: DEBUG nova.compute.manager [None req-ed4a7950-6e03-4793-89a0-6118f000eacb tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] [instance: d6e2d77b-9894-4afa-8fa1-13a2842ba9a7] Start spawning the instance on the hypervisor. {{(pid=75229) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 09:48:06 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-ed4a7950-6e03-4793-89a0-6118f000eacb tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] [instance: d6e2d77b-9894-4afa-8fa1-13a2842ba9a7] Creating instance directory {{(pid=75229) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 09:48:06 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-ed4a7950-6e03-4793-89a0-6118f000eacb tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] [instance: d6e2d77b-9894-4afa-8fa1-13a2842ba9a7] Creating image(s)
Nov 14 09:48:06 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-ed4a7950-6e03-4793-89a0-6118f000eacb tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] Acquiring lock "/opt/stack/data/nova/instances/d6e2d77b-9894-4afa-8fa1-13a2842ba9a7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:48:06 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-ed4a7950-6e03-4793-89a0-6118f000eacb tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] Lock "/opt/stack/data/nova/instances/d6e2d77b-9894-4afa-8fa1-13a2842ba9a7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:48:06 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-ed4a7950-6e03-4793-89a0-6118f000eacb tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] Lock "/opt/stack/data/nova/instances/d6e2d77b-9894-4afa-8fa1-13a2842ba9a7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:48:06 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-ed4a7950-6e03-4793-89a0-6118f000eacb tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6 --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:48:06 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-ed4a7950-6e03-4793-89a0-6118f000eacb tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6 --force-share --output=json" returned: 0 in 0.216s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:48:06 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-ed4a7950-6e03-4793-89a0-6118f000eacb tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] Acquiring lock "4f30e3fe703d2381679612a57b1fb80a467f60b6" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:48:06 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-ed4a7950-6e03-4793-89a0-6118f000eacb tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] Lock "4f30e3fe703d2381679612a57b1fb80a467f60b6" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:48:06 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-ed4a7950-6e03-4793-89a0-6118f000eacb tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6 --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:48:06 user nova-compute[75229]: DEBUG nova.network.neutron [None req-3f7a76b1-7df1-476d-8de9-cc7e5ab78ca9 tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] [instance: a60d339f-e134-477c-8505-bf8c79d2a21c] Port cb98fc47-7b69-4bde-9a4c-717cd44ba908 binding to destination host user is already ACTIVE {{(pid=75229) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 14 09:48:07 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-ed4a7950-6e03-4793-89a0-6118f000eacb tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6 --force-share --output=json" returned: 0 in 0.190s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:48:07 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-ed4a7950-6e03-4793-89a0-6118f000eacb tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6,backing_fmt=raw /opt/stack/data/nova/instances/d6e2d77b-9894-4afa-8fa1-13a2842ba9a7/disk 1073741824 {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:48:07 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-ed4a7950-6e03-4793-89a0-6118f000eacb tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6,backing_fmt=raw /opt/stack/data/nova/instances/d6e2d77b-9894-4afa-8fa1-13a2842ba9a7/disk 1073741824" returned: 0 in 0.057s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:48:07 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-ed4a7950-6e03-4793-89a0-6118f000eacb tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] Lock "4f30e3fe703d2381679612a57b1fb80a467f60b6" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.254s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:48:07 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-ed4a7950-6e03-4793-89a0-6118f000eacb tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6 --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:48:07 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-3f7a76b1-7df1-476d-8de9-cc7e5ab78ca9 tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] Acquiring lock "a60d339f-e134-477c-8505-bf8c79d2a21c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:48:07 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-3f7a76b1-7df1-476d-8de9-cc7e5ab78ca9 tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] Lock "a60d339f-e134-477c-8505-bf8c79d2a21c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.002s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:48:07 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-3f7a76b1-7df1-476d-8de9-cc7e5ab78ca9 tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] Lock "a60d339f-e134-477c-8505-bf8c79d2a21c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:48:07 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-3f7a76b1-7df1-476d-8de9-cc7e5ab78ca9 tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] Acquiring lock "refresh_cache-a60d339f-e134-477c-8505-bf8c79d2a21c" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 09:48:07 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-3f7a76b1-7df1-476d-8de9-cc7e5ab78ca9 tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] Acquired lock "refresh_cache-a60d339f-e134-477c-8505-bf8c79d2a21c" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 09:48:07 user nova-compute[75229]: DEBUG nova.network.neutron [None req-3f7a76b1-7df1-476d-8de9-cc7e5ab78ca9 tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] [instance: a60d339f-e134-477c-8505-bf8c79d2a21c] Building network info cache for instance {{(pid=75229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 09:48:07 user nova-compute[75229]: DEBUG nova.compute.manager [None req-4431daf5-21b2-4d0f-8867-50a609adbff9 tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] [instance: e09b3809-2e23-401c-9a72-88feb2bb657c] Checking state {{(pid=75229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 09:48:07 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-ed4a7950-6e03-4793-89a0-6118f000eacb tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6 --force-share --output=json" returned: 0 in 0.216s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:48:07 user nova-compute[75229]: DEBUG nova.virt.disk.api [None req-ed4a7950-6e03-4793-89a0-6118f000eacb tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d6e2d77b-9894-4afa-8fa1-13a2842ba9a7/disk. size=1073741824 {{(pid=75229) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 09:48:07 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-ed4a7950-6e03-4793-89a0-6118f000eacb tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6e2d77b-9894-4afa-8fa1-13a2842ba9a7/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:48:07 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-ed4a7950-6e03-4793-89a0-6118f000eacb tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6e2d77b-9894-4afa-8fa1-13a2842ba9a7/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:48:07 user nova-compute[75229]: DEBUG nova.virt.disk.api [None req-ed4a7950-6e03-4793-89a0-6118f000eacb tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] Cannot resize image /opt/stack/data/nova/instances/d6e2d77b-9894-4afa-8fa1-13a2842ba9a7/disk to a smaller size. {{(pid=75229) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 09:48:07 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-ed4a7950-6e03-4793-89a0-6118f000eacb tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] [instance: d6e2d77b-9894-4afa-8fa1-13a2842ba9a7] Created local disks {{(pid=75229) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 09:48:07 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-ed4a7950-6e03-4793-89a0-6118f000eacb tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] [instance: d6e2d77b-9894-4afa-8fa1-13a2842ba9a7] Ensure instance console log exists: /opt/stack/data/nova/instances/d6e2d77b-9894-4afa-8fa1-13a2842ba9a7/console.log {{(pid=75229) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 09:48:07 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-ed4a7950-6e03-4793-89a0-6118f000eacb tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:48:07 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-ed4a7950-6e03-4793-89a0-6118f000eacb tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:48:07 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-ed4a7950-6e03-4793-89a0-6118f000eacb tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:48:07 user nova-compute[75229]: DEBUG nova.network.neutron [None req-ed4a7950-6e03-4793-89a0-6118f000eacb tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] [instance: d6e2d77b-9894-4afa-8fa1-13a2842ba9a7] Successfully created port: 05d6e94a-7444-4671-b2e8-b997c37965ea {{(pid=75229) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 09:48:07 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:48:07 user nova-compute[75229]: DEBUG nova.network.neutron [None req-3f7a76b1-7df1-476d-8de9-cc7e5ab78ca9 tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] [instance: a60d339f-e134-477c-8505-bf8c79d2a21c] Updating instance_info_cache with network_info: [{"id": "cb98fc47-7b69-4bde-9a4c-717cd44ba908", "address": "fa:16:3e:6c:f4:6d", "network": {"id": "2b667d50-4579-4453-b4d3-a818a0d2c6fc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1719812180-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.24", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32e17c7c586542139cdbc5bfda57e075", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb98fc47-7b", "ovs_interfaceid": "cb98fc47-7b69-4bde-9a4c-717cd44ba908", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 09:48:07 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-3f7a76b1-7df1-476d-8de9-cc7e5ab78ca9 tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] Releasing lock "refresh_cache-a60d339f-e134-477c-8505-bf8c79d2a21c" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 09:48:08 user nova-compute[75229]: DEBUG os_brick.utils [None req-3f7a76b1-7df1-476d-8de9-cc7e5ab78ca9 tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 09:48:08 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:48:08 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.036s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:48:08 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8c240a4-a906-4ade-a9b0-a41e2020ae1a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f1154031c835\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:48:08 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:48:08 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:48:08 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[95dad1bd-d23e-4fad-90f7-2698f227be55]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:48:08 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:48:08 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:48:08 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea7e04ed-d14d-4f4c-8778-b10106ba27c2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:48:08 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[b276c8a7-414d-4418-943a-69b448ccc747]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:48:08 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-3f7a76b1-7df1-476d-8de9-cc7e5ab78ca9 tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] Running cmd (subprocess): nvme version {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:48:08 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-3f7a76b1-7df1-476d-8de9-cc7e5ab78ca9 tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] 'nvme version' failed. Not Retrying. {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 09:48:08 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3f7a76b1-7df1-476d-8de9-cc7e5ab78ca9 tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] nvme not present on system {{(pid=75229) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 09:48:08 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:48:08 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 09:48:08 user nova-compute[75229]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 09:48:08 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[94e394f4-05c1-44cf-9865-144bbd74c31c]: (4, '') {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:48:08 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.lightos [None req-3f7a76b1-7df1-476d-8de9-cc7e5ab78ca9 tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75229) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 09:48:08 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.lightos [None req-3f7a76b1-7df1-476d-8de9-cc7e5ab78ca9 tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75229) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 09:48:08 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.lightos [None req-3f7a76b1-7df1-476d-8de9-cc7e5ab78ca9 tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] LIGHTOS: no hostnqn found. {{(pid=75229) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 09:48:08 user nova-compute[75229]: DEBUG os_brick.utils [None req-3f7a76b1-7df1-476d-8de9-cc7e5ab78ca9 tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] <== get_connector_properties: return (162ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f1154031c835', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 09:48:08 user nova-compute[75229]: DEBUG nova.network.neutron [None req-ed4a7950-6e03-4793-89a0-6118f000eacb tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] [instance: d6e2d77b-9894-4afa-8fa1-13a2842ba9a7] Successfully updated port: 05d6e94a-7444-4671-b2e8-b997c37965ea {{(pid=75229) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 09:48:08 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-ed4a7950-6e03-4793-89a0-6118f000eacb tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] Acquiring lock "refresh_cache-d6e2d77b-9894-4afa-8fa1-13a2842ba9a7" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 09:48:08 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-ed4a7950-6e03-4793-89a0-6118f000eacb tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] Acquired lock "refresh_cache-d6e2d77b-9894-4afa-8fa1-13a2842ba9a7" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 09:48:08 user nova-compute[75229]: DEBUG nova.network.neutron [None req-ed4a7950-6e03-4793-89a0-6118f000eacb tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] [instance: d6e2d77b-9894-4afa-8fa1-13a2842ba9a7] Building network info cache for instance {{(pid=75229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 09:48:08 user nova-compute[75229]: DEBUG nova.compute.manager [req-4bd50a81-8859-4707-b956-1014c4a446ef req-f26052c1-6ea7-440b-a60e-d4d381485791 service nova] [instance: d6e2d77b-9894-4afa-8fa1-13a2842ba9a7] Received event network-changed-05d6e94a-7444-4671-b2e8-b997c37965ea {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:48:08 user nova-compute[75229]: DEBUG nova.compute.manager [req-4bd50a81-8859-4707-b956-1014c4a446ef req-f26052c1-6ea7-440b-a60e-d4d381485791 service nova] [instance: d6e2d77b-9894-4afa-8fa1-13a2842ba9a7] Refreshing instance network info cache due to event network-changed-05d6e94a-7444-4671-b2e8-b997c37965ea. {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 09:48:08 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-4bd50a81-8859-4707-b956-1014c4a446ef req-f26052c1-6ea7-440b-a60e-d4d381485791 service nova] Acquiring lock "refresh_cache-d6e2d77b-9894-4afa-8fa1-13a2842ba9a7" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 09:48:08 user nova-compute[75229]: DEBUG nova.network.neutron [None req-ed4a7950-6e03-4793-89a0-6118f000eacb tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] [instance: d6e2d77b-9894-4afa-8fa1-13a2842ba9a7] Instance cache missing network info. {{(pid=75229) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 09:48:08 user nova-compute[75229]: DEBUG nova.network.neutron [None req-ed4a7950-6e03-4793-89a0-6118f000eacb tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] [instance: d6e2d77b-9894-4afa-8fa1-13a2842ba9a7] Updating instance_info_cache with network_info: [{"id": "05d6e94a-7444-4671-b2e8-b997c37965ea", "address": "fa:16:3e:a0:ae:e3", "network": {"id": "4bc624aa-efaf-45a9-b889-84d4bf2953b4", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-271284704-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d2e9dceab8a45eaa3adb619433b7cf0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05d6e94a-74", "ovs_interfaceid": "05d6e94a-7444-4671-b2e8-b997c37965ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 09:48:08 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-ed4a7950-6e03-4793-89a0-6118f000eacb tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] Releasing lock "refresh_cache-d6e2d77b-9894-4afa-8fa1-13a2842ba9a7" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 09:48:08 user nova-compute[75229]: DEBUG nova.compute.manager [None req-ed4a7950-6e03-4793-89a0-6118f000eacb tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] [instance: d6e2d77b-9894-4afa-8fa1-13a2842ba9a7] Instance network_info: |[{"id": "05d6e94a-7444-4671-b2e8-b997c37965ea", "address": "fa:16:3e:a0:ae:e3", "network": {"id": "4bc624aa-efaf-45a9-b889-84d4bf2953b4", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-271284704-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d2e9dceab8a45eaa3adb619433b7cf0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05d6e94a-74", "ovs_interfaceid": "05d6e94a-7444-4671-b2e8-b997c37965ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75229) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 09:48:08 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-4bd50a81-8859-4707-b956-1014c4a446ef req-f26052c1-6ea7-440b-a60e-d4d381485791 service nova] Acquired lock "refresh_cache-d6e2d77b-9894-4afa-8fa1-13a2842ba9a7" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 09:48:08 user nova-compute[75229]: DEBUG nova.network.neutron [req-4bd50a81-8859-4707-b956-1014c4a446ef req-f26052c1-6ea7-440b-a60e-d4d381485791 service nova] [instance: d6e2d77b-9894-4afa-8fa1-13a2842ba9a7] Refreshing network info cache for port 05d6e94a-7444-4671-b2e8-b997c37965ea {{(pid=75229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 09:48:08 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-ed4a7950-6e03-4793-89a0-6118f000eacb tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] [instance: d6e2d77b-9894-4afa-8fa1-13a2842ba9a7] Start _get_guest_xml network_info=[{"id": "05d6e94a-7444-4671-b2e8-b997c37965ea", "address": "fa:16:3e:a0:ae:e3", "network": {"id": "4bc624aa-efaf-45a9-b889-84d4bf2953b4", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-271284704-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d2e9dceab8a45eaa3adb619433b7cf0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05d6e94a-74", "ovs_interfaceid": "05d6e94a-7444-4671-b2e8-b997c37965ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T09:40:10Z,direct_url=<?>,disk_format='qcow2',id=3bef8470-ecc7-40e3-95d4-9254348ea72d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='de5a91106b6948ed937a7178ff9464c4',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T09:40:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'disk_bus': 'virtio', 'guest_format': None, 'encryption_secret_uuid': None, 'size': 0, 'device_type': 'disk', 'image_id': '3bef8470-ecc7-40e3-95d4-9254348ea72d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75229) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 09:48:08 user nova-compute[75229]: WARNING nova.virt.libvirt.driver [None req-ed4a7950-6e03-4793-89a0-6118f000eacb tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 09:48:08 user nova-compute[75229]: WARNING nova.virt.libvirt.driver [None req-ed4a7950-6e03-4793-89a0-6118f000eacb tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 09:48:08 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-ed4a7950-6e03-4793-89a0-6118f000eacb tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75229) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 09:48:08 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-ed4a7950-6e03-4793-89a0-6118f000eacb tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] CPU controller missing on host. {{(pid=75229) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 09:48:08 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-f1b4008d-653a-4188-8f00-bd7d32a92f1b tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Acquiring lock "4255af28-a111-4475-b207-67e335fd0835" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:48:08 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-f1b4008d-653a-4188-8f00-bd7d32a92f1b tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Lock "4255af28-a111-4475-b207-67e335fd0835" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:48:08 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-ed4a7950-6e03-4793-89a0-6118f000eacb tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75229) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 09:48:08 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-ed4a7950-6e03-4793-89a0-6118f000eacb tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] CPU controller found on host. {{(pid=75229) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 09:48:08 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-ed4a7950-6e03-4793-89a0-6118f000eacb tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75229) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 09:48:08 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-ed4a7950-6e03-4793-89a0-6118f000eacb tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T09:39:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T09:40:10Z,direct_url=<?>,disk_format='qcow2',id=3bef8470-ecc7-40e3-95d4-9254348ea72d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='de5a91106b6948ed937a7178ff9464c4',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T09:40:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 09:48:08 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-ed4a7950-6e03-4793-89a0-6118f000eacb tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] Flavor limits 0:0:0 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 09:48:08 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-ed4a7950-6e03-4793-89a0-6118f000eacb tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] Image limits 0:0:0 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 09:48:08 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-ed4a7950-6e03-4793-89a0-6118f000eacb tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] Flavor pref 0:0:0 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 09:48:08 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-ed4a7950-6e03-4793-89a0-6118f000eacb tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] Image pref 0:0:0 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 09:48:08 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-ed4a7950-6e03-4793-89a0-6118f000eacb tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 09:48:08 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-ed4a7950-6e03-4793-89a0-6118f000eacb tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 09:48:08 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-ed4a7950-6e03-4793-89a0-6118f000eacb tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75229) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 09:48:08 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-ed4a7950-6e03-4793-89a0-6118f000eacb tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] Got 1 possible topologies {{(pid=75229) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 09:48:08 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-ed4a7950-6e03-4793-89a0-6118f000eacb tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 09:48:08 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-ed4a7950-6e03-4793-89a0-6118f000eacb tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 09:48:08 user nova-compute[75229]: DEBUG nova.virt.libvirt.vif [None req-ed4a7950-6e03-4793-89a0-6118f000eacb tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T09:48:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-161153698',display_name='tempest-VolumesSnapshotTestJSON-instance-161153698',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-161153698',id=16,image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD1ns/Jr45ukV2Y3duFLk5SuDHY4g/7oYMty7tukJKQ158uwBywoFts56N8SMrnSQG2VaDtHtZT9xM7w+BbeuoWquQOuAF9N85kTE48U9KH23eMvTtBNVlNPGSM3hkmyXQ==',key_name='tempest-keypair-254709066',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9d2e9dceab8a45eaa3adb619433b7cf0',ramdisk_id='',reservation_id='r-rltyyx3j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1180270100',owner_user_name='tempest-VolumesSnapshotTestJSON-1180270100-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T09:48:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='915a9d3b56244777aba6ea938e150d3d',uuid=d6e2d77b-9894-4afa-8fa1-13a2842ba9a7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "05d6e94a-7444-4671-b2e8-b997c37965ea", "address": "fa:16:3e:a0:ae:e3", "network": {"id": "4bc624aa-efaf-45a9-b889-84d4bf2953b4", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-271284704-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d2e9dceab8a45eaa3adb619433b7cf0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05d6e94a-74", "ovs_interfaceid": "05d6e94a-7444-4671-b2e8-b997c37965ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75229) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 09:48:08 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-ed4a7950-6e03-4793-89a0-6118f000eacb tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] Converting VIF {"id": "05d6e94a-7444-4671-b2e8-b997c37965ea", "address": "fa:16:3e:a0:ae:e3", "network": {"id": "4bc624aa-efaf-45a9-b889-84d4bf2953b4", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-271284704-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d2e9dceab8a45eaa3adb619433b7cf0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05d6e94a-74", "ovs_interfaceid": "05d6e94a-7444-4671-b2e8-b997c37965ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 09:48:08 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-ed4a7950-6e03-4793-89a0-6118f000eacb tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a0:ae:e3,bridge_name='br-int',has_traffic_filtering=True,id=05d6e94a-7444-4671-b2e8-b997c37965ea,network=Network(4bc624aa-efaf-45a9-b889-84d4bf2953b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap05d6e94a-74') {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 09:48:08 user nova-compute[75229]: DEBUG nova.objects.instance [None req-ed4a7950-6e03-4793-89a0-6118f000eacb tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] Lazy-loading 'pci_devices' on Instance uuid d6e2d77b-9894-4afa-8fa1-13a2842ba9a7 {{(pid=75229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 09:48:08 user nova-compute[75229]: DEBUG nova.compute.manager [None req-f1b4008d-653a-4188-8f00-bd7d32a92f1b tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] [instance: 4255af28-a111-4475-b207-67e335fd0835] Starting instance... {{(pid=75229) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 09:48:08 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-ed4a7950-6e03-4793-89a0-6118f000eacb tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] [instance: d6e2d77b-9894-4afa-8fa1-13a2842ba9a7] End _get_guest_xml xml=<domain type="kvm">
Nov 14 09:48:08 user nova-compute[75229]:   <uuid>d6e2d77b-9894-4afa-8fa1-13a2842ba9a7</uuid>
Nov 14 09:48:08 user nova-compute[75229]:   <name>instance-00000010</name>
Nov 14 09:48:08 user nova-compute[75229]:   <memory>524288</memory>
Nov 14 09:48:08 user nova-compute[75229]:   <vcpu>1</vcpu>
Nov 14 09:48:08 user nova-compute[75229]:   <metadata>
Nov 14 09:48:08 user nova-compute[75229]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 09:48:08 user nova-compute[75229]:       <nova:package version="0.0.0"/>
Nov 14 09:48:08 user nova-compute[75229]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-161153698</nova:name>
Nov 14 09:48:08 user nova-compute[75229]:       <nova:creationTime>2023-11-14 09:48:08</nova:creationTime>
Nov 14 09:48:08 user nova-compute[75229]:       <nova:flavor name="m1.tiny">
Nov 14 09:48:08 user nova-compute[75229]:         <nova:memory>512</nova:memory>
Nov 14 09:48:08 user nova-compute[75229]:         <nova:disk>1</nova:disk>
Nov 14 09:48:08 user nova-compute[75229]:         <nova:swap>0</nova:swap>
Nov 14 09:48:08 user nova-compute[75229]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 09:48:08 user nova-compute[75229]:         <nova:vcpus>1</nova:vcpus>
Nov 14 09:48:08 user nova-compute[75229]:       </nova:flavor>
Nov 14 09:48:08 user nova-compute[75229]:       <nova:owner>
Nov 14 09:48:08 user nova-compute[75229]:         <nova:user uuid="915a9d3b56244777aba6ea938e150d3d">tempest-VolumesSnapshotTestJSON-1180270100-project-member</nova:user>
Nov 14 09:48:08 user nova-compute[75229]:         <nova:project uuid="9d2e9dceab8a45eaa3adb619433b7cf0">tempest-VolumesSnapshotTestJSON-1180270100</nova:project>
Nov 14 09:48:08 user nova-compute[75229]:       </nova:owner>
Nov 14 09:48:08 user nova-compute[75229]:       <nova:root type="image" uuid="3bef8470-ecc7-40e3-95d4-9254348ea72d"/>
Nov 14 09:48:08 user nova-compute[75229]:       <nova:ports>
Nov 14 09:48:08 user nova-compute[75229]:         <nova:port uuid="05d6e94a-7444-4671-b2e8-b997c37965ea">
Nov 14 09:48:08 user nova-compute[75229]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 14 09:48:08 user nova-compute[75229]:         </nova:port>
Nov 14 09:48:08 user nova-compute[75229]:       </nova:ports>
Nov 14 09:48:08 user nova-compute[75229]:     </nova:instance>
Nov 14 09:48:08 user nova-compute[75229]:   </metadata>
Nov 14 09:48:08 user nova-compute[75229]:   <sysinfo type="smbios">
Nov 14 09:48:08 user nova-compute[75229]:     <system>
Nov 14 09:48:08 user nova-compute[75229]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 09:48:08 user nova-compute[75229]:       <entry name="product">OpenStack Nova</entry>
Nov 14 09:48:08 user nova-compute[75229]:       <entry name="version">0.0.0</entry>
Nov 14 09:48:08 user nova-compute[75229]:       <entry name="serial">d6e2d77b-9894-4afa-8fa1-13a2842ba9a7</entry>
Nov 14 09:48:08 user nova-compute[75229]:       <entry name="uuid">d6e2d77b-9894-4afa-8fa1-13a2842ba9a7</entry>
Nov 14 09:48:08 user nova-compute[75229]:       <entry name="family">Virtual Machine</entry>
Nov 14 09:48:08 user nova-compute[75229]:     </system>
Nov 14 09:48:08 user nova-compute[75229]:   </sysinfo>
Nov 14 09:48:08 user nova-compute[75229]:   <os>
Nov 14 09:48:08 user nova-compute[75229]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 09:48:08 user nova-compute[75229]:     <boot dev="hd"/>
Nov 14 09:48:08 user nova-compute[75229]:     <smbios mode="sysinfo"/>
Nov 14 09:48:08 user nova-compute[75229]:   </os>
Nov 14 09:48:08 user nova-compute[75229]:   <features>
Nov 14 09:48:08 user nova-compute[75229]:     <acpi/>
Nov 14 09:48:08 user nova-compute[75229]:     <apic/>
Nov 14 09:48:08 user nova-compute[75229]:     <vmcoreinfo/>
Nov 14 09:48:08 user nova-compute[75229]:   </features>
Nov 14 09:48:08 user nova-compute[75229]:   <clock offset="utc">
Nov 14 09:48:08 user nova-compute[75229]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 09:48:08 user nova-compute[75229]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 09:48:08 user nova-compute[75229]:     <timer name="hpet" present="no"/>
Nov 14 09:48:08 user nova-compute[75229]:   </clock>
Nov 14 09:48:08 user nova-compute[75229]:   <cpu mode="custom" match="exact">
Nov 14 09:48:08 user nova-compute[75229]:     <model>Nehalem</model>
Nov 14 09:48:08 user nova-compute[75229]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 09:48:08 user nova-compute[75229]:   </cpu>
Nov 14 09:48:08 user nova-compute[75229]:   <devices>
Nov 14 09:48:08 user nova-compute[75229]:     <disk type="file" device="disk">
Nov 14 09:48:08 user nova-compute[75229]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 09:48:08 user nova-compute[75229]:       <source file="/opt/stack/data/nova/instances/d6e2d77b-9894-4afa-8fa1-13a2842ba9a7/disk"/>
Nov 14 09:48:08 user nova-compute[75229]:       <target dev="vda" bus="virtio"/>
Nov 14 09:48:08 user nova-compute[75229]:     </disk>
Nov 14 09:48:08 user nova-compute[75229]:     <interface type="ethernet">
Nov 14 09:48:08 user nova-compute[75229]:       <mac address="fa:16:3e:a0:ae:e3"/>
Nov 14 09:48:08 user nova-compute[75229]:       <model type="virtio"/>
Nov 14 09:48:08 user nova-compute[75229]:       <mtu size="1442"/>
Nov 14 09:48:08 user nova-compute[75229]:       <target dev="tap05d6e94a-74"/>
Nov 14 09:48:08 user nova-compute[75229]:     </interface>
Nov 14 09:48:08 user nova-compute[75229]:     <serial type="pty">
Nov 14 09:48:08 user nova-compute[75229]:       <log file="/opt/stack/data/nova/instances/d6e2d77b-9894-4afa-8fa1-13a2842ba9a7/console.log" append="off"/>
Nov 14 09:48:08 user nova-compute[75229]:     </serial>
Nov 14 09:48:08 user nova-compute[75229]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 09:48:08 user nova-compute[75229]:     <video>
Nov 14 09:48:08 user nova-compute[75229]:       <model type="virtio"/>
Nov 14 09:48:08 user nova-compute[75229]:     </video>
Nov 14 09:48:08 user nova-compute[75229]:     <rng model="virtio">
Nov 14 09:48:08 user nova-compute[75229]:       <backend model="random">/dev/urandom</backend>
Nov 14 09:48:08 user nova-compute[75229]:     </rng>
Nov 14 09:48:08 user nova-compute[75229]:     <controller type="usb" index="0" model="none"/>
Nov 14 09:48:08 user nova-compute[75229]:     <memballoon model="virtio">
Nov 14 09:48:08 user nova-compute[75229]:       <stats period="10"/>
Nov 14 09:48:08 user nova-compute[75229]:     </memballoon>
Nov 14 09:48:08 user nova-compute[75229]:   </devices>
Nov 14 09:48:08 user nova-compute[75229]: </domain>
Nov 14 09:48:08 user nova-compute[75229]:  {{(pid=75229) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 09:48:08 user nova-compute[75229]: DEBUG nova.virt.libvirt.vif [None req-ed4a7950-6e03-4793-89a0-6118f000eacb tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T09:48:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-161153698',display_name='tempest-VolumesSnapshotTestJSON-instance-161153698',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-161153698',id=16,image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD1ns/Jr45ukV2Y3duFLk5SuDHY4g/7oYMty7tukJKQ158uwBywoFts56N8SMrnSQG2VaDtHtZT9xM7w+BbeuoWquQOuAF9N85kTE48U9KH23eMvTtBNVlNPGSM3hkmyXQ==',key_name='tempest-keypair-254709066',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9d2e9dceab8a45eaa3adb619433b7cf0',ramdisk_id='',reservation_id='r-rltyyx3j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1180270100',owner_user_name='tempest-VolumesSnapshotTestJSON-1180270100-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T09:48:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='915a9d3b56244777aba6ea938e150d3d',uuid=d6e2d77b-9894-4afa-8fa1-13a2842ba9a7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "05d6e94a-7444-4671-b2e8-b997c37965ea", "address": "fa:16:3e:a0:ae:e3", "network": {"id": "4bc624aa-efaf-45a9-b889-84d4bf2953b4", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-271284704-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d2e9dceab8a45eaa3adb619433b7cf0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05d6e94a-74", "ovs_interfaceid": "05d6e94a-7444-4671-b2e8-b997c37965ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 09:48:08 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-ed4a7950-6e03-4793-89a0-6118f000eacb tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] Converting VIF {"id": "05d6e94a-7444-4671-b2e8-b997c37965ea", "address": "fa:16:3e:a0:ae:e3", "network": {"id": "4bc624aa-efaf-45a9-b889-84d4bf2953b4", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-271284704-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d2e9dceab8a45eaa3adb619433b7cf0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05d6e94a-74", "ovs_interfaceid": "05d6e94a-7444-4671-b2e8-b997c37965ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 09:48:08 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-ed4a7950-6e03-4793-89a0-6118f000eacb tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a0:ae:e3,bridge_name='br-int',has_traffic_filtering=True,id=05d6e94a-7444-4671-b2e8-b997c37965ea,network=Network(4bc624aa-efaf-45a9-b889-84d4bf2953b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap05d6e94a-74') {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 09:48:08 user nova-compute[75229]: DEBUG os_vif [None req-ed4a7950-6e03-4793-89a0-6118f000eacb tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a0:ae:e3,bridge_name='br-int',has_traffic_filtering=True,id=05d6e94a-7444-4671-b2e8-b997c37965ea,network=Network(4bc624aa-efaf-45a9-b889-84d4bf2953b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap05d6e94a-74') {{(pid=75229) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 09:48:08 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:48:08 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:48:08 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 09:48:08 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:48:08 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '29300e44-692a-535b-9010-597f05f2b47c', '_type': 'linux-noop'}}, row=False) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:48:08 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:48:08 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 09:48:08 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:48:08 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap05d6e94a-74, may_exist=True, interface_attrs={}) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:48:08 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap05d6e94a-74, col_values=(('qos', UUID('9b5a6681-e8f5-48b1-9122-714a8f0d35cf')),), if_exists=True) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:48:08 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap05d6e94a-74, col_values=(('external_ids', {'iface-id': '05d6e94a-7444-4671-b2e8-b997c37965ea', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a0:ae:e3', 'vm-uuid': 'd6e2d77b-9894-4afa-8fa1-13a2842ba9a7'}),), if_exists=True) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:48:08 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:48:08 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 09:48:09 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:48:09 user nova-compute[75229]: INFO os_vif [None req-ed4a7950-6e03-4793-89a0-6118f000eacb tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a0:ae:e3,bridge_name='br-int',has_traffic_filtering=True,id=05d6e94a-7444-4671-b2e8-b997c37965ea,network=Network(4bc624aa-efaf-45a9-b889-84d4bf2953b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap05d6e94a-74')
Nov 14 09:48:09 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-f1b4008d-653a-4188-8f00-bd7d32a92f1b tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:48:09 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-f1b4008d-653a-4188-8f00-bd7d32a92f1b tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:48:09 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-f1b4008d-653a-4188-8f00-bd7d32a92f1b tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75229) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 09:48:09 user nova-compute[75229]: INFO nova.compute.claims [None req-f1b4008d-653a-4188-8f00-bd7d32a92f1b tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] [instance: 4255af28-a111-4475-b207-67e335fd0835] Claim successful on node user
Nov 14 09:48:09 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-ed4a7950-6e03-4793-89a0-6118f000eacb tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] No BDM found with device name vda, not building metadata. {{(pid=75229) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 09:48:09 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-ed4a7950-6e03-4793-89a0-6118f000eacb tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] No VIF found with MAC fa:16:3e:a0:ae:e3, not building metadata {{(pid=75229) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 09:48:09 user nova-compute[75229]: DEBUG nova.network.neutron [req-4bd50a81-8859-4707-b956-1014c4a446ef req-f26052c1-6ea7-440b-a60e-d4d381485791 service nova] [instance: d6e2d77b-9894-4afa-8fa1-13a2842ba9a7] Updated VIF entry in instance network info cache for port 05d6e94a-7444-4671-b2e8-b997c37965ea. {{(pid=75229) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 09:48:09 user nova-compute[75229]: DEBUG nova.network.neutron [req-4bd50a81-8859-4707-b956-1014c4a446ef req-f26052c1-6ea7-440b-a60e-d4d381485791 service nova] [instance: d6e2d77b-9894-4afa-8fa1-13a2842ba9a7] Updating instance_info_cache with network_info: [{"id": "05d6e94a-7444-4671-b2e8-b997c37965ea", "address": "fa:16:3e:a0:ae:e3", "network": {"id": "4bc624aa-efaf-45a9-b889-84d4bf2953b4", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-271284704-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d2e9dceab8a45eaa3adb619433b7cf0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05d6e94a-74", "ovs_interfaceid": "05d6e94a-7444-4671-b2e8-b997c37965ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 09:48:09 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-4bd50a81-8859-4707-b956-1014c4a446ef req-f26052c1-6ea7-440b-a60e-d4d381485791 service nova] Releasing lock "refresh_cache-d6e2d77b-9894-4afa-8fa1-13a2842ba9a7" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 09:48:09 user nova-compute[75229]: DEBUG nova.compute.provider_tree [None req-f1b4008d-653a-4188-8f00-bd7d32a92f1b tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Inventory has not changed in ProviderTree for provider: d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 {{(pid=75229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 09:48:09 user nova-compute[75229]: DEBUG nova.scheduler.client.report [None req-f1b4008d-653a-4188-8f00-bd7d32a92f1b tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Inventory has not changed for provider d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 09:48:09 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-f1b4008d-653a-4188-8f00-bd7d32a92f1b tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.695s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:48:09 user nova-compute[75229]: DEBUG nova.compute.manager [None req-f1b4008d-653a-4188-8f00-bd7d32a92f1b tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] [instance: 4255af28-a111-4475-b207-67e335fd0835] Start building networks asynchronously for instance. {{(pid=75229) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 09:48:09 user nova-compute[75229]: DEBUG nova.compute.manager [None req-f1b4008d-653a-4188-8f00-bd7d32a92f1b tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] [instance: 4255af28-a111-4475-b207-67e335fd0835] Allocating IP information in the background. {{(pid=75229) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 09:48:09 user nova-compute[75229]: DEBUG nova.network.neutron [None req-f1b4008d-653a-4188-8f00-bd7d32a92f1b tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] [instance: 4255af28-a111-4475-b207-67e335fd0835] allocate_for_instance() {{(pid=75229) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 09:48:09 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-f1b4008d-653a-4188-8f00-bd7d32a92f1b tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] [instance: 4255af28-a111-4475-b207-67e335fd0835] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 09:48:09 user nova-compute[75229]: DEBUG nova.compute.manager [None req-f1b4008d-653a-4188-8f00-bd7d32a92f1b tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] [instance: 4255af28-a111-4475-b207-67e335fd0835] Start building block device mappings for instance. {{(pid=75229) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 09:48:09 user nova-compute[75229]: DEBUG nova.policy [None req-f1b4008d-653a-4188-8f00-bd7d32a92f1b tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3b8313e365eb4970a58c412768e959bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b8d48c38c7344f5b12d0ed5b9392554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75229) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 09:48:10 user nova-compute[75229]: DEBUG nova.compute.manager [None req-f1b4008d-653a-4188-8f00-bd7d32a92f1b tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] [instance: 4255af28-a111-4475-b207-67e335fd0835] Start spawning the instance on the hypervisor. {{(pid=75229) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 09:48:10 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-f1b4008d-653a-4188-8f00-bd7d32a92f1b tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] [instance: 4255af28-a111-4475-b207-67e335fd0835] Creating instance directory {{(pid=75229) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 09:48:10 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-f1b4008d-653a-4188-8f00-bd7d32a92f1b tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] [instance: 4255af28-a111-4475-b207-67e335fd0835] Creating image(s)
Nov 14 09:48:10 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-f1b4008d-653a-4188-8f00-bd7d32a92f1b tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Acquiring lock "/opt/stack/data/nova/instances/4255af28-a111-4475-b207-67e335fd0835/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:48:10 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-f1b4008d-653a-4188-8f00-bd7d32a92f1b tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Lock "/opt/stack/data/nova/instances/4255af28-a111-4475-b207-67e335fd0835/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:48:10 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-f1b4008d-653a-4188-8f00-bd7d32a92f1b tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Lock "/opt/stack/data/nova/instances/4255af28-a111-4475-b207-67e335fd0835/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:48:10 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-f1b4008d-653a-4188-8f00-bd7d32a92f1b tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6 --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:48:10 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-f1b4008d-653a-4188-8f00-bd7d32a92f1b tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6 --force-share --output=json" returned: 0 in 0.279s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:48:10 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-f1b4008d-653a-4188-8f00-bd7d32a92f1b tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Acquiring lock "4f30e3fe703d2381679612a57b1fb80a467f60b6" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:48:10 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-f1b4008d-653a-4188-8f00-bd7d32a92f1b tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Lock "4f30e3fe703d2381679612a57b1fb80a467f60b6" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:48:10 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-f1b4008d-653a-4188-8f00-bd7d32a92f1b tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6 --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:48:10 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-f1b4008d-653a-4188-8f00-bd7d32a92f1b tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6 --force-share --output=json" returned: 0 in 0.227s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:48:10 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-f1b4008d-653a-4188-8f00-bd7d32a92f1b tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6,backing_fmt=raw /opt/stack/data/nova/instances/4255af28-a111-4475-b207-67e335fd0835/disk 1073741824 {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:48:10 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:48:10 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-f1b4008d-653a-4188-8f00-bd7d32a92f1b tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6,backing_fmt=raw /opt/stack/data/nova/instances/4255af28-a111-4475-b207-67e335fd0835/disk 1073741824" returned: 0 in 0.268s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:48:10 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-f1b4008d-653a-4188-8f00-bd7d32a92f1b tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Lock "4f30e3fe703d2381679612a57b1fb80a467f60b6" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.500s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:48:10 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-f1b4008d-653a-4188-8f00-bd7d32a92f1b tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6 --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:48:11 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:48:11 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-f1b4008d-653a-4188-8f00-bd7d32a92f1b tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6 --force-share --output=json" returned: 0 in 0.228s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:48:11 user nova-compute[75229]: DEBUG nova.virt.disk.api [None req-f1b4008d-653a-4188-8f00-bd7d32a92f1b tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4255af28-a111-4475-b207-67e335fd0835/disk. size=1073741824 {{(pid=75229) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 09:48:11 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-f1b4008d-653a-4188-8f00-bd7d32a92f1b tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4255af28-a111-4475-b207-67e335fd0835/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:48:11 user nova-compute[75229]: DEBUG nova.network.neutron [None req-f1b4008d-653a-4188-8f00-bd7d32a92f1b tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] [instance: 4255af28-a111-4475-b207-67e335fd0835] Successfully created port: 8d218cec-b5d6-46ed-94be-4802fcdd0388 {{(pid=75229) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 09:48:11 user nova-compute[75229]: DEBUG nova.compute.manager [req-86e6e4ce-6f3a-42f0-b6fe-97796e8f3e42 req-cf7e34e5-34dc-443e-8f23-4ed34e848c1c service nova] [instance: d6e2d77b-9894-4afa-8fa1-13a2842ba9a7] Received event network-vif-plugged-05d6e94a-7444-4671-b2e8-b997c37965ea {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:48:11 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-86e6e4ce-6f3a-42f0-b6fe-97796e8f3e42 req-cf7e34e5-34dc-443e-8f23-4ed34e848c1c service nova] Acquiring lock "d6e2d77b-9894-4afa-8fa1-13a2842ba9a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:48:11 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-86e6e4ce-6f3a-42f0-b6fe-97796e8f3e42 req-cf7e34e5-34dc-443e-8f23-4ed34e848c1c service nova] Lock "d6e2d77b-9894-4afa-8fa1-13a2842ba9a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:48:11 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-86e6e4ce-6f3a-42f0-b6fe-97796e8f3e42 req-cf7e34e5-34dc-443e-8f23-4ed34e848c1c service nova] Lock "d6e2d77b-9894-4afa-8fa1-13a2842ba9a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:48:11 user nova-compute[75229]: DEBUG nova.compute.manager [req-86e6e4ce-6f3a-42f0-b6fe-97796e8f3e42 req-cf7e34e5-34dc-443e-8f23-4ed34e848c1c service nova] [instance: d6e2d77b-9894-4afa-8fa1-13a2842ba9a7] No waiting events found dispatching network-vif-plugged-05d6e94a-7444-4671-b2e8-b997c37965ea {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 09:48:11 user nova-compute[75229]: WARNING nova.compute.manager [req-86e6e4ce-6f3a-42f0-b6fe-97796e8f3e42 req-cf7e34e5-34dc-443e-8f23-4ed34e848c1c service nova] [instance: d6e2d77b-9894-4afa-8fa1-13a2842ba9a7] Received unexpected event network-vif-plugged-05d6e94a-7444-4671-b2e8-b997c37965ea for instance with vm_state building and task_state spawning.
Nov 14 09:48:11 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-f1b4008d-653a-4188-8f00-bd7d32a92f1b tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4255af28-a111-4475-b207-67e335fd0835/disk --force-share --output=json" returned: 0 in 0.251s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:48:11 user nova-compute[75229]: DEBUG nova.virt.disk.api [None req-f1b4008d-653a-4188-8f00-bd7d32a92f1b tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Cannot resize image /opt/stack/data/nova/instances/4255af28-a111-4475-b207-67e335fd0835/disk to a smaller size. {{(pid=75229) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 09:48:11 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-f1b4008d-653a-4188-8f00-bd7d32a92f1b tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] [instance: 4255af28-a111-4475-b207-67e335fd0835] Created local disks {{(pid=75229) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 09:48:11 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-f1b4008d-653a-4188-8f00-bd7d32a92f1b tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] [instance: 4255af28-a111-4475-b207-67e335fd0835] Ensure instance console log exists: /opt/stack/data/nova/instances/4255af28-a111-4475-b207-67e335fd0835/console.log {{(pid=75229) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 09:48:11 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-f1b4008d-653a-4188-8f00-bd7d32a92f1b tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:48:11 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-f1b4008d-653a-4188-8f00-bd7d32a92f1b tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:48:11 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-f1b4008d-653a-4188-8f00-bd7d32a92f1b tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:48:11 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:48:11 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:48:11 user nova-compute[75229]: DEBUG nova.network.neutron [None req-f1b4008d-653a-4188-8f00-bd7d32a92f1b tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] [instance: 4255af28-a111-4475-b207-67e335fd0835] Successfully updated port: 8d218cec-b5d6-46ed-94be-4802fcdd0388 {{(pid=75229) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 09:48:11 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-f1b4008d-653a-4188-8f00-bd7d32a92f1b tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Acquiring lock "refresh_cache-4255af28-a111-4475-b207-67e335fd0835" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 09:48:11 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-f1b4008d-653a-4188-8f00-bd7d32a92f1b tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Acquired lock "refresh_cache-4255af28-a111-4475-b207-67e335fd0835" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 09:48:11 user nova-compute[75229]: DEBUG nova.network.neutron [None req-f1b4008d-653a-4188-8f00-bd7d32a92f1b tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] [instance: 4255af28-a111-4475-b207-67e335fd0835] Building network info cache for instance {{(pid=75229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 09:48:11 user nova-compute[75229]: DEBUG nova.compute.manager [req-8365eb63-73e2-4c5e-81f9-96a1ab429e2e req-98ec4082-4cf9-43be-af30-21b68b12fef4 service nova] [instance: 4255af28-a111-4475-b207-67e335fd0835] Received event network-changed-8d218cec-b5d6-46ed-94be-4802fcdd0388 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:48:11 user nova-compute[75229]: DEBUG nova.compute.manager [req-8365eb63-73e2-4c5e-81f9-96a1ab429e2e req-98ec4082-4cf9-43be-af30-21b68b12fef4 service nova] [instance: 4255af28-a111-4475-b207-67e335fd0835] Refreshing instance network info cache due to event network-changed-8d218cec-b5d6-46ed-94be-4802fcdd0388. {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 09:48:11 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-8365eb63-73e2-4c5e-81f9-96a1ab429e2e req-98ec4082-4cf9-43be-af30-21b68b12fef4 service nova] Acquiring lock "refresh_cache-4255af28-a111-4475-b207-67e335fd0835" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 09:48:11 user nova-compute[75229]: DEBUG nova.network.neutron [None req-f1b4008d-653a-4188-8f00-bd7d32a92f1b tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] [instance: 4255af28-a111-4475-b207-67e335fd0835] Instance cache missing network info. {{(pid=75229) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 09:48:12 user nova-compute[75229]: DEBUG nova.network.neutron [None req-f1b4008d-653a-4188-8f00-bd7d32a92f1b tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] [instance: 4255af28-a111-4475-b207-67e335fd0835] Updating instance_info_cache with network_info: [{"id": "8d218cec-b5d6-46ed-94be-4802fcdd0388", "address": "fa:16:3e:3d:eb:0f", "network": {"id": "bd407caa-6ef6-400d-9327-3179dc1d8da4", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-29933774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b8d48c38c7344f5b12d0ed5b9392554", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d218cec-b5", "ovs_interfaceid": "8d218cec-b5d6-46ed-94be-4802fcdd0388", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 09:48:12 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-f1b4008d-653a-4188-8f00-bd7d32a92f1b tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Releasing lock "refresh_cache-4255af28-a111-4475-b207-67e335fd0835" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 09:48:12 user nova-compute[75229]: DEBUG nova.compute.manager [None req-f1b4008d-653a-4188-8f00-bd7d32a92f1b tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] [instance: 4255af28-a111-4475-b207-67e335fd0835] Instance network_info: |[{"id": "8d218cec-b5d6-46ed-94be-4802fcdd0388", "address": "fa:16:3e:3d:eb:0f", "network": {"id": "bd407caa-6ef6-400d-9327-3179dc1d8da4", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-29933774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b8d48c38c7344f5b12d0ed5b9392554", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d218cec-b5", "ovs_interfaceid": "8d218cec-b5d6-46ed-94be-4802fcdd0388", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75229) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 09:48:12 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-8365eb63-73e2-4c5e-81f9-96a1ab429e2e req-98ec4082-4cf9-43be-af30-21b68b12fef4 service nova] Acquired lock "refresh_cache-4255af28-a111-4475-b207-67e335fd0835" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 09:48:12 user nova-compute[75229]: DEBUG nova.network.neutron [req-8365eb63-73e2-4c5e-81f9-96a1ab429e2e req-98ec4082-4cf9-43be-af30-21b68b12fef4 service nova] [instance: 4255af28-a111-4475-b207-67e335fd0835] Refreshing network info cache for port 8d218cec-b5d6-46ed-94be-4802fcdd0388 {{(pid=75229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 09:48:12 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-f1b4008d-653a-4188-8f00-bd7d32a92f1b tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] [instance: 4255af28-a111-4475-b207-67e335fd0835] Start _get_guest_xml network_info=[{"id": "8d218cec-b5d6-46ed-94be-4802fcdd0388", "address": "fa:16:3e:3d:eb:0f", "network": {"id": "bd407caa-6ef6-400d-9327-3179dc1d8da4", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-29933774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b8d48c38c7344f5b12d0ed5b9392554", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d218cec-b5", "ovs_interfaceid": "8d218cec-b5d6-46ed-94be-4802fcdd0388", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T09:40:10Z,direct_url=<?>,disk_format='qcow2',id=3bef8470-ecc7-40e3-95d4-9254348ea72d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='de5a91106b6948ed937a7178ff9464c4',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T09:40:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'disk_bus': 'virtio', 'guest_format': None, 'encryption_secret_uuid': None, 'size': 0, 'device_type': 'disk', 'image_id': '3bef8470-ecc7-40e3-95d4-9254348ea72d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75229) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 09:48:12 user nova-compute[75229]: WARNING nova.virt.libvirt.driver [None req-f1b4008d-653a-4188-8f00-bd7d32a92f1b tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 09:48:12 user nova-compute[75229]: WARNING nova.virt.libvirt.driver [None req-f1b4008d-653a-4188-8f00-bd7d32a92f1b tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 09:48:12 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-f1b4008d-653a-4188-8f00-bd7d32a92f1b tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75229) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 09:48:12 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-f1b4008d-653a-4188-8f00-bd7d32a92f1b tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] CPU controller missing on host. {{(pid=75229) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 09:48:12 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-f1b4008d-653a-4188-8f00-bd7d32a92f1b tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75229) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 09:48:12 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-f1b4008d-653a-4188-8f00-bd7d32a92f1b tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] CPU controller found on host. {{(pid=75229) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 09:48:12 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-f1b4008d-653a-4188-8f00-bd7d32a92f1b tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75229) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 09:48:12 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-f1b4008d-653a-4188-8f00-bd7d32a92f1b tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T09:39:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T09:40:10Z,direct_url=<?>,disk_format='qcow2',id=3bef8470-ecc7-40e3-95d4-9254348ea72d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='de5a91106b6948ed937a7178ff9464c4',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T09:40:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 09:48:12 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-f1b4008d-653a-4188-8f00-bd7d32a92f1b tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Flavor limits 0:0:0 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 09:48:12 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-f1b4008d-653a-4188-8f00-bd7d32a92f1b tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Image limits 0:0:0 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 09:48:12 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-f1b4008d-653a-4188-8f00-bd7d32a92f1b tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Flavor pref 0:0:0 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 09:48:12 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-f1b4008d-653a-4188-8f00-bd7d32a92f1b tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Image pref 0:0:0 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 09:48:12 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-f1b4008d-653a-4188-8f00-bd7d32a92f1b tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 09:48:12 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-f1b4008d-653a-4188-8f00-bd7d32a92f1b tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 09:48:12 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-f1b4008d-653a-4188-8f00-bd7d32a92f1b tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75229) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 09:48:12 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-f1b4008d-653a-4188-8f00-bd7d32a92f1b tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Got 1 possible topologies {{(pid=75229) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 09:48:12 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-f1b4008d-653a-4188-8f00-bd7d32a92f1b tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 09:48:12 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-f1b4008d-653a-4188-8f00-bd7d32a92f1b tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 09:48:12 user nova-compute[75229]: DEBUG nova.virt.libvirt.vif [None req-f1b4008d-653a-4188-8f00-bd7d32a92f1b tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T09:48:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-489286667',display_name='tempest-AttachVolumeNegativeTest-server-489286667',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-489286667',id=17,image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIePywKDJu3c2ut6s3j5HhKF9jxepJwLQA4ynuwJiP0zyPDVN37yMeGM0c7z8ydx2gKHVn6mwDVxPIpAfh0tYpXrrmZ23wcEUCfMOtz6xS5SKKIUF/EkxDGiZlRLYJUjUw==',key_name='tempest-keypair-1284613226',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8b8d48c38c7344f5b12d0ed5b9392554',ramdisk_id='',reservation_id='r-m51zye0t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-140392099',owner_user_name='tempest-AttachVolumeNegativeTest-140392099-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T09:48:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3b8313e365eb4970a58c412768e959bf',uuid=4255af28-a111-4475-b207-67e335fd0835,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8d218cec-b5d6-46ed-94be-4802fcdd0388", "address": "fa:16:3e:3d:eb:0f", "network": {"id": "bd407caa-6ef6-400d-9327-3179dc1d8da4", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-29933774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b8d48c38c7344f5b12d0ed5b9392554", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d218cec-b5", "ovs_interfaceid": "8d218cec-b5d6-46ed-94be-4802fcdd0388", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75229) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 09:48:12 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-f1b4008d-653a-4188-8f00-bd7d32a92f1b tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Converting VIF {"id": "8d218cec-b5d6-46ed-94be-4802fcdd0388", "address": "fa:16:3e:3d:eb:0f", "network": {"id": "bd407caa-6ef6-400d-9327-3179dc1d8da4", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-29933774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b8d48c38c7344f5b12d0ed5b9392554", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d218cec-b5", "ovs_interfaceid": "8d218cec-b5d6-46ed-94be-4802fcdd0388", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 09:48:12 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-f1b4008d-653a-4188-8f00-bd7d32a92f1b tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3d:eb:0f,bridge_name='br-int',has_traffic_filtering=True,id=8d218cec-b5d6-46ed-94be-4802fcdd0388,network=Network(bd407caa-6ef6-400d-9327-3179dc1d8da4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d218cec-b5') {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 09:48:12 user nova-compute[75229]: DEBUG nova.objects.instance [None req-f1b4008d-653a-4188-8f00-bd7d32a92f1b tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Lazy-loading 'pci_devices' on Instance uuid 4255af28-a111-4475-b207-67e335fd0835 {{(pid=75229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 09:48:12 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-f1b4008d-653a-4188-8f00-bd7d32a92f1b tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] [instance: 4255af28-a111-4475-b207-67e335fd0835] End _get_guest_xml xml=<domain type="kvm">
Nov 14 09:48:12 user nova-compute[75229]:   <uuid>4255af28-a111-4475-b207-67e335fd0835</uuid>
Nov 14 09:48:12 user nova-compute[75229]:   <name>instance-00000011</name>
Nov 14 09:48:12 user nova-compute[75229]:   <memory>524288</memory>
Nov 14 09:48:12 user nova-compute[75229]:   <vcpu>1</vcpu>
Nov 14 09:48:12 user nova-compute[75229]:   <metadata>
Nov 14 09:48:12 user nova-compute[75229]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 09:48:12 user nova-compute[75229]:       <nova:package version="0.0.0"/>
Nov 14 09:48:12 user nova-compute[75229]:       <nova:name>tempest-AttachVolumeNegativeTest-server-489286667</nova:name>
Nov 14 09:48:12 user nova-compute[75229]:       <nova:creationTime>2023-11-14 09:48:12</nova:creationTime>
Nov 14 09:48:12 user nova-compute[75229]:       <nova:flavor name="m1.tiny">
Nov 14 09:48:12 user nova-compute[75229]:         <nova:memory>512</nova:memory>
Nov 14 09:48:12 user nova-compute[75229]:         <nova:disk>1</nova:disk>
Nov 14 09:48:12 user nova-compute[75229]:         <nova:swap>0</nova:swap>
Nov 14 09:48:12 user nova-compute[75229]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 09:48:12 user nova-compute[75229]:         <nova:vcpus>1</nova:vcpus>
Nov 14 09:48:12 user nova-compute[75229]:       </nova:flavor>
Nov 14 09:48:12 user nova-compute[75229]:       <nova:owner>
Nov 14 09:48:12 user nova-compute[75229]:         <nova:user uuid="3b8313e365eb4970a58c412768e959bf">tempest-AttachVolumeNegativeTest-140392099-project-member</nova:user>
Nov 14 09:48:12 user nova-compute[75229]:         <nova:project uuid="8b8d48c38c7344f5b12d0ed5b9392554">tempest-AttachVolumeNegativeTest-140392099</nova:project>
Nov 14 09:48:12 user nova-compute[75229]:       </nova:owner>
Nov 14 09:48:12 user nova-compute[75229]:       <nova:root type="image" uuid="3bef8470-ecc7-40e3-95d4-9254348ea72d"/>
Nov 14 09:48:12 user nova-compute[75229]:       <nova:ports>
Nov 14 09:48:12 user nova-compute[75229]:         <nova:port uuid="8d218cec-b5d6-46ed-94be-4802fcdd0388">
Nov 14 09:48:12 user nova-compute[75229]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 14 09:48:12 user nova-compute[75229]:         </nova:port>
Nov 14 09:48:12 user nova-compute[75229]:       </nova:ports>
Nov 14 09:48:12 user nova-compute[75229]:     </nova:instance>
Nov 14 09:48:12 user nova-compute[75229]:   </metadata>
Nov 14 09:48:12 user nova-compute[75229]:   <sysinfo type="smbios">
Nov 14 09:48:12 user nova-compute[75229]:     <system>
Nov 14 09:48:12 user nova-compute[75229]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 09:48:12 user nova-compute[75229]:       <entry name="product">OpenStack Nova</entry>
Nov 14 09:48:12 user nova-compute[75229]:       <entry name="version">0.0.0</entry>
Nov 14 09:48:12 user nova-compute[75229]:       <entry name="serial">4255af28-a111-4475-b207-67e335fd0835</entry>
Nov 14 09:48:12 user nova-compute[75229]:       <entry name="uuid">4255af28-a111-4475-b207-67e335fd0835</entry>
Nov 14 09:48:12 user nova-compute[75229]:       <entry name="family">Virtual Machine</entry>
Nov 14 09:48:12 user nova-compute[75229]:     </system>
Nov 14 09:48:12 user nova-compute[75229]:   </sysinfo>
Nov 14 09:48:12 user nova-compute[75229]:   <os>
Nov 14 09:48:12 user nova-compute[75229]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 09:48:12 user nova-compute[75229]:     <boot dev="hd"/>
Nov 14 09:48:12 user nova-compute[75229]:     <smbios mode="sysinfo"/>
Nov 14 09:48:12 user nova-compute[75229]:   </os>
Nov 14 09:48:12 user nova-compute[75229]:   <features>
Nov 14 09:48:12 user nova-compute[75229]:     <acpi/>
Nov 14 09:48:12 user nova-compute[75229]:     <apic/>
Nov 14 09:48:12 user nova-compute[75229]:     <vmcoreinfo/>
Nov 14 09:48:12 user nova-compute[75229]:   </features>
Nov 14 09:48:12 user nova-compute[75229]:   <clock offset="utc">
Nov 14 09:48:12 user nova-compute[75229]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 09:48:12 user nova-compute[75229]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 09:48:12 user nova-compute[75229]:     <timer name="hpet" present="no"/>
Nov 14 09:48:12 user nova-compute[75229]:   </clock>
Nov 14 09:48:12 user nova-compute[75229]:   <cpu mode="custom" match="exact">
Nov 14 09:48:12 user nova-compute[75229]:     <model>Nehalem</model>
Nov 14 09:48:12 user nova-compute[75229]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 09:48:12 user nova-compute[75229]:   </cpu>
Nov 14 09:48:12 user nova-compute[75229]:   <devices>
Nov 14 09:48:12 user nova-compute[75229]:     <disk type="file" device="disk">
Nov 14 09:48:12 user nova-compute[75229]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 09:48:12 user nova-compute[75229]:       <source file="/opt/stack/data/nova/instances/4255af28-a111-4475-b207-67e335fd0835/disk"/>
Nov 14 09:48:12 user nova-compute[75229]:       <target dev="vda" bus="virtio"/>
Nov 14 09:48:12 user nova-compute[75229]:     </disk>
Nov 14 09:48:12 user nova-compute[75229]:     <interface type="ethernet">
Nov 14 09:48:12 user nova-compute[75229]:       <mac address="fa:16:3e:3d:eb:0f"/>
Nov 14 09:48:12 user nova-compute[75229]:       <model type="virtio"/>
Nov 14 09:48:12 user nova-compute[75229]:       <mtu size="1442"/>
Nov 14 09:48:12 user nova-compute[75229]:       <target dev="tap8d218cec-b5"/>
Nov 14 09:48:12 user nova-compute[75229]:     </interface>
Nov 14 09:48:12 user nova-compute[75229]:     <serial type="pty">
Nov 14 09:48:12 user nova-compute[75229]:       <log file="/opt/stack/data/nova/instances/4255af28-a111-4475-b207-67e335fd0835/console.log" append="off"/>
Nov 14 09:48:12 user nova-compute[75229]:     </serial>
Nov 14 09:48:12 user nova-compute[75229]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 09:48:12 user nova-compute[75229]:     <video>
Nov 14 09:48:12 user nova-compute[75229]:       <model type="virtio"/>
Nov 14 09:48:12 user nova-compute[75229]:     </video>
Nov 14 09:48:12 user nova-compute[75229]:     <rng model="virtio">
Nov 14 09:48:12 user nova-compute[75229]:       <backend model="random">/dev/urandom</backend>
Nov 14 09:48:12 user nova-compute[75229]:     </rng>
Nov 14 09:48:12 user nova-compute[75229]:     <controller type="usb" index="0" model="none"/>
Nov 14 09:48:12 user nova-compute[75229]:     <memballoon model="virtio">
Nov 14 09:48:12 user nova-compute[75229]:       <stats period="10"/>
Nov 14 09:48:12 user nova-compute[75229]:     </memballoon>
Nov 14 09:48:12 user nova-compute[75229]:   </devices>
Nov 14 09:48:12 user nova-compute[75229]: </domain>
Nov 14 09:48:12 user nova-compute[75229]:  {{(pid=75229) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 09:48:12 user nova-compute[75229]: DEBUG nova.virt.libvirt.vif [None req-f1b4008d-653a-4188-8f00-bd7d32a92f1b tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T09:48:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-489286667',display_name='tempest-AttachVolumeNegativeTest-server-489286667',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-489286667',id=17,image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIePywKDJu3c2ut6s3j5HhKF9jxepJwLQA4ynuwJiP0zyPDVN37yMeGM0c7z8ydx2gKHVn6mwDVxPIpAfh0tYpXrrmZ23wcEUCfMOtz6xS5SKKIUF/EkxDGiZlRLYJUjUw==',key_name='tempest-keypair-1284613226',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8b8d48c38c7344f5b12d0ed5b9392554',ramdisk_id='',reservation_id='r-m51zye0t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-140392099',owner_user_name='tempest-AttachVolumeNegativeTest-140392099-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T09:48:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3b8313e365eb4970a58c412768e959bf',uuid=4255af28-a111-4475-b207-67e335fd0835,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8d218cec-b5d6-46ed-94be-4802fcdd0388", "address": "fa:16:3e:3d:eb:0f", "network": {"id": "bd407caa-6ef6-400d-9327-3179dc1d8da4", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-29933774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b8d48c38c7344f5b12d0ed5b9392554", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d218cec-b5", "ovs_interfaceid": "8d218cec-b5d6-46ed-94be-4802fcdd0388", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 09:48:12 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-f1b4008d-653a-4188-8f00-bd7d32a92f1b tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Converting VIF {"id": "8d218cec-b5d6-46ed-94be-4802fcdd0388", "address": "fa:16:3e:3d:eb:0f", "network": {"id": "bd407caa-6ef6-400d-9327-3179dc1d8da4", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-29933774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b8d48c38c7344f5b12d0ed5b9392554", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d218cec-b5", "ovs_interfaceid": "8d218cec-b5d6-46ed-94be-4802fcdd0388", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 09:48:12 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-f1b4008d-653a-4188-8f00-bd7d32a92f1b tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3d:eb:0f,bridge_name='br-int',has_traffic_filtering=True,id=8d218cec-b5d6-46ed-94be-4802fcdd0388,network=Network(bd407caa-6ef6-400d-9327-3179dc1d8da4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d218cec-b5') {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 09:48:12 user nova-compute[75229]: DEBUG os_vif [None req-f1b4008d-653a-4188-8f00-bd7d32a92f1b tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3d:eb:0f,bridge_name='br-int',has_traffic_filtering=True,id=8d218cec-b5d6-46ed-94be-4802fcdd0388,network=Network(bd407caa-6ef6-400d-9327-3179dc1d8da4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d218cec-b5') {{(pid=75229) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 09:48:12 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:48:12 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:48:12 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 09:48:12 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:48:12 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2c0e86fa-f8f8-5f54-9cf0-0955944ae147', '_type': 'linux-noop'}}, row=False) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:48:12 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:48:12 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 09:48:12 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:48:12 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:48:12 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8d218cec-b5, may_exist=True, interface_attrs={}) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:48:12 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8d218cec-b5, col_values=(('qos', UUID('be905412-bff1-443b-831f-e1e26d8b37f2')),), if_exists=True) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:48:12 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8d218cec-b5, col_values=(('external_ids', {'iface-id': '8d218cec-b5d6-46ed-94be-4802fcdd0388', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3d:eb:0f', 'vm-uuid': '4255af28-a111-4475-b207-67e335fd0835'}),), if_exists=True) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:48:12 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:48:12 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 09:48:12 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:48:12 user nova-compute[75229]: INFO os_vif [None req-f1b4008d-653a-4188-8f00-bd7d32a92f1b tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3d:eb:0f,bridge_name='br-int',has_traffic_filtering=True,id=8d218cec-b5d6-46ed-94be-4802fcdd0388,network=Network(bd407caa-6ef6-400d-9327-3179dc1d8da4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d218cec-b5')
Nov 14 09:48:12 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-f1b4008d-653a-4188-8f00-bd7d32a92f1b tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] No BDM found with device name vda, not building metadata. {{(pid=75229) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 09:48:12 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-f1b4008d-653a-4188-8f00-bd7d32a92f1b tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] No VIF found with MAC fa:16:3e:3d:eb:0f, not building metadata {{(pid=75229) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 09:48:12 user nova-compute[75229]: DEBUG nova.network.neutron [req-8365eb63-73e2-4c5e-81f9-96a1ab429e2e req-98ec4082-4cf9-43be-af30-21b68b12fef4 service nova] [instance: 4255af28-a111-4475-b207-67e335fd0835] Updated VIF entry in instance network info cache for port 8d218cec-b5d6-46ed-94be-4802fcdd0388. {{(pid=75229) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 09:48:12 user nova-compute[75229]: DEBUG nova.network.neutron [req-8365eb63-73e2-4c5e-81f9-96a1ab429e2e req-98ec4082-4cf9-43be-af30-21b68b12fef4 service nova] [instance: 4255af28-a111-4475-b207-67e335fd0835] Updating instance_info_cache with network_info: [{"id": "8d218cec-b5d6-46ed-94be-4802fcdd0388", "address": "fa:16:3e:3d:eb:0f", "network": {"id": "bd407caa-6ef6-400d-9327-3179dc1d8da4", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-29933774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b8d48c38c7344f5b12d0ed5b9392554", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d218cec-b5", "ovs_interfaceid": "8d218cec-b5d6-46ed-94be-4802fcdd0388", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 09:48:12 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-8365eb63-73e2-4c5e-81f9-96a1ab429e2e req-98ec4082-4cf9-43be-af30-21b68b12fef4 service nova] Releasing lock "refresh_cache-4255af28-a111-4475-b207-67e335fd0835" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 09:48:12 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:48:13 user nova-compute[75229]: DEBUG nova.compute.manager [req-fa37d7ba-3286-4310-b4f6-2c5afc4f5a3f req-cfc71f53-a003-44a4-ad1f-31f3d5925f08 service nova] [instance: d6e2d77b-9894-4afa-8fa1-13a2842ba9a7] Received event network-vif-plugged-05d6e94a-7444-4671-b2e8-b997c37965ea {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:48:13 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-fa37d7ba-3286-4310-b4f6-2c5afc4f5a3f req-cfc71f53-a003-44a4-ad1f-31f3d5925f08 service nova] Acquiring lock "d6e2d77b-9894-4afa-8fa1-13a2842ba9a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:48:13 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-fa37d7ba-3286-4310-b4f6-2c5afc4f5a3f req-cfc71f53-a003-44a4-ad1f-31f3d5925f08 service nova] Lock "d6e2d77b-9894-4afa-8fa1-13a2842ba9a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:48:13 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-fa37d7ba-3286-4310-b4f6-2c5afc4f5a3f req-cfc71f53-a003-44a4-ad1f-31f3d5925f08 service nova] Lock "d6e2d77b-9894-4afa-8fa1-13a2842ba9a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:48:13 user nova-compute[75229]: DEBUG nova.compute.manager [req-fa37d7ba-3286-4310-b4f6-2c5afc4f5a3f req-cfc71f53-a003-44a4-ad1f-31f3d5925f08 service nova] [instance: d6e2d77b-9894-4afa-8fa1-13a2842ba9a7] No waiting events found dispatching network-vif-plugged-05d6e94a-7444-4671-b2e8-b997c37965ea {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 09:48:13 user nova-compute[75229]: WARNING nova.compute.manager [req-fa37d7ba-3286-4310-b4f6-2c5afc4f5a3f req-cfc71f53-a003-44a4-ad1f-31f3d5925f08 service nova] [instance: d6e2d77b-9894-4afa-8fa1-13a2842ba9a7] Received unexpected event network-vif-plugged-05d6e94a-7444-4671-b2e8-b997c37965ea for instance with vm_state building and task_state spawning.
Nov 14 09:48:13 user nova-compute[75229]: DEBUG nova.compute.manager [None req-ed4a7950-6e03-4793-89a0-6118f000eacb tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] [instance: d6e2d77b-9894-4afa-8fa1-13a2842ba9a7] Instance event wait completed in 0 seconds for  {{(pid=75229) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 09:48:13 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-ed4a7950-6e03-4793-89a0-6118f000eacb tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] [instance: d6e2d77b-9894-4afa-8fa1-13a2842ba9a7] Guest created on hypervisor {{(pid=75229) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 09:48:13 user nova-compute[75229]: INFO nova.virt.libvirt.driver [-] [instance: d6e2d77b-9894-4afa-8fa1-13a2842ba9a7] Instance spawned successfully.
Nov 14 09:48:13 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-ed4a7950-6e03-4793-89a0-6118f000eacb tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] [instance: d6e2d77b-9894-4afa-8fa1-13a2842ba9a7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 09:48:13 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-ed4a7950-6e03-4793-89a0-6118f000eacb tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] [instance: d6e2d77b-9894-4afa-8fa1-13a2842ba9a7] Found default for hw_cdrom_bus of ide {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 09:48:13 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-ed4a7950-6e03-4793-89a0-6118f000eacb tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] [instance: d6e2d77b-9894-4afa-8fa1-13a2842ba9a7] Found default for hw_disk_bus of virtio {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 09:48:13 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-ed4a7950-6e03-4793-89a0-6118f000eacb tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] [instance: d6e2d77b-9894-4afa-8fa1-13a2842ba9a7] Found default for hw_input_bus of None {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 09:48:13 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-ed4a7950-6e03-4793-89a0-6118f000eacb tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] [instance: d6e2d77b-9894-4afa-8fa1-13a2842ba9a7] Found default for hw_pointer_model of None {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 09:48:13 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-ed4a7950-6e03-4793-89a0-6118f000eacb tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] [instance: d6e2d77b-9894-4afa-8fa1-13a2842ba9a7] Found default for hw_video_model of virtio {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 09:48:13 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-ed4a7950-6e03-4793-89a0-6118f000eacb tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] [instance: d6e2d77b-9894-4afa-8fa1-13a2842ba9a7] Found default for hw_vif_model of virtio {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 09:48:13 user nova-compute[75229]: INFO nova.compute.manager [None req-ed4a7950-6e03-4793-89a0-6118f000eacb tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] [instance: d6e2d77b-9894-4afa-8fa1-13a2842ba9a7] Took 6.99 seconds to spawn the instance on the hypervisor.
Nov 14 09:48:13 user nova-compute[75229]: DEBUG nova.compute.manager [None req-ed4a7950-6e03-4793-89a0-6118f000eacb tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] [instance: d6e2d77b-9894-4afa-8fa1-13a2842ba9a7] Checking state {{(pid=75229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 09:48:13 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-3f7a76b1-7df1-476d-8de9-cc7e5ab78ca9 tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] [instance: a60d339f-e134-477c-8505-bf8c79d2a21c] Starting finish_migration {{(pid=75229) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Nov 14 09:48:13 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-3f7a76b1-7df1-476d-8de9-cc7e5ab78ca9 tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] [instance: a60d339f-e134-477c-8505-bf8c79d2a21c] Instance directory exists: not creating {{(pid=75229) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 14 09:48:13 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-3f7a76b1-7df1-476d-8de9-cc7e5ab78ca9 tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] [instance: a60d339f-e134-477c-8505-bf8c79d2a21c] Creating image(s)
Nov 14 09:48:13 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-3f7a76b1-7df1-476d-8de9-cc7e5ab78ca9 tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6 --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:48:13 user nova-compute[75229]: INFO nova.compute.manager [None req-ed4a7950-6e03-4793-89a0-6118f000eacb tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] [instance: d6e2d77b-9894-4afa-8fa1-13a2842ba9a7] Took 8.11 seconds to build instance.
Nov 14 09:48:13 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-ed4a7950-6e03-4793-89a0-6118f000eacb tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] Lock "d6e2d77b-9894-4afa-8fa1-13a2842ba9a7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.287s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:48:13 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-3f7a76b1-7df1-476d-8de9-cc7e5ab78ca9 tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6 --force-share --output=json" returned: 0 in 0.190s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:48:13 user nova-compute[75229]: DEBUG nova.virt.disk.api [None req-3f7a76b1-7df1-476d-8de9-cc7e5ab78ca9 tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a60d339f-e134-477c-8505-bf8c79d2a21c/disk. size=21474836480 {{(pid=75229) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 09:48:13 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-3f7a76b1-7df1-476d-8de9-cc7e5ab78ca9 tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a60d339f-e134-477c-8505-bf8c79d2a21c/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:48:13 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:48:14 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:48:14 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-3f7a76b1-7df1-476d-8de9-cc7e5ab78ca9 tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a60d339f-e134-477c-8505-bf8c79d2a21c/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:48:14 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-3f7a76b1-7df1-476d-8de9-cc7e5ab78ca9 tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] Running cmd (subprocess): qemu-img resize /opt/stack/data/nova/instances/a60d339f-e134-477c-8505-bf8c79d2a21c/disk 21474836480 {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:48:14 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-3f7a76b1-7df1-476d-8de9-cc7e5ab78ca9 tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] CMD "qemu-img resize /opt/stack/data/nova/instances/a60d339f-e134-477c-8505-bf8c79d2a21c/disk 21474836480" returned: 0 in 0.053s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:48:14 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-3f7a76b1-7df1-476d-8de9-cc7e5ab78ca9 tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] [instance: a60d339f-e134-477c-8505-bf8c79d2a21c] Did not create local disks {{(pid=75229) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 14 09:48:14 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-3f7a76b1-7df1-476d-8de9-cc7e5ab78ca9 tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] [instance: a60d339f-e134-477c-8505-bf8c79d2a21c] Ensure instance console log exists: /opt/stack/data/nova/instances/a60d339f-e134-477c-8505-bf8c79d2a21c/console.log {{(pid=75229) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 09:48:14 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-3f7a76b1-7df1-476d-8de9-cc7e5ab78ca9 tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:48:14 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-3f7a76b1-7df1-476d-8de9-cc7e5ab78ca9 tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.004s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:48:14 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-3f7a76b1-7df1-476d-8de9-cc7e5ab78ca9 tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:48:14 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-3f7a76b1-7df1-476d-8de9-cc7e5ab78ca9 tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] [instance: a60d339f-e134-477c-8505-bf8c79d2a21c] Start _get_guest_xml network_info=[{"id": "cb98fc47-7b69-4bde-9a4c-717cd44ba908", "address": "fa:16:3e:6c:f4:6d", "network": {"id": "2b667d50-4579-4453-b4d3-a818a0d2c6fc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1719812180-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.24", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1719812180-network", "vif_mac": "fa:16:3e:6c:f4:6d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32e17c7c586542139cdbc5bfda57e075", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb98fc47-7b", "ovs_interfaceid": "cb98fc47-7b69-4bde-9a4c-717cd44ba908", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T09:40:10Z,direct_url=<?>,disk_format='qcow2',id=3bef8470-ecc7-40e3-95d4-9254348ea72d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='de5a91106b6948ed937a7178ff9464c4',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T09:40:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'disk_bus': 'virtio', 'guest_format': None, 'encryption_secret_uuid': None, 'size': 0, 'device_type': 'disk', 'image_id': '3bef8470-ecc7-40e3-95d4-9254348ea72d'}], 'ephemerals': [], 'block_device_mapping': [{'boot_index': None, 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:aca09258-022b-4f04-b418-f2a170332755', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BrhyGdAv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': 'a60d339f-e134-477c-8505-bf8c79d2a21c', 'attached_at': '2023-11-14T09:48:13.000000', 'detached_at': '', 'volume_id': 'aca09258-022b-4f04-b418-f2a170332755', 'serial': 'aca09258-022b-4f04-b418-f2a170332755'}, 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'attachment_id': '4ae51485-1418-4f4a-bc84-14f50c3652c5', 'guest_format': None, 'device_type': 'disk', 'volume_type': None} {{(pid=75229) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 09:48:14 user nova-compute[75229]: WARNING nova.virt.libvirt.driver [None req-3f7a76b1-7df1-476d-8de9-cc7e5ab78ca9 tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 09:48:14 user nova-compute[75229]: WARNING nova.virt.libvirt.driver [None req-3f7a76b1-7df1-476d-8de9-cc7e5ab78ca9 tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 09:48:14 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-3f7a76b1-7df1-476d-8de9-cc7e5ab78ca9 tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75229) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 09:48:14 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-3f7a76b1-7df1-476d-8de9-cc7e5ab78ca9 tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] CPU controller missing on host. {{(pid=75229) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 09:48:14 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-3f7a76b1-7df1-476d-8de9-cc7e5ab78ca9 tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75229) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 09:48:14 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-3f7a76b1-7df1-476d-8de9-cc7e5ab78ca9 tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] CPU controller found on host. {{(pid=75229) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 09:48:14 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-3f7a76b1-7df1-476d-8de9-cc7e5ab78ca9 tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75229) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 09:48:14 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-3f7a76b1-7df1-476d-8de9-cc7e5ab78ca9 tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T09:40:00Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T09:40:10Z,direct_url=<?>,disk_format='qcow2',id=3bef8470-ecc7-40e3-95d4-9254348ea72d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='de5a91106b6948ed937a7178ff9464c4',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T09:40:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 09:48:14 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-3f7a76b1-7df1-476d-8de9-cc7e5ab78ca9 tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] Flavor limits 0:0:0 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 09:48:14 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-3f7a76b1-7df1-476d-8de9-cc7e5ab78ca9 tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] Image limits 0:0:0 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 09:48:14 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-3f7a76b1-7df1-476d-8de9-cc7e5ab78ca9 tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] Flavor pref 0:0:0 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 09:48:14 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-3f7a76b1-7df1-476d-8de9-cc7e5ab78ca9 tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] Image pref 0:0:0 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 09:48:14 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-3f7a76b1-7df1-476d-8de9-cc7e5ab78ca9 tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 09:48:14 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-3f7a76b1-7df1-476d-8de9-cc7e5ab78ca9 tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 09:48:14 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-3f7a76b1-7df1-476d-8de9-cc7e5ab78ca9 tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75229) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 09:48:14 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-3f7a76b1-7df1-476d-8de9-cc7e5ab78ca9 tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] Got 1 possible topologies {{(pid=75229) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 09:48:14 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-3f7a76b1-7df1-476d-8de9-cc7e5ab78ca9 tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 09:48:14 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-3f7a76b1-7df1-476d-8de9-cc7e5ab78ca9 tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 09:48:14 user nova-compute[75229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3f7a76b1-7df1-476d-8de9-cc7e5ab78ca9 tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] [instance: a60d339f-e134-477c-8505-bf8c79d2a21c] Calling os-brick to attach iSCSI Volume {{(pid=75229) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 09:48:14 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f7a76b1-7df1-476d-8de9-cc7e5ab78ca9 tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f73f85151b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:aca09258-022b-4f04-b418-f2a170332755', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BrhyGdAv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 09:48:14 user nova-compute[75229]: WARNING os_brick.initiator.connectors.base [None req-3f7a76b1-7df1-476d-8de9-cc7e5ab78ca9 tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 09:48:14 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-3f7a76b1-7df1-476d-8de9-cc7e5ab78ca9 tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 09:48:14 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-3f7a76b1-7df1-476d-8de9-cc7e5ab78ca9 tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 09:48:14 user nova-compute[75229]: WARNING os_brick.initiator.connectors.base [None req-3f7a76b1-7df1-476d-8de9-cc7e5ab78ca9 tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 09:48:14 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-3f7a76b1-7df1-476d-8de9-cc7e5ab78ca9 tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:aca09258-022b-4f04-b418-f2a170332755" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 09:48:14 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-3f7a76b1-7df1-476d-8de9-cc7e5ab78ca9 tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:aca09258-022b-4f04-b418-f2a170332755" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 09:48:14 user nova-compute[75229]: INFO os_brick.initiator.connectors.iscsi [None req-3f7a76b1-7df1-476d-8de9-cc7e5ab78ca9 tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 09:48:14 user nova-compute[75229]: DEBUG nova.compute.manager [req-ce1e84ae-6191-4ca7-ac10-e858ea6301eb req-b80248c8-aea2-41f6-aa7b-f8421a7e7d2f service nova] [instance: 4255af28-a111-4475-b207-67e335fd0835] Received event network-vif-plugged-8d218cec-b5d6-46ed-94be-4802fcdd0388 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:48:14 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-ce1e84ae-6191-4ca7-ac10-e858ea6301eb req-b80248c8-aea2-41f6-aa7b-f8421a7e7d2f service nova] Acquiring lock "4255af28-a111-4475-b207-67e335fd0835-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:48:14 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-ce1e84ae-6191-4ca7-ac10-e858ea6301eb req-b80248c8-aea2-41f6-aa7b-f8421a7e7d2f service nova] Lock "4255af28-a111-4475-b207-67e335fd0835-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:48:14 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-ce1e84ae-6191-4ca7-ac10-e858ea6301eb req-b80248c8-aea2-41f6-aa7b-f8421a7e7d2f service nova] Lock "4255af28-a111-4475-b207-67e335fd0835-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:48:14 user nova-compute[75229]: DEBUG nova.compute.manager [req-ce1e84ae-6191-4ca7-ac10-e858ea6301eb req-b80248c8-aea2-41f6-aa7b-f8421a7e7d2f service nova] [instance: 4255af28-a111-4475-b207-67e335fd0835] No waiting events found dispatching network-vif-plugged-8d218cec-b5d6-46ed-94be-4802fcdd0388 {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 09:48:14 user nova-compute[75229]: WARNING nova.compute.manager [req-ce1e84ae-6191-4ca7-ac10-e858ea6301eb req-b80248c8-aea2-41f6-aa7b-f8421a7e7d2f service nova] [instance: 4255af28-a111-4475-b207-67e335fd0835] Received unexpected event network-vif-plugged-8d218cec-b5d6-46ed-94be-4802fcdd0388 for instance with vm_state building and task_state spawning.
Nov 14 09:48:14 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aca09258-022b-4f04-b418-f2a170332755 -p 172.16.0.220:3260 {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:48:14 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aca09258-022b-4f04-b418-f2a170332755 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:48:14 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7c3f3c5-4306-4fa5-b628-7618e62178d4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:48:14 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f7a76b1-7df1-476d-8de9-cc7e5ab78ca9 tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 09:48:14 user nova-compute[75229]:  {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:48:14 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aca09258-022b-4f04-b418-f2a170332755 -p 172.16.0.220:3260 --interface default --op new {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:48:14 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aca09258-022b-4f04-b418-f2a170332755 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.049s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:48:14 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa5aca6c-1417-4958-a011-539f9fa7ead6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:aca09258-022b-4f04-b418-f2a170332755] added\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:48:14 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f7a76b1-7df1-476d-8de9-cc7e5ab78ca9 tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:aca09258-022b-4f04-b418-f2a170332755] added
Nov 14 09:48:14 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:48:14 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aca09258-022b-4f04-b418-f2a170332755 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:48:14 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aca09258-022b-4f04-b418-f2a170332755 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:48:14 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[76bc4721-24d0-414d-becb-0b317bf5c8ea]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:48:14 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f7a76b1-7df1-476d-8de9-cc7e5ab78ca9 tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:48:14 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aca09258-022b-4f04-b418-f2a170332755 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:48:14 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aca09258-022b-4f04-b418-f2a170332755 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:48:14 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[c44bb18e-f29b-4637-9ca7-296d986159ed]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:48:14 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f7a76b1-7df1-476d-8de9-cc7e5ab78ca9 tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:48:14 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aca09258-022b-4f04-b418-f2a170332755 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BrhyGdAv {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:48:14 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aca09258-022b-4f04-b418-f2a170332755 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BrhyGdAv" returned: 0 in 0.030s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:48:14 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[eea8bd79-0dff-40fc-b5ba-29d9c2194476]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:48:14 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f7a76b1-7df1-476d-8de9-cc7e5ab78ca9 tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BrhyGdAv'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:48:14 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aca09258-022b-4f04-b418-f2a170332755 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:48:14 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aca09258-022b-4f04-b418-f2a170332755 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.060s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:48:14 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[069efa3c-e444-41b1-9d11-5e885bb9446c]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:48:14 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f7a76b1-7df1-476d-8de9-cc7e5ab78ca9 tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:48:14 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:48:14 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.090s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:48:14 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[980a33b5-bd5c-4500-bf0d-c1ef9bbf4e8c]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db131665-6ac2-437a-8adf-23593475a8aa (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0433e38-fa42-4cff-af48-8cb5da297597 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13c53511-ea64-4896-b325-504ce58d7895 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fed285f-9be4-4601-8cb5-4329d7ebed8c (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b54e594-ae66-4ba2-9bda-aa4431d31c3f (non-flash)\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:48:14 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f7a76b1-7df1-476d-8de9-cc7e5ab78ca9 tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db131665-6ac2-437a-8adf-23593475a8aa (non-flash)
Nov 14 09:48:14 user nova-compute[75229]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0433e38-fa42-4cff-af48-8cb5da297597 (non-flash)
Nov 14 09:48:14 user nova-compute[75229]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13c53511-ea64-4896-b325-504ce58d7895 (non-flash)
Nov 14 09:48:14 user nova-compute[75229]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fed285f-9be4-4601-8cb5-4329d7ebed8c (non-flash)
Nov 14 09:48:14 user nova-compute[75229]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b54e594-ae66-4ba2-9bda-aa4431d31c3f (non-flash)
Nov 14 09:48:14 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 09:48:14 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f7a76b1-7df1-476d-8de9-cc7e5ab78ca9 tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db131665-6ac2-437a-8adf-23593475a8aa (non-flash)
Nov 14 09:48:14 user nova-compute[75229]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0433e38-fa42-4cff-af48-8cb5da297597 (non-flash)
Nov 14 09:48:14 user nova-compute[75229]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13c53511-ea64-4896-b325-504ce58d7895 (non-flash)
Nov 14 09:48:14 user nova-compute[75229]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fed285f-9be4-4601-8cb5-4329d7ebed8c (non-flash)
Nov 14 09:48:14 user nova-compute[75229]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b54e594-ae66-4ba2-9bda-aa4431d31c3f (non-flash)
Nov 14 09:48:14 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 09:48:14 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aca09258-022b-4f04-b418-f2a170332755 -p 172.16.0.220:3260 --login {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:48:14 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:48:14 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:48:14 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:48:14 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:48:14 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aca09258-022b-4f04-b418-f2a170332755 -p 172.16.0.220:3260 --login" returned: 0 in 0.126s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:48:14 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[9799a08a-3783-4853-ab65-e386b4dfb8af]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:aca09258-022b-4f04-b418-f2a170332755, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:aca09258-022b-4f04-b418-f2a170332755, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:48:14 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f7a76b1-7df1-476d-8de9-cc7e5ab78ca9 tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:aca09258-022b-4f04-b418-f2a170332755, portal: 172.16.0.220,3260]
Nov 14 09:48:14 user nova-compute[75229]: Login to [iface: default, target: iqn.2010-10.org.openstack:aca09258-022b-4f04-b418-f2a170332755, portal: 172.16.0.220,3260] successful.
Nov 14 09:48:14 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:48:14 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aca09258-022b-4f04-b418-f2a170332755 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:48:14 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:48:14 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aca09258-022b-4f04-b418-f2a170332755 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:48:14 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[14ac1092-6cef-4f9f-b699-8464fa73a411]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:48:14 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f7a76b1-7df1-476d-8de9-cc7e5ab78ca9 tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:48:14 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:48:14 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:48:14 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9a60b1e-4089-49b7-8a58-d06ba24549ba]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db131665-6ac2-437a-8adf-23593475a8aa (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0433e38-fa42-4cff-af48-8cb5da297597 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13c53511-ea64-4896-b325-504ce58d7895 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fed285f-9be4-4601-8cb5-4329d7ebed8c (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b54e594-ae66-4ba2-9bda-aa4431d31c3f (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aca09258-022b-4f04-b418-f2a170332755 (non-flash)\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:48:14 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f7a76b1-7df1-476d-8de9-cc7e5ab78ca9 tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db131665-6ac2-437a-8adf-23593475a8aa (non-flash)
Nov 14 09:48:14 user nova-compute[75229]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0433e38-fa42-4cff-af48-8cb5da297597 (non-flash)
Nov 14 09:48:14 user nova-compute[75229]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13c53511-ea64-4896-b325-504ce58d7895 (non-flash)
Nov 14 09:48:14 user nova-compute[75229]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fed285f-9be4-4601-8cb5-4329d7ebed8c (non-flash)
Nov 14 09:48:14 user nova-compute[75229]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b54e594-ae66-4ba2-9bda-aa4431d31c3f (non-flash)
Nov 14 09:48:14 user nova-compute[75229]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aca09258-022b-4f04-b418-f2a170332755 (non-flash)
Nov 14 09:48:14 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 09:48:14 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f7a76b1-7df1-476d-8de9-cc7e5ab78ca9 tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db131665-6ac2-437a-8adf-23593475a8aa (non-flash)
Nov 14 09:48:14 user nova-compute[75229]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0433e38-fa42-4cff-af48-8cb5da297597 (non-flash)
Nov 14 09:48:14 user nova-compute[75229]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13c53511-ea64-4896-b325-504ce58d7895 (non-flash)
Nov 14 09:48:14 user nova-compute[75229]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fed285f-9be4-4601-8cb5-4329d7ebed8c (non-flash)
Nov 14 09:48:14 user nova-compute[75229]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b54e594-ae66-4ba2-9bda-aa4431d31c3f (non-flash)
Nov 14 09:48:14 user nova-compute[75229]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aca09258-022b-4f04-b418-f2a170332755 (non-flash)
Nov 14 09:48:14 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 09:48:14 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-3f7a76b1-7df1-476d-8de9-cc7e5ab78ca9 tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:aca09258-022b-4f04-b418-f2a170332755" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.595s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 09:48:14 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f7a76b1-7df1-476d-8de9-cc7e5ab78ca9 tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] Connected to 172.16.0.220:3260 {{(pid=75229) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 09:48:14 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-3f7a76b1-7df1-476d-8de9-cc7e5ab78ca9 tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] HCTL ('37', '-', '-', 0) found on session 19 with lun 0 {{(pid=75229) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 09:48:14 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-3f7a76b1-7df1-476d-8de9-cc7e5ab78ca9 tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75229) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 09:48:14 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:48:14 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.021s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:48:14 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e43e63a-fe9e-4db8-aef0-5468f465f5fb]: (4, ('- - 0', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:48:14 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-3f7a76b1-7df1-476d-8de9-cc7e5ab78ca9 tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] Searching for a device in session 19 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75229) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 09:48:14 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f7a76b1-7df1-476d-8de9-cc7e5ab78ca9 tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:aca09258-022b-4f04-b418-f2a170332755', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BrhyGdAv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75229) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 09:48:15 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-3f7a76b1-7df1-476d-8de9-cc7e5ab78ca9 tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.647s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 09:48:15 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f7a76b1-7df1-476d-8de9-cc7e5ab78ca9 tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] <== connect_volume: return (1648ms) {'type': 'block', 'scsi_wwn': '23266303965393733', 'path': '/dev/sdf'} {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 09:48:15 user nova-compute[75229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3f7a76b1-7df1-476d-8de9-cc7e5ab78ca9 tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] [instance: a60d339f-e134-477c-8505-bf8c79d2a21c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23266303965393733', 'path': '/dev/sdf'} {{(pid=75229) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 09:48:16 user nova-compute[75229]: DEBUG nova.virt.libvirt.vif [None req-3f7a76b1-7df1-476d-8de9-cc7e5ab78ca9 tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T09:43:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-285833760',display_name='tempest-ServerActionsTestOtherB-server-285833760',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-285833760',id=5,image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLBqRiXBmoqcQBqBQflJnJ0Bni+p+JlFtve2BlM0X9wLvjWsKzu7TCQo3Ot5hzNFvzwCz/gEUspFHpyxxEkScMIm/fUvYWhxYR4DsojCDDatjjGg5V63rlfYUre+iymhFw==',key_name='tempest-keypair-1362974744',keypairs=<?>,launch_index=0,launched_at=2023-11-14T09:44:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='32e17c7c586542139cdbc5bfda57e075',ramdisk_id='',reservation_id='r-vw8kxtrn',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-45710955',owner_user_name='tempest-ServerActionsTestOtherB-45710955-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T09:48:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='39c6903e2d154e838835eb5265776521',uuid=a60d339f-e134-477c-8505-bf8c79d2a21c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cb98fc47-7b69-4bde-9a4c-717cd44ba908", "address": "fa:16:3e:6c:f4:6d", "network": {"id": "2b667d50-4579-4453-b4d3-a818a0d2c6fc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1719812180-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.24", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1719812180-network", "vif_mac": "fa:16:3e:6c:f4:6d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32e17c7c586542139cdbc5bfda57e075", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb98fc47-7b", "ovs_interfaceid": "cb98fc47-7b69-4bde-9a4c-717cd44ba908", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75229) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 09:48:16 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-3f7a76b1-7df1-476d-8de9-cc7e5ab78ca9 tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] Converting VIF {"id": "cb98fc47-7b69-4bde-9a4c-717cd44ba908", "address": "fa:16:3e:6c:f4:6d", "network": {"id": "2b667d50-4579-4453-b4d3-a818a0d2c6fc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1719812180-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.24", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1719812180-network", "vif_mac": "fa:16:3e:6c:f4:6d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32e17c7c586542139cdbc5bfda57e075", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb98fc47-7b", "ovs_interfaceid": "cb98fc47-7b69-4bde-9a4c-717cd44ba908", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 09:48:16 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-3f7a76b1-7df1-476d-8de9-cc7e5ab78ca9 tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6c:f4:6d,bridge_name='br-int',has_traffic_filtering=True,id=cb98fc47-7b69-4bde-9a4c-717cd44ba908,network=Network(2b667d50-4579-4453-b4d3-a818a0d2c6fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb98fc47-7b') {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 09:48:16 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-3f7a76b1-7df1-476d-8de9-cc7e5ab78ca9 tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] [instance: a60d339f-e134-477c-8505-bf8c79d2a21c] End _get_guest_xml xml=<domain type="kvm">
Nov 14 09:48:16 user nova-compute[75229]:   <uuid>a60d339f-e134-477c-8505-bf8c79d2a21c</uuid>
Nov 14 09:48:16 user nova-compute[75229]:   <name>instance-00000005</name>
Nov 14 09:48:16 user nova-compute[75229]:   <memory>2097152</memory>
Nov 14 09:48:16 user nova-compute[75229]:   <vcpu>1</vcpu>
Nov 14 09:48:16 user nova-compute[75229]:   <metadata>
Nov 14 09:48:16 user nova-compute[75229]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 09:48:16 user nova-compute[75229]:       <nova:package version="0.0.0"/>
Nov 14 09:48:16 user nova-compute[75229]:       <nova:name>tempest-ServerActionsTestOtherB-server-285833760</nova:name>
Nov 14 09:48:16 user nova-compute[75229]:       <nova:creationTime>2023-11-14 09:48:14</nova:creationTime>
Nov 14 09:48:16 user nova-compute[75229]:       <nova:flavor name="m1.small">
Nov 14 09:48:16 user nova-compute[75229]:         <nova:memory>2048</nova:memory>
Nov 14 09:48:16 user nova-compute[75229]:         <nova:disk>20</nova:disk>
Nov 14 09:48:16 user nova-compute[75229]:         <nova:swap>0</nova:swap>
Nov 14 09:48:16 user nova-compute[75229]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 09:48:16 user nova-compute[75229]:         <nova:vcpus>1</nova:vcpus>
Nov 14 09:48:16 user nova-compute[75229]:       </nova:flavor>
Nov 14 09:48:16 user nova-compute[75229]:       <nova:owner>
Nov 14 09:48:16 user nova-compute[75229]:         <nova:user uuid="39c6903e2d154e838835eb5265776521">tempest-ServerActionsTestOtherB-45710955-project-member</nova:user>
Nov 14 09:48:16 user nova-compute[75229]:         <nova:project uuid="32e17c7c586542139cdbc5bfda57e075">tempest-ServerActionsTestOtherB-45710955</nova:project>
Nov 14 09:48:16 user nova-compute[75229]:       </nova:owner>
Nov 14 09:48:16 user nova-compute[75229]:       <nova:root type="image" uuid="3bef8470-ecc7-40e3-95d4-9254348ea72d"/>
Nov 14 09:48:16 user nova-compute[75229]:       <nova:ports>
Nov 14 09:48:16 user nova-compute[75229]:         <nova:port uuid="cb98fc47-7b69-4bde-9a4c-717cd44ba908">
Nov 14 09:48:16 user nova-compute[75229]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 14 09:48:16 user nova-compute[75229]:         </nova:port>
Nov 14 09:48:16 user nova-compute[75229]:       </nova:ports>
Nov 14 09:48:16 user nova-compute[75229]:     </nova:instance>
Nov 14 09:48:16 user nova-compute[75229]:   </metadata>
Nov 14 09:48:16 user nova-compute[75229]:   <sysinfo type="smbios">
Nov 14 09:48:16 user nova-compute[75229]:     <system>
Nov 14 09:48:16 user nova-compute[75229]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 09:48:16 user nova-compute[75229]:       <entry name="product">OpenStack Nova</entry>
Nov 14 09:48:16 user nova-compute[75229]:       <entry name="version">0.0.0</entry>
Nov 14 09:48:16 user nova-compute[75229]:       <entry name="serial">a60d339f-e134-477c-8505-bf8c79d2a21c</entry>
Nov 14 09:48:16 user nova-compute[75229]:       <entry name="uuid">a60d339f-e134-477c-8505-bf8c79d2a21c</entry>
Nov 14 09:48:16 user nova-compute[75229]:       <entry name="family">Virtual Machine</entry>
Nov 14 09:48:16 user nova-compute[75229]:     </system>
Nov 14 09:48:16 user nova-compute[75229]:   </sysinfo>
Nov 14 09:48:16 user nova-compute[75229]:   <os>
Nov 14 09:48:16 user nova-compute[75229]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 09:48:16 user nova-compute[75229]:     <boot dev="hd"/>
Nov 14 09:48:16 user nova-compute[75229]:     <smbios mode="sysinfo"/>
Nov 14 09:48:16 user nova-compute[75229]:   </os>
Nov 14 09:48:16 user nova-compute[75229]:   <features>
Nov 14 09:48:16 user nova-compute[75229]:     <acpi/>
Nov 14 09:48:16 user nova-compute[75229]:     <apic/>
Nov 14 09:48:16 user nova-compute[75229]:     <vmcoreinfo/>
Nov 14 09:48:16 user nova-compute[75229]:   </features>
Nov 14 09:48:16 user nova-compute[75229]:   <clock offset="utc">
Nov 14 09:48:16 user nova-compute[75229]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 09:48:16 user nova-compute[75229]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 09:48:16 user nova-compute[75229]:     <timer name="hpet" present="no"/>
Nov 14 09:48:16 user nova-compute[75229]:   </clock>
Nov 14 09:48:16 user nova-compute[75229]:   <cpu mode="custom" match="exact">
Nov 14 09:48:16 user nova-compute[75229]:     <model>Nehalem</model>
Nov 14 09:48:16 user nova-compute[75229]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 09:48:16 user nova-compute[75229]:   </cpu>
Nov 14 09:48:16 user nova-compute[75229]:   <devices>
Nov 14 09:48:16 user nova-compute[75229]:     <disk type="file" device="disk">
Nov 14 09:48:16 user nova-compute[75229]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 09:48:16 user nova-compute[75229]:       <source file="/opt/stack/data/nova/instances/a60d339f-e134-477c-8505-bf8c79d2a21c/disk"/>
Nov 14 09:48:16 user nova-compute[75229]:       <target dev="vda" bus="virtio"/>
Nov 14 09:48:16 user nova-compute[75229]:     </disk>
Nov 14 09:48:16 user nova-compute[75229]:     <disk type="block" device="disk">
Nov 14 09:48:16 user nova-compute[75229]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 09:48:16 user nova-compute[75229]:       <source dev="/dev/sdf"/>
Nov 14 09:48:16 user nova-compute[75229]:       <target dev="vdb" bus="virtio"/>
Nov 14 09:48:16 user nova-compute[75229]:       <serial>aca09258-022b-4f04-b418-f2a170332755</serial>
Nov 14 09:48:16 user nova-compute[75229]:     </disk>
Nov 14 09:48:16 user nova-compute[75229]:     <interface type="ethernet">
Nov 14 09:48:16 user nova-compute[75229]:       <mac address="fa:16:3e:6c:f4:6d"/>
Nov 14 09:48:16 user nova-compute[75229]:       <model type="virtio"/>
Nov 14 09:48:16 user nova-compute[75229]:       <mtu size="1442"/>
Nov 14 09:48:16 user nova-compute[75229]:       <target dev="tapcb98fc47-7b"/>
Nov 14 09:48:16 user nova-compute[75229]:     </interface>
Nov 14 09:48:16 user nova-compute[75229]:     <serial type="pty">
Nov 14 09:48:16 user nova-compute[75229]:       <log file="/opt/stack/data/nova/instances/a60d339f-e134-477c-8505-bf8c79d2a21c/console.log" append="off"/>
Nov 14 09:48:16 user nova-compute[75229]:     </serial>
Nov 14 09:48:16 user nova-compute[75229]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 09:48:16 user nova-compute[75229]:     <video>
Nov 14 09:48:16 user nova-compute[75229]:       <model type="virtio"/>
Nov 14 09:48:16 user nova-compute[75229]:     </video>
Nov 14 09:48:16 user nova-compute[75229]:     <rng model="virtio">
Nov 14 09:48:16 user nova-compute[75229]:       <backend model="random">/dev/urandom</backend>
Nov 14 09:48:16 user nova-compute[75229]:     </rng>
Nov 14 09:48:16 user nova-compute[75229]:     <controller type="usb" index="0" model="none"/>
Nov 14 09:48:16 user nova-compute[75229]:     <memballoon model="virtio">
Nov 14 09:48:16 user nova-compute[75229]:       <stats period="10"/>
Nov 14 09:48:16 user nova-compute[75229]:     </memballoon>
Nov 14 09:48:16 user nova-compute[75229]:   </devices>
Nov 14 09:48:16 user nova-compute[75229]: </domain>
Nov 14 09:48:16 user nova-compute[75229]:  {{(pid=75229) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 09:48:16 user nova-compute[75229]: DEBUG nova.virt.libvirt.vif [None req-3f7a76b1-7df1-476d-8de9-cc7e5ab78ca9 tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T09:43:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-285833760',display_name='tempest-ServerActionsTestOtherB-server-285833760',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-285833760',id=5,image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLBqRiXBmoqcQBqBQflJnJ0Bni+p+JlFtve2BlM0X9wLvjWsKzu7TCQo3Ot5hzNFvzwCz/gEUspFHpyxxEkScMIm/fUvYWhxYR4DsojCDDatjjGg5V63rlfYUre+iymhFw==',key_name='tempest-keypair-1362974744',keypairs=<?>,launch_index=0,launched_at=2023-11-14T09:44:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='32e17c7c586542139cdbc5bfda57e075',ramdisk_id='',reservation_id='r-vw8kxtrn',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-45710955',owner_user_name='tempest-ServerActionsTestOtherB-45710955-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T09:48:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='39c6903e2d154e838835eb5265776521',uuid=a60d339f-e134-477c-8505-bf8c79d2a21c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cb98fc47-7b69-4bde-9a4c-717cd44ba908", "address": "fa:16:3e:6c:f4:6d", "network": {"id": "2b667d50-4579-4453-b4d3-a818a0d2c6fc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1719812180-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.24", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1719812180-network", "vif_mac": "fa:16:3e:6c:f4:6d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32e17c7c586542139cdbc5bfda57e075", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb98fc47-7b", "ovs_interfaceid": "cb98fc47-7b69-4bde-9a4c-717cd44ba908", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 09:48:16 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-3f7a76b1-7df1-476d-8de9-cc7e5ab78ca9 tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] Converting VIF {"id": "cb98fc47-7b69-4bde-9a4c-717cd44ba908", "address": "fa:16:3e:6c:f4:6d", "network": {"id": "2b667d50-4579-4453-b4d3-a818a0d2c6fc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1719812180-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.24", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1719812180-network", "vif_mac": "fa:16:3e:6c:f4:6d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32e17c7c586542139cdbc5bfda57e075", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb98fc47-7b", "ovs_interfaceid": "cb98fc47-7b69-4bde-9a4c-717cd44ba908", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 09:48:16 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-3f7a76b1-7df1-476d-8de9-cc7e5ab78ca9 tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6c:f4:6d,bridge_name='br-int',has_traffic_filtering=True,id=cb98fc47-7b69-4bde-9a4c-717cd44ba908,network=Network(2b667d50-4579-4453-b4d3-a818a0d2c6fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb98fc47-7b') {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 09:48:16 user nova-compute[75229]: DEBUG os_vif [None req-3f7a76b1-7df1-476d-8de9-cc7e5ab78ca9 tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6c:f4:6d,bridge_name='br-int',has_traffic_filtering=True,id=cb98fc47-7b69-4bde-9a4c-717cd44ba908,network=Network(2b667d50-4579-4453-b4d3-a818a0d2c6fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb98fc47-7b') {{(pid=75229) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 09:48:16 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:48:16 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:48:16 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 09:48:16 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:48:16 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9749a676-2e86-568f-b7d8-1b9ced9bbfec', '_type': 'linux-noop'}}, row=False) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:48:16 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:48:16 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 09:48:16 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:48:16 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcb98fc47-7b, may_exist=True, interface_attrs={}) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:48:16 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapcb98fc47-7b, col_values=(('qos', UUID('aae5fa0c-c0e6-4ba7-b6cc-271c7f903b49')),), if_exists=True) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:48:16 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapcb98fc47-7b, col_values=(('external_ids', {'iface-id': 'cb98fc47-7b69-4bde-9a4c-717cd44ba908', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6c:f4:6d', 'vm-uuid': 'a60d339f-e134-477c-8505-bf8c79d2a21c'}),), if_exists=True) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:48:16 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:48:16 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 09:48:16 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:48:16 user nova-compute[75229]: INFO os_vif [None req-3f7a76b1-7df1-476d-8de9-cc7e5ab78ca9 tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6c:f4:6d,bridge_name='br-int',has_traffic_filtering=True,id=cb98fc47-7b69-4bde-9a4c-717cd44ba908,network=Network(2b667d50-4579-4453-b4d3-a818a0d2c6fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb98fc47-7b')
Nov 14 09:48:16 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-3f7a76b1-7df1-476d-8de9-cc7e5ab78ca9 tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] No BDM found with device name vda, not building metadata. {{(pid=75229) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 09:48:16 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-3f7a76b1-7df1-476d-8de9-cc7e5ab78ca9 tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75229) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 09:48:16 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-3f7a76b1-7df1-476d-8de9-cc7e5ab78ca9 tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] No VIF found with MAC fa:16:3e:6c:f4:6d, not building metadata {{(pid=75229) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 09:48:16 user nova-compute[75229]: DEBUG nova.compute.manager [req-41aabd52-eb32-4dd8-91f4-d1e98d0c28c6 req-2a3b83ea-4444-4f12-ab45-cfa2e3d97f5a service nova] [instance: 4255af28-a111-4475-b207-67e335fd0835] Received event network-vif-plugged-8d218cec-b5d6-46ed-94be-4802fcdd0388 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:48:16 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-41aabd52-eb32-4dd8-91f4-d1e98d0c28c6 req-2a3b83ea-4444-4f12-ab45-cfa2e3d97f5a service nova] Acquiring lock "4255af28-a111-4475-b207-67e335fd0835-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:48:16 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-41aabd52-eb32-4dd8-91f4-d1e98d0c28c6 req-2a3b83ea-4444-4f12-ab45-cfa2e3d97f5a service nova] Lock "4255af28-a111-4475-b207-67e335fd0835-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:48:16 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-41aabd52-eb32-4dd8-91f4-d1e98d0c28c6 req-2a3b83ea-4444-4f12-ab45-cfa2e3d97f5a service nova] Lock "4255af28-a111-4475-b207-67e335fd0835-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:48:16 user nova-compute[75229]: DEBUG nova.compute.manager [req-41aabd52-eb32-4dd8-91f4-d1e98d0c28c6 req-2a3b83ea-4444-4f12-ab45-cfa2e3d97f5a service nova] [instance: 4255af28-a111-4475-b207-67e335fd0835] No waiting events found dispatching network-vif-plugged-8d218cec-b5d6-46ed-94be-4802fcdd0388 {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 09:48:16 user nova-compute[75229]: WARNING nova.compute.manager [req-41aabd52-eb32-4dd8-91f4-d1e98d0c28c6 req-2a3b83ea-4444-4f12-ab45-cfa2e3d97f5a service nova] [instance: 4255af28-a111-4475-b207-67e335fd0835] Received unexpected event network-vif-plugged-8d218cec-b5d6-46ed-94be-4802fcdd0388 for instance with vm_state building and task_state spawning.
Nov 14 09:48:16 user nova-compute[75229]: DEBUG nova.compute.manager [None req-f1b4008d-653a-4188-8f00-bd7d32a92f1b tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] [instance: 4255af28-a111-4475-b207-67e335fd0835] Instance event wait completed in 0 seconds for  {{(pid=75229) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 09:48:16 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-f1b4008d-653a-4188-8f00-bd7d32a92f1b tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] [instance: 4255af28-a111-4475-b207-67e335fd0835] Guest created on hypervisor {{(pid=75229) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 09:48:16 user nova-compute[75229]: INFO nova.virt.libvirt.driver [-] [instance: 4255af28-a111-4475-b207-67e335fd0835] Instance spawned successfully.
Nov 14 09:48:16 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-f1b4008d-653a-4188-8f00-bd7d32a92f1b tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] [instance: 4255af28-a111-4475-b207-67e335fd0835] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 09:48:16 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-f1b4008d-653a-4188-8f00-bd7d32a92f1b tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] [instance: 4255af28-a111-4475-b207-67e335fd0835] Found default for hw_cdrom_bus of ide {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 09:48:16 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-f1b4008d-653a-4188-8f00-bd7d32a92f1b tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] [instance: 4255af28-a111-4475-b207-67e335fd0835] Found default for hw_disk_bus of virtio {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 09:48:16 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-f1b4008d-653a-4188-8f00-bd7d32a92f1b tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] [instance: 4255af28-a111-4475-b207-67e335fd0835] Found default for hw_input_bus of None {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 09:48:16 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-f1b4008d-653a-4188-8f00-bd7d32a92f1b tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] [instance: 4255af28-a111-4475-b207-67e335fd0835] Found default for hw_pointer_model of None {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 09:48:16 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-f1b4008d-653a-4188-8f00-bd7d32a92f1b tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] [instance: 4255af28-a111-4475-b207-67e335fd0835] Found default for hw_video_model of virtio {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 09:48:16 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-f1b4008d-653a-4188-8f00-bd7d32a92f1b tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] [instance: 4255af28-a111-4475-b207-67e335fd0835] Found default for hw_vif_model of virtio {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 09:48:16 user nova-compute[75229]: INFO nova.compute.manager [None req-f1b4008d-653a-4188-8f00-bd7d32a92f1b tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] [instance: 4255af28-a111-4475-b207-67e335fd0835] Took 6.83 seconds to spawn the instance on the hypervisor.
Nov 14 09:48:16 user nova-compute[75229]: DEBUG nova.compute.manager [None req-f1b4008d-653a-4188-8f00-bd7d32a92f1b tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] [instance: 4255af28-a111-4475-b207-67e335fd0835] Checking state {{(pid=75229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 09:48:17 user nova-compute[75229]: INFO nova.compute.manager [None req-f1b4008d-653a-4188-8f00-bd7d32a92f1b tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] [instance: 4255af28-a111-4475-b207-67e335fd0835] Took 8.08 seconds to build instance.
Nov 14 09:48:17 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-f1b4008d-653a-4188-8f00-bd7d32a92f1b tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Lock "4255af28-a111-4475-b207-67e335fd0835" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.247s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:48:17 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:48:17 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:48:17 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:48:17 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:48:17 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:48:18 user nova-compute[75229]: DEBUG nova.compute.manager [req-1444d2d7-4634-4335-a649-349b8986ed24 req-6859f943-6921-45a4-aa40-f40bcbace2f4 service nova] [instance: a60d339f-e134-477c-8505-bf8c79d2a21c] Received event network-vif-plugged-cb98fc47-7b69-4bde-9a4c-717cd44ba908 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:48:18 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-1444d2d7-4634-4335-a649-349b8986ed24 req-6859f943-6921-45a4-aa40-f40bcbace2f4 service nova] Acquiring lock "a60d339f-e134-477c-8505-bf8c79d2a21c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:48:18 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-1444d2d7-4634-4335-a649-349b8986ed24 req-6859f943-6921-45a4-aa40-f40bcbace2f4 service nova] Lock "a60d339f-e134-477c-8505-bf8c79d2a21c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:48:18 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-1444d2d7-4634-4335-a649-349b8986ed24 req-6859f943-6921-45a4-aa40-f40bcbace2f4 service nova] Lock "a60d339f-e134-477c-8505-bf8c79d2a21c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:48:18 user nova-compute[75229]: DEBUG nova.compute.manager [req-1444d2d7-4634-4335-a649-349b8986ed24 req-6859f943-6921-45a4-aa40-f40bcbace2f4 service nova] [instance: a60d339f-e134-477c-8505-bf8c79d2a21c] No waiting events found dispatching network-vif-plugged-cb98fc47-7b69-4bde-9a4c-717cd44ba908 {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 09:48:18 user nova-compute[75229]: WARNING nova.compute.manager [req-1444d2d7-4634-4335-a649-349b8986ed24 req-6859f943-6921-45a4-aa40-f40bcbace2f4 service nova] [instance: a60d339f-e134-477c-8505-bf8c79d2a21c] Received unexpected event network-vif-plugged-cb98fc47-7b69-4bde-9a4c-717cd44ba908 for instance with vm_state active and task_state resize_finish.
Nov 14 09:48:18 user nova-compute[75229]: DEBUG nova.compute.manager [req-1444d2d7-4634-4335-a649-349b8986ed24 req-6859f943-6921-45a4-aa40-f40bcbace2f4 service nova] [instance: a60d339f-e134-477c-8505-bf8c79d2a21c] Received event network-vif-plugged-cb98fc47-7b69-4bde-9a4c-717cd44ba908 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:48:18 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-1444d2d7-4634-4335-a649-349b8986ed24 req-6859f943-6921-45a4-aa40-f40bcbace2f4 service nova] Acquiring lock "a60d339f-e134-477c-8505-bf8c79d2a21c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:48:18 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-1444d2d7-4634-4335-a649-349b8986ed24 req-6859f943-6921-45a4-aa40-f40bcbace2f4 service nova] Lock "a60d339f-e134-477c-8505-bf8c79d2a21c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:48:18 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-1444d2d7-4634-4335-a649-349b8986ed24 req-6859f943-6921-45a4-aa40-f40bcbace2f4 service nova] Lock "a60d339f-e134-477c-8505-bf8c79d2a21c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:48:18 user nova-compute[75229]: DEBUG nova.compute.manager [req-1444d2d7-4634-4335-a649-349b8986ed24 req-6859f943-6921-45a4-aa40-f40bcbace2f4 service nova] [instance: a60d339f-e134-477c-8505-bf8c79d2a21c] No waiting events found dispatching network-vif-plugged-cb98fc47-7b69-4bde-9a4c-717cd44ba908 {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 09:48:18 user nova-compute[75229]: WARNING nova.compute.manager [req-1444d2d7-4634-4335-a649-349b8986ed24 req-6859f943-6921-45a4-aa40-f40bcbace2f4 service nova] [instance: a60d339f-e134-477c-8505-bf8c79d2a21c] Received unexpected event network-vif-plugged-cb98fc47-7b69-4bde-9a4c-717cd44ba908 for instance with vm_state active and task_state resize_finish.
Nov 14 09:48:18 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:48:18 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:48:18 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:48:18 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:48:20 user nova-compute[75229]: DEBUG nova.compute.manager [None req-3f7a76b1-7df1-476d-8de9-cc7e5ab78ca9 tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] [instance: a60d339f-e134-477c-8505-bf8c79d2a21c] Instance event wait completed in 0 seconds for  {{(pid=75229) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 09:48:20 user nova-compute[75229]: INFO nova.virt.libvirt.driver [-] [instance: a60d339f-e134-477c-8505-bf8c79d2a21c] Instance running successfully.
Nov 14 09:48:20 user nova-compute[75229]: DEBUG nova.virt.libvirt.guest [None req-3f7a76b1-7df1-476d-8de9-cc7e5ab78ca9 tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] [instance: a60d339f-e134-477c-8505-bf8c79d2a21c] Failed to set time: agent not configured {{(pid=75229) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Nov 14 09:48:20 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-3f7a76b1-7df1-476d-8de9-cc7e5ab78ca9 tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] [instance: a60d339f-e134-477c-8505-bf8c79d2a21c] finish_migration finished successfully. {{(pid=75229) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Nov 14 09:48:21 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:48:22 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:48:22 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:48:26 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:48:26 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:48:27 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:48:29 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:48:31 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:48:32 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:48:36 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:48:36 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:48:37 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:48:40 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:48:40 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:48:41 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:48:42 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:48:43 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:48:46 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:48:46 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 09:48:46 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 09:48:46 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:48:46 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.002s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:48:46 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:48:46 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Auditing locally available compute resources for user (node: user) {{(pid=75229) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 09:48:46 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb53ba25-d865-41ae-90f3-6e154e2778ba/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:48:47 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb53ba25-d865-41ae-90f3-6e154e2778ba/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:48:47 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb53ba25-d865-41ae-90f3-6e154e2778ba/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:48:47 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb53ba25-d865-41ae-90f3-6e154e2778ba/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:48:47 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7750cbc-b3d0-44aa-8b88-c291ba007a8a/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:48:47 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7750cbc-b3d0-44aa-8b88-c291ba007a8a/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:48:47 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7750cbc-b3d0-44aa-8b88-c291ba007a8a/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:48:47 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7750cbc-b3d0-44aa-8b88-c291ba007a8a/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:48:47 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38f30682-2278-40aa-914e-2867e771eb19/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:48:47 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:48:48 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38f30682-2278-40aa-914e-2867e771eb19/disk --force-share --output=json" returned: 0 in 0.246s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:48:48 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38f30682-2278-40aa-914e-2867e771eb19/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:48:48 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38f30682-2278-40aa-914e-2867e771eb19/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:48:48 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a60d339f-e134-477c-8505-bf8c79d2a21c/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:48:48 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a60d339f-e134-477c-8505-bf8c79d2a21c/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:48:48 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a60d339f-e134-477c-8505-bf8c79d2a21c/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:48:48 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a60d339f-e134-477c-8505-bf8c79d2a21c/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:48:48 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=75229) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 09:48:48 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be813b28-133f-416a-b2b5-dc0b9e4064b7/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:48:48 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be813b28-133f-416a-b2b5-dc0b9e4064b7/disk --force-share --output=json" returned: 0 in 0.264s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:48:48 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be813b28-133f-416a-b2b5-dc0b9e4064b7/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:48:49 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be813b28-133f-416a-b2b5-dc0b9e4064b7/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:48:49 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90bd76df-96cb-4bec-9862-853d94cdbaab/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:48:49 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90bd76df-96cb-4bec-9862-853d94cdbaab/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:48:49 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90bd76df-96cb-4bec-9862-853d94cdbaab/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:48:49 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90bd76df-96cb-4bec-9862-853d94cdbaab/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:48:49 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] skipping disk /dev/sdg (vdc) as it is a volume {{(pid=75229) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 09:48:49 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6e2d77b-9894-4afa-8fa1-13a2842ba9a7/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:48:49 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6e2d77b-9894-4afa-8fa1-13a2842ba9a7/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:48:49 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6e2d77b-9894-4afa-8fa1-13a2842ba9a7/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:48:50 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6e2d77b-9894-4afa-8fa1-13a2842ba9a7/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:48:50 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e09b3809-2e23-401c-9a72-88feb2bb657c/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:48:50 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:48:50 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e09b3809-2e23-401c-9a72-88feb2bb657c/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:48:50 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e09b3809-2e23-401c-9a72-88feb2bb657c/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:48:50 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e09b3809-2e23-401c-9a72-88feb2bb657c/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:48:50 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75229) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 09:48:50 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e09b3809-2e23-401c-9a72-88feb2bb657c/disk.rescue --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:48:50 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e09b3809-2e23-401c-9a72-88feb2bb657c/disk.rescue --force-share --output=json" returned: 0 in 0.187s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:48:50 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e09b3809-2e23-401c-9a72-88feb2bb657c/disk.rescue --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:48:50 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e09b3809-2e23-401c-9a72-88feb2bb657c/disk.rescue --force-share --output=json" returned: 0 in 0.232s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:48:50 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75229) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 09:48:50 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75229) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 09:48:50 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] skipping disk /dev/sdd (vdc) as it is a volume {{(pid=75229) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 09:48:50 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4255af28-a111-4475-b207-67e335fd0835/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:48:51 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:48:51 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:48:51 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4255af28-a111-4475-b207-67e335fd0835/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:48:51 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4255af28-a111-4475-b207-67e335fd0835/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:48:51 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4255af28-a111-4475-b207-67e335fd0835/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:48:52 user nova-compute[75229]: WARNING nova.virt.libvirt.driver [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 09:48:52 user nova-compute[75229]: WARNING nova.virt.libvirt.driver [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 09:48:52 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Hypervisor/Node resource view: name=user free_ram=7192MB free_disk=25.345260620117188GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75229) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 09:48:52 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:48:52 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.005s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:48:52 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:48:52 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Applying migration context for instance a60d339f-e134-477c-8505-bf8c79d2a21c as it has an incoming, in-progress migration 2ccefcb8-9839-48e7-bdc8-dfbad0d1bf64. Migration status is finished {{(pid=75229) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 14 09:48:52 user nova-compute[75229]: INFO nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] [instance: a60d339f-e134-477c-8505-bf8c79d2a21c] Updating resource usage from migration 2ccefcb8-9839-48e7-bdc8-dfbad0d1bf64
Nov 14 09:48:52 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Instance a7750cbc-b3d0-44aa-8b88-c291ba007a8a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 09:48:52 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Instance e09b3809-2e23-401c-9a72-88feb2bb657c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 09:48:52 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Instance eb53ba25-d865-41ae-90f3-6e154e2778ba actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 09:48:52 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Instance 38f30682-2278-40aa-914e-2867e771eb19 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 09:48:52 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Instance 9bcd05e7-481c-4ee9-953d-2873e6aa849d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 09:48:52 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Instance 90bd76df-96cb-4bec-9862-853d94cdbaab actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 09:48:52 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Instance be813b28-133f-416a-b2b5-dc0b9e4064b7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 09:48:52 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Migration 2ccefcb8-9839-48e7-bdc8-dfbad0d1bf64 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 14 09:48:52 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Instance a60d339f-e134-477c-8505-bf8c79d2a21c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 09:48:52 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Instance d6e2d77b-9894-4afa-8fa1-13a2842ba9a7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 09:48:52 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Instance 4255af28-a111-4475-b207-67e335fd0835 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 09:48:52 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=75229) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 09:48:52 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=29GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=75229) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 09:48:52 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-16bde4e4-15d8-4832-92f9-a1cab8fcd8d1 tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] Acquiring lock "38f30682-2278-40aa-914e-2867e771eb19" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:48:52 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-16bde4e4-15d8-4832-92f9-a1cab8fcd8d1 tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] Lock "38f30682-2278-40aa-914e-2867e771eb19" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:48:52 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-16bde4e4-15d8-4832-92f9-a1cab8fcd8d1 tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] Acquiring lock "38f30682-2278-40aa-914e-2867e771eb19-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:48:52 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-16bde4e4-15d8-4832-92f9-a1cab8fcd8d1 tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] Lock "38f30682-2278-40aa-914e-2867e771eb19-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:48:52 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-16bde4e4-15d8-4832-92f9-a1cab8fcd8d1 tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] Lock "38f30682-2278-40aa-914e-2867e771eb19-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:48:52 user nova-compute[75229]: INFO nova.compute.manager [None req-16bde4e4-15d8-4832-92f9-a1cab8fcd8d1 tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] [instance: 38f30682-2278-40aa-914e-2867e771eb19] Terminating instance
Nov 14 09:48:52 user nova-compute[75229]: DEBUG nova.compute.manager [None req-16bde4e4-15d8-4832-92f9-a1cab8fcd8d1 tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] [instance: 38f30682-2278-40aa-914e-2867e771eb19] Start destroying the instance on the hypervisor. {{(pid=75229) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 09:48:52 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:48:52 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:48:52 user nova-compute[75229]: DEBUG nova.compute.provider_tree [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Inventory has not changed in ProviderTree for provider: d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 {{(pid=75229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 09:48:52 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:48:52 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:48:52 user nova-compute[75229]: DEBUG nova.scheduler.client.report [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Inventory has not changed for provider d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 09:48:52 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:48:52 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Compute_service record updated for user:user {{(pid=75229) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 09:48:52 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.662s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:48:53 user nova-compute[75229]: INFO nova.virt.libvirt.driver [-] [instance: 38f30682-2278-40aa-914e-2867e771eb19] Instance destroyed successfully.
Nov 14 09:48:53 user nova-compute[75229]: DEBUG nova.objects.instance [None req-16bde4e4-15d8-4832-92f9-a1cab8fcd8d1 tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] Lazy-loading 'resources' on Instance uuid 38f30682-2278-40aa-914e-2867e771eb19 {{(pid=75229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 09:48:53 user nova-compute[75229]: DEBUG nova.virt.libvirt.vif [None req-16bde4e4-15d8-4832-92f9-a1cab8fcd8d1 tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T09:46:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1066646083',display_name='tempest-VolumesAdminNegativeTest-server-1066646083',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1066646083',id=13,image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-14T09:47:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6026f6867f00423283219da921bef367',ramdisk_id='',reservation_id='r-ney68s17',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-333811129',owner_user_name='tempest-VolumesAdminNegativeTest-333811129-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T09:47:05Z,user_data=None,user_id='ce091bb40ce04afeb988be064cbe673a',uuid=38f30682-2278-40aa-914e-2867e771eb19,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "68bf11fd-3f67-41f3-a6c8-b6ef1bbfd979", "address": "fa:16:3e:3c:89:4e", "network": {"id": "9ace077c-6658-4348-ac9b-f6be125b4f0f", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1010403250-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6026f6867f00423283219da921bef367", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68bf11fd-3f", "ovs_interfaceid": "68bf11fd-3f67-41f3-a6c8-b6ef1bbfd979", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 09:48:53 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-16bde4e4-15d8-4832-92f9-a1cab8fcd8d1 tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] Converting VIF {"id": "68bf11fd-3f67-41f3-a6c8-b6ef1bbfd979", "address": "fa:16:3e:3c:89:4e", "network": {"id": "9ace077c-6658-4348-ac9b-f6be125b4f0f", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1010403250-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6026f6867f00423283219da921bef367", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68bf11fd-3f", "ovs_interfaceid": "68bf11fd-3f67-41f3-a6c8-b6ef1bbfd979", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 09:48:53 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-16bde4e4-15d8-4832-92f9-a1cab8fcd8d1 tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3c:89:4e,bridge_name='br-int',has_traffic_filtering=True,id=68bf11fd-3f67-41f3-a6c8-b6ef1bbfd979,network=Network(9ace077c-6658-4348-ac9b-f6be125b4f0f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68bf11fd-3f') {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 09:48:53 user nova-compute[75229]: DEBUG os_vif [None req-16bde4e4-15d8-4832-92f9-a1cab8fcd8d1 tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3c:89:4e,bridge_name='br-int',has_traffic_filtering=True,id=68bf11fd-3f67-41f3-a6c8-b6ef1bbfd979,network=Network(9ace077c-6658-4348-ac9b-f6be125b4f0f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68bf11fd-3f') {{(pid=75229) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 09:48:53 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:48:53 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap68bf11fd-3f, bridge=br-int, if_exists=True) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:48:53 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:48:53 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:48:53 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:48:53 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=76a2d398-27c9-4d19-8581-d9cc451b65af) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:48:53 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:48:53 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:48:53 user nova-compute[75229]: INFO os_vif [None req-16bde4e4-15d8-4832-92f9-a1cab8fcd8d1 tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3c:89:4e,bridge_name='br-int',has_traffic_filtering=True,id=68bf11fd-3f67-41f3-a6c8-b6ef1bbfd979,network=Network(9ace077c-6658-4348-ac9b-f6be125b4f0f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68bf11fd-3f')
Nov 14 09:48:53 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-16bde4e4-15d8-4832-92f9-a1cab8fcd8d1 tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] [instance: 38f30682-2278-40aa-914e-2867e771eb19] Deleting instance files /opt/stack/data/nova/instances/38f30682-2278-40aa-914e-2867e771eb19_del
Nov 14 09:48:53 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-16bde4e4-15d8-4832-92f9-a1cab8fcd8d1 tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] [instance: 38f30682-2278-40aa-914e-2867e771eb19] Deletion of /opt/stack/data/nova/instances/38f30682-2278-40aa-914e-2867e771eb19_del complete
Nov 14 09:48:53 user nova-compute[75229]: INFO nova.compute.manager [None req-16bde4e4-15d8-4832-92f9-a1cab8fcd8d1 tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] [instance: 38f30682-2278-40aa-914e-2867e771eb19] Took 0.67 seconds to destroy the instance on the hypervisor.
Nov 14 09:48:53 user nova-compute[75229]: DEBUG oslo.service.loopingcall [None req-16bde4e4-15d8-4832-92f9-a1cab8fcd8d1 tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75229) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 09:48:53 user nova-compute[75229]: DEBUG nova.compute.manager [-] [instance: 38f30682-2278-40aa-914e-2867e771eb19] Deallocating network for instance {{(pid=75229) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 09:48:53 user nova-compute[75229]: DEBUG nova.network.neutron [-] [instance: 38f30682-2278-40aa-914e-2867e771eb19] deallocate_for_instance() {{(pid=75229) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 09:48:53 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 09:48:53 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 09:48:53 user nova-compute[75229]: DEBUG nova.compute.manager [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Starting heal instance info cache {{(pid=75229) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 09:48:53 user nova-compute[75229]: DEBUG nova.network.neutron [-] [instance: 38f30682-2278-40aa-914e-2867e771eb19] Updating instance_info_cache with network_info: [] {{(pid=75229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 09:48:53 user nova-compute[75229]: INFO nova.compute.manager [-] [instance: 38f30682-2278-40aa-914e-2867e771eb19] Took 0.82 seconds to deallocate network for instance.
Nov 14 09:48:54 user nova-compute[75229]: DEBUG nova.compute.manager [req-c7185c5b-0fed-4fa6-badc-60b1b9dbab64 req-7514fe60-4587-4798-81b1-ee34980a91ff service nova] [instance: 38f30682-2278-40aa-914e-2867e771eb19] Received event network-vif-deleted-68bf11fd-3f67-41f3-a6c8-b6ef1bbfd979 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:48:54 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-16bde4e4-15d8-4832-92f9-a1cab8fcd8d1 tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:48:54 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-16bde4e4-15d8-4832-92f9-a1cab8fcd8d1 tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:48:54 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-2552574c-7261-4457-825c-8a3e4e8e59da tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Acquiring lock "4c9fe69e-3f9d-4b30-a9e4-efc3e83efa17" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:48:54 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-2552574c-7261-4457-825c-8a3e4e8e59da tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Lock "4c9fe69e-3f9d-4b30-a9e4-efc3e83efa17" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:48:54 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Acquiring lock "refresh_cache-a60d339f-e134-477c-8505-bf8c79d2a21c" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 09:48:54 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Acquired lock "refresh_cache-a60d339f-e134-477c-8505-bf8c79d2a21c" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 09:48:54 user nova-compute[75229]: DEBUG nova.network.neutron [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] [instance: a60d339f-e134-477c-8505-bf8c79d2a21c] Forcefully refreshing network info cache for instance {{(pid=75229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 09:48:54 user nova-compute[75229]: DEBUG nova.compute.manager [None req-2552574c-7261-4457-825c-8a3e4e8e59da tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] [instance: 4c9fe69e-3f9d-4b30-a9e4-efc3e83efa17] Starting instance... {{(pid=75229) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 09:48:54 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-2552574c-7261-4457-825c-8a3e4e8e59da tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:48:54 user nova-compute[75229]: DEBUG nova.compute.provider_tree [None req-16bde4e4-15d8-4832-92f9-a1cab8fcd8d1 tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] Inventory has not changed in ProviderTree for provider: d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 {{(pid=75229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 09:48:54 user nova-compute[75229]: DEBUG nova.scheduler.client.report [None req-16bde4e4-15d8-4832-92f9-a1cab8fcd8d1 tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] Inventory has not changed for provider d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 09:48:54 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-16bde4e4-15d8-4832-92f9-a1cab8fcd8d1 tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.445s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:48:54 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-2552574c-7261-4457-825c-8a3e4e8e59da tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.244s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:48:54 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-2552574c-7261-4457-825c-8a3e4e8e59da tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75229) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 09:48:54 user nova-compute[75229]: INFO nova.compute.claims [None req-2552574c-7261-4457-825c-8a3e4e8e59da tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] [instance: 4c9fe69e-3f9d-4b30-a9e4-efc3e83efa17] Claim successful on node user
Nov 14 09:48:54 user nova-compute[75229]: INFO nova.scheduler.client.report [None req-16bde4e4-15d8-4832-92f9-a1cab8fcd8d1 tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] Deleted allocations for instance 38f30682-2278-40aa-914e-2867e771eb19
Nov 14 09:48:54 user nova-compute[75229]: DEBUG nova.network.neutron [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] [instance: a60d339f-e134-477c-8505-bf8c79d2a21c] Updating instance_info_cache with network_info: [{"id": "cb98fc47-7b69-4bde-9a4c-717cd44ba908", "address": "fa:16:3e:6c:f4:6d", "network": {"id": "2b667d50-4579-4453-b4d3-a818a0d2c6fc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1719812180-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.24", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32e17c7c586542139cdbc5bfda57e075", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb98fc47-7b", "ovs_interfaceid": "cb98fc47-7b69-4bde-9a4c-717cd44ba908", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 09:48:54 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Releasing lock "refresh_cache-a60d339f-e134-477c-8505-bf8c79d2a21c" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 09:48:54 user nova-compute[75229]: DEBUG nova.compute.manager [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] [instance: a60d339f-e134-477c-8505-bf8c79d2a21c] Updated the network info_cache for instance {{(pid=75229) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 09:48:54 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-16bde4e4-15d8-4832-92f9-a1cab8fcd8d1 tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] Lock "38f30682-2278-40aa-914e-2867e771eb19" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.254s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:48:54 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 09:48:54 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 09:48:54 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 09:48:54 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 09:48:54 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 09:48:54 user nova-compute[75229]: DEBUG nova.compute.manager [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75229) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 09:48:54 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-9c9d2ab2-ab73-4cb8-bb8e-e7f1a0b80fc8 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Acquiring lock "b5170e9e-66e3-4df1-9807-4958cac6480e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:48:54 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-9c9d2ab2-ab73-4cb8-bb8e-e7f1a0b80fc8 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Lock "b5170e9e-66e3-4df1-9807-4958cac6480e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:48:54 user nova-compute[75229]: DEBUG nova.compute.manager [None req-9c9d2ab2-ab73-4cb8-bb8e-e7f1a0b80fc8 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] [instance: b5170e9e-66e3-4df1-9807-4958cac6480e] Starting instance... {{(pid=75229) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 09:48:54 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-9c9d2ab2-ab73-4cb8-bb8e-e7f1a0b80fc8 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:48:55 user nova-compute[75229]: DEBUG nova.compute.provider_tree [None req-2552574c-7261-4457-825c-8a3e4e8e59da tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Inventory has not changed in ProviderTree for provider: d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 {{(pid=75229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 09:48:55 user nova-compute[75229]: DEBUG nova.scheduler.client.report [None req-2552574c-7261-4457-825c-8a3e4e8e59da tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Inventory has not changed for provider d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 09:48:55 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-2552574c-7261-4457-825c-8a3e4e8e59da tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.542s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:48:55 user nova-compute[75229]: DEBUG nova.compute.manager [None req-2552574c-7261-4457-825c-8a3e4e8e59da tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] [instance: 4c9fe69e-3f9d-4b30-a9e4-efc3e83efa17] Start building networks asynchronously for instance. {{(pid=75229) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 09:48:55 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-9c9d2ab2-ab73-4cb8-bb8e-e7f1a0b80fc8 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.182s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:48:55 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-9c9d2ab2-ab73-4cb8-bb8e-e7f1a0b80fc8 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75229) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 09:48:55 user nova-compute[75229]: INFO nova.compute.claims [None req-9c9d2ab2-ab73-4cb8-bb8e-e7f1a0b80fc8 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] [instance: b5170e9e-66e3-4df1-9807-4958cac6480e] Claim successful on node user
Nov 14 09:48:55 user nova-compute[75229]: DEBUG nova.compute.manager [None req-2552574c-7261-4457-825c-8a3e4e8e59da tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] [instance: 4c9fe69e-3f9d-4b30-a9e4-efc3e83efa17] Allocating IP information in the background. {{(pid=75229) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 09:48:55 user nova-compute[75229]: DEBUG nova.network.neutron [None req-2552574c-7261-4457-825c-8a3e4e8e59da tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] [instance: 4c9fe69e-3f9d-4b30-a9e4-efc3e83efa17] allocate_for_instance() {{(pid=75229) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 09:48:55 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-2552574c-7261-4457-825c-8a3e4e8e59da tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] [instance: 4c9fe69e-3f9d-4b30-a9e4-efc3e83efa17] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 09:48:55 user nova-compute[75229]: DEBUG nova.compute.manager [None req-2552574c-7261-4457-825c-8a3e4e8e59da tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] [instance: 4c9fe69e-3f9d-4b30-a9e4-efc3e83efa17] Start building block device mappings for instance. {{(pid=75229) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 09:48:55 user nova-compute[75229]: DEBUG nova.policy [None req-2552574c-7261-4457-825c-8a3e4e8e59da tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a3cb33a5c522499e8cd254edd5e15879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46457b27e3ed416e827c3c22449fb512', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75229) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 09:48:55 user nova-compute[75229]: DEBUG nova.compute.manager [None req-2552574c-7261-4457-825c-8a3e4e8e59da tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] [instance: 4c9fe69e-3f9d-4b30-a9e4-efc3e83efa17] Start spawning the instance on the hypervisor. {{(pid=75229) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 09:48:55 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-2552574c-7261-4457-825c-8a3e4e8e59da tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] [instance: 4c9fe69e-3f9d-4b30-a9e4-efc3e83efa17] Creating instance directory {{(pid=75229) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 09:48:55 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-2552574c-7261-4457-825c-8a3e4e8e59da tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] [instance: 4c9fe69e-3f9d-4b30-a9e4-efc3e83efa17] Creating image(s)
Nov 14 09:48:55 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-2552574c-7261-4457-825c-8a3e4e8e59da tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Acquiring lock "/opt/stack/data/nova/instances/4c9fe69e-3f9d-4b30-a9e4-efc3e83efa17/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:48:55 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-2552574c-7261-4457-825c-8a3e4e8e59da tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Lock "/opt/stack/data/nova/instances/4c9fe69e-3f9d-4b30-a9e4-efc3e83efa17/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:48:55 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-2552574c-7261-4457-825c-8a3e4e8e59da tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Lock "/opt/stack/data/nova/instances/4c9fe69e-3f9d-4b30-a9e4-efc3e83efa17/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:48:55 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-2552574c-7261-4457-825c-8a3e4e8e59da tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6 --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:48:55 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-2552574c-7261-4457-825c-8a3e4e8e59da tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6 --force-share --output=json" returned: 0 in 0.204s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:48:55 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-2552574c-7261-4457-825c-8a3e4e8e59da tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Acquiring lock "4f30e3fe703d2381679612a57b1fb80a467f60b6" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:48:55 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-2552574c-7261-4457-825c-8a3e4e8e59da tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Lock "4f30e3fe703d2381679612a57b1fb80a467f60b6" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:48:55 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-2552574c-7261-4457-825c-8a3e4e8e59da tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6 --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:48:55 user nova-compute[75229]: DEBUG nova.compute.provider_tree [None req-9c9d2ab2-ab73-4cb8-bb8e-e7f1a0b80fc8 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Inventory has not changed in ProviderTree for provider: d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 {{(pid=75229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 09:48:55 user nova-compute[75229]: DEBUG nova.scheduler.client.report [None req-9c9d2ab2-ab73-4cb8-bb8e-e7f1a0b80fc8 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Inventory has not changed for provider d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 09:48:55 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-9c9d2ab2-ab73-4cb8-bb8e-e7f1a0b80fc8 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.591s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:48:55 user nova-compute[75229]: DEBUG nova.compute.manager [None req-9c9d2ab2-ab73-4cb8-bb8e-e7f1a0b80fc8 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] [instance: b5170e9e-66e3-4df1-9807-4958cac6480e] Start building networks asynchronously for instance. {{(pid=75229) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 09:48:55 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-2552574c-7261-4457-825c-8a3e4e8e59da tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6 --force-share --output=json" returned: 0 in 0.195s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:48:55 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-2552574c-7261-4457-825c-8a3e4e8e59da tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6,backing_fmt=raw /opt/stack/data/nova/instances/4c9fe69e-3f9d-4b30-a9e4-efc3e83efa17/disk 1073741824 {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:48:55 user nova-compute[75229]: DEBUG nova.compute.manager [None req-9c9d2ab2-ab73-4cb8-bb8e-e7f1a0b80fc8 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] [instance: b5170e9e-66e3-4df1-9807-4958cac6480e] Allocating IP information in the background. {{(pid=75229) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 09:48:55 user nova-compute[75229]: DEBUG nova.network.neutron [None req-9c9d2ab2-ab73-4cb8-bb8e-e7f1a0b80fc8 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] [instance: b5170e9e-66e3-4df1-9807-4958cac6480e] allocate_for_instance() {{(pid=75229) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 09:48:55 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-2552574c-7261-4457-825c-8a3e4e8e59da tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6,backing_fmt=raw /opt/stack/data/nova/instances/4c9fe69e-3f9d-4b30-a9e4-efc3e83efa17/disk 1073741824" returned: 0 in 0.069s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:48:55 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-2552574c-7261-4457-825c-8a3e4e8e59da tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Lock "4f30e3fe703d2381679612a57b1fb80a467f60b6" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.267s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:48:55 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-2552574c-7261-4457-825c-8a3e4e8e59da tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6 --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:48:55 user nova-compute[75229]: DEBUG nova.network.neutron [None req-2552574c-7261-4457-825c-8a3e4e8e59da tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] [instance: 4c9fe69e-3f9d-4b30-a9e4-efc3e83efa17] Successfully created port: 235153d6-63c1-44d2-97cc-c083544e6790 {{(pid=75229) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 09:48:55 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-9c9d2ab2-ab73-4cb8-bb8e-e7f1a0b80fc8 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] [instance: b5170e9e-66e3-4df1-9807-4958cac6480e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 09:48:55 user nova-compute[75229]: DEBUG nova.compute.manager [None req-9c9d2ab2-ab73-4cb8-bb8e-e7f1a0b80fc8 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] [instance: b5170e9e-66e3-4df1-9807-4958cac6480e] Start building block device mappings for instance. {{(pid=75229) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 09:48:55 user nova-compute[75229]: DEBUG nova.policy [None req-9c9d2ab2-ab73-4cb8-bb8e-e7f1a0b80fc8 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a3cb33a5c522499e8cd254edd5e15879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46457b27e3ed416e827c3c22449fb512', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75229) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 09:48:55 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-2552574c-7261-4457-825c-8a3e4e8e59da tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6 --force-share --output=json" returned: 0 in 0.199s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:48:55 user nova-compute[75229]: DEBUG nova.virt.disk.api [None req-2552574c-7261-4457-825c-8a3e4e8e59da tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4c9fe69e-3f9d-4b30-a9e4-efc3e83efa17/disk. size=1073741824 {{(pid=75229) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 09:48:56 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-2552574c-7261-4457-825c-8a3e4e8e59da tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c9fe69e-3f9d-4b30-a9e4-efc3e83efa17/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:48:56 user nova-compute[75229]: DEBUG nova.compute.manager [None req-9c9d2ab2-ab73-4cb8-bb8e-e7f1a0b80fc8 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] [instance: b5170e9e-66e3-4df1-9807-4958cac6480e] Start spawning the instance on the hypervisor. {{(pid=75229) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 09:48:56 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-9c9d2ab2-ab73-4cb8-bb8e-e7f1a0b80fc8 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] [instance: b5170e9e-66e3-4df1-9807-4958cac6480e] Creating instance directory {{(pid=75229) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 09:48:56 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-9c9d2ab2-ab73-4cb8-bb8e-e7f1a0b80fc8 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] [instance: b5170e9e-66e3-4df1-9807-4958cac6480e] Creating image(s)
Nov 14 09:48:56 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-9c9d2ab2-ab73-4cb8-bb8e-e7f1a0b80fc8 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Acquiring lock "/opt/stack/data/nova/instances/b5170e9e-66e3-4df1-9807-4958cac6480e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:48:56 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-9c9d2ab2-ab73-4cb8-bb8e-e7f1a0b80fc8 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Lock "/opt/stack/data/nova/instances/b5170e9e-66e3-4df1-9807-4958cac6480e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:48:56 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-9c9d2ab2-ab73-4cb8-bb8e-e7f1a0b80fc8 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Lock "/opt/stack/data/nova/instances/b5170e9e-66e3-4df1-9807-4958cac6480e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:48:56 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-9c9d2ab2-ab73-4cb8-bb8e-e7f1a0b80fc8 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6 --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:48:56 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-2552574c-7261-4457-825c-8a3e4e8e59da tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c9fe69e-3f9d-4b30-a9e4-efc3e83efa17/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:48:56 user nova-compute[75229]: DEBUG nova.virt.disk.api [None req-2552574c-7261-4457-825c-8a3e4e8e59da tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Cannot resize image /opt/stack/data/nova/instances/4c9fe69e-3f9d-4b30-a9e4-efc3e83efa17/disk to a smaller size. {{(pid=75229) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 09:48:56 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-2552574c-7261-4457-825c-8a3e4e8e59da tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] [instance: 4c9fe69e-3f9d-4b30-a9e4-efc3e83efa17] Created local disks {{(pid=75229) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 09:48:56 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-2552574c-7261-4457-825c-8a3e4e8e59da tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] [instance: 4c9fe69e-3f9d-4b30-a9e4-efc3e83efa17] Ensure instance console log exists: /opt/stack/data/nova/instances/4c9fe69e-3f9d-4b30-a9e4-efc3e83efa17/console.log {{(pid=75229) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 09:48:56 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-2552574c-7261-4457-825c-8a3e4e8e59da tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:48:56 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-2552574c-7261-4457-825c-8a3e4e8e59da tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:48:56 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-2552574c-7261-4457-825c-8a3e4e8e59da tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:48:56 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-9c9d2ab2-ab73-4cb8-bb8e-e7f1a0b80fc8 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6 --force-share --output=json" returned: 0 in 0.189s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:48:56 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-9c9d2ab2-ab73-4cb8-bb8e-e7f1a0b80fc8 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Acquiring lock "4f30e3fe703d2381679612a57b1fb80a467f60b6" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:48:56 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-9c9d2ab2-ab73-4cb8-bb8e-e7f1a0b80fc8 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Lock "4f30e3fe703d2381679612a57b1fb80a467f60b6" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:48:56 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-9c9d2ab2-ab73-4cb8-bb8e-e7f1a0b80fc8 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6 --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:48:56 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-9c9d2ab2-ab73-4cb8-bb8e-e7f1a0b80fc8 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6 --force-share --output=json" returned: 0 in 0.206s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:48:56 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-9c9d2ab2-ab73-4cb8-bb8e-e7f1a0b80fc8 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6,backing_fmt=raw /opt/stack/data/nova/instances/b5170e9e-66e3-4df1-9807-4958cac6480e/disk 1073741824 {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:48:56 user nova-compute[75229]: DEBUG nova.network.neutron [None req-9c9d2ab2-ab73-4cb8-bb8e-e7f1a0b80fc8 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] [instance: b5170e9e-66e3-4df1-9807-4958cac6480e] Successfully created port: bed3fc1c-227e-44d2-85e1-589501a2e9dc {{(pid=75229) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 09:48:56 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-9c9d2ab2-ab73-4cb8-bb8e-e7f1a0b80fc8 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6,backing_fmt=raw /opt/stack/data/nova/instances/b5170e9e-66e3-4df1-9807-4958cac6480e/disk 1073741824" returned: 0 in 0.052s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:48:56 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-9c9d2ab2-ab73-4cb8-bb8e-e7f1a0b80fc8 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Lock "4f30e3fe703d2381679612a57b1fb80a467f60b6" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.265s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:48:56 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-9c9d2ab2-ab73-4cb8-bb8e-e7f1a0b80fc8 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6 --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:48:56 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-9c9d2ab2-ab73-4cb8-bb8e-e7f1a0b80fc8 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6 --force-share --output=json" returned: 0 in 0.219s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:48:56 user nova-compute[75229]: DEBUG nova.virt.disk.api [None req-9c9d2ab2-ab73-4cb8-bb8e-e7f1a0b80fc8 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b5170e9e-66e3-4df1-9807-4958cac6480e/disk. size=1073741824 {{(pid=75229) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 09:48:56 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-9c9d2ab2-ab73-4cb8-bb8e-e7f1a0b80fc8 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5170e9e-66e3-4df1-9807-4958cac6480e/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:48:56 user nova-compute[75229]: DEBUG nova.network.neutron [None req-2552574c-7261-4457-825c-8a3e4e8e59da tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] [instance: 4c9fe69e-3f9d-4b30-a9e4-efc3e83efa17] Successfully updated port: 235153d6-63c1-44d2-97cc-c083544e6790 {{(pid=75229) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 09:48:56 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-2552574c-7261-4457-825c-8a3e4e8e59da tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Acquiring lock "refresh_cache-4c9fe69e-3f9d-4b30-a9e4-efc3e83efa17" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 09:48:56 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-2552574c-7261-4457-825c-8a3e4e8e59da tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Acquired lock "refresh_cache-4c9fe69e-3f9d-4b30-a9e4-efc3e83efa17" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 09:48:56 user nova-compute[75229]: DEBUG nova.network.neutron [None req-2552574c-7261-4457-825c-8a3e4e8e59da tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] [instance: 4c9fe69e-3f9d-4b30-a9e4-efc3e83efa17] Building network info cache for instance {{(pid=75229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 09:48:56 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-9c9d2ab2-ab73-4cb8-bb8e-e7f1a0b80fc8 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5170e9e-66e3-4df1-9807-4958cac6480e/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:48:56 user nova-compute[75229]: DEBUG nova.virt.disk.api [None req-9c9d2ab2-ab73-4cb8-bb8e-e7f1a0b80fc8 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Cannot resize image /opt/stack/data/nova/instances/b5170e9e-66e3-4df1-9807-4958cac6480e/disk to a smaller size. {{(pid=75229) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 09:48:56 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-9c9d2ab2-ab73-4cb8-bb8e-e7f1a0b80fc8 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] [instance: b5170e9e-66e3-4df1-9807-4958cac6480e] Created local disks {{(pid=75229) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 09:48:56 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-9c9d2ab2-ab73-4cb8-bb8e-e7f1a0b80fc8 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] [instance: b5170e9e-66e3-4df1-9807-4958cac6480e] Ensure instance console log exists: /opt/stack/data/nova/instances/b5170e9e-66e3-4df1-9807-4958cac6480e/console.log {{(pid=75229) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 09:48:56 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-9c9d2ab2-ab73-4cb8-bb8e-e7f1a0b80fc8 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:48:56 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-9c9d2ab2-ab73-4cb8-bb8e-e7f1a0b80fc8 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:48:56 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-9c9d2ab2-ab73-4cb8-bb8e-e7f1a0b80fc8 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:48:56 user nova-compute[75229]: DEBUG nova.compute.manager [req-7e33d296-8e29-4935-a7ed-e338856b2c1d req-6b6e2c95-5e64-40f6-ad82-c524c42bfe60 service nova] [instance: 4c9fe69e-3f9d-4b30-a9e4-efc3e83efa17] Received event network-changed-235153d6-63c1-44d2-97cc-c083544e6790 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:48:56 user nova-compute[75229]: DEBUG nova.compute.manager [req-7e33d296-8e29-4935-a7ed-e338856b2c1d req-6b6e2c95-5e64-40f6-ad82-c524c42bfe60 service nova] [instance: 4c9fe69e-3f9d-4b30-a9e4-efc3e83efa17] Refreshing instance network info cache due to event network-changed-235153d6-63c1-44d2-97cc-c083544e6790. {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 09:48:56 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-7e33d296-8e29-4935-a7ed-e338856b2c1d req-6b6e2c95-5e64-40f6-ad82-c524c42bfe60 service nova] Acquiring lock "refresh_cache-4c9fe69e-3f9d-4b30-a9e4-efc3e83efa17" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 09:48:56 user nova-compute[75229]: DEBUG nova.network.neutron [None req-2552574c-7261-4457-825c-8a3e4e8e59da tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] [instance: 4c9fe69e-3f9d-4b30-a9e4-efc3e83efa17] Instance cache missing network info. {{(pid=75229) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 09:48:57 user nova-compute[75229]: DEBUG nova.network.neutron [None req-9c9d2ab2-ab73-4cb8-bb8e-e7f1a0b80fc8 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] [instance: b5170e9e-66e3-4df1-9807-4958cac6480e] Successfully updated port: bed3fc1c-227e-44d2-85e1-589501a2e9dc {{(pid=75229) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 09:48:57 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-9c9d2ab2-ab73-4cb8-bb8e-e7f1a0b80fc8 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Acquiring lock "refresh_cache-b5170e9e-66e3-4df1-9807-4958cac6480e" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 09:48:57 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-9c9d2ab2-ab73-4cb8-bb8e-e7f1a0b80fc8 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Acquired lock "refresh_cache-b5170e9e-66e3-4df1-9807-4958cac6480e" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 09:48:57 user nova-compute[75229]: DEBUG nova.network.neutron [None req-9c9d2ab2-ab73-4cb8-bb8e-e7f1a0b80fc8 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] [instance: b5170e9e-66e3-4df1-9807-4958cac6480e] Building network info cache for instance {{(pid=75229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 09:48:57 user nova-compute[75229]: DEBUG nova.network.neutron [None req-2552574c-7261-4457-825c-8a3e4e8e59da tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] [instance: 4c9fe69e-3f9d-4b30-a9e4-efc3e83efa17] Updating instance_info_cache with network_info: [{"id": "235153d6-63c1-44d2-97cc-c083544e6790", "address": "fa:16:3e:a0:db:35", "network": {"id": "22eed29e-7148-42f9-b4c7-b97811cba8eb", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2000485731-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46457b27e3ed416e827c3c22449fb512", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap235153d6-63", "ovs_interfaceid": "235153d6-63c1-44d2-97cc-c083544e6790", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 09:48:57 user nova-compute[75229]: DEBUG nova.compute.manager [req-ef48da68-631b-4a4b-ba92-464e5c1c4a93 req-70cfd699-c464-4c21-a1c2-c5faee4f7116 service nova] [instance: b5170e9e-66e3-4df1-9807-4958cac6480e] Received event network-changed-bed3fc1c-227e-44d2-85e1-589501a2e9dc {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:48:57 user nova-compute[75229]: DEBUG nova.compute.manager [req-ef48da68-631b-4a4b-ba92-464e5c1c4a93 req-70cfd699-c464-4c21-a1c2-c5faee4f7116 service nova] [instance: b5170e9e-66e3-4df1-9807-4958cac6480e] Refreshing instance network info cache due to event network-changed-bed3fc1c-227e-44d2-85e1-589501a2e9dc. {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 09:48:57 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-ef48da68-631b-4a4b-ba92-464e5c1c4a93 req-70cfd699-c464-4c21-a1c2-c5faee4f7116 service nova] Acquiring lock "refresh_cache-b5170e9e-66e3-4df1-9807-4958cac6480e" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 09:48:57 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-2552574c-7261-4457-825c-8a3e4e8e59da tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Releasing lock "refresh_cache-4c9fe69e-3f9d-4b30-a9e4-efc3e83efa17" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 09:48:57 user nova-compute[75229]: DEBUG nova.compute.manager [None req-2552574c-7261-4457-825c-8a3e4e8e59da tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] [instance: 4c9fe69e-3f9d-4b30-a9e4-efc3e83efa17] Instance network_info: |[{"id": "235153d6-63c1-44d2-97cc-c083544e6790", "address": "fa:16:3e:a0:db:35", "network": {"id": "22eed29e-7148-42f9-b4c7-b97811cba8eb", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2000485731-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46457b27e3ed416e827c3c22449fb512", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap235153d6-63", "ovs_interfaceid": "235153d6-63c1-44d2-97cc-c083544e6790", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75229) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 09:48:57 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-7e33d296-8e29-4935-a7ed-e338856b2c1d req-6b6e2c95-5e64-40f6-ad82-c524c42bfe60 service nova] Acquired lock "refresh_cache-4c9fe69e-3f9d-4b30-a9e4-efc3e83efa17" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 09:48:57 user nova-compute[75229]: DEBUG nova.network.neutron [req-7e33d296-8e29-4935-a7ed-e338856b2c1d req-6b6e2c95-5e64-40f6-ad82-c524c42bfe60 service nova] [instance: 4c9fe69e-3f9d-4b30-a9e4-efc3e83efa17] Refreshing network info cache for port 235153d6-63c1-44d2-97cc-c083544e6790 {{(pid=75229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 09:48:57 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-2552574c-7261-4457-825c-8a3e4e8e59da tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] [instance: 4c9fe69e-3f9d-4b30-a9e4-efc3e83efa17] Start _get_guest_xml network_info=[{"id": "235153d6-63c1-44d2-97cc-c083544e6790", "address": "fa:16:3e:a0:db:35", "network": {"id": "22eed29e-7148-42f9-b4c7-b97811cba8eb", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2000485731-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46457b27e3ed416e827c3c22449fb512", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap235153d6-63", "ovs_interfaceid": "235153d6-63c1-44d2-97cc-c083544e6790", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T09:40:10Z,direct_url=<?>,disk_format='qcow2',id=3bef8470-ecc7-40e3-95d4-9254348ea72d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='de5a91106b6948ed937a7178ff9464c4',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T09:40:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'disk_bus': 'virtio', 'guest_format': None, 'encryption_secret_uuid': None, 'size': 0, 'device_type': 'disk', 'image_id': '3bef8470-ecc7-40e3-95d4-9254348ea72d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75229) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 09:48:57 user nova-compute[75229]: WARNING nova.virt.libvirt.driver [None req-2552574c-7261-4457-825c-8a3e4e8e59da tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 09:48:57 user nova-compute[75229]: WARNING nova.virt.libvirt.driver [None req-2552574c-7261-4457-825c-8a3e4e8e59da tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 09:48:57 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-2552574c-7261-4457-825c-8a3e4e8e59da tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75229) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 09:48:57 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-2552574c-7261-4457-825c-8a3e4e8e59da tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] CPU controller missing on host. {{(pid=75229) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 09:48:57 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-2552574c-7261-4457-825c-8a3e4e8e59da tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75229) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 09:48:57 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-2552574c-7261-4457-825c-8a3e4e8e59da tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] CPU controller found on host. {{(pid=75229) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 09:48:57 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-2552574c-7261-4457-825c-8a3e4e8e59da tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75229) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 09:48:57 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-2552574c-7261-4457-825c-8a3e4e8e59da tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T09:39:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T09:40:10Z,direct_url=<?>,disk_format='qcow2',id=3bef8470-ecc7-40e3-95d4-9254348ea72d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='de5a91106b6948ed937a7178ff9464c4',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T09:40:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 09:48:57 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-2552574c-7261-4457-825c-8a3e4e8e59da tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Flavor limits 0:0:0 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 09:48:57 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-2552574c-7261-4457-825c-8a3e4e8e59da tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Image limits 0:0:0 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 09:48:57 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-2552574c-7261-4457-825c-8a3e4e8e59da tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Flavor pref 0:0:0 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 09:48:57 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-2552574c-7261-4457-825c-8a3e4e8e59da tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Image pref 0:0:0 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 09:48:57 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-2552574c-7261-4457-825c-8a3e4e8e59da tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 09:48:57 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-2552574c-7261-4457-825c-8a3e4e8e59da tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 09:48:57 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-2552574c-7261-4457-825c-8a3e4e8e59da tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75229) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 09:48:57 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-2552574c-7261-4457-825c-8a3e4e8e59da tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Got 1 possible topologies {{(pid=75229) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 09:48:57 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-2552574c-7261-4457-825c-8a3e4e8e59da tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 09:48:57 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-2552574c-7261-4457-825c-8a3e4e8e59da tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 09:48:57 user nova-compute[75229]: DEBUG nova.virt.libvirt.vif [None req-2552574c-7261-4457-825c-8a3e4e8e59da tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T09:48:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-2544538',display_name='tempest-ServerRescueNegativeTestJSON-server-2544538',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-2544538',id=18,image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='46457b27e3ed416e827c3c22449fb512',ramdisk_id='',reservation_id='r-4gsrvn1y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-557279920',owner_user_name='tempest-ServerRescueNegativeTestJSON-557279920-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T09:48:55Z,user_data=None,user_id='a3cb33a5c522499e8cd254edd5e15879',uuid=4c9fe69e-3f9d-4b30-a9e4-efc3e83efa17,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "235153d6-63c1-44d2-97cc-c083544e6790", "address": "fa:16:3e:a0:db:35", "network": {"id": "22eed29e-7148-42f9-b4c7-b97811cba8eb", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2000485731-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46457b27e3ed416e827c3c22449fb512", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap235153d6-63", "ovs_interfaceid": "235153d6-63c1-44d2-97cc-c083544e6790", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75229) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 09:48:57 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-2552574c-7261-4457-825c-8a3e4e8e59da tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Converting VIF {"id": "235153d6-63c1-44d2-97cc-c083544e6790", "address": "fa:16:3e:a0:db:35", "network": {"id": "22eed29e-7148-42f9-b4c7-b97811cba8eb", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2000485731-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46457b27e3ed416e827c3c22449fb512", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap235153d6-63", "ovs_interfaceid": "235153d6-63c1-44d2-97cc-c083544e6790", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 09:48:57 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-2552574c-7261-4457-825c-8a3e4e8e59da tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a0:db:35,bridge_name='br-int',has_traffic_filtering=True,id=235153d6-63c1-44d2-97cc-c083544e6790,network=Network(22eed29e-7148-42f9-b4c7-b97811cba8eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap235153d6-63') {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 09:48:57 user nova-compute[75229]: DEBUG nova.objects.instance [None req-2552574c-7261-4457-825c-8a3e4e8e59da tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Lazy-loading 'pci_devices' on Instance uuid 4c9fe69e-3f9d-4b30-a9e4-efc3e83efa17 {{(pid=75229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 09:48:57 user nova-compute[75229]: DEBUG nova.network.neutron [None req-9c9d2ab2-ab73-4cb8-bb8e-e7f1a0b80fc8 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] [instance: b5170e9e-66e3-4df1-9807-4958cac6480e] Instance cache missing network info. {{(pid=75229) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 09:48:57 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-2552574c-7261-4457-825c-8a3e4e8e59da tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] [instance: 4c9fe69e-3f9d-4b30-a9e4-efc3e83efa17] End _get_guest_xml xml=<domain type="kvm">
Nov 14 09:48:57 user nova-compute[75229]:   <uuid>4c9fe69e-3f9d-4b30-a9e4-efc3e83efa17</uuid>
Nov 14 09:48:57 user nova-compute[75229]:   <name>instance-00000012</name>
Nov 14 09:48:57 user nova-compute[75229]:   <memory>524288</memory>
Nov 14 09:48:57 user nova-compute[75229]:   <vcpu>1</vcpu>
Nov 14 09:48:57 user nova-compute[75229]:   <metadata>
Nov 14 09:48:57 user nova-compute[75229]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 09:48:57 user nova-compute[75229]:       <nova:package version="0.0.0"/>
Nov 14 09:48:57 user nova-compute[75229]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-2544538</nova:name>
Nov 14 09:48:57 user nova-compute[75229]:       <nova:creationTime>2023-11-14 09:48:57</nova:creationTime>
Nov 14 09:48:57 user nova-compute[75229]:       <nova:flavor name="m1.tiny">
Nov 14 09:48:57 user nova-compute[75229]:         <nova:memory>512</nova:memory>
Nov 14 09:48:57 user nova-compute[75229]:         <nova:disk>1</nova:disk>
Nov 14 09:48:57 user nova-compute[75229]:         <nova:swap>0</nova:swap>
Nov 14 09:48:57 user nova-compute[75229]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 09:48:57 user nova-compute[75229]:         <nova:vcpus>1</nova:vcpus>
Nov 14 09:48:57 user nova-compute[75229]:       </nova:flavor>
Nov 14 09:48:57 user nova-compute[75229]:       <nova:owner>
Nov 14 09:48:57 user nova-compute[75229]:         <nova:user uuid="a3cb33a5c522499e8cd254edd5e15879">tempest-ServerRescueNegativeTestJSON-557279920-project-member</nova:user>
Nov 14 09:48:57 user nova-compute[75229]:         <nova:project uuid="46457b27e3ed416e827c3c22449fb512">tempest-ServerRescueNegativeTestJSON-557279920</nova:project>
Nov 14 09:48:57 user nova-compute[75229]:       </nova:owner>
Nov 14 09:48:57 user nova-compute[75229]:       <nova:root type="image" uuid="3bef8470-ecc7-40e3-95d4-9254348ea72d"/>
Nov 14 09:48:57 user nova-compute[75229]:       <nova:ports>
Nov 14 09:48:57 user nova-compute[75229]:         <nova:port uuid="235153d6-63c1-44d2-97cc-c083544e6790">
Nov 14 09:48:57 user nova-compute[75229]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 14 09:48:57 user nova-compute[75229]:         </nova:port>
Nov 14 09:48:57 user nova-compute[75229]:       </nova:ports>
Nov 14 09:48:57 user nova-compute[75229]:     </nova:instance>
Nov 14 09:48:57 user nova-compute[75229]:   </metadata>
Nov 14 09:48:57 user nova-compute[75229]:   <sysinfo type="smbios">
Nov 14 09:48:57 user nova-compute[75229]:     <system>
Nov 14 09:48:57 user nova-compute[75229]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 09:48:57 user nova-compute[75229]:       <entry name="product">OpenStack Nova</entry>
Nov 14 09:48:57 user nova-compute[75229]:       <entry name="version">0.0.0</entry>
Nov 14 09:48:57 user nova-compute[75229]:       <entry name="serial">4c9fe69e-3f9d-4b30-a9e4-efc3e83efa17</entry>
Nov 14 09:48:57 user nova-compute[75229]:       <entry name="uuid">4c9fe69e-3f9d-4b30-a9e4-efc3e83efa17</entry>
Nov 14 09:48:57 user nova-compute[75229]:       <entry name="family">Virtual Machine</entry>
Nov 14 09:48:57 user nova-compute[75229]:     </system>
Nov 14 09:48:57 user nova-compute[75229]:   </sysinfo>
Nov 14 09:48:57 user nova-compute[75229]:   <os>
Nov 14 09:48:57 user nova-compute[75229]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 09:48:57 user nova-compute[75229]:     <boot dev="hd"/>
Nov 14 09:48:57 user nova-compute[75229]:     <smbios mode="sysinfo"/>
Nov 14 09:48:57 user nova-compute[75229]:   </os>
Nov 14 09:48:57 user nova-compute[75229]:   <features>
Nov 14 09:48:57 user nova-compute[75229]:     <acpi/>
Nov 14 09:48:57 user nova-compute[75229]:     <apic/>
Nov 14 09:48:57 user nova-compute[75229]:     <vmcoreinfo/>
Nov 14 09:48:57 user nova-compute[75229]:   </features>
Nov 14 09:48:57 user nova-compute[75229]:   <clock offset="utc">
Nov 14 09:48:57 user nova-compute[75229]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 09:48:57 user nova-compute[75229]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 09:48:57 user nova-compute[75229]:     <timer name="hpet" present="no"/>
Nov 14 09:48:57 user nova-compute[75229]:   </clock>
Nov 14 09:48:57 user nova-compute[75229]:   <cpu mode="custom" match="exact">
Nov 14 09:48:57 user nova-compute[75229]:     <model>Nehalem</model>
Nov 14 09:48:57 user nova-compute[75229]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 09:48:57 user nova-compute[75229]:   </cpu>
Nov 14 09:48:57 user nova-compute[75229]:   <devices>
Nov 14 09:48:57 user nova-compute[75229]:     <disk type="file" device="disk">
Nov 14 09:48:57 user nova-compute[75229]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 09:48:57 user nova-compute[75229]:       <source file="/opt/stack/data/nova/instances/4c9fe69e-3f9d-4b30-a9e4-efc3e83efa17/disk"/>
Nov 14 09:48:57 user nova-compute[75229]:       <target dev="vda" bus="virtio"/>
Nov 14 09:48:57 user nova-compute[75229]:     </disk>
Nov 14 09:48:57 user nova-compute[75229]:     <interface type="ethernet">
Nov 14 09:48:57 user nova-compute[75229]:       <mac address="fa:16:3e:a0:db:35"/>
Nov 14 09:48:57 user nova-compute[75229]:       <model type="virtio"/>
Nov 14 09:48:57 user nova-compute[75229]:       <mtu size="1442"/>
Nov 14 09:48:57 user nova-compute[75229]:       <target dev="tap235153d6-63"/>
Nov 14 09:48:57 user nova-compute[75229]:     </interface>
Nov 14 09:48:57 user nova-compute[75229]:     <serial type="pty">
Nov 14 09:48:57 user nova-compute[75229]:       <log file="/opt/stack/data/nova/instances/4c9fe69e-3f9d-4b30-a9e4-efc3e83efa17/console.log" append="off"/>
Nov 14 09:48:57 user nova-compute[75229]:     </serial>
Nov 14 09:48:57 user nova-compute[75229]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 09:48:57 user nova-compute[75229]:     <video>
Nov 14 09:48:57 user nova-compute[75229]:       <model type="virtio"/>
Nov 14 09:48:57 user nova-compute[75229]:     </video>
Nov 14 09:48:57 user nova-compute[75229]:     <rng model="virtio">
Nov 14 09:48:57 user nova-compute[75229]:       <backend model="random">/dev/urandom</backend>
Nov 14 09:48:57 user nova-compute[75229]:     </rng>
Nov 14 09:48:57 user nova-compute[75229]:     <controller type="usb" index="0" model="none"/>
Nov 14 09:48:57 user nova-compute[75229]:     <memballoon model="virtio">
Nov 14 09:48:57 user nova-compute[75229]:       <stats period="10"/>
Nov 14 09:48:57 user nova-compute[75229]:     </memballoon>
Nov 14 09:48:57 user nova-compute[75229]:   </devices>
Nov 14 09:48:57 user nova-compute[75229]: </domain>
Nov 14 09:48:57 user nova-compute[75229]:  {{(pid=75229) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 09:48:57 user nova-compute[75229]: DEBUG nova.virt.libvirt.vif [None req-2552574c-7261-4457-825c-8a3e4e8e59da tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T09:48:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-2544538',display_name='tempest-ServerRescueNegativeTestJSON-server-2544538',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-2544538',id=18,image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='46457b27e3ed416e827c3c22449fb512',ramdisk_id='',reservation_id='r-4gsrvn1y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-557279920',owner_user_name='tempest-ServerRescueNegativeTestJSON-557279920-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T09:48:55Z,user_data=None,user_id='a3cb33a5c522499e8cd254edd5e15879',uuid=4c9fe69e-3f9d-4b30-a9e4-efc3e83efa17,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "235153d6-63c1-44d2-97cc-c083544e6790", "address": "fa:16:3e:a0:db:35", "network": {"id": "22eed29e-7148-42f9-b4c7-b97811cba8eb", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2000485731-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46457b27e3ed416e827c3c22449fb512", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap235153d6-63", "ovs_interfaceid": "235153d6-63c1-44d2-97cc-c083544e6790", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 09:48:57 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-2552574c-7261-4457-825c-8a3e4e8e59da tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Converting VIF {"id": "235153d6-63c1-44d2-97cc-c083544e6790", "address": "fa:16:3e:a0:db:35", "network": {"id": "22eed29e-7148-42f9-b4c7-b97811cba8eb", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2000485731-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46457b27e3ed416e827c3c22449fb512", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap235153d6-63", "ovs_interfaceid": "235153d6-63c1-44d2-97cc-c083544e6790", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 09:48:57 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-2552574c-7261-4457-825c-8a3e4e8e59da tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a0:db:35,bridge_name='br-int',has_traffic_filtering=True,id=235153d6-63c1-44d2-97cc-c083544e6790,network=Network(22eed29e-7148-42f9-b4c7-b97811cba8eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap235153d6-63') {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 09:48:57 user nova-compute[75229]: DEBUG os_vif [None req-2552574c-7261-4457-825c-8a3e4e8e59da tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a0:db:35,bridge_name='br-int',has_traffic_filtering=True,id=235153d6-63c1-44d2-97cc-c083544e6790,network=Network(22eed29e-7148-42f9-b4c7-b97811cba8eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap235153d6-63') {{(pid=75229) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 09:48:57 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:48:57 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:48:57 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 09:48:57 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:48:57 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f416e7d6-0f4a-5568-99c1-cf909d864bc9', '_type': 'linux-noop'}}, row=False) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:48:57 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:48:57 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 09:48:57 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:48:57 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap235153d6-63, may_exist=True, interface_attrs={}) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:48:57 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap235153d6-63, col_values=(('qos', UUID('fb885958-d330-43dc-b513-6ced03845c0b')),), if_exists=True) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:48:57 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap235153d6-63, col_values=(('external_ids', {'iface-id': '235153d6-63c1-44d2-97cc-c083544e6790', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a0:db:35', 'vm-uuid': '4c9fe69e-3f9d-4b30-a9e4-efc3e83efa17'}),), if_exists=True) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:48:57 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:48:57 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 09:48:57 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:48:57 user nova-compute[75229]: INFO os_vif [None req-2552574c-7261-4457-825c-8a3e4e8e59da tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a0:db:35,bridge_name='br-int',has_traffic_filtering=True,id=235153d6-63c1-44d2-97cc-c083544e6790,network=Network(22eed29e-7148-42f9-b4c7-b97811cba8eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap235153d6-63')
Nov 14 09:48:57 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-2552574c-7261-4457-825c-8a3e4e8e59da tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] No BDM found with device name vda, not building metadata. {{(pid=75229) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 09:48:57 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-2552574c-7261-4457-825c-8a3e4e8e59da tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] No VIF found with MAC fa:16:3e:a0:db:35, not building metadata {{(pid=75229) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 09:48:57 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:48:57 user nova-compute[75229]: DEBUG nova.network.neutron [None req-9c9d2ab2-ab73-4cb8-bb8e-e7f1a0b80fc8 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] [instance: b5170e9e-66e3-4df1-9807-4958cac6480e] Updating instance_info_cache with network_info: [{"id": "bed3fc1c-227e-44d2-85e1-589501a2e9dc", "address": "fa:16:3e:26:85:42", "network": {"id": "22eed29e-7148-42f9-b4c7-b97811cba8eb", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2000485731-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46457b27e3ed416e827c3c22449fb512", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbed3fc1c-22", "ovs_interfaceid": "bed3fc1c-227e-44d2-85e1-589501a2e9dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 09:48:57 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-9c9d2ab2-ab73-4cb8-bb8e-e7f1a0b80fc8 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Releasing lock "refresh_cache-b5170e9e-66e3-4df1-9807-4958cac6480e" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 09:48:57 user nova-compute[75229]: DEBUG nova.compute.manager [None req-9c9d2ab2-ab73-4cb8-bb8e-e7f1a0b80fc8 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] [instance: b5170e9e-66e3-4df1-9807-4958cac6480e] Instance network_info: |[{"id": "bed3fc1c-227e-44d2-85e1-589501a2e9dc", "address": "fa:16:3e:26:85:42", "network": {"id": "22eed29e-7148-42f9-b4c7-b97811cba8eb", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2000485731-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46457b27e3ed416e827c3c22449fb512", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbed3fc1c-22", "ovs_interfaceid": "bed3fc1c-227e-44d2-85e1-589501a2e9dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75229) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 09:48:57 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-ef48da68-631b-4a4b-ba92-464e5c1c4a93 req-70cfd699-c464-4c21-a1c2-c5faee4f7116 service nova] Acquired lock "refresh_cache-b5170e9e-66e3-4df1-9807-4958cac6480e" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 09:48:57 user nova-compute[75229]: DEBUG nova.network.neutron [req-ef48da68-631b-4a4b-ba92-464e5c1c4a93 req-70cfd699-c464-4c21-a1c2-c5faee4f7116 service nova] [instance: b5170e9e-66e3-4df1-9807-4958cac6480e] Refreshing network info cache for port bed3fc1c-227e-44d2-85e1-589501a2e9dc {{(pid=75229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 09:48:57 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-9c9d2ab2-ab73-4cb8-bb8e-e7f1a0b80fc8 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] [instance: b5170e9e-66e3-4df1-9807-4958cac6480e] Start _get_guest_xml network_info=[{"id": "bed3fc1c-227e-44d2-85e1-589501a2e9dc", "address": "fa:16:3e:26:85:42", "network": {"id": "22eed29e-7148-42f9-b4c7-b97811cba8eb", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2000485731-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46457b27e3ed416e827c3c22449fb512", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbed3fc1c-22", "ovs_interfaceid": "bed3fc1c-227e-44d2-85e1-589501a2e9dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T09:40:10Z,direct_url=<?>,disk_format='qcow2',id=3bef8470-ecc7-40e3-95d4-9254348ea72d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='de5a91106b6948ed937a7178ff9464c4',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T09:40:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'disk_bus': 'virtio', 'guest_format': None, 'encryption_secret_uuid': None, 'size': 0, 'device_type': 'disk', 'image_id': '3bef8470-ecc7-40e3-95d4-9254348ea72d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75229) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 09:48:57 user nova-compute[75229]: DEBUG nova.network.neutron [req-7e33d296-8e29-4935-a7ed-e338856b2c1d req-6b6e2c95-5e64-40f6-ad82-c524c42bfe60 service nova] [instance: 4c9fe69e-3f9d-4b30-a9e4-efc3e83efa17] Updated VIF entry in instance network info cache for port 235153d6-63c1-44d2-97cc-c083544e6790. {{(pid=75229) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 09:48:58 user nova-compute[75229]: DEBUG nova.network.neutron [req-7e33d296-8e29-4935-a7ed-e338856b2c1d req-6b6e2c95-5e64-40f6-ad82-c524c42bfe60 service nova] [instance: 4c9fe69e-3f9d-4b30-a9e4-efc3e83efa17] Updating instance_info_cache with network_info: [{"id": "235153d6-63c1-44d2-97cc-c083544e6790", "address": "fa:16:3e:a0:db:35", "network": {"id": "22eed29e-7148-42f9-b4c7-b97811cba8eb", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2000485731-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46457b27e3ed416e827c3c22449fb512", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap235153d6-63", "ovs_interfaceid": "235153d6-63c1-44d2-97cc-c083544e6790", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 09:48:58 user nova-compute[75229]: WARNING nova.virt.libvirt.driver [None req-9c9d2ab2-ab73-4cb8-bb8e-e7f1a0b80fc8 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 09:48:58 user nova-compute[75229]: WARNING nova.virt.libvirt.driver [None req-9c9d2ab2-ab73-4cb8-bb8e-e7f1a0b80fc8 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 09:48:58 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-7e33d296-8e29-4935-a7ed-e338856b2c1d req-6b6e2c95-5e64-40f6-ad82-c524c42bfe60 service nova] Releasing lock "refresh_cache-4c9fe69e-3f9d-4b30-a9e4-efc3e83efa17" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 09:48:58 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-9c9d2ab2-ab73-4cb8-bb8e-e7f1a0b80fc8 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75229) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 09:48:58 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-9c9d2ab2-ab73-4cb8-bb8e-e7f1a0b80fc8 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] CPU controller missing on host. {{(pid=75229) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 09:48:58 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-9c9d2ab2-ab73-4cb8-bb8e-e7f1a0b80fc8 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75229) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 09:48:58 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-9c9d2ab2-ab73-4cb8-bb8e-e7f1a0b80fc8 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] CPU controller found on host. {{(pid=75229) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 09:48:58 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-9c9d2ab2-ab73-4cb8-bb8e-e7f1a0b80fc8 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75229) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 09:48:58 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-9c9d2ab2-ab73-4cb8-bb8e-e7f1a0b80fc8 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T09:39:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T09:40:10Z,direct_url=<?>,disk_format='qcow2',id=3bef8470-ecc7-40e3-95d4-9254348ea72d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='de5a91106b6948ed937a7178ff9464c4',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T09:40:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 09:48:58 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-9c9d2ab2-ab73-4cb8-bb8e-e7f1a0b80fc8 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Flavor limits 0:0:0 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 09:48:58 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-9c9d2ab2-ab73-4cb8-bb8e-e7f1a0b80fc8 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Image limits 0:0:0 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 09:48:58 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-9c9d2ab2-ab73-4cb8-bb8e-e7f1a0b80fc8 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Flavor pref 0:0:0 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 09:48:58 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-9c9d2ab2-ab73-4cb8-bb8e-e7f1a0b80fc8 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Image pref 0:0:0 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 09:48:58 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-9c9d2ab2-ab73-4cb8-bb8e-e7f1a0b80fc8 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 09:48:58 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-9c9d2ab2-ab73-4cb8-bb8e-e7f1a0b80fc8 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 09:48:58 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-9c9d2ab2-ab73-4cb8-bb8e-e7f1a0b80fc8 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75229) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 09:48:58 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-9c9d2ab2-ab73-4cb8-bb8e-e7f1a0b80fc8 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Got 1 possible topologies {{(pid=75229) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 09:48:58 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-9c9d2ab2-ab73-4cb8-bb8e-e7f1a0b80fc8 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 09:48:58 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-9c9d2ab2-ab73-4cb8-bb8e-e7f1a0b80fc8 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 09:48:58 user nova-compute[75229]: DEBUG nova.virt.libvirt.vif [None req-9c9d2ab2-ab73-4cb8-bb8e-e7f1a0b80fc8 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T09:48:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-939346932',display_name='tempest-ServerRescueNegativeTestJSON-server-939346932',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-939346932',id=19,image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='46457b27e3ed416e827c3c22449fb512',ramdisk_id='',reservation_id='r-wp091n1y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-557279920',owner_user_name='tempest-ServerRescueNegativeTestJSON-557279920-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T09:48:56Z,user_data=None,user_id='a3cb33a5c522499e8cd254edd5e15879',uuid=b5170e9e-66e3-4df1-9807-4958cac6480e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bed3fc1c-227e-44d2-85e1-589501a2e9dc", "address": "fa:16:3e:26:85:42", "network": {"id": "22eed29e-7148-42f9-b4c7-b97811cba8eb", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2000485731-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46457b27e3ed416e827c3c22449fb512", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbed3fc1c-22", "ovs_interfaceid": "bed3fc1c-227e-44d2-85e1-589501a2e9dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75229) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 09:48:58 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-9c9d2ab2-ab73-4cb8-bb8e-e7f1a0b80fc8 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Converting VIF {"id": "bed3fc1c-227e-44d2-85e1-589501a2e9dc", "address": "fa:16:3e:26:85:42", "network": {"id": "22eed29e-7148-42f9-b4c7-b97811cba8eb", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2000485731-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46457b27e3ed416e827c3c22449fb512", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbed3fc1c-22", "ovs_interfaceid": "bed3fc1c-227e-44d2-85e1-589501a2e9dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 09:48:58 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-9c9d2ab2-ab73-4cb8-bb8e-e7f1a0b80fc8 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:26:85:42,bridge_name='br-int',has_traffic_filtering=True,id=bed3fc1c-227e-44d2-85e1-589501a2e9dc,network=Network(22eed29e-7148-42f9-b4c7-b97811cba8eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbed3fc1c-22') {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 09:48:58 user nova-compute[75229]: DEBUG nova.objects.instance [None req-9c9d2ab2-ab73-4cb8-bb8e-e7f1a0b80fc8 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Lazy-loading 'pci_devices' on Instance uuid b5170e9e-66e3-4df1-9807-4958cac6480e {{(pid=75229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 09:48:58 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-9c9d2ab2-ab73-4cb8-bb8e-e7f1a0b80fc8 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] [instance: b5170e9e-66e3-4df1-9807-4958cac6480e] End _get_guest_xml xml=<domain type="kvm">
Nov 14 09:48:58 user nova-compute[75229]:   <uuid>b5170e9e-66e3-4df1-9807-4958cac6480e</uuid>
Nov 14 09:48:58 user nova-compute[75229]:   <name>instance-00000013</name>
Nov 14 09:48:58 user nova-compute[75229]:   <memory>524288</memory>
Nov 14 09:48:58 user nova-compute[75229]:   <vcpu>1</vcpu>
Nov 14 09:48:58 user nova-compute[75229]:   <metadata>
Nov 14 09:48:58 user nova-compute[75229]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 09:48:58 user nova-compute[75229]:       <nova:package version="0.0.0"/>
Nov 14 09:48:58 user nova-compute[75229]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-939346932</nova:name>
Nov 14 09:48:58 user nova-compute[75229]:       <nova:creationTime>2023-11-14 09:48:58</nova:creationTime>
Nov 14 09:48:58 user nova-compute[75229]:       <nova:flavor name="m1.tiny">
Nov 14 09:48:58 user nova-compute[75229]:         <nova:memory>512</nova:memory>
Nov 14 09:48:58 user nova-compute[75229]:         <nova:disk>1</nova:disk>
Nov 14 09:48:58 user nova-compute[75229]:         <nova:swap>0</nova:swap>
Nov 14 09:48:58 user nova-compute[75229]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 09:48:58 user nova-compute[75229]:         <nova:vcpus>1</nova:vcpus>
Nov 14 09:48:58 user nova-compute[75229]:       </nova:flavor>
Nov 14 09:48:58 user nova-compute[75229]:       <nova:owner>
Nov 14 09:48:58 user nova-compute[75229]:         <nova:user uuid="a3cb33a5c522499e8cd254edd5e15879">tempest-ServerRescueNegativeTestJSON-557279920-project-member</nova:user>
Nov 14 09:48:58 user nova-compute[75229]:         <nova:project uuid="46457b27e3ed416e827c3c22449fb512">tempest-ServerRescueNegativeTestJSON-557279920</nova:project>
Nov 14 09:48:58 user nova-compute[75229]:       </nova:owner>
Nov 14 09:48:58 user nova-compute[75229]:       <nova:root type="image" uuid="3bef8470-ecc7-40e3-95d4-9254348ea72d"/>
Nov 14 09:48:58 user nova-compute[75229]:       <nova:ports>
Nov 14 09:48:58 user nova-compute[75229]:         <nova:port uuid="bed3fc1c-227e-44d2-85e1-589501a2e9dc">
Nov 14 09:48:58 user nova-compute[75229]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 14 09:48:58 user nova-compute[75229]:         </nova:port>
Nov 14 09:48:58 user nova-compute[75229]:       </nova:ports>
Nov 14 09:48:58 user nova-compute[75229]:     </nova:instance>
Nov 14 09:48:58 user nova-compute[75229]:   </metadata>
Nov 14 09:48:58 user nova-compute[75229]:   <sysinfo type="smbios">
Nov 14 09:48:58 user nova-compute[75229]:     <system>
Nov 14 09:48:58 user nova-compute[75229]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 09:48:58 user nova-compute[75229]:       <entry name="product">OpenStack Nova</entry>
Nov 14 09:48:58 user nova-compute[75229]:       <entry name="version">0.0.0</entry>
Nov 14 09:48:58 user nova-compute[75229]:       <entry name="serial">b5170e9e-66e3-4df1-9807-4958cac6480e</entry>
Nov 14 09:48:58 user nova-compute[75229]:       <entry name="uuid">b5170e9e-66e3-4df1-9807-4958cac6480e</entry>
Nov 14 09:48:58 user nova-compute[75229]:       <entry name="family">Virtual Machine</entry>
Nov 14 09:48:58 user nova-compute[75229]:     </system>
Nov 14 09:48:58 user nova-compute[75229]:   </sysinfo>
Nov 14 09:48:58 user nova-compute[75229]:   <os>
Nov 14 09:48:58 user nova-compute[75229]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 09:48:58 user nova-compute[75229]:     <boot dev="hd"/>
Nov 14 09:48:58 user nova-compute[75229]:     <smbios mode="sysinfo"/>
Nov 14 09:48:58 user nova-compute[75229]:   </os>
Nov 14 09:48:58 user nova-compute[75229]:   <features>
Nov 14 09:48:58 user nova-compute[75229]:     <acpi/>
Nov 14 09:48:58 user nova-compute[75229]:     <apic/>
Nov 14 09:48:58 user nova-compute[75229]:     <vmcoreinfo/>
Nov 14 09:48:58 user nova-compute[75229]:   </features>
Nov 14 09:48:58 user nova-compute[75229]:   <clock offset="utc">
Nov 14 09:48:58 user nova-compute[75229]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 09:48:58 user nova-compute[75229]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 09:48:58 user nova-compute[75229]:     <timer name="hpet" present="no"/>
Nov 14 09:48:58 user nova-compute[75229]:   </clock>
Nov 14 09:48:58 user nova-compute[75229]:   <cpu mode="custom" match="exact">
Nov 14 09:48:58 user nova-compute[75229]:     <model>Nehalem</model>
Nov 14 09:48:58 user nova-compute[75229]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 09:48:58 user nova-compute[75229]:   </cpu>
Nov 14 09:48:58 user nova-compute[75229]:   <devices>
Nov 14 09:48:58 user nova-compute[75229]:     <disk type="file" device="disk">
Nov 14 09:48:58 user nova-compute[75229]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 09:48:58 user nova-compute[75229]:       <source file="/opt/stack/data/nova/instances/b5170e9e-66e3-4df1-9807-4958cac6480e/disk"/>
Nov 14 09:48:58 user nova-compute[75229]:       <target dev="vda" bus="virtio"/>
Nov 14 09:48:58 user nova-compute[75229]:     </disk>
Nov 14 09:48:58 user nova-compute[75229]:     <interface type="ethernet">
Nov 14 09:48:58 user nova-compute[75229]:       <mac address="fa:16:3e:26:85:42"/>
Nov 14 09:48:58 user nova-compute[75229]:       <model type="virtio"/>
Nov 14 09:48:58 user nova-compute[75229]:       <mtu size="1442"/>
Nov 14 09:48:58 user nova-compute[75229]:       <target dev="tapbed3fc1c-22"/>
Nov 14 09:48:58 user nova-compute[75229]:     </interface>
Nov 14 09:48:58 user nova-compute[75229]:     <serial type="pty">
Nov 14 09:48:58 user nova-compute[75229]:       <log file="/opt/stack/data/nova/instances/b5170e9e-66e3-4df1-9807-4958cac6480e/console.log" append="off"/>
Nov 14 09:48:58 user nova-compute[75229]:     </serial>
Nov 14 09:48:58 user nova-compute[75229]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 09:48:58 user nova-compute[75229]:     <video>
Nov 14 09:48:58 user nova-compute[75229]:       <model type="virtio"/>
Nov 14 09:48:58 user nova-compute[75229]:     </video>
Nov 14 09:48:58 user nova-compute[75229]:     <rng model="virtio">
Nov 14 09:48:58 user nova-compute[75229]:       <backend model="random">/dev/urandom</backend>
Nov 14 09:48:58 user nova-compute[75229]:     </rng>
Nov 14 09:48:58 user nova-compute[75229]:     <controller type="usb" index="0" model="none"/>
Nov 14 09:48:58 user nova-compute[75229]:     <memballoon model="virtio">
Nov 14 09:48:58 user nova-compute[75229]:       <stats period="10"/>
Nov 14 09:48:58 user nova-compute[75229]:     </memballoon>
Nov 14 09:48:58 user nova-compute[75229]:   </devices>
Nov 14 09:48:58 user nova-compute[75229]: </domain>
Nov 14 09:48:58 user nova-compute[75229]:  {{(pid=75229) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 09:48:58 user nova-compute[75229]: DEBUG nova.virt.libvirt.vif [None req-9c9d2ab2-ab73-4cb8-bb8e-e7f1a0b80fc8 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T09:48:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-939346932',display_name='tempest-ServerRescueNegativeTestJSON-server-939346932',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-939346932',id=19,image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='46457b27e3ed416e827c3c22449fb512',ramdisk_id='',reservation_id='r-wp091n1y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-557279920',owner_user_name='tempest-ServerRescueNegativeTestJSON-557279920-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T09:48:56Z,user_data=None,user_id='a3cb33a5c522499e8cd254edd5e15879',uuid=b5170e9e-66e3-4df1-9807-4958cac6480e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bed3fc1c-227e-44d2-85e1-589501a2e9dc", "address": "fa:16:3e:26:85:42", "network": {"id": "22eed29e-7148-42f9-b4c7-b97811cba8eb", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2000485731-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46457b27e3ed416e827c3c22449fb512", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbed3fc1c-22", "ovs_interfaceid": "bed3fc1c-227e-44d2-85e1-589501a2e9dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 09:48:58 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-9c9d2ab2-ab73-4cb8-bb8e-e7f1a0b80fc8 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Converting VIF {"id": "bed3fc1c-227e-44d2-85e1-589501a2e9dc", "address": "fa:16:3e:26:85:42", "network": {"id": "22eed29e-7148-42f9-b4c7-b97811cba8eb", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2000485731-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46457b27e3ed416e827c3c22449fb512", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbed3fc1c-22", "ovs_interfaceid": "bed3fc1c-227e-44d2-85e1-589501a2e9dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 09:48:58 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-9c9d2ab2-ab73-4cb8-bb8e-e7f1a0b80fc8 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:26:85:42,bridge_name='br-int',has_traffic_filtering=True,id=bed3fc1c-227e-44d2-85e1-589501a2e9dc,network=Network(22eed29e-7148-42f9-b4c7-b97811cba8eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbed3fc1c-22') {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 09:48:58 user nova-compute[75229]: DEBUG os_vif [None req-9c9d2ab2-ab73-4cb8-bb8e-e7f1a0b80fc8 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:26:85:42,bridge_name='br-int',has_traffic_filtering=True,id=bed3fc1c-227e-44d2-85e1-589501a2e9dc,network=Network(22eed29e-7148-42f9-b4c7-b97811cba8eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbed3fc1c-22') {{(pid=75229) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 09:48:58 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:48:58 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:48:58 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 09:48:58 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:48:58 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b7c15161-5a90-5d3f-aad4-0ed90854ae27', '_type': 'linux-noop'}}, row=False) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:48:58 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:48:58 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 09:48:58 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:48:58 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:48:58 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbed3fc1c-22, may_exist=True, interface_attrs={}) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:48:58 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapbed3fc1c-22, col_values=(('qos', UUID('6b3f94b8-2469-4180-bd9b-e19e636a1b2a')),), if_exists=True) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:48:58 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapbed3fc1c-22, col_values=(('external_ids', {'iface-id': 'bed3fc1c-227e-44d2-85e1-589501a2e9dc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:26:85:42', 'vm-uuid': 'b5170e9e-66e3-4df1-9807-4958cac6480e'}),), if_exists=True) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:48:58 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:48:58 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 09:48:58 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:48:58 user nova-compute[75229]: INFO os_vif [None req-9c9d2ab2-ab73-4cb8-bb8e-e7f1a0b80fc8 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:26:85:42,bridge_name='br-int',has_traffic_filtering=True,id=bed3fc1c-227e-44d2-85e1-589501a2e9dc,network=Network(22eed29e-7148-42f9-b4c7-b97811cba8eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbed3fc1c-22')
Nov 14 09:48:58 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-9c9d2ab2-ab73-4cb8-bb8e-e7f1a0b80fc8 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] No BDM found with device name vda, not building metadata. {{(pid=75229) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 09:48:58 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-9c9d2ab2-ab73-4cb8-bb8e-e7f1a0b80fc8 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] No VIF found with MAC fa:16:3e:26:85:42, not building metadata {{(pid=75229) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 09:48:58 user nova-compute[75229]: DEBUG nova.network.neutron [req-ef48da68-631b-4a4b-ba92-464e5c1c4a93 req-70cfd699-c464-4c21-a1c2-c5faee4f7116 service nova] [instance: b5170e9e-66e3-4df1-9807-4958cac6480e] Updated VIF entry in instance network info cache for port bed3fc1c-227e-44d2-85e1-589501a2e9dc. {{(pid=75229) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 09:48:58 user nova-compute[75229]: DEBUG nova.network.neutron [req-ef48da68-631b-4a4b-ba92-464e5c1c4a93 req-70cfd699-c464-4c21-a1c2-c5faee4f7116 service nova] [instance: b5170e9e-66e3-4df1-9807-4958cac6480e] Updating instance_info_cache with network_info: [{"id": "bed3fc1c-227e-44d2-85e1-589501a2e9dc", "address": "fa:16:3e:26:85:42", "network": {"id": "22eed29e-7148-42f9-b4c7-b97811cba8eb", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2000485731-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46457b27e3ed416e827c3c22449fb512", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbed3fc1c-22", "ovs_interfaceid": "bed3fc1c-227e-44d2-85e1-589501a2e9dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 09:48:58 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-ef48da68-631b-4a4b-ba92-464e5c1c4a93 req-70cfd699-c464-4c21-a1c2-c5faee4f7116 service nova] Releasing lock "refresh_cache-b5170e9e-66e3-4df1-9807-4958cac6480e" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 09:49:00 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:49:00 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:49:00 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:49:00 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:49:00 user nova-compute[75229]: DEBUG nova.compute.manager [req-bfb7a1cf-06a0-4845-92d3-defc1b3b9213 req-9db3d274-3219-49dc-98ba-ad876287a2ed service nova] [instance: 4c9fe69e-3f9d-4b30-a9e4-efc3e83efa17] Received event network-vif-plugged-235153d6-63c1-44d2-97cc-c083544e6790 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:49:00 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-bfb7a1cf-06a0-4845-92d3-defc1b3b9213 req-9db3d274-3219-49dc-98ba-ad876287a2ed service nova] Acquiring lock "4c9fe69e-3f9d-4b30-a9e4-efc3e83efa17-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:49:00 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-bfb7a1cf-06a0-4845-92d3-defc1b3b9213 req-9db3d274-3219-49dc-98ba-ad876287a2ed service nova] Lock "4c9fe69e-3f9d-4b30-a9e4-efc3e83efa17-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:49:00 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-bfb7a1cf-06a0-4845-92d3-defc1b3b9213 req-9db3d274-3219-49dc-98ba-ad876287a2ed service nova] Lock "4c9fe69e-3f9d-4b30-a9e4-efc3e83efa17-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:49:00 user nova-compute[75229]: DEBUG nova.compute.manager [req-bfb7a1cf-06a0-4845-92d3-defc1b3b9213 req-9db3d274-3219-49dc-98ba-ad876287a2ed service nova] [instance: 4c9fe69e-3f9d-4b30-a9e4-efc3e83efa17] No waiting events found dispatching network-vif-plugged-235153d6-63c1-44d2-97cc-c083544e6790 {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 09:49:00 user nova-compute[75229]: WARNING nova.compute.manager [req-bfb7a1cf-06a0-4845-92d3-defc1b3b9213 req-9db3d274-3219-49dc-98ba-ad876287a2ed service nova] [instance: 4c9fe69e-3f9d-4b30-a9e4-efc3e83efa17] Received unexpected event network-vif-plugged-235153d6-63c1-44d2-97cc-c083544e6790 for instance with vm_state building and task_state spawning.
Nov 14 09:49:00 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:49:00 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:49:00 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:49:00 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:49:00 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:49:00 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:49:01 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:49:02 user nova-compute[75229]: DEBUG nova.compute.manager [req-3a6e7cf3-4275-4f83-8266-b98fd4062c5c req-fbec6108-755e-4063-9f36-1cf0e8c7c835 service nova] [instance: 4c9fe69e-3f9d-4b30-a9e4-efc3e83efa17] Received event network-vif-plugged-235153d6-63c1-44d2-97cc-c083544e6790 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:49:02 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-3a6e7cf3-4275-4f83-8266-b98fd4062c5c req-fbec6108-755e-4063-9f36-1cf0e8c7c835 service nova] Acquiring lock "4c9fe69e-3f9d-4b30-a9e4-efc3e83efa17-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:49:02 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-3a6e7cf3-4275-4f83-8266-b98fd4062c5c req-fbec6108-755e-4063-9f36-1cf0e8c7c835 service nova] Lock "4c9fe69e-3f9d-4b30-a9e4-efc3e83efa17-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:49:02 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-3a6e7cf3-4275-4f83-8266-b98fd4062c5c req-fbec6108-755e-4063-9f36-1cf0e8c7c835 service nova] Lock "4c9fe69e-3f9d-4b30-a9e4-efc3e83efa17-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:49:02 user nova-compute[75229]: DEBUG nova.compute.manager [req-3a6e7cf3-4275-4f83-8266-b98fd4062c5c req-fbec6108-755e-4063-9f36-1cf0e8c7c835 service nova] [instance: 4c9fe69e-3f9d-4b30-a9e4-efc3e83efa17] No waiting events found dispatching network-vif-plugged-235153d6-63c1-44d2-97cc-c083544e6790 {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 09:49:02 user nova-compute[75229]: WARNING nova.compute.manager [req-3a6e7cf3-4275-4f83-8266-b98fd4062c5c req-fbec6108-755e-4063-9f36-1cf0e8c7c835 service nova] [instance: 4c9fe69e-3f9d-4b30-a9e4-efc3e83efa17] Received unexpected event network-vif-plugged-235153d6-63c1-44d2-97cc-c083544e6790 for instance with vm_state building and task_state spawning.
Nov 14 09:49:02 user nova-compute[75229]: DEBUG nova.compute.manager [req-3a6e7cf3-4275-4f83-8266-b98fd4062c5c req-fbec6108-755e-4063-9f36-1cf0e8c7c835 service nova] [instance: b5170e9e-66e3-4df1-9807-4958cac6480e] Received event network-vif-plugged-bed3fc1c-227e-44d2-85e1-589501a2e9dc {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:49:02 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-3a6e7cf3-4275-4f83-8266-b98fd4062c5c req-fbec6108-755e-4063-9f36-1cf0e8c7c835 service nova] Acquiring lock "b5170e9e-66e3-4df1-9807-4958cac6480e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:49:02 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-3a6e7cf3-4275-4f83-8266-b98fd4062c5c req-fbec6108-755e-4063-9f36-1cf0e8c7c835 service nova] Lock "b5170e9e-66e3-4df1-9807-4958cac6480e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:49:02 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-3a6e7cf3-4275-4f83-8266-b98fd4062c5c req-fbec6108-755e-4063-9f36-1cf0e8c7c835 service nova] Lock "b5170e9e-66e3-4df1-9807-4958cac6480e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:49:02 user nova-compute[75229]: DEBUG nova.compute.manager [req-3a6e7cf3-4275-4f83-8266-b98fd4062c5c req-fbec6108-755e-4063-9f36-1cf0e8c7c835 service nova] [instance: b5170e9e-66e3-4df1-9807-4958cac6480e] No waiting events found dispatching network-vif-plugged-bed3fc1c-227e-44d2-85e1-589501a2e9dc {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 09:49:02 user nova-compute[75229]: WARNING nova.compute.manager [req-3a6e7cf3-4275-4f83-8266-b98fd4062c5c req-fbec6108-755e-4063-9f36-1cf0e8c7c835 service nova] [instance: b5170e9e-66e3-4df1-9807-4958cac6480e] Received unexpected event network-vif-plugged-bed3fc1c-227e-44d2-85e1-589501a2e9dc for instance with vm_state building and task_state spawning.
Nov 14 09:49:02 user nova-compute[75229]: DEBUG nova.compute.manager [req-3a6e7cf3-4275-4f83-8266-b98fd4062c5c req-fbec6108-755e-4063-9f36-1cf0e8c7c835 service nova] [instance: b5170e9e-66e3-4df1-9807-4958cac6480e] Received event network-vif-plugged-bed3fc1c-227e-44d2-85e1-589501a2e9dc {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:49:02 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-3a6e7cf3-4275-4f83-8266-b98fd4062c5c req-fbec6108-755e-4063-9f36-1cf0e8c7c835 service nova] Acquiring lock "b5170e9e-66e3-4df1-9807-4958cac6480e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:49:02 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-3a6e7cf3-4275-4f83-8266-b98fd4062c5c req-fbec6108-755e-4063-9f36-1cf0e8c7c835 service nova] Lock "b5170e9e-66e3-4df1-9807-4958cac6480e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:49:02 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-3a6e7cf3-4275-4f83-8266-b98fd4062c5c req-fbec6108-755e-4063-9f36-1cf0e8c7c835 service nova] Lock "b5170e9e-66e3-4df1-9807-4958cac6480e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:49:02 user nova-compute[75229]: DEBUG nova.compute.manager [req-3a6e7cf3-4275-4f83-8266-b98fd4062c5c req-fbec6108-755e-4063-9f36-1cf0e8c7c835 service nova] [instance: b5170e9e-66e3-4df1-9807-4958cac6480e] No waiting events found dispatching network-vif-plugged-bed3fc1c-227e-44d2-85e1-589501a2e9dc {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 09:49:02 user nova-compute[75229]: WARNING nova.compute.manager [req-3a6e7cf3-4275-4f83-8266-b98fd4062c5c req-fbec6108-755e-4063-9f36-1cf0e8c7c835 service nova] [instance: b5170e9e-66e3-4df1-9807-4958cac6480e] Received unexpected event network-vif-plugged-bed3fc1c-227e-44d2-85e1-589501a2e9dc for instance with vm_state building and task_state spawning.
Nov 14 09:49:02 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:49:03 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:49:03 user nova-compute[75229]: DEBUG nova.compute.manager [None req-2552574c-7261-4457-825c-8a3e4e8e59da tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] [instance: 4c9fe69e-3f9d-4b30-a9e4-efc3e83efa17] Instance event wait completed in 0 seconds for  {{(pid=75229) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 09:49:03 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-2552574c-7261-4457-825c-8a3e4e8e59da tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] [instance: 4c9fe69e-3f9d-4b30-a9e4-efc3e83efa17] Guest created on hypervisor {{(pid=75229) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 09:49:03 user nova-compute[75229]: DEBUG nova.compute.manager [None req-9c9d2ab2-ab73-4cb8-bb8e-e7f1a0b80fc8 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] [instance: b5170e9e-66e3-4df1-9807-4958cac6480e] Instance event wait completed in 0 seconds for  {{(pid=75229) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 09:49:03 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-9c9d2ab2-ab73-4cb8-bb8e-e7f1a0b80fc8 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] [instance: b5170e9e-66e3-4df1-9807-4958cac6480e] Guest created on hypervisor {{(pid=75229) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 09:49:03 user nova-compute[75229]: INFO nova.virt.libvirt.driver [-] [instance: 4c9fe69e-3f9d-4b30-a9e4-efc3e83efa17] Instance spawned successfully.
Nov 14 09:49:03 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-2552574c-7261-4457-825c-8a3e4e8e59da tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] [instance: 4c9fe69e-3f9d-4b30-a9e4-efc3e83efa17] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 09:49:03 user nova-compute[75229]: INFO nova.virt.libvirt.driver [-] [instance: b5170e9e-66e3-4df1-9807-4958cac6480e] Instance spawned successfully.
Nov 14 09:49:03 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-9c9d2ab2-ab73-4cb8-bb8e-e7f1a0b80fc8 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] [instance: b5170e9e-66e3-4df1-9807-4958cac6480e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 09:49:03 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-2552574c-7261-4457-825c-8a3e4e8e59da tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] [instance: 4c9fe69e-3f9d-4b30-a9e4-efc3e83efa17] Found default for hw_cdrom_bus of ide {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 09:49:03 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-2552574c-7261-4457-825c-8a3e4e8e59da tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] [instance: 4c9fe69e-3f9d-4b30-a9e4-efc3e83efa17] Found default for hw_disk_bus of virtio {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 09:49:03 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-2552574c-7261-4457-825c-8a3e4e8e59da tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] [instance: 4c9fe69e-3f9d-4b30-a9e4-efc3e83efa17] Found default for hw_input_bus of None {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 09:49:03 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-2552574c-7261-4457-825c-8a3e4e8e59da tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] [instance: 4c9fe69e-3f9d-4b30-a9e4-efc3e83efa17] Found default for hw_pointer_model of None {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 09:49:03 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-2552574c-7261-4457-825c-8a3e4e8e59da tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] [instance: 4c9fe69e-3f9d-4b30-a9e4-efc3e83efa17] Found default for hw_video_model of virtio {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 09:49:03 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-2552574c-7261-4457-825c-8a3e4e8e59da tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] [instance: 4c9fe69e-3f9d-4b30-a9e4-efc3e83efa17] Found default for hw_vif_model of virtio {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 09:49:03 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-9c9d2ab2-ab73-4cb8-bb8e-e7f1a0b80fc8 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] [instance: b5170e9e-66e3-4df1-9807-4958cac6480e] Found default for hw_cdrom_bus of ide {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 09:49:03 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-9c9d2ab2-ab73-4cb8-bb8e-e7f1a0b80fc8 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] [instance: b5170e9e-66e3-4df1-9807-4958cac6480e] Found default for hw_disk_bus of virtio {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 09:49:03 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-9c9d2ab2-ab73-4cb8-bb8e-e7f1a0b80fc8 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] [instance: b5170e9e-66e3-4df1-9807-4958cac6480e] Found default for hw_input_bus of None {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 09:49:03 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-9c9d2ab2-ab73-4cb8-bb8e-e7f1a0b80fc8 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] [instance: b5170e9e-66e3-4df1-9807-4958cac6480e] Found default for hw_pointer_model of None {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 09:49:03 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-9c9d2ab2-ab73-4cb8-bb8e-e7f1a0b80fc8 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] [instance: b5170e9e-66e3-4df1-9807-4958cac6480e] Found default for hw_video_model of virtio {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 09:49:03 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-9c9d2ab2-ab73-4cb8-bb8e-e7f1a0b80fc8 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] [instance: b5170e9e-66e3-4df1-9807-4958cac6480e] Found default for hw_vif_model of virtio {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 09:49:03 user nova-compute[75229]: INFO nova.compute.manager [None req-9c9d2ab2-ab73-4cb8-bb8e-e7f1a0b80fc8 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] [instance: b5170e9e-66e3-4df1-9807-4958cac6480e] Took 7.49 seconds to spawn the instance on the hypervisor.
Nov 14 09:49:03 user nova-compute[75229]: DEBUG nova.compute.manager [None req-9c9d2ab2-ab73-4cb8-bb8e-e7f1a0b80fc8 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] [instance: b5170e9e-66e3-4df1-9807-4958cac6480e] Checking state {{(pid=75229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 09:49:03 user nova-compute[75229]: INFO nova.compute.manager [None req-2552574c-7261-4457-825c-8a3e4e8e59da tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] [instance: 4c9fe69e-3f9d-4b30-a9e4-efc3e83efa17] Took 8.23 seconds to spawn the instance on the hypervisor.
Nov 14 09:49:03 user nova-compute[75229]: DEBUG nova.compute.manager [None req-2552574c-7261-4457-825c-8a3e4e8e59da tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] [instance: 4c9fe69e-3f9d-4b30-a9e4-efc3e83efa17] Checking state {{(pid=75229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 09:49:03 user nova-compute[75229]: INFO nova.compute.manager [None req-2552574c-7261-4457-825c-8a3e4e8e59da tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] [instance: 4c9fe69e-3f9d-4b30-a9e4-efc3e83efa17] Took 9.41 seconds to build instance.
Nov 14 09:49:03 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-2552574c-7261-4457-825c-8a3e4e8e59da tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Lock "4c9fe69e-3f9d-4b30-a9e4-efc3e83efa17" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.588s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:49:03 user nova-compute[75229]: INFO nova.compute.manager [None req-9c9d2ab2-ab73-4cb8-bb8e-e7f1a0b80fc8 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] [instance: b5170e9e-66e3-4df1-9807-4958cac6480e] Took 8.83 seconds to build instance.
Nov 14 09:49:03 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-9c9d2ab2-ab73-4cb8-bb8e-e7f1a0b80fc8 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Lock "b5170e9e-66e3-4df1-9807-4958cac6480e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.932s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:49:04 user nova-compute[75229]: DEBUG nova.compute.manager [req-ea334f2c-2123-4673-9c3f-4bb9bce18d85 req-380b4285-da78-4fda-8d62-0e5ba8c84646 service nova] [instance: 9bcd05e7-481c-4ee9-953d-2873e6aa849d] Received event network-changed-71040f8f-3771-47df-a138-07571bf3eb9b {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:49:04 user nova-compute[75229]: DEBUG nova.compute.manager [req-ea334f2c-2123-4673-9c3f-4bb9bce18d85 req-380b4285-da78-4fda-8d62-0e5ba8c84646 service nova] [instance: 9bcd05e7-481c-4ee9-953d-2873e6aa849d] Refreshing instance network info cache due to event network-changed-71040f8f-3771-47df-a138-07571bf3eb9b. {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 09:49:04 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-ea334f2c-2123-4673-9c3f-4bb9bce18d85 req-380b4285-da78-4fda-8d62-0e5ba8c84646 service nova] Acquiring lock "refresh_cache-9bcd05e7-481c-4ee9-953d-2873e6aa849d" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 09:49:04 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-ea334f2c-2123-4673-9c3f-4bb9bce18d85 req-380b4285-da78-4fda-8d62-0e5ba8c84646 service nova] Acquired lock "refresh_cache-9bcd05e7-481c-4ee9-953d-2873e6aa849d" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 09:49:04 user nova-compute[75229]: DEBUG nova.network.neutron [req-ea334f2c-2123-4673-9c3f-4bb9bce18d85 req-380b4285-da78-4fda-8d62-0e5ba8c84646 service nova] [instance: 9bcd05e7-481c-4ee9-953d-2873e6aa849d] Refreshing network info cache for port 71040f8f-3771-47df-a138-07571bf3eb9b {{(pid=75229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 09:49:04 user nova-compute[75229]: DEBUG nova.network.neutron [req-ea334f2c-2123-4673-9c3f-4bb9bce18d85 req-380b4285-da78-4fda-8d62-0e5ba8c84646 service nova] [instance: 9bcd05e7-481c-4ee9-953d-2873e6aa849d] Updated VIF entry in instance network info cache for port 71040f8f-3771-47df-a138-07571bf3eb9b. {{(pid=75229) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 09:49:04 user nova-compute[75229]: DEBUG nova.network.neutron [req-ea334f2c-2123-4673-9c3f-4bb9bce18d85 req-380b4285-da78-4fda-8d62-0e5ba8c84646 service nova] [instance: 9bcd05e7-481c-4ee9-953d-2873e6aa849d] Updating instance_info_cache with network_info: [{"id": "71040f8f-3771-47df-a138-07571bf3eb9b", "address": "fa:16:3e:76:1c:74", "network": {"id": "8efb8df0-c10e-46aa-b2e0-bb03cfeb00e8", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-2058178363-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.71", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "703b87f76dd845e4846d746bbf3dbb6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71040f8f-37", "ovs_interfaceid": "71040f8f-3771-47df-a138-07571bf3eb9b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ddcf0922-99ea-4e9f-8fe3-61df68231a99", "address": "fa:16:3e:2d:60:2c", "network": {"id": "cd9117eb-aeb0-4c47-b450-2286d1680ed3", "bridge": "br-int", "label": "tempest-device-tagging-net1-1915364084", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.144", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "703b87f76dd845e4846d746bbf3dbb6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapddcf0922-99", "ovs_interfaceid": "ddcf0922-99ea-4e9f-8fe3-61df68231a99", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "db5f7129-8708-4f26-9975-c462270d47f3", "address": "fa:16:3e:6a:77:bd", "network": {"id": "cd9117eb-aeb0-4c47-b450-2286d1680ed3", "bridge": "br-int", "label": "tempest-device-tagging-net1-1915364084", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.33", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "703b87f76dd845e4846d746bbf3dbb6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb5f7129-87", "ovs_interfaceid": "db5f7129-8708-4f26-9975-c462270d47f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7363cfca-de5d-4f2f-b467-752de544bc21", "address": "fa:16:3e:f9:0c:a4", "network": {"id": "cd9117eb-aeb0-4c47-b450-2286d1680ed3", "bridge": "br-int", "label": "tempest-device-tagging-net1-1915364084", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.239", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "703b87f76dd845e4846d746bbf3dbb6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7363cfca-de", "ovs_interfaceid": "7363cfca-de5d-4f2f-b467-752de544bc21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "fccc2ab0-7340-4ab5-be12-dd7b08c0cc72", "address": "fa:16:3e:bf:7e:6f", "network": {"id": "cd9117eb-aeb0-4c47-b450-2286d1680ed3", "bridge": "br-int", "label": "tempest-device-tagging-net1-1915364084", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.125", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "703b87f76dd845e4846d746bbf3dbb6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfccc2ab0-73", "ovs_interfaceid": "fccc2ab0-7340-4ab5-be12-dd7b08c0cc72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1766a369-08d0-4fc1-b0b3-fc8e3c6a051f", "address": "fa:16:3e:9e:05:3c", "network": {"id": "5584ce2f-1d94-4822-b275-d059d121bea5", "bridge": "br-int", "label": "tempest-device-tagging-net2-310256364", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "703b87f76dd845e4846d746bbf3dbb6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1766a369-08", "ovs_interfaceid": "1766a369-08d0-4fc1-b0b3-fc8e3c6a051f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "94fc3f23-6f54-4e7c-815d-bf0c53245856", "address": "fa:16:3e:51:94:fa", "network": {"id": "5584ce2f-1d94-4822-b275-d059d121bea5", "bridge": "br-int", "label": "tempest-device-tagging-net2-310256364", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "703b87f76dd845e4846d746bbf3dbb6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94fc3f23-6f", "ovs_interfaceid": "94fc3f23-6f54-4e7c-815d-bf0c53245856", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 09:49:04 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-ea334f2c-2123-4673-9c3f-4bb9bce18d85 req-380b4285-da78-4fda-8d62-0e5ba8c84646 service nova] Releasing lock "refresh_cache-9bcd05e7-481c-4ee9-953d-2873e6aa849d" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 09:49:06 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-c3267b15-b2b9-48f1-9a7e-99530506d1bc tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] Acquiring lock "9bcd05e7-481c-4ee9-953d-2873e6aa849d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:49:06 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-c3267b15-b2b9-48f1-9a7e-99530506d1bc tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] Lock "9bcd05e7-481c-4ee9-953d-2873e6aa849d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:49:06 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-c3267b15-b2b9-48f1-9a7e-99530506d1bc tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] Acquiring lock "9bcd05e7-481c-4ee9-953d-2873e6aa849d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:49:06 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-c3267b15-b2b9-48f1-9a7e-99530506d1bc tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] Lock "9bcd05e7-481c-4ee9-953d-2873e6aa849d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:49:06 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-c3267b15-b2b9-48f1-9a7e-99530506d1bc tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] Lock "9bcd05e7-481c-4ee9-953d-2873e6aa849d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:49:06 user nova-compute[75229]: INFO nova.compute.manager [None req-c3267b15-b2b9-48f1-9a7e-99530506d1bc tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] [instance: 9bcd05e7-481c-4ee9-953d-2873e6aa849d] Terminating instance
Nov 14 09:49:06 user nova-compute[75229]: DEBUG nova.compute.manager [None req-c3267b15-b2b9-48f1-9a7e-99530506d1bc tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] [instance: 9bcd05e7-481c-4ee9-953d-2873e6aa849d] Start destroying the instance on the hypervisor. {{(pid=75229) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 09:49:06 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:49:06 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:49:06 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:49:06 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:49:07 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:49:07 user nova-compute[75229]: DEBUG nova.compute.manager [req-97953063-bd0d-41ec-9f39-c3a90391255f req-f74b4b91-bab8-4223-b75f-dc6f0ca0d98d service nova] [instance: 9bcd05e7-481c-4ee9-953d-2873e6aa849d] Received event network-vif-unplugged-71040f8f-3771-47df-a138-07571bf3eb9b {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:49:07 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-97953063-bd0d-41ec-9f39-c3a90391255f req-f74b4b91-bab8-4223-b75f-dc6f0ca0d98d service nova] Acquiring lock "9bcd05e7-481c-4ee9-953d-2873e6aa849d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:49:07 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-97953063-bd0d-41ec-9f39-c3a90391255f req-f74b4b91-bab8-4223-b75f-dc6f0ca0d98d service nova] Lock "9bcd05e7-481c-4ee9-953d-2873e6aa849d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:49:07 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-97953063-bd0d-41ec-9f39-c3a90391255f req-f74b4b91-bab8-4223-b75f-dc6f0ca0d98d service nova] Lock "9bcd05e7-481c-4ee9-953d-2873e6aa849d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:49:07 user nova-compute[75229]: DEBUG nova.compute.manager [req-97953063-bd0d-41ec-9f39-c3a90391255f req-f74b4b91-bab8-4223-b75f-dc6f0ca0d98d service nova] [instance: 9bcd05e7-481c-4ee9-953d-2873e6aa849d] No waiting events found dispatching network-vif-unplugged-71040f8f-3771-47df-a138-07571bf3eb9b {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 09:49:07 user nova-compute[75229]: DEBUG nova.compute.manager [req-97953063-bd0d-41ec-9f39-c3a90391255f req-f74b4b91-bab8-4223-b75f-dc6f0ca0d98d service nova] [instance: 9bcd05e7-481c-4ee9-953d-2873e6aa849d] Received event network-vif-unplugged-71040f8f-3771-47df-a138-07571bf3eb9b for instance with task_state deleting. {{(pid=75229) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 09:49:07 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:49:07 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:49:07 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:49:07 user nova-compute[75229]: DEBUG nova.compute.manager [req-ee2ae5e5-5f21-46ae-892b-2dc2e737c12f req-9e766831-a195-4710-91a4-d0898e3dc5b3 service nova] [instance: 9bcd05e7-481c-4ee9-953d-2873e6aa849d] Received event network-vif-unplugged-ddcf0922-99ea-4e9f-8fe3-61df68231a99 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:49:07 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-ee2ae5e5-5f21-46ae-892b-2dc2e737c12f req-9e766831-a195-4710-91a4-d0898e3dc5b3 service nova] Acquiring lock "9bcd05e7-481c-4ee9-953d-2873e6aa849d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:49:07 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-ee2ae5e5-5f21-46ae-892b-2dc2e737c12f req-9e766831-a195-4710-91a4-d0898e3dc5b3 service nova] Lock "9bcd05e7-481c-4ee9-953d-2873e6aa849d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:49:07 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-ee2ae5e5-5f21-46ae-892b-2dc2e737c12f req-9e766831-a195-4710-91a4-d0898e3dc5b3 service nova] Lock "9bcd05e7-481c-4ee9-953d-2873e6aa849d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:49:07 user nova-compute[75229]: DEBUG nova.compute.manager [req-ee2ae5e5-5f21-46ae-892b-2dc2e737c12f req-9e766831-a195-4710-91a4-d0898e3dc5b3 service nova] [instance: 9bcd05e7-481c-4ee9-953d-2873e6aa849d] No waiting events found dispatching network-vif-unplugged-ddcf0922-99ea-4e9f-8fe3-61df68231a99 {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 09:49:07 user nova-compute[75229]: DEBUG nova.compute.manager [req-ee2ae5e5-5f21-46ae-892b-2dc2e737c12f req-9e766831-a195-4710-91a4-d0898e3dc5b3 service nova] [instance: 9bcd05e7-481c-4ee9-953d-2873e6aa849d] Received event network-vif-unplugged-ddcf0922-99ea-4e9f-8fe3-61df68231a99 for instance with task_state deleting. {{(pid=75229) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 09:49:07 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:49:07 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:49:07 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:49:07 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:49:07 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:49:07 user nova-compute[75229]: DEBUG nova.compute.manager [req-7e28bde6-0307-4351-bb22-187a57bb96f5 req-ef476ced-5f10-4951-8609-d52fde2bf48b service nova] [instance: 9bcd05e7-481c-4ee9-953d-2873e6aa849d] Received event network-vif-unplugged-db5f7129-8708-4f26-9975-c462270d47f3 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:49:07 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-7e28bde6-0307-4351-bb22-187a57bb96f5 req-ef476ced-5f10-4951-8609-d52fde2bf48b service nova] Acquiring lock "9bcd05e7-481c-4ee9-953d-2873e6aa849d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:49:07 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-7e28bde6-0307-4351-bb22-187a57bb96f5 req-ef476ced-5f10-4951-8609-d52fde2bf48b service nova] Lock "9bcd05e7-481c-4ee9-953d-2873e6aa849d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:49:07 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-7e28bde6-0307-4351-bb22-187a57bb96f5 req-ef476ced-5f10-4951-8609-d52fde2bf48b service nova] Lock "9bcd05e7-481c-4ee9-953d-2873e6aa849d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:49:07 user nova-compute[75229]: DEBUG nova.compute.manager [req-7e28bde6-0307-4351-bb22-187a57bb96f5 req-ef476ced-5f10-4951-8609-d52fde2bf48b service nova] [instance: 9bcd05e7-481c-4ee9-953d-2873e6aa849d] No waiting events found dispatching network-vif-unplugged-db5f7129-8708-4f26-9975-c462270d47f3 {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 09:49:07 user nova-compute[75229]: DEBUG nova.compute.manager [req-7e28bde6-0307-4351-bb22-187a57bb96f5 req-ef476ced-5f10-4951-8609-d52fde2bf48b service nova] [instance: 9bcd05e7-481c-4ee9-953d-2873e6aa849d] Received event network-vif-unplugged-db5f7129-8708-4f26-9975-c462270d47f3 for instance with task_state deleting. {{(pid=75229) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 09:49:07 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:49:07 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:49:07 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:49:07 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:49:08 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:49:08 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:49:08 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:49:08 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:49:08 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:49:08 user nova-compute[75229]: INFO nova.virt.libvirt.driver [-] [instance: 9bcd05e7-481c-4ee9-953d-2873e6aa849d] Instance destroyed successfully.
Nov 14 09:49:08 user nova-compute[75229]: DEBUG nova.objects.instance [None req-c3267b15-b2b9-48f1-9a7e-99530506d1bc tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] Lazy-loading 'resources' on Instance uuid 9bcd05e7-481c-4ee9-953d-2873e6aa849d {{(pid=75229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 09:49:08 user nova-compute[75229]: DEBUG nova.virt.libvirt.vif [None req-c3267b15-b2b9-48f1-9a7e-99530506d1bc tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T09:47:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1344448520',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1344448520',id=14,image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJA+mbW53CYPI09BJIYFnLrEotoFcZVkgH+GWeiBg0GW7ir0gJlqKnbnYK0AWdLlotPNpYiaLOq+gZ7eeixO/d6vHaXAxAISIFWGg7b0SpDRPk8D4ksykF7CXaWbd/kgfA==',key_name='tempest-keypair-2078999652',keypairs=<?>,launch_index=0,launched_at=2023-11-14T09:47:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='703b87f76dd845e4846d746bbf3dbb6c',ramdisk_id='',reservation_id='r-u2q5b3ln',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1091422151',owner_user_name='tempest-TaggedBootDevicesTest_v242-1091422151-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T09:47:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f24bad24bb284d15bf2ef1f4fa211389',uuid=9bcd05e7-481c-4ee9-953d-2873e6aa849d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "71040f8f-3771-47df-a138-07571bf3eb9b", "address": "fa:16:3e:76:1c:74", "network": {"id": "8efb8df0-c10e-46aa-b2e0-bb03cfeb00e8", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-2058178363-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.71", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "703b87f76dd845e4846d746bbf3dbb6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71040f8f-37", "ovs_interfaceid": "71040f8f-3771-47df-a138-07571bf3eb9b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 09:49:08 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-c3267b15-b2b9-48f1-9a7e-99530506d1bc tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] Converting VIF {"id": "71040f8f-3771-47df-a138-07571bf3eb9b", "address": "fa:16:3e:76:1c:74", "network": {"id": "8efb8df0-c10e-46aa-b2e0-bb03cfeb00e8", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-2058178363-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.71", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "703b87f76dd845e4846d746bbf3dbb6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71040f8f-37", "ovs_interfaceid": "71040f8f-3771-47df-a138-07571bf3eb9b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 09:49:08 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-c3267b15-b2b9-48f1-9a7e-99530506d1bc tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:76:1c:74,bridge_name='br-int',has_traffic_filtering=True,id=71040f8f-3771-47df-a138-07571bf3eb9b,network=Network(8efb8df0-c10e-46aa-b2e0-bb03cfeb00e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71040f8f-37') {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 09:49:08 user nova-compute[75229]: DEBUG os_vif [None req-c3267b15-b2b9-48f1-9a7e-99530506d1bc tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:76:1c:74,bridge_name='br-int',has_traffic_filtering=True,id=71040f8f-3771-47df-a138-07571bf3eb9b,network=Network(8efb8df0-c10e-46aa-b2e0-bb03cfeb00e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71040f8f-37') {{(pid=75229) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 09:49:08 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:49:08 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap71040f8f-37, bridge=br-int, if_exists=True) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:49:08 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 09:49:08 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:49:08 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:49:08 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c6dd845d-1750-454e-9070-1e9b368021b2) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:49:08 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 09:49:08 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:49:08 user nova-compute[75229]: INFO os_vif [None req-c3267b15-b2b9-48f1-9a7e-99530506d1bc tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:76:1c:74,bridge_name='br-int',has_traffic_filtering=True,id=71040f8f-3771-47df-a138-07571bf3eb9b,network=Network(8efb8df0-c10e-46aa-b2e0-bb03cfeb00e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71040f8f-37')
Nov 14 09:49:08 user nova-compute[75229]: DEBUG nova.virt.libvirt.vif [None req-c3267b15-b2b9-48f1-9a7e-99530506d1bc tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T09:47:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1344448520',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1344448520',id=14,image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJA+mbW53CYPI09BJIYFnLrEotoFcZVkgH+GWeiBg0GW7ir0gJlqKnbnYK0AWdLlotPNpYiaLOq+gZ7eeixO/d6vHaXAxAISIFWGg7b0SpDRPk8D4ksykF7CXaWbd/kgfA==',key_name='tempest-keypair-2078999652',keypairs=<?>,launch_index=0,launched_at=2023-11-14T09:47:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='703b87f76dd845e4846d746bbf3dbb6c',ramdisk_id='',reservation_id='r-u2q5b3ln',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1091422151',owner_user_name='tempest-TaggedBootDevicesTest_v242-1091422151-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T09:47:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f24bad24bb284d15bf2ef1f4fa211389',uuid=9bcd05e7-481c-4ee9-953d-2873e6aa849d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ddcf0922-99ea-4e9f-8fe3-61df68231a99", "address": "fa:16:3e:2d:60:2c", "network": {"id": "cd9117eb-aeb0-4c47-b450-2286d1680ed3", "bridge": "br-int", "label": "tempest-device-tagging-net1-1915364084", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.144", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "703b87f76dd845e4846d746bbf3dbb6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapddcf0922-99", "ovs_interfaceid": "ddcf0922-99ea-4e9f-8fe3-61df68231a99", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75229) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 09:49:08 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-c3267b15-b2b9-48f1-9a7e-99530506d1bc tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] Converting VIF {"id": "ddcf0922-99ea-4e9f-8fe3-61df68231a99", "address": "fa:16:3e:2d:60:2c", "network": {"id": "cd9117eb-aeb0-4c47-b450-2286d1680ed3", "bridge": "br-int", "label": "tempest-device-tagging-net1-1915364084", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.144", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "703b87f76dd845e4846d746bbf3dbb6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapddcf0922-99", "ovs_interfaceid": "ddcf0922-99ea-4e9f-8fe3-61df68231a99", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 09:49:08 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-c3267b15-b2b9-48f1-9a7e-99530506d1bc tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2d:60:2c,bridge_name='br-int',has_traffic_filtering=True,id=ddcf0922-99ea-4e9f-8fe3-61df68231a99,network=Network(cd9117eb-aeb0-4c47-b450-2286d1680ed3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapddcf0922-99') {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 09:49:08 user nova-compute[75229]: DEBUG os_vif [None req-c3267b15-b2b9-48f1-9a7e-99530506d1bc tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2d:60:2c,bridge_name='br-int',has_traffic_filtering=True,id=ddcf0922-99ea-4e9f-8fe3-61df68231a99,network=Network(cd9117eb-aeb0-4c47-b450-2286d1680ed3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapddcf0922-99') {{(pid=75229) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 09:49:08 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:49:08 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapddcf0922-99, bridge=br-int, if_exists=True) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:49:08 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 09:49:08 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:49:08 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:49:08 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=916d39de-08b8-45cb-a18e-a26f44f869b3) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:49:08 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 09:49:09 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:49:09 user nova-compute[75229]: INFO os_vif [None req-c3267b15-b2b9-48f1-9a7e-99530506d1bc tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2d:60:2c,bridge_name='br-int',has_traffic_filtering=True,id=ddcf0922-99ea-4e9f-8fe3-61df68231a99,network=Network(cd9117eb-aeb0-4c47-b450-2286d1680ed3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapddcf0922-99')
Nov 14 09:49:09 user nova-compute[75229]: DEBUG nova.virt.libvirt.vif [None req-c3267b15-b2b9-48f1-9a7e-99530506d1bc tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T09:47:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1344448520',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1344448520',id=14,image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJA+mbW53CYPI09BJIYFnLrEotoFcZVkgH+GWeiBg0GW7ir0gJlqKnbnYK0AWdLlotPNpYiaLOq+gZ7eeixO/d6vHaXAxAISIFWGg7b0SpDRPk8D4ksykF7CXaWbd/kgfA==',key_name='tempest-keypair-2078999652',keypairs=<?>,launch_index=0,launched_at=2023-11-14T09:47:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='703b87f76dd845e4846d746bbf3dbb6c',ramdisk_id='',reservation_id='r-u2q5b3ln',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1091422151',owner_user_name='tempest-TaggedBootDevicesTest_v242-1091422151-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T09:47:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f24bad24bb284d15bf2ef1f4fa211389',uuid=9bcd05e7-481c-4ee9-953d-2873e6aa849d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "db5f7129-8708-4f26-9975-c462270d47f3", "address": "fa:16:3e:6a:77:bd", "network": {"id": "cd9117eb-aeb0-4c47-b450-2286d1680ed3", "bridge": "br-int", "label": "tempest-device-tagging-net1-1915364084", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.33", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "703b87f76dd845e4846d746bbf3dbb6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb5f7129-87", "ovs_interfaceid": "db5f7129-8708-4f26-9975-c462270d47f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75229) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 09:49:09 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-c3267b15-b2b9-48f1-9a7e-99530506d1bc tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] Converting VIF {"id": "db5f7129-8708-4f26-9975-c462270d47f3", "address": "fa:16:3e:6a:77:bd", "network": {"id": "cd9117eb-aeb0-4c47-b450-2286d1680ed3", "bridge": "br-int", "label": "tempest-device-tagging-net1-1915364084", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.33", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "703b87f76dd845e4846d746bbf3dbb6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb5f7129-87", "ovs_interfaceid": "db5f7129-8708-4f26-9975-c462270d47f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 09:49:09 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-c3267b15-b2b9-48f1-9a7e-99530506d1bc tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6a:77:bd,bridge_name='br-int',has_traffic_filtering=True,id=db5f7129-8708-4f26-9975-c462270d47f3,network=Network(cd9117eb-aeb0-4c47-b450-2286d1680ed3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapdb5f7129-87') {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 09:49:09 user nova-compute[75229]: DEBUG os_vif [None req-c3267b15-b2b9-48f1-9a7e-99530506d1bc tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6a:77:bd,bridge_name='br-int',has_traffic_filtering=True,id=db5f7129-8708-4f26-9975-c462270d47f3,network=Network(cd9117eb-aeb0-4c47-b450-2286d1680ed3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapdb5f7129-87') {{(pid=75229) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 09:49:09 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:49:09 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdb5f7129-87, bridge=br-int, if_exists=True) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:49:09 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 09:49:09 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:49:09 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:49:09 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a9539fc0-7981-4b6a-8bb5-1427be6c962a) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:49:09 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 09:49:09 user nova-compute[75229]: DEBUG nova.compute.manager [req-8b2e73bc-0ad8-4a8f-8ed3-066d74182155 req-1b29a3c3-9ef6-4a59-86bc-ec48646bf67c service nova] [instance: 9bcd05e7-481c-4ee9-953d-2873e6aa849d] Received event network-vif-plugged-71040f8f-3771-47df-a138-07571bf3eb9b {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:49:09 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-8b2e73bc-0ad8-4a8f-8ed3-066d74182155 req-1b29a3c3-9ef6-4a59-86bc-ec48646bf67c service nova] Acquiring lock "9bcd05e7-481c-4ee9-953d-2873e6aa849d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:49:09 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-8b2e73bc-0ad8-4a8f-8ed3-066d74182155 req-1b29a3c3-9ef6-4a59-86bc-ec48646bf67c service nova] Lock "9bcd05e7-481c-4ee9-953d-2873e6aa849d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:49:09 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-8b2e73bc-0ad8-4a8f-8ed3-066d74182155 req-1b29a3c3-9ef6-4a59-86bc-ec48646bf67c service nova] Lock "9bcd05e7-481c-4ee9-953d-2873e6aa849d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:49:09 user nova-compute[75229]: DEBUG nova.compute.manager [req-8b2e73bc-0ad8-4a8f-8ed3-066d74182155 req-1b29a3c3-9ef6-4a59-86bc-ec48646bf67c service nova] [instance: 9bcd05e7-481c-4ee9-953d-2873e6aa849d] No waiting events found dispatching network-vif-plugged-71040f8f-3771-47df-a138-07571bf3eb9b {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 09:49:09 user nova-compute[75229]: WARNING nova.compute.manager [req-8b2e73bc-0ad8-4a8f-8ed3-066d74182155 req-1b29a3c3-9ef6-4a59-86bc-ec48646bf67c service nova] [instance: 9bcd05e7-481c-4ee9-953d-2873e6aa849d] Received unexpected event network-vif-plugged-71040f8f-3771-47df-a138-07571bf3eb9b for instance with vm_state active and task_state deleting.
Nov 14 09:49:09 user nova-compute[75229]: DEBUG nova.compute.manager [req-8b2e73bc-0ad8-4a8f-8ed3-066d74182155 req-1b29a3c3-9ef6-4a59-86bc-ec48646bf67c service nova] [instance: 9bcd05e7-481c-4ee9-953d-2873e6aa849d] Received event network-vif-unplugged-7363cfca-de5d-4f2f-b467-752de544bc21 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:49:09 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-8b2e73bc-0ad8-4a8f-8ed3-066d74182155 req-1b29a3c3-9ef6-4a59-86bc-ec48646bf67c service nova] Acquiring lock "9bcd05e7-481c-4ee9-953d-2873e6aa849d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:49:09 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-8b2e73bc-0ad8-4a8f-8ed3-066d74182155 req-1b29a3c3-9ef6-4a59-86bc-ec48646bf67c service nova] Lock "9bcd05e7-481c-4ee9-953d-2873e6aa849d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:49:09 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-8b2e73bc-0ad8-4a8f-8ed3-066d74182155 req-1b29a3c3-9ef6-4a59-86bc-ec48646bf67c service nova] Lock "9bcd05e7-481c-4ee9-953d-2873e6aa849d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:49:09 user nova-compute[75229]: DEBUG nova.compute.manager [req-8b2e73bc-0ad8-4a8f-8ed3-066d74182155 req-1b29a3c3-9ef6-4a59-86bc-ec48646bf67c service nova] [instance: 9bcd05e7-481c-4ee9-953d-2873e6aa849d] No waiting events found dispatching network-vif-unplugged-7363cfca-de5d-4f2f-b467-752de544bc21 {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 09:49:09 user nova-compute[75229]: DEBUG nova.compute.manager [req-8b2e73bc-0ad8-4a8f-8ed3-066d74182155 req-1b29a3c3-9ef6-4a59-86bc-ec48646bf67c service nova] [instance: 9bcd05e7-481c-4ee9-953d-2873e6aa849d] Received event network-vif-unplugged-7363cfca-de5d-4f2f-b467-752de544bc21 for instance with task_state deleting. {{(pid=75229) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 09:49:09 user nova-compute[75229]: DEBUG nova.compute.manager [req-8b2e73bc-0ad8-4a8f-8ed3-066d74182155 req-1b29a3c3-9ef6-4a59-86bc-ec48646bf67c service nova] [instance: 9bcd05e7-481c-4ee9-953d-2873e6aa849d] Received event network-vif-plugged-7363cfca-de5d-4f2f-b467-752de544bc21 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:49:09 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-8b2e73bc-0ad8-4a8f-8ed3-066d74182155 req-1b29a3c3-9ef6-4a59-86bc-ec48646bf67c service nova] Acquiring lock "9bcd05e7-481c-4ee9-953d-2873e6aa849d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:49:09 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-8b2e73bc-0ad8-4a8f-8ed3-066d74182155 req-1b29a3c3-9ef6-4a59-86bc-ec48646bf67c service nova] Lock "9bcd05e7-481c-4ee9-953d-2873e6aa849d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:49:09 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-8b2e73bc-0ad8-4a8f-8ed3-066d74182155 req-1b29a3c3-9ef6-4a59-86bc-ec48646bf67c service nova] Lock "9bcd05e7-481c-4ee9-953d-2873e6aa849d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:49:09 user nova-compute[75229]: DEBUG nova.compute.manager [req-8b2e73bc-0ad8-4a8f-8ed3-066d74182155 req-1b29a3c3-9ef6-4a59-86bc-ec48646bf67c service nova] [instance: 9bcd05e7-481c-4ee9-953d-2873e6aa849d] No waiting events found dispatching network-vif-plugged-7363cfca-de5d-4f2f-b467-752de544bc21 {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 09:49:09 user nova-compute[75229]: WARNING nova.compute.manager [req-8b2e73bc-0ad8-4a8f-8ed3-066d74182155 req-1b29a3c3-9ef6-4a59-86bc-ec48646bf67c service nova] [instance: 9bcd05e7-481c-4ee9-953d-2873e6aa849d] Received unexpected event network-vif-plugged-7363cfca-de5d-4f2f-b467-752de544bc21 for instance with vm_state active and task_state deleting.
Nov 14 09:49:09 user nova-compute[75229]: DEBUG nova.compute.manager [req-8b2e73bc-0ad8-4a8f-8ed3-066d74182155 req-1b29a3c3-9ef6-4a59-86bc-ec48646bf67c service nova] [instance: 9bcd05e7-481c-4ee9-953d-2873e6aa849d] Received event network-vif-unplugged-1766a369-08d0-4fc1-b0b3-fc8e3c6a051f {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:49:09 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-8b2e73bc-0ad8-4a8f-8ed3-066d74182155 req-1b29a3c3-9ef6-4a59-86bc-ec48646bf67c service nova] Acquiring lock "9bcd05e7-481c-4ee9-953d-2873e6aa849d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:49:09 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-8b2e73bc-0ad8-4a8f-8ed3-066d74182155 req-1b29a3c3-9ef6-4a59-86bc-ec48646bf67c service nova] Lock "9bcd05e7-481c-4ee9-953d-2873e6aa849d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:49:09 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-8b2e73bc-0ad8-4a8f-8ed3-066d74182155 req-1b29a3c3-9ef6-4a59-86bc-ec48646bf67c service nova] Lock "9bcd05e7-481c-4ee9-953d-2873e6aa849d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:49:09 user nova-compute[75229]: DEBUG nova.compute.manager [req-8b2e73bc-0ad8-4a8f-8ed3-066d74182155 req-1b29a3c3-9ef6-4a59-86bc-ec48646bf67c service nova] [instance: 9bcd05e7-481c-4ee9-953d-2873e6aa849d] No waiting events found dispatching network-vif-unplugged-1766a369-08d0-4fc1-b0b3-fc8e3c6a051f {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 09:49:09 user nova-compute[75229]: DEBUG nova.compute.manager [req-8b2e73bc-0ad8-4a8f-8ed3-066d74182155 req-1b29a3c3-9ef6-4a59-86bc-ec48646bf67c service nova] [instance: 9bcd05e7-481c-4ee9-953d-2873e6aa849d] Received event network-vif-unplugged-1766a369-08d0-4fc1-b0b3-fc8e3c6a051f for instance with task_state deleting. {{(pid=75229) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 09:49:09 user nova-compute[75229]: DEBUG nova.compute.manager [req-8b2e73bc-0ad8-4a8f-8ed3-066d74182155 req-1b29a3c3-9ef6-4a59-86bc-ec48646bf67c service nova] [instance: 9bcd05e7-481c-4ee9-953d-2873e6aa849d] Received event network-vif-plugged-1766a369-08d0-4fc1-b0b3-fc8e3c6a051f {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:49:09 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-8b2e73bc-0ad8-4a8f-8ed3-066d74182155 req-1b29a3c3-9ef6-4a59-86bc-ec48646bf67c service nova] Acquiring lock "9bcd05e7-481c-4ee9-953d-2873e6aa849d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:49:09 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-8b2e73bc-0ad8-4a8f-8ed3-066d74182155 req-1b29a3c3-9ef6-4a59-86bc-ec48646bf67c service nova] Lock "9bcd05e7-481c-4ee9-953d-2873e6aa849d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:49:09 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-8b2e73bc-0ad8-4a8f-8ed3-066d74182155 req-1b29a3c3-9ef6-4a59-86bc-ec48646bf67c service nova] Lock "9bcd05e7-481c-4ee9-953d-2873e6aa849d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:49:09 user nova-compute[75229]: DEBUG nova.compute.manager [req-8b2e73bc-0ad8-4a8f-8ed3-066d74182155 req-1b29a3c3-9ef6-4a59-86bc-ec48646bf67c service nova] [instance: 9bcd05e7-481c-4ee9-953d-2873e6aa849d] No waiting events found dispatching network-vif-plugged-1766a369-08d0-4fc1-b0b3-fc8e3c6a051f {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 09:49:09 user nova-compute[75229]: WARNING nova.compute.manager [req-8b2e73bc-0ad8-4a8f-8ed3-066d74182155 req-1b29a3c3-9ef6-4a59-86bc-ec48646bf67c service nova] [instance: 9bcd05e7-481c-4ee9-953d-2873e6aa849d] Received unexpected event network-vif-plugged-1766a369-08d0-4fc1-b0b3-fc8e3c6a051f for instance with vm_state active and task_state deleting.
Nov 14 09:49:09 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:49:09 user nova-compute[75229]: INFO os_vif [None req-c3267b15-b2b9-48f1-9a7e-99530506d1bc tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6a:77:bd,bridge_name='br-int',has_traffic_filtering=True,id=db5f7129-8708-4f26-9975-c462270d47f3,network=Network(cd9117eb-aeb0-4c47-b450-2286d1680ed3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapdb5f7129-87')
Nov 14 09:49:09 user nova-compute[75229]: DEBUG nova.virt.libvirt.vif [None req-c3267b15-b2b9-48f1-9a7e-99530506d1bc tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T09:47:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1344448520',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1344448520',id=14,image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJA+mbW53CYPI09BJIYFnLrEotoFcZVkgH+GWeiBg0GW7ir0gJlqKnbnYK0AWdLlotPNpYiaLOq+gZ7eeixO/d6vHaXAxAISIFWGg7b0SpDRPk8D4ksykF7CXaWbd/kgfA==',key_name='tempest-keypair-2078999652',keypairs=<?>,launch_index=0,launched_at=2023-11-14T09:47:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='703b87f76dd845e4846d746bbf3dbb6c',ramdisk_id='',reservation_id='r-u2q5b3ln',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1091422151',owner_user_name='tempest-TaggedBootDevicesTest_v242-1091422151-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T09:47:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f24bad24bb284d15bf2ef1f4fa211389',uuid=9bcd05e7-481c-4ee9-953d-2873e6aa849d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7363cfca-de5d-4f2f-b467-752de544bc21", "address": "fa:16:3e:f9:0c:a4", "network": {"id": "cd9117eb-aeb0-4c47-b450-2286d1680ed3", "bridge": "br-int", "label": "tempest-device-tagging-net1-1915364084", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.239", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "703b87f76dd845e4846d746bbf3dbb6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7363cfca-de", "ovs_interfaceid": "7363cfca-de5d-4f2f-b467-752de544bc21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 09:49:09 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-c3267b15-b2b9-48f1-9a7e-99530506d1bc tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] Converting VIF {"id": "7363cfca-de5d-4f2f-b467-752de544bc21", "address": "fa:16:3e:f9:0c:a4", "network": {"id": "cd9117eb-aeb0-4c47-b450-2286d1680ed3", "bridge": "br-int", "label": "tempest-device-tagging-net1-1915364084", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.239", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "703b87f76dd845e4846d746bbf3dbb6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7363cfca-de", "ovs_interfaceid": "7363cfca-de5d-4f2f-b467-752de544bc21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 09:49:09 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-c3267b15-b2b9-48f1-9a7e-99530506d1bc tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f9:0c:a4,bridge_name='br-int',has_traffic_filtering=True,id=7363cfca-de5d-4f2f-b467-752de544bc21,network=Network(cd9117eb-aeb0-4c47-b450-2286d1680ed3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7363cfca-de') {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 09:49:09 user nova-compute[75229]: DEBUG os_vif [None req-c3267b15-b2b9-48f1-9a7e-99530506d1bc tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f9:0c:a4,bridge_name='br-int',has_traffic_filtering=True,id=7363cfca-de5d-4f2f-b467-752de544bc21,network=Network(cd9117eb-aeb0-4c47-b450-2286d1680ed3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7363cfca-de') {{(pid=75229) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 09:49:09 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:49:09 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7363cfca-de, bridge=br-int, if_exists=True) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:49:09 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 09:49:09 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:49:09 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:49:09 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a348acee-7edd-4df9-b665-6c4f1744d53d) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:49:09 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 09:49:09 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:49:09 user nova-compute[75229]: INFO os_vif [None req-c3267b15-b2b9-48f1-9a7e-99530506d1bc tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f9:0c:a4,bridge_name='br-int',has_traffic_filtering=True,id=7363cfca-de5d-4f2f-b467-752de544bc21,network=Network(cd9117eb-aeb0-4c47-b450-2286d1680ed3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7363cfca-de')
Nov 14 09:49:09 user nova-compute[75229]: DEBUG nova.virt.libvirt.vif [None req-c3267b15-b2b9-48f1-9a7e-99530506d1bc tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T09:47:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1344448520',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1344448520',id=14,image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJA+mbW53CYPI09BJIYFnLrEotoFcZVkgH+GWeiBg0GW7ir0gJlqKnbnYK0AWdLlotPNpYiaLOq+gZ7eeixO/d6vHaXAxAISIFWGg7b0SpDRPk8D4ksykF7CXaWbd/kgfA==',key_name='tempest-keypair-2078999652',keypairs=<?>,launch_index=0,launched_at=2023-11-14T09:47:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='703b87f76dd845e4846d746bbf3dbb6c',ramdisk_id='',reservation_id='r-u2q5b3ln',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1091422151',owner_user_name='tempest-TaggedBootDevicesTest_v242-1091422151-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T09:47:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f24bad24bb284d15bf2ef1f4fa211389',uuid=9bcd05e7-481c-4ee9-953d-2873e6aa849d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fccc2ab0-7340-4ab5-be12-dd7b08c0cc72", "address": "fa:16:3e:bf:7e:6f", "network": {"id": "cd9117eb-aeb0-4c47-b450-2286d1680ed3", "bridge": "br-int", "label": "tempest-device-tagging-net1-1915364084", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.125", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "703b87f76dd845e4846d746bbf3dbb6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfccc2ab0-73", "ovs_interfaceid": "fccc2ab0-7340-4ab5-be12-dd7b08c0cc72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 09:49:09 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-c3267b15-b2b9-48f1-9a7e-99530506d1bc tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] Converting VIF {"id": "fccc2ab0-7340-4ab5-be12-dd7b08c0cc72", "address": "fa:16:3e:bf:7e:6f", "network": {"id": "cd9117eb-aeb0-4c47-b450-2286d1680ed3", "bridge": "br-int", "label": "tempest-device-tagging-net1-1915364084", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.125", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "703b87f76dd845e4846d746bbf3dbb6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfccc2ab0-73", "ovs_interfaceid": "fccc2ab0-7340-4ab5-be12-dd7b08c0cc72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 09:49:09 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-c3267b15-b2b9-48f1-9a7e-99530506d1bc tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bf:7e:6f,bridge_name='br-int',has_traffic_filtering=True,id=fccc2ab0-7340-4ab5-be12-dd7b08c0cc72,network=Network(cd9117eb-aeb0-4c47-b450-2286d1680ed3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfccc2ab0-73') {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 09:49:09 user nova-compute[75229]: DEBUG os_vif [None req-c3267b15-b2b9-48f1-9a7e-99530506d1bc tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bf:7e:6f,bridge_name='br-int',has_traffic_filtering=True,id=fccc2ab0-7340-4ab5-be12-dd7b08c0cc72,network=Network(cd9117eb-aeb0-4c47-b450-2286d1680ed3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfccc2ab0-73') {{(pid=75229) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 09:49:09 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:49:09 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfccc2ab0-73, bridge=br-int, if_exists=True) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:49:09 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 09:49:09 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:49:09 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:49:09 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a67a7fc1-7b6b-4f2c-9c5a-b573c1ab8b03) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:49:09 user nova-compute[75229]: DEBUG nova.compute.manager [req-0a9a191c-071e-4530-aa90-bf2052d4e37f req-95f15d31-9d4c-4712-a36f-31dc0ff9938b service nova] [instance: 9bcd05e7-481c-4ee9-953d-2873e6aa849d] Received event network-vif-plugged-ddcf0922-99ea-4e9f-8fe3-61df68231a99 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:49:09 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-0a9a191c-071e-4530-aa90-bf2052d4e37f req-95f15d31-9d4c-4712-a36f-31dc0ff9938b service nova] Acquiring lock "9bcd05e7-481c-4ee9-953d-2873e6aa849d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:49:09 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-0a9a191c-071e-4530-aa90-bf2052d4e37f req-95f15d31-9d4c-4712-a36f-31dc0ff9938b service nova] Lock "9bcd05e7-481c-4ee9-953d-2873e6aa849d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:49:09 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-0a9a191c-071e-4530-aa90-bf2052d4e37f req-95f15d31-9d4c-4712-a36f-31dc0ff9938b service nova] Lock "9bcd05e7-481c-4ee9-953d-2873e6aa849d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:49:09 user nova-compute[75229]: DEBUG nova.compute.manager [req-0a9a191c-071e-4530-aa90-bf2052d4e37f req-95f15d31-9d4c-4712-a36f-31dc0ff9938b service nova] [instance: 9bcd05e7-481c-4ee9-953d-2873e6aa849d] No waiting events found dispatching network-vif-plugged-ddcf0922-99ea-4e9f-8fe3-61df68231a99 {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 09:49:09 user nova-compute[75229]: WARNING nova.compute.manager [req-0a9a191c-071e-4530-aa90-bf2052d4e37f req-95f15d31-9d4c-4712-a36f-31dc0ff9938b service nova] [instance: 9bcd05e7-481c-4ee9-953d-2873e6aa849d] Received unexpected event network-vif-plugged-ddcf0922-99ea-4e9f-8fe3-61df68231a99 for instance with vm_state active and task_state deleting.
Nov 14 09:49:09 user nova-compute[75229]: DEBUG nova.compute.manager [req-0a9a191c-071e-4530-aa90-bf2052d4e37f req-95f15d31-9d4c-4712-a36f-31dc0ff9938b service nova] [instance: 9bcd05e7-481c-4ee9-953d-2873e6aa849d] Received event network-vif-unplugged-fccc2ab0-7340-4ab5-be12-dd7b08c0cc72 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:49:09 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-0a9a191c-071e-4530-aa90-bf2052d4e37f req-95f15d31-9d4c-4712-a36f-31dc0ff9938b service nova] Acquiring lock "9bcd05e7-481c-4ee9-953d-2873e6aa849d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:49:09 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-0a9a191c-071e-4530-aa90-bf2052d4e37f req-95f15d31-9d4c-4712-a36f-31dc0ff9938b service nova] Lock "9bcd05e7-481c-4ee9-953d-2873e6aa849d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:49:09 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-0a9a191c-071e-4530-aa90-bf2052d4e37f req-95f15d31-9d4c-4712-a36f-31dc0ff9938b service nova] Lock "9bcd05e7-481c-4ee9-953d-2873e6aa849d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:49:09 user nova-compute[75229]: DEBUG nova.compute.manager [req-0a9a191c-071e-4530-aa90-bf2052d4e37f req-95f15d31-9d4c-4712-a36f-31dc0ff9938b service nova] [instance: 9bcd05e7-481c-4ee9-953d-2873e6aa849d] No waiting events found dispatching network-vif-unplugged-fccc2ab0-7340-4ab5-be12-dd7b08c0cc72 {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 09:49:09 user nova-compute[75229]: DEBUG nova.compute.manager [req-0a9a191c-071e-4530-aa90-bf2052d4e37f req-95f15d31-9d4c-4712-a36f-31dc0ff9938b service nova] [instance: 9bcd05e7-481c-4ee9-953d-2873e6aa849d] Received event network-vif-unplugged-fccc2ab0-7340-4ab5-be12-dd7b08c0cc72 for instance with task_state deleting. {{(pid=75229) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 09:49:09 user nova-compute[75229]: DEBUG nova.compute.manager [req-0a9a191c-071e-4530-aa90-bf2052d4e37f req-95f15d31-9d4c-4712-a36f-31dc0ff9938b service nova] [instance: 9bcd05e7-481c-4ee9-953d-2873e6aa849d] Received event network-vif-plugged-fccc2ab0-7340-4ab5-be12-dd7b08c0cc72 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:49:09 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-0a9a191c-071e-4530-aa90-bf2052d4e37f req-95f15d31-9d4c-4712-a36f-31dc0ff9938b service nova] Acquiring lock "9bcd05e7-481c-4ee9-953d-2873e6aa849d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:49:09 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-0a9a191c-071e-4530-aa90-bf2052d4e37f req-95f15d31-9d4c-4712-a36f-31dc0ff9938b service nova] Lock "9bcd05e7-481c-4ee9-953d-2873e6aa849d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:49:09 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-0a9a191c-071e-4530-aa90-bf2052d4e37f req-95f15d31-9d4c-4712-a36f-31dc0ff9938b service nova] Lock "9bcd05e7-481c-4ee9-953d-2873e6aa849d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:49:09 user nova-compute[75229]: DEBUG nova.compute.manager [req-0a9a191c-071e-4530-aa90-bf2052d4e37f req-95f15d31-9d4c-4712-a36f-31dc0ff9938b service nova] [instance: 9bcd05e7-481c-4ee9-953d-2873e6aa849d] No waiting events found dispatching network-vif-plugged-fccc2ab0-7340-4ab5-be12-dd7b08c0cc72 {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 09:49:09 user nova-compute[75229]: WARNING nova.compute.manager [req-0a9a191c-071e-4530-aa90-bf2052d4e37f req-95f15d31-9d4c-4712-a36f-31dc0ff9938b service nova] [instance: 9bcd05e7-481c-4ee9-953d-2873e6aa849d] Received unexpected event network-vif-plugged-fccc2ab0-7340-4ab5-be12-dd7b08c0cc72 for instance with vm_state active and task_state deleting.
Nov 14 09:49:09 user nova-compute[75229]: DEBUG nova.compute.manager [req-0a9a191c-071e-4530-aa90-bf2052d4e37f req-95f15d31-9d4c-4712-a36f-31dc0ff9938b service nova] [instance: 9bcd05e7-481c-4ee9-953d-2873e6aa849d] Received event network-vif-unplugged-94fc3f23-6f54-4e7c-815d-bf0c53245856 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:49:09 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-0a9a191c-071e-4530-aa90-bf2052d4e37f req-95f15d31-9d4c-4712-a36f-31dc0ff9938b service nova] Acquiring lock "9bcd05e7-481c-4ee9-953d-2873e6aa849d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:49:09 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-0a9a191c-071e-4530-aa90-bf2052d4e37f req-95f15d31-9d4c-4712-a36f-31dc0ff9938b service nova] Lock "9bcd05e7-481c-4ee9-953d-2873e6aa849d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:49:09 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-0a9a191c-071e-4530-aa90-bf2052d4e37f req-95f15d31-9d4c-4712-a36f-31dc0ff9938b service nova] Lock "9bcd05e7-481c-4ee9-953d-2873e6aa849d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:49:09 user nova-compute[75229]: DEBUG nova.compute.manager [req-0a9a191c-071e-4530-aa90-bf2052d4e37f req-95f15d31-9d4c-4712-a36f-31dc0ff9938b service nova] [instance: 9bcd05e7-481c-4ee9-953d-2873e6aa849d] No waiting events found dispatching network-vif-unplugged-94fc3f23-6f54-4e7c-815d-bf0c53245856 {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 09:49:09 user nova-compute[75229]: DEBUG nova.compute.manager [req-0a9a191c-071e-4530-aa90-bf2052d4e37f req-95f15d31-9d4c-4712-a36f-31dc0ff9938b service nova] [instance: 9bcd05e7-481c-4ee9-953d-2873e6aa849d] Received event network-vif-unplugged-94fc3f23-6f54-4e7c-815d-bf0c53245856 for instance with task_state deleting. {{(pid=75229) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 09:49:09 user nova-compute[75229]: DEBUG nova.compute.manager [req-0a9a191c-071e-4530-aa90-bf2052d4e37f req-95f15d31-9d4c-4712-a36f-31dc0ff9938b service nova] [instance: 9bcd05e7-481c-4ee9-953d-2873e6aa849d] Received event network-vif-plugged-94fc3f23-6f54-4e7c-815d-bf0c53245856 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:49:09 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-0a9a191c-071e-4530-aa90-bf2052d4e37f req-95f15d31-9d4c-4712-a36f-31dc0ff9938b service nova] Acquiring lock "9bcd05e7-481c-4ee9-953d-2873e6aa849d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:49:09 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-0a9a191c-071e-4530-aa90-bf2052d4e37f req-95f15d31-9d4c-4712-a36f-31dc0ff9938b service nova] Lock "9bcd05e7-481c-4ee9-953d-2873e6aa849d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:49:09 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-0a9a191c-071e-4530-aa90-bf2052d4e37f req-95f15d31-9d4c-4712-a36f-31dc0ff9938b service nova] Lock "9bcd05e7-481c-4ee9-953d-2873e6aa849d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:49:09 user nova-compute[75229]: DEBUG nova.compute.manager [req-0a9a191c-071e-4530-aa90-bf2052d4e37f req-95f15d31-9d4c-4712-a36f-31dc0ff9938b service nova] [instance: 9bcd05e7-481c-4ee9-953d-2873e6aa849d] No waiting events found dispatching network-vif-plugged-94fc3f23-6f54-4e7c-815d-bf0c53245856 {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 09:49:09 user nova-compute[75229]: WARNING nova.compute.manager [req-0a9a191c-071e-4530-aa90-bf2052d4e37f req-95f15d31-9d4c-4712-a36f-31dc0ff9938b service nova] [instance: 9bcd05e7-481c-4ee9-953d-2873e6aa849d] Received unexpected event network-vif-plugged-94fc3f23-6f54-4e7c-815d-bf0c53245856 for instance with vm_state active and task_state deleting.
Nov 14 09:49:09 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:49:09 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:49:09 user nova-compute[75229]: INFO os_vif [None req-c3267b15-b2b9-48f1-9a7e-99530506d1bc tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bf:7e:6f,bridge_name='br-int',has_traffic_filtering=True,id=fccc2ab0-7340-4ab5-be12-dd7b08c0cc72,network=Network(cd9117eb-aeb0-4c47-b450-2286d1680ed3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfccc2ab0-73')
Nov 14 09:49:09 user nova-compute[75229]: DEBUG nova.virt.libvirt.vif [None req-c3267b15-b2b9-48f1-9a7e-99530506d1bc tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T09:47:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1344448520',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1344448520',id=14,image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJA+mbW53CYPI09BJIYFnLrEotoFcZVkgH+GWeiBg0GW7ir0gJlqKnbnYK0AWdLlotPNpYiaLOq+gZ7eeixO/d6vHaXAxAISIFWGg7b0SpDRPk8D4ksykF7CXaWbd/kgfA==',key_name='tempest-keypair-2078999652',keypairs=<?>,launch_index=0,launched_at=2023-11-14T09:47:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='703b87f76dd845e4846d746bbf3dbb6c',ramdisk_id='',reservation_id='r-u2q5b3ln',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1091422151',owner_user_name='tempest-TaggedBootDevicesTest_v242-1091422151-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T09:47:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f24bad24bb284d15bf2ef1f4fa211389',uuid=9bcd05e7-481c-4ee9-953d-2873e6aa849d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1766a369-08d0-4fc1-b0b3-fc8e3c6a051f", "address": "fa:16:3e:9e:05:3c", "network": {"id": "5584ce2f-1d94-4822-b275-d059d121bea5", "bridge": "br-int", "label": "tempest-device-tagging-net2-310256364", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "703b87f76dd845e4846d746bbf3dbb6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1766a369-08", "ovs_interfaceid": "1766a369-08d0-4fc1-b0b3-fc8e3c6a051f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 09:49:09 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-c3267b15-b2b9-48f1-9a7e-99530506d1bc tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] Converting VIF {"id": "1766a369-08d0-4fc1-b0b3-fc8e3c6a051f", "address": "fa:16:3e:9e:05:3c", "network": {"id": "5584ce2f-1d94-4822-b275-d059d121bea5", "bridge": "br-int", "label": "tempest-device-tagging-net2-310256364", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "703b87f76dd845e4846d746bbf3dbb6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1766a369-08", "ovs_interfaceid": "1766a369-08d0-4fc1-b0b3-fc8e3c6a051f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 09:49:09 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-c3267b15-b2b9-48f1-9a7e-99530506d1bc tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9e:05:3c,bridge_name='br-int',has_traffic_filtering=True,id=1766a369-08d0-4fc1-b0b3-fc8e3c6a051f,network=Network(5584ce2f-1d94-4822-b275-d059d121bea5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1766a369-08') {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 09:49:09 user nova-compute[75229]: DEBUG os_vif [None req-c3267b15-b2b9-48f1-9a7e-99530506d1bc tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9e:05:3c,bridge_name='br-int',has_traffic_filtering=True,id=1766a369-08d0-4fc1-b0b3-fc8e3c6a051f,network=Network(5584ce2f-1d94-4822-b275-d059d121bea5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1766a369-08') {{(pid=75229) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 09:49:09 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:49:09 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1766a369-08, bridge=br-int, if_exists=True) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:49:09 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:49:09 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 09:49:09 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:49:09 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:49:09 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0d6f8da1-1ab3-45d3-92dd-4833b3e75d36) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:49:09 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:49:09 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 09:49:09 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:49:09 user nova-compute[75229]: INFO os_vif [None req-c3267b15-b2b9-48f1-9a7e-99530506d1bc tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9e:05:3c,bridge_name='br-int',has_traffic_filtering=True,id=1766a369-08d0-4fc1-b0b3-fc8e3c6a051f,network=Network(5584ce2f-1d94-4822-b275-d059d121bea5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1766a369-08')
Nov 14 09:49:09 user nova-compute[75229]: DEBUG nova.virt.libvirt.vif [None req-c3267b15-b2b9-48f1-9a7e-99530506d1bc tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T09:47:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1344448520',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1344448520',id=14,image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJA+mbW53CYPI09BJIYFnLrEotoFcZVkgH+GWeiBg0GW7ir0gJlqKnbnYK0AWdLlotPNpYiaLOq+gZ7eeixO/d6vHaXAxAISIFWGg7b0SpDRPk8D4ksykF7CXaWbd/kgfA==',key_name='tempest-keypair-2078999652',keypairs=<?>,launch_index=0,launched_at=2023-11-14T09:47:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='703b87f76dd845e4846d746bbf3dbb6c',ramdisk_id='',reservation_id='r-u2q5b3ln',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1091422151',owner_user_name='tempest-TaggedBootDevicesTest_v242-1091422151-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T09:47:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f24bad24bb284d15bf2ef1f4fa211389',uuid=9bcd05e7-481c-4ee9-953d-2873e6aa849d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "94fc3f23-6f54-4e7c-815d-bf0c53245856", "address": "fa:16:3e:51:94:fa", "network": {"id": "5584ce2f-1d94-4822-b275-d059d121bea5", "bridge": "br-int", "label": "tempest-device-tagging-net2-310256364", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "703b87f76dd845e4846d746bbf3dbb6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94fc3f23-6f", "ovs_interfaceid": "94fc3f23-6f54-4e7c-815d-bf0c53245856", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 09:49:09 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-c3267b15-b2b9-48f1-9a7e-99530506d1bc tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] Converting VIF {"id": "94fc3f23-6f54-4e7c-815d-bf0c53245856", "address": "fa:16:3e:51:94:fa", "network": {"id": "5584ce2f-1d94-4822-b275-d059d121bea5", "bridge": "br-int", "label": "tempest-device-tagging-net2-310256364", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "703b87f76dd845e4846d746bbf3dbb6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94fc3f23-6f", "ovs_interfaceid": "94fc3f23-6f54-4e7c-815d-bf0c53245856", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 09:49:09 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-c3267b15-b2b9-48f1-9a7e-99530506d1bc tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:51:94:fa,bridge_name='br-int',has_traffic_filtering=True,id=94fc3f23-6f54-4e7c-815d-bf0c53245856,network=Network(5584ce2f-1d94-4822-b275-d059d121bea5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94fc3f23-6f') {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 09:49:09 user nova-compute[75229]: DEBUG os_vif [None req-c3267b15-b2b9-48f1-9a7e-99530506d1bc tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:51:94:fa,bridge_name='br-int',has_traffic_filtering=True,id=94fc3f23-6f54-4e7c-815d-bf0c53245856,network=Network(5584ce2f-1d94-4822-b275-d059d121bea5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94fc3f23-6f') {{(pid=75229) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 09:49:09 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:49:09 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap94fc3f23-6f, bridge=br-int, if_exists=True) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:49:09 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:49:09 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:49:09 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:49:09 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f1b741ff-52c0-4eb2-8f37-28d4a27cc5ee) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:49:09 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:49:09 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:49:09 user nova-compute[75229]: INFO os_vif [None req-c3267b15-b2b9-48f1-9a7e-99530506d1bc tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:51:94:fa,bridge_name='br-int',has_traffic_filtering=True,id=94fc3f23-6f54-4e7c-815d-bf0c53245856,network=Network(5584ce2f-1d94-4822-b275-d059d121bea5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94fc3f23-6f')
Nov 14 09:49:09 user nova-compute[75229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c3267b15-b2b9-48f1-9a7e-99530506d1bc tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] [instance: 9bcd05e7-481c-4ee9-953d-2873e6aa849d] calling os-brick to detach iSCSI Volume {{(pid=75229) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 09:49:09 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3267b15-b2b9-48f1-9a7e-99530506d1bc tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f73f85151b0>, {'target_iqn': 'iqn.2010-10.org.openstack:13c53511-ea64-4896-b325-504ce58d7895', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vWuhixRB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 09:49:09 user nova-compute[75229]: WARNING os_brick.initiator.connectors.base [None req-c3267b15-b2b9-48f1-9a7e-99530506d1bc tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 09:49:09 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-c3267b15-b2b9-48f1-9a7e-99530506d1bc tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 09:49:09 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-c3267b15-b2b9-48f1-9a7e-99530506d1bc tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 09:49:09 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:49:09 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:49:09 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[3568fd7e-95d3-4c45-8dde-4485da49c5cc]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5b54e594-ae66-4ba2-9bda-aa4431d31c3f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:db131665-6ac2-437a-8adf-23593475a8aa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:aca09258-022b-4f04-b418-f2a170332755\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:13c53511-ea64-4896-b325-504ce58d7895\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3fed285f-9be4-4601-8cb5-4329d7ebed8c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b0433e38-fa42-4cff-af48-8cb5da297597\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:49:09 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3267b15-b2b9-48f1-9a7e-99530506d1bc tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 09:49:09 user nova-compute[75229]: No targets found.
Nov 14 09:49:09 user nova-compute[75229]: iSNS:
Nov 14 09:49:09 user nova-compute[75229]: No targets found.
Nov 14 09:49:09 user nova-compute[75229]: STATIC:
Nov 14 09:49:09 user nova-compute[75229]: Target: iqn.2010-10.org.openstack:5b54e594-ae66-4ba2-9bda-aa4431d31c3f
Nov 14 09:49:09 user nova-compute[75229]:         Portal: 172.16.0.220:3260,-1
Nov 14 09:49:09 user nova-compute[75229]:                 Iface Name: default
Nov 14 09:49:09 user nova-compute[75229]: Target: iqn.2010-10.org.openstack:db131665-6ac2-437a-8adf-23593475a8aa
Nov 14 09:49:09 user nova-compute[75229]:         Portal: 172.16.0.220:3260,-1
Nov 14 09:49:09 user nova-compute[75229]:                 Iface Name: default
Nov 14 09:49:09 user nova-compute[75229]: Target: iqn.2010-10.org.openstack:aca09258-022b-4f04-b418-f2a170332755
Nov 14 09:49:09 user nova-compute[75229]:         Portal: 172.16.0.220:3260,-1
Nov 14 09:49:09 user nova-compute[75229]:                 Iface Name: default
Nov 14 09:49:09 user nova-compute[75229]: Target: iqn.2010-10.org.openstack:13c53511-ea64-4896-b325-504ce58d7895
Nov 14 09:49:09 user nova-compute[75229]:         Portal: 172.16.0.220:3260,-1
Nov 14 09:49:09 user nova-compute[75229]:                 Iface Name: default
Nov 14 09:49:09 user nova-compute[75229]: Target: iqn.2010-10.org.openstack:3fed285f-9be4-4601-8cb5-4329d7ebed8c
Nov 14 09:49:09 user nova-compute[75229]:         Portal: 172.16.0.220:3260,-1
Nov 14 09:49:09 user nova-compute[75229]:                 Iface Name: default
Nov 14 09:49:09 user nova-compute[75229]: Target: iqn.2010-10.org.openstack:b0433e38-fa42-4cff-af48-8cb5da297597
Nov 14 09:49:09 user nova-compute[75229]:         Portal: 172.16.0.220:3260,-1
Nov 14 09:49:09 user nova-compute[75229]:                 Iface Name: default
Nov 14 09:49:09 user nova-compute[75229]: FIRMWARE:
Nov 14 09:49:09 user nova-compute[75229]: No targets found.
Nov 14 09:49:09 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 09:49:09 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3267b15-b2b9-48f1-9a7e-99530506d1bc tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 09:49:09 user nova-compute[75229]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 09:49:09 user nova-compute[75229]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75229) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 09:49:09 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3267b15-b2b9-48f1-9a7e-99530506d1bc tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:13c53511-ea64-4896-b325-504ce58d7895', 0)] {{(pid=75229) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 09:49:09 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:49:09 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:49:09 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[e38fd967-9696-4488-9ff1-da2e6ec1e34e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:13c53511-ea64-4896-b325-504ce58d7895\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3fed285f-9be4-4601-8cb5-4329d7ebed8c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5b54e594-ae66-4ba2-9bda-aa4431d31c3f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aca09258-022b-4f04-b418-f2a170332755\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b0433e38-fa42-4cff-af48-8cb5da297597\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:db131665-6ac2-437a-8adf-23593475a8aa\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:49:09 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:49:09 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:49:09 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d0ab887-271b-4a52-957b-2d38aaa8717c]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db131665-6ac2-437a-8adf-23593475a8aa (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0433e38-fa42-4cff-af48-8cb5da297597 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13c53511-ea64-4896-b325-504ce58d7895 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fed285f-9be4-4601-8cb5-4329d7ebed8c (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b54e594-ae66-4ba2-9bda-aa4431d31c3f (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aca09258-022b-4f04-b418-f2a170332755 (non-flash)\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:49:09 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3267b15-b2b9-48f1-9a7e-99530506d1bc tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db131665-6ac2-437a-8adf-23593475a8aa (non-flash)
Nov 14 09:49:09 user nova-compute[75229]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0433e38-fa42-4cff-af48-8cb5da297597 (non-flash)
Nov 14 09:49:09 user nova-compute[75229]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13c53511-ea64-4896-b325-504ce58d7895 (non-flash)
Nov 14 09:49:09 user nova-compute[75229]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fed285f-9be4-4601-8cb5-4329d7ebed8c (non-flash)
Nov 14 09:49:09 user nova-compute[75229]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b54e594-ae66-4ba2-9bda-aa4431d31c3f (non-flash)
Nov 14 09:49:09 user nova-compute[75229]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aca09258-022b-4f04-b418-f2a170332755 (non-flash)
Nov 14 09:49:09 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 09:49:09 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3267b15-b2b9-48f1-9a7e-99530506d1bc tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db131665-6ac2-437a-8adf-23593475a8aa (non-flash)
Nov 14 09:49:09 user nova-compute[75229]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0433e38-fa42-4cff-af48-8cb5da297597 (non-flash)
Nov 14 09:49:09 user nova-compute[75229]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13c53511-ea64-4896-b325-504ce58d7895 (non-flash)
Nov 14 09:49:09 user nova-compute[75229]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fed285f-9be4-4601-8cb5-4329d7ebed8c (non-flash)
Nov 14 09:49:09 user nova-compute[75229]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b54e594-ae66-4ba2-9bda-aa4431d31c3f (non-flash)
Nov 14 09:49:09 user nova-compute[75229]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aca09258-022b-4f04-b418-f2a170332755 (non-flash)
Nov 14 09:49:09 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 09:49:09 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3267b15-b2b9-48f1-9a7e-99530506d1bc tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f73f8655870>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:13c53511-ea64-4896-b325-504ce58d7895'): ({'sdd'}, set())}) {{(pid=75229) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 09:49:09 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-c3267b15-b2b9-48f1-9a7e-99530506d1bc tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] Removing single pathed devices sdd {{(pid=75229) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 09:49:09 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:49:09 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:49:09 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3c6064c-0b3e-4598-b11d-488b42c97b8f]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:49:09 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:49:09 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.022s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:49:09 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[aedbe8f4-458e-43be-9709-d01684d0afcd]: (4, ('ok\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:49:09 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-c3267b15-b2b9-48f1-9a7e-99530506d1bc tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] Flushing IO for device /dev/sdd {{(pid=75229) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 09:49:09 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:49:09 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:49:09 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[a22a98d9-f59d-47fd-9bd1-6ecd438fc431]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:49:09 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-c3267b15-b2b9-48f1-9a7e-99530506d1bc tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75229) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 09:49:09 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:49:09 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.037s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:49:09 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[8001a1bd-f05e-40fc-a908-58d92729c578]: (4, ('1', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:49:09 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-c3267b15-b2b9-48f1-9a7e-99530506d1bc tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75229) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 09:49:09 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-c3267b15-b2b9-48f1-9a7e-99530506d1bc tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] SCSI volumes sdd have been removed. {{(pid=75229) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 09:49:09 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3267b15-b2b9-48f1-9a7e-99530506d1bc tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:13c53511-ea64-4896-b325-504ce58d7895')] {{(pid=75229) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 09:49:09 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13c53511-ea64-4896-b325-504ce58d7895 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:49:09 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13c53511-ea64-4896-b325-504ce58d7895 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:49:09 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca529373-39bf-4d7b-9f7d-586b4c5a2d15]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:49:09 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3267b15-b2b9-48f1-9a7e-99530506d1bc tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:49:09 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13c53511-ea64-4896-b325-504ce58d7895 -p 172.16.0.220:3260 --logout {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:49:09 user nova-compute[75229]: DEBUG nova.compute.manager [req-b75a5e8f-73d0-4ad9-8585-4ba5bf34fcb4 req-5c477d35-3796-49af-85ea-f1f879e0141e service nova] [instance: 9bcd05e7-481c-4ee9-953d-2873e6aa849d] Received event network-vif-plugged-db5f7129-8708-4f26-9975-c462270d47f3 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:49:09 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-b75a5e8f-73d0-4ad9-8585-4ba5bf34fcb4 req-5c477d35-3796-49af-85ea-f1f879e0141e service nova] Acquiring lock "9bcd05e7-481c-4ee9-953d-2873e6aa849d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:49:09 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-b75a5e8f-73d0-4ad9-8585-4ba5bf34fcb4 req-5c477d35-3796-49af-85ea-f1f879e0141e service nova] Lock "9bcd05e7-481c-4ee9-953d-2873e6aa849d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:49:09 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-b75a5e8f-73d0-4ad9-8585-4ba5bf34fcb4 req-5c477d35-3796-49af-85ea-f1f879e0141e service nova] Lock "9bcd05e7-481c-4ee9-953d-2873e6aa849d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:49:09 user nova-compute[75229]: DEBUG nova.compute.manager [req-b75a5e8f-73d0-4ad9-8585-4ba5bf34fcb4 req-5c477d35-3796-49af-85ea-f1f879e0141e service nova] [instance: 9bcd05e7-481c-4ee9-953d-2873e6aa849d] No waiting events found dispatching network-vif-plugged-db5f7129-8708-4f26-9975-c462270d47f3 {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 09:49:09 user nova-compute[75229]: WARNING nova.compute.manager [req-b75a5e8f-73d0-4ad9-8585-4ba5bf34fcb4 req-5c477d35-3796-49af-85ea-f1f879e0141e service nova] [instance: 9bcd05e7-481c-4ee9-953d-2873e6aa849d] Received unexpected event network-vif-plugged-db5f7129-8708-4f26-9975-c462270d47f3 for instance with vm_state active and task_state deleting.
Nov 14 09:49:09 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13c53511-ea64-4896-b325-504ce58d7895 -p 172.16.0.220:3260 --logout" returned: 0 in 0.075s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:49:09 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b5c4443-df65-46a0-9684-c698d536d3d9]: (4, ('Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:13c53511-ea64-4896-b325-504ce58d7895, portal: 172.16.0.220,3260]\nLogout of [sid: 15, target: iqn.2010-10.org.openstack:13c53511-ea64-4896-b325-504ce58d7895, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:49:09 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3267b15-b2b9-48f1-9a7e-99530506d1bc tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:13c53511-ea64-4896-b325-504ce58d7895, portal: 172.16.0.220,3260]
Nov 14 09:49:09 user nova-compute[75229]: Logout of [sid: 15, target: iqn.2010-10.org.openstack:13c53511-ea64-4896-b325-504ce58d7895, portal: 172.16.0.220,3260] successful.
Nov 14 09:49:09 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:49:09 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13c53511-ea64-4896-b325-504ce58d7895 -p 172.16.0.220:3260 --op delete {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:49:09 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13c53511-ea64-4896-b325-504ce58d7895 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.035s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:49:09 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6dc9e92-d17a-4597-84e9-19cbcf24034c]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:49:09 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3267b15-b2b9-48f1-9a7e-99530506d1bc tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:49:09 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-c3267b15-b2b9-48f1-9a7e-99530506d1bc tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.353s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 09:49:09 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3267b15-b2b9-48f1-9a7e-99530506d1bc tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] <== disconnect_volume: return (355ms) None {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 09:49:09 user nova-compute[75229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c3267b15-b2b9-48f1-9a7e-99530506d1bc tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] [instance: 9bcd05e7-481c-4ee9-953d-2873e6aa849d] Disconnected iSCSI Volume {{(pid=75229) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 09:49:09 user nova-compute[75229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c3267b15-b2b9-48f1-9a7e-99530506d1bc tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] [instance: 9bcd05e7-481c-4ee9-953d-2873e6aa849d] calling os-brick to detach iSCSI Volume {{(pid=75229) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 09:49:09 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3267b15-b2b9-48f1-9a7e-99530506d1bc tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f73f85151b0>, {'target_iqn': 'iqn.2010-10.org.openstack:b0433e38-fa42-4cff-af48-8cb5da297597', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xaKMoEBs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 09:49:09 user nova-compute[75229]: WARNING os_brick.initiator.connectors.base [None req-c3267b15-b2b9-48f1-9a7e-99530506d1bc tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 09:49:09 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-c3267b15-b2b9-48f1-9a7e-99530506d1bc tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 09:49:09 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-c3267b15-b2b9-48f1-9a7e-99530506d1bc tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 09:49:09 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:49:09 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:49:09 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[7473f21c-37d8-4cb5-b64f-e0fd9fdf2a67]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5b54e594-ae66-4ba2-9bda-aa4431d31c3f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:db131665-6ac2-437a-8adf-23593475a8aa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:aca09258-022b-4f04-b418-f2a170332755\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3fed285f-9be4-4601-8cb5-4329d7ebed8c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b0433e38-fa42-4cff-af48-8cb5da297597\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:49:09 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3267b15-b2b9-48f1-9a7e-99530506d1bc tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 09:49:09 user nova-compute[75229]: No targets found.
Nov 14 09:49:09 user nova-compute[75229]: iSNS:
Nov 14 09:49:09 user nova-compute[75229]: No targets found.
Nov 14 09:49:09 user nova-compute[75229]: STATIC:
Nov 14 09:49:09 user nova-compute[75229]: Target: iqn.2010-10.org.openstack:5b54e594-ae66-4ba2-9bda-aa4431d31c3f
Nov 14 09:49:09 user nova-compute[75229]:         Portal: 172.16.0.220:3260,-1
Nov 14 09:49:09 user nova-compute[75229]:                 Iface Name: default
Nov 14 09:49:09 user nova-compute[75229]: Target: iqn.2010-10.org.openstack:db131665-6ac2-437a-8adf-23593475a8aa
Nov 14 09:49:09 user nova-compute[75229]:         Portal: 172.16.0.220:3260,-1
Nov 14 09:49:09 user nova-compute[75229]:                 Iface Name: default
Nov 14 09:49:09 user nova-compute[75229]: Target: iqn.2010-10.org.openstack:aca09258-022b-4f04-b418-f2a170332755
Nov 14 09:49:09 user nova-compute[75229]:         Portal: 172.16.0.220:3260,-1
Nov 14 09:49:09 user nova-compute[75229]:                 Iface Name: default
Nov 14 09:49:09 user nova-compute[75229]: Target: iqn.2010-10.org.openstack:3fed285f-9be4-4601-8cb5-4329d7ebed8c
Nov 14 09:49:09 user nova-compute[75229]:         Portal: 172.16.0.220:3260,-1
Nov 14 09:49:09 user nova-compute[75229]:                 Iface Name: default
Nov 14 09:49:09 user nova-compute[75229]: Target: iqn.2010-10.org.openstack:b0433e38-fa42-4cff-af48-8cb5da297597
Nov 14 09:49:09 user nova-compute[75229]:         Portal: 172.16.0.220:3260,-1
Nov 14 09:49:09 user nova-compute[75229]:                 Iface Name: default
Nov 14 09:49:09 user nova-compute[75229]: FIRMWARE:
Nov 14 09:49:09 user nova-compute[75229]: No targets found.
Nov 14 09:49:09 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 09:49:09 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3267b15-b2b9-48f1-9a7e-99530506d1bc tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 09:49:09 user nova-compute[75229]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 09:49:09 user nova-compute[75229]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75229) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 09:49:09 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3267b15-b2b9-48f1-9a7e-99530506d1bc tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b0433e38-fa42-4cff-af48-8cb5da297597', 0)] {{(pid=75229) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 09:49:09 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:49:09 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:49:09 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[c063187b-4963-4ab8-9378-483bf2646618]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3fed285f-9be4-4601-8cb5-4329d7ebed8c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5b54e594-ae66-4ba2-9bda-aa4431d31c3f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aca09258-022b-4f04-b418-f2a170332755\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b0433e38-fa42-4cff-af48-8cb5da297597\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:db131665-6ac2-437a-8adf-23593475a8aa\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:49:09 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:49:09 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:49:09 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a425ad5-6b43-4b90-88c7-6357bb861e43]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db131665-6ac2-437a-8adf-23593475a8aa (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0433e38-fa42-4cff-af48-8cb5da297597 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fed285f-9be4-4601-8cb5-4329d7ebed8c (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b54e594-ae66-4ba2-9bda-aa4431d31c3f (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aca09258-022b-4f04-b418-f2a170332755 (non-flash)\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:49:09 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3267b15-b2b9-48f1-9a7e-99530506d1bc tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db131665-6ac2-437a-8adf-23593475a8aa (non-flash)
Nov 14 09:49:09 user nova-compute[75229]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0433e38-fa42-4cff-af48-8cb5da297597 (non-flash)
Nov 14 09:49:09 user nova-compute[75229]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fed285f-9be4-4601-8cb5-4329d7ebed8c (non-flash)
Nov 14 09:49:09 user nova-compute[75229]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b54e594-ae66-4ba2-9bda-aa4431d31c3f (non-flash)
Nov 14 09:49:09 user nova-compute[75229]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aca09258-022b-4f04-b418-f2a170332755 (non-flash)
Nov 14 09:49:09 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 09:49:09 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3267b15-b2b9-48f1-9a7e-99530506d1bc tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db131665-6ac2-437a-8adf-23593475a8aa (non-flash)
Nov 14 09:49:09 user nova-compute[75229]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0433e38-fa42-4cff-af48-8cb5da297597 (non-flash)
Nov 14 09:49:09 user nova-compute[75229]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fed285f-9be4-4601-8cb5-4329d7ebed8c (non-flash)
Nov 14 09:49:09 user nova-compute[75229]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b54e594-ae66-4ba2-9bda-aa4431d31c3f (non-flash)
Nov 14 09:49:09 user nova-compute[75229]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aca09258-022b-4f04-b418-f2a170332755 (non-flash)
Nov 14 09:49:09 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 09:49:09 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3267b15-b2b9-48f1-9a7e-99530506d1bc tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f73f8655870>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b0433e38-fa42-4cff-af48-8cb5da297597'): ({'sdc'}, set())}) {{(pid=75229) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 09:49:09 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-c3267b15-b2b9-48f1-9a7e-99530506d1bc tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] Removing single pathed devices sdc {{(pid=75229) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 09:49:09 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:49:09 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:49:09 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc04d69f-abbb-4c88-ab71-fa86fcf0edfe]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:49:09 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:49:09 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:49:09 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[eecaa456-a876-4ca1-baa5-a95021f07e07]: (4, ('ok\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:49:09 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-c3267b15-b2b9-48f1-9a7e-99530506d1bc tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] Flushing IO for device /dev/sdc {{(pid=75229) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 09:49:09 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:49:09 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.017s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:49:09 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ef3275d-7465-42e1-85ed-ff126f2e292a]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:49:09 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-c3267b15-b2b9-48f1-9a7e-99530506d1bc tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75229) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 09:49:09 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:49:09 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.042s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:49:09 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bdeb364-8b79-4637-8d45-0de3471d18c1]: (4, ('1', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:49:09 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-c3267b15-b2b9-48f1-9a7e-99530506d1bc tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75229) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 09:49:09 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-c3267b15-b2b9-48f1-9a7e-99530506d1bc tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] SCSI volumes sdc have been removed. {{(pid=75229) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 09:49:09 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3267b15-b2b9-48f1-9a7e-99530506d1bc tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b0433e38-fa42-4cff-af48-8cb5da297597')] {{(pid=75229) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 09:49:09 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0433e38-fa42-4cff-af48-8cb5da297597 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:49:09 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0433e38-fa42-4cff-af48-8cb5da297597 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:49:09 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc496677-44c9-4063-ac42-40f96ebf6b7f]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:49:09 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3267b15-b2b9-48f1-9a7e-99530506d1bc tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:49:09 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0433e38-fa42-4cff-af48-8cb5da297597 -p 172.16.0.220:3260 --logout {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:49:10 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0433e38-fa42-4cff-af48-8cb5da297597 -p 172.16.0.220:3260 --logout" returned: 0 in 0.143s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:49:10 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fc5ba60-c204-484d-9187-cb5a161cfc9e]: (4, ('Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:b0433e38-fa42-4cff-af48-8cb5da297597, portal: 172.16.0.220,3260]\nLogout of [sid: 14, target: iqn.2010-10.org.openstack:b0433e38-fa42-4cff-af48-8cb5da297597, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:49:10 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3267b15-b2b9-48f1-9a7e-99530506d1bc tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:b0433e38-fa42-4cff-af48-8cb5da297597, portal: 172.16.0.220,3260]
Nov 14 09:49:10 user nova-compute[75229]: Logout of [sid: 14, target: iqn.2010-10.org.openstack:b0433e38-fa42-4cff-af48-8cb5da297597, portal: 172.16.0.220,3260] successful.
Nov 14 09:49:10 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:49:10 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0433e38-fa42-4cff-af48-8cb5da297597 -p 172.16.0.220:3260 --op delete {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:49:10 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0433e38-fa42-4cff-af48-8cb5da297597 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:49:10 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba25ca86-8f2f-4aa8-a776-7b32c8763fdb]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:49:10 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3267b15-b2b9-48f1-9a7e-99530506d1bc tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:49:10 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-c3267b15-b2b9-48f1-9a7e-99530506d1bc tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.426s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 09:49:10 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3267b15-b2b9-48f1-9a7e-99530506d1bc tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] <== disconnect_volume: return (427ms) None {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 09:49:10 user nova-compute[75229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c3267b15-b2b9-48f1-9a7e-99530506d1bc tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] [instance: 9bcd05e7-481c-4ee9-953d-2873e6aa849d] Disconnected iSCSI Volume {{(pid=75229) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 09:49:10 user nova-compute[75229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c3267b15-b2b9-48f1-9a7e-99530506d1bc tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] [instance: 9bcd05e7-481c-4ee9-953d-2873e6aa849d] calling os-brick to detach iSCSI Volume {{(pid=75229) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 09:49:10 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3267b15-b2b9-48f1-9a7e-99530506d1bc tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f73f85151b0>, {'target_iqn': 'iqn.2010-10.org.openstack:db131665-6ac2-437a-8adf-23593475a8aa', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TsGBKMaX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 09:49:10 user nova-compute[75229]: WARNING os_brick.initiator.connectors.base [None req-c3267b15-b2b9-48f1-9a7e-99530506d1bc tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 09:49:10 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-c3267b15-b2b9-48f1-9a7e-99530506d1bc tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 09:49:10 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-c3267b15-b2b9-48f1-9a7e-99530506d1bc tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 09:49:10 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:49:10 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:49:10 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[002528da-f483-4183-95e2-006f0ab95cea]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5b54e594-ae66-4ba2-9bda-aa4431d31c3f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:db131665-6ac2-437a-8adf-23593475a8aa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:aca09258-022b-4f04-b418-f2a170332755\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3fed285f-9be4-4601-8cb5-4329d7ebed8c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:49:10 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3267b15-b2b9-48f1-9a7e-99530506d1bc tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 09:49:10 user nova-compute[75229]: No targets found.
Nov 14 09:49:10 user nova-compute[75229]: iSNS:
Nov 14 09:49:10 user nova-compute[75229]: No targets found.
Nov 14 09:49:10 user nova-compute[75229]: STATIC:
Nov 14 09:49:10 user nova-compute[75229]: Target: iqn.2010-10.org.openstack:5b54e594-ae66-4ba2-9bda-aa4431d31c3f
Nov 14 09:49:10 user nova-compute[75229]:         Portal: 172.16.0.220:3260,-1
Nov 14 09:49:10 user nova-compute[75229]:                 Iface Name: default
Nov 14 09:49:10 user nova-compute[75229]: Target: iqn.2010-10.org.openstack:db131665-6ac2-437a-8adf-23593475a8aa
Nov 14 09:49:10 user nova-compute[75229]:         Portal: 172.16.0.220:3260,-1
Nov 14 09:49:10 user nova-compute[75229]:                 Iface Name: default
Nov 14 09:49:10 user nova-compute[75229]: Target: iqn.2010-10.org.openstack:aca09258-022b-4f04-b418-f2a170332755
Nov 14 09:49:10 user nova-compute[75229]:         Portal: 172.16.0.220:3260,-1
Nov 14 09:49:10 user nova-compute[75229]:                 Iface Name: default
Nov 14 09:49:10 user nova-compute[75229]: Target: iqn.2010-10.org.openstack:3fed285f-9be4-4601-8cb5-4329d7ebed8c
Nov 14 09:49:10 user nova-compute[75229]:         Portal: 172.16.0.220:3260,-1
Nov 14 09:49:10 user nova-compute[75229]:                 Iface Name: default
Nov 14 09:49:10 user nova-compute[75229]: FIRMWARE:
Nov 14 09:49:10 user nova-compute[75229]: No targets found.
Nov 14 09:49:10 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 09:49:10 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3267b15-b2b9-48f1-9a7e-99530506d1bc tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 09:49:10 user nova-compute[75229]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 09:49:10 user nova-compute[75229]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75229) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 09:49:10 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3267b15-b2b9-48f1-9a7e-99530506d1bc tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:db131665-6ac2-437a-8adf-23593475a8aa', 0)] {{(pid=75229) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 09:49:10 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:49:10 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:49:10 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6647d67-a2ad-4299-977d-98d8f43bbc98]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3fed285f-9be4-4601-8cb5-4329d7ebed8c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5b54e594-ae66-4ba2-9bda-aa4431d31c3f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aca09258-022b-4f04-b418-f2a170332755\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:db131665-6ac2-437a-8adf-23593475a8aa\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:49:10 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:49:10 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:49:10 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bb4f01b-9698-4b4a-95c2-51127c7362d4]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db131665-6ac2-437a-8adf-23593475a8aa (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fed285f-9be4-4601-8cb5-4329d7ebed8c (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b54e594-ae66-4ba2-9bda-aa4431d31c3f (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aca09258-022b-4f04-b418-f2a170332755 (non-flash)\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:49:10 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3267b15-b2b9-48f1-9a7e-99530506d1bc tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db131665-6ac2-437a-8adf-23593475a8aa (non-flash)
Nov 14 09:49:10 user nova-compute[75229]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fed285f-9be4-4601-8cb5-4329d7ebed8c (non-flash)
Nov 14 09:49:10 user nova-compute[75229]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b54e594-ae66-4ba2-9bda-aa4431d31c3f (non-flash)
Nov 14 09:49:10 user nova-compute[75229]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aca09258-022b-4f04-b418-f2a170332755 (non-flash)
Nov 14 09:49:10 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 09:49:10 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3267b15-b2b9-48f1-9a7e-99530506d1bc tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db131665-6ac2-437a-8adf-23593475a8aa (non-flash)
Nov 14 09:49:10 user nova-compute[75229]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fed285f-9be4-4601-8cb5-4329d7ebed8c (non-flash)
Nov 14 09:49:10 user nova-compute[75229]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b54e594-ae66-4ba2-9bda-aa4431d31c3f (non-flash)
Nov 14 09:49:10 user nova-compute[75229]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aca09258-022b-4f04-b418-f2a170332755 (non-flash)
Nov 14 09:49:10 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 09:49:10 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3267b15-b2b9-48f1-9a7e-99530506d1bc tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f73f8655870>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:db131665-6ac2-437a-8adf-23593475a8aa'): ({'sdb'}, set())}) {{(pid=75229) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 09:49:10 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-c3267b15-b2b9-48f1-9a7e-99530506d1bc tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] Removing single pathed devices sdb {{(pid=75229) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 09:49:10 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:49:10 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:49:10 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[db81752b-6860-40ca-9f97-2c6adbc88e91]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:49:10 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:49:10 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:49:10 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[591923fa-29ec-4f2e-b5d0-13f4120e2512]: (4, ('ok\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:49:10 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-c3267b15-b2b9-48f1-9a7e-99530506d1bc tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] Flushing IO for device /dev/sdb {{(pid=75229) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 09:49:10 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:49:10 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:49:10 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[9121cf19-cb07-443c-875e-1285b4116ceb]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:49:10 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-c3267b15-b2b9-48f1-9a7e-99530506d1bc tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75229) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 09:49:10 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:49:10 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.045s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:49:10 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[17e0223d-bbb7-4f51-ad12-37379565ee2f]: (4, ('1', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:49:10 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-c3267b15-b2b9-48f1-9a7e-99530506d1bc tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75229) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 09:49:10 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-c3267b15-b2b9-48f1-9a7e-99530506d1bc tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] SCSI volumes sdb have been removed. {{(pid=75229) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 09:49:10 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3267b15-b2b9-48f1-9a7e-99530506d1bc tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:db131665-6ac2-437a-8adf-23593475a8aa')] {{(pid=75229) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 09:49:10 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db131665-6ac2-437a-8adf-23593475a8aa -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:49:10 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db131665-6ac2-437a-8adf-23593475a8aa -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:49:10 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c0f81f5-7d5d-4587-8357-9a82a6f3a3ab]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:49:10 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3267b15-b2b9-48f1-9a7e-99530506d1bc tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:49:10 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db131665-6ac2-437a-8adf-23593475a8aa -p 172.16.0.220:3260 --logout {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:49:10 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db131665-6ac2-437a-8adf-23593475a8aa -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:49:10 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[33d7cf6c-28ad-401c-b12f-b8557eb34ec3]: (4, ('Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:db131665-6ac2-437a-8adf-23593475a8aa, portal: 172.16.0.220,3260]\nLogout of [sid: 13, target: iqn.2010-10.org.openstack:db131665-6ac2-437a-8adf-23593475a8aa, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:49:10 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3267b15-b2b9-48f1-9a7e-99530506d1bc tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:db131665-6ac2-437a-8adf-23593475a8aa, portal: 172.16.0.220,3260]
Nov 14 09:49:10 user nova-compute[75229]: Logout of [sid: 13, target: iqn.2010-10.org.openstack:db131665-6ac2-437a-8adf-23593475a8aa, portal: 172.16.0.220,3260] successful.
Nov 14 09:49:10 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:49:10 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db131665-6ac2-437a-8adf-23593475a8aa -p 172.16.0.220:3260 --op delete {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:49:10 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db131665-6ac2-437a-8adf-23593475a8aa -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:49:10 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d636b25-2efe-46cf-9a57-8c32badf9162]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:49:10 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3267b15-b2b9-48f1-9a7e-99530506d1bc tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:49:10 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-c3267b15-b2b9-48f1-9a7e-99530506d1bc tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.337s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 09:49:10 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3267b15-b2b9-48f1-9a7e-99530506d1bc tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] <== disconnect_volume: return (338ms) None {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 09:49:10 user nova-compute[75229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c3267b15-b2b9-48f1-9a7e-99530506d1bc tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] [instance: 9bcd05e7-481c-4ee9-953d-2873e6aa849d] Disconnected iSCSI Volume {{(pid=75229) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 09:49:10 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-c3267b15-b2b9-48f1-9a7e-99530506d1bc tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] [instance: 9bcd05e7-481c-4ee9-953d-2873e6aa849d] Deleting instance files /opt/stack/data/nova/instances/9bcd05e7-481c-4ee9-953d-2873e6aa849d_del
Nov 14 09:49:10 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-c3267b15-b2b9-48f1-9a7e-99530506d1bc tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] [instance: 9bcd05e7-481c-4ee9-953d-2873e6aa849d] Deletion of /opt/stack/data/nova/instances/9bcd05e7-481c-4ee9-953d-2873e6aa849d_del complete
Nov 14 09:49:10 user nova-compute[75229]: INFO nova.compute.manager [None req-c3267b15-b2b9-48f1-9a7e-99530506d1bc tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] [instance: 9bcd05e7-481c-4ee9-953d-2873e6aa849d] Took 3.84 seconds to destroy the instance on the hypervisor.
Nov 14 09:49:10 user nova-compute[75229]: DEBUG oslo.service.loopingcall [None req-c3267b15-b2b9-48f1-9a7e-99530506d1bc tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75229) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 09:49:10 user nova-compute[75229]: DEBUG nova.compute.manager [-] [instance: 9bcd05e7-481c-4ee9-953d-2873e6aa849d] Deallocating network for instance {{(pid=75229) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 09:49:10 user nova-compute[75229]: DEBUG nova.network.neutron [-] [instance: 9bcd05e7-481c-4ee9-953d-2873e6aa849d] deallocate_for_instance() {{(pid=75229) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 09:49:12 user nova-compute[75229]: DEBUG nova.compute.manager [req-3e3b849e-f5b7-4362-b7c9-b5402f58a672 req-5ec29a56-ab5b-4cc0-a365-7f14422ea31a service nova] [instance: 9bcd05e7-481c-4ee9-953d-2873e6aa849d] Received event network-vif-deleted-1766a369-08d0-4fc1-b0b3-fc8e3c6a051f {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:49:12 user nova-compute[75229]: INFO nova.compute.manager [req-3e3b849e-f5b7-4362-b7c9-b5402f58a672 req-5ec29a56-ab5b-4cc0-a365-7f14422ea31a service nova] [instance: 9bcd05e7-481c-4ee9-953d-2873e6aa849d] Neutron deleted interface 1766a369-08d0-4fc1-b0b3-fc8e3c6a051f; detaching it from the instance and deleting it from the info cache
Nov 14 09:49:12 user nova-compute[75229]: DEBUG nova.network.neutron [req-3e3b849e-f5b7-4362-b7c9-b5402f58a672 req-5ec29a56-ab5b-4cc0-a365-7f14422ea31a service nova] [instance: 9bcd05e7-481c-4ee9-953d-2873e6aa849d] Updating instance_info_cache with network_info: [{"id": "71040f8f-3771-47df-a138-07571bf3eb9b", "address": "fa:16:3e:76:1c:74", "network": {"id": "8efb8df0-c10e-46aa-b2e0-bb03cfeb00e8", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-2058178363-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.71", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "703b87f76dd845e4846d746bbf3dbb6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71040f8f-37", "ovs_interfaceid": "71040f8f-3771-47df-a138-07571bf3eb9b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ddcf0922-99ea-4e9f-8fe3-61df68231a99", "address": "fa:16:3e:2d:60:2c", "network": {"id": "cd9117eb-aeb0-4c47-b450-2286d1680ed3", "bridge": "br-int", "label": "tempest-device-tagging-net1-1915364084", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.144", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "703b87f76dd845e4846d746bbf3dbb6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapddcf0922-99", "ovs_interfaceid": "ddcf0922-99ea-4e9f-8fe3-61df68231a99", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "db5f7129-8708-4f26-9975-c462270d47f3", "address": "fa:16:3e:6a:77:bd", "network": {"id": "cd9117eb-aeb0-4c47-b450-2286d1680ed3", "bridge": "br-int", "label": "tempest-device-tagging-net1-1915364084", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.33", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "703b87f76dd845e4846d746bbf3dbb6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb5f7129-87", "ovs_interfaceid": "db5f7129-8708-4f26-9975-c462270d47f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7363cfca-de5d-4f2f-b467-752de544bc21", "address": "fa:16:3e:f9:0c:a4", "network": {"id": "cd9117eb-aeb0-4c47-b450-2286d1680ed3", "bridge": "br-int", "label": "tempest-device-tagging-net1-1915364084", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.239", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "703b87f76dd845e4846d746bbf3dbb6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7363cfca-de", "ovs_interfaceid": "7363cfca-de5d-4f2f-b467-752de544bc21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "fccc2ab0-7340-4ab5-be12-dd7b08c0cc72", "address": "fa:16:3e:bf:7e:6f", "network": {"id": "cd9117eb-aeb0-4c47-b450-2286d1680ed3", "bridge": "br-int", "label": "tempest-device-tagging-net1-1915364084", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.125", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "703b87f76dd845e4846d746bbf3dbb6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfccc2ab0-73", "ovs_interfaceid": "fccc2ab0-7340-4ab5-be12-dd7b08c0cc72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "94fc3f23-6f54-4e7c-815d-bf0c53245856", "address": "fa:16:3e:51:94:fa", "network": {"id": "5584ce2f-1d94-4822-b275-d059d121bea5", "bridge": "br-int", "label": "tempest-device-tagging-net2-310256364", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "703b87f76dd845e4846d746bbf3dbb6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94fc3f23-6f", "ovs_interfaceid": "94fc3f23-6f54-4e7c-815d-bf0c53245856", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 09:49:12 user nova-compute[75229]: DEBUG nova.compute.manager [req-3e3b849e-f5b7-4362-b7c9-b5402f58a672 req-5ec29a56-ab5b-4cc0-a365-7f14422ea31a service nova] [instance: 9bcd05e7-481c-4ee9-953d-2873e6aa849d] Detach interface failed, port_id=1766a369-08d0-4fc1-b0b3-fc8e3c6a051f, reason: Instance 9bcd05e7-481c-4ee9-953d-2873e6aa849d could not be found. {{(pid=75229) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 14 09:49:13 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:49:14 user nova-compute[75229]: DEBUG nova.network.neutron [-] [instance: 9bcd05e7-481c-4ee9-953d-2873e6aa849d] Updating instance_info_cache with network_info: [] {{(pid=75229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 09:49:14 user nova-compute[75229]: INFO nova.compute.manager [-] [instance: 9bcd05e7-481c-4ee9-953d-2873e6aa849d] Took 3.58 seconds to deallocate network for instance.
Nov 14 09:49:14 user nova-compute[75229]: DEBUG nova.compute.manager [req-849a8e79-ec13-408a-b938-697de71c24e3 req-82e9e557-e20d-4315-9928-438e1b7670d4 service nova] [instance: 9bcd05e7-481c-4ee9-953d-2873e6aa849d] Received event network-vif-deleted-71040f8f-3771-47df-a138-07571bf3eb9b {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:49:14 user nova-compute[75229]: DEBUG nova.compute.manager [req-849a8e79-ec13-408a-b938-697de71c24e3 req-82e9e557-e20d-4315-9928-438e1b7670d4 service nova] [instance: 9bcd05e7-481c-4ee9-953d-2873e6aa849d] Received event network-vif-deleted-94fc3f23-6f54-4e7c-815d-bf0c53245856 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:49:14 user nova-compute[75229]: DEBUG nova.compute.manager [req-849a8e79-ec13-408a-b938-697de71c24e3 req-82e9e557-e20d-4315-9928-438e1b7670d4 service nova] [instance: 9bcd05e7-481c-4ee9-953d-2873e6aa849d] Received event network-vif-deleted-fccc2ab0-7340-4ab5-be12-dd7b08c0cc72 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:49:14 user nova-compute[75229]: DEBUG nova.compute.manager [req-849a8e79-ec13-408a-b938-697de71c24e3 req-82e9e557-e20d-4315-9928-438e1b7670d4 service nova] [instance: 9bcd05e7-481c-4ee9-953d-2873e6aa849d] Received event network-vif-deleted-7363cfca-de5d-4f2f-b467-752de544bc21 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:49:14 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:49:16 user nova-compute[75229]: INFO nova.compute.manager [None req-c3267b15-b2b9-48f1-9a7e-99530506d1bc tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] [instance: 9bcd05e7-481c-4ee9-953d-2873e6aa849d] Took 2.35 seconds to detach 3 volumes for instance.
Nov 14 09:49:16 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-c3267b15-b2b9-48f1-9a7e-99530506d1bc tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:49:16 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-c3267b15-b2b9-48f1-9a7e-99530506d1bc tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:49:16 user nova-compute[75229]: DEBUG nova.compute.provider_tree [None req-c3267b15-b2b9-48f1-9a7e-99530506d1bc tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] Inventory has not changed in ProviderTree for provider: d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 {{(pid=75229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 09:49:16 user nova-compute[75229]: DEBUG nova.scheduler.client.report [None req-c3267b15-b2b9-48f1-9a7e-99530506d1bc tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] Inventory has not changed for provider d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 09:49:17 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-c3267b15-b2b9-48f1-9a7e-99530506d1bc tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.449s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:49:17 user nova-compute[75229]: INFO nova.scheduler.client.report [None req-c3267b15-b2b9-48f1-9a7e-99530506d1bc tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] Deleted allocations for instance 9bcd05e7-481c-4ee9-953d-2873e6aa849d
Nov 14 09:49:17 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-c3267b15-b2b9-48f1-9a7e-99530506d1bc tempest-TaggedBootDevicesTest_v242-1091422151 tempest-TaggedBootDevicesTest_v242-1091422151-project-member] Lock "9bcd05e7-481c-4ee9-953d-2873e6aa849d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 10.467s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:49:19 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 09:49:19 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:49:19 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75229) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 09:49:19 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75229) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 09:49:19 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75229) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 09:49:19 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:49:20 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:49:21 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:49:23 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:49:24 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:49:25 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:49:27 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:49:27 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-dc2298af-0efe-4953-80f9-1007c75f1268 tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Acquiring lock "90bd76df-96cb-4bec-9862-853d94cdbaab" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:49:27 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-dc2298af-0efe-4953-80f9-1007c75f1268 tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Lock "90bd76df-96cb-4bec-9862-853d94cdbaab" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:49:27 user nova-compute[75229]: INFO nova.compute.manager [None req-dc2298af-0efe-4953-80f9-1007c75f1268 tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] [instance: 90bd76df-96cb-4bec-9862-853d94cdbaab] Detaching volume 5b54e594-ae66-4ba2-9bda-aa4431d31c3f
Nov 14 09:49:27 user nova-compute[75229]: INFO nova.virt.block_device [None req-dc2298af-0efe-4953-80f9-1007c75f1268 tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] [instance: 90bd76df-96cb-4bec-9862-853d94cdbaab] Attempting to driver detach volume 5b54e594-ae66-4ba2-9bda-aa4431d31c3f from mountpoint /dev/vdc
Nov 14 09:49:27 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-dc2298af-0efe-4953-80f9-1007c75f1268 tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Attempting to detach device vdc from instance 90bd76df-96cb-4bec-9862-853d94cdbaab from the persistent domain config. {{(pid=75229) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 09:49:27 user nova-compute[75229]: DEBUG nova.virt.libvirt.guest [None req-dc2298af-0efe-4953-80f9-1007c75f1268 tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 09:49:27 user nova-compute[75229]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 09:49:27 user nova-compute[75229]:   <source dev="/dev/sdg"/>
Nov 14 09:49:27 user nova-compute[75229]:   <target dev="vdc" bus="virtio"/>
Nov 14 09:49:27 user nova-compute[75229]:   <serial>5b54e594-ae66-4ba2-9bda-aa4431d31c3f</serial>
Nov 14 09:49:27 user nova-compute[75229]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 14 09:49:27 user nova-compute[75229]: </disk>
Nov 14 09:49:27 user nova-compute[75229]:  {{(pid=75229) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 09:49:27 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-dc2298af-0efe-4953-80f9-1007c75f1268 tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Successfully detached device vdc from instance 90bd76df-96cb-4bec-9862-853d94cdbaab from the persistent domain config.
Nov 14 09:49:27 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-dc2298af-0efe-4953-80f9-1007c75f1268 tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 90bd76df-96cb-4bec-9862-853d94cdbaab from the live domain config. {{(pid=75229) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 09:49:27 user nova-compute[75229]: DEBUG nova.virt.libvirt.guest [None req-dc2298af-0efe-4953-80f9-1007c75f1268 tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 09:49:27 user nova-compute[75229]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 09:49:27 user nova-compute[75229]:   <source dev="/dev/sdg"/>
Nov 14 09:49:27 user nova-compute[75229]:   <target dev="vdc" bus="virtio"/>
Nov 14 09:49:27 user nova-compute[75229]:   <serial>5b54e594-ae66-4ba2-9bda-aa4431d31c3f</serial>
Nov 14 09:49:27 user nova-compute[75229]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 14 09:49:27 user nova-compute[75229]: </disk>
Nov 14 09:49:27 user nova-compute[75229]:  {{(pid=75229) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 09:49:28 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:49:28 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-dc2298af-0efe-4953-80f9-1007c75f1268 tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 90bd76df-96cb-4bec-9862-853d94cdbaab {{(pid=75229) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 09:49:29 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:49:30 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bab54164-97e4-4c55-8750-6dd384f6d7aa tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] Acquiring lock "a4ce290f-6dd2-44b6-91be-8e775045837e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:49:30 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bab54164-97e4-4c55-8750-6dd384f6d7aa tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] Lock "a4ce290f-6dd2-44b6-91be-8e775045837e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:49:30 user nova-compute[75229]: DEBUG nova.compute.manager [None req-bab54164-97e4-4c55-8750-6dd384f6d7aa tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] [instance: a4ce290f-6dd2-44b6-91be-8e775045837e] Starting instance... {{(pid=75229) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 09:49:31 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bab54164-97e4-4c55-8750-6dd384f6d7aa tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:49:31 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bab54164-97e4-4c55-8750-6dd384f6d7aa tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:49:31 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-bab54164-97e4-4c55-8750-6dd384f6d7aa tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75229) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 09:49:31 user nova-compute[75229]: INFO nova.compute.claims [None req-bab54164-97e4-4c55-8750-6dd384f6d7aa tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] [instance: a4ce290f-6dd2-44b6-91be-8e775045837e] Claim successful on node user
Nov 14 09:49:31 user nova-compute[75229]: DEBUG nova.compute.provider_tree [None req-bab54164-97e4-4c55-8750-6dd384f6d7aa tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] Inventory has not changed in ProviderTree for provider: d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 {{(pid=75229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 09:49:31 user nova-compute[75229]: DEBUG nova.scheduler.client.report [None req-bab54164-97e4-4c55-8750-6dd384f6d7aa tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] Inventory has not changed for provider d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 09:49:31 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bab54164-97e4-4c55-8750-6dd384f6d7aa tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.431s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:49:31 user nova-compute[75229]: DEBUG nova.compute.manager [None req-bab54164-97e4-4c55-8750-6dd384f6d7aa tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] [instance: a4ce290f-6dd2-44b6-91be-8e775045837e] Start building networks asynchronously for instance. {{(pid=75229) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 09:49:31 user nova-compute[75229]: DEBUG nova.compute.manager [None req-bab54164-97e4-4c55-8750-6dd384f6d7aa tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] [instance: a4ce290f-6dd2-44b6-91be-8e775045837e] Allocating IP information in the background. {{(pid=75229) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 09:49:31 user nova-compute[75229]: DEBUG nova.network.neutron [None req-bab54164-97e4-4c55-8750-6dd384f6d7aa tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] [instance: a4ce290f-6dd2-44b6-91be-8e775045837e] allocate_for_instance() {{(pid=75229) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 09:49:31 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-bab54164-97e4-4c55-8750-6dd384f6d7aa tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] [instance: a4ce290f-6dd2-44b6-91be-8e775045837e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 09:49:31 user nova-compute[75229]: DEBUG nova.compute.manager [None req-bab54164-97e4-4c55-8750-6dd384f6d7aa tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] [instance: a4ce290f-6dd2-44b6-91be-8e775045837e] Start building block device mappings for instance. {{(pid=75229) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 09:49:31 user nova-compute[75229]: DEBUG nova.policy [None req-bab54164-97e4-4c55-8750-6dd384f6d7aa tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9b525334713e47ceb8f71035116d5c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a196548d9de4e18b8bab9fefdab0861', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75229) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 09:49:31 user nova-compute[75229]: DEBUG nova.compute.manager [None req-bab54164-97e4-4c55-8750-6dd384f6d7aa tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] [instance: a4ce290f-6dd2-44b6-91be-8e775045837e] Start spawning the instance on the hypervisor. {{(pid=75229) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 09:49:31 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-bab54164-97e4-4c55-8750-6dd384f6d7aa tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] [instance: a4ce290f-6dd2-44b6-91be-8e775045837e] Creating instance directory {{(pid=75229) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 09:49:31 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-bab54164-97e4-4c55-8750-6dd384f6d7aa tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] [instance: a4ce290f-6dd2-44b6-91be-8e775045837e] Creating image(s)
Nov 14 09:49:31 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bab54164-97e4-4c55-8750-6dd384f6d7aa tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] Acquiring lock "/opt/stack/data/nova/instances/a4ce290f-6dd2-44b6-91be-8e775045837e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:49:31 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bab54164-97e4-4c55-8750-6dd384f6d7aa tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] Lock "/opt/stack/data/nova/instances/a4ce290f-6dd2-44b6-91be-8e775045837e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:49:31 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bab54164-97e4-4c55-8750-6dd384f6d7aa tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] Lock "/opt/stack/data/nova/instances/a4ce290f-6dd2-44b6-91be-8e775045837e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:49:31 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bab54164-97e4-4c55-8750-6dd384f6d7aa tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6 --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:49:31 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:49:31 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bab54164-97e4-4c55-8750-6dd384f6d7aa tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6 --force-share --output=json" returned: 0 in 0.174s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:49:31 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bab54164-97e4-4c55-8750-6dd384f6d7aa tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] Acquiring lock "4f30e3fe703d2381679612a57b1fb80a467f60b6" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:49:31 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bab54164-97e4-4c55-8750-6dd384f6d7aa tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] Lock "4f30e3fe703d2381679612a57b1fb80a467f60b6" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:49:31 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bab54164-97e4-4c55-8750-6dd384f6d7aa tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6 --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:49:32 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bab54164-97e4-4c55-8750-6dd384f6d7aa tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6 --force-share --output=json" returned: 0 in 0.171s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:49:32 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bab54164-97e4-4c55-8750-6dd384f6d7aa tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6,backing_fmt=raw /opt/stack/data/nova/instances/a4ce290f-6dd2-44b6-91be-8e775045837e/disk 1073741824 {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:49:33 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bab54164-97e4-4c55-8750-6dd384f6d7aa tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6,backing_fmt=raw /opt/stack/data/nova/instances/a4ce290f-6dd2-44b6-91be-8e775045837e/disk 1073741824" returned: 0 in 0.182s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:49:33 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bab54164-97e4-4c55-8750-6dd384f6d7aa tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] Lock "4f30e3fe703d2381679612a57b1fb80a467f60b6" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.361s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:49:33 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bab54164-97e4-4c55-8750-6dd384f6d7aa tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6 --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:49:33 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bab54164-97e4-4c55-8750-6dd384f6d7aa tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6 --force-share --output=json" returned: 0 in 0.253s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:49:33 user nova-compute[75229]: DEBUG nova.virt.disk.api [None req-bab54164-97e4-4c55-8750-6dd384f6d7aa tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a4ce290f-6dd2-44b6-91be-8e775045837e/disk. size=1073741824 {{(pid=75229) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 09:49:33 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bab54164-97e4-4c55-8750-6dd384f6d7aa tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4ce290f-6dd2-44b6-91be-8e775045837e/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:49:33 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bab54164-97e4-4c55-8750-6dd384f6d7aa tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4ce290f-6dd2-44b6-91be-8e775045837e/disk --force-share --output=json" returned: 0 in 0.316s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:49:33 user nova-compute[75229]: DEBUG nova.virt.disk.api [None req-bab54164-97e4-4c55-8750-6dd384f6d7aa tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] Cannot resize image /opt/stack/data/nova/instances/a4ce290f-6dd2-44b6-91be-8e775045837e/disk to a smaller size. {{(pid=75229) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 09:49:33 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-bab54164-97e4-4c55-8750-6dd384f6d7aa tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] [instance: a4ce290f-6dd2-44b6-91be-8e775045837e] Created local disks {{(pid=75229) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 09:49:33 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-bab54164-97e4-4c55-8750-6dd384f6d7aa tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] [instance: a4ce290f-6dd2-44b6-91be-8e775045837e] Ensure instance console log exists: /opt/stack/data/nova/instances/a4ce290f-6dd2-44b6-91be-8e775045837e/console.log {{(pid=75229) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 09:49:33 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bab54164-97e4-4c55-8750-6dd384f6d7aa tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:49:33 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bab54164-97e4-4c55-8750-6dd384f6d7aa tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:49:33 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bab54164-97e4-4c55-8750-6dd384f6d7aa tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:49:33 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:49:33 user nova-compute[75229]: DEBUG nova.network.neutron [None req-bab54164-97e4-4c55-8750-6dd384f6d7aa tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] [instance: a4ce290f-6dd2-44b6-91be-8e775045837e] Successfully created port: 0621f697-c41d-49da-9b80-6a2879fef41e {{(pid=75229) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 09:49:34 user nova-compute[75229]: DEBUG nova.network.neutron [None req-bab54164-97e4-4c55-8750-6dd384f6d7aa tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] [instance: a4ce290f-6dd2-44b6-91be-8e775045837e] Successfully updated port: 0621f697-c41d-49da-9b80-6a2879fef41e {{(pid=75229) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 09:49:34 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bab54164-97e4-4c55-8750-6dd384f6d7aa tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] Acquiring lock "refresh_cache-a4ce290f-6dd2-44b6-91be-8e775045837e" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 09:49:34 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bab54164-97e4-4c55-8750-6dd384f6d7aa tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] Acquired lock "refresh_cache-a4ce290f-6dd2-44b6-91be-8e775045837e" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 09:49:34 user nova-compute[75229]: DEBUG nova.network.neutron [None req-bab54164-97e4-4c55-8750-6dd384f6d7aa tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] [instance: a4ce290f-6dd2-44b6-91be-8e775045837e] Building network info cache for instance {{(pid=75229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 09:49:34 user nova-compute[75229]: DEBUG nova.compute.manager [req-55ce63c5-6b7b-45d0-ab7d-10300b30b486 req-e5da18dd-3da1-49cd-81cb-4f1856cf6049 service nova] [instance: a4ce290f-6dd2-44b6-91be-8e775045837e] Received event network-changed-0621f697-c41d-49da-9b80-6a2879fef41e {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:49:34 user nova-compute[75229]: DEBUG nova.compute.manager [req-55ce63c5-6b7b-45d0-ab7d-10300b30b486 req-e5da18dd-3da1-49cd-81cb-4f1856cf6049 service nova] [instance: a4ce290f-6dd2-44b6-91be-8e775045837e] Refreshing instance network info cache due to event network-changed-0621f697-c41d-49da-9b80-6a2879fef41e. {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 09:49:34 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-55ce63c5-6b7b-45d0-ab7d-10300b30b486 req-e5da18dd-3da1-49cd-81cb-4f1856cf6049 service nova] Acquiring lock "refresh_cache-a4ce290f-6dd2-44b6-91be-8e775045837e" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 09:49:34 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:49:34 user nova-compute[75229]: DEBUG nova.network.neutron [None req-bab54164-97e4-4c55-8750-6dd384f6d7aa tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] [instance: a4ce290f-6dd2-44b6-91be-8e775045837e] Instance cache missing network info. {{(pid=75229) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 09:49:34 user nova-compute[75229]: DEBUG nova.network.neutron [None req-bab54164-97e4-4c55-8750-6dd384f6d7aa tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] [instance: a4ce290f-6dd2-44b6-91be-8e775045837e] Updating instance_info_cache with network_info: [{"id": "0621f697-c41d-49da-9b80-6a2879fef41e", "address": "fa:16:3e:34:59:a9", "network": {"id": "8d89f286-0349-4334-b27a-873f684d3652", "bridge": "br-int", "label": "tempest-TestStampPattern-841799214-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a196548d9de4e18b8bab9fefdab0861", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0621f697-c4", "ovs_interfaceid": "0621f697-c41d-49da-9b80-6a2879fef41e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 09:49:34 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bab54164-97e4-4c55-8750-6dd384f6d7aa tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] Releasing lock "refresh_cache-a4ce290f-6dd2-44b6-91be-8e775045837e" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 09:49:34 user nova-compute[75229]: DEBUG nova.compute.manager [None req-bab54164-97e4-4c55-8750-6dd384f6d7aa tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] [instance: a4ce290f-6dd2-44b6-91be-8e775045837e] Instance network_info: |[{"id": "0621f697-c41d-49da-9b80-6a2879fef41e", "address": "fa:16:3e:34:59:a9", "network": {"id": "8d89f286-0349-4334-b27a-873f684d3652", "bridge": "br-int", "label": "tempest-TestStampPattern-841799214-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a196548d9de4e18b8bab9fefdab0861", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0621f697-c4", "ovs_interfaceid": "0621f697-c41d-49da-9b80-6a2879fef41e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75229) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 09:49:34 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-55ce63c5-6b7b-45d0-ab7d-10300b30b486 req-e5da18dd-3da1-49cd-81cb-4f1856cf6049 service nova] Acquired lock "refresh_cache-a4ce290f-6dd2-44b6-91be-8e775045837e" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 09:49:34 user nova-compute[75229]: DEBUG nova.network.neutron [req-55ce63c5-6b7b-45d0-ab7d-10300b30b486 req-e5da18dd-3da1-49cd-81cb-4f1856cf6049 service nova] [instance: a4ce290f-6dd2-44b6-91be-8e775045837e] Refreshing network info cache for port 0621f697-c41d-49da-9b80-6a2879fef41e {{(pid=75229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 09:49:34 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-bab54164-97e4-4c55-8750-6dd384f6d7aa tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] [instance: a4ce290f-6dd2-44b6-91be-8e775045837e] Start _get_guest_xml network_info=[{"id": "0621f697-c41d-49da-9b80-6a2879fef41e", "address": "fa:16:3e:34:59:a9", "network": {"id": "8d89f286-0349-4334-b27a-873f684d3652", "bridge": "br-int", "label": "tempest-TestStampPattern-841799214-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a196548d9de4e18b8bab9fefdab0861", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0621f697-c4", "ovs_interfaceid": "0621f697-c41d-49da-9b80-6a2879fef41e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T09:40:10Z,direct_url=<?>,disk_format='qcow2',id=3bef8470-ecc7-40e3-95d4-9254348ea72d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='de5a91106b6948ed937a7178ff9464c4',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T09:40:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'disk_bus': 'virtio', 'guest_format': None, 'encryption_secret_uuid': None, 'size': 0, 'device_type': 'disk', 'image_id': '3bef8470-ecc7-40e3-95d4-9254348ea72d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75229) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 09:49:34 user nova-compute[75229]: WARNING nova.virt.libvirt.driver [None req-bab54164-97e4-4c55-8750-6dd384f6d7aa tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 09:49:34 user nova-compute[75229]: WARNING nova.virt.libvirt.driver [None req-bab54164-97e4-4c55-8750-6dd384f6d7aa tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 09:49:34 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-bab54164-97e4-4c55-8750-6dd384f6d7aa tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75229) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 09:49:34 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-bab54164-97e4-4c55-8750-6dd384f6d7aa tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] CPU controller missing on host. {{(pid=75229) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 09:49:34 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-bab54164-97e4-4c55-8750-6dd384f6d7aa tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75229) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 09:49:34 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-bab54164-97e4-4c55-8750-6dd384f6d7aa tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] CPU controller found on host. {{(pid=75229) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 09:49:34 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-bab54164-97e4-4c55-8750-6dd384f6d7aa tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75229) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 09:49:34 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-bab54164-97e4-4c55-8750-6dd384f6d7aa tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T09:39:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T09:40:10Z,direct_url=<?>,disk_format='qcow2',id=3bef8470-ecc7-40e3-95d4-9254348ea72d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='de5a91106b6948ed937a7178ff9464c4',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T09:40:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 09:49:34 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-bab54164-97e4-4c55-8750-6dd384f6d7aa tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] Flavor limits 0:0:0 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 09:49:34 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-bab54164-97e4-4c55-8750-6dd384f6d7aa tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] Image limits 0:0:0 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 09:49:34 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-bab54164-97e4-4c55-8750-6dd384f6d7aa tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] Flavor pref 0:0:0 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 09:49:34 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-bab54164-97e4-4c55-8750-6dd384f6d7aa tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] Image pref 0:0:0 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 09:49:34 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-bab54164-97e4-4c55-8750-6dd384f6d7aa tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 09:49:34 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-bab54164-97e4-4c55-8750-6dd384f6d7aa tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 09:49:34 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-bab54164-97e4-4c55-8750-6dd384f6d7aa tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75229) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 09:49:34 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-bab54164-97e4-4c55-8750-6dd384f6d7aa tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] Got 1 possible topologies {{(pid=75229) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 09:49:34 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-bab54164-97e4-4c55-8750-6dd384f6d7aa tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 09:49:34 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-bab54164-97e4-4c55-8750-6dd384f6d7aa tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 09:49:34 user nova-compute[75229]: DEBUG nova.virt.libvirt.vif [None req-bab54164-97e4-4c55-8750-6dd384f6d7aa tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T09:49:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-627374227',display_name='tempest-TestStampPattern-server-627374227',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-627374227',id=20,image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC4/xEtZHm9Yk+8VKGmlmnaP2DqqxnCgXK/PuxMNYGLOnEJxt/VGvxZAFawEytkJILlGgczmBioMsbqPdSyGvSqffIJvSQLFesfq/9wXT8F6tu1JAnyvbNVNg8/xsFVJ6w==',key_name='tempest-TestStampPattern-1732599618',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6a196548d9de4e18b8bab9fefdab0861',ramdisk_id='',reservation_id='r-0eflrpcq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-1637982262',owner_user_name='tempest-TestStampPattern-1637982262-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T09:49:32Z,user_data=None,user_id='9b525334713e47ceb8f71035116d5c36',uuid=a4ce290f-6dd2-44b6-91be-8e775045837e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0621f697-c41d-49da-9b80-6a2879fef41e", "address": "fa:16:3e:34:59:a9", "network": {"id": "8d89f286-0349-4334-b27a-873f684d3652", "bridge": "br-int", "label": "tempest-TestStampPattern-841799214-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a196548d9de4e18b8bab9fefdab0861", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0621f697-c4", "ovs_interfaceid": "0621f697-c41d-49da-9b80-6a2879fef41e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75229) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 09:49:34 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-bab54164-97e4-4c55-8750-6dd384f6d7aa tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] Converting VIF {"id": "0621f697-c41d-49da-9b80-6a2879fef41e", "address": "fa:16:3e:34:59:a9", "network": {"id": "8d89f286-0349-4334-b27a-873f684d3652", "bridge": "br-int", "label": "tempest-TestStampPattern-841799214-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a196548d9de4e18b8bab9fefdab0861", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0621f697-c4", "ovs_interfaceid": "0621f697-c41d-49da-9b80-6a2879fef41e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 09:49:34 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-bab54164-97e4-4c55-8750-6dd384f6d7aa tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:34:59:a9,bridge_name='br-int',has_traffic_filtering=True,id=0621f697-c41d-49da-9b80-6a2879fef41e,network=Network(8d89f286-0349-4334-b27a-873f684d3652),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0621f697-c4') {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 09:49:34 user nova-compute[75229]: DEBUG nova.objects.instance [None req-bab54164-97e4-4c55-8750-6dd384f6d7aa tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] Lazy-loading 'pci_devices' on Instance uuid a4ce290f-6dd2-44b6-91be-8e775045837e {{(pid=75229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 09:49:34 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-bab54164-97e4-4c55-8750-6dd384f6d7aa tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] [instance: a4ce290f-6dd2-44b6-91be-8e775045837e] End _get_guest_xml xml=<domain type="kvm">
Nov 14 09:49:34 user nova-compute[75229]:   <uuid>a4ce290f-6dd2-44b6-91be-8e775045837e</uuid>
Nov 14 09:49:34 user nova-compute[75229]:   <name>instance-00000014</name>
Nov 14 09:49:34 user nova-compute[75229]:   <memory>524288</memory>
Nov 14 09:49:34 user nova-compute[75229]:   <vcpu>1</vcpu>
Nov 14 09:49:34 user nova-compute[75229]:   <metadata>
Nov 14 09:49:34 user nova-compute[75229]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 09:49:34 user nova-compute[75229]:       <nova:package version="0.0.0"/>
Nov 14 09:49:34 user nova-compute[75229]:       <nova:name>tempest-TestStampPattern-server-627374227</nova:name>
Nov 14 09:49:34 user nova-compute[75229]:       <nova:creationTime>2023-11-14 09:49:34</nova:creationTime>
Nov 14 09:49:34 user nova-compute[75229]:       <nova:flavor name="m1.tiny">
Nov 14 09:49:34 user nova-compute[75229]:         <nova:memory>512</nova:memory>
Nov 14 09:49:34 user nova-compute[75229]:         <nova:disk>1</nova:disk>
Nov 14 09:49:34 user nova-compute[75229]:         <nova:swap>0</nova:swap>
Nov 14 09:49:34 user nova-compute[75229]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 09:49:34 user nova-compute[75229]:         <nova:vcpus>1</nova:vcpus>
Nov 14 09:49:34 user nova-compute[75229]:       </nova:flavor>
Nov 14 09:49:34 user nova-compute[75229]:       <nova:owner>
Nov 14 09:49:34 user nova-compute[75229]:         <nova:user uuid="9b525334713e47ceb8f71035116d5c36">tempest-TestStampPattern-1637982262-project-member</nova:user>
Nov 14 09:49:34 user nova-compute[75229]:         <nova:project uuid="6a196548d9de4e18b8bab9fefdab0861">tempest-TestStampPattern-1637982262</nova:project>
Nov 14 09:49:34 user nova-compute[75229]:       </nova:owner>
Nov 14 09:49:34 user nova-compute[75229]:       <nova:root type="image" uuid="3bef8470-ecc7-40e3-95d4-9254348ea72d"/>
Nov 14 09:49:34 user nova-compute[75229]:       <nova:ports>
Nov 14 09:49:34 user nova-compute[75229]:         <nova:port uuid="0621f697-c41d-49da-9b80-6a2879fef41e">
Nov 14 09:49:34 user nova-compute[75229]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 14 09:49:34 user nova-compute[75229]:         </nova:port>
Nov 14 09:49:34 user nova-compute[75229]:       </nova:ports>
Nov 14 09:49:34 user nova-compute[75229]:     </nova:instance>
Nov 14 09:49:34 user nova-compute[75229]:   </metadata>
Nov 14 09:49:34 user nova-compute[75229]:   <sysinfo type="smbios">
Nov 14 09:49:34 user nova-compute[75229]:     <system>
Nov 14 09:49:34 user nova-compute[75229]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 09:49:34 user nova-compute[75229]:       <entry name="product">OpenStack Nova</entry>
Nov 14 09:49:34 user nova-compute[75229]:       <entry name="version">0.0.0</entry>
Nov 14 09:49:34 user nova-compute[75229]:       <entry name="serial">a4ce290f-6dd2-44b6-91be-8e775045837e</entry>
Nov 14 09:49:34 user nova-compute[75229]:       <entry name="uuid">a4ce290f-6dd2-44b6-91be-8e775045837e</entry>
Nov 14 09:49:34 user nova-compute[75229]:       <entry name="family">Virtual Machine</entry>
Nov 14 09:49:34 user nova-compute[75229]:     </system>
Nov 14 09:49:34 user nova-compute[75229]:   </sysinfo>
Nov 14 09:49:34 user nova-compute[75229]:   <os>
Nov 14 09:49:34 user nova-compute[75229]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 09:49:34 user nova-compute[75229]:     <boot dev="hd"/>
Nov 14 09:49:34 user nova-compute[75229]:     <smbios mode="sysinfo"/>
Nov 14 09:49:34 user nova-compute[75229]:   </os>
Nov 14 09:49:34 user nova-compute[75229]:   <features>
Nov 14 09:49:34 user nova-compute[75229]:     <acpi/>
Nov 14 09:49:34 user nova-compute[75229]:     <apic/>
Nov 14 09:49:34 user nova-compute[75229]:     <vmcoreinfo/>
Nov 14 09:49:34 user nova-compute[75229]:   </features>
Nov 14 09:49:34 user nova-compute[75229]:   <clock offset="utc">
Nov 14 09:49:34 user nova-compute[75229]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 09:49:34 user nova-compute[75229]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 09:49:34 user nova-compute[75229]:     <timer name="hpet" present="no"/>
Nov 14 09:49:34 user nova-compute[75229]:   </clock>
Nov 14 09:49:34 user nova-compute[75229]:   <cpu mode="custom" match="exact">
Nov 14 09:49:34 user nova-compute[75229]:     <model>Nehalem</model>
Nov 14 09:49:34 user nova-compute[75229]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 09:49:34 user nova-compute[75229]:   </cpu>
Nov 14 09:49:34 user nova-compute[75229]:   <devices>
Nov 14 09:49:34 user nova-compute[75229]:     <disk type="file" device="disk">
Nov 14 09:49:34 user nova-compute[75229]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 09:49:34 user nova-compute[75229]:       <source file="/opt/stack/data/nova/instances/a4ce290f-6dd2-44b6-91be-8e775045837e/disk"/>
Nov 14 09:49:34 user nova-compute[75229]:       <target dev="vda" bus="virtio"/>
Nov 14 09:49:34 user nova-compute[75229]:     </disk>
Nov 14 09:49:34 user nova-compute[75229]:     <interface type="ethernet">
Nov 14 09:49:34 user nova-compute[75229]:       <mac address="fa:16:3e:34:59:a9"/>
Nov 14 09:49:34 user nova-compute[75229]:       <model type="virtio"/>
Nov 14 09:49:34 user nova-compute[75229]:       <mtu size="1442"/>
Nov 14 09:49:34 user nova-compute[75229]:       <target dev="tap0621f697-c4"/>
Nov 14 09:49:34 user nova-compute[75229]:     </interface>
Nov 14 09:49:34 user nova-compute[75229]:     <serial type="pty">
Nov 14 09:49:34 user nova-compute[75229]:       <log file="/opt/stack/data/nova/instances/a4ce290f-6dd2-44b6-91be-8e775045837e/console.log" append="off"/>
Nov 14 09:49:34 user nova-compute[75229]:     </serial>
Nov 14 09:49:34 user nova-compute[75229]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 09:49:34 user nova-compute[75229]:     <video>
Nov 14 09:49:34 user nova-compute[75229]:       <model type="virtio"/>
Nov 14 09:49:34 user nova-compute[75229]:     </video>
Nov 14 09:49:34 user nova-compute[75229]:     <rng model="virtio">
Nov 14 09:49:34 user nova-compute[75229]:       <backend model="random">/dev/urandom</backend>
Nov 14 09:49:34 user nova-compute[75229]:     </rng>
Nov 14 09:49:34 user nova-compute[75229]:     <controller type="usb" index="0" model="none"/>
Nov 14 09:49:34 user nova-compute[75229]:     <memballoon model="virtio">
Nov 14 09:49:34 user nova-compute[75229]:       <stats period="10"/>
Nov 14 09:49:34 user nova-compute[75229]:     </memballoon>
Nov 14 09:49:34 user nova-compute[75229]:   </devices>
Nov 14 09:49:34 user nova-compute[75229]: </domain>
Nov 14 09:49:34 user nova-compute[75229]:  {{(pid=75229) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 09:49:34 user nova-compute[75229]: DEBUG nova.virt.libvirt.vif [None req-bab54164-97e4-4c55-8750-6dd384f6d7aa tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T09:49:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-627374227',display_name='tempest-TestStampPattern-server-627374227',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-627374227',id=20,image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC4/xEtZHm9Yk+8VKGmlmnaP2DqqxnCgXK/PuxMNYGLOnEJxt/VGvxZAFawEytkJILlGgczmBioMsbqPdSyGvSqffIJvSQLFesfq/9wXT8F6tu1JAnyvbNVNg8/xsFVJ6w==',key_name='tempest-TestStampPattern-1732599618',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6a196548d9de4e18b8bab9fefdab0861',ramdisk_id='',reservation_id='r-0eflrpcq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-1637982262',owner_user_name='tempest-TestStampPattern-1637982262-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T09:49:32Z,user_data=None,user_id='9b525334713e47ceb8f71035116d5c36',uuid=a4ce290f-6dd2-44b6-91be-8e775045837e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0621f697-c41d-49da-9b80-6a2879fef41e", "address": "fa:16:3e:34:59:a9", "network": {"id": "8d89f286-0349-4334-b27a-873f684d3652", "bridge": "br-int", "label": "tempest-TestStampPattern-841799214-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a196548d9de4e18b8bab9fefdab0861", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0621f697-c4", "ovs_interfaceid": "0621f697-c41d-49da-9b80-6a2879fef41e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 09:49:34 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-bab54164-97e4-4c55-8750-6dd384f6d7aa tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] Converting VIF {"id": "0621f697-c41d-49da-9b80-6a2879fef41e", "address": "fa:16:3e:34:59:a9", "network": {"id": "8d89f286-0349-4334-b27a-873f684d3652", "bridge": "br-int", "label": "tempest-TestStampPattern-841799214-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a196548d9de4e18b8bab9fefdab0861", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0621f697-c4", "ovs_interfaceid": "0621f697-c41d-49da-9b80-6a2879fef41e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 09:49:34 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-bab54164-97e4-4c55-8750-6dd384f6d7aa tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:34:59:a9,bridge_name='br-int',has_traffic_filtering=True,id=0621f697-c41d-49da-9b80-6a2879fef41e,network=Network(8d89f286-0349-4334-b27a-873f684d3652),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0621f697-c4') {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 09:49:34 user nova-compute[75229]: DEBUG os_vif [None req-bab54164-97e4-4c55-8750-6dd384f6d7aa tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:34:59:a9,bridge_name='br-int',has_traffic_filtering=True,id=0621f697-c41d-49da-9b80-6a2879fef41e,network=Network(8d89f286-0349-4334-b27a-873f684d3652),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0621f697-c4') {{(pid=75229) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 09:49:34 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:49:34 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:49:34 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 09:49:34 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:49:34 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '54b4234c-c9c5-5484-ba53-2b74d0b8cdc0', '_type': 'linux-noop'}}, row=False) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:49:34 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:49:34 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:49:34 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:49:34 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0621f697-c4, may_exist=True, interface_attrs={}) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:49:34 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0621f697-c4, col_values=(('qos', UUID('bab860ba-408b-4d09-aca9-47f0d60e8330')),), if_exists=True) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:49:34 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0621f697-c4, col_values=(('external_ids', {'iface-id': '0621f697-c41d-49da-9b80-6a2879fef41e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:34:59:a9', 'vm-uuid': 'a4ce290f-6dd2-44b6-91be-8e775045837e'}),), if_exists=True) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:49:34 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 09:49:34 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:49:34 user nova-compute[75229]: INFO os_vif [None req-bab54164-97e4-4c55-8750-6dd384f6d7aa tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:34:59:a9,bridge_name='br-int',has_traffic_filtering=True,id=0621f697-c41d-49da-9b80-6a2879fef41e,network=Network(8d89f286-0349-4334-b27a-873f684d3652),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0621f697-c4')
Nov 14 09:49:34 user nova-compute[75229]: DEBUG nova.compute.manager [req-fae58a8d-be7f-4f5c-af40-9ea0df49ed60 req-c20b61e9-e33b-4121-b438-64a64abff849 service nova] [instance: be813b28-133f-416a-b2b5-dc0b9e4064b7] Received event network-changed-d9a42cb3-5297-4aaf-bf16-9e591cab2fdc {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:49:34 user nova-compute[75229]: DEBUG nova.compute.manager [req-fae58a8d-be7f-4f5c-af40-9ea0df49ed60 req-c20b61e9-e33b-4121-b438-64a64abff849 service nova] [instance: be813b28-133f-416a-b2b5-dc0b9e4064b7] Refreshing instance network info cache due to event network-changed-d9a42cb3-5297-4aaf-bf16-9e591cab2fdc. {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 09:49:34 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-fae58a8d-be7f-4f5c-af40-9ea0df49ed60 req-c20b61e9-e33b-4121-b438-64a64abff849 service nova] Acquiring lock "refresh_cache-be813b28-133f-416a-b2b5-dc0b9e4064b7" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 09:49:34 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-fae58a8d-be7f-4f5c-af40-9ea0df49ed60 req-c20b61e9-e33b-4121-b438-64a64abff849 service nova] Acquired lock "refresh_cache-be813b28-133f-416a-b2b5-dc0b9e4064b7" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 09:49:34 user nova-compute[75229]: DEBUG nova.network.neutron [req-fae58a8d-be7f-4f5c-af40-9ea0df49ed60 req-c20b61e9-e33b-4121-b438-64a64abff849 service nova] [instance: be813b28-133f-416a-b2b5-dc0b9e4064b7] Refreshing network info cache for port d9a42cb3-5297-4aaf-bf16-9e591cab2fdc {{(pid=75229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 09:49:34 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-bab54164-97e4-4c55-8750-6dd384f6d7aa tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] No BDM found with device name vda, not building metadata. {{(pid=75229) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 09:49:34 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-bab54164-97e4-4c55-8750-6dd384f6d7aa tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] No VIF found with MAC fa:16:3e:34:59:a9, not building metadata {{(pid=75229) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 09:49:35 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:49:35 user nova-compute[75229]: DEBUG nova.network.neutron [req-55ce63c5-6b7b-45d0-ab7d-10300b30b486 req-e5da18dd-3da1-49cd-81cb-4f1856cf6049 service nova] [instance: a4ce290f-6dd2-44b6-91be-8e775045837e] Updated VIF entry in instance network info cache for port 0621f697-c41d-49da-9b80-6a2879fef41e. {{(pid=75229) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 09:49:35 user nova-compute[75229]: DEBUG nova.network.neutron [req-55ce63c5-6b7b-45d0-ab7d-10300b30b486 req-e5da18dd-3da1-49cd-81cb-4f1856cf6049 service nova] [instance: a4ce290f-6dd2-44b6-91be-8e775045837e] Updating instance_info_cache with network_info: [{"id": "0621f697-c41d-49da-9b80-6a2879fef41e", "address": "fa:16:3e:34:59:a9", "network": {"id": "8d89f286-0349-4334-b27a-873f684d3652", "bridge": "br-int", "label": "tempest-TestStampPattern-841799214-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a196548d9de4e18b8bab9fefdab0861", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0621f697-c4", "ovs_interfaceid": "0621f697-c41d-49da-9b80-6a2879fef41e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 09:49:35 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-55ce63c5-6b7b-45d0-ab7d-10300b30b486 req-e5da18dd-3da1-49cd-81cb-4f1856cf6049 service nova] Releasing lock "refresh_cache-a4ce290f-6dd2-44b6-91be-8e775045837e" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 09:49:35 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-970385d5-e495-4ac8-b634-1dc0aa221991 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Acquiring lock "be813b28-133f-416a-b2b5-dc0b9e4064b7" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:49:35 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-970385d5-e495-4ac8-b634-1dc0aa221991 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Lock "be813b28-133f-416a-b2b5-dc0b9e4064b7" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:49:35 user nova-compute[75229]: DEBUG nova.objects.instance [None req-970385d5-e495-4ac8-b634-1dc0aa221991 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Lazy-loading 'flavor' on Instance uuid be813b28-133f-416a-b2b5-dc0b9e4064b7 {{(pid=75229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 09:49:35 user nova-compute[75229]: DEBUG nova.network.neutron [req-fae58a8d-be7f-4f5c-af40-9ea0df49ed60 req-c20b61e9-e33b-4121-b438-64a64abff849 service nova] [instance: be813b28-133f-416a-b2b5-dc0b9e4064b7] Updated VIF entry in instance network info cache for port d9a42cb3-5297-4aaf-bf16-9e591cab2fdc. {{(pid=75229) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 09:49:35 user nova-compute[75229]: DEBUG nova.network.neutron [req-fae58a8d-be7f-4f5c-af40-9ea0df49ed60 req-c20b61e9-e33b-4121-b438-64a64abff849 service nova] [instance: be813b28-133f-416a-b2b5-dc0b9e4064b7] Updating instance_info_cache with network_info: [{"id": "d9a42cb3-5297-4aaf-bf16-9e591cab2fdc", "address": "fa:16:3e:27:a8:b8", "network": {"id": "5dfc532f-3d5d-4342-b7f1-12c9c3992a54", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1457278473-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.17", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46e65cdd021f4a3db7c9254bb6d98b46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9a42cb3-52", "ovs_interfaceid": "d9a42cb3-5297-4aaf-bf16-9e591cab2fdc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 09:49:35 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-fae58a8d-be7f-4f5c-af40-9ea0df49ed60 req-c20b61e9-e33b-4121-b438-64a64abff849 service nova] Releasing lock "refresh_cache-be813b28-133f-416a-b2b5-dc0b9e4064b7" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 09:49:35 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-970385d5-e495-4ac8-b634-1dc0aa221991 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Lock "be813b28-133f-416a-b2b5-dc0b9e4064b7" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.082s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:49:35 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-970385d5-e495-4ac8-b634-1dc0aa221991 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Acquiring lock "be813b28-133f-416a-b2b5-dc0b9e4064b7" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:49:35 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-970385d5-e495-4ac8-b634-1dc0aa221991 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Lock "be813b28-133f-416a-b2b5-dc0b9e4064b7" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:49:35 user nova-compute[75229]: INFO nova.compute.manager [None req-970385d5-e495-4ac8-b634-1dc0aa221991 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] [instance: be813b28-133f-416a-b2b5-dc0b9e4064b7] Attaching volume a7902ab8-168d-4c8a-90e9-bf44d669ce2b to /dev/vdb
Nov 14 09:49:35 user nova-compute[75229]: DEBUG os_brick.utils [None req-970385d5-e495-4ac8-b634-1dc0aa221991 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 09:49:35 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:49:35 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:49:35 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9aed6fb-823c-4e30-900e-da650060614d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f1154031c835\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:49:35 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:49:35 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:49:35 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2d31544-5698-43fa-87e6-44960fe42cfa]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:49:35 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:49:35 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:49:35 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[d197fea6-0f53-4f84-b040-05075a88658d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:49:35 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[e809af40-5813-4426-b5ca-7e830564a51f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:49:35 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-970385d5-e495-4ac8-b634-1dc0aa221991 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Running cmd (subprocess): nvme version {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:49:35 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-970385d5-e495-4ac8-b634-1dc0aa221991 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] 'nvme version' failed. Not Retrying. {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 09:49:35 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.nvmeof [None req-970385d5-e495-4ac8-b634-1dc0aa221991 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] nvme not present on system {{(pid=75229) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 09:49:35 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:49:35 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 09:49:35 user nova-compute[75229]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 09:49:35 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbfd10d0-9182-4cf8-9a0b-bf2d5f1179b2]: (4, '') {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:49:35 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.lightos [None req-970385d5-e495-4ac8-b634-1dc0aa221991 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75229) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 09:49:35 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.lightos [None req-970385d5-e495-4ac8-b634-1dc0aa221991 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75229) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 09:49:35 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.lightos [None req-970385d5-e495-4ac8-b634-1dc0aa221991 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] LIGHTOS: no hostnqn found. {{(pid=75229) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 09:49:35 user nova-compute[75229]: DEBUG os_brick.utils [None req-970385d5-e495-4ac8-b634-1dc0aa221991 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] <== get_connector_properties: return (115ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f1154031c835', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 09:49:35 user nova-compute[75229]: DEBUG nova.virt.block_device [None req-970385d5-e495-4ac8-b634-1dc0aa221991 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] [instance: be813b28-133f-416a-b2b5-dc0b9e4064b7] Updating existing volume attachment record: 8e0ae997-4552-4db3-8adc-d146c4516404 {{(pid=75229) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 09:49:36 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:49:36 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:49:36 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:49:36 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:49:36 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:49:36 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:49:36 user nova-compute[75229]: DEBUG nova.compute.manager [req-1c63f256-f70f-4cf4-be9c-b08999010f70 req-84ff5855-381f-43cf-95d4-90fc0c477554 service nova] [instance: a4ce290f-6dd2-44b6-91be-8e775045837e] Received event network-vif-plugged-0621f697-c41d-49da-9b80-6a2879fef41e {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:49:36 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-1c63f256-f70f-4cf4-be9c-b08999010f70 req-84ff5855-381f-43cf-95d4-90fc0c477554 service nova] Acquiring lock "a4ce290f-6dd2-44b6-91be-8e775045837e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:49:36 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-1c63f256-f70f-4cf4-be9c-b08999010f70 req-84ff5855-381f-43cf-95d4-90fc0c477554 service nova] Lock "a4ce290f-6dd2-44b6-91be-8e775045837e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:49:36 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-1c63f256-f70f-4cf4-be9c-b08999010f70 req-84ff5855-381f-43cf-95d4-90fc0c477554 service nova] Lock "a4ce290f-6dd2-44b6-91be-8e775045837e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:49:36 user nova-compute[75229]: DEBUG nova.compute.manager [req-1c63f256-f70f-4cf4-be9c-b08999010f70 req-84ff5855-381f-43cf-95d4-90fc0c477554 service nova] [instance: a4ce290f-6dd2-44b6-91be-8e775045837e] No waiting events found dispatching network-vif-plugged-0621f697-c41d-49da-9b80-6a2879fef41e {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 09:49:36 user nova-compute[75229]: WARNING nova.compute.manager [req-1c63f256-f70f-4cf4-be9c-b08999010f70 req-84ff5855-381f-43cf-95d4-90fc0c477554 service nova] [instance: a4ce290f-6dd2-44b6-91be-8e775045837e] Received unexpected event network-vif-plugged-0621f697-c41d-49da-9b80-6a2879fef41e for instance with vm_state building and task_state spawning.
Nov 14 09:49:36 user nova-compute[75229]: DEBUG nova.compute.manager [req-1c63f256-f70f-4cf4-be9c-b08999010f70 req-84ff5855-381f-43cf-95d4-90fc0c477554 service nova] [instance: a4ce290f-6dd2-44b6-91be-8e775045837e] Received event network-vif-plugged-0621f697-c41d-49da-9b80-6a2879fef41e {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:49:36 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-1c63f256-f70f-4cf4-be9c-b08999010f70 req-84ff5855-381f-43cf-95d4-90fc0c477554 service nova] Acquiring lock "a4ce290f-6dd2-44b6-91be-8e775045837e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:49:36 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-1c63f256-f70f-4cf4-be9c-b08999010f70 req-84ff5855-381f-43cf-95d4-90fc0c477554 service nova] Lock "a4ce290f-6dd2-44b6-91be-8e775045837e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:49:36 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-1c63f256-f70f-4cf4-be9c-b08999010f70 req-84ff5855-381f-43cf-95d4-90fc0c477554 service nova] Lock "a4ce290f-6dd2-44b6-91be-8e775045837e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:49:36 user nova-compute[75229]: DEBUG nova.compute.manager [req-1c63f256-f70f-4cf4-be9c-b08999010f70 req-84ff5855-381f-43cf-95d4-90fc0c477554 service nova] [instance: a4ce290f-6dd2-44b6-91be-8e775045837e] No waiting events found dispatching network-vif-plugged-0621f697-c41d-49da-9b80-6a2879fef41e {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 09:49:36 user nova-compute[75229]: WARNING nova.compute.manager [req-1c63f256-f70f-4cf4-be9c-b08999010f70 req-84ff5855-381f-43cf-95d4-90fc0c477554 service nova] [instance: a4ce290f-6dd2-44b6-91be-8e775045837e] Received unexpected event network-vif-plugged-0621f697-c41d-49da-9b80-6a2879fef41e for instance with vm_state building and task_state spawning.
Nov 14 09:49:38 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:49:38 user nova-compute[75229]: DEBUG nova.compute.manager [None req-bab54164-97e4-4c55-8750-6dd384f6d7aa tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] [instance: a4ce290f-6dd2-44b6-91be-8e775045837e] Instance event wait completed in 0 seconds for  {{(pid=75229) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 09:49:38 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-bab54164-97e4-4c55-8750-6dd384f6d7aa tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] [instance: a4ce290f-6dd2-44b6-91be-8e775045837e] Guest created on hypervisor {{(pid=75229) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 09:49:38 user nova-compute[75229]: INFO nova.virt.libvirt.driver [-] [instance: a4ce290f-6dd2-44b6-91be-8e775045837e] Instance spawned successfully.
Nov 14 09:49:38 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-bab54164-97e4-4c55-8750-6dd384f6d7aa tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] [instance: a4ce290f-6dd2-44b6-91be-8e775045837e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 09:49:38 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-bab54164-97e4-4c55-8750-6dd384f6d7aa tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] [instance: a4ce290f-6dd2-44b6-91be-8e775045837e] Found default for hw_cdrom_bus of ide {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 09:49:38 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-bab54164-97e4-4c55-8750-6dd384f6d7aa tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] [instance: a4ce290f-6dd2-44b6-91be-8e775045837e] Found default for hw_disk_bus of virtio {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 09:49:38 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-bab54164-97e4-4c55-8750-6dd384f6d7aa tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] [instance: a4ce290f-6dd2-44b6-91be-8e775045837e] Found default for hw_input_bus of None {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 09:49:38 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-bab54164-97e4-4c55-8750-6dd384f6d7aa tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] [instance: a4ce290f-6dd2-44b6-91be-8e775045837e] Found default for hw_pointer_model of None {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 09:49:38 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-bab54164-97e4-4c55-8750-6dd384f6d7aa tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] [instance: a4ce290f-6dd2-44b6-91be-8e775045837e] Found default for hw_video_model of virtio {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 09:49:38 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-bab54164-97e4-4c55-8750-6dd384f6d7aa tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] [instance: a4ce290f-6dd2-44b6-91be-8e775045837e] Found default for hw_vif_model of virtio {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 09:49:38 user nova-compute[75229]: INFO nova.compute.manager [None req-bab54164-97e4-4c55-8750-6dd384f6d7aa tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] [instance: a4ce290f-6dd2-44b6-91be-8e775045837e] Took 6.91 seconds to spawn the instance on the hypervisor.
Nov 14 09:49:38 user nova-compute[75229]: DEBUG nova.compute.manager [None req-bab54164-97e4-4c55-8750-6dd384f6d7aa tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] [instance: a4ce290f-6dd2-44b6-91be-8e775045837e] Checking state {{(pid=75229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 09:49:38 user nova-compute[75229]: INFO nova.compute.manager [None req-bab54164-97e4-4c55-8750-6dd384f6d7aa tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] [instance: a4ce290f-6dd2-44b6-91be-8e775045837e] Took 7.71 seconds to build instance.
Nov 14 09:49:38 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bab54164-97e4-4c55-8750-6dd384f6d7aa tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] Lock "a4ce290f-6dd2-44b6-91be-8e775045837e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.816s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:49:39 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:49:39 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:49:40 user nova-compute[75229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-970385d5-e495-4ac8-b634-1dc0aa221991 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] [instance: be813b28-133f-416a-b2b5-dc0b9e4064b7] Calling os-brick to attach iSCSI Volume {{(pid=75229) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 09:49:40 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-970385d5-e495-4ac8-b634-1dc0aa221991 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f73f85151b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a7902ab8-168d-4c8a-90e9-bf44d669ce2b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HBhZNQjK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 09:49:40 user nova-compute[75229]: WARNING os_brick.initiator.connectors.base [None req-970385d5-e495-4ac8-b634-1dc0aa221991 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 09:49:40 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-970385d5-e495-4ac8-b634-1dc0aa221991 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 09:49:40 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-970385d5-e495-4ac8-b634-1dc0aa221991 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 09:49:40 user nova-compute[75229]: WARNING os_brick.initiator.connectors.base [None req-970385d5-e495-4ac8-b634-1dc0aa221991 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 09:49:40 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-970385d5-e495-4ac8-b634-1dc0aa221991 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a7902ab8-168d-4c8a-90e9-bf44d669ce2b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 09:49:40 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-970385d5-e495-4ac8-b634-1dc0aa221991 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a7902ab8-168d-4c8a-90e9-bf44d669ce2b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 09:49:40 user nova-compute[75229]: INFO os_brick.initiator.connectors.iscsi [None req-970385d5-e495-4ac8-b634-1dc0aa221991 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 09:49:40 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7902ab8-168d-4c8a-90e9-bf44d669ce2b -p 172.16.0.220:3260 {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:49:40 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7902ab8-168d-4c8a-90e9-bf44d669ce2b -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:49:40 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e6bc834-ebbc-4c18-a0a8-986c6445c51a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:49:40 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-970385d5-e495-4ac8-b634-1dc0aa221991 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 09:49:40 user nova-compute[75229]:  {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:49:40 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7902ab8-168d-4c8a-90e9-bf44d669ce2b -p 172.16.0.220:3260 --interface default --op new {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:49:40 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7902ab8-168d-4c8a-90e9-bf44d669ce2b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:49:40 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b6c2cbb-40a6-4dd5-825f-c8ca59aa3879]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a7902ab8-168d-4c8a-90e9-bf44d669ce2b] added\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:49:40 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-970385d5-e495-4ac8-b634-1dc0aa221991 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a7902ab8-168d-4c8a-90e9-bf44d669ce2b] added
Nov 14 09:49:40 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:49:40 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7902ab8-168d-4c8a-90e9-bf44d669ce2b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:49:40 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7902ab8-168d-4c8a-90e9-bf44d669ce2b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:49:40 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[01c2e692-41f5-424b-8cca-9848bccdad24]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:49:40 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-970385d5-e495-4ac8-b634-1dc0aa221991 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:49:40 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7902ab8-168d-4c8a-90e9-bf44d669ce2b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:49:40 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7902ab8-168d-4c8a-90e9-bf44d669ce2b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:49:40 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa185d8c-9b0f-457b-9ba3-6c978b31bc6e]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:49:40 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-970385d5-e495-4ac8-b634-1dc0aa221991 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:49:40 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7902ab8-168d-4c8a-90e9-bf44d669ce2b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HBhZNQjK {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:49:40 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7902ab8-168d-4c8a-90e9-bf44d669ce2b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HBhZNQjK" returned: 0 in 0.020s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:49:40 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[811f6636-b182-451e-a2d6-78bc6c74d059]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:49:40 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-970385d5-e495-4ac8-b634-1dc0aa221991 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HBhZNQjK'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:49:40 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7902ab8-168d-4c8a-90e9-bf44d669ce2b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:49:40 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7902ab8-168d-4c8a-90e9-bf44d669ce2b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:49:40 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[021fd8ff-088b-40cd-af85-3729fa9f43f5]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:49:40 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-970385d5-e495-4ac8-b634-1dc0aa221991 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:49:40 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:49:40 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:49:40 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[199f4cb4-0498-4edb-b112-933b7b8210f3]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fed285f-9be4-4601-8cb5-4329d7ebed8c (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b54e594-ae66-4ba2-9bda-aa4431d31c3f (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aca09258-022b-4f04-b418-f2a170332755 (non-flash)\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:49:40 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-970385d5-e495-4ac8-b634-1dc0aa221991 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fed285f-9be4-4601-8cb5-4329d7ebed8c (non-flash)
Nov 14 09:49:40 user nova-compute[75229]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b54e594-ae66-4ba2-9bda-aa4431d31c3f (non-flash)
Nov 14 09:49:40 user nova-compute[75229]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aca09258-022b-4f04-b418-f2a170332755 (non-flash)
Nov 14 09:49:40 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 09:49:40 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-970385d5-e495-4ac8-b634-1dc0aa221991 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fed285f-9be4-4601-8cb5-4329d7ebed8c (non-flash)
Nov 14 09:49:40 user nova-compute[75229]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b54e594-ae66-4ba2-9bda-aa4431d31c3f (non-flash)
Nov 14 09:49:40 user nova-compute[75229]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aca09258-022b-4f04-b418-f2a170332755 (non-flash)
Nov 14 09:49:40 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 09:49:40 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7902ab8-168d-4c8a-90e9-bf44d669ce2b -p 172.16.0.220:3260 --login {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:49:40 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7902ab8-168d-4c8a-90e9-bf44d669ce2b -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:49:40 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[8325d426-e229-4645-807e-3f986e3d1968]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a7902ab8-168d-4c8a-90e9-bf44d669ce2b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a7902ab8-168d-4c8a-90e9-bf44d669ce2b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:49:40 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-970385d5-e495-4ac8-b634-1dc0aa221991 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a7902ab8-168d-4c8a-90e9-bf44d669ce2b, portal: 172.16.0.220,3260]
Nov 14 09:49:40 user nova-compute[75229]: Login to [iface: default, target: iqn.2010-10.org.openstack:a7902ab8-168d-4c8a-90e9-bf44d669ce2b, portal: 172.16.0.220,3260] successful.
Nov 14 09:49:40 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:49:40 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7902ab8-168d-4c8a-90e9-bf44d669ce2b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:49:40 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7902ab8-168d-4c8a-90e9-bf44d669ce2b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:49:40 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[642daf27-d224-4d92-bb52-14368fe2c587]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:49:40 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-970385d5-e495-4ac8-b634-1dc0aa221991 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:49:40 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:49:40 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:49:40 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4f839df-c772-48f8-b92a-0a46b53fd5e1]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fed285f-9be4-4601-8cb5-4329d7ebed8c (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b54e594-ae66-4ba2-9bda-aa4431d31c3f (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aca09258-022b-4f04-b418-f2a170332755 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7902ab8-168d-4c8a-90e9-bf44d669ce2b (non-flash)\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:49:40 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-970385d5-e495-4ac8-b634-1dc0aa221991 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fed285f-9be4-4601-8cb5-4329d7ebed8c (non-flash)
Nov 14 09:49:40 user nova-compute[75229]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b54e594-ae66-4ba2-9bda-aa4431d31c3f (non-flash)
Nov 14 09:49:40 user nova-compute[75229]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aca09258-022b-4f04-b418-f2a170332755 (non-flash)
Nov 14 09:49:40 user nova-compute[75229]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7902ab8-168d-4c8a-90e9-bf44d669ce2b (non-flash)
Nov 14 09:49:40 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 09:49:40 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-970385d5-e495-4ac8-b634-1dc0aa221991 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fed285f-9be4-4601-8cb5-4329d7ebed8c (non-flash)
Nov 14 09:49:40 user nova-compute[75229]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b54e594-ae66-4ba2-9bda-aa4431d31c3f (non-flash)
Nov 14 09:49:40 user nova-compute[75229]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aca09258-022b-4f04-b418-f2a170332755 (non-flash)
Nov 14 09:49:40 user nova-compute[75229]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7902ab8-168d-4c8a-90e9-bf44d669ce2b (non-flash)
Nov 14 09:49:40 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 09:49:40 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-970385d5-e495-4ac8-b634-1dc0aa221991 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a7902ab8-168d-4c8a-90e9-bf44d669ce2b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.286s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 09:49:40 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-970385d5-e495-4ac8-b634-1dc0aa221991 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Connected to 172.16.0.220:3260 {{(pid=75229) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 09:49:40 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-970385d5-e495-4ac8-b634-1dc0aa221991 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] HCTL ('33', '-', '-', 0) found on session 20 with lun 0 {{(pid=75229) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 09:49:40 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-970385d5-e495-4ac8-b634-1dc0aa221991 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75229) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 09:49:40 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:49:40 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.022s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:49:40 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2fc8717-4928-4fde-93c6-c4ca81839256]: (4, ('- - 0', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:49:40 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-970385d5-e495-4ac8-b634-1dc0aa221991 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Searching for a device in session 20 and hctl ['33', '*', '*', 0] yield: None {{(pid=75229) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 09:49:41 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:49:41 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-970385d5-e495-4ac8-b634-1dc0aa221991 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Searching for a device in session 20 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75229) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 09:49:41 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-970385d5-e495-4ac8-b634-1dc0aa221991 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:a7902ab8-168d-4c8a-90e9-bf44d669ce2b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HBhZNQjK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75229) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 09:49:41 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-970385d5-e495-4ac8-b634-1dc0aa221991 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.321s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 09:49:41 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-970385d5-e495-4ac8-b634-1dc0aa221991 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] <== connect_volume: return (1322ms) {'type': 'block', 'scsi_wwn': '23232316238343830', 'path': '/dev/sdb'} {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 09:49:41 user nova-compute[75229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-970385d5-e495-4ac8-b634-1dc0aa221991 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] [instance: be813b28-133f-416a-b2b5-dc0b9e4064b7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23232316238343830', 'path': '/dev/sdb'} {{(pid=75229) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 09:49:41 user nova-compute[75229]: DEBUG nova.objects.instance [None req-970385d5-e495-4ac8-b634-1dc0aa221991 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Lazy-loading 'flavor' on Instance uuid be813b28-133f-416a-b2b5-dc0b9e4064b7 {{(pid=75229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 09:49:41 user nova-compute[75229]: DEBUG nova.virt.libvirt.guest [None req-970385d5-e495-4ac8-b634-1dc0aa221991 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 09:49:41 user nova-compute[75229]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 09:49:41 user nova-compute[75229]:   <source dev="/dev/sdb"/>
Nov 14 09:49:41 user nova-compute[75229]:   <target dev="vdb" bus="virtio"/>
Nov 14 09:49:41 user nova-compute[75229]:   <serial>a7902ab8-168d-4c8a-90e9-bf44d669ce2b</serial>
Nov 14 09:49:41 user nova-compute[75229]: </disk>
Nov 14 09:49:41 user nova-compute[75229]:  {{(pid=75229) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 09:49:41 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 09:49:41 user nova-compute[75229]: DEBUG nova.compute.manager [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Cleaning up deleted instances {{(pid=75229) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 14 09:49:41 user nova-compute[75229]: DEBUG nova.compute.manager [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] There are 0 instances to clean {{(pid=75229) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 14 09:49:42 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-970385d5-e495-4ac8-b634-1dc0aa221991 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] No BDM found with device name vda, not building metadata. {{(pid=75229) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 09:49:42 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-970385d5-e495-4ac8-b634-1dc0aa221991 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75229) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 09:49:42 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-970385d5-e495-4ac8-b634-1dc0aa221991 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] No VIF found with MAC fa:16:3e:27:a8:b8, not building metadata {{(pid=75229) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 09:49:42 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-970385d5-e495-4ac8-b634-1dc0aa221991 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Lock "be813b28-133f-416a-b2b5-dc0b9e4064b7" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.578s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:49:43 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:49:44 user nova-compute[75229]: INFO nova.compute.manager [None req-7dd57e30-92d4-41c9-af13-77ac442a957a tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] [instance: be813b28-133f-416a-b2b5-dc0b9e4064b7] Rebuilding instance
Nov 14 09:49:44 user nova-compute[75229]: DEBUG nova.compute.manager [None req-7dd57e30-92d4-41c9-af13-77ac442a957a tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] [instance: be813b28-133f-416a-b2b5-dc0b9e4064b7] Checking state {{(pid=75229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 09:49:44 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:49:44 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:49:44 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:49:44 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:49:44 user nova-compute[75229]: DEBUG nova.compute.manager [req-01a86685-31a8-4851-b4be-5bad5077fb5a req-42dd82de-d3d9-4f81-b361-8757507af1b0 service nova] [instance: be813b28-133f-416a-b2b5-dc0b9e4064b7] Received event network-vif-unplugged-d9a42cb3-5297-4aaf-bf16-9e591cab2fdc {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:49:44 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-01a86685-31a8-4851-b4be-5bad5077fb5a req-42dd82de-d3d9-4f81-b361-8757507af1b0 service nova] Acquiring lock "be813b28-133f-416a-b2b5-dc0b9e4064b7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:49:44 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-01a86685-31a8-4851-b4be-5bad5077fb5a req-42dd82de-d3d9-4f81-b361-8757507af1b0 service nova] Lock "be813b28-133f-416a-b2b5-dc0b9e4064b7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:49:44 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-01a86685-31a8-4851-b4be-5bad5077fb5a req-42dd82de-d3d9-4f81-b361-8757507af1b0 service nova] Lock "be813b28-133f-416a-b2b5-dc0b9e4064b7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:49:44 user nova-compute[75229]: DEBUG nova.compute.manager [req-01a86685-31a8-4851-b4be-5bad5077fb5a req-42dd82de-d3d9-4f81-b361-8757507af1b0 service nova] [instance: be813b28-133f-416a-b2b5-dc0b9e4064b7] No waiting events found dispatching network-vif-unplugged-d9a42cb3-5297-4aaf-bf16-9e591cab2fdc {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 09:49:44 user nova-compute[75229]: WARNING nova.compute.manager [req-01a86685-31a8-4851-b4be-5bad5077fb5a req-42dd82de-d3d9-4f81-b361-8757507af1b0 service nova] [instance: be813b28-133f-416a-b2b5-dc0b9e4064b7] Received unexpected event network-vif-unplugged-d9a42cb3-5297-4aaf-bf16-9e591cab2fdc for instance with vm_state active and task_state rebuilding.
Nov 14 09:49:44 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:49:45 user nova-compute[75229]: INFO nova.virt.libvirt.driver [-] [instance: be813b28-133f-416a-b2b5-dc0b9e4064b7] Instance destroyed successfully.
Nov 14 09:49:45 user nova-compute[75229]: INFO nova.compute.manager [None req-7dd57e30-92d4-41c9-af13-77ac442a957a tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] [instance: be813b28-133f-416a-b2b5-dc0b9e4064b7] Detaching volume a7902ab8-168d-4c8a-90e9-bf44d669ce2b
Nov 14 09:49:45 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-4661d339-89ca-440f-9559-5a9b473af706 tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] Acquiring lock "eb53ba25-d865-41ae-90f3-6e154e2778ba" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:49:45 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-4661d339-89ca-440f-9559-5a9b473af706 tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] Lock "eb53ba25-d865-41ae-90f3-6e154e2778ba" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:49:45 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-4661d339-89ca-440f-9559-5a9b473af706 tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] Acquiring lock "eb53ba25-d865-41ae-90f3-6e154e2778ba-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:49:45 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-4661d339-89ca-440f-9559-5a9b473af706 tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] Lock "eb53ba25-d865-41ae-90f3-6e154e2778ba-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:49:45 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-4661d339-89ca-440f-9559-5a9b473af706 tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] Lock "eb53ba25-d865-41ae-90f3-6e154e2778ba-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:49:45 user nova-compute[75229]: INFO nova.compute.manager [None req-4661d339-89ca-440f-9559-5a9b473af706 tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] [instance: eb53ba25-d865-41ae-90f3-6e154e2778ba] Terminating instance
Nov 14 09:49:45 user nova-compute[75229]: DEBUG nova.compute.manager [None req-4661d339-89ca-440f-9559-5a9b473af706 tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] [instance: eb53ba25-d865-41ae-90f3-6e154e2778ba] Start destroying the instance on the hypervisor. {{(pid=75229) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 09:49:45 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-9263b606-7384-49ba-93c3-ffbfa7db372c tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] Acquiring lock "94e2b266-2fe3-481a-bb1e-24f835a79ddf" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:49:45 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-9263b606-7384-49ba-93c3-ffbfa7db372c tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] Lock "94e2b266-2fe3-481a-bb1e-24f835a79ddf" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:49:45 user nova-compute[75229]: DEBUG nova.compute.manager [None req-9263b606-7384-49ba-93c3-ffbfa7db372c tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] [instance: 94e2b266-2fe3-481a-bb1e-24f835a79ddf] Starting instance... {{(pid=75229) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 09:49:45 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:49:45 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:49:45 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:49:45 user nova-compute[75229]: INFO nova.virt.block_device [None req-7dd57e30-92d4-41c9-af13-77ac442a957a tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] [instance: be813b28-133f-416a-b2b5-dc0b9e4064b7] Attempting to driver detach volume a7902ab8-168d-4c8a-90e9-bf44d669ce2b from mountpoint /dev/vdb
Nov 14 09:49:45 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-7dd57e30-92d4-41c9-af13-77ac442a957a tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Attempting to detach device vdb from instance be813b28-133f-416a-b2b5-dc0b9e4064b7 from the persistent domain config. {{(pid=75229) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 09:49:45 user nova-compute[75229]: DEBUG nova.virt.libvirt.guest [None req-7dd57e30-92d4-41c9-af13-77ac442a957a tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 09:49:45 user nova-compute[75229]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 09:49:45 user nova-compute[75229]:   <source dev="/dev/sdb"/>
Nov 14 09:49:45 user nova-compute[75229]:   <target dev="vdb" bus="virtio"/>
Nov 14 09:49:45 user nova-compute[75229]:   <serial>a7902ab8-168d-4c8a-90e9-bf44d669ce2b</serial>
Nov 14 09:49:45 user nova-compute[75229]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 09:49:45 user nova-compute[75229]: </disk>
Nov 14 09:49:45 user nova-compute[75229]:  {{(pid=75229) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 09:49:45 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:49:45 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-7dd57e30-92d4-41c9-af13-77ac442a957a tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Successfully detached device vdb from instance be813b28-133f-416a-b2b5-dc0b9e4064b7 from the persistent domain config.
Nov 14 09:49:45 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-9263b606-7384-49ba-93c3-ffbfa7db372c tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:49:45 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-9263b606-7384-49ba-93c3-ffbfa7db372c tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:49:45 user nova-compute[75229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7dd57e30-92d4-41c9-af13-77ac442a957a tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] [instance: be813b28-133f-416a-b2b5-dc0b9e4064b7] calling os-brick to detach iSCSI Volume {{(pid=75229) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 09:49:45 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dd57e30-92d4-41c9-af13-77ac442a957a tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f73f85151b0>, {'target_iqn': 'iqn.2010-10.org.openstack:a7902ab8-168d-4c8a-90e9-bf44d669ce2b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HBhZNQjK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 09:49:45 user nova-compute[75229]: WARNING os_brick.initiator.connectors.base [None req-7dd57e30-92d4-41c9-af13-77ac442a957a tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 14 09:49:45 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-7dd57e30-92d4-41c9-af13-77ac442a957a tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 09:49:45 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-7dd57e30-92d4-41c9-af13-77ac442a957a tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 09:49:45 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:49:45 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-9263b606-7384-49ba-93c3-ffbfa7db372c tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75229) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 09:49:45 user nova-compute[75229]: INFO nova.compute.claims [None req-9263b606-7384-49ba-93c3-ffbfa7db372c tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] [instance: 94e2b266-2fe3-481a-bb1e-24f835a79ddf] Claim successful on node user
Nov 14 09:49:45 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.028s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:49:45 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ba30a4a-fd74-44e6-ae85-e87c97a69341]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5b54e594-ae66-4ba2-9bda-aa4431d31c3f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:aca09258-022b-4f04-b418-f2a170332755\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a7902ab8-168d-4c8a-90e9-bf44d669ce2b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3fed285f-9be4-4601-8cb5-4329d7ebed8c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:49:45 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dd57e30-92d4-41c9-af13-77ac442a957a tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 09:49:45 user nova-compute[75229]: No targets found.
Nov 14 09:49:45 user nova-compute[75229]: iSNS:
Nov 14 09:49:45 user nova-compute[75229]: No targets found.
Nov 14 09:49:45 user nova-compute[75229]: STATIC:
Nov 14 09:49:45 user nova-compute[75229]: Target: iqn.2010-10.org.openstack:5b54e594-ae66-4ba2-9bda-aa4431d31c3f
Nov 14 09:49:45 user nova-compute[75229]:         Portal: 172.16.0.220:3260,-1
Nov 14 09:49:45 user nova-compute[75229]:                 Iface Name: default
Nov 14 09:49:45 user nova-compute[75229]: Target: iqn.2010-10.org.openstack:aca09258-022b-4f04-b418-f2a170332755
Nov 14 09:49:45 user nova-compute[75229]:         Portal: 172.16.0.220:3260,-1
Nov 14 09:49:45 user nova-compute[75229]:                 Iface Name: default
Nov 14 09:49:45 user nova-compute[75229]: Target: iqn.2010-10.org.openstack:a7902ab8-168d-4c8a-90e9-bf44d669ce2b
Nov 14 09:49:45 user nova-compute[75229]:         Portal: 172.16.0.220:3260,-1
Nov 14 09:49:45 user nova-compute[75229]:                 Iface Name: default
Nov 14 09:49:45 user nova-compute[75229]: Target: iqn.2010-10.org.openstack:3fed285f-9be4-4601-8cb5-4329d7ebed8c
Nov 14 09:49:45 user nova-compute[75229]:         Portal: 172.16.0.220:3260,-1
Nov 14 09:49:45 user nova-compute[75229]:                 Iface Name: default
Nov 14 09:49:45 user nova-compute[75229]: FIRMWARE:
Nov 14 09:49:45 user nova-compute[75229]: No targets found.
Nov 14 09:49:45 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 09:49:45 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dd57e30-92d4-41c9-af13-77ac442a957a tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 09:49:45 user nova-compute[75229]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 09:49:45 user nova-compute[75229]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75229) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 09:49:45 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dd57e30-92d4-41c9-af13-77ac442a957a tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a7902ab8-168d-4c8a-90e9-bf44d669ce2b', 0)] {{(pid=75229) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 09:49:45 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:49:45 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:49:45 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[452b8258-791f-4f75-b011-6438eca04c78]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3fed285f-9be4-4601-8cb5-4329d7ebed8c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5b54e594-ae66-4ba2-9bda-aa4431d31c3f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a7902ab8-168d-4c8a-90e9-bf44d669ce2b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aca09258-022b-4f04-b418-f2a170332755\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:49:45 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:49:45 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:49:45 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[f932afbd-e7e7-4e9a-bce4-cf0e4328747d]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fed285f-9be4-4601-8cb5-4329d7ebed8c (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b54e594-ae66-4ba2-9bda-aa4431d31c3f (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aca09258-022b-4f04-b418-f2a170332755 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7902ab8-168d-4c8a-90e9-bf44d669ce2b (non-flash)\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:49:45 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dd57e30-92d4-41c9-af13-77ac442a957a tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fed285f-9be4-4601-8cb5-4329d7ebed8c (non-flash)
Nov 14 09:49:45 user nova-compute[75229]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b54e594-ae66-4ba2-9bda-aa4431d31c3f (non-flash)
Nov 14 09:49:45 user nova-compute[75229]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aca09258-022b-4f04-b418-f2a170332755 (non-flash)
Nov 14 09:49:45 user nova-compute[75229]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7902ab8-168d-4c8a-90e9-bf44d669ce2b (non-flash)
Nov 14 09:49:45 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 09:49:45 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dd57e30-92d4-41c9-af13-77ac442a957a tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fed285f-9be4-4601-8cb5-4329d7ebed8c (non-flash)
Nov 14 09:49:45 user nova-compute[75229]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b54e594-ae66-4ba2-9bda-aa4431d31c3f (non-flash)
Nov 14 09:49:45 user nova-compute[75229]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aca09258-022b-4f04-b418-f2a170332755 (non-flash)
Nov 14 09:49:45 user nova-compute[75229]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7902ab8-168d-4c8a-90e9-bf44d669ce2b (non-flash)
Nov 14 09:49:45 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 09:49:45 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dd57e30-92d4-41c9-af13-77ac442a957a tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f73f84c1480>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a7902ab8-168d-4c8a-90e9-bf44d669ce2b'): ({'sdb'}, set())}) {{(pid=75229) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 09:49:45 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-7dd57e30-92d4-41c9-af13-77ac442a957a tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Removing single pathed devices sdb {{(pid=75229) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 09:49:45 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:49:45 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:49:45 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[5647c4a6-bd44-41be-af13-627df45ac72e]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:49:45 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:49:45 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 09:49:45 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:49:45 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[902b2419-ee99-49e3-b838-f8c5863e3748]: (4, ('ok\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:49:45 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-7dd57e30-92d4-41c9-af13-77ac442a957a tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Flushing IO for device /dev/sdb {{(pid=75229) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 09:49:45 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:49:45 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:49:45 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[893b4083-4f3e-483c-b720-7cb09c6ae796]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:49:45 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-7dd57e30-92d4-41c9-af13-77ac442a957a tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75229) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 09:49:45 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:49:45 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.057s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:49:45 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[94bb2c68-d117-4d9d-afee-a7c60d9f739d]: (4, ('1', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:49:45 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-7dd57e30-92d4-41c9-af13-77ac442a957a tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75229) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 09:49:45 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-7dd57e30-92d4-41c9-af13-77ac442a957a tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] SCSI volumes sdb have been removed. {{(pid=75229) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 09:49:45 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dd57e30-92d4-41c9-af13-77ac442a957a tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a7902ab8-168d-4c8a-90e9-bf44d669ce2b')] {{(pid=75229) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 09:49:45 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7902ab8-168d-4c8a-90e9-bf44d669ce2b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:49:45 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7902ab8-168d-4c8a-90e9-bf44d669ce2b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:49:45 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[13fa795c-26f7-4b24-b31c-fd97477af7b4]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:49:45 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dd57e30-92d4-41c9-af13-77ac442a957a tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:49:45 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7902ab8-168d-4c8a-90e9-bf44d669ce2b -p 172.16.0.220:3260 --logout {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:49:45 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7902ab8-168d-4c8a-90e9-bf44d669ce2b -p 172.16.0.220:3260 --logout" returned: 0 in 0.081s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:49:45 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[c59046b3-6aec-440c-8dbe-81ca0f0e7f0a]: (4, ('Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:a7902ab8-168d-4c8a-90e9-bf44d669ce2b, portal: 172.16.0.220,3260]\nLogout of [sid: 20, target: iqn.2010-10.org.openstack:a7902ab8-168d-4c8a-90e9-bf44d669ce2b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:49:45 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dd57e30-92d4-41c9-af13-77ac442a957a tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:a7902ab8-168d-4c8a-90e9-bf44d669ce2b, portal: 172.16.0.220,3260]
Nov 14 09:49:45 user nova-compute[75229]: Logout of [sid: 20, target: iqn.2010-10.org.openstack:a7902ab8-168d-4c8a-90e9-bf44d669ce2b, portal: 172.16.0.220,3260] successful.
Nov 14 09:49:45 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:49:45 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7902ab8-168d-4c8a-90e9-bf44d669ce2b -p 172.16.0.220:3260 --op delete {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:49:45 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7902ab8-168d-4c8a-90e9-bf44d669ce2b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.044s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:49:45 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[94d38444-21e9-4d78-919b-eb36cba6439b]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:49:45 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dd57e30-92d4-41c9-af13-77ac442a957a tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:49:45 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-7dd57e30-92d4-41c9-af13-77ac442a957a tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.392s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 09:49:45 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dd57e30-92d4-41c9-af13-77ac442a957a tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] <== disconnect_volume: return (393ms) None {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 09:49:45 user nova-compute[75229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7dd57e30-92d4-41c9-af13-77ac442a957a tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] [instance: be813b28-133f-416a-b2b5-dc0b9e4064b7] Disconnected iSCSI Volume {{(pid=75229) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 09:49:46 user nova-compute[75229]: DEBUG nova.compute.provider_tree [None req-9263b606-7384-49ba-93c3-ffbfa7db372c tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] Inventory has not changed in ProviderTree for provider: d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 {{(pid=75229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 09:49:46 user nova-compute[75229]: DEBUG nova.scheduler.client.report [None req-9263b606-7384-49ba-93c3-ffbfa7db372c tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] Inventory has not changed for provider d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 09:49:46 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-9263b606-7384-49ba-93c3-ffbfa7db372c tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.535s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:49:46 user nova-compute[75229]: DEBUG nova.compute.manager [None req-9263b606-7384-49ba-93c3-ffbfa7db372c tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] [instance: 94e2b266-2fe3-481a-bb1e-24f835a79ddf] Start building networks asynchronously for instance. {{(pid=75229) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 09:49:46 user nova-compute[75229]: INFO nova.virt.libvirt.driver [-] [instance: eb53ba25-d865-41ae-90f3-6e154e2778ba] Instance destroyed successfully.
Nov 14 09:49:46 user nova-compute[75229]: DEBUG nova.objects.instance [None req-4661d339-89ca-440f-9559-5a9b473af706 tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] Lazy-loading 'resources' on Instance uuid eb53ba25-d865-41ae-90f3-6e154e2778ba {{(pid=75229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 09:49:46 user nova-compute[75229]: DEBUG nova.virt.libvirt.vif [None req-4661d339-89ca-440f-9559-5a9b473af706 tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T09:44:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1925681213',display_name='tempest-VolumesAdminNegativeTest-server-1925681213',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1925681213',id=6,image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF9zy5mgVntJuOJ60ueuS9e/tjoHUFtvBli6Yg4p9s8JC3I9/lHYbJyCSdGrB/l/48+E/nh37qcl/lyRYbiT92OOjUa+0D7sV9dFqsjgy9fjsbhchLmhsHpM8jiCMEvfpA==',key_name='tempest-keypair-1897784256',keypairs=<?>,launch_index=0,launched_at=2023-11-14T09:44:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6026f6867f00423283219da921bef367',ramdisk_id='',reservation_id='r-kw33neqc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-333811129',owner_user_name='tempest-VolumesAdminNegativeTest-333811129-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T09:44:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ce091bb40ce04afeb988be064cbe673a',uuid=eb53ba25-d865-41ae-90f3-6e154e2778ba,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "695e538f-be1d-4450-84a0-2a0bb92dd2ac", "address": "fa:16:3e:4e:66:82", "network": {"id": "9ace077c-6658-4348-ac9b-f6be125b4f0f", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1010403250-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.168", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6026f6867f00423283219da921bef367", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap695e538f-be", "ovs_interfaceid": "695e538f-be1d-4450-84a0-2a0bb92dd2ac", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 09:49:46 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-4661d339-89ca-440f-9559-5a9b473af706 tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] Converting VIF {"id": "695e538f-be1d-4450-84a0-2a0bb92dd2ac", "address": "fa:16:3e:4e:66:82", "network": {"id": "9ace077c-6658-4348-ac9b-f6be125b4f0f", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1010403250-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.168", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6026f6867f00423283219da921bef367", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap695e538f-be", "ovs_interfaceid": "695e538f-be1d-4450-84a0-2a0bb92dd2ac", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 09:49:46 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-4661d339-89ca-440f-9559-5a9b473af706 tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4e:66:82,bridge_name='br-int',has_traffic_filtering=True,id=695e538f-be1d-4450-84a0-2a0bb92dd2ac,network=Network(9ace077c-6658-4348-ac9b-f6be125b4f0f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap695e538f-be') {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 09:49:46 user nova-compute[75229]: DEBUG os_vif [None req-4661d339-89ca-440f-9559-5a9b473af706 tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4e:66:82,bridge_name='br-int',has_traffic_filtering=True,id=695e538f-be1d-4450-84a0-2a0bb92dd2ac,network=Network(9ace077c-6658-4348-ac9b-f6be125b4f0f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap695e538f-be') {{(pid=75229) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 09:49:46 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:49:46 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap695e538f-be, bridge=br-int, if_exists=True) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:49:46 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:49:46 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 09:49:46 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:49:46 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:49:46 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=51f8bec4-3a54-41f5-8976-242cc599f898) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:49:46 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:49:46 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 09:49:46 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:49:46 user nova-compute[75229]: INFO os_vif [None req-4661d339-89ca-440f-9559-5a9b473af706 tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4e:66:82,bridge_name='br-int',has_traffic_filtering=True,id=695e538f-be1d-4450-84a0-2a0bb92dd2ac,network=Network(9ace077c-6658-4348-ac9b-f6be125b4f0f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap695e538f-be')
Nov 14 09:49:46 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-4661d339-89ca-440f-9559-5a9b473af706 tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] [instance: eb53ba25-d865-41ae-90f3-6e154e2778ba] Deleting instance files /opt/stack/data/nova/instances/eb53ba25-d865-41ae-90f3-6e154e2778ba_del
Nov 14 09:49:46 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-4661d339-89ca-440f-9559-5a9b473af706 tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] [instance: eb53ba25-d865-41ae-90f3-6e154e2778ba] Deletion of /opt/stack/data/nova/instances/eb53ba25-d865-41ae-90f3-6e154e2778ba_del complete
Nov 14 09:49:46 user nova-compute[75229]: DEBUG nova.compute.manager [None req-9263b606-7384-49ba-93c3-ffbfa7db372c tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] [instance: 94e2b266-2fe3-481a-bb1e-24f835a79ddf] Allocating IP information in the background. {{(pid=75229) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 09:49:46 user nova-compute[75229]: DEBUG nova.network.neutron [None req-9263b606-7384-49ba-93c3-ffbfa7db372c tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] [instance: 94e2b266-2fe3-481a-bb1e-24f835a79ddf] allocate_for_instance() {{(pid=75229) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 09:49:46 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-9263b606-7384-49ba-93c3-ffbfa7db372c tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] [instance: 94e2b266-2fe3-481a-bb1e-24f835a79ddf] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 09:49:46 user nova-compute[75229]: DEBUG nova.compute.manager [None req-9263b606-7384-49ba-93c3-ffbfa7db372c tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] [instance: 94e2b266-2fe3-481a-bb1e-24f835a79ddf] Start building block device mappings for instance. {{(pid=75229) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 09:49:46 user nova-compute[75229]: DEBUG nova.policy [None req-9263b606-7384-49ba-93c3-ffbfa7db372c tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3603da40a87149478458797ea9aedfe2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a6157b9827b44d2bab197220b635fd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75229) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 09:49:46 user nova-compute[75229]: INFO nova.compute.manager [None req-4661d339-89ca-440f-9559-5a9b473af706 tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] [instance: eb53ba25-d865-41ae-90f3-6e154e2778ba] Took 0.92 seconds to destroy the instance on the hypervisor.
Nov 14 09:49:46 user nova-compute[75229]: DEBUG oslo.service.loopingcall [None req-4661d339-89ca-440f-9559-5a9b473af706 tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75229) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 09:49:46 user nova-compute[75229]: DEBUG nova.compute.manager [-] [instance: eb53ba25-d865-41ae-90f3-6e154e2778ba] Deallocating network for instance {{(pid=75229) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 09:49:46 user nova-compute[75229]: DEBUG nova.network.neutron [-] [instance: eb53ba25-d865-41ae-90f3-6e154e2778ba] deallocate_for_instance() {{(pid=75229) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 09:49:46 user nova-compute[75229]: DEBUG nova.compute.manager [None req-9263b606-7384-49ba-93c3-ffbfa7db372c tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] [instance: 94e2b266-2fe3-481a-bb1e-24f835a79ddf] Start spawning the instance on the hypervisor. {{(pid=75229) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 09:49:46 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-9263b606-7384-49ba-93c3-ffbfa7db372c tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] [instance: 94e2b266-2fe3-481a-bb1e-24f835a79ddf] Creating instance directory {{(pid=75229) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 09:49:46 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-9263b606-7384-49ba-93c3-ffbfa7db372c tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] [instance: 94e2b266-2fe3-481a-bb1e-24f835a79ddf] Creating image(s)
Nov 14 09:49:46 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-9263b606-7384-49ba-93c3-ffbfa7db372c tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] Acquiring lock "/opt/stack/data/nova/instances/94e2b266-2fe3-481a-bb1e-24f835a79ddf/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:49:46 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-9263b606-7384-49ba-93c3-ffbfa7db372c tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] Lock "/opt/stack/data/nova/instances/94e2b266-2fe3-481a-bb1e-24f835a79ddf/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:49:46 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-9263b606-7384-49ba-93c3-ffbfa7db372c tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] Lock "/opt/stack/data/nova/instances/94e2b266-2fe3-481a-bb1e-24f835a79ddf/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:49:46 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-9263b606-7384-49ba-93c3-ffbfa7db372c tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] Acquiring lock "4fef5d435559eee5483c7cb62e0076a8e2f37001" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:49:46 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-9263b606-7384-49ba-93c3-ffbfa7db372c tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] Lock "4fef5d435559eee5483c7cb62e0076a8e2f37001" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:49:46 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-9263b606-7384-49ba-93c3-ffbfa7db372c tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4fef5d435559eee5483c7cb62e0076a8e2f37001.part --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:49:46 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 09:49:46 user nova-compute[75229]: DEBUG nova.compute.manager [req-2df90627-09bb-4092-b674-b8aed12b61f7 req-233f395b-b88b-4dd3-86c3-11f2d59abf3c service nova] [instance: be813b28-133f-416a-b2b5-dc0b9e4064b7] Received event network-vif-plugged-d9a42cb3-5297-4aaf-bf16-9e591cab2fdc {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:49:46 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-2df90627-09bb-4092-b674-b8aed12b61f7 req-233f395b-b88b-4dd3-86c3-11f2d59abf3c service nova] Acquiring lock "be813b28-133f-416a-b2b5-dc0b9e4064b7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:49:46 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-2df90627-09bb-4092-b674-b8aed12b61f7 req-233f395b-b88b-4dd3-86c3-11f2d59abf3c service nova] Lock "be813b28-133f-416a-b2b5-dc0b9e4064b7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:49:46 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-2df90627-09bb-4092-b674-b8aed12b61f7 req-233f395b-b88b-4dd3-86c3-11f2d59abf3c service nova] Lock "be813b28-133f-416a-b2b5-dc0b9e4064b7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:49:46 user nova-compute[75229]: DEBUG nova.compute.manager [req-2df90627-09bb-4092-b674-b8aed12b61f7 req-233f395b-b88b-4dd3-86c3-11f2d59abf3c service nova] [instance: be813b28-133f-416a-b2b5-dc0b9e4064b7] No waiting events found dispatching network-vif-plugged-d9a42cb3-5297-4aaf-bf16-9e591cab2fdc {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 09:49:46 user nova-compute[75229]: WARNING nova.compute.manager [req-2df90627-09bb-4092-b674-b8aed12b61f7 req-233f395b-b88b-4dd3-86c3-11f2d59abf3c service nova] [instance: be813b28-133f-416a-b2b5-dc0b9e4064b7] Received unexpected event network-vif-plugged-d9a42cb3-5297-4aaf-bf16-9e591cab2fdc for instance with vm_state active and task_state rebuilding.
Nov 14 09:49:46 user nova-compute[75229]: DEBUG nova.compute.manager [req-2df90627-09bb-4092-b674-b8aed12b61f7 req-233f395b-b88b-4dd3-86c3-11f2d59abf3c service nova] [instance: eb53ba25-d865-41ae-90f3-6e154e2778ba] Received event network-vif-unplugged-695e538f-be1d-4450-84a0-2a0bb92dd2ac {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:49:46 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-2df90627-09bb-4092-b674-b8aed12b61f7 req-233f395b-b88b-4dd3-86c3-11f2d59abf3c service nova] Acquiring lock "eb53ba25-d865-41ae-90f3-6e154e2778ba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:49:46 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-2df90627-09bb-4092-b674-b8aed12b61f7 req-233f395b-b88b-4dd3-86c3-11f2d59abf3c service nova] Lock "eb53ba25-d865-41ae-90f3-6e154e2778ba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:49:46 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-2df90627-09bb-4092-b674-b8aed12b61f7 req-233f395b-b88b-4dd3-86c3-11f2d59abf3c service nova] Lock "eb53ba25-d865-41ae-90f3-6e154e2778ba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:49:46 user nova-compute[75229]: DEBUG nova.compute.manager [req-2df90627-09bb-4092-b674-b8aed12b61f7 req-233f395b-b88b-4dd3-86c3-11f2d59abf3c service nova] [instance: eb53ba25-d865-41ae-90f3-6e154e2778ba] No waiting events found dispatching network-vif-unplugged-695e538f-be1d-4450-84a0-2a0bb92dd2ac {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 09:49:46 user nova-compute[75229]: DEBUG nova.compute.manager [req-2df90627-09bb-4092-b674-b8aed12b61f7 req-233f395b-b88b-4dd3-86c3-11f2d59abf3c service nova] [instance: eb53ba25-d865-41ae-90f3-6e154e2778ba] Received event network-vif-unplugged-695e538f-be1d-4450-84a0-2a0bb92dd2ac for instance with task_state deleting. {{(pid=75229) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 09:49:46 user nova-compute[75229]: DEBUG nova.compute.manager [req-2df90627-09bb-4092-b674-b8aed12b61f7 req-233f395b-b88b-4dd3-86c3-11f2d59abf3c service nova] [instance: eb53ba25-d865-41ae-90f3-6e154e2778ba] Received event network-vif-plugged-695e538f-be1d-4450-84a0-2a0bb92dd2ac {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:49:46 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-2df90627-09bb-4092-b674-b8aed12b61f7 req-233f395b-b88b-4dd3-86c3-11f2d59abf3c service nova] Acquiring lock "eb53ba25-d865-41ae-90f3-6e154e2778ba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:49:46 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-2df90627-09bb-4092-b674-b8aed12b61f7 req-233f395b-b88b-4dd3-86c3-11f2d59abf3c service nova] Lock "eb53ba25-d865-41ae-90f3-6e154e2778ba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:49:46 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-2df90627-09bb-4092-b674-b8aed12b61f7 req-233f395b-b88b-4dd3-86c3-11f2d59abf3c service nova] Lock "eb53ba25-d865-41ae-90f3-6e154e2778ba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:49:46 user nova-compute[75229]: DEBUG nova.compute.manager [req-2df90627-09bb-4092-b674-b8aed12b61f7 req-233f395b-b88b-4dd3-86c3-11f2d59abf3c service nova] [instance: eb53ba25-d865-41ae-90f3-6e154e2778ba] No waiting events found dispatching network-vif-plugged-695e538f-be1d-4450-84a0-2a0bb92dd2ac {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 09:49:46 user nova-compute[75229]: WARNING nova.compute.manager [req-2df90627-09bb-4092-b674-b8aed12b61f7 req-233f395b-b88b-4dd3-86c3-11f2d59abf3c service nova] [instance: eb53ba25-d865-41ae-90f3-6e154e2778ba] Received unexpected event network-vif-plugged-695e538f-be1d-4450-84a0-2a0bb92dd2ac for instance with vm_state active and task_state deleting.
Nov 14 09:49:46 user nova-compute[75229]: DEBUG nova.network.neutron [None req-9263b606-7384-49ba-93c3-ffbfa7db372c tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] [instance: 94e2b266-2fe3-481a-bb1e-24f835a79ddf] Successfully created port: be0352bd-a149-4097-b049-8445f895d993 {{(pid=75229) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 09:49:46 user nova-compute[75229]: INFO nova.virt.libvirt.driver [-] [instance: be813b28-133f-416a-b2b5-dc0b9e4064b7] Instance destroyed successfully.
Nov 14 09:49:46 user nova-compute[75229]: DEBUG nova.virt.libvirt.vif [None req-7dd57e30-92d4-41c9-af13-77ac442a957a tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T09:47:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-266135781',display_name='tempest-ServerActionsTestOtherA-server-179119578',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-266135781',id=15,image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI5pWGQ4KaFZcOEff0OXqhHA6X74NcsQbIGrT1blkx1Y+aHHl7DvQb7afEPRDoAhltmJD8qcavQNRjJLbmHNs+eYeK4dOL8IJQfu1ghTHpot7XRacUK1z4qoyxfCdssM8g==',key_name='tempest-keypair-865166921',keypairs=<?>,launch_index=0,launched_at=2023-11-14T09:47:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='46e65cdd021f4a3db7c9254bb6d98b46',ramdisk_id='',reservation_id='r-0oyrmh9m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-280196295',owner_user_name='tempest-ServerActionsTestOtherA-280196295-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T09:49:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c0c381a0f6124f1ca6ce85c057b9143a',uuid=be813b28-133f-416a-b2b5-dc0b9e4064b7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d9a42cb3-5297-4aaf-bf16-9e591cab2fdc", "address": "fa:16:3e:27:a8:b8", "network": {"id": "5dfc532f-3d5d-4342-b7f1-12c9c3992a54", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1457278473-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.17", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46e65cdd021f4a3db7c9254bb6d98b46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9a42cb3-52", "ovs_interfaceid": "d9a42cb3-5297-4aaf-bf16-9e591cab2fdc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 09:49:46 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-7dd57e30-92d4-41c9-af13-77ac442a957a tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Converting VIF {"id": "d9a42cb3-5297-4aaf-bf16-9e591cab2fdc", "address": "fa:16:3e:27:a8:b8", "network": {"id": "5dfc532f-3d5d-4342-b7f1-12c9c3992a54", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1457278473-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.17", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46e65cdd021f4a3db7c9254bb6d98b46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9a42cb3-52", "ovs_interfaceid": "d9a42cb3-5297-4aaf-bf16-9e591cab2fdc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 09:49:46 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-7dd57e30-92d4-41c9-af13-77ac442a957a tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:27:a8:b8,bridge_name='br-int',has_traffic_filtering=True,id=d9a42cb3-5297-4aaf-bf16-9e591cab2fdc,network=Network(5dfc532f-3d5d-4342-b7f1-12c9c3992a54),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9a42cb3-52') {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 09:49:46 user nova-compute[75229]: DEBUG os_vif [None req-7dd57e30-92d4-41c9-af13-77ac442a957a tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:27:a8:b8,bridge_name='br-int',has_traffic_filtering=True,id=d9a42cb3-5297-4aaf-bf16-9e591cab2fdc,network=Network(5dfc532f-3d5d-4342-b7f1-12c9c3992a54),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9a42cb3-52') {{(pid=75229) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 09:49:46 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:49:46 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:49:46 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:49:46 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Auditing locally available compute resources for user (node: user) {{(pid=75229) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 09:49:46 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:49:46 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd9a42cb3-52, bridge=br-int, if_exists=True) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:49:46 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 09:49:46 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:49:46 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=dbe5d18c-5483-41a3-9e4b-278155ef1b0f) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:49:46 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:49:46 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:49:46 user nova-compute[75229]: INFO os_vif [None req-7dd57e30-92d4-41c9-af13-77ac442a957a tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:27:a8:b8,bridge_name='br-int',has_traffic_filtering=True,id=d9a42cb3-5297-4aaf-bf16-9e591cab2fdc,network=Network(5dfc532f-3d5d-4342-b7f1-12c9c3992a54),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9a42cb3-52')
Nov 14 09:49:46 user nova-compute[75229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7dd57e30-92d4-41c9-af13-77ac442a957a tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] [instance: be813b28-133f-416a-b2b5-dc0b9e4064b7] calling os-brick to detach iSCSI Volume {{(pid=75229) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 09:49:46 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dd57e30-92d4-41c9-af13-77ac442a957a tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f73f85151b0>, {'target_iqn': 'iqn.2010-10.org.openstack:a7902ab8-168d-4c8a-90e9-bf44d669ce2b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HBhZNQjK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 09:49:46 user nova-compute[75229]: WARNING os_brick.initiator.connectors.base [None req-7dd57e30-92d4-41c9-af13-77ac442a957a tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 14 09:49:46 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-7dd57e30-92d4-41c9-af13-77ac442a957a tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 09:49:46 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-7dd57e30-92d4-41c9-af13-77ac442a957a tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 09:49:46 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:49:47 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-9263b606-7384-49ba-93c3-ffbfa7db372c tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4fef5d435559eee5483c7cb62e0076a8e2f37001.part --force-share --output=json" returned: 0 in 0.206s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:49:47 user nova-compute[75229]: DEBUG nova.virt.images [None req-9263b606-7384-49ba-93c3-ffbfa7db372c tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] efab0bf3-e7ec-4953-8a54-2c5bb0a3baf6 was qcow2, converting to raw {{(pid=75229) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 14 09:49:47 user nova-compute[75229]: DEBUG nova.privsep.utils [None req-9263b606-7384-49ba-93c3-ffbfa7db372c tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75229) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 14 09:49:47 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-9263b606-7384-49ba-93c3-ffbfa7db372c tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/4fef5d435559eee5483c7cb62e0076a8e2f37001.part /opt/stack/data/nova/instances/_base/4fef5d435559eee5483c7cb62e0076a8e2f37001.converted {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:49:47 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:49:47 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[657e23ed-37d1-4cc6-ac77-4d1caa0dbb65]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5b54e594-ae66-4ba2-9bda-aa4431d31c3f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:aca09258-022b-4f04-b418-f2a170332755\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3fed285f-9be4-4601-8cb5-4329d7ebed8c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:49:47 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dd57e30-92d4-41c9-af13-77ac442a957a tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 09:49:47 user nova-compute[75229]: No targets found.
Nov 14 09:49:47 user nova-compute[75229]: iSNS:
Nov 14 09:49:47 user nova-compute[75229]: No targets found.
Nov 14 09:49:47 user nova-compute[75229]: STATIC:
Nov 14 09:49:47 user nova-compute[75229]: Target: iqn.2010-10.org.openstack:5b54e594-ae66-4ba2-9bda-aa4431d31c3f
Nov 14 09:49:47 user nova-compute[75229]:         Portal: 172.16.0.220:3260,-1
Nov 14 09:49:47 user nova-compute[75229]:                 Iface Name: default
Nov 14 09:49:47 user nova-compute[75229]: Target: iqn.2010-10.org.openstack:aca09258-022b-4f04-b418-f2a170332755
Nov 14 09:49:47 user nova-compute[75229]:         Portal: 172.16.0.220:3260,-1
Nov 14 09:49:47 user nova-compute[75229]:                 Iface Name: default
Nov 14 09:49:47 user nova-compute[75229]: Target: iqn.2010-10.org.openstack:3fed285f-9be4-4601-8cb5-4329d7ebed8c
Nov 14 09:49:47 user nova-compute[75229]:         Portal: 172.16.0.220:3260,-1
Nov 14 09:49:47 user nova-compute[75229]:                 Iface Name: default
Nov 14 09:49:47 user nova-compute[75229]: FIRMWARE:
Nov 14 09:49:47 user nova-compute[75229]: No targets found.
Nov 14 09:49:47 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 09:49:47 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dd57e30-92d4-41c9-af13-77ac442a957a tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 09:49:47 user nova-compute[75229]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 09:49:47 user nova-compute[75229]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75229) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 09:49:47 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dd57e30-92d4-41c9-af13-77ac442a957a tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a7902ab8-168d-4c8a-90e9-bf44d669ce2b', 0)] {{(pid=75229) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 09:49:47 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:49:47 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:49:47 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb457b60-812a-4f8c-97ba-f396ab6ba343]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3fed285f-9be4-4601-8cb5-4329d7ebed8c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5b54e594-ae66-4ba2-9bda-aa4431d31c3f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aca09258-022b-4f04-b418-f2a170332755\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:49:47 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:49:47 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:49:47 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdf4a2b2-4f27-4060-9d15-4d628cd89774]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fed285f-9be4-4601-8cb5-4329d7ebed8c (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b54e594-ae66-4ba2-9bda-aa4431d31c3f (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aca09258-022b-4f04-b418-f2a170332755 (non-flash)\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:49:47 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dd57e30-92d4-41c9-af13-77ac442a957a tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fed285f-9be4-4601-8cb5-4329d7ebed8c (non-flash)
Nov 14 09:49:47 user nova-compute[75229]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b54e594-ae66-4ba2-9bda-aa4431d31c3f (non-flash)
Nov 14 09:49:47 user nova-compute[75229]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aca09258-022b-4f04-b418-f2a170332755 (non-flash)
Nov 14 09:49:47 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 09:49:47 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dd57e30-92d4-41c9-af13-77ac442a957a tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fed285f-9be4-4601-8cb5-4329d7ebed8c (non-flash)
Nov 14 09:49:47 user nova-compute[75229]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b54e594-ae66-4ba2-9bda-aa4431d31c3f (non-flash)
Nov 14 09:49:47 user nova-compute[75229]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aca09258-022b-4f04-b418-f2a170332755 (non-flash)
Nov 14 09:49:47 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 09:49:47 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dd57e30-92d4-41c9-af13-77ac442a957a tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f73d4e99ea0>, {}) {{(pid=75229) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 09:49:47 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dd57e30-92d4-41c9-af13-77ac442a957a tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Disconnecting from: [] {{(pid=75229) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 09:49:47 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-7dd57e30-92d4-41c9-af13-77ac442a957a tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.138s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 09:49:47 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dd57e30-92d4-41c9-af13-77ac442a957a tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] <== disconnect_volume: return (141ms) None {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 09:49:47 user nova-compute[75229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7dd57e30-92d4-41c9-af13-77ac442a957a tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] [instance: be813b28-133f-416a-b2b5-dc0b9e4064b7] Disconnected iSCSI Volume {{(pid=75229) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 09:49:47 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-7dd57e30-92d4-41c9-af13-77ac442a957a tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] [instance: be813b28-133f-416a-b2b5-dc0b9e4064b7] Deleting instance files /opt/stack/data/nova/instances/be813b28-133f-416a-b2b5-dc0b9e4064b7_del
Nov 14 09:49:47 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-7dd57e30-92d4-41c9-af13-77ac442a957a tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] [instance: be813b28-133f-416a-b2b5-dc0b9e4064b7] Deletion of /opt/stack/data/nova/instances/be813b28-133f-416a-b2b5-dc0b9e4064b7_del complete
Nov 14 09:49:47 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-9263b606-7384-49ba-93c3-ffbfa7db372c tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/4fef5d435559eee5483c7cb62e0076a8e2f37001.part /opt/stack/data/nova/instances/_base/4fef5d435559eee5483c7cb62e0076a8e2f37001.converted" returned: 0 in 0.185s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:49:47 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-9263b606-7384-49ba-93c3-ffbfa7db372c tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4fef5d435559eee5483c7cb62e0076a8e2f37001.converted --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:49:47 user nova-compute[75229]: INFO nova.compute.manager [None req-64bc43f2-2e3f-44a6-87a9-0a7dcad856e8 tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] [instance: e09b3809-2e23-401c-9a72-88feb2bb657c] Unrescuing
Nov 14 09:49:47 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-64bc43f2-2e3f-44a6-87a9-0a7dcad856e8 tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] Acquiring lock "refresh_cache-e09b3809-2e23-401c-9a72-88feb2bb657c" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 09:49:47 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-64bc43f2-2e3f-44a6-87a9-0a7dcad856e8 tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] Acquired lock "refresh_cache-e09b3809-2e23-401c-9a72-88feb2bb657c" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 09:49:47 user nova-compute[75229]: DEBUG nova.network.neutron [None req-64bc43f2-2e3f-44a6-87a9-0a7dcad856e8 tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] [instance: e09b3809-2e23-401c-9a72-88feb2bb657c] Building network info cache for instance {{(pid=75229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 09:49:47 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7750cbc-b3d0-44aa-8b88-c291ba007a8a/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:49:47 user nova-compute[75229]: DEBUG nova.network.neutron [-] [instance: eb53ba25-d865-41ae-90f3-6e154e2778ba] Updating instance_info_cache with network_info: [] {{(pid=75229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 09:49:47 user nova-compute[75229]: DEBUG nova.compute.manager [req-edceb366-e1d1-4791-a118-78fdba5ca07d req-5056e60d-437a-4b77-8965-d68dd261ea07 service nova] [instance: eb53ba25-d865-41ae-90f3-6e154e2778ba] Received event network-vif-deleted-695e538f-be1d-4450-84a0-2a0bb92dd2ac {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:49:47 user nova-compute[75229]: INFO nova.compute.manager [req-edceb366-e1d1-4791-a118-78fdba5ca07d req-5056e60d-437a-4b77-8965-d68dd261ea07 service nova] [instance: eb53ba25-d865-41ae-90f3-6e154e2778ba] Neutron deleted interface 695e538f-be1d-4450-84a0-2a0bb92dd2ac; detaching it from the instance and deleting it from the info cache
Nov 14 09:49:47 user nova-compute[75229]: DEBUG nova.network.neutron [req-edceb366-e1d1-4791-a118-78fdba5ca07d req-5056e60d-437a-4b77-8965-d68dd261ea07 service nova] [instance: eb53ba25-d865-41ae-90f3-6e154e2778ba] Updating instance_info_cache with network_info: [] {{(pid=75229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 09:49:47 user nova-compute[75229]: INFO nova.compute.manager [-] [instance: eb53ba25-d865-41ae-90f3-6e154e2778ba] Took 1.09 seconds to deallocate network for instance.
Nov 14 09:49:47 user nova-compute[75229]: DEBUG nova.compute.manager [req-edceb366-e1d1-4791-a118-78fdba5ca07d req-5056e60d-437a-4b77-8965-d68dd261ea07 service nova] [instance: eb53ba25-d865-41ae-90f3-6e154e2778ba] Detach interface failed, port_id=695e538f-be1d-4450-84a0-2a0bb92dd2ac, reason: Instance eb53ba25-d865-41ae-90f3-6e154e2778ba could not be found. {{(pid=75229) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 14 09:49:47 user nova-compute[75229]: INFO nova.virt.block_device [None req-7dd57e30-92d4-41c9-af13-77ac442a957a tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] [instance: be813b28-133f-416a-b2b5-dc0b9e4064b7] Booting with volume a7902ab8-168d-4c8a-90e9-bf44d669ce2b at /dev/vdb
Nov 14 09:49:47 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-4661d339-89ca-440f-9559-5a9b473af706 tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:49:47 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-4661d339-89ca-440f-9559-5a9b473af706 tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:49:47 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-9263b606-7384-49ba-93c3-ffbfa7db372c tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4fef5d435559eee5483c7cb62e0076a8e2f37001.converted --force-share --output=json" returned: 0 in 0.238s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:49:47 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-9263b606-7384-49ba-93c3-ffbfa7db372c tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] Lock "4fef5d435559eee5483c7cb62e0076a8e2f37001" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.098s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:49:47 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-9263b606-7384-49ba-93c3-ffbfa7db372c tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4fef5d435559eee5483c7cb62e0076a8e2f37001 --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:49:47 user nova-compute[75229]: DEBUG os_brick.utils [None req-7dd57e30-92d4-41c9-af13-77ac442a957a tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 09:49:47 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7750cbc-b3d0-44aa-8b88-c291ba007a8a/disk --force-share --output=json" returned: 0 in 0.248s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:49:47 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:49:47 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7750cbc-b3d0-44aa-8b88-c291ba007a8a/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:49:47 user nova-compute[75229]: DEBUG nova.network.neutron [None req-9263b606-7384-49ba-93c3-ffbfa7db372c tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] [instance: 94e2b266-2fe3-481a-bb1e-24f835a79ddf] Successfully updated port: be0352bd-a149-4097-b049-8445f895d993 {{(pid=75229) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 09:49:47 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:49:47 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d500464-2434-4761-ac20-492561333bdb]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f1154031c835\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:49:47 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:49:47 user nova-compute[75229]: DEBUG nova.compute.manager [req-d96bea37-a753-4b6e-8bdc-17a3d4befd68 req-ad803013-243a-4504-b5fa-807d95239567 service nova] [instance: 94e2b266-2fe3-481a-bb1e-24f835a79ddf] Received event network-changed-be0352bd-a149-4097-b049-8445f895d993 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:49:47 user nova-compute[75229]: DEBUG nova.compute.manager [req-d96bea37-a753-4b6e-8bdc-17a3d4befd68 req-ad803013-243a-4504-b5fa-807d95239567 service nova] [instance: 94e2b266-2fe3-481a-bb1e-24f835a79ddf] Refreshing instance network info cache due to event network-changed-be0352bd-a149-4097-b049-8445f895d993. {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 09:49:47 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-d96bea37-a753-4b6e-8bdc-17a3d4befd68 req-ad803013-243a-4504-b5fa-807d95239567 service nova] Acquiring lock "refresh_cache-94e2b266-2fe3-481a-bb1e-24f835a79ddf" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 09:49:47 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-d96bea37-a753-4b6e-8bdc-17a3d4befd68 req-ad803013-243a-4504-b5fa-807d95239567 service nova] Acquired lock "refresh_cache-94e2b266-2fe3-481a-bb1e-24f835a79ddf" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 09:49:47 user nova-compute[75229]: DEBUG nova.network.neutron [req-d96bea37-a753-4b6e-8bdc-17a3d4befd68 req-ad803013-243a-4504-b5fa-807d95239567 service nova] [instance: 94e2b266-2fe3-481a-bb1e-24f835a79ddf] Refreshing network info cache for port be0352bd-a149-4097-b049-8445f895d993 {{(pid=75229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 09:49:47 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-9263b606-7384-49ba-93c3-ffbfa7db372c tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] Acquiring lock "refresh_cache-94e2b266-2fe3-481a-bb1e-24f835a79ddf" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 09:49:47 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.027s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:49:47 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bff0710-adc0-4bab-a61e-081b8f90ce9c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:49:47 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:49:47 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:49:47 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[93145c4b-c4ee-432e-802d-969f227df601]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:49:47 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-9263b606-7384-49ba-93c3-ffbfa7db372c tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4fef5d435559eee5483c7cb62e0076a8e2f37001 --force-share --output=json" returned: 0 in 0.196s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:49:47 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-9263b606-7384-49ba-93c3-ffbfa7db372c tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] Acquiring lock "4fef5d435559eee5483c7cb62e0076a8e2f37001" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:49:47 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-9263b606-7384-49ba-93c3-ffbfa7db372c tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] Lock "4fef5d435559eee5483c7cb62e0076a8e2f37001" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:49:47 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-9263b606-7384-49ba-93c3-ffbfa7db372c tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4fef5d435559eee5483c7cb62e0076a8e2f37001 --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:49:47 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[0443a52b-85d9-4143-bdb1-8196b7ee47ac]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:49:47 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-7dd57e30-92d4-41c9-af13-77ac442a957a tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Running cmd (subprocess): nvme version {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:49:47 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-7dd57e30-92d4-41c9-af13-77ac442a957a tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] 'nvme version' failed. Not Retrying. {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 09:49:47 user nova-compute[75229]: DEBUG nova.network.neutron [req-d96bea37-a753-4b6e-8bdc-17a3d4befd68 req-ad803013-243a-4504-b5fa-807d95239567 service nova] [instance: 94e2b266-2fe3-481a-bb1e-24f835a79ddf] Instance cache missing network info. {{(pid=75229) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 09:49:47 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7dd57e30-92d4-41c9-af13-77ac442a957a tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] nvme not present on system {{(pid=75229) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 09:49:47 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7750cbc-b3d0-44aa-8b88-c291ba007a8a/disk --force-share --output=json" returned: 0 in 0.249s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:49:47 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:49:47 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 09:49:47 user nova-compute[75229]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 09:49:47 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7f1ab5e-f3c6-4ffb-bd61-d8c6c90c1e9a]: (4, '') {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:49:47 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.lightos [None req-7dd57e30-92d4-41c9-af13-77ac442a957a tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75229) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 09:49:47 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.lightos [None req-7dd57e30-92d4-41c9-af13-77ac442a957a tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75229) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 09:49:47 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.lightos [None req-7dd57e30-92d4-41c9-af13-77ac442a957a tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] LIGHTOS: no hostnqn found. {{(pid=75229) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 09:49:47 user nova-compute[75229]: DEBUG os_brick.utils [None req-7dd57e30-92d4-41c9-af13-77ac442a957a tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] <== get_connector_properties: return (288ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f1154031c835', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 09:49:47 user nova-compute[75229]: DEBUG nova.virt.block_device [None req-7dd57e30-92d4-41c9-af13-77ac442a957a tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] [instance: be813b28-133f-416a-b2b5-dc0b9e4064b7] Updating existing volume attachment record: f1ff531a-7e21-4bb2-8df2-ffae9dc94972 {{(pid=75229) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 09:49:47 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a60d339f-e134-477c-8505-bf8c79d2a21c/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:49:47 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-9263b606-7384-49ba-93c3-ffbfa7db372c tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4fef5d435559eee5483c7cb62e0076a8e2f37001 --force-share --output=json" returned: 0 in 0.219s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:49:47 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-9263b606-7384-49ba-93c3-ffbfa7db372c tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4fef5d435559eee5483c7cb62e0076a8e2f37001,backing_fmt=raw /opt/stack/data/nova/instances/94e2b266-2fe3-481a-bb1e-24f835a79ddf/disk 1073741824 {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:49:47 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-9263b606-7384-49ba-93c3-ffbfa7db372c tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4fef5d435559eee5483c7cb62e0076a8e2f37001,backing_fmt=raw /opt/stack/data/nova/instances/94e2b266-2fe3-481a-bb1e-24f835a79ddf/disk 1073741824" returned: 0 in 0.059s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:49:47 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-9263b606-7384-49ba-93c3-ffbfa7db372c tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] Lock "4fef5d435559eee5483c7cb62e0076a8e2f37001" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.288s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:49:47 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-9263b606-7384-49ba-93c3-ffbfa7db372c tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4fef5d435559eee5483c7cb62e0076a8e2f37001 --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:49:48 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a60d339f-e134-477c-8505-bf8c79d2a21c/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:49:48 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a60d339f-e134-477c-8505-bf8c79d2a21c/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:49:48 user nova-compute[75229]: DEBUG nova.network.neutron [req-d96bea37-a753-4b6e-8bdc-17a3d4befd68 req-ad803013-243a-4504-b5fa-807d95239567 service nova] [instance: 94e2b266-2fe3-481a-bb1e-24f835a79ddf] Updating instance_info_cache with network_info: [] {{(pid=75229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 09:49:48 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-d96bea37-a753-4b6e-8bdc-17a3d4befd68 req-ad803013-243a-4504-b5fa-807d95239567 service nova] Releasing lock "refresh_cache-94e2b266-2fe3-481a-bb1e-24f835a79ddf" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 09:49:48 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-9263b606-7384-49ba-93c3-ffbfa7db372c tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] Acquired lock "refresh_cache-94e2b266-2fe3-481a-bb1e-24f835a79ddf" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 09:49:48 user nova-compute[75229]: DEBUG nova.network.neutron [None req-9263b606-7384-49ba-93c3-ffbfa7db372c tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] [instance: 94e2b266-2fe3-481a-bb1e-24f835a79ddf] Building network info cache for instance {{(pid=75229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 09:49:48 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:49:48 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-9263b606-7384-49ba-93c3-ffbfa7db372c tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4fef5d435559eee5483c7cb62e0076a8e2f37001 --force-share --output=json" returned: 0 in 0.202s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:49:48 user nova-compute[75229]: DEBUG nova.virt.disk.api [None req-9263b606-7384-49ba-93c3-ffbfa7db372c tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] Checking if we can resize image /opt/stack/data/nova/instances/94e2b266-2fe3-481a-bb1e-24f835a79ddf/disk. size=1073741824 {{(pid=75229) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 09:49:48 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-9263b606-7384-49ba-93c3-ffbfa7db372c tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94e2b266-2fe3-481a-bb1e-24f835a79ddf/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:49:48 user nova-compute[75229]: DEBUG nova.network.neutron [None req-9263b606-7384-49ba-93c3-ffbfa7db372c tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] [instance: 94e2b266-2fe3-481a-bb1e-24f835a79ddf] Instance cache missing network info. {{(pid=75229) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 09:49:48 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a60d339f-e134-477c-8505-bf8c79d2a21c/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:49:48 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=75229) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 09:49:48 user nova-compute[75229]: WARNING nova.virt.libvirt.driver [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Error from libvirt while getting description of instance-0000000f: [Error Code 42] Domain not found: no domain with matching uuid 'be813b28-133f-416a-b2b5-dc0b9e4064b7' (instance-0000000f): libvirt.libvirtError: Domain not found: no domain with matching uuid 'be813b28-133f-416a-b2b5-dc0b9e4064b7' (instance-0000000f)
Nov 14 09:49:48 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90bd76df-96cb-4bec-9862-853d94cdbaab/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:49:48 user nova-compute[75229]: DEBUG nova.network.neutron [None req-64bc43f2-2e3f-44a6-87a9-0a7dcad856e8 tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] [instance: e09b3809-2e23-401c-9a72-88feb2bb657c] Updating instance_info_cache with network_info: [{"id": "472488d2-9453-4d74-a6b1-6966b835572d", "address": "fa:16:3e:9f:3a:e8", "network": {"id": "f5285ef5-fa74-4079-a8cd-f970d97c97c3", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-62550527-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.73", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54dca06fda8b43d5bc92fa7c97a872a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap472488d2-94", "ovs_interfaceid": "472488d2-9453-4d74-a6b1-6966b835572d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 09:49:48 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-64bc43f2-2e3f-44a6-87a9-0a7dcad856e8 tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] Releasing lock "refresh_cache-e09b3809-2e23-401c-9a72-88feb2bb657c" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 09:49:48 user nova-compute[75229]: DEBUG nova.objects.instance [None req-64bc43f2-2e3f-44a6-87a9-0a7dcad856e8 tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] Lazy-loading 'flavor' on Instance uuid e09b3809-2e23-401c-9a72-88feb2bb657c {{(pid=75229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 09:49:48 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-9263b606-7384-49ba-93c3-ffbfa7db372c tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94e2b266-2fe3-481a-bb1e-24f835a79ddf/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:49:48 user nova-compute[75229]: DEBUG nova.virt.disk.api [None req-9263b606-7384-49ba-93c3-ffbfa7db372c tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] Cannot resize image /opt/stack/data/nova/instances/94e2b266-2fe3-481a-bb1e-24f835a79ddf/disk to a smaller size. {{(pid=75229) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 09:49:48 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-9263b606-7384-49ba-93c3-ffbfa7db372c tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] [instance: 94e2b266-2fe3-481a-bb1e-24f835a79ddf] Created local disks {{(pid=75229) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 09:49:48 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-9263b606-7384-49ba-93c3-ffbfa7db372c tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] [instance: 94e2b266-2fe3-481a-bb1e-24f835a79ddf] Ensure instance console log exists: /opt/stack/data/nova/instances/94e2b266-2fe3-481a-bb1e-24f835a79ddf/console.log {{(pid=75229) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 09:49:48 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-9263b606-7384-49ba-93c3-ffbfa7db372c tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:49:48 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-9263b606-7384-49ba-93c3-ffbfa7db372c tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:49:48 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-9263b606-7384-49ba-93c3-ffbfa7db372c tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:49:48 user nova-compute[75229]: DEBUG nova.compute.provider_tree [None req-4661d339-89ca-440f-9559-5a9b473af706 tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] Inventory has not changed in ProviderTree for provider: d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 {{(pid=75229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 09:49:48 user nova-compute[75229]: DEBUG nova.scheduler.client.report [None req-4661d339-89ca-440f-9559-5a9b473af706 tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] Inventory has not changed for provider d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 09:49:48 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-4661d339-89ca-440f-9559-5a9b473af706 tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.999s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:49:48 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90bd76df-96cb-4bec-9862-853d94cdbaab/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:49:48 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90bd76df-96cb-4bec-9862-853d94cdbaab/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:49:48 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:49:48 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:49:48 user nova-compute[75229]: INFO nova.scheduler.client.report [None req-4661d339-89ca-440f-9559-5a9b473af706 tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] Deleted allocations for instance eb53ba25-d865-41ae-90f3-6e154e2778ba
Nov 14 09:49:48 user nova-compute[75229]: WARNING nova.virt.libvirt.driver [None req-dc2298af-0efe-4953-80f9-1007c75f1268 tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance 90bd76df-96cb-4bec-9862-853d94cdbaab is timed out.
Nov 14 09:49:48 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:49:48 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-dc2298af-0efe-4953-80f9-1007c75f1268 tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Successfully detached device vdc from instance 90bd76df-96cb-4bec-9862-853d94cdbaab from the live domain config.
Nov 14 09:49:48 user nova-compute[75229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dc2298af-0efe-4953-80f9-1007c75f1268 tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] [instance: 90bd76df-96cb-4bec-9862-853d94cdbaab] calling os-brick to detach iSCSI Volume {{(pid=75229) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 09:49:48 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc2298af-0efe-4953-80f9-1007c75f1268 tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f73f85151b0>, {'target_iqn': 'iqn.2010-10.org.openstack:5b54e594-ae66-4ba2-9bda-aa4431d31c3f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fPmAiwBK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 09:49:48 user nova-compute[75229]: WARNING os_brick.initiator.connectors.base [None req-dc2298af-0efe-4953-80f9-1007c75f1268 tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 09:49:48 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-dc2298af-0efe-4953-80f9-1007c75f1268 tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 09:49:48 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-dc2298af-0efe-4953-80f9-1007c75f1268 tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 09:49:48 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:49:48 user nova-compute[75229]: DEBUG nova.network.neutron [None req-9263b606-7384-49ba-93c3-ffbfa7db372c tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] [instance: 94e2b266-2fe3-481a-bb1e-24f835a79ddf] Updating instance_info_cache with network_info: [{"id": "be0352bd-a149-4097-b049-8445f895d993", "address": "fa:16:3e:dc:24:42", "network": {"id": "1687d918-9f70-4099-b44c-97f92f90e6ff", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2074208460-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a6157b9827b44d2bab197220b635fd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe0352bd-a1", "ovs_interfaceid": "be0352bd-a149-4097-b049-8445f895d993", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 09:49:48 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.053s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:49:48 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2a68c28-9586-4af7-9f80-5660bf0bb535]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5b54e594-ae66-4ba2-9bda-aa4431d31c3f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:aca09258-022b-4f04-b418-f2a170332755\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3fed285f-9be4-4601-8cb5-4329d7ebed8c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:49:48 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc2298af-0efe-4953-80f9-1007c75f1268 tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 09:49:48 user nova-compute[75229]: No targets found.
Nov 14 09:49:48 user nova-compute[75229]: iSNS:
Nov 14 09:49:48 user nova-compute[75229]: No targets found.
Nov 14 09:49:48 user nova-compute[75229]: STATIC:
Nov 14 09:49:48 user nova-compute[75229]: Target: iqn.2010-10.org.openstack:5b54e594-ae66-4ba2-9bda-aa4431d31c3f
Nov 14 09:49:48 user nova-compute[75229]:         Portal: 172.16.0.220:3260,-1
Nov 14 09:49:48 user nova-compute[75229]:                 Iface Name: default
Nov 14 09:49:48 user nova-compute[75229]: Target: iqn.2010-10.org.openstack:aca09258-022b-4f04-b418-f2a170332755
Nov 14 09:49:48 user nova-compute[75229]:         Portal: 172.16.0.220:3260,-1
Nov 14 09:49:48 user nova-compute[75229]:                 Iface Name: default
Nov 14 09:49:48 user nova-compute[75229]: Target: iqn.2010-10.org.openstack:3fed285f-9be4-4601-8cb5-4329d7ebed8c
Nov 14 09:49:48 user nova-compute[75229]:         Portal: 172.16.0.220:3260,-1
Nov 14 09:49:48 user nova-compute[75229]:                 Iface Name: default
Nov 14 09:49:48 user nova-compute[75229]: FIRMWARE:
Nov 14 09:49:48 user nova-compute[75229]: No targets found.
Nov 14 09:49:48 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 09:49:48 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc2298af-0efe-4953-80f9-1007c75f1268 tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 09:49:48 user nova-compute[75229]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 09:49:48 user nova-compute[75229]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75229) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 09:49:48 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc2298af-0efe-4953-80f9-1007c75f1268 tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5b54e594-ae66-4ba2-9bda-aa4431d31c3f', 0)] {{(pid=75229) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 09:49:48 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:49:48 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:49:48 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fa2688e-cf18-4a89-904b-f0308973e90e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3fed285f-9be4-4601-8cb5-4329d7ebed8c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5b54e594-ae66-4ba2-9bda-aa4431d31c3f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aca09258-022b-4f04-b418-f2a170332755\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:49:48 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:49:48 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-9263b606-7384-49ba-93c3-ffbfa7db372c tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] Releasing lock "refresh_cache-94e2b266-2fe3-481a-bb1e-24f835a79ddf" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 09:49:48 user nova-compute[75229]: DEBUG nova.compute.manager [None req-9263b606-7384-49ba-93c3-ffbfa7db372c tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] [instance: 94e2b266-2fe3-481a-bb1e-24f835a79ddf] Instance network_info: |[{"id": "be0352bd-a149-4097-b049-8445f895d993", "address": "fa:16:3e:dc:24:42", "network": {"id": "1687d918-9f70-4099-b44c-97f92f90e6ff", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2074208460-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a6157b9827b44d2bab197220b635fd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe0352bd-a1", "ovs_interfaceid": "be0352bd-a149-4097-b049-8445f895d993", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75229) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 09:49:48 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-9263b606-7384-49ba-93c3-ffbfa7db372c tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] [instance: 94e2b266-2fe3-481a-bb1e-24f835a79ddf] Start _get_guest_xml network_info=[{"id": "be0352bd-a149-4097-b049-8445f895d993", "address": "fa:16:3e:dc:24:42", "network": {"id": "1687d918-9f70-4099-b44c-97f92f90e6ff", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2074208460-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a6157b9827b44d2bab197220b635fd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe0352bd-a1", "ovs_interfaceid": "be0352bd-a149-4097-b049-8445f895d993", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T09:49:42Z,direct_url=<?>,disk_format='qcow2',id=efab0bf3-e7ec-4953-8a54-2c5bb0a3baf6,min_disk=0,min_ram=0,name='tempest-scenario-img--1579703390',owner='4a6157b9827b44d2bab197220b635fd3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T09:49:44Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'disk_bus': 'virtio', 'guest_format': None, 'encryption_secret_uuid': None, 'size': 0, 'device_type': 'disk', 'image_id': 'efab0bf3-e7ec-4953-8a54-2c5bb0a3baf6'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75229) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 09:49:48 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-4661d339-89ca-440f-9559-5a9b473af706 tempest-VolumesAdminNegativeTest-333811129 tempest-VolumesAdminNegativeTest-333811129-project-member] Lock "eb53ba25-d865-41ae-90f3-6e154e2778ba" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.326s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:49:48 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:49:48 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[4be2c865-c1fe-4dc2-bc1a-7b171b8b19c9]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fed285f-9be4-4601-8cb5-4329d7ebed8c (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b54e594-ae66-4ba2-9bda-aa4431d31c3f (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aca09258-022b-4f04-b418-f2a170332755 (non-flash)\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:49:48 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc2298af-0efe-4953-80f9-1007c75f1268 tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fed285f-9be4-4601-8cb5-4329d7ebed8c (non-flash)
Nov 14 09:49:48 user nova-compute[75229]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b54e594-ae66-4ba2-9bda-aa4431d31c3f (non-flash)
Nov 14 09:49:48 user nova-compute[75229]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aca09258-022b-4f04-b418-f2a170332755 (non-flash)
Nov 14 09:49:48 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 09:49:48 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc2298af-0efe-4953-80f9-1007c75f1268 tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fed285f-9be4-4601-8cb5-4329d7ebed8c (non-flash)
Nov 14 09:49:48 user nova-compute[75229]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b54e594-ae66-4ba2-9bda-aa4431d31c3f (non-flash)
Nov 14 09:49:48 user nova-compute[75229]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aca09258-022b-4f04-b418-f2a170332755 (non-flash)
Nov 14 09:49:48 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 09:49:48 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc2298af-0efe-4953-80f9-1007c75f1268 tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f73d4ec9630>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5b54e594-ae66-4ba2-9bda-aa4431d31c3f'): ({'sdg'}, set())}) {{(pid=75229) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 09:49:48 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-dc2298af-0efe-4953-80f9-1007c75f1268 tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Removing single pathed devices sdg {{(pid=75229) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 09:49:48 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:49:48 user nova-compute[75229]: WARNING nova.virt.libvirt.driver [None req-9263b606-7384-49ba-93c3-ffbfa7db372c tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 09:49:48 user nova-compute[75229]: WARNING nova.virt.libvirt.driver [None req-9263b606-7384-49ba-93c3-ffbfa7db372c tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 09:49:48 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90bd76df-96cb-4bec-9862-853d94cdbaab/disk --force-share --output=json" returned: 0 in 0.277s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:49:48 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:49:48 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[c744cce3-7ecf-45b4-9aec-d3045c0a931b]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:49:48 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-9263b606-7384-49ba-93c3-ffbfa7db372c tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75229) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 09:49:48 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-9263b606-7384-49ba-93c3-ffbfa7db372c tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] CPU controller missing on host. {{(pid=75229) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 09:49:48 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:49:48 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6e2d77b-9894-4afa-8fa1-13a2842ba9a7/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:49:48 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.023s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:49:48 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[e732e553-5924-4678-9a68-0d1a90e7998e]: (4, ('ok\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:49:48 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-dc2298af-0efe-4953-80f9-1007c75f1268 tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Flushing IO for device /dev/sdg {{(pid=75229) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 09:49:48 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-9263b606-7384-49ba-93c3-ffbfa7db372c tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75229) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 09:49:48 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-9263b606-7384-49ba-93c3-ffbfa7db372c tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] CPU controller found on host. {{(pid=75229) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 09:49:48 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-9263b606-7384-49ba-93c3-ffbfa7db372c tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75229) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 09:49:48 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-9263b606-7384-49ba-93c3-ffbfa7db372c tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T09:39:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T09:49:42Z,direct_url=<?>,disk_format='qcow2',id=efab0bf3-e7ec-4953-8a54-2c5bb0a3baf6,min_disk=0,min_ram=0,name='tempest-scenario-img--1579703390',owner='4a6157b9827b44d2bab197220b635fd3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T09:49:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 09:49:48 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-9263b606-7384-49ba-93c3-ffbfa7db372c tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] Flavor limits 0:0:0 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 09:49:48 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-9263b606-7384-49ba-93c3-ffbfa7db372c tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] Image limits 0:0:0 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 09:49:48 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-9263b606-7384-49ba-93c3-ffbfa7db372c tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] Flavor pref 0:0:0 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 09:49:48 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-9263b606-7384-49ba-93c3-ffbfa7db372c tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] Image pref 0:0:0 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 09:49:48 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-9263b606-7384-49ba-93c3-ffbfa7db372c tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 09:49:48 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-9263b606-7384-49ba-93c3-ffbfa7db372c tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 09:49:48 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-9263b606-7384-49ba-93c3-ffbfa7db372c tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75229) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 09:49:48 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-9263b606-7384-49ba-93c3-ffbfa7db372c tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] Got 1 possible topologies {{(pid=75229) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 09:49:48 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-9263b606-7384-49ba-93c3-ffbfa7db372c tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 09:49:48 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-9263b606-7384-49ba-93c3-ffbfa7db372c tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 09:49:48 user nova-compute[75229]: DEBUG nova.virt.libvirt.vif [None req-9263b606-7384-49ba-93c3-ffbfa7db372c tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T09:49:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1624451670',display_name='tempest-TestMinimumBasicScenario-server-1624451670',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1624451670',id=21,image_ref='efab0bf3-e7ec-4953-8a54-2c5bb0a3baf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHLGyqy66WiitWeWLqujQDO7dBN6UvLDY3R5qVL6duh6Uqwoj1b+NfY0QC2GN9l+L9VeminYuv9MwxoPfEZ4V+l+UlMp+6JyFrnRt14AE/ia/51KfvySly2NYmpfm1yFaw==',key_name='tempest-TestMinimumBasicScenario-185710581',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4a6157b9827b44d2bab197220b635fd3',ramdisk_id='',reservation_id='r-0ro875yg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='efab0bf3-e7ec-4953-8a54-2c5bb0a3baf6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-284611138',owner_user_name='tempest-TestMinimumBasicScenario-284611138-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T09:49:46Z,user_data=None,user_id='3603da40a87149478458797ea9aedfe2',uuid=94e2b266-2fe3-481a-bb1e-24f835a79ddf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "be0352bd-a149-4097-b049-8445f895d993", "address": "fa:16:3e:dc:24:42", "network": {"id": "1687d918-9f70-4099-b44c-97f92f90e6ff", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2074208460-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a6157b9827b44d2bab197220b635fd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe0352bd-a1", "ovs_interfaceid": "be0352bd-a149-4097-b049-8445f895d993", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75229) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 09:49:48 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-9263b606-7384-49ba-93c3-ffbfa7db372c tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] Converting VIF {"id": "be0352bd-a149-4097-b049-8445f895d993", "address": "fa:16:3e:dc:24:42", "network": {"id": "1687d918-9f70-4099-b44c-97f92f90e6ff", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2074208460-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a6157b9827b44d2bab197220b635fd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe0352bd-a1", "ovs_interfaceid": "be0352bd-a149-4097-b049-8445f895d993", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 09:49:48 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-9263b606-7384-49ba-93c3-ffbfa7db372c tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dc:24:42,bridge_name='br-int',has_traffic_filtering=True,id=be0352bd-a149-4097-b049-8445f895d993,network=Network(1687d918-9f70-4099-b44c-97f92f90e6ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe0352bd-a1') {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 09:49:48 user nova-compute[75229]: DEBUG nova.objects.instance [None req-9263b606-7384-49ba-93c3-ffbfa7db372c tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] Lazy-loading 'pci_devices' on Instance uuid 94e2b266-2fe3-481a-bb1e-24f835a79ddf {{(pid=75229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 09:49:48 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:49:48 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.015s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:49:48 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[979ebda1-e003-49a5-8be5-125525b931ea]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:49:48 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-dc2298af-0efe-4953-80f9-1007c75f1268 tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=75229) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 09:49:48 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:49:48 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-9263b606-7384-49ba-93c3-ffbfa7db372c tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] [instance: 94e2b266-2fe3-481a-bb1e-24f835a79ddf] End _get_guest_xml xml=<domain type="kvm">
Nov 14 09:49:48 user nova-compute[75229]:   <uuid>94e2b266-2fe3-481a-bb1e-24f835a79ddf</uuid>
Nov 14 09:49:48 user nova-compute[75229]:   <name>instance-00000015</name>
Nov 14 09:49:48 user nova-compute[75229]:   <memory>524288</memory>
Nov 14 09:49:48 user nova-compute[75229]:   <vcpu>1</vcpu>
Nov 14 09:49:48 user nova-compute[75229]:   <metadata>
Nov 14 09:49:48 user nova-compute[75229]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 09:49:48 user nova-compute[75229]:       <nova:package version="0.0.0"/>
Nov 14 09:49:48 user nova-compute[75229]:       <nova:name>tempest-TestMinimumBasicScenario-server-1624451670</nova:name>
Nov 14 09:49:48 user nova-compute[75229]:       <nova:creationTime>2023-11-14 09:49:48</nova:creationTime>
Nov 14 09:49:48 user nova-compute[75229]:       <nova:flavor name="m1.tiny">
Nov 14 09:49:48 user nova-compute[75229]:         <nova:memory>512</nova:memory>
Nov 14 09:49:48 user nova-compute[75229]:         <nova:disk>1</nova:disk>
Nov 14 09:49:48 user nova-compute[75229]:         <nova:swap>0</nova:swap>
Nov 14 09:49:48 user nova-compute[75229]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 09:49:48 user nova-compute[75229]:         <nova:vcpus>1</nova:vcpus>
Nov 14 09:49:48 user nova-compute[75229]:       </nova:flavor>
Nov 14 09:49:48 user nova-compute[75229]:       <nova:owner>
Nov 14 09:49:48 user nova-compute[75229]:         <nova:user uuid="3603da40a87149478458797ea9aedfe2">tempest-TestMinimumBasicScenario-284611138-project-member</nova:user>
Nov 14 09:49:48 user nova-compute[75229]:         <nova:project uuid="4a6157b9827b44d2bab197220b635fd3">tempest-TestMinimumBasicScenario-284611138</nova:project>
Nov 14 09:49:48 user nova-compute[75229]:       </nova:owner>
Nov 14 09:49:48 user nova-compute[75229]:       <nova:root type="image" uuid="efab0bf3-e7ec-4953-8a54-2c5bb0a3baf6"/>
Nov 14 09:49:48 user nova-compute[75229]:       <nova:ports>
Nov 14 09:49:48 user nova-compute[75229]:         <nova:port uuid="be0352bd-a149-4097-b049-8445f895d993">
Nov 14 09:49:48 user nova-compute[75229]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 14 09:49:48 user nova-compute[75229]:         </nova:port>
Nov 14 09:49:48 user nova-compute[75229]:       </nova:ports>
Nov 14 09:49:48 user nova-compute[75229]:     </nova:instance>
Nov 14 09:49:48 user nova-compute[75229]:   </metadata>
Nov 14 09:49:48 user nova-compute[75229]:   <sysinfo type="smbios">
Nov 14 09:49:48 user nova-compute[75229]:     <system>
Nov 14 09:49:48 user nova-compute[75229]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 09:49:48 user nova-compute[75229]:       <entry name="product">OpenStack Nova</entry>
Nov 14 09:49:48 user nova-compute[75229]:       <entry name="version">0.0.0</entry>
Nov 14 09:49:48 user nova-compute[75229]:       <entry name="serial">94e2b266-2fe3-481a-bb1e-24f835a79ddf</entry>
Nov 14 09:49:48 user nova-compute[75229]:       <entry name="uuid">94e2b266-2fe3-481a-bb1e-24f835a79ddf</entry>
Nov 14 09:49:48 user nova-compute[75229]:       <entry name="family">Virtual Machine</entry>
Nov 14 09:49:48 user nova-compute[75229]:     </system>
Nov 14 09:49:48 user nova-compute[75229]:   </sysinfo>
Nov 14 09:49:48 user nova-compute[75229]:   <os>
Nov 14 09:49:48 user nova-compute[75229]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 09:49:48 user nova-compute[75229]:     <boot dev="hd"/>
Nov 14 09:49:48 user nova-compute[75229]:     <smbios mode="sysinfo"/>
Nov 14 09:49:48 user nova-compute[75229]:   </os>
Nov 14 09:49:48 user nova-compute[75229]:   <features>
Nov 14 09:49:48 user nova-compute[75229]:     <acpi/>
Nov 14 09:49:48 user nova-compute[75229]:     <apic/>
Nov 14 09:49:48 user nova-compute[75229]:     <vmcoreinfo/>
Nov 14 09:49:48 user nova-compute[75229]:   </features>
Nov 14 09:49:48 user nova-compute[75229]:   <clock offset="utc">
Nov 14 09:49:48 user nova-compute[75229]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 09:49:48 user nova-compute[75229]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 09:49:48 user nova-compute[75229]:     <timer name="hpet" present="no"/>
Nov 14 09:49:48 user nova-compute[75229]:   </clock>
Nov 14 09:49:48 user nova-compute[75229]:   <cpu mode="custom" match="exact">
Nov 14 09:49:48 user nova-compute[75229]:     <model>Nehalem</model>
Nov 14 09:49:48 user nova-compute[75229]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 09:49:48 user nova-compute[75229]:   </cpu>
Nov 14 09:49:48 user nova-compute[75229]:   <devices>
Nov 14 09:49:48 user nova-compute[75229]:     <disk type="file" device="disk">
Nov 14 09:49:48 user nova-compute[75229]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 09:49:48 user nova-compute[75229]:       <source file="/opt/stack/data/nova/instances/94e2b266-2fe3-481a-bb1e-24f835a79ddf/disk"/>
Nov 14 09:49:48 user nova-compute[75229]:       <target dev="vda" bus="virtio"/>
Nov 14 09:49:48 user nova-compute[75229]:     </disk>
Nov 14 09:49:48 user nova-compute[75229]:     <interface type="ethernet">
Nov 14 09:49:48 user nova-compute[75229]:       <mac address="fa:16:3e:dc:24:42"/>
Nov 14 09:49:48 user nova-compute[75229]:       <model type="virtio"/>
Nov 14 09:49:48 user nova-compute[75229]:       <mtu size="1442"/>
Nov 14 09:49:48 user nova-compute[75229]:       <target dev="tapbe0352bd-a1"/>
Nov 14 09:49:48 user nova-compute[75229]:     </interface>
Nov 14 09:49:48 user nova-compute[75229]:     <serial type="pty">
Nov 14 09:49:48 user nova-compute[75229]:       <log file="/opt/stack/data/nova/instances/94e2b266-2fe3-481a-bb1e-24f835a79ddf/console.log" append="off"/>
Nov 14 09:49:48 user nova-compute[75229]:     </serial>
Nov 14 09:49:48 user nova-compute[75229]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 09:49:48 user nova-compute[75229]:     <video>
Nov 14 09:49:48 user nova-compute[75229]:       <model type="virtio"/>
Nov 14 09:49:48 user nova-compute[75229]:     </video>
Nov 14 09:49:48 user nova-compute[75229]:     <rng model="virtio">
Nov 14 09:49:48 user nova-compute[75229]:       <backend model="random">/dev/urandom</backend>
Nov 14 09:49:48 user nova-compute[75229]:     </rng>
Nov 14 09:49:48 user nova-compute[75229]:     <controller type="usb" index="0" model="none"/>
Nov 14 09:49:48 user nova-compute[75229]:     <memballoon model="virtio">
Nov 14 09:49:48 user nova-compute[75229]:       <stats period="10"/>
Nov 14 09:49:48 user nova-compute[75229]:     </memballoon>
Nov 14 09:49:48 user nova-compute[75229]:   </devices>
Nov 14 09:49:48 user nova-compute[75229]: </domain>
Nov 14 09:49:48 user nova-compute[75229]:  {{(pid=75229) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 09:49:48 user nova-compute[75229]: DEBUG nova.virt.libvirt.vif [None req-9263b606-7384-49ba-93c3-ffbfa7db372c tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T09:49:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1624451670',display_name='tempest-TestMinimumBasicScenario-server-1624451670',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1624451670',id=21,image_ref='efab0bf3-e7ec-4953-8a54-2c5bb0a3baf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHLGyqy66WiitWeWLqujQDO7dBN6UvLDY3R5qVL6duh6Uqwoj1b+NfY0QC2GN9l+L9VeminYuv9MwxoPfEZ4V+l+UlMp+6JyFrnRt14AE/ia/51KfvySly2NYmpfm1yFaw==',key_name='tempest-TestMinimumBasicScenario-185710581',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4a6157b9827b44d2bab197220b635fd3',ramdisk_id='',reservation_id='r-0ro875yg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='efab0bf3-e7ec-4953-8a54-2c5bb0a3baf6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-284611138',owner_user_name='tempest-TestMinimumBasicScenario-284611138-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T09:49:46Z,user_data=None,user_id='3603da40a87149478458797ea9aedfe2',uuid=94e2b266-2fe3-481a-bb1e-24f835a79ddf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "be0352bd-a149-4097-b049-8445f895d993", "address": "fa:16:3e:dc:24:42", "network": {"id": "1687d918-9f70-4099-b44c-97f92f90e6ff", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2074208460-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a6157b9827b44d2bab197220b635fd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe0352bd-a1", "ovs_interfaceid": "be0352bd-a149-4097-b049-8445f895d993", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 09:49:48 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-9263b606-7384-49ba-93c3-ffbfa7db372c tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] Converting VIF {"id": "be0352bd-a149-4097-b049-8445f895d993", "address": "fa:16:3e:dc:24:42", "network": {"id": "1687d918-9f70-4099-b44c-97f92f90e6ff", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2074208460-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a6157b9827b44d2bab197220b635fd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe0352bd-a1", "ovs_interfaceid": "be0352bd-a149-4097-b049-8445f895d993", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 09:49:48 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-9263b606-7384-49ba-93c3-ffbfa7db372c tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dc:24:42,bridge_name='br-int',has_traffic_filtering=True,id=be0352bd-a149-4097-b049-8445f895d993,network=Network(1687d918-9f70-4099-b44c-97f92f90e6ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe0352bd-a1') {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 09:49:48 user nova-compute[75229]: DEBUG os_vif [None req-9263b606-7384-49ba-93c3-ffbfa7db372c tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:dc:24:42,bridge_name='br-int',has_traffic_filtering=True,id=be0352bd-a149-4097-b049-8445f895d993,network=Network(1687d918-9f70-4099-b44c-97f92f90e6ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe0352bd-a1') {{(pid=75229) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 09:49:48 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:49:48 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:49:48 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 09:49:48 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:49:48 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '65344a75-82d0-5e13-8545-55072b208337', '_type': 'linux-noop'}}, row=False) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:49:48 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:49:48 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 09:49:48 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:49:48 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:49:48 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbe0352bd-a1, may_exist=True, interface_attrs={}) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:49:48 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapbe0352bd-a1, col_values=(('qos', UUID('3185c932-fa0c-4b31-921a-4a8f9c443129')),), if_exists=True) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:49:48 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapbe0352bd-a1, col_values=(('external_ids', {'iface-id': 'be0352bd-a149-4097-b049-8445f895d993', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:dc:24:42', 'vm-uuid': '94e2b266-2fe3-481a-bb1e-24f835a79ddf'}),), if_exists=True) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:49:48 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:49:48 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.053s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:49:48 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ac210b9-3b91-4b69-99dc-3e35ca2ab90d]: (4, ('1', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:49:48 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 09:49:48 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-dc2298af-0efe-4953-80f9-1007c75f1268 tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=75229) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 09:49:48 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-dc2298af-0efe-4953-80f9-1007c75f1268 tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] SCSI volumes sdg have been removed. {{(pid=75229) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 09:49:48 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc2298af-0efe-4953-80f9-1007c75f1268 tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5b54e594-ae66-4ba2-9bda-aa4431d31c3f')] {{(pid=75229) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 09:49:48 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b54e594-ae66-4ba2-9bda-aa4431d31c3f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:49:48 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:49:48 user nova-compute[75229]: INFO os_vif [None req-9263b606-7384-49ba-93c3-ffbfa7db372c tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:dc:24:42,bridge_name='br-int',has_traffic_filtering=True,id=be0352bd-a149-4097-b049-8445f895d993,network=Network(1687d918-9f70-4099-b44c-97f92f90e6ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe0352bd-a1')
Nov 14 09:49:48 user nova-compute[75229]: DEBUG nova.compute.manager [req-ddbcfc1b-b08c-444b-9ee4-d07305d6d818 req-f26544fc-1adf-4bef-97a4-157a2eeff4ed service nova] [instance: e09b3809-2e23-401c-9a72-88feb2bb657c] Received event network-changed-472488d2-9453-4d74-a6b1-6966b835572d {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:49:48 user nova-compute[75229]: DEBUG nova.compute.manager [req-ddbcfc1b-b08c-444b-9ee4-d07305d6d818 req-f26544fc-1adf-4bef-97a4-157a2eeff4ed service nova] [instance: e09b3809-2e23-401c-9a72-88feb2bb657c] Refreshing instance network info cache due to event network-changed-472488d2-9453-4d74-a6b1-6966b835572d. {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 09:49:48 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-ddbcfc1b-b08c-444b-9ee4-d07305d6d818 req-f26544fc-1adf-4bef-97a4-157a2eeff4ed service nova] Acquiring lock "refresh_cache-e09b3809-2e23-401c-9a72-88feb2bb657c" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 09:49:48 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-ddbcfc1b-b08c-444b-9ee4-d07305d6d818 req-f26544fc-1adf-4bef-97a4-157a2eeff4ed service nova] Acquired lock "refresh_cache-e09b3809-2e23-401c-9a72-88feb2bb657c" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 09:49:48 user nova-compute[75229]: DEBUG nova.network.neutron [req-ddbcfc1b-b08c-444b-9ee4-d07305d6d818 req-f26544fc-1adf-4bef-97a4-157a2eeff4ed service nova] [instance: e09b3809-2e23-401c-9a72-88feb2bb657c] Refreshing network info cache for port 472488d2-9453-4d74-a6b1-6966b835572d {{(pid=75229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 09:49:48 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b54e594-ae66-4ba2-9bda-aa4431d31c3f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:49:48 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5258d37-2bc8-408f-9d88-8e2306447050]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:49:48 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc2298af-0efe-4953-80f9-1007c75f1268 tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:49:48 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b54e594-ae66-4ba2-9bda-aa4431d31c3f -p 172.16.0.220:3260 --logout {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:49:48 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6e2d77b-9894-4afa-8fa1-13a2842ba9a7/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:49:48 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6e2d77b-9894-4afa-8fa1-13a2842ba9a7/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:49:49 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b54e594-ae66-4ba2-9bda-aa4431d31c3f -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:49:49 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[006850be-e70b-4fcc-9393-459ea8b8fcc0]: (4, ('Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:5b54e594-ae66-4ba2-9bda-aa4431d31c3f, portal: 172.16.0.220,3260]\nLogout of [sid: 18, target: iqn.2010-10.org.openstack:5b54e594-ae66-4ba2-9bda-aa4431d31c3f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:49:49 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc2298af-0efe-4953-80f9-1007c75f1268 tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:5b54e594-ae66-4ba2-9bda-aa4431d31c3f, portal: 172.16.0.220,3260]
Nov 14 09:49:49 user nova-compute[75229]: Logout of [sid: 18, target: iqn.2010-10.org.openstack:5b54e594-ae66-4ba2-9bda-aa4431d31c3f, portal: 172.16.0.220,3260] successful.
Nov 14 09:49:49 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:49:49 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b54e594-ae66-4ba2-9bda-aa4431d31c3f -p 172.16.0.220:3260 --op delete {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:49:49 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-9263b606-7384-49ba-93c3-ffbfa7db372c tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] No BDM found with device name vda, not building metadata. {{(pid=75229) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 09:49:49 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-9263b606-7384-49ba-93c3-ffbfa7db372c tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] No VIF found with MAC fa:16:3e:dc:24:42, not building metadata {{(pid=75229) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 09:49:49 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b54e594-ae66-4ba2-9bda-aa4431d31c3f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:49:49 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fc7eda1-f0a2-4309-a20e-cec1b23b49a1]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:49:49 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc2298af-0efe-4953-80f9-1007c75f1268 tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:49:49 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-dc2298af-0efe-4953-80f9-1007c75f1268 tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.484s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 09:49:49 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc2298af-0efe-4953-80f9-1007c75f1268 tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] <== disconnect_volume: return (485ms) None {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 09:49:49 user nova-compute[75229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dc2298af-0efe-4953-80f9-1007c75f1268 tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] [instance: 90bd76df-96cb-4bec-9862-853d94cdbaab] Disconnected iSCSI Volume {{(pid=75229) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 09:49:49 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6e2d77b-9894-4afa-8fa1-13a2842ba9a7/disk --force-share --output=json" returned: 0 in 0.242s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:49:49 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c9fe69e-3f9d-4b30-a9e4-efc3e83efa17/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:49:49 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c9fe69e-3f9d-4b30-a9e4-efc3e83efa17/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:49:49 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c9fe69e-3f9d-4b30-a9e4-efc3e83efa17/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:49:49 user nova-compute[75229]: DEBUG nova.network.neutron [req-ddbcfc1b-b08c-444b-9ee4-d07305d6d818 req-f26544fc-1adf-4bef-97a4-157a2eeff4ed service nova] [instance: e09b3809-2e23-401c-9a72-88feb2bb657c] Updated VIF entry in instance network info cache for port 472488d2-9453-4d74-a6b1-6966b835572d. {{(pid=75229) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 09:49:49 user nova-compute[75229]: DEBUG nova.network.neutron [req-ddbcfc1b-b08c-444b-9ee4-d07305d6d818 req-f26544fc-1adf-4bef-97a4-157a2eeff4ed service nova] [instance: e09b3809-2e23-401c-9a72-88feb2bb657c] Updating instance_info_cache with network_info: [{"id": "472488d2-9453-4d74-a6b1-6966b835572d", "address": "fa:16:3e:9f:3a:e8", "network": {"id": "f5285ef5-fa74-4079-a8cd-f970d97c97c3", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-62550527-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.73", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54dca06fda8b43d5bc92fa7c97a872a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap472488d2-94", "ovs_interfaceid": "472488d2-9453-4d74-a6b1-6966b835572d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 09:49:49 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-ddbcfc1b-b08c-444b-9ee4-d07305d6d818 req-f26544fc-1adf-4bef-97a4-157a2eeff4ed service nova] Releasing lock "refresh_cache-e09b3809-2e23-401c-9a72-88feb2bb657c" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 09:49:49 user nova-compute[75229]: DEBUG nova.compute.manager [req-ddbcfc1b-b08c-444b-9ee4-d07305d6d818 req-f26544fc-1adf-4bef-97a4-157a2eeff4ed service nova] [instance: e09b3809-2e23-401c-9a72-88feb2bb657c] Received event network-changed-472488d2-9453-4d74-a6b1-6966b835572d {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:49:49 user nova-compute[75229]: DEBUG nova.compute.manager [req-ddbcfc1b-b08c-444b-9ee4-d07305d6d818 req-f26544fc-1adf-4bef-97a4-157a2eeff4ed service nova] [instance: e09b3809-2e23-401c-9a72-88feb2bb657c] Refreshing instance network info cache due to event network-changed-472488d2-9453-4d74-a6b1-6966b835572d. {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 09:49:49 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-ddbcfc1b-b08c-444b-9ee4-d07305d6d818 req-f26544fc-1adf-4bef-97a4-157a2eeff4ed service nova] Acquiring lock "refresh_cache-e09b3809-2e23-401c-9a72-88feb2bb657c" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 09:49:49 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-ddbcfc1b-b08c-444b-9ee4-d07305d6d818 req-f26544fc-1adf-4bef-97a4-157a2eeff4ed service nova] Acquired lock "refresh_cache-e09b3809-2e23-401c-9a72-88feb2bb657c" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 09:49:49 user nova-compute[75229]: DEBUG nova.network.neutron [req-ddbcfc1b-b08c-444b-9ee4-d07305d6d818 req-f26544fc-1adf-4bef-97a4-157a2eeff4ed service nova] [instance: e09b3809-2e23-401c-9a72-88feb2bb657c] Refreshing network info cache for port 472488d2-9453-4d74-a6b1-6966b835572d {{(pid=75229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 09:49:49 user nova-compute[75229]: INFO nova.virt.libvirt.driver [-] [instance: e09b3809-2e23-401c-9a72-88feb2bb657c] Instance destroyed successfully.
Nov 14 09:49:49 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c9fe69e-3f9d-4b30-a9e4-efc3e83efa17/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:49:49 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4ce290f-6dd2-44b6-91be-8e775045837e/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:49:49 user nova-compute[75229]: DEBUG nova.compute.manager [req-568356e4-ec38-44b4-8a2d-eea751aa8941 req-ec61be89-ac7f-4e37-bc2e-d436220c0597 service nova] [instance: e09b3809-2e23-401c-9a72-88feb2bb657c] Received event network-vif-unplugged-472488d2-9453-4d74-a6b1-6966b835572d {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:49:49 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-568356e4-ec38-44b4-8a2d-eea751aa8941 req-ec61be89-ac7f-4e37-bc2e-d436220c0597 service nova] Acquiring lock "e09b3809-2e23-401c-9a72-88feb2bb657c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:49:49 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-568356e4-ec38-44b4-8a2d-eea751aa8941 req-ec61be89-ac7f-4e37-bc2e-d436220c0597 service nova] Lock "e09b3809-2e23-401c-9a72-88feb2bb657c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:49:49 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-568356e4-ec38-44b4-8a2d-eea751aa8941 req-ec61be89-ac7f-4e37-bc2e-d436220c0597 service nova] Lock "e09b3809-2e23-401c-9a72-88feb2bb657c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:49:49 user nova-compute[75229]: DEBUG nova.compute.manager [req-568356e4-ec38-44b4-8a2d-eea751aa8941 req-ec61be89-ac7f-4e37-bc2e-d436220c0597 service nova] [instance: e09b3809-2e23-401c-9a72-88feb2bb657c] No waiting events found dispatching network-vif-unplugged-472488d2-9453-4d74-a6b1-6966b835572d {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 09:49:49 user nova-compute[75229]: WARNING nova.compute.manager [req-568356e4-ec38-44b4-8a2d-eea751aa8941 req-ec61be89-ac7f-4e37-bc2e-d436220c0597 service nova] [instance: e09b3809-2e23-401c-9a72-88feb2bb657c] Received unexpected event network-vif-unplugged-472488d2-9453-4d74-a6b1-6966b835572d for instance with vm_state rescued and task_state unrescuing.
Nov 14 09:49:49 user nova-compute[75229]: DEBUG nova.compute.manager [req-568356e4-ec38-44b4-8a2d-eea751aa8941 req-ec61be89-ac7f-4e37-bc2e-d436220c0597 service nova] [instance: e09b3809-2e23-401c-9a72-88feb2bb657c] Received event network-vif-plugged-472488d2-9453-4d74-a6b1-6966b835572d {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:49:49 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-568356e4-ec38-44b4-8a2d-eea751aa8941 req-ec61be89-ac7f-4e37-bc2e-d436220c0597 service nova] Acquiring lock "e09b3809-2e23-401c-9a72-88feb2bb657c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:49:49 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-568356e4-ec38-44b4-8a2d-eea751aa8941 req-ec61be89-ac7f-4e37-bc2e-d436220c0597 service nova] Lock "e09b3809-2e23-401c-9a72-88feb2bb657c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:49:49 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-568356e4-ec38-44b4-8a2d-eea751aa8941 req-ec61be89-ac7f-4e37-bc2e-d436220c0597 service nova] Lock "e09b3809-2e23-401c-9a72-88feb2bb657c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:49:49 user nova-compute[75229]: DEBUG nova.compute.manager [req-568356e4-ec38-44b4-8a2d-eea751aa8941 req-ec61be89-ac7f-4e37-bc2e-d436220c0597 service nova] [instance: e09b3809-2e23-401c-9a72-88feb2bb657c] No waiting events found dispatching network-vif-plugged-472488d2-9453-4d74-a6b1-6966b835572d {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 09:49:49 user nova-compute[75229]: WARNING nova.compute.manager [req-568356e4-ec38-44b4-8a2d-eea751aa8941 req-ec61be89-ac7f-4e37-bc2e-d436220c0597 service nova] [instance: e09b3809-2e23-401c-9a72-88feb2bb657c] Received unexpected event network-vif-plugged-472488d2-9453-4d74-a6b1-6966b835572d for instance with vm_state rescued and task_state unrescuing.
Nov 14 09:49:49 user nova-compute[75229]: DEBUG nova.network.neutron [None req-fd748a0e-4bf3-442b-8b83-34a017396e4a tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] [instance: a60d339f-e134-477c-8505-bf8c79d2a21c] Port cb98fc47-7b69-4bde-9a4c-717cd44ba908 binding to destination host user is already ACTIVE {{(pid=75229) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 14 09:49:49 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-fd748a0e-4bf3-442b-8b83-34a017396e4a tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] Acquiring lock "refresh_cache-a60d339f-e134-477c-8505-bf8c79d2a21c" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 09:49:49 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-fd748a0e-4bf3-442b-8b83-34a017396e4a tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] Acquired lock "refresh_cache-a60d339f-e134-477c-8505-bf8c79d2a21c" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 09:49:49 user nova-compute[75229]: DEBUG nova.network.neutron [None req-fd748a0e-4bf3-442b-8b83-34a017396e4a tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] [instance: a60d339f-e134-477c-8505-bf8c79d2a21c] Building network info cache for instance {{(pid=75229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 09:49:49 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4ce290f-6dd2-44b6-91be-8e775045837e/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:49:49 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4ce290f-6dd2-44b6-91be-8e775045837e/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:49:49 user nova-compute[75229]: DEBUG nova.objects.instance [None req-dc2298af-0efe-4953-80f9-1007c75f1268 tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Lazy-loading 'flavor' on Instance uuid 90bd76df-96cb-4bec-9862-853d94cdbaab {{(pid=75229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 09:49:49 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-dc2298af-0efe-4953-80f9-1007c75f1268 tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Lock "90bd76df-96cb-4bec-9862-853d94cdbaab" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.120s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:49:50 user nova-compute[75229]: DEBUG nova.network.neutron [req-ddbcfc1b-b08c-444b-9ee4-d07305d6d818 req-f26544fc-1adf-4bef-97a4-157a2eeff4ed service nova] [instance: e09b3809-2e23-401c-9a72-88feb2bb657c] Updated VIF entry in instance network info cache for port 472488d2-9453-4d74-a6b1-6966b835572d. {{(pid=75229) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 09:49:50 user nova-compute[75229]: DEBUG nova.network.neutron [req-ddbcfc1b-b08c-444b-9ee4-d07305d6d818 req-f26544fc-1adf-4bef-97a4-157a2eeff4ed service nova] [instance: e09b3809-2e23-401c-9a72-88feb2bb657c] Updating instance_info_cache with network_info: [{"id": "472488d2-9453-4d74-a6b1-6966b835572d", "address": "fa:16:3e:9f:3a:e8", "network": {"id": "f5285ef5-fa74-4079-a8cd-f970d97c97c3", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-62550527-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.73", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54dca06fda8b43d5bc92fa7c97a872a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap472488d2-94", "ovs_interfaceid": "472488d2-9453-4d74-a6b1-6966b835572d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 09:49:50 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-ddbcfc1b-b08c-444b-9ee4-d07305d6d818 req-f26544fc-1adf-4bef-97a4-157a2eeff4ed service nova] Releasing lock "refresh_cache-e09b3809-2e23-401c-9a72-88feb2bb657c" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 09:49:50 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4ce290f-6dd2-44b6-91be-8e775045837e/disk --force-share --output=json" returned: 0 in 0.267s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:49:50 user nova-compute[75229]: DEBUG nova.network.neutron [None req-fd748a0e-4bf3-442b-8b83-34a017396e4a tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] [instance: a60d339f-e134-477c-8505-bf8c79d2a21c] Updating instance_info_cache with network_info: [{"id": "cb98fc47-7b69-4bde-9a4c-717cd44ba908", "address": "fa:16:3e:6c:f4:6d", "network": {"id": "2b667d50-4579-4453-b4d3-a818a0d2c6fc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1719812180-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.24", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32e17c7c586542139cdbc5bfda57e075", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb98fc47-7b", "ovs_interfaceid": "cb98fc47-7b69-4bde-9a4c-717cd44ba908", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 09:49:50 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-fd748a0e-4bf3-442b-8b83-34a017396e4a tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] Releasing lock "refresh_cache-a60d339f-e134-477c-8505-bf8c79d2a21c" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 09:49:50 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-fd748a0e-4bf3-442b-8b83-34a017396e4a tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] [instance: a60d339f-e134-477c-8505-bf8c79d2a21c] Creating tmpfile /opt/stack/data/nova/instances/a60d339f-e134-477c-8505-bf8c79d2a21c/tmpn1gf7rlg to verify with other compute node that the instance is on the same shared storage. {{(pid=75229) check_instance_shared_storage_local /opt/stack/nova/nova/virt/libvirt/driver.py:9628}}
Nov 14 09:49:50 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:49:50 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:49:50 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:49:50 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:49:50 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:49:50 user nova-compute[75229]: DEBUG nova.compute.manager [req-47b98d6f-a640-4805-95e2-5b5f6997e14f req-1cd9b7fe-26f4-42a9-8fde-d4776452385d service nova] [instance: a60d339f-e134-477c-8505-bf8c79d2a21c] Received event network-vif-unplugged-cb98fc47-7b69-4bde-9a4c-717cd44ba908 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:49:50 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-47b98d6f-a640-4805-95e2-5b5f6997e14f req-1cd9b7fe-26f4-42a9-8fde-d4776452385d service nova] Acquiring lock "a60d339f-e134-477c-8505-bf8c79d2a21c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:49:50 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-47b98d6f-a640-4805-95e2-5b5f6997e14f req-1cd9b7fe-26f4-42a9-8fde-d4776452385d service nova] Lock "a60d339f-e134-477c-8505-bf8c79d2a21c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:49:50 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-47b98d6f-a640-4805-95e2-5b5f6997e14f req-1cd9b7fe-26f4-42a9-8fde-d4776452385d service nova] Lock "a60d339f-e134-477c-8505-bf8c79d2a21c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:49:50 user nova-compute[75229]: DEBUG nova.compute.manager [req-47b98d6f-a640-4805-95e2-5b5f6997e14f req-1cd9b7fe-26f4-42a9-8fde-d4776452385d service nova] [instance: a60d339f-e134-477c-8505-bf8c79d2a21c] No waiting events found dispatching network-vif-unplugged-cb98fc47-7b69-4bde-9a4c-717cd44ba908 {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 09:49:50 user nova-compute[75229]: WARNING nova.compute.manager [req-47b98d6f-a640-4805-95e2-5b5f6997e14f req-1cd9b7fe-26f4-42a9-8fde-d4776452385d service nova] [instance: a60d339f-e134-477c-8505-bf8c79d2a21c] Received unexpected event network-vif-unplugged-cb98fc47-7b69-4bde-9a4c-717cd44ba908 for instance with vm_state resized and task_state resize_reverting.
Nov 14 09:49:50 user nova-compute[75229]: DEBUG nova.compute.manager [req-47b98d6f-a640-4805-95e2-5b5f6997e14f req-1cd9b7fe-26f4-42a9-8fde-d4776452385d service nova] [instance: a60d339f-e134-477c-8505-bf8c79d2a21c] Received event network-vif-plugged-cb98fc47-7b69-4bde-9a4c-717cd44ba908 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:49:50 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-47b98d6f-a640-4805-95e2-5b5f6997e14f req-1cd9b7fe-26f4-42a9-8fde-d4776452385d service nova] Acquiring lock "a60d339f-e134-477c-8505-bf8c79d2a21c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:49:50 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-47b98d6f-a640-4805-95e2-5b5f6997e14f req-1cd9b7fe-26f4-42a9-8fde-d4776452385d service nova] Lock "a60d339f-e134-477c-8505-bf8c79d2a21c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:49:50 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-47b98d6f-a640-4805-95e2-5b5f6997e14f req-1cd9b7fe-26f4-42a9-8fde-d4776452385d service nova] Lock "a60d339f-e134-477c-8505-bf8c79d2a21c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:49:50 user nova-compute[75229]: DEBUG nova.compute.manager [req-47b98d6f-a640-4805-95e2-5b5f6997e14f req-1cd9b7fe-26f4-42a9-8fde-d4776452385d service nova] [instance: a60d339f-e134-477c-8505-bf8c79d2a21c] No waiting events found dispatching network-vif-plugged-cb98fc47-7b69-4bde-9a4c-717cd44ba908 {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 09:49:50 user nova-compute[75229]: WARNING nova.compute.manager [req-47b98d6f-a640-4805-95e2-5b5f6997e14f req-1cd9b7fe-26f4-42a9-8fde-d4776452385d service nova] [instance: a60d339f-e134-477c-8505-bf8c79d2a21c] Received unexpected event network-vif-plugged-cb98fc47-7b69-4bde-9a4c-717cd44ba908 for instance with vm_state resized and task_state resize_reverting.
Nov 14 09:49:51 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:49:51 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:49:51 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:49:51 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:49:51 user nova-compute[75229]: INFO nova.virt.libvirt.driver [-] [instance: a60d339f-e134-477c-8505-bf8c79d2a21c] Instance destroyed successfully.
Nov 14 09:49:51 user nova-compute[75229]: DEBUG nova.objects.instance [None req-fd748a0e-4bf3-442b-8b83-34a017396e4a tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] Lazy-loading 'resources' on Instance uuid a60d339f-e134-477c-8505-bf8c79d2a21c {{(pid=75229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 09:49:51 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:49:51 user nova-compute[75229]: DEBUG nova.virt.libvirt.vif [None req-fd748a0e-4bf3-442b-8b83-34a017396e4a tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T09:43:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-285833760',display_name='tempest-ServerActionsTestOtherB-server-285833760',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-285833760',id=5,image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLBqRiXBmoqcQBqBQflJnJ0Bni+p+JlFtve2BlM0X9wLvjWsKzu7TCQo3Ot5hzNFvzwCz/gEUspFHpyxxEkScMIm/fUvYWhxYR4DsojCDDatjjGg5V63rlfYUre+iymhFw==',key_name='tempest-keypair-1362974744',keypairs=<?>,launch_index=0,launched_at=2023-11-14T09:48:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='32e17c7c586542139cdbc5bfda57e075',ramdisk_id='',reservation_id='r-vw8kxtrn',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-45710955',owner_user_name='tempest-ServerActionsTestOtherB-45710955-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T09:48:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='39c6903e2d154e838835eb5265776521',uuid=a60d339f-e134-477c-8505-bf8c79d2a21c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "cb98fc47-7b69-4bde-9a4c-717cd44ba908", "address": "fa:16:3e:6c:f4:6d", "network": {"id": "2b667d50-4579-4453-b4d3-a818a0d2c6fc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1719812180-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.24", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32e17c7c586542139cdbc5bfda57e075", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb98fc47-7b", "ovs_interfaceid": "cb98fc47-7b69-4bde-9a4c-717cd44ba908", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 09:49:51 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-fd748a0e-4bf3-442b-8b83-34a017396e4a tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] Converting VIF {"id": "cb98fc47-7b69-4bde-9a4c-717cd44ba908", "address": "fa:16:3e:6c:f4:6d", "network": {"id": "2b667d50-4579-4453-b4d3-a818a0d2c6fc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1719812180-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.24", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32e17c7c586542139cdbc5bfda57e075", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb98fc47-7b", "ovs_interfaceid": "cb98fc47-7b69-4bde-9a4c-717cd44ba908", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 09:49:51 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-fd748a0e-4bf3-442b-8b83-34a017396e4a tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6c:f4:6d,bridge_name='br-int',has_traffic_filtering=True,id=cb98fc47-7b69-4bde-9a4c-717cd44ba908,network=Network(2b667d50-4579-4453-b4d3-a818a0d2c6fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb98fc47-7b') {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 09:49:51 user nova-compute[75229]: DEBUG os_vif [None req-fd748a0e-4bf3-442b-8b83-34a017396e4a tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6c:f4:6d,bridge_name='br-int',has_traffic_filtering=True,id=cb98fc47-7b69-4bde-9a4c-717cd44ba908,network=Network(2b667d50-4579-4453-b4d3-a818a0d2c6fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb98fc47-7b') {{(pid=75229) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 09:49:51 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:49:51 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcb98fc47-7b, bridge=br-int, if_exists=True) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:49:51 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:49:51 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 09:49:51 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:49:51 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:49:51 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=aae5fa0c-c0e6-4ba7-b6cc-271c7f903b49) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:49:51 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:49:51 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 09:49:51 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:49:51 user nova-compute[75229]: INFO os_vif [None req-fd748a0e-4bf3-442b-8b83-34a017396e4a tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6c:f4:6d,bridge_name='br-int',has_traffic_filtering=True,id=cb98fc47-7b69-4bde-9a4c-717cd44ba908,network=Network(2b667d50-4579-4453-b4d3-a818a0d2c6fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb98fc47-7b')
Nov 14 09:49:51 user nova-compute[75229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fd748a0e-4bf3-442b-8b83-34a017396e4a tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] [instance: a60d339f-e134-477c-8505-bf8c79d2a21c] calling os-brick to detach iSCSI Volume {{(pid=75229) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 09:49:51 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd748a0e-4bf3-442b-8b83-34a017396e4a tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f73f85151b0>, {'target_iqn': 'iqn.2010-10.org.openstack:aca09258-022b-4f04-b418-f2a170332755', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BrhyGdAv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 09:49:51 user nova-compute[75229]: WARNING os_brick.initiator.connectors.base [None req-fd748a0e-4bf3-442b-8b83-34a017396e4a tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 09:49:51 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-fd748a0e-4bf3-442b-8b83-34a017396e4a tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 09:49:51 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-fd748a0e-4bf3-442b-8b83-34a017396e4a tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 09:49:51 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:49:51 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:49:51 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d35e38c-a5c1-4180-8a8d-1245ad8b4d39]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:aca09258-022b-4f04-b418-f2a170332755\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3fed285f-9be4-4601-8cb5-4329d7ebed8c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:49:51 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd748a0e-4bf3-442b-8b83-34a017396e4a tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 09:49:51 user nova-compute[75229]: No targets found.
Nov 14 09:49:51 user nova-compute[75229]: iSNS:
Nov 14 09:49:51 user nova-compute[75229]: No targets found.
Nov 14 09:49:51 user nova-compute[75229]: STATIC:
Nov 14 09:49:51 user nova-compute[75229]: Target: iqn.2010-10.org.openstack:aca09258-022b-4f04-b418-f2a170332755
Nov 14 09:49:51 user nova-compute[75229]:         Portal: 172.16.0.220:3260,-1
Nov 14 09:49:51 user nova-compute[75229]:                 Iface Name: default
Nov 14 09:49:51 user nova-compute[75229]: Target: iqn.2010-10.org.openstack:3fed285f-9be4-4601-8cb5-4329d7ebed8c
Nov 14 09:49:51 user nova-compute[75229]:         Portal: 172.16.0.220:3260,-1
Nov 14 09:49:51 user nova-compute[75229]:                 Iface Name: default
Nov 14 09:49:51 user nova-compute[75229]: FIRMWARE:
Nov 14 09:49:51 user nova-compute[75229]: No targets found.
Nov 14 09:49:51 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 09:49:51 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd748a0e-4bf3-442b-8b83-34a017396e4a tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 09:49:51 user nova-compute[75229]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 09:49:51 user nova-compute[75229]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75229) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 09:49:51 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd748a0e-4bf3-442b-8b83-34a017396e4a tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:aca09258-022b-4f04-b418-f2a170332755', 0)] {{(pid=75229) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 09:49:51 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:49:51 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:49:51 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb65113f-b0c7-449a-9906-96733ac591e6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3fed285f-9be4-4601-8cb5-4329d7ebed8c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aca09258-022b-4f04-b418-f2a170332755\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:49:51 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:49:51 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:49:51 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[cedc0841-2d8d-4cb0-860b-d5adc57b028b]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fed285f-9be4-4601-8cb5-4329d7ebed8c (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aca09258-022b-4f04-b418-f2a170332755 (non-flash)\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:49:51 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd748a0e-4bf3-442b-8b83-34a017396e4a tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fed285f-9be4-4601-8cb5-4329d7ebed8c (non-flash)
Nov 14 09:49:51 user nova-compute[75229]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aca09258-022b-4f04-b418-f2a170332755 (non-flash)
Nov 14 09:49:51 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 09:49:51 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd748a0e-4bf3-442b-8b83-34a017396e4a tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fed285f-9be4-4601-8cb5-4329d7ebed8c (non-flash)
Nov 14 09:49:51 user nova-compute[75229]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aca09258-022b-4f04-b418-f2a170332755 (non-flash)
Nov 14 09:49:51 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 09:49:51 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd748a0e-4bf3-442b-8b83-34a017396e4a tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f73f83e56c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:aca09258-022b-4f04-b418-f2a170332755'): ({'sdf'}, set())}) {{(pid=75229) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 09:49:51 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-fd748a0e-4bf3-442b-8b83-34a017396e4a tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] Removing single pathed devices sdf {{(pid=75229) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 09:49:51 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:49:51 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:49:51 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[b876d7f4-fa05-4298-b8ef-7ac1265da45c]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:49:51 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:49:51 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.018s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:49:51 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3e0c6c9-0908-4840-94c0-7aa4f747cc28]: (4, ('ok\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:49:51 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-fd748a0e-4bf3-442b-8b83-34a017396e4a tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] Flushing IO for device /dev/sdf {{(pid=75229) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 09:49:51 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:49:51 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.012s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:49:51 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[48dd7655-c24f-438e-9567-6765e377f5bb]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:49:51 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-fd748a0e-4bf3-442b-8b83-34a017396e4a tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75229) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 09:49:51 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:49:51 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.064s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:49:51 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c661e23-13e0-4a4f-acd6-2d524ae60cbe]: (4, ('1', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:49:51 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-fd748a0e-4bf3-442b-8b83-34a017396e4a tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75229) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 09:49:51 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-fd748a0e-4bf3-442b-8b83-34a017396e4a tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] SCSI volumes sdf have been removed. {{(pid=75229) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 09:49:51 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd748a0e-4bf3-442b-8b83-34a017396e4a tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:aca09258-022b-4f04-b418-f2a170332755')] {{(pid=75229) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 09:49:51 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:49:51 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aca09258-022b-4f04-b418-f2a170332755 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:49:51 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aca09258-022b-4f04-b418-f2a170332755 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.028s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:49:51 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbb245dc-a9ba-44e9-ad85-057364f31721]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:49:51 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd748a0e-4bf3-442b-8b83-34a017396e4a tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:49:51 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aca09258-022b-4f04-b418-f2a170332755 -p 172.16.0.220:3260 --logout {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:49:51 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:49:51 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:49:51 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:49:52 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aca09258-022b-4f04-b418-f2a170332755 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:49:52 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[eda5fb5e-866c-4246-98c9-63d87c2f51ae]: (4, ('Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:aca09258-022b-4f04-b418-f2a170332755, portal: 172.16.0.220,3260]\nLogout of [sid: 19, target: iqn.2010-10.org.openstack:aca09258-022b-4f04-b418-f2a170332755, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:49:52 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd748a0e-4bf3-442b-8b83-34a017396e4a tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:aca09258-022b-4f04-b418-f2a170332755, portal: 172.16.0.220,3260]
Nov 14 09:49:52 user nova-compute[75229]: Logout of [sid: 19, target: iqn.2010-10.org.openstack:aca09258-022b-4f04-b418-f2a170332755, portal: 172.16.0.220,3260] successful.
Nov 14 09:49:52 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:49:52 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aca09258-022b-4f04-b418-f2a170332755 -p 172.16.0.220:3260 --op delete {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:49:52 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aca09258-022b-4f04-b418-f2a170332755 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.071s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:49:52 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb59e43f-d418-4532-91d7-0ef9f8effe7c]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:49:52 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd748a0e-4bf3-442b-8b83-34a017396e4a tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:49:52 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-fd748a0e-4bf3-442b-8b83-34a017396e4a tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.422s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 09:49:52 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd748a0e-4bf3-442b-8b83-34a017396e4a tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] <== disconnect_volume: return (425ms) None {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 09:49:52 user nova-compute[75229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fd748a0e-4bf3-442b-8b83-34a017396e4a tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] [instance: a60d339f-e134-477c-8505-bf8c79d2a21c] Disconnected iSCSI Volume {{(pid=75229) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 09:49:52 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:49:52 user nova-compute[75229]: DEBUG nova.compute.manager [req-cd3c97e3-0e4e-4299-99d5-17381f9d545c req-530ac1c6-e100-4533-8ac8-5d57bc626bd0 service nova] [instance: 94e2b266-2fe3-481a-bb1e-24f835a79ddf] Received event network-vif-plugged-be0352bd-a149-4097-b049-8445f895d993 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:49:52 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-cd3c97e3-0e4e-4299-99d5-17381f9d545c req-530ac1c6-e100-4533-8ac8-5d57bc626bd0 service nova] Acquiring lock "94e2b266-2fe3-481a-bb1e-24f835a79ddf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:49:52 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-cd3c97e3-0e4e-4299-99d5-17381f9d545c req-530ac1c6-e100-4533-8ac8-5d57bc626bd0 service nova] Lock "94e2b266-2fe3-481a-bb1e-24f835a79ddf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:49:52 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-cd3c97e3-0e4e-4299-99d5-17381f9d545c req-530ac1c6-e100-4533-8ac8-5d57bc626bd0 service nova] Lock "94e2b266-2fe3-481a-bb1e-24f835a79ddf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:49:52 user nova-compute[75229]: DEBUG nova.compute.manager [req-cd3c97e3-0e4e-4299-99d5-17381f9d545c req-530ac1c6-e100-4533-8ac8-5d57bc626bd0 service nova] [instance: 94e2b266-2fe3-481a-bb1e-24f835a79ddf] No waiting events found dispatching network-vif-plugged-be0352bd-a149-4097-b049-8445f895d993 {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 09:49:52 user nova-compute[75229]: WARNING nova.compute.manager [req-cd3c97e3-0e4e-4299-99d5-17381f9d545c req-530ac1c6-e100-4533-8ac8-5d57bc626bd0 service nova] [instance: 94e2b266-2fe3-481a-bb1e-24f835a79ddf] Received unexpected event network-vif-plugged-be0352bd-a149-4097-b049-8445f895d993 for instance with vm_state building and task_state spawning.
Nov 14 09:49:52 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:49:52 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:49:52 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:49:52 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:49:52 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:49:52 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:49:52 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:49:52 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:49:52 user nova-compute[75229]: DEBUG nova.compute.manager [req-8b427ef8-019a-4821-a5ac-e7edeb8d6ecc req-ef9b38d2-bac0-458a-8823-29de0e09ada9 service nova] [instance: e09b3809-2e23-401c-9a72-88feb2bb657c] Received event network-vif-plugged-472488d2-9453-4d74-a6b1-6966b835572d {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:49:52 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-8b427ef8-019a-4821-a5ac-e7edeb8d6ecc req-ef9b38d2-bac0-458a-8823-29de0e09ada9 service nova] Acquiring lock "e09b3809-2e23-401c-9a72-88feb2bb657c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:49:52 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-8b427ef8-019a-4821-a5ac-e7edeb8d6ecc req-ef9b38d2-bac0-458a-8823-29de0e09ada9 service nova] Lock "e09b3809-2e23-401c-9a72-88feb2bb657c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:49:52 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-8b427ef8-019a-4821-a5ac-e7edeb8d6ecc req-ef9b38d2-bac0-458a-8823-29de0e09ada9 service nova] Lock "e09b3809-2e23-401c-9a72-88feb2bb657c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:49:52 user nova-compute[75229]: DEBUG nova.compute.manager [req-8b427ef8-019a-4821-a5ac-e7edeb8d6ecc req-ef9b38d2-bac0-458a-8823-29de0e09ada9 service nova] [instance: e09b3809-2e23-401c-9a72-88feb2bb657c] No waiting events found dispatching network-vif-plugged-472488d2-9453-4d74-a6b1-6966b835572d {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 09:49:52 user nova-compute[75229]: WARNING nova.compute.manager [req-8b427ef8-019a-4821-a5ac-e7edeb8d6ecc req-ef9b38d2-bac0-458a-8823-29de0e09ada9 service nova] [instance: e09b3809-2e23-401c-9a72-88feb2bb657c] Received unexpected event network-vif-plugged-472488d2-9453-4d74-a6b1-6966b835572d for instance with vm_state rescued and task_state unrescuing.
Nov 14 09:49:52 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:49:53 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e09b3809-2e23-401c-9a72-88feb2bb657c/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:49:53 user nova-compute[75229]: DEBUG nova.compute.manager [req-1fdec792-7d3c-40bd-ba8d-8429e7b7f9df req-80f8968f-a590-40d0-be24-7ab79ee891d2 service nova] [instance: a60d339f-e134-477c-8505-bf8c79d2a21c] Received event network-vif-plugged-cb98fc47-7b69-4bde-9a4c-717cd44ba908 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:49:53 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-1fdec792-7d3c-40bd-ba8d-8429e7b7f9df req-80f8968f-a590-40d0-be24-7ab79ee891d2 service nova] Acquiring lock "a60d339f-e134-477c-8505-bf8c79d2a21c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:49:53 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-1fdec792-7d3c-40bd-ba8d-8429e7b7f9df req-80f8968f-a590-40d0-be24-7ab79ee891d2 service nova] Lock "a60d339f-e134-477c-8505-bf8c79d2a21c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:49:53 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-1fdec792-7d3c-40bd-ba8d-8429e7b7f9df req-80f8968f-a590-40d0-be24-7ab79ee891d2 service nova] Lock "a60d339f-e134-477c-8505-bf8c79d2a21c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:49:53 user nova-compute[75229]: DEBUG nova.compute.manager [req-1fdec792-7d3c-40bd-ba8d-8429e7b7f9df req-80f8968f-a590-40d0-be24-7ab79ee891d2 service nova] [instance: a60d339f-e134-477c-8505-bf8c79d2a21c] No waiting events found dispatching network-vif-plugged-cb98fc47-7b69-4bde-9a4c-717cd44ba908 {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 09:49:53 user nova-compute[75229]: WARNING nova.compute.manager [req-1fdec792-7d3c-40bd-ba8d-8429e7b7f9df req-80f8968f-a590-40d0-be24-7ab79ee891d2 service nova] [instance: a60d339f-e134-477c-8505-bf8c79d2a21c] Received unexpected event network-vif-plugged-cb98fc47-7b69-4bde-9a4c-717cd44ba908 for instance with vm_state resized and task_state resize_reverting.
Nov 14 09:49:53 user nova-compute[75229]: DEBUG nova.compute.manager [req-1fdec792-7d3c-40bd-ba8d-8429e7b7f9df req-80f8968f-a590-40d0-be24-7ab79ee891d2 service nova] [instance: a60d339f-e134-477c-8505-bf8c79d2a21c] Received event network-vif-plugged-cb98fc47-7b69-4bde-9a4c-717cd44ba908 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:49:53 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-1fdec792-7d3c-40bd-ba8d-8429e7b7f9df req-80f8968f-a590-40d0-be24-7ab79ee891d2 service nova] Acquiring lock "a60d339f-e134-477c-8505-bf8c79d2a21c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:49:53 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-1fdec792-7d3c-40bd-ba8d-8429e7b7f9df req-80f8968f-a590-40d0-be24-7ab79ee891d2 service nova] Lock "a60d339f-e134-477c-8505-bf8c79d2a21c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:49:53 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-1fdec792-7d3c-40bd-ba8d-8429e7b7f9df req-80f8968f-a590-40d0-be24-7ab79ee891d2 service nova] Lock "a60d339f-e134-477c-8505-bf8c79d2a21c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:49:53 user nova-compute[75229]: DEBUG nova.compute.manager [req-1fdec792-7d3c-40bd-ba8d-8429e7b7f9df req-80f8968f-a590-40d0-be24-7ab79ee891d2 service nova] [instance: a60d339f-e134-477c-8505-bf8c79d2a21c] No waiting events found dispatching network-vif-plugged-cb98fc47-7b69-4bde-9a4c-717cd44ba908 {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 09:49:53 user nova-compute[75229]: WARNING nova.compute.manager [req-1fdec792-7d3c-40bd-ba8d-8429e7b7f9df req-80f8968f-a590-40d0-be24-7ab79ee891d2 service nova] [instance: a60d339f-e134-477c-8505-bf8c79d2a21c] Received unexpected event network-vif-plugged-cb98fc47-7b69-4bde-9a4c-717cd44ba908 for instance with vm_state resized and task_state resize_reverting.
Nov 14 09:49:53 user nova-compute[75229]: DEBUG nova.compute.manager [req-1fdec792-7d3c-40bd-ba8d-8429e7b7f9df req-80f8968f-a590-40d0-be24-7ab79ee891d2 service nova] [instance: a60d339f-e134-477c-8505-bf8c79d2a21c] Received event network-vif-unplugged-cb98fc47-7b69-4bde-9a4c-717cd44ba908 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:49:53 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-1fdec792-7d3c-40bd-ba8d-8429e7b7f9df req-80f8968f-a590-40d0-be24-7ab79ee891d2 service nova] Acquiring lock "a60d339f-e134-477c-8505-bf8c79d2a21c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:49:53 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-1fdec792-7d3c-40bd-ba8d-8429e7b7f9df req-80f8968f-a590-40d0-be24-7ab79ee891d2 service nova] Lock "a60d339f-e134-477c-8505-bf8c79d2a21c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:49:53 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-1fdec792-7d3c-40bd-ba8d-8429e7b7f9df req-80f8968f-a590-40d0-be24-7ab79ee891d2 service nova] Lock "a60d339f-e134-477c-8505-bf8c79d2a21c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:49:53 user nova-compute[75229]: DEBUG nova.compute.manager [req-1fdec792-7d3c-40bd-ba8d-8429e7b7f9df req-80f8968f-a590-40d0-be24-7ab79ee891d2 service nova] [instance: a60d339f-e134-477c-8505-bf8c79d2a21c] No waiting events found dispatching network-vif-unplugged-cb98fc47-7b69-4bde-9a4c-717cd44ba908 {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 09:49:53 user nova-compute[75229]: WARNING nova.compute.manager [req-1fdec792-7d3c-40bd-ba8d-8429e7b7f9df req-80f8968f-a590-40d0-be24-7ab79ee891d2 service nova] [instance: a60d339f-e134-477c-8505-bf8c79d2a21c] Received unexpected event network-vif-unplugged-cb98fc47-7b69-4bde-9a4c-717cd44ba908 for instance with vm_state resized and task_state resize_reverting.
Nov 14 09:49:53 user nova-compute[75229]: DEBUG nova.compute.manager [req-1fdec792-7d3c-40bd-ba8d-8429e7b7f9df req-80f8968f-a590-40d0-be24-7ab79ee891d2 service nova] [instance: a60d339f-e134-477c-8505-bf8c79d2a21c] Received event network-vif-plugged-cb98fc47-7b69-4bde-9a4c-717cd44ba908 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:49:53 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-1fdec792-7d3c-40bd-ba8d-8429e7b7f9df req-80f8968f-a590-40d0-be24-7ab79ee891d2 service nova] Acquiring lock "a60d339f-e134-477c-8505-bf8c79d2a21c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:49:53 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-1fdec792-7d3c-40bd-ba8d-8429e7b7f9df req-80f8968f-a590-40d0-be24-7ab79ee891d2 service nova] Lock "a60d339f-e134-477c-8505-bf8c79d2a21c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:49:53 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-1fdec792-7d3c-40bd-ba8d-8429e7b7f9df req-80f8968f-a590-40d0-be24-7ab79ee891d2 service nova] Lock "a60d339f-e134-477c-8505-bf8c79d2a21c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:49:53 user nova-compute[75229]: DEBUG nova.compute.manager [req-1fdec792-7d3c-40bd-ba8d-8429e7b7f9df req-80f8968f-a590-40d0-be24-7ab79ee891d2 service nova] [instance: a60d339f-e134-477c-8505-bf8c79d2a21c] No waiting events found dispatching network-vif-plugged-cb98fc47-7b69-4bde-9a4c-717cd44ba908 {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 09:49:53 user nova-compute[75229]: WARNING nova.compute.manager [req-1fdec792-7d3c-40bd-ba8d-8429e7b7f9df req-80f8968f-a590-40d0-be24-7ab79ee891d2 service nova] [instance: a60d339f-e134-477c-8505-bf8c79d2a21c] Received unexpected event network-vif-plugged-cb98fc47-7b69-4bde-9a4c-717cd44ba908 for instance with vm_state resized and task_state resize_reverting.
Nov 14 09:49:53 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-7dd57e30-92d4-41c9-af13-77ac442a957a tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] [instance: be813b28-133f-416a-b2b5-dc0b9e4064b7] Creating instance directory {{(pid=75229) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 09:49:53 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-7dd57e30-92d4-41c9-af13-77ac442a957a tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] [instance: be813b28-133f-416a-b2b5-dc0b9e4064b7] Creating image(s)
Nov 14 09:49:53 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-7dd57e30-92d4-41c9-af13-77ac442a957a tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Acquiring lock "/opt/stack/data/nova/instances/be813b28-133f-416a-b2b5-dc0b9e4064b7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:49:53 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-7dd57e30-92d4-41c9-af13-77ac442a957a tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Lock "/opt/stack/data/nova/instances/be813b28-133f-416a-b2b5-dc0b9e4064b7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:49:53 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-7dd57e30-92d4-41c9-af13-77ac442a957a tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Lock "/opt/stack/data/nova/instances/be813b28-133f-416a-b2b5-dc0b9e4064b7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:49:53 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:49:53 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-7dd57e30-92d4-41c9-af13-77ac442a957a tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6 --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:49:53 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:49:53 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e09b3809-2e23-401c-9a72-88feb2bb657c/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:49:53 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e09b3809-2e23-401c-9a72-88feb2bb657c/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:49:53 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-7dd57e30-92d4-41c9-af13-77ac442a957a tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6 --force-share --output=json" returned: 0 in 0.183s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:49:53 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-7dd57e30-92d4-41c9-af13-77ac442a957a tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Acquiring lock "4f30e3fe703d2381679612a57b1fb80a467f60b6" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:49:53 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-7dd57e30-92d4-41c9-af13-77ac442a957a tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Lock "4f30e3fe703d2381679612a57b1fb80a467f60b6" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:49:53 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-7dd57e30-92d4-41c9-af13-77ac442a957a tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6 --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:49:53 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e09b3809-2e23-401c-9a72-88feb2bb657c/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:49:53 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75229) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 09:49:53 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4255af28-a111-4475-b207-67e335fd0835/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:49:53 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-7dd57e30-92d4-41c9-af13-77ac442a957a tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6 --force-share --output=json" returned: 0 in 0.215s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:49:53 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-7dd57e30-92d4-41c9-af13-77ac442a957a tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6,backing_fmt=raw /opt/stack/data/nova/instances/be813b28-133f-416a-b2b5-dc0b9e4064b7/disk 1073741824 {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:49:53 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-7dd57e30-92d4-41c9-af13-77ac442a957a tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6,backing_fmt=raw /opt/stack/data/nova/instances/be813b28-133f-416a-b2b5-dc0b9e4064b7/disk 1073741824" returned: 0 in 0.049s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:49:53 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-7dd57e30-92d4-41c9-af13-77ac442a957a tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Lock "4f30e3fe703d2381679612a57b1fb80a467f60b6" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.271s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:49:53 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-7dd57e30-92d4-41c9-af13-77ac442a957a tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6 --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:49:53 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4255af28-a111-4475-b207-67e335fd0835/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:49:53 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4255af28-a111-4475-b207-67e335fd0835/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:49:53 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-7dd57e30-92d4-41c9-af13-77ac442a957a tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6 --force-share --output=json" returned: 0 in 0.193s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:49:53 user nova-compute[75229]: DEBUG nova.virt.disk.api [None req-7dd57e30-92d4-41c9-af13-77ac442a957a tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Checking if we can resize image /opt/stack/data/nova/instances/be813b28-133f-416a-b2b5-dc0b9e4064b7/disk. size=1073741824 {{(pid=75229) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 09:49:53 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-7dd57e30-92d4-41c9-af13-77ac442a957a tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be813b28-133f-416a-b2b5-dc0b9e4064b7/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:49:53 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4255af28-a111-4475-b207-67e335fd0835/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:49:53 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5170e9e-66e3-4df1-9807-4958cac6480e/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:49:53 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:49:53 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:49:53 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-7dd57e30-92d4-41c9-af13-77ac442a957a tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be813b28-133f-416a-b2b5-dc0b9e4064b7/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:49:53 user nova-compute[75229]: DEBUG nova.virt.disk.api [None req-7dd57e30-92d4-41c9-af13-77ac442a957a tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Cannot resize image /opt/stack/data/nova/instances/be813b28-133f-416a-b2b5-dc0b9e4064b7/disk to a smaller size. {{(pid=75229) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 09:49:53 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-7dd57e30-92d4-41c9-af13-77ac442a957a tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] [instance: be813b28-133f-416a-b2b5-dc0b9e4064b7] Created local disks {{(pid=75229) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 09:49:53 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-7dd57e30-92d4-41c9-af13-77ac442a957a tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] [instance: be813b28-133f-416a-b2b5-dc0b9e4064b7] Ensure instance console log exists: /opt/stack/data/nova/instances/be813b28-133f-416a-b2b5-dc0b9e4064b7/console.log {{(pid=75229) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 09:49:53 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-7dd57e30-92d4-41c9-af13-77ac442a957a tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:49:53 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-7dd57e30-92d4-41c9-af13-77ac442a957a tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:49:53 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-7dd57e30-92d4-41c9-af13-77ac442a957a tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:49:53 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-7dd57e30-92d4-41c9-af13-77ac442a957a tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] [instance: be813b28-133f-416a-b2b5-dc0b9e4064b7] Start _get_guest_xml network_info=[{"id": "d9a42cb3-5297-4aaf-bf16-9e591cab2fdc", "address": "fa:16:3e:27:a8:b8", "network": {"id": "5dfc532f-3d5d-4342-b7f1-12c9c3992a54", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1457278473-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.17", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46e65cdd021f4a3db7c9254bb6d98b46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9a42cb3-52", "ovs_interfaceid": "d9a42cb3-5297-4aaf-bf16-9e591cab2fdc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T09:40:10Z,direct_url=<?>,disk_format='qcow2',id=3bef8470-ecc7-40e3-95d4-9254348ea72d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='de5a91106b6948ed937a7178ff9464c4',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T09:40:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'disk_bus': 'virtio', 'guest_format': None, 'encryption_secret_uuid': None, 'size': 0, 'device_type': 'disk', 'image_id': '3bef8470-ecc7-40e3-95d4-9254348ea72d'}], 'ephemerals': [], 'block_device_mapping': [{'boot_index': None, 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:a7902ab8-168d-4c8a-90e9-bf44d669ce2b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HBhZNQjK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'be813b28-133f-416a-b2b5-dc0b9e4064b7', 'attached_at': '', 'detached_at': '', 'volume_id': 'a7902ab8-168d-4c8a-90e9-bf44d669ce2b', 'serial': 'a7902ab8-168d-4c8a-90e9-bf44d669ce2b'}, 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'attachment_id': 'f1ff531a-7e21-4bb2-8df2-ffae9dc94972', 'guest_format': None, 'device_type': 'disk', 'volume_type': None} {{(pid=75229) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 09:49:53 user nova-compute[75229]: WARNING nova.virt.libvirt.driver [None req-7dd57e30-92d4-41c9-af13-77ac442a957a tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 14 09:49:53 user nova-compute[75229]: WARNING nova.virt.libvirt.driver [None req-7dd57e30-92d4-41c9-af13-77ac442a957a tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 14 09:49:53 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-7dd57e30-92d4-41c9-af13-77ac442a957a tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75229) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 09:49:53 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-7dd57e30-92d4-41c9-af13-77ac442a957a tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] CPU controller missing on host. {{(pid=75229) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 09:49:53 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-7dd57e30-92d4-41c9-af13-77ac442a957a tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75229) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 09:49:53 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-7dd57e30-92d4-41c9-af13-77ac442a957a tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] CPU controller found on host. {{(pid=75229) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 09:49:53 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-7dd57e30-92d4-41c9-af13-77ac442a957a tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75229) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 09:49:53 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-7dd57e30-92d4-41c9-af13-77ac442a957a tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T09:39:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T09:40:10Z,direct_url=<?>,disk_format='qcow2',id=3bef8470-ecc7-40e3-95d4-9254348ea72d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='de5a91106b6948ed937a7178ff9464c4',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T09:40:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 09:49:53 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-7dd57e30-92d4-41c9-af13-77ac442a957a tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Flavor limits 0:0:0 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 09:49:53 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-7dd57e30-92d4-41c9-af13-77ac442a957a tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Image limits 0:0:0 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 09:49:53 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-7dd57e30-92d4-41c9-af13-77ac442a957a tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Flavor pref 0:0:0 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 09:49:53 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-7dd57e30-92d4-41c9-af13-77ac442a957a tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Image pref 0:0:0 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 09:49:53 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-7dd57e30-92d4-41c9-af13-77ac442a957a tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 09:49:53 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-7dd57e30-92d4-41c9-af13-77ac442a957a tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 09:49:53 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-7dd57e30-92d4-41c9-af13-77ac442a957a tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75229) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 09:49:53 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-7dd57e30-92d4-41c9-af13-77ac442a957a tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Got 1 possible topologies {{(pid=75229) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 09:49:53 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-7dd57e30-92d4-41c9-af13-77ac442a957a tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 09:49:53 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-7dd57e30-92d4-41c9-af13-77ac442a957a tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 09:49:53 user nova-compute[75229]: DEBUG nova.objects.instance [None req-7dd57e30-92d4-41c9-af13-77ac442a957a tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Lazy-loading 'vcpu_model' on Instance uuid be813b28-133f-416a-b2b5-dc0b9e4064b7 {{(pid=75229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 09:49:54 user nova-compute[75229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7dd57e30-92d4-41c9-af13-77ac442a957a tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] [instance: be813b28-133f-416a-b2b5-dc0b9e4064b7] Calling os-brick to attach iSCSI Volume {{(pid=75229) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 09:49:54 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dd57e30-92d4-41c9-af13-77ac442a957a tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f73f85151b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a7902ab8-168d-4c8a-90e9-bf44d669ce2b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HBhZNQjK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 09:49:54 user nova-compute[75229]: WARNING os_brick.initiator.connectors.base [None req-7dd57e30-92d4-41c9-af13-77ac442a957a tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 14 09:49:54 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-7dd57e30-92d4-41c9-af13-77ac442a957a tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 09:49:54 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-7dd57e30-92d4-41c9-af13-77ac442a957a tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 09:49:54 user nova-compute[75229]: WARNING os_brick.initiator.connectors.base [None req-7dd57e30-92d4-41c9-af13-77ac442a957a tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 14 09:49:54 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-7dd57e30-92d4-41c9-af13-77ac442a957a tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a7902ab8-168d-4c8a-90e9-bf44d669ce2b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 09:49:54 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-7dd57e30-92d4-41c9-af13-77ac442a957a tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a7902ab8-168d-4c8a-90e9-bf44d669ce2b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 09:49:54 user nova-compute[75229]: INFO os_brick.initiator.connectors.iscsi [None req-7dd57e30-92d4-41c9-af13-77ac442a957a tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 09:49:54 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5170e9e-66e3-4df1-9807-4958cac6480e/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:49:54 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5170e9e-66e3-4df1-9807-4958cac6480e/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:49:54 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7902ab8-168d-4c8a-90e9-bf44d669ce2b -p 172.16.0.220:3260 {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:49:54 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7902ab8-168d-4c8a-90e9-bf44d669ce2b -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:49:54 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[27524591-0949-4437-8629-f22be80f377b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:49:54 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dd57e30-92d4-41c9-af13-77ac442a957a tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 09:49:54 user nova-compute[75229]:  {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:49:54 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7902ab8-168d-4c8a-90e9-bf44d669ce2b -p 172.16.0.220:3260 --interface default --op new {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:49:54 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7902ab8-168d-4c8a-90e9-bf44d669ce2b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:49:54 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[e428970a-3f00-4b70-a80b-db179f2a06d2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a7902ab8-168d-4c8a-90e9-bf44d669ce2b] added\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:49:54 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dd57e30-92d4-41c9-af13-77ac442a957a tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a7902ab8-168d-4c8a-90e9-bf44d669ce2b] added
Nov 14 09:49:54 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:49:54 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7902ab8-168d-4c8a-90e9-bf44d669ce2b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:49:54 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7902ab8-168d-4c8a-90e9-bf44d669ce2b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:49:54 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[37aab902-2697-42f6-aadd-dd33fa1a6331]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:49:54 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dd57e30-92d4-41c9-af13-77ac442a957a tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:49:54 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7902ab8-168d-4c8a-90e9-bf44d669ce2b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:49:54 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7902ab8-168d-4c8a-90e9-bf44d669ce2b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:49:54 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a6f48d5-249e-450f-b2cc-11b5e01cdd41]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:49:54 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dd57e30-92d4-41c9-af13-77ac442a957a tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:49:54 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7902ab8-168d-4c8a-90e9-bf44d669ce2b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HBhZNQjK {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:49:54 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7902ab8-168d-4c8a-90e9-bf44d669ce2b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HBhZNQjK" returned: 0 in 0.018s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:49:54 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[f723d9fe-a398-47be-be69-3cb92de4388d]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:49:54 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dd57e30-92d4-41c9-af13-77ac442a957a tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HBhZNQjK'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:49:54 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7902ab8-168d-4c8a-90e9-bf44d669ce2b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:49:54 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7902ab8-168d-4c8a-90e9-bf44d669ce2b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:49:54 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[660115d4-e3ac-4d5e-b595-2fb7a8d39814]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:49:54 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dd57e30-92d4-41c9-af13-77ac442a957a tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:49:54 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:49:54 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-fd748a0e-4bf3-442b-8b83-34a017396e4a tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:49:54 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-fd748a0e-4bf3-442b-8b83-34a017396e4a tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:49:54 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:49:54 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[de5f70cc-0d0c-4e0f-9358-a72b7383c52b]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fed285f-9be4-4601-8cb5-4329d7ebed8c (non-flash)\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:49:54 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dd57e30-92d4-41c9-af13-77ac442a957a tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fed285f-9be4-4601-8cb5-4329d7ebed8c (non-flash)
Nov 14 09:49:54 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 09:49:54 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dd57e30-92d4-41c9-af13-77ac442a957a tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fed285f-9be4-4601-8cb5-4329d7ebed8c (non-flash)
Nov 14 09:49:54 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 09:49:54 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5170e9e-66e3-4df1-9807-4958cac6480e/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:49:54 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7902ab8-168d-4c8a-90e9-bf44d669ce2b -p 172.16.0.220:3260 --login {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:49:54 user nova-compute[75229]: DEBUG nova.objects.instance [None req-fd748a0e-4bf3-442b-8b83-34a017396e4a tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] Lazy-loading 'migration_context' on Instance uuid a60d339f-e134-477c-8505-bf8c79d2a21c {{(pid=75229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 09:49:54 user nova-compute[75229]: DEBUG nova.objects.base [None req-fd748a0e-4bf3-442b-8b83-34a017396e4a tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] Object Instance<a60d339f-e134-477c-8505-bf8c79d2a21c> lazy-loaded attributes: resources,migration_context {{(pid=75229) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 09:49:54 user nova-compute[75229]: DEBUG nova.compute.manager [req-9c4527d9-a5fd-4383-9f03-386c2f42255f req-f0ca0f07-3614-4894-8500-9ed998d60fa7 service nova] [instance: 94e2b266-2fe3-481a-bb1e-24f835a79ddf] Received event network-vif-plugged-be0352bd-a149-4097-b049-8445f895d993 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:49:54 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-9c4527d9-a5fd-4383-9f03-386c2f42255f req-f0ca0f07-3614-4894-8500-9ed998d60fa7 service nova] Acquiring lock "94e2b266-2fe3-481a-bb1e-24f835a79ddf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:49:54 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-9c4527d9-a5fd-4383-9f03-386c2f42255f req-f0ca0f07-3614-4894-8500-9ed998d60fa7 service nova] Lock "94e2b266-2fe3-481a-bb1e-24f835a79ddf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:49:54 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-9c4527d9-a5fd-4383-9f03-386c2f42255f req-f0ca0f07-3614-4894-8500-9ed998d60fa7 service nova] Lock "94e2b266-2fe3-481a-bb1e-24f835a79ddf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:49:54 user nova-compute[75229]: DEBUG nova.compute.manager [req-9c4527d9-a5fd-4383-9f03-386c2f42255f req-f0ca0f07-3614-4894-8500-9ed998d60fa7 service nova] [instance: 94e2b266-2fe3-481a-bb1e-24f835a79ddf] No waiting events found dispatching network-vif-plugged-be0352bd-a149-4097-b049-8445f895d993 {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 09:49:54 user nova-compute[75229]: WARNING nova.compute.manager [req-9c4527d9-a5fd-4383-9f03-386c2f42255f req-f0ca0f07-3614-4894-8500-9ed998d60fa7 service nova] [instance: 94e2b266-2fe3-481a-bb1e-24f835a79ddf] Received unexpected event network-vif-plugged-be0352bd-a149-4097-b049-8445f895d993 for instance with vm_state building and task_state spawning.
Nov 14 09:49:55 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7902ab8-168d-4c8a-90e9-bf44d669ce2b -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:49:55 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[eacafc22-9967-4106-b176-8a7838885850]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a7902ab8-168d-4c8a-90e9-bf44d669ce2b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a7902ab8-168d-4c8a-90e9-bf44d669ce2b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:49:55 user nova-compute[75229]: DEBUG nova.scheduler.client.report [None req-fd748a0e-4bf3-442b-8b83-34a017396e4a tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] Refreshing inventories for resource provider d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 {{(pid=75229) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 14 09:49:55 user nova-compute[75229]: DEBUG nova.compute.manager [req-f2f610fa-c610-49cf-abdb-b96c05c87962 req-adf07a05-b597-44ac-96be-a29e0dc39601 service nova] [instance: e09b3809-2e23-401c-9a72-88feb2bb657c] Received event network-vif-plugged-472488d2-9453-4d74-a6b1-6966b835572d {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:49:55 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-f2f610fa-c610-49cf-abdb-b96c05c87962 req-adf07a05-b597-44ac-96be-a29e0dc39601 service nova] Acquiring lock "e09b3809-2e23-401c-9a72-88feb2bb657c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:49:55 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-f2f610fa-c610-49cf-abdb-b96c05c87962 req-adf07a05-b597-44ac-96be-a29e0dc39601 service nova] Lock "e09b3809-2e23-401c-9a72-88feb2bb657c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:49:55 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-f2f610fa-c610-49cf-abdb-b96c05c87962 req-adf07a05-b597-44ac-96be-a29e0dc39601 service nova] Lock "e09b3809-2e23-401c-9a72-88feb2bb657c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:49:55 user nova-compute[75229]: DEBUG nova.compute.manager [req-f2f610fa-c610-49cf-abdb-b96c05c87962 req-adf07a05-b597-44ac-96be-a29e0dc39601 service nova] [instance: e09b3809-2e23-401c-9a72-88feb2bb657c] No waiting events found dispatching network-vif-plugged-472488d2-9453-4d74-a6b1-6966b835572d {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 09:49:55 user nova-compute[75229]: WARNING nova.compute.manager [req-f2f610fa-c610-49cf-abdb-b96c05c87962 req-adf07a05-b597-44ac-96be-a29e0dc39601 service nova] [instance: e09b3809-2e23-401c-9a72-88feb2bb657c] Received unexpected event network-vif-plugged-472488d2-9453-4d74-a6b1-6966b835572d for instance with vm_state rescued and task_state unrescuing.
Nov 14 09:49:55 user nova-compute[75229]: DEBUG nova.compute.manager [None req-9263b606-7384-49ba-93c3-ffbfa7db372c tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] [instance: 94e2b266-2fe3-481a-bb1e-24f835a79ddf] Instance event wait completed in 0 seconds for  {{(pid=75229) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 09:49:55 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-9263b606-7384-49ba-93c3-ffbfa7db372c tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] [instance: 94e2b266-2fe3-481a-bb1e-24f835a79ddf] Guest created on hypervisor {{(pid=75229) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 09:49:55 user nova-compute[75229]: DEBUG nova.compute.manager [None req-64bc43f2-2e3f-44a6-87a9-0a7dcad856e8 tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] [instance: e09b3809-2e23-401c-9a72-88feb2bb657c] Checking state {{(pid=75229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 09:49:55 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dd57e30-92d4-41c9-af13-77ac442a957a tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a7902ab8-168d-4c8a-90e9-bf44d669ce2b, portal: 172.16.0.220,3260]
Nov 14 09:49:55 user nova-compute[75229]: Login to [iface: default, target: iqn.2010-10.org.openstack:a7902ab8-168d-4c8a-90e9-bf44d669ce2b, portal: 172.16.0.220,3260] successful.
Nov 14 09:49:55 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:49:55 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7902ab8-168d-4c8a-90e9-bf44d669ce2b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:49:55 user nova-compute[75229]: WARNING nova.virt.libvirt.driver [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 09:49:55 user nova-compute[75229]: WARNING nova.virt.libvirt.driver [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 09:49:55 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Hypervisor/Node resource view: name=user free_ram=7364MB free_disk=25.250564575195312GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75229) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 09:49:55 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:49:55 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7902ab8-168d-4c8a-90e9-bf44d669ce2b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:49:55 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e4bd36b-bee5-4641-885c-1a13949237a3]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:49:55 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dd57e30-92d4-41c9-af13-77ac442a957a tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:49:55 user nova-compute[75229]: INFO nova.virt.libvirt.driver [-] [instance: 94e2b266-2fe3-481a-bb1e-24f835a79ddf] Instance spawned successfully.
Nov 14 09:49:55 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-9263b606-7384-49ba-93c3-ffbfa7db372c tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] [instance: 94e2b266-2fe3-481a-bb1e-24f835a79ddf] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 09:49:55 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:49:55 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-9263b606-7384-49ba-93c3-ffbfa7db372c tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] [instance: 94e2b266-2fe3-481a-bb1e-24f835a79ddf] Found default for hw_cdrom_bus of ide {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 09:49:55 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-9263b606-7384-49ba-93c3-ffbfa7db372c tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] [instance: 94e2b266-2fe3-481a-bb1e-24f835a79ddf] Found default for hw_disk_bus of virtio {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 09:49:55 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-9263b606-7384-49ba-93c3-ffbfa7db372c tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] [instance: 94e2b266-2fe3-481a-bb1e-24f835a79ddf] Found default for hw_input_bus of None {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 09:49:55 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-9263b606-7384-49ba-93c3-ffbfa7db372c tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] [instance: 94e2b266-2fe3-481a-bb1e-24f835a79ddf] Found default for hw_pointer_model of None {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 09:49:55 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-9263b606-7384-49ba-93c3-ffbfa7db372c tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] [instance: 94e2b266-2fe3-481a-bb1e-24f835a79ddf] Found default for hw_video_model of virtio {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 09:49:55 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-9263b606-7384-49ba-93c3-ffbfa7db372c tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] [instance: 94e2b266-2fe3-481a-bb1e-24f835a79ddf] Found default for hw_vif_model of virtio {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 09:49:55 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:49:55 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[d06a135e-5665-4c36-9651-ef2c0a29bc86]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fed285f-9be4-4601-8cb5-4329d7ebed8c (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7902ab8-168d-4c8a-90e9-bf44d669ce2b (non-flash)\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:49:55 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dd57e30-92d4-41c9-af13-77ac442a957a tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fed285f-9be4-4601-8cb5-4329d7ebed8c (non-flash)
Nov 14 09:49:55 user nova-compute[75229]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7902ab8-168d-4c8a-90e9-bf44d669ce2b (non-flash)
Nov 14 09:49:55 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 09:49:55 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dd57e30-92d4-41c9-af13-77ac442a957a tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fed285f-9be4-4601-8cb5-4329d7ebed8c (non-flash)
Nov 14 09:49:55 user nova-compute[75229]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7902ab8-168d-4c8a-90e9-bf44d669ce2b (non-flash)
Nov 14 09:49:55 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 09:49:55 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-7dd57e30-92d4-41c9-af13-77ac442a957a tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a7902ab8-168d-4c8a-90e9-bf44d669ce2b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.096s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 09:49:55 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dd57e30-92d4-41c9-af13-77ac442a957a tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Connected to 172.16.0.220:3260 {{(pid=75229) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 09:49:55 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-7dd57e30-92d4-41c9-af13-77ac442a957a tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] HCTL ('33', '-', '-', 0) found on session 21 with lun 0 {{(pid=75229) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 09:49:55 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-7dd57e30-92d4-41c9-af13-77ac442a957a tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75229) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 09:49:55 user nova-compute[75229]: DEBUG nova.scheduler.client.report [None req-fd748a0e-4bf3-442b-8b83-34a017396e4a tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] Updating ProviderTree inventory for provider d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75229) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 14 09:49:55 user nova-compute[75229]: DEBUG nova.compute.provider_tree [None req-fd748a0e-4bf3-442b-8b83-34a017396e4a tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] Updating inventory in ProviderTree for provider d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 14 09:49:55 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:49:55 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.027s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:49:55 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7bb5d35-6f61-4027-b5da-e85ed46e18b6]: (4, ('- - 0', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:49:55 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-7dd57e30-92d4-41c9-af13-77ac442a957a tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Searching for a device in session 21 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75229) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 09:49:55 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dd57e30-92d4-41c9-af13-77ac442a957a tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:a7902ab8-168d-4c8a-90e9-bf44d669ce2b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HBhZNQjK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75229) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 09:49:55 user nova-compute[75229]: INFO nova.compute.manager [None req-9263b606-7384-49ba-93c3-ffbfa7db372c tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] [instance: 94e2b266-2fe3-481a-bb1e-24f835a79ddf] Took 8.86 seconds to spawn the instance on the hypervisor.
Nov 14 09:49:55 user nova-compute[75229]: DEBUG nova.compute.manager [None req-9263b606-7384-49ba-93c3-ffbfa7db372c tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] [instance: 94e2b266-2fe3-481a-bb1e-24f835a79ddf] Checking state {{(pid=75229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 09:49:55 user nova-compute[75229]: DEBUG nova.scheduler.client.report [None req-fd748a0e-4bf3-442b-8b83-34a017396e4a tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] Refreshing aggregate associations for resource provider d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3, aggregates: None {{(pid=75229) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 14 09:49:55 user nova-compute[75229]: DEBUG nova.scheduler.client.report [None req-fd748a0e-4bf3-442b-8b83-34a017396e4a tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] Refreshing trait associations for resource provider d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3, traits: COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_MMX,HW_CPU_X86_SSE42,HW_CPU_X86_SSSE3,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_TRUSTED_CERTS,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSE,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_USB,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_RESCUE_BFV {{(pid=75229) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 14 09:49:55 user nova-compute[75229]: INFO nova.compute.manager [None req-9263b606-7384-49ba-93c3-ffbfa7db372c tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] [instance: 94e2b266-2fe3-481a-bb1e-24f835a79ddf] Took 9.76 seconds to build instance.
Nov 14 09:49:55 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-9263b606-7384-49ba-93c3-ffbfa7db372c tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] Lock "94e2b266-2fe3-481a-bb1e-24f835a79ddf" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.971s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:49:55 user nova-compute[75229]: DEBUG nova.compute.provider_tree [None req-fd748a0e-4bf3-442b-8b83-34a017396e4a tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] Inventory has not changed in ProviderTree for provider: d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 {{(pid=75229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 09:49:55 user nova-compute[75229]: DEBUG nova.scheduler.client.report [None req-fd748a0e-4bf3-442b-8b83-34a017396e4a tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] Inventory has not changed for provider d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 09:49:55 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-fd748a0e-4bf3-442b-8b83-34a017396e4a tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: held 1.524s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:49:55 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.657s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:49:55 user nova-compute[75229]: INFO nova.compute.manager [None req-fd748a0e-4bf3-442b-8b83-34a017396e4a tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] [instance: a60d339f-e134-477c-8505-bf8c79d2a21c] Swapping old allocation on dict_keys(['d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3']) held by migration 2ccefcb8-9839-48e7-bdc8-dfbad0d1bf64 for instance
Nov 14 09:49:55 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Instance a7750cbc-b3d0-44aa-8b88-c291ba007a8a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 09:49:55 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Instance e09b3809-2e23-401c-9a72-88feb2bb657c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 09:49:55 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Instance 90bd76df-96cb-4bec-9862-853d94cdbaab actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 09:49:55 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Instance be813b28-133f-416a-b2b5-dc0b9e4064b7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 09:49:55 user nova-compute[75229]: DEBUG nova.scheduler.client.report [None req-fd748a0e-4bf3-442b-8b83-34a017396e4a tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] Overwriting current allocation {'allocations': {'d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3': {'resources': {'VCPU': 1, 'MEMORY_MB': 2048, 'DISK_GB': 20}, 'generation': 26}}, 'project_id': '32e17c7c586542139cdbc5bfda57e075', 'user_id': '39c6903e2d154e838835eb5265776521', 'consumer_generation': 1} on consumer a60d339f-e134-477c-8505-bf8c79d2a21c {{(pid=75229) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:2018}}
Nov 14 09:49:56 user nova-compute[75229]: INFO nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Instance 2ccefcb8-9839-48e7-bdc8-dfbad0d1bf64 has allocations against this compute host but is not found in the database.
Nov 14 09:49:56 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Instance a60d339f-e134-477c-8505-bf8c79d2a21c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 09:49:56 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Instance d6e2d77b-9894-4afa-8fa1-13a2842ba9a7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 09:49:56 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Instance 4255af28-a111-4475-b207-67e335fd0835 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 09:49:56 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Instance 4c9fe69e-3f9d-4b30-a9e4-efc3e83efa17 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 09:49:56 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Instance b5170e9e-66e3-4df1-9807-4958cac6480e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 09:49:56 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Instance a4ce290f-6dd2-44b6-91be-8e775045837e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 09:49:56 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Instance 94e2b266-2fe3-481a-bb1e-24f835a79ddf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 09:49:56 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=75229) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 09:49:56 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=30GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=75229) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 09:49:56 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-7dd57e30-92d4-41c9-af13-77ac442a957a tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.140s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 09:49:56 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dd57e30-92d4-41c9-af13-77ac442a957a tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] <== connect_volume: return (2142ms) {'type': 'block', 'scsi_wwn': '23232316238343830', 'path': '/dev/sdb'} {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 09:49:56 user nova-compute[75229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7dd57e30-92d4-41c9-af13-77ac442a957a tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] [instance: be813b28-133f-416a-b2b5-dc0b9e4064b7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23232316238343830', 'path': '/dev/sdb'} {{(pid=75229) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 09:49:56 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-fd748a0e-4bf3-442b-8b83-34a017396e4a tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] Acquiring lock "refresh_cache-a60d339f-e134-477c-8505-bf8c79d2a21c" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 09:49:56 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-fd748a0e-4bf3-442b-8b83-34a017396e4a tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] Acquired lock "refresh_cache-a60d339f-e134-477c-8505-bf8c79d2a21c" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 09:49:56 user nova-compute[75229]: DEBUG nova.network.neutron [None req-fd748a0e-4bf3-442b-8b83-34a017396e4a tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] [instance: a60d339f-e134-477c-8505-bf8c79d2a21c] Building network info cache for instance {{(pid=75229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 09:49:56 user nova-compute[75229]: DEBUG nova.virt.libvirt.vif [None req-7dd57e30-92d4-41c9-af13-77ac442a957a tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-14T09:47:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-266135781',display_name='tempest-ServerActionsTestOtherA-server-179119578',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-266135781',id=15,image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI5pWGQ4KaFZcOEff0OXqhHA6X74NcsQbIGrT1blkx1Y+aHHl7DvQb7afEPRDoAhltmJD8qcavQNRjJLbmHNs+eYeK4dOL8IJQfu1ghTHpot7XRacUK1z4qoyxfCdssM8g==',key_name='tempest-keypair-865166921',keypairs=<?>,launch_index=0,launched_at=2023-11-14T09:47:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='46e65cdd021f4a3db7c9254bb6d98b46',ramdisk_id='',reservation_id='r-0oyrmh9m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-280196295',owner_user_name='tempest-ServerActionsTestOtherA-280196295-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T09:49:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c0c381a0f6124f1ca6ce85c057b9143a',uuid=be813b28-133f-416a-b2b5-dc0b9e4064b7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d9a42cb3-5297-4aaf-bf16-9e591cab2fdc", "address": "fa:16:3e:27:a8:b8", "network": {"id": "5dfc532f-3d5d-4342-b7f1-12c9c3992a54", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1457278473-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.17", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46e65cdd021f4a3db7c9254bb6d98b46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9a42cb3-52", "ovs_interfaceid": "d9a42cb3-5297-4aaf-bf16-9e591cab2fdc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75229) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 09:49:56 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-7dd57e30-92d4-41c9-af13-77ac442a957a tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Converting VIF {"id": "d9a42cb3-5297-4aaf-bf16-9e591cab2fdc", "address": "fa:16:3e:27:a8:b8", "network": {"id": "5dfc532f-3d5d-4342-b7f1-12c9c3992a54", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1457278473-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.17", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46e65cdd021f4a3db7c9254bb6d98b46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9a42cb3-52", "ovs_interfaceid": "d9a42cb3-5297-4aaf-bf16-9e591cab2fdc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 09:49:56 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-7dd57e30-92d4-41c9-af13-77ac442a957a tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:27:a8:b8,bridge_name='br-int',has_traffic_filtering=True,id=d9a42cb3-5297-4aaf-bf16-9e591cab2fdc,network=Network(5dfc532f-3d5d-4342-b7f1-12c9c3992a54),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9a42cb3-52') {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 09:49:56 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-7dd57e30-92d4-41c9-af13-77ac442a957a tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] [instance: be813b28-133f-416a-b2b5-dc0b9e4064b7] End _get_guest_xml xml=<domain type="kvm">
Nov 14 09:49:56 user nova-compute[75229]:   <uuid>be813b28-133f-416a-b2b5-dc0b9e4064b7</uuid>
Nov 14 09:49:56 user nova-compute[75229]:   <name>instance-0000000f</name>
Nov 14 09:49:56 user nova-compute[75229]:   <memory>524288</memory>
Nov 14 09:49:56 user nova-compute[75229]:   <vcpu>1</vcpu>
Nov 14 09:49:56 user nova-compute[75229]:   <metadata>
Nov 14 09:49:56 user nova-compute[75229]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 09:49:56 user nova-compute[75229]:       <nova:package version="0.0.0"/>
Nov 14 09:49:56 user nova-compute[75229]:       <nova:name>tempest-ServerActionsTestOtherA-server-179119578</nova:name>
Nov 14 09:49:56 user nova-compute[75229]:       <nova:creationTime>2023-11-14 09:49:53</nova:creationTime>
Nov 14 09:49:56 user nova-compute[75229]:       <nova:flavor name="m1.tiny">
Nov 14 09:49:56 user nova-compute[75229]:         <nova:memory>512</nova:memory>
Nov 14 09:49:56 user nova-compute[75229]:         <nova:disk>1</nova:disk>
Nov 14 09:49:56 user nova-compute[75229]:         <nova:swap>0</nova:swap>
Nov 14 09:49:56 user nova-compute[75229]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 09:49:56 user nova-compute[75229]:         <nova:vcpus>1</nova:vcpus>
Nov 14 09:49:56 user nova-compute[75229]:       </nova:flavor>
Nov 14 09:49:56 user nova-compute[75229]:       <nova:owner>
Nov 14 09:49:56 user nova-compute[75229]:         <nova:user uuid="c0c381a0f6124f1ca6ce85c057b9143a">tempest-ServerActionsTestOtherA-280196295-project-member</nova:user>
Nov 14 09:49:56 user nova-compute[75229]:         <nova:project uuid="46e65cdd021f4a3db7c9254bb6d98b46">tempest-ServerActionsTestOtherA-280196295</nova:project>
Nov 14 09:49:56 user nova-compute[75229]:       </nova:owner>
Nov 14 09:49:56 user nova-compute[75229]:       <nova:root type="image" uuid="3bef8470-ecc7-40e3-95d4-9254348ea72d"/>
Nov 14 09:49:56 user nova-compute[75229]:       <nova:ports>
Nov 14 09:49:56 user nova-compute[75229]:         <nova:port uuid="d9a42cb3-5297-4aaf-bf16-9e591cab2fdc">
Nov 14 09:49:56 user nova-compute[75229]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 14 09:49:56 user nova-compute[75229]:         </nova:port>
Nov 14 09:49:56 user nova-compute[75229]:       </nova:ports>
Nov 14 09:49:56 user nova-compute[75229]:     </nova:instance>
Nov 14 09:49:56 user nova-compute[75229]:   </metadata>
Nov 14 09:49:56 user nova-compute[75229]:   <sysinfo type="smbios">
Nov 14 09:49:56 user nova-compute[75229]:     <system>
Nov 14 09:49:56 user nova-compute[75229]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 09:49:56 user nova-compute[75229]:       <entry name="product">OpenStack Nova</entry>
Nov 14 09:49:56 user nova-compute[75229]:       <entry name="version">0.0.0</entry>
Nov 14 09:49:56 user nova-compute[75229]:       <entry name="serial">be813b28-133f-416a-b2b5-dc0b9e4064b7</entry>
Nov 14 09:49:56 user nova-compute[75229]:       <entry name="uuid">be813b28-133f-416a-b2b5-dc0b9e4064b7</entry>
Nov 14 09:49:56 user nova-compute[75229]:       <entry name="family">Virtual Machine</entry>
Nov 14 09:49:56 user nova-compute[75229]:     </system>
Nov 14 09:49:56 user nova-compute[75229]:   </sysinfo>
Nov 14 09:49:56 user nova-compute[75229]:   <os>
Nov 14 09:49:56 user nova-compute[75229]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 09:49:56 user nova-compute[75229]:     <boot dev="hd"/>
Nov 14 09:49:56 user nova-compute[75229]:     <smbios mode="sysinfo"/>
Nov 14 09:49:56 user nova-compute[75229]:   </os>
Nov 14 09:49:56 user nova-compute[75229]:   <features>
Nov 14 09:49:56 user nova-compute[75229]:     <acpi/>
Nov 14 09:49:56 user nova-compute[75229]:     <apic/>
Nov 14 09:49:56 user nova-compute[75229]:     <vmcoreinfo/>
Nov 14 09:49:56 user nova-compute[75229]:   </features>
Nov 14 09:49:56 user nova-compute[75229]:   <clock offset="utc">
Nov 14 09:49:56 user nova-compute[75229]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 09:49:56 user nova-compute[75229]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 09:49:56 user nova-compute[75229]:     <timer name="hpet" present="no"/>
Nov 14 09:49:56 user nova-compute[75229]:   </clock>
Nov 14 09:49:56 user nova-compute[75229]:   <cpu mode="custom" match="exact">
Nov 14 09:49:56 user nova-compute[75229]:     <model>Nehalem</model>
Nov 14 09:49:56 user nova-compute[75229]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 09:49:56 user nova-compute[75229]:   </cpu>
Nov 14 09:49:56 user nova-compute[75229]:   <devices>
Nov 14 09:49:56 user nova-compute[75229]:     <disk type="file" device="disk">
Nov 14 09:49:56 user nova-compute[75229]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 09:49:56 user nova-compute[75229]:       <source file="/opt/stack/data/nova/instances/be813b28-133f-416a-b2b5-dc0b9e4064b7/disk"/>
Nov 14 09:49:56 user nova-compute[75229]:       <target dev="vda" bus="virtio"/>
Nov 14 09:49:56 user nova-compute[75229]:     </disk>
Nov 14 09:49:56 user nova-compute[75229]:     <disk type="block" device="disk">
Nov 14 09:49:56 user nova-compute[75229]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 09:49:56 user nova-compute[75229]:       <source dev="/dev/sdb"/>
Nov 14 09:49:56 user nova-compute[75229]:       <target dev="vdb" bus="virtio"/>
Nov 14 09:49:56 user nova-compute[75229]:       <serial>a7902ab8-168d-4c8a-90e9-bf44d669ce2b</serial>
Nov 14 09:49:56 user nova-compute[75229]:     </disk>
Nov 14 09:49:56 user nova-compute[75229]:     <interface type="ethernet">
Nov 14 09:49:56 user nova-compute[75229]:       <mac address="fa:16:3e:27:a8:b8"/>
Nov 14 09:49:56 user nova-compute[75229]:       <model type="virtio"/>
Nov 14 09:49:56 user nova-compute[75229]:       <mtu size="1442"/>
Nov 14 09:49:56 user nova-compute[75229]:       <target dev="tapd9a42cb3-52"/>
Nov 14 09:49:56 user nova-compute[75229]:     </interface>
Nov 14 09:49:56 user nova-compute[75229]:     <serial type="pty">
Nov 14 09:49:56 user nova-compute[75229]:       <log file="/opt/stack/data/nova/instances/be813b28-133f-416a-b2b5-dc0b9e4064b7/console.log" append="off"/>
Nov 14 09:49:56 user nova-compute[75229]:     </serial>
Nov 14 09:49:56 user nova-compute[75229]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 09:49:56 user nova-compute[75229]:     <video>
Nov 14 09:49:56 user nova-compute[75229]:       <model type="virtio"/>
Nov 14 09:49:56 user nova-compute[75229]:     </video>
Nov 14 09:49:56 user nova-compute[75229]:     <rng model="virtio">
Nov 14 09:49:56 user nova-compute[75229]:       <backend model="random">/dev/urandom</backend>
Nov 14 09:49:56 user nova-compute[75229]:     </rng>
Nov 14 09:49:56 user nova-compute[75229]:     <controller type="usb" index="0" model="none"/>
Nov 14 09:49:56 user nova-compute[75229]:     <memballoon model="virtio">
Nov 14 09:49:56 user nova-compute[75229]:       <stats period="10"/>
Nov 14 09:49:56 user nova-compute[75229]:     </memballoon>
Nov 14 09:49:56 user nova-compute[75229]:   </devices>
Nov 14 09:49:56 user nova-compute[75229]: </domain>
Nov 14 09:49:56 user nova-compute[75229]:  {{(pid=75229) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 09:49:56 user nova-compute[75229]: DEBUG nova.virt.libvirt.vif [None req-7dd57e30-92d4-41c9-af13-77ac442a957a tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-14T09:47:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-266135781',display_name='tempest-ServerActionsTestOtherA-server-179119578',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-266135781',id=15,image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI5pWGQ4KaFZcOEff0OXqhHA6X74NcsQbIGrT1blkx1Y+aHHl7DvQb7afEPRDoAhltmJD8qcavQNRjJLbmHNs+eYeK4dOL8IJQfu1ghTHpot7XRacUK1z4qoyxfCdssM8g==',key_name='tempest-keypair-865166921',keypairs=<?>,launch_index=0,launched_at=2023-11-14T09:47:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='46e65cdd021f4a3db7c9254bb6d98b46',ramdisk_id='',reservation_id='r-0oyrmh9m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-280196295',owner_user_name='tempest-ServerActionsTestOtherA-280196295-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T09:49:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c0c381a0f6124f1ca6ce85c057b9143a',uuid=be813b28-133f-416a-b2b5-dc0b9e4064b7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d9a42cb3-5297-4aaf-bf16-9e591cab2fdc", "address": "fa:16:3e:27:a8:b8", "network": {"id": "5dfc532f-3d5d-4342-b7f1-12c9c3992a54", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1457278473-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.17", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46e65cdd021f4a3db7c9254bb6d98b46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9a42cb3-52", "ovs_interfaceid": "d9a42cb3-5297-4aaf-bf16-9e591cab2fdc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 09:49:56 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-7dd57e30-92d4-41c9-af13-77ac442a957a tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Converting VIF {"id": "d9a42cb3-5297-4aaf-bf16-9e591cab2fdc", "address": "fa:16:3e:27:a8:b8", "network": {"id": "5dfc532f-3d5d-4342-b7f1-12c9c3992a54", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1457278473-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.17", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46e65cdd021f4a3db7c9254bb6d98b46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9a42cb3-52", "ovs_interfaceid": "d9a42cb3-5297-4aaf-bf16-9e591cab2fdc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 09:49:56 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-7dd57e30-92d4-41c9-af13-77ac442a957a tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:27:a8:b8,bridge_name='br-int',has_traffic_filtering=True,id=d9a42cb3-5297-4aaf-bf16-9e591cab2fdc,network=Network(5dfc532f-3d5d-4342-b7f1-12c9c3992a54),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9a42cb3-52') {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 09:49:56 user nova-compute[75229]: DEBUG os_vif [None req-7dd57e30-92d4-41c9-af13-77ac442a957a tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:27:a8:b8,bridge_name='br-int',has_traffic_filtering=True,id=d9a42cb3-5297-4aaf-bf16-9e591cab2fdc,network=Network(5dfc532f-3d5d-4342-b7f1-12c9c3992a54),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9a42cb3-52') {{(pid=75229) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 09:49:56 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:49:56 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:49:56 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 09:49:56 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:49:56 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '68779a89-3436-56cb-af29-e347c566d472', '_type': 'linux-noop'}}, row=False) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:49:56 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:49:56 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 09:49:56 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:49:56 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd9a42cb3-52, may_exist=True, interface_attrs={}) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:49:56 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd9a42cb3-52, col_values=(('qos', UUID('6225e968-cf93-4038-b466-e8e1e7ec7e9a')),), if_exists=True) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:49:56 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd9a42cb3-52, col_values=(('external_ids', {'iface-id': 'd9a42cb3-5297-4aaf-bf16-9e591cab2fdc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:27:a8:b8', 'vm-uuid': 'be813b28-133f-416a-b2b5-dc0b9e4064b7'}),), if_exists=True) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:49:56 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:49:56 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 09:49:56 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:49:56 user nova-compute[75229]: INFO os_vif [None req-7dd57e30-92d4-41c9-af13-77ac442a957a tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:27:a8:b8,bridge_name='br-int',has_traffic_filtering=True,id=d9a42cb3-5297-4aaf-bf16-9e591cab2fdc,network=Network(5dfc532f-3d5d-4342-b7f1-12c9c3992a54),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9a42cb3-52')
Nov 14 09:49:56 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-7dd57e30-92d4-41c9-af13-77ac442a957a tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] No BDM found with device name vda, not building metadata. {{(pid=75229) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 09:49:56 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-7dd57e30-92d4-41c9-af13-77ac442a957a tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75229) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 09:49:56 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-7dd57e30-92d4-41c9-af13-77ac442a957a tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] No VIF found with MAC fa:16:3e:27:a8:b8, not building metadata {{(pid=75229) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 09:49:56 user nova-compute[75229]: DEBUG nova.compute.provider_tree [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Inventory has not changed in ProviderTree for provider: d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 {{(pid=75229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 09:49:56 user nova-compute[75229]: DEBUG nova.scheduler.client.report [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Inventory has not changed for provider d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 09:49:56 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Compute_service record updated for user:user {{(pid=75229) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 09:49:56 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.807s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:49:56 user nova-compute[75229]: DEBUG nova.compute.manager [req-7abb69ea-91ba-45a9-b2d5-a8a24559d45a req-c30887ef-f59f-4aa0-bc86-527a7ef87574 service nova] [instance: d6e2d77b-9894-4afa-8fa1-13a2842ba9a7] Received event network-changed-05d6e94a-7444-4671-b2e8-b997c37965ea {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:49:56 user nova-compute[75229]: DEBUG nova.compute.manager [req-7abb69ea-91ba-45a9-b2d5-a8a24559d45a req-c30887ef-f59f-4aa0-bc86-527a7ef87574 service nova] [instance: d6e2d77b-9894-4afa-8fa1-13a2842ba9a7] Refreshing instance network info cache due to event network-changed-05d6e94a-7444-4671-b2e8-b997c37965ea. {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 09:49:56 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-7abb69ea-91ba-45a9-b2d5-a8a24559d45a req-c30887ef-f59f-4aa0-bc86-527a7ef87574 service nova] Acquiring lock "refresh_cache-d6e2d77b-9894-4afa-8fa1-13a2842ba9a7" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 09:49:56 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-7abb69ea-91ba-45a9-b2d5-a8a24559d45a req-c30887ef-f59f-4aa0-bc86-527a7ef87574 service nova] Acquired lock "refresh_cache-d6e2d77b-9894-4afa-8fa1-13a2842ba9a7" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 09:49:56 user nova-compute[75229]: DEBUG nova.network.neutron [req-7abb69ea-91ba-45a9-b2d5-a8a24559d45a req-c30887ef-f59f-4aa0-bc86-527a7ef87574 service nova] [instance: d6e2d77b-9894-4afa-8fa1-13a2842ba9a7] Refreshing network info cache for port 05d6e94a-7444-4671-b2e8-b997c37965ea {{(pid=75229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 09:49:56 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 09:49:56 user nova-compute[75229]: DEBUG nova.compute.manager [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75229) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 14 09:49:56 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 09:49:56 user nova-compute[75229]: DEBUG nova.network.neutron [None req-fd748a0e-4bf3-442b-8b83-34a017396e4a tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] [instance: a60d339f-e134-477c-8505-bf8c79d2a21c] Updating instance_info_cache with network_info: [{"id": "cb98fc47-7b69-4bde-9a4c-717cd44ba908", "address": "fa:16:3e:6c:f4:6d", "network": {"id": "2b667d50-4579-4453-b4d3-a818a0d2c6fc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1719812180-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.24", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32e17c7c586542139cdbc5bfda57e075", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb98fc47-7b", "ovs_interfaceid": "cb98fc47-7b69-4bde-9a4c-717cd44ba908", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 09:49:56 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-86f8158b-6067-4b4e-b943-9300794cadb6 tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] Acquiring lock "d6e2d77b-9894-4afa-8fa1-13a2842ba9a7" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:49:56 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-86f8158b-6067-4b4e-b943-9300794cadb6 tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] Lock "d6e2d77b-9894-4afa-8fa1-13a2842ba9a7" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:49:57 user nova-compute[75229]: DEBUG nova.objects.instance [None req-86f8158b-6067-4b4e-b943-9300794cadb6 tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] Lazy-loading 'flavor' on Instance uuid d6e2d77b-9894-4afa-8fa1-13a2842ba9a7 {{(pid=75229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 09:49:57 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-86f8158b-6067-4b4e-b943-9300794cadb6 tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] [instance: d6e2d77b-9894-4afa-8fa1-13a2842ba9a7] Ignoring supplied device name: /dev/vdb
Nov 14 09:49:57 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-fd748a0e-4bf3-442b-8b83-34a017396e4a tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] Releasing lock "refresh_cache-a60d339f-e134-477c-8505-bf8c79d2a21c" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 09:49:57 user nova-compute[75229]: DEBUG os_brick.utils [None req-fd748a0e-4bf3-442b-8b83-34a017396e4a tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 09:49:57 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:49:57 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-86f8158b-6067-4b4e-b943-9300794cadb6 tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] Lock "d6e2d77b-9894-4afa-8fa1-13a2842ba9a7" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.231s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:49:57 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:49:57 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[6da607a1-8b79-4b29-8e7d-b91dc7b46f23]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f1154031c835\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:49:57 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:49:57 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:49:57 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b0d4a77-249c-4183-b6cd-f0ef8b525679]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:49:57 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:49:57 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:49:57 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab6f59ec-681e-4fb2-8ab7-d58a9143d79b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:49:57 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[40db2368-06dd-4755-9bd6-25247f7f4745]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:49:57 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-fd748a0e-4bf3-442b-8b83-34a017396e4a tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] Running cmd (subprocess): nvme version {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:49:57 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-fd748a0e-4bf3-442b-8b83-34a017396e4a tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] 'nvme version' failed. Not Retrying. {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 09:49:57 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fd748a0e-4bf3-442b-8b83-34a017396e4a tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] nvme not present on system {{(pid=75229) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 09:49:57 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:49:57 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 09:49:57 user nova-compute[75229]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 09:49:57 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[ada36c99-86ce-4c0c-b896-bfb9e33e090b]: (4, '') {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:49:57 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.lightos [None req-fd748a0e-4bf3-442b-8b83-34a017396e4a tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75229) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 09:49:57 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.lightos [None req-fd748a0e-4bf3-442b-8b83-34a017396e4a tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75229) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 09:49:57 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.lightos [None req-fd748a0e-4bf3-442b-8b83-34a017396e4a tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] LIGHTOS: no hostnqn found. {{(pid=75229) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 09:49:57 user nova-compute[75229]: DEBUG os_brick.utils [None req-fd748a0e-4bf3-442b-8b83-34a017396e4a tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f1154031c835', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 09:49:57 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-86f8158b-6067-4b4e-b943-9300794cadb6 tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] Acquiring lock "d6e2d77b-9894-4afa-8fa1-13a2842ba9a7" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:49:57 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-86f8158b-6067-4b4e-b943-9300794cadb6 tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] Lock "d6e2d77b-9894-4afa-8fa1-13a2842ba9a7" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:49:57 user nova-compute[75229]: INFO nova.compute.manager [None req-86f8158b-6067-4b4e-b943-9300794cadb6 tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] [instance: d6e2d77b-9894-4afa-8fa1-13a2842ba9a7] Attaching volume 1a3c64c6-8528-4707-a0c0-68a0649277a0 to /dev/vdb
Nov 14 09:49:57 user nova-compute[75229]: DEBUG nova.network.neutron [req-7abb69ea-91ba-45a9-b2d5-a8a24559d45a req-c30887ef-f59f-4aa0-bc86-527a7ef87574 service nova] [instance: d6e2d77b-9894-4afa-8fa1-13a2842ba9a7] Updated VIF entry in instance network info cache for port 05d6e94a-7444-4671-b2e8-b997c37965ea. {{(pid=75229) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 09:49:57 user nova-compute[75229]: DEBUG nova.network.neutron [req-7abb69ea-91ba-45a9-b2d5-a8a24559d45a req-c30887ef-f59f-4aa0-bc86-527a7ef87574 service nova] [instance: d6e2d77b-9894-4afa-8fa1-13a2842ba9a7] Updating instance_info_cache with network_info: [{"id": "05d6e94a-7444-4671-b2e8-b997c37965ea", "address": "fa:16:3e:a0:ae:e3", "network": {"id": "4bc624aa-efaf-45a9-b889-84d4bf2953b4", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-271284704-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.109", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d2e9dceab8a45eaa3adb619433b7cf0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05d6e94a-74", "ovs_interfaceid": "05d6e94a-7444-4671-b2e8-b997c37965ea", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 09:49:57 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-7abb69ea-91ba-45a9-b2d5-a8a24559d45a req-c30887ef-f59f-4aa0-bc86-527a7ef87574 service nova] Releasing lock "refresh_cache-d6e2d77b-9894-4afa-8fa1-13a2842ba9a7" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 09:49:57 user nova-compute[75229]: DEBUG os_brick.utils [None req-86f8158b-6067-4b4e-b943-9300794cadb6 tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 09:49:57 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:49:57 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:49:57 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[d81d2b2d-7c4c-47a2-9961-91715733bb4a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f1154031c835\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:49:57 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:49:57 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:49:57 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b703e26-680e-4194-8398-42700a0197e4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:49:57 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:49:57 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:49:57 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee7efaaf-a797-4c50-af17-c6920fe05d95]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:49:57 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dc5b637-ccfd-40d9-9158-5ccb8871039f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:49:57 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-86f8158b-6067-4b4e-b943-9300794cadb6 tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] Running cmd (subprocess): nvme version {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:49:57 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-86f8158b-6067-4b4e-b943-9300794cadb6 tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] 'nvme version' failed. Not Retrying. {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 09:49:57 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.nvmeof [None req-86f8158b-6067-4b4e-b943-9300794cadb6 tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] nvme not present on system {{(pid=75229) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 09:49:57 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:49:57 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 09:49:57 user nova-compute[75229]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 09:49:57 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dbc506e-eb1f-4e75-9047-cba38839b5ab]: (4, '') {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:49:57 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.lightos [None req-86f8158b-6067-4b4e-b943-9300794cadb6 tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75229) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 09:49:57 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.lightos [None req-86f8158b-6067-4b4e-b943-9300794cadb6 tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75229) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 09:49:57 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.lightos [None req-86f8158b-6067-4b4e-b943-9300794cadb6 tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] LIGHTOS: no hostnqn found. {{(pid=75229) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 09:49:57 user nova-compute[75229]: DEBUG os_brick.utils [None req-86f8158b-6067-4b4e-b943-9300794cadb6 tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f1154031c835', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 09:49:57 user nova-compute[75229]: DEBUG nova.virt.block_device [None req-86f8158b-6067-4b4e-b943-9300794cadb6 tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] [instance: d6e2d77b-9894-4afa-8fa1-13a2842ba9a7] Updating existing volume attachment record: 10f5ce3c-f1f0-4859-ac22-b09cf441ce76 {{(pid=75229) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 09:49:58 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:49:58 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:49:58 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:49:58 user nova-compute[75229]: DEBUG nova.compute.manager [req-a684db78-6586-4039-8a9e-59661c3b518f req-6627bea1-b0f5-4c85-8374-ad4f3afc0357 service nova] [instance: be813b28-133f-416a-b2b5-dc0b9e4064b7] Received event network-vif-plugged-d9a42cb3-5297-4aaf-bf16-9e591cab2fdc {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:49:58 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-a684db78-6586-4039-8a9e-59661c3b518f req-6627bea1-b0f5-4c85-8374-ad4f3afc0357 service nova] Acquiring lock "be813b28-133f-416a-b2b5-dc0b9e4064b7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:49:58 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-a684db78-6586-4039-8a9e-59661c3b518f req-6627bea1-b0f5-4c85-8374-ad4f3afc0357 service nova] Lock "be813b28-133f-416a-b2b5-dc0b9e4064b7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:49:58 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-a684db78-6586-4039-8a9e-59661c3b518f req-6627bea1-b0f5-4c85-8374-ad4f3afc0357 service nova] Lock "be813b28-133f-416a-b2b5-dc0b9e4064b7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:49:58 user nova-compute[75229]: DEBUG nova.compute.manager [req-a684db78-6586-4039-8a9e-59661c3b518f req-6627bea1-b0f5-4c85-8374-ad4f3afc0357 service nova] [instance: be813b28-133f-416a-b2b5-dc0b9e4064b7] No waiting events found dispatching network-vif-plugged-d9a42cb3-5297-4aaf-bf16-9e591cab2fdc {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 09:49:58 user nova-compute[75229]: WARNING nova.compute.manager [req-a684db78-6586-4039-8a9e-59661c3b518f req-6627bea1-b0f5-4c85-8374-ad4f3afc0357 service nova] [instance: be813b28-133f-416a-b2b5-dc0b9e4064b7] Received unexpected event network-vif-plugged-d9a42cb3-5297-4aaf-bf16-9e591cab2fdc for instance with vm_state active and task_state rebuild_spawning.
Nov 14 09:49:58 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:49:58 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:49:58 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 09:49:58 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 09:49:58 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 09:49:58 user nova-compute[75229]: DEBUG nova.compute.manager [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Starting heal instance info cache {{(pid=75229) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 09:49:58 user nova-compute[75229]: DEBUG nova.compute.manager [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Didn't find any instances for network info cache update. {{(pid=75229) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 14 09:49:58 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 09:49:58 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 09:49:58 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 09:49:58 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 09:49:58 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 09:49:58 user nova-compute[75229]: DEBUG nova.compute.manager [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75229) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 09:50:00 user nova-compute[75229]: DEBUG nova.compute.manager [req-99f75414-bbfa-499d-8c24-7dde628aa197 req-9d89399c-b92e-4859-9e5f-d9fd736616ef service nova] [instance: be813b28-133f-416a-b2b5-dc0b9e4064b7] Received event network-vif-plugged-d9a42cb3-5297-4aaf-bf16-9e591cab2fdc {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:50:00 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-99f75414-bbfa-499d-8c24-7dde628aa197 req-9d89399c-b92e-4859-9e5f-d9fd736616ef service nova] Acquiring lock "be813b28-133f-416a-b2b5-dc0b9e4064b7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:50:00 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-99f75414-bbfa-499d-8c24-7dde628aa197 req-9d89399c-b92e-4859-9e5f-d9fd736616ef service nova] Lock "be813b28-133f-416a-b2b5-dc0b9e4064b7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:50:00 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-99f75414-bbfa-499d-8c24-7dde628aa197 req-9d89399c-b92e-4859-9e5f-d9fd736616ef service nova] Lock "be813b28-133f-416a-b2b5-dc0b9e4064b7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:50:00 user nova-compute[75229]: DEBUG nova.compute.manager [req-99f75414-bbfa-499d-8c24-7dde628aa197 req-9d89399c-b92e-4859-9e5f-d9fd736616ef service nova] [instance: be813b28-133f-416a-b2b5-dc0b9e4064b7] No waiting events found dispatching network-vif-plugged-d9a42cb3-5297-4aaf-bf16-9e591cab2fdc {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 09:50:00 user nova-compute[75229]: WARNING nova.compute.manager [req-99f75414-bbfa-499d-8c24-7dde628aa197 req-9d89399c-b92e-4859-9e5f-d9fd736616ef service nova] [instance: be813b28-133f-416a-b2b5-dc0b9e4064b7] Received unexpected event network-vif-plugged-d9a42cb3-5297-4aaf-bf16-9e591cab2fdc for instance with vm_state active and task_state rebuild_spawning.
Nov 14 09:50:00 user nova-compute[75229]: DEBUG nova.compute.manager [req-99f75414-bbfa-499d-8c24-7dde628aa197 req-9d89399c-b92e-4859-9e5f-d9fd736616ef service nova] [instance: 4255af28-a111-4475-b207-67e335fd0835] Received event network-changed-8d218cec-b5d6-46ed-94be-4802fcdd0388 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:50:00 user nova-compute[75229]: DEBUG nova.compute.manager [req-99f75414-bbfa-499d-8c24-7dde628aa197 req-9d89399c-b92e-4859-9e5f-d9fd736616ef service nova] [instance: 4255af28-a111-4475-b207-67e335fd0835] Refreshing instance network info cache due to event network-changed-8d218cec-b5d6-46ed-94be-4802fcdd0388. {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 09:50:00 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-99f75414-bbfa-499d-8c24-7dde628aa197 req-9d89399c-b92e-4859-9e5f-d9fd736616ef service nova] Acquiring lock "refresh_cache-4255af28-a111-4475-b207-67e335fd0835" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 09:50:00 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-99f75414-bbfa-499d-8c24-7dde628aa197 req-9d89399c-b92e-4859-9e5f-d9fd736616ef service nova] Acquired lock "refresh_cache-4255af28-a111-4475-b207-67e335fd0835" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 09:50:00 user nova-compute[75229]: DEBUG nova.network.neutron [req-99f75414-bbfa-499d-8c24-7dde628aa197 req-9d89399c-b92e-4859-9e5f-d9fd736616ef service nova] [instance: 4255af28-a111-4475-b207-67e335fd0835] Refreshing network info cache for port 8d218cec-b5d6-46ed-94be-4802fcdd0388 {{(pid=75229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 09:50:00 user nova-compute[75229]: DEBUG nova.compute.manager [None req-7dd57e30-92d4-41c9-af13-77ac442a957a tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] [instance: be813b28-133f-416a-b2b5-dc0b9e4064b7] Instance event wait completed in 0 seconds for  {{(pid=75229) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 09:50:00 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-7dd57e30-92d4-41c9-af13-77ac442a957a tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] [instance: be813b28-133f-416a-b2b5-dc0b9e4064b7] Guest created on hypervisor {{(pid=75229) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 09:50:00 user nova-compute[75229]: INFO nova.virt.libvirt.driver [-] [instance: be813b28-133f-416a-b2b5-dc0b9e4064b7] Instance spawned successfully.
Nov 14 09:50:00 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-7dd57e30-92d4-41c9-af13-77ac442a957a tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] [instance: be813b28-133f-416a-b2b5-dc0b9e4064b7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 09:50:00 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-7dd57e30-92d4-41c9-af13-77ac442a957a tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] [instance: be813b28-133f-416a-b2b5-dc0b9e4064b7] Found default for hw_cdrom_bus of ide {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 09:50:00 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-7dd57e30-92d4-41c9-af13-77ac442a957a tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] [instance: be813b28-133f-416a-b2b5-dc0b9e4064b7] Found default for hw_disk_bus of virtio {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 09:50:00 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-7dd57e30-92d4-41c9-af13-77ac442a957a tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] [instance: be813b28-133f-416a-b2b5-dc0b9e4064b7] Found default for hw_input_bus of None {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 09:50:00 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-7dd57e30-92d4-41c9-af13-77ac442a957a tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] [instance: be813b28-133f-416a-b2b5-dc0b9e4064b7] Found default for hw_pointer_model of None {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 09:50:00 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-7dd57e30-92d4-41c9-af13-77ac442a957a tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] [instance: be813b28-133f-416a-b2b5-dc0b9e4064b7] Found default for hw_video_model of virtio {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 09:50:00 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-7dd57e30-92d4-41c9-af13-77ac442a957a tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] [instance: be813b28-133f-416a-b2b5-dc0b9e4064b7] Found default for hw_vif_model of virtio {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 09:50:00 user nova-compute[75229]: DEBUG nova.compute.manager [None req-7dd57e30-92d4-41c9-af13-77ac442a957a tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] [instance: be813b28-133f-416a-b2b5-dc0b9e4064b7] Checking state {{(pid=75229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 09:50:01 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-7dd57e30-92d4-41c9-af13-77ac442a957a tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:50:01 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-7dd57e30-92d4-41c9-af13-77ac442a957a tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:50:01 user nova-compute[75229]: DEBUG nova.objects.instance [None req-7dd57e30-92d4-41c9-af13-77ac442a957a tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] [instance: be813b28-133f-416a-b2b5-dc0b9e4064b7] Trying to apply a migration context that does not seem to be set for this instance {{(pid=75229) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Nov 14 09:50:01 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-7dd57e30-92d4-41c9-af13-77ac442a957a tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.109s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:50:01 user nova-compute[75229]: DEBUG nova.network.neutron [req-99f75414-bbfa-499d-8c24-7dde628aa197 req-9d89399c-b92e-4859-9e5f-d9fd736616ef service nova] [instance: 4255af28-a111-4475-b207-67e335fd0835] Updated VIF entry in instance network info cache for port 8d218cec-b5d6-46ed-94be-4802fcdd0388. {{(pid=75229) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 09:50:01 user nova-compute[75229]: DEBUG nova.network.neutron [req-99f75414-bbfa-499d-8c24-7dde628aa197 req-9d89399c-b92e-4859-9e5f-d9fd736616ef service nova] [instance: 4255af28-a111-4475-b207-67e335fd0835] Updating instance_info_cache with network_info: [{"id": "8d218cec-b5d6-46ed-94be-4802fcdd0388", "address": "fa:16:3e:3d:eb:0f", "network": {"id": "bd407caa-6ef6-400d-9327-3179dc1d8da4", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-29933774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.175", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b8d48c38c7344f5b12d0ed5b9392554", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d218cec-b5", "ovs_interfaceid": "8d218cec-b5d6-46ed-94be-4802fcdd0388", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 09:50:01 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-99f75414-bbfa-499d-8c24-7dde628aa197 req-9d89399c-b92e-4859-9e5f-d9fd736616ef service nova] Releasing lock "refresh_cache-4255af28-a111-4475-b207-67e335fd0835" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 09:50:01 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:50:02 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-fd748a0e-4bf3-442b-8b83-34a017396e4a tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] [instance: a60d339f-e134-477c-8505-bf8c79d2a21c] Starting finish_revert_migration {{(pid=75229) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11819}}
Nov 14 09:50:03 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-fd748a0e-4bf3-442b-8b83-34a017396e4a tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] [instance: a60d339f-e134-477c-8505-bf8c79d2a21c] Start _get_guest_xml network_info=[{"id": "cb98fc47-7b69-4bde-9a4c-717cd44ba908", "address": "fa:16:3e:6c:f4:6d", "network": {"id": "2b667d50-4579-4453-b4d3-a818a0d2c6fc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1719812180-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.24", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32e17c7c586542139cdbc5bfda57e075", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb98fc47-7b", "ovs_interfaceid": "cb98fc47-7b69-4bde-9a4c-717cd44ba908", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=3bef8470-ecc7-40e3-95d4-9254348ea72d,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'disk_bus': 'virtio', 'guest_format': None, 'encryption_secret_uuid': None, 'size': 0, 'device_type': 'disk', 'image_id': '3bef8470-ecc7-40e3-95d4-9254348ea72d'}], 'ephemerals': [], 'block_device_mapping': [{'boot_index': None, 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:aca09258-022b-4f04-b418-f2a170332755', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BrhyGdAv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': 'a60d339f-e134-477c-8505-bf8c79d2a21c', 'attached_at': '2023-11-14T09:50:03.000000', 'detached_at': '', 'volume_id': 'aca09258-022b-4f04-b418-f2a170332755', 'serial': 'aca09258-022b-4f04-b418-f2a170332755'}, 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'attachment_id': '1599333b-334d-4873-bdd2-d2b5f463eb68', 'guest_format': None, 'device_type': 'disk', 'volume_type': None} {{(pid=75229) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 09:50:03 user nova-compute[75229]: WARNING nova.virt.libvirt.driver [None req-fd748a0e-4bf3-442b-8b83-34a017396e4a tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 09:50:03 user nova-compute[75229]: WARNING nova.virt.libvirt.driver [None req-fd748a0e-4bf3-442b-8b83-34a017396e4a tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 09:50:03 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-fd748a0e-4bf3-442b-8b83-34a017396e4a tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75229) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 09:50:03 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-fd748a0e-4bf3-442b-8b83-34a017396e4a tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] CPU controller missing on host. {{(pid=75229) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 09:50:03 user nova-compute[75229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-86f8158b-6067-4b4e-b943-9300794cadb6 tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] [instance: d6e2d77b-9894-4afa-8fa1-13a2842ba9a7] Calling os-brick to attach iSCSI Volume {{(pid=75229) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 09:50:03 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-86f8158b-6067-4b4e-b943-9300794cadb6 tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f73f85151b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:1a3c64c6-8528-4707-a0c0-68a0649277a0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yJZDXugh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 09:50:03 user nova-compute[75229]: WARNING os_brick.initiator.connectors.base [None req-86f8158b-6067-4b4e-b943-9300794cadb6 tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 09:50:03 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-86f8158b-6067-4b4e-b943-9300794cadb6 tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 09:50:03 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-86f8158b-6067-4b4e-b943-9300794cadb6 tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 09:50:03 user nova-compute[75229]: WARNING os_brick.initiator.connectors.base [None req-86f8158b-6067-4b4e-b943-9300794cadb6 tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 09:50:03 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-86f8158b-6067-4b4e-b943-9300794cadb6 tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1a3c64c6-8528-4707-a0c0-68a0649277a0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 09:50:03 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-86f8158b-6067-4b4e-b943-9300794cadb6 tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1a3c64c6-8528-4707-a0c0-68a0649277a0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 09:50:03 user nova-compute[75229]: INFO os_brick.initiator.connectors.iscsi [None req-86f8158b-6067-4b4e-b943-9300794cadb6 tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 09:50:03 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a3c64c6-8528-4707-a0c0-68a0649277a0 -p 172.16.0.220:3260 {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:50:03 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-fd748a0e-4bf3-442b-8b83-34a017396e4a tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75229) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 09:50:03 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-fd748a0e-4bf3-442b-8b83-34a017396e4a tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] CPU controller found on host. {{(pid=75229) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 09:50:03 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-fd748a0e-4bf3-442b-8b83-34a017396e4a tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75229) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 09:50:03 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-fd748a0e-4bf3-442b-8b83-34a017396e4a tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T09:39:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=3bef8470-ecc7-40e3-95d4-9254348ea72d,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 09:50:03 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-fd748a0e-4bf3-442b-8b83-34a017396e4a tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] Flavor limits 0:0:0 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 09:50:03 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-fd748a0e-4bf3-442b-8b83-34a017396e4a tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] Image limits 0:0:0 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 09:50:03 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-fd748a0e-4bf3-442b-8b83-34a017396e4a tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] Flavor pref 0:0:0 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 09:50:03 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-fd748a0e-4bf3-442b-8b83-34a017396e4a tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] Image pref 0:0:0 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 09:50:03 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-fd748a0e-4bf3-442b-8b83-34a017396e4a tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 09:50:03 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-fd748a0e-4bf3-442b-8b83-34a017396e4a tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 09:50:03 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-fd748a0e-4bf3-442b-8b83-34a017396e4a tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75229) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 09:50:03 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-fd748a0e-4bf3-442b-8b83-34a017396e4a tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] Got 1 possible topologies {{(pid=75229) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 09:50:03 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-fd748a0e-4bf3-442b-8b83-34a017396e4a tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 09:50:03 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-fd748a0e-4bf3-442b-8b83-34a017396e4a tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 09:50:03 user nova-compute[75229]: DEBUG nova.objects.instance [None req-fd748a0e-4bf3-442b-8b83-34a017396e4a tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] Lazy-loading 'vcpu_model' on Instance uuid a60d339f-e134-477c-8505-bf8c79d2a21c {{(pid=75229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 09:50:03 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a3c64c6-8528-4707-a0c0-68a0649277a0 -p 172.16.0.220:3260" returned: 21 in 0.046s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:50:03 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4837013-7563-4984-8efe-9521a057fb1d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:50:03 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-86f8158b-6067-4b4e-b943-9300794cadb6 tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 09:50:03 user nova-compute[75229]:  {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:50:03 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a3c64c6-8528-4707-a0c0-68a0649277a0 -p 172.16.0.220:3260 --interface default --op new {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:50:03 user nova-compute[75229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fd748a0e-4bf3-442b-8b83-34a017396e4a tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] [instance: a60d339f-e134-477c-8505-bf8c79d2a21c] Calling os-brick to attach iSCSI Volume {{(pid=75229) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 09:50:03 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd748a0e-4bf3-442b-8b83-34a017396e4a tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f73f85151b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:aca09258-022b-4f04-b418-f2a170332755', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BrhyGdAv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 09:50:03 user nova-compute[75229]: WARNING os_brick.initiator.connectors.base [None req-fd748a0e-4bf3-442b-8b83-34a017396e4a tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 09:50:03 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-fd748a0e-4bf3-442b-8b83-34a017396e4a tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 09:50:03 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a3c64c6-8528-4707-a0c0-68a0649277a0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:50:03 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2eadad2-a6dd-4c7c-8980-06e66954be58]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1a3c64c6-8528-4707-a0c0-68a0649277a0] added\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:50:03 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-86f8158b-6067-4b4e-b943-9300794cadb6 tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1a3c64c6-8528-4707-a0c0-68a0649277a0] added
Nov 14 09:50:03 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:50:03 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a3c64c6-8528-4707-a0c0-68a0649277a0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:50:03 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a3c64c6-8528-4707-a0c0-68a0649277a0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.042s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:50:03 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[dde0f97e-39eb-496b-883c-22c9067a20d0]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:50:03 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-86f8158b-6067-4b4e-b943-9300794cadb6 tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:50:03 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a3c64c6-8528-4707-a0c0-68a0649277a0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:50:03 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:50:03 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a3c64c6-8528-4707-a0c0-68a0649277a0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.034s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:50:03 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[8122375d-8779-4aea-aa67-10df1d235335]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:50:03 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-86f8158b-6067-4b4e-b943-9300794cadb6 tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:50:03 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a3c64c6-8528-4707-a0c0-68a0649277a0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yJZDXugh {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:50:03 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a3c64c6-8528-4707-a0c0-68a0649277a0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yJZDXugh" returned: 0 in 0.020s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:50:03 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[81cfb322-1ed0-48a5-9f65-47b3d6c6cd2b]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:50:03 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-86f8158b-6067-4b4e-b943-9300794cadb6 tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'yJZDXugh'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:50:03 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a3c64c6-8528-4707-a0c0-68a0649277a0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:50:03 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a3c64c6-8528-4707-a0c0-68a0649277a0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:50:03 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdf185ba-0095-4205-a920-ef3e7aaf54a2]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:50:03 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-86f8158b-6067-4b4e-b943-9300794cadb6 tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:50:03 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:50:03 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:50:03 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc86b6f9-4715-4cde-a1e2-e60a4b159bf6]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fed285f-9be4-4601-8cb5-4329d7ebed8c (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7902ab8-168d-4c8a-90e9-bf44d669ce2b (non-flash)\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:50:03 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-86f8158b-6067-4b4e-b943-9300794cadb6 tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fed285f-9be4-4601-8cb5-4329d7ebed8c (non-flash)
Nov 14 09:50:03 user nova-compute[75229]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7902ab8-168d-4c8a-90e9-bf44d669ce2b (non-flash)
Nov 14 09:50:03 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 09:50:03 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-86f8158b-6067-4b4e-b943-9300794cadb6 tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fed285f-9be4-4601-8cb5-4329d7ebed8c (non-flash)
Nov 14 09:50:03 user nova-compute[75229]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7902ab8-168d-4c8a-90e9-bf44d669ce2b (non-flash)
Nov 14 09:50:03 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 09:50:03 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a3c64c6-8528-4707-a0c0-68a0649277a0 -p 172.16.0.220:3260 --login {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:50:03 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a3c64c6-8528-4707-a0c0-68a0649277a0 -p 172.16.0.220:3260 --login" returned: 0 in 0.072s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:50:03 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[56f02abd-3d78-40b3-93d1-773d2f95b49d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1a3c64c6-8528-4707-a0c0-68a0649277a0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1a3c64c6-8528-4707-a0c0-68a0649277a0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:50:03 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-86f8158b-6067-4b4e-b943-9300794cadb6 tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1a3c64c6-8528-4707-a0c0-68a0649277a0, portal: 172.16.0.220,3260]
Nov 14 09:50:03 user nova-compute[75229]: Login to [iface: default, target: iqn.2010-10.org.openstack:1a3c64c6-8528-4707-a0c0-68a0649277a0, portal: 172.16.0.220,3260] successful.
Nov 14 09:50:03 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:50:03 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a3c64c6-8528-4707-a0c0-68a0649277a0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:50:03 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a3c64c6-8528-4707-a0c0-68a0649277a0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:50:03 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[db0cb2c2-e96e-4682-b94e-188137749ad3]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:50:03 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-86f8158b-6067-4b4e-b943-9300794cadb6 tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:50:03 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:50:03 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.039s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:50:03 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e4a88d9-dac8-4330-bd7b-aa6678f0cb40]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fed285f-9be4-4601-8cb5-4329d7ebed8c (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7902ab8-168d-4c8a-90e9-bf44d669ce2b (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a3c64c6-8528-4707-a0c0-68a0649277a0 (non-flash)\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:50:03 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-86f8158b-6067-4b4e-b943-9300794cadb6 tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fed285f-9be4-4601-8cb5-4329d7ebed8c (non-flash)
Nov 14 09:50:03 user nova-compute[75229]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7902ab8-168d-4c8a-90e9-bf44d669ce2b (non-flash)
Nov 14 09:50:03 user nova-compute[75229]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a3c64c6-8528-4707-a0c0-68a0649277a0 (non-flash)
Nov 14 09:50:03 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 09:50:03 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-86f8158b-6067-4b4e-b943-9300794cadb6 tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fed285f-9be4-4601-8cb5-4329d7ebed8c (non-flash)
Nov 14 09:50:03 user nova-compute[75229]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7902ab8-168d-4c8a-90e9-bf44d669ce2b (non-flash)
Nov 14 09:50:03 user nova-compute[75229]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a3c64c6-8528-4707-a0c0-68a0649277a0 (non-flash)
Nov 14 09:50:03 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 09:50:03 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-86f8158b-6067-4b4e-b943-9300794cadb6 tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1a3c64c6-8528-4707-a0c0-68a0649277a0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.431s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 09:50:03 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-86f8158b-6067-4b4e-b943-9300794cadb6 tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] Connected to 172.16.0.220:3260 {{(pid=75229) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 09:50:03 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-86f8158b-6067-4b4e-b943-9300794cadb6 tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] HCTL ('34', '-', '-', 0) found on session 22 with lun 0 {{(pid=75229) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 09:50:03 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-86f8158b-6067-4b4e-b943-9300794cadb6 tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75229) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 09:50:03 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:50:03 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.020s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:50:03 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9511f74-aa7b-4c0c-a33a-3133d1c42227]: (4, ('- - 0', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:50:03 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-86f8158b-6067-4b4e-b943-9300794cadb6 tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] Searching for a device in session 22 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75229) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 09:50:03 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-86f8158b-6067-4b4e-b943-9300794cadb6 tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:1a3c64c6-8528-4707-a0c0-68a0649277a0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yJZDXugh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75229) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 09:50:03 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-79575969-ff51-4137-8d5d-a969902966c4 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Acquiring lock "4255af28-a111-4475-b207-67e335fd0835" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:50:03 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-79575969-ff51-4137-8d5d-a969902966c4 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Lock "4255af28-a111-4475-b207-67e335fd0835" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:50:03 user nova-compute[75229]: DEBUG nova.objects.instance [None req-79575969-ff51-4137-8d5d-a969902966c4 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Lazy-loading 'flavor' on Instance uuid 4255af28-a111-4475-b207-67e335fd0835 {{(pid=75229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 09:50:03 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-79575969-ff51-4137-8d5d-a969902966c4 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Lock "4255af28-a111-4475-b207-67e335fd0835" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.068s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:50:03 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-79575969-ff51-4137-8d5d-a969902966c4 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Acquiring lock "4255af28-a111-4475-b207-67e335fd0835" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:50:03 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-79575969-ff51-4137-8d5d-a969902966c4 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Lock "4255af28-a111-4475-b207-67e335fd0835" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:50:03 user nova-compute[75229]: INFO nova.compute.manager [None req-79575969-ff51-4137-8d5d-a969902966c4 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] [instance: 4255af28-a111-4475-b207-67e335fd0835] Attaching volume 2bae4836-52c2-428b-b299-a6a72899197d to /dev/vdb
Nov 14 09:50:04 user nova-compute[75229]: DEBUG os_brick.utils [None req-79575969-ff51-4137-8d5d-a969902966c4 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 09:50:04 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:50:04 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:50:04 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ca89b87-0651-4f89-ae41-78aff9f6845f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f1154031c835\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:50:04 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:50:04 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:50:04 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8550362-9631-40d1-b58d-38e0b0aa8c82]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:50:04 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:50:04 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:50:04 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[819d2d67-a881-45b1-9d1d-cc4ca3c0aa47]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:50:04 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[9530d6ea-8e14-423c-b8f5-54c0ed4471b8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:50:04 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-79575969-ff51-4137-8d5d-a969902966c4 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Running cmd (subprocess): nvme version {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:50:04 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-79575969-ff51-4137-8d5d-a969902966c4 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] 'nvme version' failed. Not Retrying. {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 09:50:04 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.nvmeof [None req-79575969-ff51-4137-8d5d-a969902966c4 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] nvme not present on system {{(pid=75229) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 09:50:04 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:50:04 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 09:50:04 user nova-compute[75229]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 09:50:04 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[9744f6c3-97d4-480f-bb0f-0ce6eced6dbd]: (4, '') {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:50:04 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.lightos [None req-79575969-ff51-4137-8d5d-a969902966c4 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75229) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 09:50:04 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.lightos [None req-79575969-ff51-4137-8d5d-a969902966c4 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75229) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 09:50:04 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.lightos [None req-79575969-ff51-4137-8d5d-a969902966c4 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] LIGHTOS: no hostnqn found. {{(pid=75229) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 09:50:04 user nova-compute[75229]: DEBUG os_brick.utils [None req-79575969-ff51-4137-8d5d-a969902966c4 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f1154031c835', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 09:50:04 user nova-compute[75229]: DEBUG nova.virt.block_device [None req-79575969-ff51-4137-8d5d-a969902966c4 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] [instance: 4255af28-a111-4475-b207-67e335fd0835] Updating existing volume attachment record: 767d9abc-990e-45c3-8acf-8bd194092574 {{(pid=75229) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 09:50:04 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-86f8158b-6067-4b4e-b943-9300794cadb6 tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.477s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 09:50:04 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-86f8158b-6067-4b4e-b943-9300794cadb6 tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] <== connect_volume: return (1481ms) {'type': 'block', 'scsi_wwn': '23034646634306665', 'path': '/dev/sdc'} {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 09:50:04 user nova-compute[75229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-86f8158b-6067-4b4e-b943-9300794cadb6 tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] [instance: d6e2d77b-9894-4afa-8fa1-13a2842ba9a7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23034646634306665', 'path': '/dev/sdc'} {{(pid=75229) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 09:50:04 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-fd748a0e-4bf3-442b-8b83-34a017396e4a tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.376s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 09:50:04 user nova-compute[75229]: WARNING os_brick.initiator.connectors.base [None req-fd748a0e-4bf3-442b-8b83-34a017396e4a tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 09:50:04 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-fd748a0e-4bf3-442b-8b83-34a017396e4a tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:aca09258-022b-4f04-b418-f2a170332755" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 09:50:04 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-fd748a0e-4bf3-442b-8b83-34a017396e4a tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:aca09258-022b-4f04-b418-f2a170332755" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 09:50:04 user nova-compute[75229]: INFO os_brick.initiator.connectors.iscsi [None req-fd748a0e-4bf3-442b-8b83-34a017396e4a tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 09:50:04 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aca09258-022b-4f04-b418-f2a170332755 -p 172.16.0.220:3260 {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:50:04 user nova-compute[75229]: DEBUG nova.objects.instance [None req-86f8158b-6067-4b4e-b943-9300794cadb6 tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] Lazy-loading 'flavor' on Instance uuid d6e2d77b-9894-4afa-8fa1-13a2842ba9a7 {{(pid=75229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 09:50:04 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aca09258-022b-4f04-b418-f2a170332755 -p 172.16.0.220:3260" returned: 21 in 0.029s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:50:04 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[708cae6c-1162-4350-8349-7a51fd670f99]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:50:04 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd748a0e-4bf3-442b-8b83-34a017396e4a tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 09:50:04 user nova-compute[75229]:  {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:50:04 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aca09258-022b-4f04-b418-f2a170332755 -p 172.16.0.220:3260 --interface default --op new {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:50:04 user nova-compute[75229]: DEBUG nova.virt.libvirt.guest [None req-86f8158b-6067-4b4e-b943-9300794cadb6 tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 09:50:04 user nova-compute[75229]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 09:50:04 user nova-compute[75229]:   <source dev="/dev/sdc"/>
Nov 14 09:50:04 user nova-compute[75229]:   <target dev="vdb" bus="virtio"/>
Nov 14 09:50:04 user nova-compute[75229]:   <serial>1a3c64c6-8528-4707-a0c0-68a0649277a0</serial>
Nov 14 09:50:04 user nova-compute[75229]: </disk>
Nov 14 09:50:04 user nova-compute[75229]:  {{(pid=75229) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 09:50:04 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aca09258-022b-4f04-b418-f2a170332755 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:50:04 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[74004f67-0c70-4497-a0a3-b7d5ca26aeaa]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:aca09258-022b-4f04-b418-f2a170332755] added\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:50:04 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd748a0e-4bf3-442b-8b83-34a017396e4a tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:aca09258-022b-4f04-b418-f2a170332755] added
Nov 14 09:50:04 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:50:04 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aca09258-022b-4f04-b418-f2a170332755 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:50:04 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aca09258-022b-4f04-b418-f2a170332755 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:50:04 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[5af9f2af-a3e7-49db-9789-cfb9a27347d7]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:50:04 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd748a0e-4bf3-442b-8b83-34a017396e4a tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:50:04 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aca09258-022b-4f04-b418-f2a170332755 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:50:04 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aca09258-022b-4f04-b418-f2a170332755 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:50:04 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[a08df08f-fbd0-4d3c-9954-8e2448d46f0d]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:50:04 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd748a0e-4bf3-442b-8b83-34a017396e4a tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:50:04 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aca09258-022b-4f04-b418-f2a170332755 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BrhyGdAv {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:50:04 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aca09258-022b-4f04-b418-f2a170332755 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BrhyGdAv" returned: 0 in 0.019s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:50:04 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[59d8a19c-c987-47d7-be52-d9d257ba652f]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:50:04 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd748a0e-4bf3-442b-8b83-34a017396e4a tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BrhyGdAv'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:50:04 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aca09258-022b-4f04-b418-f2a170332755 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:50:04 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aca09258-022b-4f04-b418-f2a170332755 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:50:04 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0d273c4-5cef-4f04-b1f6-e5f6ae409b36]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:50:04 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd748a0e-4bf3-442b-8b83-34a017396e4a tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:50:04 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:50:04 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:50:04 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[32d70390-87c1-447f-97e9-ce0db0b21d67]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fed285f-9be4-4601-8cb5-4329d7ebed8c (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7902ab8-168d-4c8a-90e9-bf44d669ce2b (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a3c64c6-8528-4707-a0c0-68a0649277a0 (non-flash)\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:50:04 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd748a0e-4bf3-442b-8b83-34a017396e4a tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fed285f-9be4-4601-8cb5-4329d7ebed8c (non-flash)
Nov 14 09:50:04 user nova-compute[75229]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7902ab8-168d-4c8a-90e9-bf44d669ce2b (non-flash)
Nov 14 09:50:04 user nova-compute[75229]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a3c64c6-8528-4707-a0c0-68a0649277a0 (non-flash)
Nov 14 09:50:04 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 09:50:04 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd748a0e-4bf3-442b-8b83-34a017396e4a tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fed285f-9be4-4601-8cb5-4329d7ebed8c (non-flash)
Nov 14 09:50:04 user nova-compute[75229]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7902ab8-168d-4c8a-90e9-bf44d669ce2b (non-flash)
Nov 14 09:50:04 user nova-compute[75229]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a3c64c6-8528-4707-a0c0-68a0649277a0 (non-flash)
Nov 14 09:50:04 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 09:50:04 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aca09258-022b-4f04-b418-f2a170332755 -p 172.16.0.220:3260 --login {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:50:04 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aca09258-022b-4f04-b418-f2a170332755 -p 172.16.0.220:3260 --login" returned: 0 in 0.087s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:50:04 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[837b2e01-6fb5-472a-b563-ec38a2b454ba]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:aca09258-022b-4f04-b418-f2a170332755, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:aca09258-022b-4f04-b418-f2a170332755, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:50:04 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd748a0e-4bf3-442b-8b83-34a017396e4a tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:aca09258-022b-4f04-b418-f2a170332755, portal: 172.16.0.220,3260]
Nov 14 09:50:04 user nova-compute[75229]: Login to [iface: default, target: iqn.2010-10.org.openstack:aca09258-022b-4f04-b418-f2a170332755, portal: 172.16.0.220,3260] successful.
Nov 14 09:50:04 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:50:04 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aca09258-022b-4f04-b418-f2a170332755 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:50:04 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aca09258-022b-4f04-b418-f2a170332755 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.033s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:50:04 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[a50cc8c7-74f8-41f1-a28a-4ea2e31e57f1]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:50:04 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd748a0e-4bf3-442b-8b83-34a017396e4a tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:50:04 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:50:04 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:50:04 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[13f88853-8579-4745-b91e-d9ab361e4113]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fed285f-9be4-4601-8cb5-4329d7ebed8c (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7902ab8-168d-4c8a-90e9-bf44d669ce2b (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a3c64c6-8528-4707-a0c0-68a0649277a0 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aca09258-022b-4f04-b418-f2a170332755 (non-flash)\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:50:04 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd748a0e-4bf3-442b-8b83-34a017396e4a tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fed285f-9be4-4601-8cb5-4329d7ebed8c (non-flash)
Nov 14 09:50:04 user nova-compute[75229]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7902ab8-168d-4c8a-90e9-bf44d669ce2b (non-flash)
Nov 14 09:50:04 user nova-compute[75229]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a3c64c6-8528-4707-a0c0-68a0649277a0 (non-flash)
Nov 14 09:50:04 user nova-compute[75229]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aca09258-022b-4f04-b418-f2a170332755 (non-flash)
Nov 14 09:50:04 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 09:50:04 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd748a0e-4bf3-442b-8b83-34a017396e4a tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fed285f-9be4-4601-8cb5-4329d7ebed8c (non-flash)
Nov 14 09:50:04 user nova-compute[75229]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7902ab8-168d-4c8a-90e9-bf44d669ce2b (non-flash)
Nov 14 09:50:04 user nova-compute[75229]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a3c64c6-8528-4707-a0c0-68a0649277a0 (non-flash)
Nov 14 09:50:04 user nova-compute[75229]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aca09258-022b-4f04-b418-f2a170332755 (non-flash)
Nov 14 09:50:04 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 09:50:04 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-fd748a0e-4bf3-442b-8b83-34a017396e4a tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:aca09258-022b-4f04-b418-f2a170332755" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.360s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 09:50:04 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd748a0e-4bf3-442b-8b83-34a017396e4a tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] Connected to 172.16.0.220:3260 {{(pid=75229) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 09:50:04 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-fd748a0e-4bf3-442b-8b83-34a017396e4a tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] HCTL ('35', '-', '-', 0) found on session 23 with lun 0 {{(pid=75229) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 09:50:04 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-fd748a0e-4bf3-442b-8b83-34a017396e4a tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75229) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 09:50:04 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:50:04 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.020s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:50:04 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[94b4698b-eb8a-4d99-a8d6-319433a092ec]: (4, ('- - 0', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:50:04 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-fd748a0e-4bf3-442b-8b83-34a017396e4a tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] Searching for a device in session 23 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75229) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 09:50:04 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd748a0e-4bf3-442b-8b83-34a017396e4a tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:aca09258-022b-4f04-b418-f2a170332755', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BrhyGdAv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75229) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 09:50:05 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-86f8158b-6067-4b4e-b943-9300794cadb6 tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] No BDM found with device name vda, not building metadata. {{(pid=75229) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 09:50:05 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-86f8158b-6067-4b4e-b943-9300794cadb6 tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75229) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 09:50:05 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-86f8158b-6067-4b4e-b943-9300794cadb6 tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] No VIF found with MAC fa:16:3e:a0:ae:e3, not building metadata {{(pid=75229) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 09:50:05 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-86f8158b-6067-4b4e-b943-9300794cadb6 tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] Lock "d6e2d77b-9894-4afa-8fa1-13a2842ba9a7" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.069s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:50:05 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-fd748a0e-4bf3-442b-8b83-34a017396e4a tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.397s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 09:50:05 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd748a0e-4bf3-442b-8b83-34a017396e4a tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] <== connect_volume: return (2773ms) {'type': 'block', 'scsi_wwn': '23266303965393733', 'path': '/dev/sdd'} {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 09:50:05 user nova-compute[75229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fd748a0e-4bf3-442b-8b83-34a017396e4a tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] [instance: a60d339f-e134-477c-8505-bf8c79d2a21c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23266303965393733', 'path': '/dev/sdd'} {{(pid=75229) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 09:50:05 user nova-compute[75229]: DEBUG nova.virt.libvirt.vif [None req-fd748a0e-4bf3-442b-8b83-34a017396e4a tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T09:43:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-285833760',display_name='tempest-ServerActionsTestOtherB-server-285833760',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-285833760',id=5,image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLBqRiXBmoqcQBqBQflJnJ0Bni+p+JlFtve2BlM0X9wLvjWsKzu7TCQo3Ot5hzNFvzwCz/gEUspFHpyxxEkScMIm/fUvYWhxYR4DsojCDDatjjGg5V63rlfYUre+iymhFw==',key_name='tempest-keypair-1362974744',keypairs=<?>,launch_index=0,launched_at=2023-11-14T09:48:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='32e17c7c586542139cdbc5bfda57e075',ramdisk_id='',reservation_id='r-vw8kxtrn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-45710955',owner_user_name='tempest-ServerActionsTestOtherB-45710955-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T09:49:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='39c6903e2d154e838835eb5265776521',uuid=a60d339f-e134-477c-8505-bf8c79d2a21c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "cb98fc47-7b69-4bde-9a4c-717cd44ba908", "address": "fa:16:3e:6c:f4:6d", "network": {"id": "2b667d50-4579-4453-b4d3-a818a0d2c6fc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1719812180-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.24", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32e17c7c586542139cdbc5bfda57e075", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb98fc47-7b", "ovs_interfaceid": "cb98fc47-7b69-4bde-9a4c-717cd44ba908", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75229) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 09:50:05 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-fd748a0e-4bf3-442b-8b83-34a017396e4a tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] Converting VIF {"id": "cb98fc47-7b69-4bde-9a4c-717cd44ba908", "address": "fa:16:3e:6c:f4:6d", "network": {"id": "2b667d50-4579-4453-b4d3-a818a0d2c6fc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1719812180-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.24", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32e17c7c586542139cdbc5bfda57e075", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb98fc47-7b", "ovs_interfaceid": "cb98fc47-7b69-4bde-9a4c-717cd44ba908", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 09:50:05 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-fd748a0e-4bf3-442b-8b83-34a017396e4a tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6c:f4:6d,bridge_name='br-int',has_traffic_filtering=True,id=cb98fc47-7b69-4bde-9a4c-717cd44ba908,network=Network(2b667d50-4579-4453-b4d3-a818a0d2c6fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb98fc47-7b') {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 09:50:05 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-fd748a0e-4bf3-442b-8b83-34a017396e4a tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] [instance: a60d339f-e134-477c-8505-bf8c79d2a21c] End _get_guest_xml xml=<domain type="kvm">
Nov 14 09:50:05 user nova-compute[75229]:   <uuid>a60d339f-e134-477c-8505-bf8c79d2a21c</uuid>
Nov 14 09:50:05 user nova-compute[75229]:   <name>instance-00000005</name>
Nov 14 09:50:05 user nova-compute[75229]:   <memory>524288</memory>
Nov 14 09:50:05 user nova-compute[75229]:   <vcpu>1</vcpu>
Nov 14 09:50:05 user nova-compute[75229]:   <metadata>
Nov 14 09:50:05 user nova-compute[75229]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 09:50:05 user nova-compute[75229]:       <nova:package version="0.0.0"/>
Nov 14 09:50:05 user nova-compute[75229]:       <nova:name>tempest-ServerActionsTestOtherB-server-285833760</nova:name>
Nov 14 09:50:05 user nova-compute[75229]:       <nova:creationTime>2023-11-14 09:50:03</nova:creationTime>
Nov 14 09:50:05 user nova-compute[75229]:       <nova:flavor name="m1.tiny">
Nov 14 09:50:05 user nova-compute[75229]:         <nova:memory>512</nova:memory>
Nov 14 09:50:05 user nova-compute[75229]:         <nova:disk>1</nova:disk>
Nov 14 09:50:05 user nova-compute[75229]:         <nova:swap>0</nova:swap>
Nov 14 09:50:05 user nova-compute[75229]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 09:50:05 user nova-compute[75229]:         <nova:vcpus>1</nova:vcpus>
Nov 14 09:50:05 user nova-compute[75229]:       </nova:flavor>
Nov 14 09:50:05 user nova-compute[75229]:       <nova:owner>
Nov 14 09:50:05 user nova-compute[75229]:         <nova:user uuid="39c6903e2d154e838835eb5265776521">tempest-ServerActionsTestOtherB-45710955-project-member</nova:user>
Nov 14 09:50:05 user nova-compute[75229]:         <nova:project uuid="32e17c7c586542139cdbc5bfda57e075">tempest-ServerActionsTestOtherB-45710955</nova:project>
Nov 14 09:50:05 user nova-compute[75229]:       </nova:owner>
Nov 14 09:50:05 user nova-compute[75229]:       <nova:root type="image" uuid="3bef8470-ecc7-40e3-95d4-9254348ea72d"/>
Nov 14 09:50:05 user nova-compute[75229]:       <nova:ports>
Nov 14 09:50:05 user nova-compute[75229]:         <nova:port uuid="cb98fc47-7b69-4bde-9a4c-717cd44ba908">
Nov 14 09:50:05 user nova-compute[75229]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 14 09:50:05 user nova-compute[75229]:         </nova:port>
Nov 14 09:50:05 user nova-compute[75229]:       </nova:ports>
Nov 14 09:50:05 user nova-compute[75229]:     </nova:instance>
Nov 14 09:50:05 user nova-compute[75229]:   </metadata>
Nov 14 09:50:05 user nova-compute[75229]:   <sysinfo type="smbios">
Nov 14 09:50:05 user nova-compute[75229]:     <system>
Nov 14 09:50:05 user nova-compute[75229]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 09:50:05 user nova-compute[75229]:       <entry name="product">OpenStack Nova</entry>
Nov 14 09:50:05 user nova-compute[75229]:       <entry name="version">0.0.0</entry>
Nov 14 09:50:05 user nova-compute[75229]:       <entry name="serial">a60d339f-e134-477c-8505-bf8c79d2a21c</entry>
Nov 14 09:50:05 user nova-compute[75229]:       <entry name="uuid">a60d339f-e134-477c-8505-bf8c79d2a21c</entry>
Nov 14 09:50:05 user nova-compute[75229]:       <entry name="family">Virtual Machine</entry>
Nov 14 09:50:05 user nova-compute[75229]:     </system>
Nov 14 09:50:05 user nova-compute[75229]:   </sysinfo>
Nov 14 09:50:05 user nova-compute[75229]:   <os>
Nov 14 09:50:05 user nova-compute[75229]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 09:50:05 user nova-compute[75229]:     <boot dev="hd"/>
Nov 14 09:50:05 user nova-compute[75229]:     <smbios mode="sysinfo"/>
Nov 14 09:50:05 user nova-compute[75229]:   </os>
Nov 14 09:50:05 user nova-compute[75229]:   <features>
Nov 14 09:50:05 user nova-compute[75229]:     <acpi/>
Nov 14 09:50:05 user nova-compute[75229]:     <apic/>
Nov 14 09:50:05 user nova-compute[75229]:     <vmcoreinfo/>
Nov 14 09:50:05 user nova-compute[75229]:   </features>
Nov 14 09:50:05 user nova-compute[75229]:   <clock offset="utc">
Nov 14 09:50:05 user nova-compute[75229]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 09:50:05 user nova-compute[75229]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 09:50:05 user nova-compute[75229]:     <timer name="hpet" present="no"/>
Nov 14 09:50:05 user nova-compute[75229]:   </clock>
Nov 14 09:50:05 user nova-compute[75229]:   <cpu mode="custom" match="exact">
Nov 14 09:50:05 user nova-compute[75229]:     <model>Nehalem</model>
Nov 14 09:50:05 user nova-compute[75229]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 09:50:05 user nova-compute[75229]:   </cpu>
Nov 14 09:50:05 user nova-compute[75229]:   <devices>
Nov 14 09:50:05 user nova-compute[75229]:     <disk type="file" device="disk">
Nov 14 09:50:05 user nova-compute[75229]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 09:50:05 user nova-compute[75229]:       <source file="/opt/stack/data/nova/instances/a60d339f-e134-477c-8505-bf8c79d2a21c/disk"/>
Nov 14 09:50:05 user nova-compute[75229]:       <target dev="vda" bus="virtio"/>
Nov 14 09:50:05 user nova-compute[75229]:     </disk>
Nov 14 09:50:05 user nova-compute[75229]:     <disk type="block" device="disk">
Nov 14 09:50:05 user nova-compute[75229]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 09:50:05 user nova-compute[75229]:       <source dev="/dev/sdd"/>
Nov 14 09:50:05 user nova-compute[75229]:       <target dev="vdb" bus="virtio"/>
Nov 14 09:50:05 user nova-compute[75229]:       <serial>aca09258-022b-4f04-b418-f2a170332755</serial>
Nov 14 09:50:05 user nova-compute[75229]:     </disk>
Nov 14 09:50:05 user nova-compute[75229]:     <interface type="ethernet">
Nov 14 09:50:05 user nova-compute[75229]:       <mac address="fa:16:3e:6c:f4:6d"/>
Nov 14 09:50:05 user nova-compute[75229]:       <model type="virtio"/>
Nov 14 09:50:05 user nova-compute[75229]:       <mtu size="1442"/>
Nov 14 09:50:05 user nova-compute[75229]:       <target dev="tapcb98fc47-7b"/>
Nov 14 09:50:05 user nova-compute[75229]:     </interface>
Nov 14 09:50:05 user nova-compute[75229]:     <serial type="pty">
Nov 14 09:50:05 user nova-compute[75229]:       <log file="/opt/stack/data/nova/instances/a60d339f-e134-477c-8505-bf8c79d2a21c/console.log" append="off"/>
Nov 14 09:50:05 user nova-compute[75229]:     </serial>
Nov 14 09:50:05 user nova-compute[75229]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 09:50:05 user nova-compute[75229]:     <video>
Nov 14 09:50:05 user nova-compute[75229]:       <model type="virtio"/>
Nov 14 09:50:05 user nova-compute[75229]:     </video>
Nov 14 09:50:05 user nova-compute[75229]:     <rng model="virtio">
Nov 14 09:50:05 user nova-compute[75229]:       <backend model="random">/dev/urandom</backend>
Nov 14 09:50:05 user nova-compute[75229]:     </rng>
Nov 14 09:50:05 user nova-compute[75229]:     <controller type="usb" index="0" model="none"/>
Nov 14 09:50:05 user nova-compute[75229]:     <memballoon model="virtio">
Nov 14 09:50:05 user nova-compute[75229]:       <stats period="10"/>
Nov 14 09:50:05 user nova-compute[75229]:     </memballoon>
Nov 14 09:50:05 user nova-compute[75229]:   </devices>
Nov 14 09:50:05 user nova-compute[75229]: </domain>
Nov 14 09:50:05 user nova-compute[75229]:  {{(pid=75229) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 09:50:05 user nova-compute[75229]: DEBUG nova.virt.libvirt.vif [None req-fd748a0e-4bf3-442b-8b83-34a017396e4a tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T09:43:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-285833760',display_name='tempest-ServerActionsTestOtherB-server-285833760',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-285833760',id=5,image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLBqRiXBmoqcQBqBQflJnJ0Bni+p+JlFtve2BlM0X9wLvjWsKzu7TCQo3Ot5hzNFvzwCz/gEUspFHpyxxEkScMIm/fUvYWhxYR4DsojCDDatjjGg5V63rlfYUre+iymhFw==',key_name='tempest-keypair-1362974744',keypairs=<?>,launch_index=0,launched_at=2023-11-14T09:48:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='32e17c7c586542139cdbc5bfda57e075',ramdisk_id='',reservation_id='r-vw8kxtrn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-45710955',owner_user_name='tempest-ServerActionsTestOtherB-45710955-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T09:49:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='39c6903e2d154e838835eb5265776521',uuid=a60d339f-e134-477c-8505-bf8c79d2a21c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "cb98fc47-7b69-4bde-9a4c-717cd44ba908", "address": "fa:16:3e:6c:f4:6d", "network": {"id": "2b667d50-4579-4453-b4d3-a818a0d2c6fc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1719812180-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.24", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32e17c7c586542139cdbc5bfda57e075", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb98fc47-7b", "ovs_interfaceid": "cb98fc47-7b69-4bde-9a4c-717cd44ba908", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 09:50:05 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-fd748a0e-4bf3-442b-8b83-34a017396e4a tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] Converting VIF {"id": "cb98fc47-7b69-4bde-9a4c-717cd44ba908", "address": "fa:16:3e:6c:f4:6d", "network": {"id": "2b667d50-4579-4453-b4d3-a818a0d2c6fc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1719812180-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.24", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32e17c7c586542139cdbc5bfda57e075", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb98fc47-7b", "ovs_interfaceid": "cb98fc47-7b69-4bde-9a4c-717cd44ba908", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 09:50:05 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-fd748a0e-4bf3-442b-8b83-34a017396e4a tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6c:f4:6d,bridge_name='br-int',has_traffic_filtering=True,id=cb98fc47-7b69-4bde-9a4c-717cd44ba908,network=Network(2b667d50-4579-4453-b4d3-a818a0d2c6fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb98fc47-7b') {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 09:50:05 user nova-compute[75229]: DEBUG os_vif [None req-fd748a0e-4bf3-442b-8b83-34a017396e4a tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6c:f4:6d,bridge_name='br-int',has_traffic_filtering=True,id=cb98fc47-7b69-4bde-9a4c-717cd44ba908,network=Network(2b667d50-4579-4453-b4d3-a818a0d2c6fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb98fc47-7b') {{(pid=75229) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 09:50:05 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:50:05 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:50:05 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 09:50:05 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:50:05 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9749a676-2e86-568f-b7d8-1b9ced9bbfec', '_type': 'linux-noop'}}, row=False) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:50:05 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:50:05 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 09:50:05 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:50:05 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcb98fc47-7b, may_exist=True, interface_attrs={}) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:50:05 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapcb98fc47-7b, col_values=(('qos', UUID('c397fc03-06f7-41c4-ad05-ae462c9d324a')),), if_exists=True) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:50:05 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapcb98fc47-7b, col_values=(('external_ids', {'iface-id': 'cb98fc47-7b69-4bde-9a4c-717cd44ba908', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6c:f4:6d', 'vm-uuid': 'a60d339f-e134-477c-8505-bf8c79d2a21c'}),), if_exists=True) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:50:06 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 09:50:06 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:50:06 user nova-compute[75229]: INFO os_vif [None req-fd748a0e-4bf3-442b-8b83-34a017396e4a tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6c:f4:6d,bridge_name='br-int',has_traffic_filtering=True,id=cb98fc47-7b69-4bde-9a4c-717cd44ba908,network=Network(2b667d50-4579-4453-b4d3-a818a0d2c6fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb98fc47-7b')
Nov 14 09:50:07 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:50:07 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:50:07 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:50:07 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:50:07 user nova-compute[75229]: DEBUG nova.compute.manager [req-bf197ac9-ccc3-4b42-a83b-3da08b821a1b req-ed23fdb1-ca2c-4ff8-9d23-e0b9d40daea1 service nova] [instance: a60d339f-e134-477c-8505-bf8c79d2a21c] Received event network-vif-plugged-cb98fc47-7b69-4bde-9a4c-717cd44ba908 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:50:07 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-bf197ac9-ccc3-4b42-a83b-3da08b821a1b req-ed23fdb1-ca2c-4ff8-9d23-e0b9d40daea1 service nova] Acquiring lock "a60d339f-e134-477c-8505-bf8c79d2a21c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:50:07 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-bf197ac9-ccc3-4b42-a83b-3da08b821a1b req-ed23fdb1-ca2c-4ff8-9d23-e0b9d40daea1 service nova] Lock "a60d339f-e134-477c-8505-bf8c79d2a21c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:50:07 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-bf197ac9-ccc3-4b42-a83b-3da08b821a1b req-ed23fdb1-ca2c-4ff8-9d23-e0b9d40daea1 service nova] Lock "a60d339f-e134-477c-8505-bf8c79d2a21c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:50:07 user nova-compute[75229]: DEBUG nova.compute.manager [req-bf197ac9-ccc3-4b42-a83b-3da08b821a1b req-ed23fdb1-ca2c-4ff8-9d23-e0b9d40daea1 service nova] [instance: a60d339f-e134-477c-8505-bf8c79d2a21c] No waiting events found dispatching network-vif-plugged-cb98fc47-7b69-4bde-9a4c-717cd44ba908 {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 09:50:07 user nova-compute[75229]: WARNING nova.compute.manager [req-bf197ac9-ccc3-4b42-a83b-3da08b821a1b req-ed23fdb1-ca2c-4ff8-9d23-e0b9d40daea1 service nova] [instance: a60d339f-e134-477c-8505-bf8c79d2a21c] Received unexpected event network-vif-plugged-cb98fc47-7b69-4bde-9a4c-717cd44ba908 for instance with vm_state resized and task_state resize_reverting.
Nov 14 09:50:08 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:50:08 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:50:08 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:50:08 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:50:08 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:50:09 user nova-compute[75229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-79575969-ff51-4137-8d5d-a969902966c4 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] [instance: 4255af28-a111-4475-b207-67e335fd0835] Calling os-brick to attach iSCSI Volume {{(pid=75229) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 09:50:09 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-79575969-ff51-4137-8d5d-a969902966c4 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f73f85151b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2bae4836-52c2-428b-b299-a6a72899197d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IWJXKaHp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 09:50:09 user nova-compute[75229]: WARNING os_brick.initiator.connectors.base [None req-79575969-ff51-4137-8d5d-a969902966c4 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 09:50:09 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-79575969-ff51-4137-8d5d-a969902966c4 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 09:50:09 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-79575969-ff51-4137-8d5d-a969902966c4 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 09:50:09 user nova-compute[75229]: WARNING os_brick.initiator.connectors.base [None req-79575969-ff51-4137-8d5d-a969902966c4 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 09:50:09 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-79575969-ff51-4137-8d5d-a969902966c4 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2bae4836-52c2-428b-b299-a6a72899197d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 09:50:09 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-79575969-ff51-4137-8d5d-a969902966c4 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2bae4836-52c2-428b-b299-a6a72899197d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 09:50:09 user nova-compute[75229]: INFO os_brick.initiator.connectors.iscsi [None req-79575969-ff51-4137-8d5d-a969902966c4 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 09:50:09 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2bae4836-52c2-428b-b299-a6a72899197d -p 172.16.0.220:3260 {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:50:09 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2bae4836-52c2-428b-b299-a6a72899197d -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:50:09 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[54c867d4-75ba-4a37-8092-037171adec9b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:50:09 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-79575969-ff51-4137-8d5d-a969902966c4 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 09:50:09 user nova-compute[75229]:  {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:50:09 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2bae4836-52c2-428b-b299-a6a72899197d -p 172.16.0.220:3260 --interface default --op new {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:50:09 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2bae4836-52c2-428b-b299-a6a72899197d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.041s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:50:09 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd042d61-761f-4c22-b470-0807be11eb9d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2bae4836-52c2-428b-b299-a6a72899197d] added\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:50:09 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-79575969-ff51-4137-8d5d-a969902966c4 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2bae4836-52c2-428b-b299-a6a72899197d] added
Nov 14 09:50:09 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:50:09 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2bae4836-52c2-428b-b299-a6a72899197d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:50:09 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2bae4836-52c2-428b-b299-a6a72899197d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:50:09 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c04b2a4-e85f-42b3-a7b8-60c4cab88366]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:50:09 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-79575969-ff51-4137-8d5d-a969902966c4 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:50:09 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2bae4836-52c2-428b-b299-a6a72899197d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:50:09 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2bae4836-52c2-428b-b299-a6a72899197d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:50:09 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c506a29-9b4b-4b70-b7bc-c246aadc30ee]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:50:09 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-79575969-ff51-4137-8d5d-a969902966c4 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:50:09 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2bae4836-52c2-428b-b299-a6a72899197d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IWJXKaHp {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:50:09 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2bae4836-52c2-428b-b299-a6a72899197d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IWJXKaHp" returned: 0 in 0.020s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:50:09 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7c15533-de7c-4bb8-a4d0-03d96c8d685d]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:50:09 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-79575969-ff51-4137-8d5d-a969902966c4 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'IWJXKaHp'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:50:09 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2bae4836-52c2-428b-b299-a6a72899197d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:50:09 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2bae4836-52c2-428b-b299-a6a72899197d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:50:09 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[394d1b85-3fb0-47fd-b1ad-420a788a0899]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:50:09 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-79575969-ff51-4137-8d5d-a969902966c4 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:50:09 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:50:09 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:50:09 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[f00879d4-2305-421a-a83a-3d0297a96918]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fed285f-9be4-4601-8cb5-4329d7ebed8c (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7902ab8-168d-4c8a-90e9-bf44d669ce2b (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a3c64c6-8528-4707-a0c0-68a0649277a0 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aca09258-022b-4f04-b418-f2a170332755 (non-flash)\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:50:09 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-79575969-ff51-4137-8d5d-a969902966c4 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fed285f-9be4-4601-8cb5-4329d7ebed8c (non-flash)
Nov 14 09:50:09 user nova-compute[75229]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7902ab8-168d-4c8a-90e9-bf44d669ce2b (non-flash)
Nov 14 09:50:09 user nova-compute[75229]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a3c64c6-8528-4707-a0c0-68a0649277a0 (non-flash)
Nov 14 09:50:09 user nova-compute[75229]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aca09258-022b-4f04-b418-f2a170332755 (non-flash)
Nov 14 09:50:09 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 09:50:09 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-79575969-ff51-4137-8d5d-a969902966c4 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fed285f-9be4-4601-8cb5-4329d7ebed8c (non-flash)
Nov 14 09:50:09 user nova-compute[75229]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7902ab8-168d-4c8a-90e9-bf44d669ce2b (non-flash)
Nov 14 09:50:09 user nova-compute[75229]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a3c64c6-8528-4707-a0c0-68a0649277a0 (non-flash)
Nov 14 09:50:09 user nova-compute[75229]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aca09258-022b-4f04-b418-f2a170332755 (non-flash)
Nov 14 09:50:09 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 09:50:09 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2bae4836-52c2-428b-b299-a6a72899197d -p 172.16.0.220:3260 --login {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:50:09 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2bae4836-52c2-428b-b299-a6a72899197d -p 172.16.0.220:3260 --login" returned: 0 in 0.093s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:50:09 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[79234290-591c-42e1-a4ff-ad66fc276fb6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2bae4836-52c2-428b-b299-a6a72899197d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2bae4836-52c2-428b-b299-a6a72899197d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:50:09 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-79575969-ff51-4137-8d5d-a969902966c4 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2bae4836-52c2-428b-b299-a6a72899197d, portal: 172.16.0.220,3260]
Nov 14 09:50:09 user nova-compute[75229]: Login to [iface: default, target: iqn.2010-10.org.openstack:2bae4836-52c2-428b-b299-a6a72899197d, portal: 172.16.0.220,3260] successful.
Nov 14 09:50:09 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:50:09 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2bae4836-52c2-428b-b299-a6a72899197d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:50:09 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2bae4836-52c2-428b-b299-a6a72899197d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:50:09 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca2b2d95-4c35-4c84-a02b-2f25287674a0]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:50:09 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-79575969-ff51-4137-8d5d-a969902966c4 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:50:09 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:50:09 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:50:09 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[877c05ba-9df8-417d-84f4-b87619b6827b]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fed285f-9be4-4601-8cb5-4329d7ebed8c (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7902ab8-168d-4c8a-90e9-bf44d669ce2b (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a3c64c6-8528-4707-a0c0-68a0649277a0 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aca09258-022b-4f04-b418-f2a170332755 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bae4836-52c2-428b-b299-a6a72899197d (non-flash)\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:50:09 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-79575969-ff51-4137-8d5d-a969902966c4 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fed285f-9be4-4601-8cb5-4329d7ebed8c (non-flash)
Nov 14 09:50:09 user nova-compute[75229]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7902ab8-168d-4c8a-90e9-bf44d669ce2b (non-flash)
Nov 14 09:50:09 user nova-compute[75229]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a3c64c6-8528-4707-a0c0-68a0649277a0 (non-flash)
Nov 14 09:50:09 user nova-compute[75229]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aca09258-022b-4f04-b418-f2a170332755 (non-flash)
Nov 14 09:50:09 user nova-compute[75229]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bae4836-52c2-428b-b299-a6a72899197d (non-flash)
Nov 14 09:50:09 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 09:50:09 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-79575969-ff51-4137-8d5d-a969902966c4 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fed285f-9be4-4601-8cb5-4329d7ebed8c (non-flash)
Nov 14 09:50:09 user nova-compute[75229]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7902ab8-168d-4c8a-90e9-bf44d669ce2b (non-flash)
Nov 14 09:50:09 user nova-compute[75229]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a3c64c6-8528-4707-a0c0-68a0649277a0 (non-flash)
Nov 14 09:50:09 user nova-compute[75229]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aca09258-022b-4f04-b418-f2a170332755 (non-flash)
Nov 14 09:50:09 user nova-compute[75229]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bae4836-52c2-428b-b299-a6a72899197d (non-flash)
Nov 14 09:50:09 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 09:50:09 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-79575969-ff51-4137-8d5d-a969902966c4 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2bae4836-52c2-428b-b299-a6a72899197d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.376s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 09:50:09 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-79575969-ff51-4137-8d5d-a969902966c4 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Connected to 172.16.0.220:3260 {{(pid=75229) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 09:50:09 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-79575969-ff51-4137-8d5d-a969902966c4 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] HCTL ('37', '-', '-', 0) found on session 24 with lun 0 {{(pid=75229) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 09:50:09 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-79575969-ff51-4137-8d5d-a969902966c4 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75229) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 09:50:09 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:50:09 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.017s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:50:09 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[96dcb16c-d802-4520-bf54-e3379cec6c5f]: (4, ('- - 0', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:50:09 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-79575969-ff51-4137-8d5d-a969902966c4 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Searching for a device in session 24 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75229) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 09:50:09 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-79575969-ff51-4137-8d5d-a969902966c4 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:2bae4836-52c2-428b-b299-a6a72899197d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IWJXKaHp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75229) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 09:50:09 user nova-compute[75229]: DEBUG nova.compute.manager [req-30f47581-38c6-4fe6-9aa0-5f6447427853 req-3f86694e-9e3a-4749-afc6-100b0990e859 service nova] [instance: a60d339f-e134-477c-8505-bf8c79d2a21c] Received event network-vif-plugged-cb98fc47-7b69-4bde-9a4c-717cd44ba908 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:50:09 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-30f47581-38c6-4fe6-9aa0-5f6447427853 req-3f86694e-9e3a-4749-afc6-100b0990e859 service nova] Acquiring lock "a60d339f-e134-477c-8505-bf8c79d2a21c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:50:09 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-30f47581-38c6-4fe6-9aa0-5f6447427853 req-3f86694e-9e3a-4749-afc6-100b0990e859 service nova] Lock "a60d339f-e134-477c-8505-bf8c79d2a21c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:50:09 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-30f47581-38c6-4fe6-9aa0-5f6447427853 req-3f86694e-9e3a-4749-afc6-100b0990e859 service nova] Lock "a60d339f-e134-477c-8505-bf8c79d2a21c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:50:09 user nova-compute[75229]: DEBUG nova.compute.manager [req-30f47581-38c6-4fe6-9aa0-5f6447427853 req-3f86694e-9e3a-4749-afc6-100b0990e859 service nova] [instance: a60d339f-e134-477c-8505-bf8c79d2a21c] No waiting events found dispatching network-vif-plugged-cb98fc47-7b69-4bde-9a4c-717cd44ba908 {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 09:50:09 user nova-compute[75229]: WARNING nova.compute.manager [req-30f47581-38c6-4fe6-9aa0-5f6447427853 req-3f86694e-9e3a-4749-afc6-100b0990e859 service nova] [instance: a60d339f-e134-477c-8505-bf8c79d2a21c] Received unexpected event network-vif-plugged-cb98fc47-7b69-4bde-9a4c-717cd44ba908 for instance with vm_state resized and task_state resize_reverting.
Nov 14 09:50:10 user nova-compute[75229]: DEBUG nova.compute.manager [None req-fd748a0e-4bf3-442b-8b83-34a017396e4a tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] [instance: a60d339f-e134-477c-8505-bf8c79d2a21c] Instance event wait completed in 0 seconds for  {{(pid=75229) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 09:50:10 user nova-compute[75229]: INFO nova.virt.libvirt.driver [-] [instance: a60d339f-e134-477c-8505-bf8c79d2a21c] Instance running successfully.
Nov 14 09:50:10 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-fd748a0e-4bf3-442b-8b83-34a017396e4a tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] [instance: a60d339f-e134-477c-8505-bf8c79d2a21c] finish_revert_migration finished successfully. {{(pid=75229) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11863}}
Nov 14 09:50:10 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 09:50:10 user nova-compute[75229]: DEBUG nova.compute.manager [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Triggering sync for uuid a7750cbc-b3d0-44aa-8b88-c291ba007a8a {{(pid=75229) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 09:50:10 user nova-compute[75229]: DEBUG nova.compute.manager [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Triggering sync for uuid e09b3809-2e23-401c-9a72-88feb2bb657c {{(pid=75229) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 09:50:10 user nova-compute[75229]: DEBUG nova.compute.manager [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Triggering sync for uuid a60d339f-e134-477c-8505-bf8c79d2a21c {{(pid=75229) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 09:50:10 user nova-compute[75229]: DEBUG nova.compute.manager [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Triggering sync for uuid d6e2d77b-9894-4afa-8fa1-13a2842ba9a7 {{(pid=75229) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 09:50:10 user nova-compute[75229]: DEBUG nova.compute.manager [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Triggering sync for uuid 4255af28-a111-4475-b207-67e335fd0835 {{(pid=75229) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 09:50:10 user nova-compute[75229]: DEBUG nova.compute.manager [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Triggering sync for uuid 4c9fe69e-3f9d-4b30-a9e4-efc3e83efa17 {{(pid=75229) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 09:50:10 user nova-compute[75229]: DEBUG nova.compute.manager [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Triggering sync for uuid b5170e9e-66e3-4df1-9807-4958cac6480e {{(pid=75229) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 09:50:10 user nova-compute[75229]: DEBUG nova.compute.manager [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Triggering sync for uuid a4ce290f-6dd2-44b6-91be-8e775045837e {{(pid=75229) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 09:50:10 user nova-compute[75229]: DEBUG nova.compute.manager [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Triggering sync for uuid 94e2b266-2fe3-481a-bb1e-24f835a79ddf {{(pid=75229) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 09:50:10 user nova-compute[75229]: DEBUG nova.compute.manager [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Triggering sync for uuid 90bd76df-96cb-4bec-9862-853d94cdbaab {{(pid=75229) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 09:50:10 user nova-compute[75229]: DEBUG nova.compute.manager [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Triggering sync for uuid be813b28-133f-416a-b2b5-dc0b9e4064b7 {{(pid=75229) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 09:50:10 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Acquiring lock "a7750cbc-b3d0-44aa-8b88-c291ba007a8a" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:50:10 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Lock "a7750cbc-b3d0-44aa-8b88-c291ba007a8a" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:50:10 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Acquiring lock "e09b3809-2e23-401c-9a72-88feb2bb657c" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:50:10 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Lock "e09b3809-2e23-401c-9a72-88feb2bb657c" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:50:10 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Acquiring lock "a60d339f-e134-477c-8505-bf8c79d2a21c" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:50:10 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Lock "a60d339f-e134-477c-8505-bf8c79d2a21c" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:50:10 user nova-compute[75229]: INFO nova.compute.manager [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] [instance: a60d339f-e134-477c-8505-bf8c79d2a21c] During sync_power_state the instance has a pending task (resize_reverting). Skip.
Nov 14 09:50:10 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Lock "a60d339f-e134-477c-8505-bf8c79d2a21c" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:50:10 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Acquiring lock "d6e2d77b-9894-4afa-8fa1-13a2842ba9a7" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:50:10 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Lock "d6e2d77b-9894-4afa-8fa1-13a2842ba9a7" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:50:10 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Acquiring lock "4255af28-a111-4475-b207-67e335fd0835" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:50:10 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Acquiring lock "4c9fe69e-3f9d-4b30-a9e4-efc3e83efa17" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:50:10 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Lock "4c9fe69e-3f9d-4b30-a9e4-efc3e83efa17" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:50:10 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Acquiring lock "b5170e9e-66e3-4df1-9807-4958cac6480e" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:50:10 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Lock "b5170e9e-66e3-4df1-9807-4958cac6480e" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:50:10 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Acquiring lock "a4ce290f-6dd2-44b6-91be-8e775045837e" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:50:10 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Lock "a4ce290f-6dd2-44b6-91be-8e775045837e" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:50:10 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Acquiring lock "94e2b266-2fe3-481a-bb1e-24f835a79ddf" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:50:10 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Lock "94e2b266-2fe3-481a-bb1e-24f835a79ddf" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:50:10 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Acquiring lock "90bd76df-96cb-4bec-9862-853d94cdbaab" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:50:10 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Lock "90bd76df-96cb-4bec-9862-853d94cdbaab" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:50:10 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Acquiring lock "be813b28-133f-416a-b2b5-dc0b9e4064b7" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:50:10 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Lock "be813b28-133f-416a-b2b5-dc0b9e4064b7" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:50:10 user nova-compute[75229]: INFO nova.compute.manager [None req-fd748a0e-4bf3-442b-8b83-34a017396e4a tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] [instance: a60d339f-e134-477c-8505-bf8c79d2a21c] Updating instance to original state: 'active'
Nov 14 09:50:10 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Lock "a7750cbc-b3d0-44aa-8b88-c291ba007a8a" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.095s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:50:10 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Lock "d6e2d77b-9894-4afa-8fa1-13a2842ba9a7" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.103s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:50:10 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Lock "4c9fe69e-3f9d-4b30-a9e4-efc3e83efa17" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.104s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:50:10 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Lock "94e2b266-2fe3-481a-bb1e-24f835a79ddf" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.114s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:50:10 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Lock "e09b3809-2e23-401c-9a72-88feb2bb657c" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.136s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:50:10 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Lock "90bd76df-96cb-4bec-9862-853d94cdbaab" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.142s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:50:10 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Lock "b5170e9e-66e3-4df1-9807-4958cac6480e" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.145s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:50:10 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Lock "a4ce290f-6dd2-44b6-91be-8e775045837e" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.157s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:50:10 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Lock "be813b28-133f-416a-b2b5-dc0b9e4064b7" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.161s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:50:10 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-79575969-ff51-4137-8d5d-a969902966c4 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.409s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 09:50:10 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-79575969-ff51-4137-8d5d-a969902966c4 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] <== connect_volume: return (1412ms) {'type': 'block', 'scsi_wwn': '26634323533343031', 'path': '/dev/sdf'} {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 09:50:10 user nova-compute[75229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-79575969-ff51-4137-8d5d-a969902966c4 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] [instance: 4255af28-a111-4475-b207-67e335fd0835] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26634323533343031', 'path': '/dev/sdf'} {{(pid=75229) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 09:50:10 user nova-compute[75229]: DEBUG nova.objects.instance [None req-79575969-ff51-4137-8d5d-a969902966c4 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Lazy-loading 'flavor' on Instance uuid 4255af28-a111-4475-b207-67e335fd0835 {{(pid=75229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 09:50:10 user nova-compute[75229]: DEBUG nova.virt.libvirt.guest [None req-79575969-ff51-4137-8d5d-a969902966c4 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 09:50:10 user nova-compute[75229]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 09:50:10 user nova-compute[75229]:   <source dev="/dev/sdf"/>
Nov 14 09:50:10 user nova-compute[75229]:   <target dev="vdb" bus="virtio"/>
Nov 14 09:50:10 user nova-compute[75229]:   <serial>2bae4836-52c2-428b-b299-a6a72899197d</serial>
Nov 14 09:50:10 user nova-compute[75229]: </disk>
Nov 14 09:50:10 user nova-compute[75229]:  {{(pid=75229) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 09:50:10 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:50:11 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:50:11 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-79575969-ff51-4137-8d5d-a969902966c4 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] No BDM found with device name vda, not building metadata. {{(pid=75229) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 09:50:11 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-79575969-ff51-4137-8d5d-a969902966c4 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75229) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 09:50:11 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-79575969-ff51-4137-8d5d-a969902966c4 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] No VIF found with MAC fa:16:3e:3d:eb:0f, not building metadata {{(pid=75229) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 09:50:11 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-79575969-ff51-4137-8d5d-a969902966c4 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Lock "4255af28-a111-4475-b207-67e335fd0835" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.383s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:50:11 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Lock "4255af28-a111-4475-b207-67e335fd0835" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 1.053s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:50:11 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Lock "4255af28-a111-4475-b207-67e335fd0835" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.039s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:50:13 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:50:13 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-77b50546-40e7-405b-9815-57f881e314fd tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] Acquiring lock "d6e2d77b-9894-4afa-8fa1-13a2842ba9a7" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:50:13 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-77b50546-40e7-405b-9815-57f881e314fd tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] Lock "d6e2d77b-9894-4afa-8fa1-13a2842ba9a7" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:50:13 user nova-compute[75229]: INFO nova.compute.manager [None req-77b50546-40e7-405b-9815-57f881e314fd tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] [instance: d6e2d77b-9894-4afa-8fa1-13a2842ba9a7] Detaching volume 1a3c64c6-8528-4707-a0c0-68a0649277a0
Nov 14 09:50:13 user nova-compute[75229]: INFO nova.virt.block_device [None req-77b50546-40e7-405b-9815-57f881e314fd tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] [instance: d6e2d77b-9894-4afa-8fa1-13a2842ba9a7] Attempting to driver detach volume 1a3c64c6-8528-4707-a0c0-68a0649277a0 from mountpoint /dev/vdb
Nov 14 09:50:13 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:50:13 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-77b50546-40e7-405b-9815-57f881e314fd tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] Attempting to detach device vdb from instance d6e2d77b-9894-4afa-8fa1-13a2842ba9a7 from the persistent domain config. {{(pid=75229) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 09:50:13 user nova-compute[75229]: DEBUG nova.virt.libvirt.guest [None req-77b50546-40e7-405b-9815-57f881e314fd tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 09:50:13 user nova-compute[75229]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 09:50:13 user nova-compute[75229]:   <source dev="/dev/sdc"/>
Nov 14 09:50:13 user nova-compute[75229]:   <target dev="vdb" bus="virtio"/>
Nov 14 09:50:13 user nova-compute[75229]:   <serial>1a3c64c6-8528-4707-a0c0-68a0649277a0</serial>
Nov 14 09:50:13 user nova-compute[75229]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 09:50:13 user nova-compute[75229]: </disk>
Nov 14 09:50:13 user nova-compute[75229]:  {{(pid=75229) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 09:50:13 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-77b50546-40e7-405b-9815-57f881e314fd tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] Successfully detached device vdb from instance d6e2d77b-9894-4afa-8fa1-13a2842ba9a7 from the persistent domain config.
Nov 14 09:50:13 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-77b50546-40e7-405b-9815-57f881e314fd tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance d6e2d77b-9894-4afa-8fa1-13a2842ba9a7 from the live domain config. {{(pid=75229) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 09:50:13 user nova-compute[75229]: DEBUG nova.virt.libvirt.guest [None req-77b50546-40e7-405b-9815-57f881e314fd tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 09:50:13 user nova-compute[75229]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 09:50:13 user nova-compute[75229]:   <source dev="/dev/sdc"/>
Nov 14 09:50:13 user nova-compute[75229]:   <target dev="vdb" bus="virtio"/>
Nov 14 09:50:13 user nova-compute[75229]:   <serial>1a3c64c6-8528-4707-a0c0-68a0649277a0</serial>
Nov 14 09:50:13 user nova-compute[75229]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 09:50:13 user nova-compute[75229]: </disk>
Nov 14 09:50:13 user nova-compute[75229]:  {{(pid=75229) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 09:50:13 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-5d0bb68d-e705-4876-a983-c2b0c680ff71 tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] Acquiring lock "d6e2d77b-9894-4afa-8fa1-13a2842ba9a7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:50:14 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-77b50546-40e7-405b-9815-57f881e314fd tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance d6e2d77b-9894-4afa-8fa1-13a2842ba9a7 {{(pid=75229) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 09:50:14 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-0525ff71-2c09-4019-a064-78e082379aa5 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Acquiring lock "5abd12fe-e6fc-4cb1-9674-da08e13886be" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:50:14 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-0525ff71-2c09-4019-a064-78e082379aa5 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Lock "5abd12fe-e6fc-4cb1-9674-da08e13886be" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:50:14 user nova-compute[75229]: DEBUG nova.compute.manager [None req-0525ff71-2c09-4019-a064-78e082379aa5 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] [instance: 5abd12fe-e6fc-4cb1-9674-da08e13886be] Starting instance... {{(pid=75229) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 09:50:14 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-0525ff71-2c09-4019-a064-78e082379aa5 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:50:14 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-0525ff71-2c09-4019-a064-78e082379aa5 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:50:14 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-0525ff71-2c09-4019-a064-78e082379aa5 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75229) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 09:50:14 user nova-compute[75229]: INFO nova.compute.claims [None req-0525ff71-2c09-4019-a064-78e082379aa5 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] [instance: 5abd12fe-e6fc-4cb1-9674-da08e13886be] Claim successful on node user
Nov 14 09:50:15 user nova-compute[75229]: DEBUG nova.compute.provider_tree [None req-0525ff71-2c09-4019-a064-78e082379aa5 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Inventory has not changed in ProviderTree for provider: d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 {{(pid=75229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 09:50:15 user nova-compute[75229]: DEBUG nova.scheduler.client.report [None req-0525ff71-2c09-4019-a064-78e082379aa5 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Inventory has not changed for provider d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 09:50:15 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-0525ff71-2c09-4019-a064-78e082379aa5 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.512s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:50:15 user nova-compute[75229]: DEBUG nova.compute.manager [None req-0525ff71-2c09-4019-a064-78e082379aa5 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] [instance: 5abd12fe-e6fc-4cb1-9674-da08e13886be] Start building networks asynchronously for instance. {{(pid=75229) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 09:50:15 user nova-compute[75229]: DEBUG nova.compute.manager [None req-0525ff71-2c09-4019-a064-78e082379aa5 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] [instance: 5abd12fe-e6fc-4cb1-9674-da08e13886be] Allocating IP information in the background. {{(pid=75229) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 09:50:15 user nova-compute[75229]: DEBUG nova.network.neutron [None req-0525ff71-2c09-4019-a064-78e082379aa5 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] [instance: 5abd12fe-e6fc-4cb1-9674-da08e13886be] allocate_for_instance() {{(pid=75229) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 09:50:15 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-0525ff71-2c09-4019-a064-78e082379aa5 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] [instance: 5abd12fe-e6fc-4cb1-9674-da08e13886be] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 09:50:15 user nova-compute[75229]: DEBUG nova.compute.manager [None req-0525ff71-2c09-4019-a064-78e082379aa5 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] [instance: 5abd12fe-e6fc-4cb1-9674-da08e13886be] Start building block device mappings for instance. {{(pid=75229) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 09:50:15 user nova-compute[75229]: DEBUG nova.policy [None req-0525ff71-2c09-4019-a064-78e082379aa5 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3b8313e365eb4970a58c412768e959bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b8d48c38c7344f5b12d0ed5b9392554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75229) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 09:50:15 user nova-compute[75229]: DEBUG nova.compute.manager [None req-0525ff71-2c09-4019-a064-78e082379aa5 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] [instance: 5abd12fe-e6fc-4cb1-9674-da08e13886be] Start spawning the instance on the hypervisor. {{(pid=75229) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 09:50:15 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-0525ff71-2c09-4019-a064-78e082379aa5 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] [instance: 5abd12fe-e6fc-4cb1-9674-da08e13886be] Creating instance directory {{(pid=75229) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 09:50:15 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-0525ff71-2c09-4019-a064-78e082379aa5 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] [instance: 5abd12fe-e6fc-4cb1-9674-da08e13886be] Creating image(s)
Nov 14 09:50:15 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-0525ff71-2c09-4019-a064-78e082379aa5 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Acquiring lock "/opt/stack/data/nova/instances/5abd12fe-e6fc-4cb1-9674-da08e13886be/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:50:15 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-0525ff71-2c09-4019-a064-78e082379aa5 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Lock "/opt/stack/data/nova/instances/5abd12fe-e6fc-4cb1-9674-da08e13886be/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:50:15 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-0525ff71-2c09-4019-a064-78e082379aa5 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Lock "/opt/stack/data/nova/instances/5abd12fe-e6fc-4cb1-9674-da08e13886be/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:50:15 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-0525ff71-2c09-4019-a064-78e082379aa5 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6 --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:50:15 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-0525ff71-2c09-4019-a064-78e082379aa5 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6 --force-share --output=json" returned: 0 in 0.207s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:50:15 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-0525ff71-2c09-4019-a064-78e082379aa5 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Acquiring lock "4f30e3fe703d2381679612a57b1fb80a467f60b6" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:50:15 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-0525ff71-2c09-4019-a064-78e082379aa5 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Lock "4f30e3fe703d2381679612a57b1fb80a467f60b6" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:50:15 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-0525ff71-2c09-4019-a064-78e082379aa5 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6 --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:50:16 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:50:16 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-0525ff71-2c09-4019-a064-78e082379aa5 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6 --force-share --output=json" returned: 0 in 0.192s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:50:16 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-0525ff71-2c09-4019-a064-78e082379aa5 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6,backing_fmt=raw /opt/stack/data/nova/instances/5abd12fe-e6fc-4cb1-9674-da08e13886be/disk 1073741824 {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:50:16 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-0525ff71-2c09-4019-a064-78e082379aa5 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6,backing_fmt=raw /opt/stack/data/nova/instances/5abd12fe-e6fc-4cb1-9674-da08e13886be/disk 1073741824" returned: 0 in 0.051s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:50:16 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-0525ff71-2c09-4019-a064-78e082379aa5 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Lock "4f30e3fe703d2381679612a57b1fb80a467f60b6" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.249s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:50:16 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-0525ff71-2c09-4019-a064-78e082379aa5 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6 --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:50:16 user nova-compute[75229]: DEBUG nova.network.neutron [None req-0525ff71-2c09-4019-a064-78e082379aa5 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] [instance: 5abd12fe-e6fc-4cb1-9674-da08e13886be] Successfully created port: dff81e5d-68b7-41dc-a6ce-7fda9da3b718 {{(pid=75229) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 09:50:16 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-0525ff71-2c09-4019-a064-78e082379aa5 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6 --force-share --output=json" returned: 0 in 0.287s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:50:16 user nova-compute[75229]: DEBUG nova.virt.disk.api [None req-0525ff71-2c09-4019-a064-78e082379aa5 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5abd12fe-e6fc-4cb1-9674-da08e13886be/disk. size=1073741824 {{(pid=75229) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 09:50:16 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-0525ff71-2c09-4019-a064-78e082379aa5 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5abd12fe-e6fc-4cb1-9674-da08e13886be/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:50:16 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-0525ff71-2c09-4019-a064-78e082379aa5 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5abd12fe-e6fc-4cb1-9674-da08e13886be/disk --force-share --output=json" returned: 0 in 0.257s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:50:16 user nova-compute[75229]: DEBUG nova.virt.disk.api [None req-0525ff71-2c09-4019-a064-78e082379aa5 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Cannot resize image /opt/stack/data/nova/instances/5abd12fe-e6fc-4cb1-9674-da08e13886be/disk to a smaller size. {{(pid=75229) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 09:50:16 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-0525ff71-2c09-4019-a064-78e082379aa5 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] [instance: 5abd12fe-e6fc-4cb1-9674-da08e13886be] Created local disks {{(pid=75229) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 09:50:16 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-0525ff71-2c09-4019-a064-78e082379aa5 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] [instance: 5abd12fe-e6fc-4cb1-9674-da08e13886be] Ensure instance console log exists: /opt/stack/data/nova/instances/5abd12fe-e6fc-4cb1-9674-da08e13886be/console.log {{(pid=75229) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 09:50:16 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-0525ff71-2c09-4019-a064-78e082379aa5 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:50:16 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-0525ff71-2c09-4019-a064-78e082379aa5 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:50:16 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-0525ff71-2c09-4019-a064-78e082379aa5 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:50:17 user nova-compute[75229]: DEBUG nova.network.neutron [None req-0525ff71-2c09-4019-a064-78e082379aa5 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] [instance: 5abd12fe-e6fc-4cb1-9674-da08e13886be] Successfully updated port: dff81e5d-68b7-41dc-a6ce-7fda9da3b718 {{(pid=75229) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 09:50:17 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-0525ff71-2c09-4019-a064-78e082379aa5 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Acquiring lock "refresh_cache-5abd12fe-e6fc-4cb1-9674-da08e13886be" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 09:50:17 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-0525ff71-2c09-4019-a064-78e082379aa5 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Acquired lock "refresh_cache-5abd12fe-e6fc-4cb1-9674-da08e13886be" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 09:50:17 user nova-compute[75229]: DEBUG nova.network.neutron [None req-0525ff71-2c09-4019-a064-78e082379aa5 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] [instance: 5abd12fe-e6fc-4cb1-9674-da08e13886be] Building network info cache for instance {{(pid=75229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 09:50:17 user nova-compute[75229]: DEBUG nova.compute.manager [req-f0b38351-c196-4329-bd2c-9b24b1f6ddfa req-4a8e537c-ff82-422b-a0dd-03a436c74e2c service nova] [instance: 5abd12fe-e6fc-4cb1-9674-da08e13886be] Received event network-changed-dff81e5d-68b7-41dc-a6ce-7fda9da3b718 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:50:17 user nova-compute[75229]: DEBUG nova.compute.manager [req-f0b38351-c196-4329-bd2c-9b24b1f6ddfa req-4a8e537c-ff82-422b-a0dd-03a436c74e2c service nova] [instance: 5abd12fe-e6fc-4cb1-9674-da08e13886be] Refreshing instance network info cache due to event network-changed-dff81e5d-68b7-41dc-a6ce-7fda9da3b718. {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 09:50:17 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-f0b38351-c196-4329-bd2c-9b24b1f6ddfa req-4a8e537c-ff82-422b-a0dd-03a436c74e2c service nova] Acquiring lock "refresh_cache-5abd12fe-e6fc-4cb1-9674-da08e13886be" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 09:50:17 user nova-compute[75229]: DEBUG nova.network.neutron [None req-0525ff71-2c09-4019-a064-78e082379aa5 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] [instance: 5abd12fe-e6fc-4cb1-9674-da08e13886be] Instance cache missing network info. {{(pid=75229) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 09:50:17 user nova-compute[75229]: DEBUG nova.network.neutron [None req-0525ff71-2c09-4019-a064-78e082379aa5 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] [instance: 5abd12fe-e6fc-4cb1-9674-da08e13886be] Updating instance_info_cache with network_info: [{"id": "dff81e5d-68b7-41dc-a6ce-7fda9da3b718", "address": "fa:16:3e:bb:19:d4", "network": {"id": "bd407caa-6ef6-400d-9327-3179dc1d8da4", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-29933774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b8d48c38c7344f5b12d0ed5b9392554", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdff81e5d-68", "ovs_interfaceid": "dff81e5d-68b7-41dc-a6ce-7fda9da3b718", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 09:50:17 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-0525ff71-2c09-4019-a064-78e082379aa5 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Releasing lock "refresh_cache-5abd12fe-e6fc-4cb1-9674-da08e13886be" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 09:50:17 user nova-compute[75229]: DEBUG nova.compute.manager [None req-0525ff71-2c09-4019-a064-78e082379aa5 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] [instance: 5abd12fe-e6fc-4cb1-9674-da08e13886be] Instance network_info: |[{"id": "dff81e5d-68b7-41dc-a6ce-7fda9da3b718", "address": "fa:16:3e:bb:19:d4", "network": {"id": "bd407caa-6ef6-400d-9327-3179dc1d8da4", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-29933774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b8d48c38c7344f5b12d0ed5b9392554", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdff81e5d-68", "ovs_interfaceid": "dff81e5d-68b7-41dc-a6ce-7fda9da3b718", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75229) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 09:50:17 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-f0b38351-c196-4329-bd2c-9b24b1f6ddfa req-4a8e537c-ff82-422b-a0dd-03a436c74e2c service nova] Acquired lock "refresh_cache-5abd12fe-e6fc-4cb1-9674-da08e13886be" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 09:50:17 user nova-compute[75229]: DEBUG nova.network.neutron [req-f0b38351-c196-4329-bd2c-9b24b1f6ddfa req-4a8e537c-ff82-422b-a0dd-03a436c74e2c service nova] [instance: 5abd12fe-e6fc-4cb1-9674-da08e13886be] Refreshing network info cache for port dff81e5d-68b7-41dc-a6ce-7fda9da3b718 {{(pid=75229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 09:50:17 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-0525ff71-2c09-4019-a064-78e082379aa5 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] [instance: 5abd12fe-e6fc-4cb1-9674-da08e13886be] Start _get_guest_xml network_info=[{"id": "dff81e5d-68b7-41dc-a6ce-7fda9da3b718", "address": "fa:16:3e:bb:19:d4", "network": {"id": "bd407caa-6ef6-400d-9327-3179dc1d8da4", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-29933774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b8d48c38c7344f5b12d0ed5b9392554", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdff81e5d-68", "ovs_interfaceid": "dff81e5d-68b7-41dc-a6ce-7fda9da3b718", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T09:40:10Z,direct_url=<?>,disk_format='qcow2',id=3bef8470-ecc7-40e3-95d4-9254348ea72d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='de5a91106b6948ed937a7178ff9464c4',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T09:40:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'disk_bus': 'virtio', 'guest_format': None, 'encryption_secret_uuid': None, 'size': 0, 'device_type': 'disk', 'image_id': '3bef8470-ecc7-40e3-95d4-9254348ea72d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75229) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 09:50:17 user nova-compute[75229]: WARNING nova.virt.libvirt.driver [None req-0525ff71-2c09-4019-a064-78e082379aa5 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 09:50:17 user nova-compute[75229]: WARNING nova.virt.libvirt.driver [None req-0525ff71-2c09-4019-a064-78e082379aa5 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 09:50:17 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-0525ff71-2c09-4019-a064-78e082379aa5 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75229) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 09:50:17 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-0525ff71-2c09-4019-a064-78e082379aa5 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] CPU controller missing on host. {{(pid=75229) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 09:50:17 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-0525ff71-2c09-4019-a064-78e082379aa5 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75229) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 09:50:17 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-0525ff71-2c09-4019-a064-78e082379aa5 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] CPU controller found on host. {{(pid=75229) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 09:50:17 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-0525ff71-2c09-4019-a064-78e082379aa5 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75229) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 09:50:17 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-0525ff71-2c09-4019-a064-78e082379aa5 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T09:39:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T09:40:10Z,direct_url=<?>,disk_format='qcow2',id=3bef8470-ecc7-40e3-95d4-9254348ea72d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='de5a91106b6948ed937a7178ff9464c4',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T09:40:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 09:50:17 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-0525ff71-2c09-4019-a064-78e082379aa5 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Flavor limits 0:0:0 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 09:50:17 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-0525ff71-2c09-4019-a064-78e082379aa5 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Image limits 0:0:0 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 09:50:17 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-0525ff71-2c09-4019-a064-78e082379aa5 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Flavor pref 0:0:0 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 09:50:17 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-0525ff71-2c09-4019-a064-78e082379aa5 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Image pref 0:0:0 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 09:50:17 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-0525ff71-2c09-4019-a064-78e082379aa5 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 09:50:17 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-0525ff71-2c09-4019-a064-78e082379aa5 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 09:50:17 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-0525ff71-2c09-4019-a064-78e082379aa5 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75229) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 09:50:17 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-0525ff71-2c09-4019-a064-78e082379aa5 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Got 1 possible topologies {{(pid=75229) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 09:50:17 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-0525ff71-2c09-4019-a064-78e082379aa5 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 09:50:17 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-0525ff71-2c09-4019-a064-78e082379aa5 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 09:50:17 user nova-compute[75229]: DEBUG nova.virt.libvirt.vif [None req-0525ff71-2c09-4019-a064-78e082379aa5 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T09:50:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-194804866',display_name='tempest-AttachVolumeNegativeTest-server-194804866',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-194804866',id=22,image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCH+ISYLuegqrbiRaGCaTLv5WJjPfOkoNb9QL15VoZ9ywRDwfO4Pjwl3HygOM1y1gAP3vd9UvUZSkQ3oDf9U60JcBir566GFrToUKfNOu6e6O78mAKueTXDnMCXFfFB+bg==',key_name='tempest-keypair-371679735',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8b8d48c38c7344f5b12d0ed5b9392554',ramdisk_id='',reservation_id='r-w5r6qttw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-140392099',owner_user_name='tempest-AttachVolumeNegativeTest-140392099-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T09:50:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3b8313e365eb4970a58c412768e959bf',uuid=5abd12fe-e6fc-4cb1-9674-da08e13886be,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dff81e5d-68b7-41dc-a6ce-7fda9da3b718", "address": "fa:16:3e:bb:19:d4", "network": {"id": "bd407caa-6ef6-400d-9327-3179dc1d8da4", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-29933774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b8d48c38c7344f5b12d0ed5b9392554", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdff81e5d-68", "ovs_interfaceid": "dff81e5d-68b7-41dc-a6ce-7fda9da3b718", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75229) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 09:50:17 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-0525ff71-2c09-4019-a064-78e082379aa5 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Converting VIF {"id": "dff81e5d-68b7-41dc-a6ce-7fda9da3b718", "address": "fa:16:3e:bb:19:d4", "network": {"id": "bd407caa-6ef6-400d-9327-3179dc1d8da4", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-29933774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b8d48c38c7344f5b12d0ed5b9392554", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdff81e5d-68", "ovs_interfaceid": "dff81e5d-68b7-41dc-a6ce-7fda9da3b718", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 09:50:17 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-0525ff71-2c09-4019-a064-78e082379aa5 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bb:19:d4,bridge_name='br-int',has_traffic_filtering=True,id=dff81e5d-68b7-41dc-a6ce-7fda9da3b718,network=Network(bd407caa-6ef6-400d-9327-3179dc1d8da4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdff81e5d-68') {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 09:50:17 user nova-compute[75229]: DEBUG nova.objects.instance [None req-0525ff71-2c09-4019-a064-78e082379aa5 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Lazy-loading 'pci_devices' on Instance uuid 5abd12fe-e6fc-4cb1-9674-da08e13886be {{(pid=75229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 09:50:17 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-0525ff71-2c09-4019-a064-78e082379aa5 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] [instance: 5abd12fe-e6fc-4cb1-9674-da08e13886be] End _get_guest_xml xml=<domain type="kvm">
Nov 14 09:50:17 user nova-compute[75229]:   <uuid>5abd12fe-e6fc-4cb1-9674-da08e13886be</uuid>
Nov 14 09:50:17 user nova-compute[75229]:   <name>instance-00000016</name>
Nov 14 09:50:17 user nova-compute[75229]:   <memory>524288</memory>
Nov 14 09:50:17 user nova-compute[75229]:   <vcpu>1</vcpu>
Nov 14 09:50:17 user nova-compute[75229]:   <metadata>
Nov 14 09:50:17 user nova-compute[75229]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 09:50:17 user nova-compute[75229]:       <nova:package version="0.0.0"/>
Nov 14 09:50:17 user nova-compute[75229]:       <nova:name>tempest-AttachVolumeNegativeTest-server-194804866</nova:name>
Nov 14 09:50:17 user nova-compute[75229]:       <nova:creationTime>2023-11-14 09:50:17</nova:creationTime>
Nov 14 09:50:17 user nova-compute[75229]:       <nova:flavor name="m1.tiny">
Nov 14 09:50:17 user nova-compute[75229]:         <nova:memory>512</nova:memory>
Nov 14 09:50:17 user nova-compute[75229]:         <nova:disk>1</nova:disk>
Nov 14 09:50:17 user nova-compute[75229]:         <nova:swap>0</nova:swap>
Nov 14 09:50:17 user nova-compute[75229]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 09:50:17 user nova-compute[75229]:         <nova:vcpus>1</nova:vcpus>
Nov 14 09:50:17 user nova-compute[75229]:       </nova:flavor>
Nov 14 09:50:17 user nova-compute[75229]:       <nova:owner>
Nov 14 09:50:17 user nova-compute[75229]:         <nova:user uuid="3b8313e365eb4970a58c412768e959bf">tempest-AttachVolumeNegativeTest-140392099-project-member</nova:user>
Nov 14 09:50:17 user nova-compute[75229]:         <nova:project uuid="8b8d48c38c7344f5b12d0ed5b9392554">tempest-AttachVolumeNegativeTest-140392099</nova:project>
Nov 14 09:50:17 user nova-compute[75229]:       </nova:owner>
Nov 14 09:50:17 user nova-compute[75229]:       <nova:root type="image" uuid="3bef8470-ecc7-40e3-95d4-9254348ea72d"/>
Nov 14 09:50:17 user nova-compute[75229]:       <nova:ports>
Nov 14 09:50:17 user nova-compute[75229]:         <nova:port uuid="dff81e5d-68b7-41dc-a6ce-7fda9da3b718">
Nov 14 09:50:17 user nova-compute[75229]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 14 09:50:17 user nova-compute[75229]:         </nova:port>
Nov 14 09:50:17 user nova-compute[75229]:       </nova:ports>
Nov 14 09:50:17 user nova-compute[75229]:     </nova:instance>
Nov 14 09:50:17 user nova-compute[75229]:   </metadata>
Nov 14 09:50:17 user nova-compute[75229]:   <sysinfo type="smbios">
Nov 14 09:50:17 user nova-compute[75229]:     <system>
Nov 14 09:50:17 user nova-compute[75229]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 09:50:17 user nova-compute[75229]:       <entry name="product">OpenStack Nova</entry>
Nov 14 09:50:17 user nova-compute[75229]:       <entry name="version">0.0.0</entry>
Nov 14 09:50:17 user nova-compute[75229]:       <entry name="serial">5abd12fe-e6fc-4cb1-9674-da08e13886be</entry>
Nov 14 09:50:17 user nova-compute[75229]:       <entry name="uuid">5abd12fe-e6fc-4cb1-9674-da08e13886be</entry>
Nov 14 09:50:17 user nova-compute[75229]:       <entry name="family">Virtual Machine</entry>
Nov 14 09:50:17 user nova-compute[75229]:     </system>
Nov 14 09:50:17 user nova-compute[75229]:   </sysinfo>
Nov 14 09:50:17 user nova-compute[75229]:   <os>
Nov 14 09:50:17 user nova-compute[75229]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 09:50:17 user nova-compute[75229]:     <boot dev="hd"/>
Nov 14 09:50:17 user nova-compute[75229]:     <smbios mode="sysinfo"/>
Nov 14 09:50:17 user nova-compute[75229]:   </os>
Nov 14 09:50:17 user nova-compute[75229]:   <features>
Nov 14 09:50:17 user nova-compute[75229]:     <acpi/>
Nov 14 09:50:17 user nova-compute[75229]:     <apic/>
Nov 14 09:50:17 user nova-compute[75229]:     <vmcoreinfo/>
Nov 14 09:50:17 user nova-compute[75229]:   </features>
Nov 14 09:50:17 user nova-compute[75229]:   <clock offset="utc">
Nov 14 09:50:17 user nova-compute[75229]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 09:50:17 user nova-compute[75229]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 09:50:17 user nova-compute[75229]:     <timer name="hpet" present="no"/>
Nov 14 09:50:17 user nova-compute[75229]:   </clock>
Nov 14 09:50:17 user nova-compute[75229]:   <cpu mode="custom" match="exact">
Nov 14 09:50:17 user nova-compute[75229]:     <model>Nehalem</model>
Nov 14 09:50:17 user nova-compute[75229]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 09:50:17 user nova-compute[75229]:   </cpu>
Nov 14 09:50:17 user nova-compute[75229]:   <devices>
Nov 14 09:50:17 user nova-compute[75229]:     <disk type="file" device="disk">
Nov 14 09:50:17 user nova-compute[75229]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 09:50:17 user nova-compute[75229]:       <source file="/opt/stack/data/nova/instances/5abd12fe-e6fc-4cb1-9674-da08e13886be/disk"/>
Nov 14 09:50:17 user nova-compute[75229]:       <target dev="vda" bus="virtio"/>
Nov 14 09:50:17 user nova-compute[75229]:     </disk>
Nov 14 09:50:17 user nova-compute[75229]:     <interface type="ethernet">
Nov 14 09:50:17 user nova-compute[75229]:       <mac address="fa:16:3e:bb:19:d4"/>
Nov 14 09:50:17 user nova-compute[75229]:       <model type="virtio"/>
Nov 14 09:50:17 user nova-compute[75229]:       <mtu size="1442"/>
Nov 14 09:50:17 user nova-compute[75229]:       <target dev="tapdff81e5d-68"/>
Nov 14 09:50:17 user nova-compute[75229]:     </interface>
Nov 14 09:50:17 user nova-compute[75229]:     <serial type="pty">
Nov 14 09:50:17 user nova-compute[75229]:       <log file="/opt/stack/data/nova/instances/5abd12fe-e6fc-4cb1-9674-da08e13886be/console.log" append="off"/>
Nov 14 09:50:17 user nova-compute[75229]:     </serial>
Nov 14 09:50:17 user nova-compute[75229]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 09:50:17 user nova-compute[75229]:     <video>
Nov 14 09:50:17 user nova-compute[75229]:       <model type="virtio"/>
Nov 14 09:50:17 user nova-compute[75229]:     </video>
Nov 14 09:50:17 user nova-compute[75229]:     <rng model="virtio">
Nov 14 09:50:17 user nova-compute[75229]:       <backend model="random">/dev/urandom</backend>
Nov 14 09:50:17 user nova-compute[75229]:     </rng>
Nov 14 09:50:17 user nova-compute[75229]:     <controller type="usb" index="0" model="none"/>
Nov 14 09:50:17 user nova-compute[75229]:     <memballoon model="virtio">
Nov 14 09:50:17 user nova-compute[75229]:       <stats period="10"/>
Nov 14 09:50:17 user nova-compute[75229]:     </memballoon>
Nov 14 09:50:17 user nova-compute[75229]:   </devices>
Nov 14 09:50:17 user nova-compute[75229]: </domain>
Nov 14 09:50:17 user nova-compute[75229]:  {{(pid=75229) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 09:50:17 user nova-compute[75229]: DEBUG nova.virt.libvirt.vif [None req-0525ff71-2c09-4019-a064-78e082379aa5 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T09:50:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-194804866',display_name='tempest-AttachVolumeNegativeTest-server-194804866',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-194804866',id=22,image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCH+ISYLuegqrbiRaGCaTLv5WJjPfOkoNb9QL15VoZ9ywRDwfO4Pjwl3HygOM1y1gAP3vd9UvUZSkQ3oDf9U60JcBir566GFrToUKfNOu6e6O78mAKueTXDnMCXFfFB+bg==',key_name='tempest-keypair-371679735',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8b8d48c38c7344f5b12d0ed5b9392554',ramdisk_id='',reservation_id='r-w5r6qttw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-140392099',owner_user_name='tempest-AttachVolumeNegativeTest-140392099-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T09:50:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3b8313e365eb4970a58c412768e959bf',uuid=5abd12fe-e6fc-4cb1-9674-da08e13886be,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dff81e5d-68b7-41dc-a6ce-7fda9da3b718", "address": "fa:16:3e:bb:19:d4", "network": {"id": "bd407caa-6ef6-400d-9327-3179dc1d8da4", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-29933774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b8d48c38c7344f5b12d0ed5b9392554", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdff81e5d-68", "ovs_interfaceid": "dff81e5d-68b7-41dc-a6ce-7fda9da3b718", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 09:50:17 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-0525ff71-2c09-4019-a064-78e082379aa5 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Converting VIF {"id": "dff81e5d-68b7-41dc-a6ce-7fda9da3b718", "address": "fa:16:3e:bb:19:d4", "network": {"id": "bd407caa-6ef6-400d-9327-3179dc1d8da4", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-29933774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b8d48c38c7344f5b12d0ed5b9392554", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdff81e5d-68", "ovs_interfaceid": "dff81e5d-68b7-41dc-a6ce-7fda9da3b718", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 09:50:17 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-0525ff71-2c09-4019-a064-78e082379aa5 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bb:19:d4,bridge_name='br-int',has_traffic_filtering=True,id=dff81e5d-68b7-41dc-a6ce-7fda9da3b718,network=Network(bd407caa-6ef6-400d-9327-3179dc1d8da4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdff81e5d-68') {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 09:50:17 user nova-compute[75229]: DEBUG os_vif [None req-0525ff71-2c09-4019-a064-78e082379aa5 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bb:19:d4,bridge_name='br-int',has_traffic_filtering=True,id=dff81e5d-68b7-41dc-a6ce-7fda9da3b718,network=Network(bd407caa-6ef6-400d-9327-3179dc1d8da4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdff81e5d-68') {{(pid=75229) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 09:50:17 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:50:17 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:50:17 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 09:50:17 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:50:17 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '865fc8ce-e1ce-5c43-92cd-2dc13a4e1d86', '_type': 'linux-noop'}}, row=False) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:50:17 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:50:17 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:50:17 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:50:17 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdff81e5d-68, may_exist=True, interface_attrs={}) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:50:17 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapdff81e5d-68, col_values=(('qos', UUID('d7a4a7b7-6270-478e-8685-90005baa92bb')),), if_exists=True) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:50:17 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapdff81e5d-68, col_values=(('external_ids', {'iface-id': 'dff81e5d-68b7-41dc-a6ce-7fda9da3b718', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bb:19:d4', 'vm-uuid': '5abd12fe-e6fc-4cb1-9674-da08e13886be'}),), if_exists=True) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:50:17 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:50:17 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 09:50:17 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:50:17 user nova-compute[75229]: INFO os_vif [None req-0525ff71-2c09-4019-a064-78e082379aa5 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bb:19:d4,bridge_name='br-int',has_traffic_filtering=True,id=dff81e5d-68b7-41dc-a6ce-7fda9da3b718,network=Network(bd407caa-6ef6-400d-9327-3179dc1d8da4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdff81e5d-68')
Nov 14 09:50:17 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-0525ff71-2c09-4019-a064-78e082379aa5 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] No BDM found with device name vda, not building metadata. {{(pid=75229) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 09:50:17 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-0525ff71-2c09-4019-a064-78e082379aa5 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] No VIF found with MAC fa:16:3e:bb:19:d4, not building metadata {{(pid=75229) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 09:50:18 user nova-compute[75229]: DEBUG nova.network.neutron [req-f0b38351-c196-4329-bd2c-9b24b1f6ddfa req-4a8e537c-ff82-422b-a0dd-03a436c74e2c service nova] [instance: 5abd12fe-e6fc-4cb1-9674-da08e13886be] Updated VIF entry in instance network info cache for port dff81e5d-68b7-41dc-a6ce-7fda9da3b718. {{(pid=75229) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 09:50:18 user nova-compute[75229]: DEBUG nova.network.neutron [req-f0b38351-c196-4329-bd2c-9b24b1f6ddfa req-4a8e537c-ff82-422b-a0dd-03a436c74e2c service nova] [instance: 5abd12fe-e6fc-4cb1-9674-da08e13886be] Updating instance_info_cache with network_info: [{"id": "dff81e5d-68b7-41dc-a6ce-7fda9da3b718", "address": "fa:16:3e:bb:19:d4", "network": {"id": "bd407caa-6ef6-400d-9327-3179dc1d8da4", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-29933774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b8d48c38c7344f5b12d0ed5b9392554", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdff81e5d-68", "ovs_interfaceid": "dff81e5d-68b7-41dc-a6ce-7fda9da3b718", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 09:50:18 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-f0b38351-c196-4329-bd2c-9b24b1f6ddfa req-4a8e537c-ff82-422b-a0dd-03a436c74e2c service nova] Releasing lock "refresh_cache-5abd12fe-e6fc-4cb1-9674-da08e13886be" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 09:50:18 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-e518f288-a511-4286-b059-2287bb9016e7 tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Acquiring lock "90bd76df-96cb-4bec-9862-853d94cdbaab" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:50:18 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-e518f288-a511-4286-b059-2287bb9016e7 tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Lock "90bd76df-96cb-4bec-9862-853d94cdbaab" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:50:18 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-e518f288-a511-4286-b059-2287bb9016e7 tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Acquiring lock "90bd76df-96cb-4bec-9862-853d94cdbaab-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:50:18 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-e518f288-a511-4286-b059-2287bb9016e7 tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Lock "90bd76df-96cb-4bec-9862-853d94cdbaab-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:50:18 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-e518f288-a511-4286-b059-2287bb9016e7 tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Lock "90bd76df-96cb-4bec-9862-853d94cdbaab-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:50:18 user nova-compute[75229]: INFO nova.compute.manager [None req-e518f288-a511-4286-b059-2287bb9016e7 tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] [instance: 90bd76df-96cb-4bec-9862-853d94cdbaab] Terminating instance
Nov 14 09:50:18 user nova-compute[75229]: DEBUG nova.compute.manager [None req-e518f288-a511-4286-b059-2287bb9016e7 tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] [instance: 90bd76df-96cb-4bec-9862-853d94cdbaab] Start destroying the instance on the hypervisor. {{(pid=75229) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 09:50:18 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:50:18 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:50:18 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:50:18 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:50:18 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:50:18 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:50:19 user nova-compute[75229]: DEBUG nova.compute.manager [req-07a5cc6d-b109-4ab7-9e1b-c58c3bd85c14 req-1f82d7ba-b0bc-4a8b-b9bd-b9ccaf2b2116 service nova] [instance: 90bd76df-96cb-4bec-9862-853d94cdbaab] Received event network-vif-unplugged-3b9b5b2a-5b1b-4ec6-900d-c27e7c4a625e {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:50:19 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-07a5cc6d-b109-4ab7-9e1b-c58c3bd85c14 req-1f82d7ba-b0bc-4a8b-b9bd-b9ccaf2b2116 service nova] Acquiring lock "90bd76df-96cb-4bec-9862-853d94cdbaab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:50:19 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-07a5cc6d-b109-4ab7-9e1b-c58c3bd85c14 req-1f82d7ba-b0bc-4a8b-b9bd-b9ccaf2b2116 service nova] Lock "90bd76df-96cb-4bec-9862-853d94cdbaab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:50:19 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-07a5cc6d-b109-4ab7-9e1b-c58c3bd85c14 req-1f82d7ba-b0bc-4a8b-b9bd-b9ccaf2b2116 service nova] Lock "90bd76df-96cb-4bec-9862-853d94cdbaab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:50:19 user nova-compute[75229]: DEBUG nova.compute.manager [req-07a5cc6d-b109-4ab7-9e1b-c58c3bd85c14 req-1f82d7ba-b0bc-4a8b-b9bd-b9ccaf2b2116 service nova] [instance: 90bd76df-96cb-4bec-9862-853d94cdbaab] No waiting events found dispatching network-vif-unplugged-3b9b5b2a-5b1b-4ec6-900d-c27e7c4a625e {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 09:50:19 user nova-compute[75229]: DEBUG nova.compute.manager [req-07a5cc6d-b109-4ab7-9e1b-c58c3bd85c14 req-1f82d7ba-b0bc-4a8b-b9bd-b9ccaf2b2116 service nova] [instance: 90bd76df-96cb-4bec-9862-853d94cdbaab] Received event network-vif-unplugged-3b9b5b2a-5b1b-4ec6-900d-c27e7c4a625e for instance with task_state deleting. {{(pid=75229) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 09:50:19 user nova-compute[75229]: DEBUG nova.compute.manager [req-07a5cc6d-b109-4ab7-9e1b-c58c3bd85c14 req-1f82d7ba-b0bc-4a8b-b9bd-b9ccaf2b2116 service nova] [instance: 90bd76df-96cb-4bec-9862-853d94cdbaab] Received event network-vif-plugged-3b9b5b2a-5b1b-4ec6-900d-c27e7c4a625e {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:50:19 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-07a5cc6d-b109-4ab7-9e1b-c58c3bd85c14 req-1f82d7ba-b0bc-4a8b-b9bd-b9ccaf2b2116 service nova] Acquiring lock "90bd76df-96cb-4bec-9862-853d94cdbaab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:50:19 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-07a5cc6d-b109-4ab7-9e1b-c58c3bd85c14 req-1f82d7ba-b0bc-4a8b-b9bd-b9ccaf2b2116 service nova] Lock "90bd76df-96cb-4bec-9862-853d94cdbaab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:50:19 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-07a5cc6d-b109-4ab7-9e1b-c58c3bd85c14 req-1f82d7ba-b0bc-4a8b-b9bd-b9ccaf2b2116 service nova] Lock "90bd76df-96cb-4bec-9862-853d94cdbaab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:50:19 user nova-compute[75229]: DEBUG nova.compute.manager [req-07a5cc6d-b109-4ab7-9e1b-c58c3bd85c14 req-1f82d7ba-b0bc-4a8b-b9bd-b9ccaf2b2116 service nova] [instance: 90bd76df-96cb-4bec-9862-853d94cdbaab] No waiting events found dispatching network-vif-plugged-3b9b5b2a-5b1b-4ec6-900d-c27e7c4a625e {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 09:50:19 user nova-compute[75229]: WARNING nova.compute.manager [req-07a5cc6d-b109-4ab7-9e1b-c58c3bd85c14 req-1f82d7ba-b0bc-4a8b-b9bd-b9ccaf2b2116 service nova] [instance: 90bd76df-96cb-4bec-9862-853d94cdbaab] Received unexpected event network-vif-plugged-3b9b5b2a-5b1b-4ec6-900d-c27e7c4a625e for instance with vm_state active and task_state deleting.
Nov 14 09:50:19 user nova-compute[75229]: INFO nova.virt.libvirt.driver [-] [instance: 90bd76df-96cb-4bec-9862-853d94cdbaab] Instance destroyed successfully.
Nov 14 09:50:19 user nova-compute[75229]: DEBUG nova.objects.instance [None req-e518f288-a511-4286-b059-2287bb9016e7 tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Lazy-loading 'resources' on Instance uuid 90bd76df-96cb-4bec-9862-853d94cdbaab {{(pid=75229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 09:50:19 user nova-compute[75229]: DEBUG nova.virt.libvirt.vif [None req-e518f288-a511-4286-b059-2287bb9016e7 tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-14T09:43:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-87180804',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-87180804',id=1,image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBONBC1lBOnKk20p2/o3g2DEYV4S0MmOiqL/3y6SgEGtYnRMtY9LagRV/BjgoGYzS5kUwcO+hOCn5LYUUXOZHlgFkRWsPnsSDpaRCWI7qP5isDTcuxzANHv5hb9uWPGI5Xw==',key_name='tempest-keypair-454270943',keypairs=<?>,launch_index=0,launched_at=2023-11-14T09:48:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ee9447f169de43829fe3ed51592752e9',ramdisk_id='',reservation_id='r-p5469a2c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-730167895',owner_user_name='tempest-AttachVolumeShelveTestJSON-730167895-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T09:48:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='319a0a5ee47a426799d40e0ebb62a3b0',uuid=90bd76df-96cb-4bec-9862-853d94cdbaab,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3b9b5b2a-5b1b-4ec6-900d-c27e7c4a625e", "address": "fa:16:3e:6e:aa:df", "network": {"id": "589aea41-545f-4875-ab56-b7aa273dad6f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-785276916-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee9447f169de43829fe3ed51592752e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b9b5b2a-5b", "ovs_interfaceid": "3b9b5b2a-5b1b-4ec6-900d-c27e7c4a625e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 09:50:19 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-e518f288-a511-4286-b059-2287bb9016e7 tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Converting VIF {"id": "3b9b5b2a-5b1b-4ec6-900d-c27e7c4a625e", "address": "fa:16:3e:6e:aa:df", "network": {"id": "589aea41-545f-4875-ab56-b7aa273dad6f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-785276916-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee9447f169de43829fe3ed51592752e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b9b5b2a-5b", "ovs_interfaceid": "3b9b5b2a-5b1b-4ec6-900d-c27e7c4a625e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 09:50:19 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-e518f288-a511-4286-b059-2287bb9016e7 tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6e:aa:df,bridge_name='br-int',has_traffic_filtering=True,id=3b9b5b2a-5b1b-4ec6-900d-c27e7c4a625e,network=Network(589aea41-545f-4875-ab56-b7aa273dad6f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b9b5b2a-5b') {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 09:50:19 user nova-compute[75229]: DEBUG os_vif [None req-e518f288-a511-4286-b059-2287bb9016e7 tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6e:aa:df,bridge_name='br-int',has_traffic_filtering=True,id=3b9b5b2a-5b1b-4ec6-900d-c27e7c4a625e,network=Network(589aea41-545f-4875-ab56-b7aa273dad6f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b9b5b2a-5b') {{(pid=75229) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 09:50:19 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:50:19 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:50:19 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3b9b5b2a-5b, bridge=br-int, if_exists=True) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:50:19 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 09:50:19 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:50:19 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:50:19 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:50:19 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:50:19 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ddbe460e-a15f-412b-b1ac-ddc8277a1c81) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:50:19 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:50:19 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 09:50:19 user nova-compute[75229]: INFO os_vif [None req-e518f288-a511-4286-b059-2287bb9016e7 tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6e:aa:df,bridge_name='br-int',has_traffic_filtering=True,id=3b9b5b2a-5b1b-4ec6-900d-c27e7c4a625e,network=Network(589aea41-545f-4875-ab56-b7aa273dad6f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b9b5b2a-5b')
Nov 14 09:50:19 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-e518f288-a511-4286-b059-2287bb9016e7 tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] [instance: 90bd76df-96cb-4bec-9862-853d94cdbaab] Deleting instance files /opt/stack/data/nova/instances/90bd76df-96cb-4bec-9862-853d94cdbaab_del
Nov 14 09:50:19 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-e518f288-a511-4286-b059-2287bb9016e7 tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] [instance: 90bd76df-96cb-4bec-9862-853d94cdbaab] Deletion of /opt/stack/data/nova/instances/90bd76df-96cb-4bec-9862-853d94cdbaab_del complete
Nov 14 09:50:19 user nova-compute[75229]: INFO nova.compute.manager [None req-e518f288-a511-4286-b059-2287bb9016e7 tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] [instance: 90bd76df-96cb-4bec-9862-853d94cdbaab] Took 1.30 seconds to destroy the instance on the hypervisor.
Nov 14 09:50:19 user nova-compute[75229]: DEBUG oslo.service.loopingcall [None req-e518f288-a511-4286-b059-2287bb9016e7 tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75229) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 09:50:19 user nova-compute[75229]: DEBUG nova.compute.manager [-] [instance: 90bd76df-96cb-4bec-9862-853d94cdbaab] Deallocating network for instance {{(pid=75229) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 09:50:19 user nova-compute[75229]: DEBUG nova.network.neutron [-] [instance: 90bd76df-96cb-4bec-9862-853d94cdbaab] deallocate_for_instance() {{(pid=75229) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 09:50:19 user nova-compute[75229]: DEBUG nova.compute.manager [req-fb4de9ad-5da5-460c-870a-6e2b41910f95 req-951fc77f-c8fa-4392-a44d-d0cb02996246 service nova] [instance: 5abd12fe-e6fc-4cb1-9674-da08e13886be] Received event network-vif-plugged-dff81e5d-68b7-41dc-a6ce-7fda9da3b718 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:50:19 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-fb4de9ad-5da5-460c-870a-6e2b41910f95 req-951fc77f-c8fa-4392-a44d-d0cb02996246 service nova] Acquiring lock "5abd12fe-e6fc-4cb1-9674-da08e13886be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:50:19 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-fb4de9ad-5da5-460c-870a-6e2b41910f95 req-951fc77f-c8fa-4392-a44d-d0cb02996246 service nova] Lock "5abd12fe-e6fc-4cb1-9674-da08e13886be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:50:19 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-fb4de9ad-5da5-460c-870a-6e2b41910f95 req-951fc77f-c8fa-4392-a44d-d0cb02996246 service nova] Lock "5abd12fe-e6fc-4cb1-9674-da08e13886be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:50:19 user nova-compute[75229]: DEBUG nova.compute.manager [req-fb4de9ad-5da5-460c-870a-6e2b41910f95 req-951fc77f-c8fa-4392-a44d-d0cb02996246 service nova] [instance: 5abd12fe-e6fc-4cb1-9674-da08e13886be] No waiting events found dispatching network-vif-plugged-dff81e5d-68b7-41dc-a6ce-7fda9da3b718 {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 09:50:19 user nova-compute[75229]: WARNING nova.compute.manager [req-fb4de9ad-5da5-460c-870a-6e2b41910f95 req-951fc77f-c8fa-4392-a44d-d0cb02996246 service nova] [instance: 5abd12fe-e6fc-4cb1-9674-da08e13886be] Received unexpected event network-vif-plugged-dff81e5d-68b7-41dc-a6ce-7fda9da3b718 for instance with vm_state building and task_state spawning.
Nov 14 09:50:19 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:50:19 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:50:20 user nova-compute[75229]: DEBUG nova.network.neutron [-] [instance: 90bd76df-96cb-4bec-9862-853d94cdbaab] Updating instance_info_cache with network_info: [] {{(pid=75229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 09:50:20 user nova-compute[75229]: INFO nova.compute.manager [-] [instance: 90bd76df-96cb-4bec-9862-853d94cdbaab] Took 0.88 seconds to deallocate network for instance.
Nov 14 09:50:20 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-e518f288-a511-4286-b059-2287bb9016e7 tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:50:20 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-e518f288-a511-4286-b059-2287bb9016e7 tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:50:20 user nova-compute[75229]: DEBUG nova.compute.provider_tree [None req-e518f288-a511-4286-b059-2287bb9016e7 tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Inventory has not changed in ProviderTree for provider: d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 {{(pid=75229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 09:50:20 user nova-compute[75229]: DEBUG nova.scheduler.client.report [None req-e518f288-a511-4286-b059-2287bb9016e7 tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Inventory has not changed for provider d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 09:50:20 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-e518f288-a511-4286-b059-2287bb9016e7 tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.443s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:50:20 user nova-compute[75229]: INFO nova.scheduler.client.report [None req-e518f288-a511-4286-b059-2287bb9016e7 tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Deleted allocations for instance 90bd76df-96cb-4bec-9862-853d94cdbaab
Nov 14 09:50:21 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-e518f288-a511-4286-b059-2287bb9016e7 tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Lock "90bd76df-96cb-4bec-9862-853d94cdbaab" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.835s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:50:21 user nova-compute[75229]: DEBUG nova.compute.manager [req-aceb32d3-adcd-414d-8128-f5fb1139d7f9 req-8f15f051-c20d-4ad6-9ed2-12702432ed21 service nova] [instance: 90bd76df-96cb-4bec-9862-853d94cdbaab] Received event network-vif-deleted-3b9b5b2a-5b1b-4ec6-900d-c27e7c4a625e {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:50:21 user nova-compute[75229]: DEBUG nova.compute.manager [req-c76bd45b-662c-4726-b343-2700930bb526 req-10a06403-c450-4f51-899e-e094f264baaa service nova] [instance: 5abd12fe-e6fc-4cb1-9674-da08e13886be] Received event network-vif-plugged-dff81e5d-68b7-41dc-a6ce-7fda9da3b718 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:50:21 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-c76bd45b-662c-4726-b343-2700930bb526 req-10a06403-c450-4f51-899e-e094f264baaa service nova] Acquiring lock "5abd12fe-e6fc-4cb1-9674-da08e13886be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:50:21 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-c76bd45b-662c-4726-b343-2700930bb526 req-10a06403-c450-4f51-899e-e094f264baaa service nova] Lock "5abd12fe-e6fc-4cb1-9674-da08e13886be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:50:21 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-c76bd45b-662c-4726-b343-2700930bb526 req-10a06403-c450-4f51-899e-e094f264baaa service nova] Lock "5abd12fe-e6fc-4cb1-9674-da08e13886be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:50:21 user nova-compute[75229]: DEBUG nova.compute.manager [req-c76bd45b-662c-4726-b343-2700930bb526 req-10a06403-c450-4f51-899e-e094f264baaa service nova] [instance: 5abd12fe-e6fc-4cb1-9674-da08e13886be] No waiting events found dispatching network-vif-plugged-dff81e5d-68b7-41dc-a6ce-7fda9da3b718 {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 09:50:21 user nova-compute[75229]: WARNING nova.compute.manager [req-c76bd45b-662c-4726-b343-2700930bb526 req-10a06403-c450-4f51-899e-e094f264baaa service nova] [instance: 5abd12fe-e6fc-4cb1-9674-da08e13886be] Received unexpected event network-vif-plugged-dff81e5d-68b7-41dc-a6ce-7fda9da3b718 for instance with vm_state building and task_state spawning.
Nov 14 09:50:21 user nova-compute[75229]: DEBUG nova.compute.manager [None req-0525ff71-2c09-4019-a064-78e082379aa5 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] [instance: 5abd12fe-e6fc-4cb1-9674-da08e13886be] Instance event wait completed in 0 seconds for  {{(pid=75229) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 09:50:21 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-0525ff71-2c09-4019-a064-78e082379aa5 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] [instance: 5abd12fe-e6fc-4cb1-9674-da08e13886be] Guest created on hypervisor {{(pid=75229) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 09:50:21 user nova-compute[75229]: INFO nova.virt.libvirt.driver [-] [instance: 5abd12fe-e6fc-4cb1-9674-da08e13886be] Instance spawned successfully.
Nov 14 09:50:21 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-0525ff71-2c09-4019-a064-78e082379aa5 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] [instance: 5abd12fe-e6fc-4cb1-9674-da08e13886be] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 09:50:21 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-0525ff71-2c09-4019-a064-78e082379aa5 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] [instance: 5abd12fe-e6fc-4cb1-9674-da08e13886be] Found default for hw_cdrom_bus of ide {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 09:50:21 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-0525ff71-2c09-4019-a064-78e082379aa5 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] [instance: 5abd12fe-e6fc-4cb1-9674-da08e13886be] Found default for hw_disk_bus of virtio {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 09:50:21 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-0525ff71-2c09-4019-a064-78e082379aa5 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] [instance: 5abd12fe-e6fc-4cb1-9674-da08e13886be] Found default for hw_input_bus of None {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 09:50:21 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-0525ff71-2c09-4019-a064-78e082379aa5 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] [instance: 5abd12fe-e6fc-4cb1-9674-da08e13886be] Found default for hw_pointer_model of None {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 09:50:21 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-0525ff71-2c09-4019-a064-78e082379aa5 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] [instance: 5abd12fe-e6fc-4cb1-9674-da08e13886be] Found default for hw_video_model of virtio {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 09:50:21 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-0525ff71-2c09-4019-a064-78e082379aa5 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] [instance: 5abd12fe-e6fc-4cb1-9674-da08e13886be] Found default for hw_vif_model of virtio {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 09:50:21 user nova-compute[75229]: INFO nova.compute.manager [None req-0525ff71-2c09-4019-a064-78e082379aa5 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] [instance: 5abd12fe-e6fc-4cb1-9674-da08e13886be] Took 6.11 seconds to spawn the instance on the hypervisor.
Nov 14 09:50:21 user nova-compute[75229]: DEBUG nova.compute.manager [None req-0525ff71-2c09-4019-a064-78e082379aa5 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] [instance: 5abd12fe-e6fc-4cb1-9674-da08e13886be] Checking state {{(pid=75229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 09:50:21 user nova-compute[75229]: INFO nova.compute.manager [None req-0525ff71-2c09-4019-a064-78e082379aa5 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] [instance: 5abd12fe-e6fc-4cb1-9674-da08e13886be] Took 7.01 seconds to build instance.
Nov 14 09:50:21 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-0525ff71-2c09-4019-a064-78e082379aa5 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Lock "5abd12fe-e6fc-4cb1-9674-da08e13886be" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.155s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:50:22 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-b52c64e8-7f4b-430f-8e6a-21145fbeb028 tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] Acquiring lock "e09b3809-2e23-401c-9a72-88feb2bb657c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:50:22 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-b52c64e8-7f4b-430f-8e6a-21145fbeb028 tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] Lock "e09b3809-2e23-401c-9a72-88feb2bb657c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:50:22 user nova-compute[75229]: INFO nova.compute.manager [None req-b52c64e8-7f4b-430f-8e6a-21145fbeb028 tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] [instance: e09b3809-2e23-401c-9a72-88feb2bb657c] Detaching volume 3fed285f-9be4-4601-8cb5-4329d7ebed8c
Nov 14 09:50:22 user nova-compute[75229]: INFO nova.virt.block_device [None req-b52c64e8-7f4b-430f-8e6a-21145fbeb028 tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] [instance: e09b3809-2e23-401c-9a72-88feb2bb657c] Attempting to driver detach volume 3fed285f-9be4-4601-8cb5-4329d7ebed8c from mountpoint /dev/vdb
Nov 14 09:50:22 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-b52c64e8-7f4b-430f-8e6a-21145fbeb028 tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] Attempting to detach device vdb from instance e09b3809-2e23-401c-9a72-88feb2bb657c from the persistent domain config. {{(pid=75229) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 09:50:22 user nova-compute[75229]: DEBUG nova.virt.libvirt.guest [None req-b52c64e8-7f4b-430f-8e6a-21145fbeb028 tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 09:50:22 user nova-compute[75229]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 09:50:22 user nova-compute[75229]:   <source dev="/dev/sde"/>
Nov 14 09:50:22 user nova-compute[75229]:   <target dev="vdb" bus="virtio"/>
Nov 14 09:50:22 user nova-compute[75229]:   <serial>3fed285f-9be4-4601-8cb5-4329d7ebed8c</serial>
Nov 14 09:50:22 user nova-compute[75229]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 09:50:22 user nova-compute[75229]: </disk>
Nov 14 09:50:22 user nova-compute[75229]:  {{(pid=75229) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 09:50:22 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-b52c64e8-7f4b-430f-8e6a-21145fbeb028 tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] Successfully detached device vdb from instance e09b3809-2e23-401c-9a72-88feb2bb657c from the persistent domain config.
Nov 14 09:50:22 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-b52c64e8-7f4b-430f-8e6a-21145fbeb028 tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance e09b3809-2e23-401c-9a72-88feb2bb657c from the live domain config. {{(pid=75229) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 09:50:22 user nova-compute[75229]: DEBUG nova.virt.libvirt.guest [None req-b52c64e8-7f4b-430f-8e6a-21145fbeb028 tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 09:50:22 user nova-compute[75229]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 09:50:22 user nova-compute[75229]:   <source dev="/dev/sde"/>
Nov 14 09:50:22 user nova-compute[75229]:   <target dev="vdb" bus="virtio"/>
Nov 14 09:50:22 user nova-compute[75229]:   <serial>3fed285f-9be4-4601-8cb5-4329d7ebed8c</serial>
Nov 14 09:50:22 user nova-compute[75229]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 09:50:22 user nova-compute[75229]: </disk>
Nov 14 09:50:22 user nova-compute[75229]:  {{(pid=75229) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 09:50:23 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:50:23 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-b52c64e8-7f4b-430f-8e6a-21145fbeb028 tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance e09b3809-2e23-401c-9a72-88feb2bb657c {{(pid=75229) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 09:50:24 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:50:28 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:50:29 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:50:33 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:50:34 user nova-compute[75229]: WARNING nova.virt.libvirt.driver [None req-77b50546-40e7-405b-9815-57f881e314fd tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance d6e2d77b-9894-4afa-8fa1-13a2842ba9a7 is timed out.
Nov 14 09:50:34 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-77b50546-40e7-405b-9815-57f881e314fd tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] Successfully detached device vdb from instance d6e2d77b-9894-4afa-8fa1-13a2842ba9a7 from the live domain config.
Nov 14 09:50:34 user nova-compute[75229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-77b50546-40e7-405b-9815-57f881e314fd tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] [instance: d6e2d77b-9894-4afa-8fa1-13a2842ba9a7] calling os-brick to detach iSCSI Volume {{(pid=75229) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 09:50:34 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-77b50546-40e7-405b-9815-57f881e314fd tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f73f85151b0>, {'target_iqn': 'iqn.2010-10.org.openstack:1a3c64c6-8528-4707-a0c0-68a0649277a0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yJZDXugh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 09:50:34 user nova-compute[75229]: WARNING os_brick.initiator.connectors.base [None req-77b50546-40e7-405b-9815-57f881e314fd tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 09:50:34 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-77b50546-40e7-405b-9815-57f881e314fd tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 09:50:34 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-77b50546-40e7-405b-9815-57f881e314fd tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 09:50:34 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:50:34 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:50:34 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[797fa8d9-6bea-404b-be4b-ea4bc687b59a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1a3c64c6-8528-4707-a0c0-68a0649277a0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2bae4836-52c2-428b-b299-a6a72899197d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:aca09258-022b-4f04-b418-f2a170332755\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a7902ab8-168d-4c8a-90e9-bf44d669ce2b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3fed285f-9be4-4601-8cb5-4329d7ebed8c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:50:34 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-77b50546-40e7-405b-9815-57f881e314fd tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 09:50:34 user nova-compute[75229]: No targets found.
Nov 14 09:50:34 user nova-compute[75229]: iSNS:
Nov 14 09:50:34 user nova-compute[75229]: No targets found.
Nov 14 09:50:34 user nova-compute[75229]: STATIC:
Nov 14 09:50:34 user nova-compute[75229]: Target: iqn.2010-10.org.openstack:1a3c64c6-8528-4707-a0c0-68a0649277a0
Nov 14 09:50:34 user nova-compute[75229]:         Portal: 172.16.0.220:3260,-1
Nov 14 09:50:34 user nova-compute[75229]:                 Iface Name: default
Nov 14 09:50:34 user nova-compute[75229]: Target: iqn.2010-10.org.openstack:2bae4836-52c2-428b-b299-a6a72899197d
Nov 14 09:50:34 user nova-compute[75229]:         Portal: 172.16.0.220:3260,-1
Nov 14 09:50:34 user nova-compute[75229]:                 Iface Name: default
Nov 14 09:50:34 user nova-compute[75229]: Target: iqn.2010-10.org.openstack:aca09258-022b-4f04-b418-f2a170332755
Nov 14 09:50:34 user nova-compute[75229]:         Portal: 172.16.0.220:3260,-1
Nov 14 09:50:34 user nova-compute[75229]:                 Iface Name: default
Nov 14 09:50:34 user nova-compute[75229]: Target: iqn.2010-10.org.openstack:a7902ab8-168d-4c8a-90e9-bf44d669ce2b
Nov 14 09:50:34 user nova-compute[75229]:         Portal: 172.16.0.220:3260,-1
Nov 14 09:50:34 user nova-compute[75229]:                 Iface Name: default
Nov 14 09:50:34 user nova-compute[75229]: Target: iqn.2010-10.org.openstack:3fed285f-9be4-4601-8cb5-4329d7ebed8c
Nov 14 09:50:34 user nova-compute[75229]:         Portal: 172.16.0.220:3260,-1
Nov 14 09:50:34 user nova-compute[75229]:                 Iface Name: default
Nov 14 09:50:34 user nova-compute[75229]: FIRMWARE:
Nov 14 09:50:34 user nova-compute[75229]: No targets found.
Nov 14 09:50:34 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 09:50:34 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-77b50546-40e7-405b-9815-57f881e314fd tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 09:50:34 user nova-compute[75229]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 09:50:34 user nova-compute[75229]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75229) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 09:50:34 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-77b50546-40e7-405b-9815-57f881e314fd tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1a3c64c6-8528-4707-a0c0-68a0649277a0', 0)] {{(pid=75229) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 09:50:34 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:50:34 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:50:34 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:50:34 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[a57f3835-8532-4eeb-b16b-c5769428510c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1a3c64c6-8528-4707-a0c0-68a0649277a0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2bae4836-52c2-428b-b299-a6a72899197d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3fed285f-9be4-4601-8cb5-4329d7ebed8c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a7902ab8-168d-4c8a-90e9-bf44d669ce2b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aca09258-022b-4f04-b418-f2a170332755\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:50:34 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:50:34 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:50:34 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[7612daca-3af1-4ae5-8354-6ce5900c3a63]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fed285f-9be4-4601-8cb5-4329d7ebed8c (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7902ab8-168d-4c8a-90e9-bf44d669ce2b (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a3c64c6-8528-4707-a0c0-68a0649277a0 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aca09258-022b-4f04-b418-f2a170332755 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bae4836-52c2-428b-b299-a6a72899197d (non-flash)\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:50:34 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-77b50546-40e7-405b-9815-57f881e314fd tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fed285f-9be4-4601-8cb5-4329d7ebed8c (non-flash)
Nov 14 09:50:34 user nova-compute[75229]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7902ab8-168d-4c8a-90e9-bf44d669ce2b (non-flash)
Nov 14 09:50:34 user nova-compute[75229]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a3c64c6-8528-4707-a0c0-68a0649277a0 (non-flash)
Nov 14 09:50:34 user nova-compute[75229]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aca09258-022b-4f04-b418-f2a170332755 (non-flash)
Nov 14 09:50:34 user nova-compute[75229]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bae4836-52c2-428b-b299-a6a72899197d (non-flash)
Nov 14 09:50:34 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 09:50:34 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-77b50546-40e7-405b-9815-57f881e314fd tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fed285f-9be4-4601-8cb5-4329d7ebed8c (non-flash)
Nov 14 09:50:34 user nova-compute[75229]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7902ab8-168d-4c8a-90e9-bf44d669ce2b (non-flash)
Nov 14 09:50:34 user nova-compute[75229]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a3c64c6-8528-4707-a0c0-68a0649277a0 (non-flash)
Nov 14 09:50:34 user nova-compute[75229]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aca09258-022b-4f04-b418-f2a170332755 (non-flash)
Nov 14 09:50:34 user nova-compute[75229]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bae4836-52c2-428b-b299-a6a72899197d (non-flash)
Nov 14 09:50:34 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 09:50:34 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-77b50546-40e7-405b-9815-57f881e314fd tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f74182daa70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1a3c64c6-8528-4707-a0c0-68a0649277a0'): ({'sdc'}, set())}) {{(pid=75229) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 09:50:34 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-77b50546-40e7-405b-9815-57f881e314fd tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] Removing single pathed devices sdc {{(pid=75229) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 09:50:34 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:50:34 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:50:34 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef8c5b30-b238-47c3-8342-7f9abe210785]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:50:34 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:50:34 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.022s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:50:34 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[033d3f6c-0bee-4f7f-953a-27f8a7e570f4]: (4, ('ok\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:50:34 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-77b50546-40e7-405b-9815-57f881e314fd tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] Flushing IO for device /dev/sdc {{(pid=75229) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 09:50:34 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:50:34 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:50:34 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0d57b7c-c97c-4a9f-acf3-d4284e603c11]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:50:34 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-77b50546-40e7-405b-9815-57f881e314fd tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75229) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 09:50:34 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:50:34 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.034s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:50:34 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a1ba9b7-0b92-4919-91fb-16f39b26d5a9]: (4, ('1', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:50:34 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-77b50546-40e7-405b-9815-57f881e314fd tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75229) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 09:50:34 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-77b50546-40e7-405b-9815-57f881e314fd tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] SCSI volumes sdc have been removed. {{(pid=75229) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 09:50:34 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-77b50546-40e7-405b-9815-57f881e314fd tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1a3c64c6-8528-4707-a0c0-68a0649277a0')] {{(pid=75229) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 09:50:34 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a3c64c6-8528-4707-a0c0-68a0649277a0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:50:34 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a3c64c6-8528-4707-a0c0-68a0649277a0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:50:34 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e1a43be-173e-4df7-b430-c36a744fc214]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:50:34 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-77b50546-40e7-405b-9815-57f881e314fd tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:50:34 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a3c64c6-8528-4707-a0c0-68a0649277a0 -p 172.16.0.220:3260 --logout {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:50:34 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a3c64c6-8528-4707-a0c0-68a0649277a0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:50:34 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d53ef31-6628-45fa-8231-bbc5b87586a0]: (4, ('Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:1a3c64c6-8528-4707-a0c0-68a0649277a0, portal: 172.16.0.220,3260]\nLogout of [sid: 22, target: iqn.2010-10.org.openstack:1a3c64c6-8528-4707-a0c0-68a0649277a0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:50:34 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-77b50546-40e7-405b-9815-57f881e314fd tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:1a3c64c6-8528-4707-a0c0-68a0649277a0, portal: 172.16.0.220,3260]
Nov 14 09:50:34 user nova-compute[75229]: Logout of [sid: 22, target: iqn.2010-10.org.openstack:1a3c64c6-8528-4707-a0c0-68a0649277a0, portal: 172.16.0.220,3260] successful.
Nov 14 09:50:34 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:50:34 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a3c64c6-8528-4707-a0c0-68a0649277a0 -p 172.16.0.220:3260 --op delete {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:50:34 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a3c64c6-8528-4707-a0c0-68a0649277a0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:50:34 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[7152d615-8f99-4deb-b949-01d1ac26f3bb]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:50:34 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-77b50546-40e7-405b-9815-57f881e314fd tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:50:34 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-77b50546-40e7-405b-9815-57f881e314fd tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.342s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 09:50:34 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-77b50546-40e7-405b-9815-57f881e314fd tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] <== disconnect_volume: return (343ms) None {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 09:50:34 user nova-compute[75229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-77b50546-40e7-405b-9815-57f881e314fd tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] [instance: d6e2d77b-9894-4afa-8fa1-13a2842ba9a7] Disconnected iSCSI Volume {{(pid=75229) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 09:50:35 user nova-compute[75229]: DEBUG nova.objects.instance [None req-77b50546-40e7-405b-9815-57f881e314fd tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] Lazy-loading 'flavor' on Instance uuid d6e2d77b-9894-4afa-8fa1-13a2842ba9a7 {{(pid=75229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 09:50:35 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-77b50546-40e7-405b-9815-57f881e314fd tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] Lock "d6e2d77b-9894-4afa-8fa1-13a2842ba9a7" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.888s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:50:35 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-5d0bb68d-e705-4876-a983-c2b0c680ff71 tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] Lock "d6e2d77b-9894-4afa-8fa1-13a2842ba9a7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 21.709s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:50:35 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-5d0bb68d-e705-4876-a983-c2b0c680ff71 tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] Acquiring lock "d6e2d77b-9894-4afa-8fa1-13a2842ba9a7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:50:35 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-5d0bb68d-e705-4876-a983-c2b0c680ff71 tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] Lock "d6e2d77b-9894-4afa-8fa1-13a2842ba9a7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:50:35 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-5d0bb68d-e705-4876-a983-c2b0c680ff71 tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] Lock "d6e2d77b-9894-4afa-8fa1-13a2842ba9a7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:50:35 user nova-compute[75229]: INFO nova.compute.manager [None req-5d0bb68d-e705-4876-a983-c2b0c680ff71 tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] [instance: d6e2d77b-9894-4afa-8fa1-13a2842ba9a7] Terminating instance
Nov 14 09:50:35 user nova-compute[75229]: DEBUG nova.compute.manager [None req-5d0bb68d-e705-4876-a983-c2b0c680ff71 tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] [instance: d6e2d77b-9894-4afa-8fa1-13a2842ba9a7] Start destroying the instance on the hypervisor. {{(pid=75229) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 09:50:35 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:50:35 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:50:35 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:50:35 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:50:35 user nova-compute[75229]: DEBUG nova.compute.manager [req-cb24dc44-ed63-4305-918f-9ac4ab1bde8a req-430b5282-d1c9-4fd7-aa99-13c56b0564b0 service nova] [instance: d6e2d77b-9894-4afa-8fa1-13a2842ba9a7] Received event network-vif-unplugged-05d6e94a-7444-4671-b2e8-b997c37965ea {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:50:35 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-cb24dc44-ed63-4305-918f-9ac4ab1bde8a req-430b5282-d1c9-4fd7-aa99-13c56b0564b0 service nova] Acquiring lock "d6e2d77b-9894-4afa-8fa1-13a2842ba9a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:50:35 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-cb24dc44-ed63-4305-918f-9ac4ab1bde8a req-430b5282-d1c9-4fd7-aa99-13c56b0564b0 service nova] Lock "d6e2d77b-9894-4afa-8fa1-13a2842ba9a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:50:35 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-cb24dc44-ed63-4305-918f-9ac4ab1bde8a req-430b5282-d1c9-4fd7-aa99-13c56b0564b0 service nova] Lock "d6e2d77b-9894-4afa-8fa1-13a2842ba9a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:50:35 user nova-compute[75229]: DEBUG nova.compute.manager [req-cb24dc44-ed63-4305-918f-9ac4ab1bde8a req-430b5282-d1c9-4fd7-aa99-13c56b0564b0 service nova] [instance: d6e2d77b-9894-4afa-8fa1-13a2842ba9a7] No waiting events found dispatching network-vif-unplugged-05d6e94a-7444-4671-b2e8-b997c37965ea {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 09:50:35 user nova-compute[75229]: DEBUG nova.compute.manager [req-cb24dc44-ed63-4305-918f-9ac4ab1bde8a req-430b5282-d1c9-4fd7-aa99-13c56b0564b0 service nova] [instance: d6e2d77b-9894-4afa-8fa1-13a2842ba9a7] Received event network-vif-unplugged-05d6e94a-7444-4671-b2e8-b997c37965ea for instance with task_state deleting. {{(pid=75229) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 09:50:36 user nova-compute[75229]: INFO nova.virt.libvirt.driver [-] [instance: d6e2d77b-9894-4afa-8fa1-13a2842ba9a7] Instance destroyed successfully.
Nov 14 09:50:36 user nova-compute[75229]: DEBUG nova.objects.instance [None req-5d0bb68d-e705-4876-a983-c2b0c680ff71 tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] Lazy-loading 'resources' on Instance uuid d6e2d77b-9894-4afa-8fa1-13a2842ba9a7 {{(pid=75229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 09:50:36 user nova-compute[75229]: DEBUG nova.virt.libvirt.vif [None req-5d0bb68d-e705-4876-a983-c2b0c680ff71 tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T09:48:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-161153698',display_name='tempest-VolumesSnapshotTestJSON-instance-161153698',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-161153698',id=16,image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD1ns/Jr45ukV2Y3duFLk5SuDHY4g/7oYMty7tukJKQ158uwBywoFts56N8SMrnSQG2VaDtHtZT9xM7w+BbeuoWquQOuAF9N85kTE48U9KH23eMvTtBNVlNPGSM3hkmyXQ==',key_name='tempest-keypair-254709066',keypairs=<?>,launch_index=0,launched_at=2023-11-14T09:48:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9d2e9dceab8a45eaa3adb619433b7cf0',ramdisk_id='',reservation_id='r-rltyyx3j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-1180270100',owner_user_name='tempest-VolumesSnapshotTestJSON-1180270100-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T09:48:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='915a9d3b56244777aba6ea938e150d3d',uuid=d6e2d77b-9894-4afa-8fa1-13a2842ba9a7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "05d6e94a-7444-4671-b2e8-b997c37965ea", "address": "fa:16:3e:a0:ae:e3", "network": {"id": "4bc624aa-efaf-45a9-b889-84d4bf2953b4", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-271284704-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.109", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d2e9dceab8a45eaa3adb619433b7cf0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05d6e94a-74", "ovs_interfaceid": "05d6e94a-7444-4671-b2e8-b997c37965ea", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 09:50:36 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-5d0bb68d-e705-4876-a983-c2b0c680ff71 tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] Converting VIF {"id": "05d6e94a-7444-4671-b2e8-b997c37965ea", "address": "fa:16:3e:a0:ae:e3", "network": {"id": "4bc624aa-efaf-45a9-b889-84d4bf2953b4", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-271284704-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.109", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d2e9dceab8a45eaa3adb619433b7cf0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05d6e94a-74", "ovs_interfaceid": "05d6e94a-7444-4671-b2e8-b997c37965ea", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 09:50:36 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-5d0bb68d-e705-4876-a983-c2b0c680ff71 tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a0:ae:e3,bridge_name='br-int',has_traffic_filtering=True,id=05d6e94a-7444-4671-b2e8-b997c37965ea,network=Network(4bc624aa-efaf-45a9-b889-84d4bf2953b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap05d6e94a-74') {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 09:50:36 user nova-compute[75229]: DEBUG os_vif [None req-5d0bb68d-e705-4876-a983-c2b0c680ff71 tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a0:ae:e3,bridge_name='br-int',has_traffic_filtering=True,id=05d6e94a-7444-4671-b2e8-b997c37965ea,network=Network(4bc624aa-efaf-45a9-b889-84d4bf2953b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap05d6e94a-74') {{(pid=75229) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 09:50:36 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:50:36 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap05d6e94a-74, bridge=br-int, if_exists=True) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:50:36 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:50:36 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:50:36 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:50:36 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9b5a6681-e8f5-48b1-9122-714a8f0d35cf) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:50:36 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:50:36 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:50:36 user nova-compute[75229]: INFO os_vif [None req-5d0bb68d-e705-4876-a983-c2b0c680ff71 tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a0:ae:e3,bridge_name='br-int',has_traffic_filtering=True,id=05d6e94a-7444-4671-b2e8-b997c37965ea,network=Network(4bc624aa-efaf-45a9-b889-84d4bf2953b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap05d6e94a-74')
Nov 14 09:50:36 user nova-compute[75229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5d0bb68d-e705-4876-a983-c2b0c680ff71 tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] [instance: d6e2d77b-9894-4afa-8fa1-13a2842ba9a7] calling os-brick to detach iSCSI Volume {{(pid=75229) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 09:50:36 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d0bb68d-e705-4876-a983-c2b0c680ff71 tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f73f85151b0>, {'target_iqn': 'iqn.2010-10.org.openstack:1a3c64c6-8528-4707-a0c0-68a0649277a0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yJZDXugh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 09:50:36 user nova-compute[75229]: WARNING os_brick.initiator.connectors.base [None req-5d0bb68d-e705-4876-a983-c2b0c680ff71 tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 09:50:36 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-5d0bb68d-e705-4876-a983-c2b0c680ff71 tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 09:50:36 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-5d0bb68d-e705-4876-a983-c2b0c680ff71 tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 09:50:36 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:50:36 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:50:36 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[84ed082d-d56f-4551-83ed-cab91929e9cb]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2bae4836-52c2-428b-b299-a6a72899197d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:aca09258-022b-4f04-b418-f2a170332755\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a7902ab8-168d-4c8a-90e9-bf44d669ce2b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3fed285f-9be4-4601-8cb5-4329d7ebed8c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:50:36 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d0bb68d-e705-4876-a983-c2b0c680ff71 tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 09:50:36 user nova-compute[75229]: No targets found.
Nov 14 09:50:36 user nova-compute[75229]: iSNS:
Nov 14 09:50:36 user nova-compute[75229]: No targets found.
Nov 14 09:50:36 user nova-compute[75229]: STATIC:
Nov 14 09:50:36 user nova-compute[75229]: Target: iqn.2010-10.org.openstack:2bae4836-52c2-428b-b299-a6a72899197d
Nov 14 09:50:36 user nova-compute[75229]:         Portal: 172.16.0.220:3260,-1
Nov 14 09:50:36 user nova-compute[75229]:                 Iface Name: default
Nov 14 09:50:36 user nova-compute[75229]: Target: iqn.2010-10.org.openstack:aca09258-022b-4f04-b418-f2a170332755
Nov 14 09:50:36 user nova-compute[75229]:         Portal: 172.16.0.220:3260,-1
Nov 14 09:50:36 user nova-compute[75229]:                 Iface Name: default
Nov 14 09:50:36 user nova-compute[75229]: Target: iqn.2010-10.org.openstack:a7902ab8-168d-4c8a-90e9-bf44d669ce2b
Nov 14 09:50:36 user nova-compute[75229]:         Portal: 172.16.0.220:3260,-1
Nov 14 09:50:36 user nova-compute[75229]:                 Iface Name: default
Nov 14 09:50:36 user nova-compute[75229]: Target: iqn.2010-10.org.openstack:3fed285f-9be4-4601-8cb5-4329d7ebed8c
Nov 14 09:50:36 user nova-compute[75229]:         Portal: 172.16.0.220:3260,-1
Nov 14 09:50:36 user nova-compute[75229]:                 Iface Name: default
Nov 14 09:50:36 user nova-compute[75229]: FIRMWARE:
Nov 14 09:50:36 user nova-compute[75229]: No targets found.
Nov 14 09:50:36 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 09:50:36 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d0bb68d-e705-4876-a983-c2b0c680ff71 tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 09:50:36 user nova-compute[75229]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 09:50:36 user nova-compute[75229]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75229) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 09:50:36 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d0bb68d-e705-4876-a983-c2b0c680ff71 tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1a3c64c6-8528-4707-a0c0-68a0649277a0', 0)] {{(pid=75229) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 09:50:36 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:50:36 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:50:36 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[903c92e8-efa4-4b68-bcc5-2d9328f995c9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2bae4836-52c2-428b-b299-a6a72899197d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3fed285f-9be4-4601-8cb5-4329d7ebed8c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a7902ab8-168d-4c8a-90e9-bf44d669ce2b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aca09258-022b-4f04-b418-f2a170332755\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:50:36 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:50:36 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:50:36 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c2a5172-ffc6-4a51-9465-ec909808ac9d]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fed285f-9be4-4601-8cb5-4329d7ebed8c (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7902ab8-168d-4c8a-90e9-bf44d669ce2b (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aca09258-022b-4f04-b418-f2a170332755 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bae4836-52c2-428b-b299-a6a72899197d (non-flash)\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:50:36 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d0bb68d-e705-4876-a983-c2b0c680ff71 tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fed285f-9be4-4601-8cb5-4329d7ebed8c (non-flash)
Nov 14 09:50:36 user nova-compute[75229]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7902ab8-168d-4c8a-90e9-bf44d669ce2b (non-flash)
Nov 14 09:50:36 user nova-compute[75229]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aca09258-022b-4f04-b418-f2a170332755 (non-flash)
Nov 14 09:50:36 user nova-compute[75229]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bae4836-52c2-428b-b299-a6a72899197d (non-flash)
Nov 14 09:50:36 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 09:50:36 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d0bb68d-e705-4876-a983-c2b0c680ff71 tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fed285f-9be4-4601-8cb5-4329d7ebed8c (non-flash)
Nov 14 09:50:36 user nova-compute[75229]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7902ab8-168d-4c8a-90e9-bf44d669ce2b (non-flash)
Nov 14 09:50:36 user nova-compute[75229]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aca09258-022b-4f04-b418-f2a170332755 (non-flash)
Nov 14 09:50:36 user nova-compute[75229]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bae4836-52c2-428b-b299-a6a72899197d (non-flash)
Nov 14 09:50:36 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 09:50:36 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d0bb68d-e705-4876-a983-c2b0c680ff71 tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f74182da680>, {}) {{(pid=75229) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 09:50:36 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d0bb68d-e705-4876-a983-c2b0c680ff71 tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] Disconnecting from: [] {{(pid=75229) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 09:50:36 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-5d0bb68d-e705-4876-a983-c2b0c680ff71 tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.084s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 09:50:36 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d0bb68d-e705-4876-a983-c2b0c680ff71 tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] <== disconnect_volume: return (85ms) None {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 09:50:36 user nova-compute[75229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5d0bb68d-e705-4876-a983-c2b0c680ff71 tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] [instance: d6e2d77b-9894-4afa-8fa1-13a2842ba9a7] Disconnected iSCSI Volume {{(pid=75229) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 09:50:36 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-5d0bb68d-e705-4876-a983-c2b0c680ff71 tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] [instance: d6e2d77b-9894-4afa-8fa1-13a2842ba9a7] Deleting instance files /opt/stack/data/nova/instances/d6e2d77b-9894-4afa-8fa1-13a2842ba9a7_del
Nov 14 09:50:36 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-5d0bb68d-e705-4876-a983-c2b0c680ff71 tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] [instance: d6e2d77b-9894-4afa-8fa1-13a2842ba9a7] Deletion of /opt/stack/data/nova/instances/d6e2d77b-9894-4afa-8fa1-13a2842ba9a7_del complete
Nov 14 09:50:36 user nova-compute[75229]: INFO nova.compute.manager [None req-5d0bb68d-e705-4876-a983-c2b0c680ff71 tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] [instance: d6e2d77b-9894-4afa-8fa1-13a2842ba9a7] Took 1.00 seconds to destroy the instance on the hypervisor.
Nov 14 09:50:36 user nova-compute[75229]: DEBUG oslo.service.loopingcall [None req-5d0bb68d-e705-4876-a983-c2b0c680ff71 tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75229) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 09:50:36 user nova-compute[75229]: DEBUG nova.compute.manager [-] [instance: d6e2d77b-9894-4afa-8fa1-13a2842ba9a7] Deallocating network for instance {{(pid=75229) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 09:50:36 user nova-compute[75229]: DEBUG nova.network.neutron [-] [instance: d6e2d77b-9894-4afa-8fa1-13a2842ba9a7] deallocate_for_instance() {{(pid=75229) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 09:50:37 user nova-compute[75229]: DEBUG nova.network.neutron [-] [instance: d6e2d77b-9894-4afa-8fa1-13a2842ba9a7] Updating instance_info_cache with network_info: [] {{(pid=75229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 09:50:37 user nova-compute[75229]: INFO nova.compute.manager [-] [instance: d6e2d77b-9894-4afa-8fa1-13a2842ba9a7] Took 0.68 seconds to deallocate network for instance.
Nov 14 09:50:37 user nova-compute[75229]: DEBUG nova.compute.manager [req-541b5c33-ad1f-4e1b-a130-65171f72b053 req-7fbe721a-a039-457c-9453-5f568984b315 service nova] [instance: d6e2d77b-9894-4afa-8fa1-13a2842ba9a7] Received event network-vif-deleted-05d6e94a-7444-4671-b2e8-b997c37965ea {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:50:37 user nova-compute[75229]: INFO nova.compute.manager [req-541b5c33-ad1f-4e1b-a130-65171f72b053 req-7fbe721a-a039-457c-9453-5f568984b315 service nova] [instance: d6e2d77b-9894-4afa-8fa1-13a2842ba9a7] Neutron deleted interface 05d6e94a-7444-4671-b2e8-b997c37965ea; detaching it from the instance and deleting it from the info cache
Nov 14 09:50:37 user nova-compute[75229]: DEBUG nova.network.neutron [req-541b5c33-ad1f-4e1b-a130-65171f72b053 req-7fbe721a-a039-457c-9453-5f568984b315 service nova] [instance: d6e2d77b-9894-4afa-8fa1-13a2842ba9a7] Updating instance_info_cache with network_info: [] {{(pid=75229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 09:50:37 user nova-compute[75229]: WARNING nova.volume.cinder [None req-5d0bb68d-e705-4876-a983-c2b0c680ff71 tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] Attachment 10f5ce3c-f1f0-4859-ac22-b09cf441ce76 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 10f5ce3c-f1f0-4859-ac22-b09cf441ce76. (HTTP 404) (Request-ID: req-b5ec8e9f-36c4-444a-a0d0-69121def0b0f)
Nov 14 09:50:37 user nova-compute[75229]: INFO nova.compute.manager [None req-5d0bb68d-e705-4876-a983-c2b0c680ff71 tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] [instance: d6e2d77b-9894-4afa-8fa1-13a2842ba9a7] Took 0.03 seconds to detach 1 volumes for instance.
Nov 14 09:50:37 user nova-compute[75229]: DEBUG nova.compute.manager [req-541b5c33-ad1f-4e1b-a130-65171f72b053 req-7fbe721a-a039-457c-9453-5f568984b315 service nova] [instance: d6e2d77b-9894-4afa-8fa1-13a2842ba9a7] Detach interface failed, port_id=05d6e94a-7444-4671-b2e8-b997c37965ea, reason: Instance d6e2d77b-9894-4afa-8fa1-13a2842ba9a7 could not be found. {{(pid=75229) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 14 09:50:37 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-5d0bb68d-e705-4876-a983-c2b0c680ff71 tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:50:37 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-5d0bb68d-e705-4876-a983-c2b0c680ff71 tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:50:37 user nova-compute[75229]: DEBUG nova.compute.provider_tree [None req-5d0bb68d-e705-4876-a983-c2b0c680ff71 tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] Inventory has not changed in ProviderTree for provider: d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 {{(pid=75229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 09:50:37 user nova-compute[75229]: DEBUG nova.scheduler.client.report [None req-5d0bb68d-e705-4876-a983-c2b0c680ff71 tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] Inventory has not changed for provider d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 09:50:37 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-5d0bb68d-e705-4876-a983-c2b0c680ff71 tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.501s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:50:37 user nova-compute[75229]: INFO nova.scheduler.client.report [None req-5d0bb68d-e705-4876-a983-c2b0c680ff71 tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] Deleted allocations for instance d6e2d77b-9894-4afa-8fa1-13a2842ba9a7
Nov 14 09:50:37 user nova-compute[75229]: DEBUG nova.compute.manager [req-d0e39c67-77cb-4df1-b8f8-64428c9bfd20 req-0c1ac348-3f7c-44cf-a95d-9a877e70ca37 service nova] [instance: d6e2d77b-9894-4afa-8fa1-13a2842ba9a7] Received event network-vif-plugged-05d6e94a-7444-4671-b2e8-b997c37965ea {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:50:37 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-d0e39c67-77cb-4df1-b8f8-64428c9bfd20 req-0c1ac348-3f7c-44cf-a95d-9a877e70ca37 service nova] Acquiring lock "d6e2d77b-9894-4afa-8fa1-13a2842ba9a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:50:37 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-d0e39c67-77cb-4df1-b8f8-64428c9bfd20 req-0c1ac348-3f7c-44cf-a95d-9a877e70ca37 service nova] Lock "d6e2d77b-9894-4afa-8fa1-13a2842ba9a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:50:37 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-d0e39c67-77cb-4df1-b8f8-64428c9bfd20 req-0c1ac348-3f7c-44cf-a95d-9a877e70ca37 service nova] Lock "d6e2d77b-9894-4afa-8fa1-13a2842ba9a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:50:37 user nova-compute[75229]: DEBUG nova.compute.manager [req-d0e39c67-77cb-4df1-b8f8-64428c9bfd20 req-0c1ac348-3f7c-44cf-a95d-9a877e70ca37 service nova] [instance: d6e2d77b-9894-4afa-8fa1-13a2842ba9a7] No waiting events found dispatching network-vif-plugged-05d6e94a-7444-4671-b2e8-b997c37965ea {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 09:50:37 user nova-compute[75229]: WARNING nova.compute.manager [req-d0e39c67-77cb-4df1-b8f8-64428c9bfd20 req-0c1ac348-3f7c-44cf-a95d-9a877e70ca37 service nova] [instance: d6e2d77b-9894-4afa-8fa1-13a2842ba9a7] Received unexpected event network-vif-plugged-05d6e94a-7444-4671-b2e8-b997c37965ea for instance with vm_state deleted and task_state None.
Nov 14 09:50:38 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-5d0bb68d-e705-4876-a983-c2b0c680ff71 tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] Lock "d6e2d77b-9894-4afa-8fa1-13a2842ba9a7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.492s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:50:38 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:50:39 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:50:41 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:50:43 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:50:43 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:50:43 user nova-compute[75229]: WARNING nova.virt.libvirt.driver [None req-b52c64e8-7f4b-430f-8e6a-21145fbeb028 tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance e09b3809-2e23-401c-9a72-88feb2bb657c is timed out.
Nov 14 09:50:43 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-b52c64e8-7f4b-430f-8e6a-21145fbeb028 tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] Successfully detached device vdb from instance e09b3809-2e23-401c-9a72-88feb2bb657c from the live domain config.
Nov 14 09:50:43 user nova-compute[75229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b52c64e8-7f4b-430f-8e6a-21145fbeb028 tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] [instance: e09b3809-2e23-401c-9a72-88feb2bb657c] calling os-brick to detach iSCSI Volume {{(pid=75229) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 09:50:43 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-b52c64e8-7f4b-430f-8e6a-21145fbeb028 tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f73f85151b0>, {'target_iqn': 'iqn.2010-10.org.openstack:3fed285f-9be4-4601-8cb5-4329d7ebed8c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NPZTmsSG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 09:50:43 user nova-compute[75229]: WARNING os_brick.initiator.connectors.base [None req-b52c64e8-7f4b-430f-8e6a-21145fbeb028 tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 09:50:43 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-b52c64e8-7f4b-430f-8e6a-21145fbeb028 tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 09:50:43 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-b52c64e8-7f4b-430f-8e6a-21145fbeb028 tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 09:50:43 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:50:43 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:50:43 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[456aaadf-d196-4296-a3ef-32f887f002b8]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2bae4836-52c2-428b-b299-a6a72899197d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:aca09258-022b-4f04-b418-f2a170332755\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a7902ab8-168d-4c8a-90e9-bf44d669ce2b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3fed285f-9be4-4601-8cb5-4329d7ebed8c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:50:43 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-b52c64e8-7f4b-430f-8e6a-21145fbeb028 tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 09:50:43 user nova-compute[75229]: No targets found.
Nov 14 09:50:43 user nova-compute[75229]: iSNS:
Nov 14 09:50:43 user nova-compute[75229]: No targets found.
Nov 14 09:50:43 user nova-compute[75229]: STATIC:
Nov 14 09:50:43 user nova-compute[75229]: Target: iqn.2010-10.org.openstack:2bae4836-52c2-428b-b299-a6a72899197d
Nov 14 09:50:43 user nova-compute[75229]:         Portal: 172.16.0.220:3260,-1
Nov 14 09:50:43 user nova-compute[75229]:                 Iface Name: default
Nov 14 09:50:43 user nova-compute[75229]: Target: iqn.2010-10.org.openstack:aca09258-022b-4f04-b418-f2a170332755
Nov 14 09:50:43 user nova-compute[75229]:         Portal: 172.16.0.220:3260,-1
Nov 14 09:50:43 user nova-compute[75229]:                 Iface Name: default
Nov 14 09:50:43 user nova-compute[75229]: Target: iqn.2010-10.org.openstack:a7902ab8-168d-4c8a-90e9-bf44d669ce2b
Nov 14 09:50:43 user nova-compute[75229]:         Portal: 172.16.0.220:3260,-1
Nov 14 09:50:43 user nova-compute[75229]:                 Iface Name: default
Nov 14 09:50:43 user nova-compute[75229]: Target: iqn.2010-10.org.openstack:3fed285f-9be4-4601-8cb5-4329d7ebed8c
Nov 14 09:50:43 user nova-compute[75229]:         Portal: 172.16.0.220:3260,-1
Nov 14 09:50:43 user nova-compute[75229]:                 Iface Name: default
Nov 14 09:50:43 user nova-compute[75229]: FIRMWARE:
Nov 14 09:50:43 user nova-compute[75229]: No targets found.
Nov 14 09:50:43 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 09:50:43 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-b52c64e8-7f4b-430f-8e6a-21145fbeb028 tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 09:50:43 user nova-compute[75229]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 09:50:43 user nova-compute[75229]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75229) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 09:50:43 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-b52c64e8-7f4b-430f-8e6a-21145fbeb028 tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3fed285f-9be4-4601-8cb5-4329d7ebed8c', 0)] {{(pid=75229) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 09:50:43 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:50:43 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:50:43 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbc88df6-005b-4c67-a92d-ea3d67a533b3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2bae4836-52c2-428b-b299-a6a72899197d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3fed285f-9be4-4601-8cb5-4329d7ebed8c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a7902ab8-168d-4c8a-90e9-bf44d669ce2b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aca09258-022b-4f04-b418-f2a170332755\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:50:43 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:50:43 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:50:43 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fa5c3fa-277d-4435-9b45-6db2c5557eb1]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fed285f-9be4-4601-8cb5-4329d7ebed8c (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7902ab8-168d-4c8a-90e9-bf44d669ce2b (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aca09258-022b-4f04-b418-f2a170332755 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bae4836-52c2-428b-b299-a6a72899197d (non-flash)\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:50:43 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-b52c64e8-7f4b-430f-8e6a-21145fbeb028 tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fed285f-9be4-4601-8cb5-4329d7ebed8c (non-flash)
Nov 14 09:50:43 user nova-compute[75229]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7902ab8-168d-4c8a-90e9-bf44d669ce2b (non-flash)
Nov 14 09:50:43 user nova-compute[75229]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aca09258-022b-4f04-b418-f2a170332755 (non-flash)
Nov 14 09:50:43 user nova-compute[75229]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bae4836-52c2-428b-b299-a6a72899197d (non-flash)
Nov 14 09:50:43 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 09:50:43 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-b52c64e8-7f4b-430f-8e6a-21145fbeb028 tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fed285f-9be4-4601-8cb5-4329d7ebed8c (non-flash)
Nov 14 09:50:43 user nova-compute[75229]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7902ab8-168d-4c8a-90e9-bf44d669ce2b (non-flash)
Nov 14 09:50:43 user nova-compute[75229]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aca09258-022b-4f04-b418-f2a170332755 (non-flash)
Nov 14 09:50:43 user nova-compute[75229]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bae4836-52c2-428b-b299-a6a72899197d (non-flash)
Nov 14 09:50:43 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 09:50:43 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-b52c64e8-7f4b-430f-8e6a-21145fbeb028 tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f741823b880>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3fed285f-9be4-4601-8cb5-4329d7ebed8c'): ({'sde'}, set())}) {{(pid=75229) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 09:50:43 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-b52c64e8-7f4b-430f-8e6a-21145fbeb028 tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] Removing single pathed devices sde {{(pid=75229) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 09:50:43 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:50:43 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:50:43 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[b33f8ae9-baef-4bc6-8d0d-5598f4f88cc1]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:50:43 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:50:43 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:50:43 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[538694db-a0f6-4022-8a81-1ed49241f6cd]: (4, ('ok\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:50:43 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-b52c64e8-7f4b-430f-8e6a-21145fbeb028 tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] Flushing IO for device /dev/sde {{(pid=75229) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 09:50:43 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:50:43 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:50:43 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[81e46f5a-cee8-4630-8c11-ba18c10ea79c]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:50:43 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-b52c64e8-7f4b-430f-8e6a-21145fbeb028 tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75229) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 09:50:43 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:50:43 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.056s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:50:43 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd510dd7-fed8-42b5-87ac-d0a74ce7c86a]: (4, ('1', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:50:43 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-b52c64e8-7f4b-430f-8e6a-21145fbeb028 tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75229) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 09:50:43 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-b52c64e8-7f4b-430f-8e6a-21145fbeb028 tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] SCSI volumes sde have been removed. {{(pid=75229) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 09:50:43 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-b52c64e8-7f4b-430f-8e6a-21145fbeb028 tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3fed285f-9be4-4601-8cb5-4329d7ebed8c')] {{(pid=75229) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 09:50:43 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3fed285f-9be4-4601-8cb5-4329d7ebed8c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:50:43 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3fed285f-9be4-4601-8cb5-4329d7ebed8c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:50:43 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[13459539-1e53-4a5e-9961-69a4fe4d1d28]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:50:43 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-b52c64e8-7f4b-430f-8e6a-21145fbeb028 tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:50:43 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3fed285f-9be4-4601-8cb5-4329d7ebed8c -p 172.16.0.220:3260 --logout {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:50:43 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3fed285f-9be4-4601-8cb5-4329d7ebed8c -p 172.16.0.220:3260 --logout" returned: 0 in 0.080s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:50:43 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a6f179b-ec78-4cd8-bfa6-672360062a8a]: (4, ('Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:3fed285f-9be4-4601-8cb5-4329d7ebed8c, portal: 172.16.0.220,3260]\nLogout of [sid: 16, target: iqn.2010-10.org.openstack:3fed285f-9be4-4601-8cb5-4329d7ebed8c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:50:43 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-b52c64e8-7f4b-430f-8e6a-21145fbeb028 tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:3fed285f-9be4-4601-8cb5-4329d7ebed8c, portal: 172.16.0.220,3260]
Nov 14 09:50:43 user nova-compute[75229]: Logout of [sid: 16, target: iqn.2010-10.org.openstack:3fed285f-9be4-4601-8cb5-4329d7ebed8c, portal: 172.16.0.220,3260] successful.
Nov 14 09:50:43 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:50:43 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3fed285f-9be4-4601-8cb5-4329d7ebed8c -p 172.16.0.220:3260 --op delete {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:50:43 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3fed285f-9be4-4601-8cb5-4329d7ebed8c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:50:43 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c4ad45d-4350-4000-8818-00b57e40388d]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:50:43 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-b52c64e8-7f4b-430f-8e6a-21145fbeb028 tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:50:43 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-b52c64e8-7f4b-430f-8e6a-21145fbeb028 tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.343s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 09:50:43 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-b52c64e8-7f4b-430f-8e6a-21145fbeb028 tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] <== disconnect_volume: return (344ms) None {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 09:50:43 user nova-compute[75229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b52c64e8-7f4b-430f-8e6a-21145fbeb028 tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] [instance: e09b3809-2e23-401c-9a72-88feb2bb657c] Disconnected iSCSI Volume {{(pid=75229) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 09:50:44 user nova-compute[75229]: DEBUG nova.objects.instance [None req-b52c64e8-7f4b-430f-8e6a-21145fbeb028 tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] Lazy-loading 'flavor' on Instance uuid e09b3809-2e23-401c-9a72-88feb2bb657c {{(pid=75229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 09:50:44 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-b52c64e8-7f4b-430f-8e6a-21145fbeb028 tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] Lock "e09b3809-2e23-401c-9a72-88feb2bb657c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.883s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:50:44 user nova-compute[75229]: INFO nova.compute.manager [None req-54fadb53-e5e0-4213-a4ee-4d3ae75e064c tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] [instance: b5170e9e-66e3-4df1-9807-4958cac6480e] Rescuing
Nov 14 09:50:44 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-54fadb53-e5e0-4213-a4ee-4d3ae75e064c tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Acquiring lock "refresh_cache-b5170e9e-66e3-4df1-9807-4958cac6480e" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 09:50:44 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-54fadb53-e5e0-4213-a4ee-4d3ae75e064c tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Acquired lock "refresh_cache-b5170e9e-66e3-4df1-9807-4958cac6480e" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 09:50:44 user nova-compute[75229]: DEBUG nova.network.neutron [None req-54fadb53-e5e0-4213-a4ee-4d3ae75e064c tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] [instance: b5170e9e-66e3-4df1-9807-4958cac6480e] Building network info cache for instance {{(pid=75229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 09:50:45 user nova-compute[75229]: DEBUG nova.network.neutron [None req-54fadb53-e5e0-4213-a4ee-4d3ae75e064c tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] [instance: b5170e9e-66e3-4df1-9807-4958cac6480e] Updating instance_info_cache with network_info: [{"id": "bed3fc1c-227e-44d2-85e1-589501a2e9dc", "address": "fa:16:3e:26:85:42", "network": {"id": "22eed29e-7148-42f9-b4c7-b97811cba8eb", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2000485731-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46457b27e3ed416e827c3c22449fb512", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbed3fc1c-22", "ovs_interfaceid": "bed3fc1c-227e-44d2-85e1-589501a2e9dc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 09:50:45 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-54fadb53-e5e0-4213-a4ee-4d3ae75e064c tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Releasing lock "refresh_cache-b5170e9e-66e3-4df1-9807-4958cac6480e" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 09:50:45 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:50:45 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:50:45 user nova-compute[75229]: DEBUG nova.compute.manager [req-09f5e8b1-ecb5-4ab5-888c-af00f1c98bbc req-14dc0b70-10b0-4884-a92b-68fb72484d8b service nova] [instance: b5170e9e-66e3-4df1-9807-4958cac6480e] Received event network-vif-unplugged-bed3fc1c-227e-44d2-85e1-589501a2e9dc {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:50:45 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-09f5e8b1-ecb5-4ab5-888c-af00f1c98bbc req-14dc0b70-10b0-4884-a92b-68fb72484d8b service nova] Acquiring lock "b5170e9e-66e3-4df1-9807-4958cac6480e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:50:45 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-09f5e8b1-ecb5-4ab5-888c-af00f1c98bbc req-14dc0b70-10b0-4884-a92b-68fb72484d8b service nova] Lock "b5170e9e-66e3-4df1-9807-4958cac6480e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:50:45 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-09f5e8b1-ecb5-4ab5-888c-af00f1c98bbc req-14dc0b70-10b0-4884-a92b-68fb72484d8b service nova] Lock "b5170e9e-66e3-4df1-9807-4958cac6480e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:50:45 user nova-compute[75229]: DEBUG nova.compute.manager [req-09f5e8b1-ecb5-4ab5-888c-af00f1c98bbc req-14dc0b70-10b0-4884-a92b-68fb72484d8b service nova] [instance: b5170e9e-66e3-4df1-9807-4958cac6480e] No waiting events found dispatching network-vif-unplugged-bed3fc1c-227e-44d2-85e1-589501a2e9dc {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 09:50:45 user nova-compute[75229]: WARNING nova.compute.manager [req-09f5e8b1-ecb5-4ab5-888c-af00f1c98bbc req-14dc0b70-10b0-4884-a92b-68fb72484d8b service nova] [instance: b5170e9e-66e3-4df1-9807-4958cac6480e] Received unexpected event network-vif-unplugged-bed3fc1c-227e-44d2-85e1-589501a2e9dc for instance with vm_state active and task_state rescuing.
Nov 14 09:50:45 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:50:45 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:50:45 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 09:50:46 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:50:46 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:50:46 user nova-compute[75229]: INFO nova.virt.libvirt.driver [-] [instance: b5170e9e-66e3-4df1-9807-4958cac6480e] Instance destroyed successfully.
Nov 14 09:50:46 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-54fadb53-e5e0-4213-a4ee-4d3ae75e064c tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] [instance: b5170e9e-66e3-4df1-9807-4958cac6480e] Attempting rescue
Nov 14 09:50:46 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-54fadb53-e5e0-4213-a4ee-4d3ae75e064c tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75229) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 14 09:50:46 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-54fadb53-e5e0-4213-a4ee-4d3ae75e064c tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] [instance: b5170e9e-66e3-4df1-9807-4958cac6480e] Instance directory exists: not creating {{(pid=75229) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 14 09:50:46 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-54fadb53-e5e0-4213-a4ee-4d3ae75e064c tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] [instance: b5170e9e-66e3-4df1-9807-4958cac6480e] Creating image(s)
Nov 14 09:50:46 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-54fadb53-e5e0-4213-a4ee-4d3ae75e064c tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Acquiring lock "/opt/stack/data/nova/instances/b5170e9e-66e3-4df1-9807-4958cac6480e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:50:46 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-54fadb53-e5e0-4213-a4ee-4d3ae75e064c tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Lock "/opt/stack/data/nova/instances/b5170e9e-66e3-4df1-9807-4958cac6480e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:50:46 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-54fadb53-e5e0-4213-a4ee-4d3ae75e064c tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Lock "/opt/stack/data/nova/instances/b5170e9e-66e3-4df1-9807-4958cac6480e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:50:46 user nova-compute[75229]: DEBUG nova.objects.instance [None req-54fadb53-e5e0-4213-a4ee-4d3ae75e064c tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Lazy-loading 'trusted_certs' on Instance uuid b5170e9e-66e3-4df1-9807-4958cac6480e {{(pid=75229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 09:50:46 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-54fadb53-e5e0-4213-a4ee-4d3ae75e064c tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Acquiring lock "4f30e3fe703d2381679612a57b1fb80a467f60b6" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:50:46 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-54fadb53-e5e0-4213-a4ee-4d3ae75e064c tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Lock "4f30e3fe703d2381679612a57b1fb80a467f60b6" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:50:46 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-54fadb53-e5e0-4213-a4ee-4d3ae75e064c tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6 --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:50:46 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-54fadb53-e5e0-4213-a4ee-4d3ae75e064c tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6 --force-share --output=json" returned: 0 in 0.167s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:50:46 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-54fadb53-e5e0-4213-a4ee-4d3ae75e064c tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6,backing_fmt=raw /opt/stack/data/nova/instances/b5170e9e-66e3-4df1-9807-4958cac6480e/disk.rescue {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:50:46 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-54fadb53-e5e0-4213-a4ee-4d3ae75e064c tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6,backing_fmt=raw /opt/stack/data/nova/instances/b5170e9e-66e3-4df1-9807-4958cac6480e/disk.rescue" returned: 0 in 0.046s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:50:46 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-54fadb53-e5e0-4213-a4ee-4d3ae75e064c tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Lock "4f30e3fe703d2381679612a57b1fb80a467f60b6" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.221s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:50:46 user nova-compute[75229]: DEBUG nova.objects.instance [None req-54fadb53-e5e0-4213-a4ee-4d3ae75e064c tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Lazy-loading 'migration_context' on Instance uuid b5170e9e-66e3-4df1-9807-4958cac6480e {{(pid=75229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 09:50:46 user nova-compute[75229]: DEBUG nova.objects.base [None req-54fadb53-e5e0-4213-a4ee-4d3ae75e064c tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Object Instance<b5170e9e-66e3-4df1-9807-4958cac6480e> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75229) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 09:50:46 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-54fadb53-e5e0-4213-a4ee-4d3ae75e064c tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] [instance: b5170e9e-66e3-4df1-9807-4958cac6480e] Created local disks {{(pid=75229) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 09:50:46 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-54fadb53-e5e0-4213-a4ee-4d3ae75e064c tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] [instance: b5170e9e-66e3-4df1-9807-4958cac6480e] Start _get_guest_xml network_info=[{"id": "bed3fc1c-227e-44d2-85e1-589501a2e9dc", "address": "fa:16:3e:26:85:42", "network": {"id": "22eed29e-7148-42f9-b4c7-b97811cba8eb", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2000485731-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-2000485731-network", "vif_mac": "fa:16:3e:26:85:42"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46457b27e3ed416e827c3c22449fb512", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbed3fc1c-22", "ovs_interfaceid": "bed3fc1c-227e-44d2-85e1-589501a2e9dc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T09:40:10Z,direct_url=<?>,disk_format='qcow2',id=3bef8470-ecc7-40e3-95d4-9254348ea72d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='de5a91106b6948ed937a7178ff9464c4',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T09:40:12Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '3bef8470-ecc7-40e3-95d4-9254348ea72d', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=75229) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 09:50:46 user nova-compute[75229]: DEBUG nova.objects.instance [None req-54fadb53-e5e0-4213-a4ee-4d3ae75e064c tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Lazy-loading 'resources' on Instance uuid b5170e9e-66e3-4df1-9807-4958cac6480e {{(pid=75229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 09:50:46 user nova-compute[75229]: DEBUG nova.objects.base [None req-54fadb53-e5e0-4213-a4ee-4d3ae75e064c tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Object Instance<b5170e9e-66e3-4df1-9807-4958cac6480e> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75229) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 09:50:46 user nova-compute[75229]: DEBUG nova.objects.instance [None req-54fadb53-e5e0-4213-a4ee-4d3ae75e064c tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Lazy-loading 'numa_topology' on Instance uuid b5170e9e-66e3-4df1-9807-4958cac6480e {{(pid=75229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 09:50:46 user nova-compute[75229]: DEBUG nova.objects.base [None req-54fadb53-e5e0-4213-a4ee-4d3ae75e064c tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Object Instance<b5170e9e-66e3-4df1-9807-4958cac6480e> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75229) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 09:50:46 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:50:46 user nova-compute[75229]: WARNING nova.virt.libvirt.driver [None req-54fadb53-e5e0-4213-a4ee-4d3ae75e064c tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 09:50:46 user nova-compute[75229]: WARNING nova.virt.libvirt.driver [None req-54fadb53-e5e0-4213-a4ee-4d3ae75e064c tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 09:50:46 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-54fadb53-e5e0-4213-a4ee-4d3ae75e064c tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75229) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 09:50:46 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-54fadb53-e5e0-4213-a4ee-4d3ae75e064c tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] CPU controller missing on host. {{(pid=75229) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 09:50:46 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-54fadb53-e5e0-4213-a4ee-4d3ae75e064c tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75229) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 09:50:46 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-54fadb53-e5e0-4213-a4ee-4d3ae75e064c tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] CPU controller found on host. {{(pid=75229) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 09:50:46 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-54fadb53-e5e0-4213-a4ee-4d3ae75e064c tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75229) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 09:50:46 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-54fadb53-e5e0-4213-a4ee-4d3ae75e064c tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T09:39:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T09:40:10Z,direct_url=<?>,disk_format='qcow2',id=3bef8470-ecc7-40e3-95d4-9254348ea72d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='de5a91106b6948ed937a7178ff9464c4',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T09:40:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 09:50:46 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-54fadb53-e5e0-4213-a4ee-4d3ae75e064c tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Flavor limits 0:0:0 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 09:50:46 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-54fadb53-e5e0-4213-a4ee-4d3ae75e064c tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Image limits 0:0:0 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 09:50:46 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-54fadb53-e5e0-4213-a4ee-4d3ae75e064c tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Flavor pref 0:0:0 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 09:50:46 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-54fadb53-e5e0-4213-a4ee-4d3ae75e064c tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Image pref 0:0:0 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 09:50:46 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-54fadb53-e5e0-4213-a4ee-4d3ae75e064c tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 09:50:46 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-54fadb53-e5e0-4213-a4ee-4d3ae75e064c tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 09:50:46 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-54fadb53-e5e0-4213-a4ee-4d3ae75e064c tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75229) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 09:50:46 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-54fadb53-e5e0-4213-a4ee-4d3ae75e064c tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Got 1 possible topologies {{(pid=75229) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 09:50:46 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-54fadb53-e5e0-4213-a4ee-4d3ae75e064c tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 09:50:46 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-54fadb53-e5e0-4213-a4ee-4d3ae75e064c tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 09:50:46 user nova-compute[75229]: DEBUG nova.objects.instance [None req-54fadb53-e5e0-4213-a4ee-4d3ae75e064c tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Lazy-loading 'vcpu_model' on Instance uuid b5170e9e-66e3-4df1-9807-4958cac6480e {{(pid=75229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 09:50:46 user nova-compute[75229]: DEBUG nova.objects.base [None req-54fadb53-e5e0-4213-a4ee-4d3ae75e064c tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Object Instance<b5170e9e-66e3-4df1-9807-4958cac6480e> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75229) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 09:50:46 user nova-compute[75229]: DEBUG nova.virt.libvirt.vif [None req-54fadb53-e5e0-4213-a4ee-4d3ae75e064c tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T09:48:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-939346932',display_name='tempest-ServerRescueNegativeTestJSON-server-939346932',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-939346932',id=19,image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-14T09:49:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='46457b27e3ed416e827c3c22449fb512',ramdisk_id='',reservation_id='r-wp091n1y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-557279920',owner_user_name='tempest-ServerRescueNegativeTestJSON-557279920-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T09:49:04Z,user_data=None,user_id='a3cb33a5c522499e8cd254edd5e15879',uuid=b5170e9e-66e3-4df1-9807-4958cac6480e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bed3fc1c-227e-44d2-85e1-589501a2e9dc", "address": "fa:16:3e:26:85:42", "network": {"id": "22eed29e-7148-42f9-b4c7-b97811cba8eb", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2000485731-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-2000485731-network", "vif_mac": "fa:16:3e:26:85:42"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46457b27e3ed416e827c3c22449fb512", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbed3fc1c-22", "ovs_interfaceid": "bed3fc1c-227e-44d2-85e1-589501a2e9dc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75229) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 09:50:46 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-54fadb53-e5e0-4213-a4ee-4d3ae75e064c tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Converting VIF {"id": "bed3fc1c-227e-44d2-85e1-589501a2e9dc", "address": "fa:16:3e:26:85:42", "network": {"id": "22eed29e-7148-42f9-b4c7-b97811cba8eb", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2000485731-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-2000485731-network", "vif_mac": "fa:16:3e:26:85:42"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46457b27e3ed416e827c3c22449fb512", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbed3fc1c-22", "ovs_interfaceid": "bed3fc1c-227e-44d2-85e1-589501a2e9dc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 09:50:46 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-54fadb53-e5e0-4213-a4ee-4d3ae75e064c tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:26:85:42,bridge_name='br-int',has_traffic_filtering=True,id=bed3fc1c-227e-44d2-85e1-589501a2e9dc,network=Network(22eed29e-7148-42f9-b4c7-b97811cba8eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbed3fc1c-22') {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 09:50:46 user nova-compute[75229]: DEBUG nova.objects.instance [None req-54fadb53-e5e0-4213-a4ee-4d3ae75e064c tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Lazy-loading 'pci_devices' on Instance uuid b5170e9e-66e3-4df1-9807-4958cac6480e {{(pid=75229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 09:50:46 user nova-compute[75229]: DEBUG nova.objects.base [None req-54fadb53-e5e0-4213-a4ee-4d3ae75e064c tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Object Instance<b5170e9e-66e3-4df1-9807-4958cac6480e> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75229) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 09:50:46 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-54fadb53-e5e0-4213-a4ee-4d3ae75e064c tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] [instance: b5170e9e-66e3-4df1-9807-4958cac6480e] End _get_guest_xml xml=<domain type="kvm">
Nov 14 09:50:46 user nova-compute[75229]:   <uuid>b5170e9e-66e3-4df1-9807-4958cac6480e</uuid>
Nov 14 09:50:46 user nova-compute[75229]:   <name>instance-00000013</name>
Nov 14 09:50:46 user nova-compute[75229]:   <memory>524288</memory>
Nov 14 09:50:46 user nova-compute[75229]:   <vcpu>1</vcpu>
Nov 14 09:50:46 user nova-compute[75229]:   <metadata>
Nov 14 09:50:46 user nova-compute[75229]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 09:50:46 user nova-compute[75229]:       <nova:package version="0.0.0"/>
Nov 14 09:50:46 user nova-compute[75229]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-939346932</nova:name>
Nov 14 09:50:46 user nova-compute[75229]:       <nova:creationTime>2023-11-14 09:50:46</nova:creationTime>
Nov 14 09:50:46 user nova-compute[75229]:       <nova:flavor name="m1.tiny">
Nov 14 09:50:46 user nova-compute[75229]:         <nova:memory>512</nova:memory>
Nov 14 09:50:46 user nova-compute[75229]:         <nova:disk>1</nova:disk>
Nov 14 09:50:46 user nova-compute[75229]:         <nova:swap>0</nova:swap>
Nov 14 09:50:46 user nova-compute[75229]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 09:50:46 user nova-compute[75229]:         <nova:vcpus>1</nova:vcpus>
Nov 14 09:50:46 user nova-compute[75229]:       </nova:flavor>
Nov 14 09:50:46 user nova-compute[75229]:       <nova:owner>
Nov 14 09:50:46 user nova-compute[75229]:         <nova:user uuid="a3cb33a5c522499e8cd254edd5e15879">tempest-ServerRescueNegativeTestJSON-557279920-project-member</nova:user>
Nov 14 09:50:46 user nova-compute[75229]:         <nova:project uuid="46457b27e3ed416e827c3c22449fb512">tempest-ServerRescueNegativeTestJSON-557279920</nova:project>
Nov 14 09:50:46 user nova-compute[75229]:       </nova:owner>
Nov 14 09:50:46 user nova-compute[75229]:       <nova:root type="image" uuid="3bef8470-ecc7-40e3-95d4-9254348ea72d"/>
Nov 14 09:50:46 user nova-compute[75229]:       <nova:ports>
Nov 14 09:50:46 user nova-compute[75229]:         <nova:port uuid="bed3fc1c-227e-44d2-85e1-589501a2e9dc">
Nov 14 09:50:46 user nova-compute[75229]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 14 09:50:46 user nova-compute[75229]:         </nova:port>
Nov 14 09:50:46 user nova-compute[75229]:       </nova:ports>
Nov 14 09:50:46 user nova-compute[75229]:     </nova:instance>
Nov 14 09:50:46 user nova-compute[75229]:   </metadata>
Nov 14 09:50:46 user nova-compute[75229]:   <sysinfo type="smbios">
Nov 14 09:50:46 user nova-compute[75229]:     <system>
Nov 14 09:50:46 user nova-compute[75229]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 09:50:46 user nova-compute[75229]:       <entry name="product">OpenStack Nova</entry>
Nov 14 09:50:46 user nova-compute[75229]:       <entry name="version">0.0.0</entry>
Nov 14 09:50:46 user nova-compute[75229]:       <entry name="serial">b5170e9e-66e3-4df1-9807-4958cac6480e</entry>
Nov 14 09:50:46 user nova-compute[75229]:       <entry name="uuid">b5170e9e-66e3-4df1-9807-4958cac6480e</entry>
Nov 14 09:50:46 user nova-compute[75229]:       <entry name="family">Virtual Machine</entry>
Nov 14 09:50:46 user nova-compute[75229]:     </system>
Nov 14 09:50:46 user nova-compute[75229]:   </sysinfo>
Nov 14 09:50:46 user nova-compute[75229]:   <os>
Nov 14 09:50:46 user nova-compute[75229]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 09:50:46 user nova-compute[75229]:     <smbios mode="sysinfo"/>
Nov 14 09:50:46 user nova-compute[75229]:   </os>
Nov 14 09:50:46 user nova-compute[75229]:   <features>
Nov 14 09:50:46 user nova-compute[75229]:     <acpi/>
Nov 14 09:50:46 user nova-compute[75229]:     <apic/>
Nov 14 09:50:46 user nova-compute[75229]:     <vmcoreinfo/>
Nov 14 09:50:46 user nova-compute[75229]:   </features>
Nov 14 09:50:46 user nova-compute[75229]:   <clock offset="utc">
Nov 14 09:50:46 user nova-compute[75229]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 09:50:46 user nova-compute[75229]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 09:50:46 user nova-compute[75229]:     <timer name="hpet" present="no"/>
Nov 14 09:50:46 user nova-compute[75229]:   </clock>
Nov 14 09:50:46 user nova-compute[75229]:   <cpu mode="custom" match="exact">
Nov 14 09:50:46 user nova-compute[75229]:     <model>Nehalem</model>
Nov 14 09:50:46 user nova-compute[75229]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 09:50:46 user nova-compute[75229]:   </cpu>
Nov 14 09:50:46 user nova-compute[75229]:   <devices>
Nov 14 09:50:46 user nova-compute[75229]:     <disk type="file" device="disk">
Nov 14 09:50:46 user nova-compute[75229]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 09:50:46 user nova-compute[75229]:       <source file="/opt/stack/data/nova/instances/b5170e9e-66e3-4df1-9807-4958cac6480e/disk.rescue"/>
Nov 14 09:50:46 user nova-compute[75229]:       <target dev="vda" bus="virtio"/>
Nov 14 09:50:46 user nova-compute[75229]:     </disk>
Nov 14 09:50:46 user nova-compute[75229]:     <disk type="file" device="disk">
Nov 14 09:50:46 user nova-compute[75229]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 09:50:46 user nova-compute[75229]:       <source file="/opt/stack/data/nova/instances/b5170e9e-66e3-4df1-9807-4958cac6480e/disk"/>
Nov 14 09:50:46 user nova-compute[75229]:       <target dev="vdb" bus="virtio"/>
Nov 14 09:50:46 user nova-compute[75229]:     </disk>
Nov 14 09:50:46 user nova-compute[75229]:     <interface type="ethernet">
Nov 14 09:50:46 user nova-compute[75229]:       <mac address="fa:16:3e:26:85:42"/>
Nov 14 09:50:46 user nova-compute[75229]:       <model type="virtio"/>
Nov 14 09:50:46 user nova-compute[75229]:       <mtu size="1442"/>
Nov 14 09:50:46 user nova-compute[75229]:       <target dev="tapbed3fc1c-22"/>
Nov 14 09:50:46 user nova-compute[75229]:     </interface>
Nov 14 09:50:46 user nova-compute[75229]:     <serial type="pty">
Nov 14 09:50:46 user nova-compute[75229]:       <log file="/opt/stack/data/nova/instances/b5170e9e-66e3-4df1-9807-4958cac6480e/console.log" append="off"/>
Nov 14 09:50:46 user nova-compute[75229]:     </serial>
Nov 14 09:50:46 user nova-compute[75229]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 09:50:46 user nova-compute[75229]:     <video>
Nov 14 09:50:46 user nova-compute[75229]:       <model type="virtio"/>
Nov 14 09:50:46 user nova-compute[75229]:     </video>
Nov 14 09:50:46 user nova-compute[75229]:     <rng model="virtio">
Nov 14 09:50:46 user nova-compute[75229]:       <backend model="random">/dev/urandom</backend>
Nov 14 09:50:46 user nova-compute[75229]:     </rng>
Nov 14 09:50:46 user nova-compute[75229]:     <controller type="usb" index="0" model="none"/>
Nov 14 09:50:46 user nova-compute[75229]:     <memballoon model="virtio">
Nov 14 09:50:46 user nova-compute[75229]:       <stats period="10"/>
Nov 14 09:50:46 user nova-compute[75229]:     </memballoon>
Nov 14 09:50:46 user nova-compute[75229]:   </devices>
Nov 14 09:50:46 user nova-compute[75229]: </domain>
Nov 14 09:50:46 user nova-compute[75229]:  {{(pid=75229) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 09:50:46 user nova-compute[75229]: INFO nova.virt.libvirt.driver [-] [instance: b5170e9e-66e3-4df1-9807-4958cac6480e] Instance destroyed successfully.
Nov 14 09:50:46 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-54fadb53-e5e0-4213-a4ee-4d3ae75e064c tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] No BDM found with device name vda, not building metadata. {{(pid=75229) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 09:50:46 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-54fadb53-e5e0-4213-a4ee-4d3ae75e064c tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75229) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 09:50:46 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-54fadb53-e5e0-4213-a4ee-4d3ae75e064c tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] No VIF found with MAC fa:16:3e:26:85:42, not building metadata {{(pid=75229) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 09:50:47 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 09:50:47 user nova-compute[75229]: DEBUG nova.compute.manager [req-fe3a30cc-83de-4465-b602-f95abc92e18f req-f4696f9f-1341-4545-836d-bc6f1a1d8d4d service nova] [instance: b5170e9e-66e3-4df1-9807-4958cac6480e] Received event network-vif-plugged-bed3fc1c-227e-44d2-85e1-589501a2e9dc {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:50:47 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-fe3a30cc-83de-4465-b602-f95abc92e18f req-f4696f9f-1341-4545-836d-bc6f1a1d8d4d service nova] Acquiring lock "b5170e9e-66e3-4df1-9807-4958cac6480e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:50:47 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-fe3a30cc-83de-4465-b602-f95abc92e18f req-f4696f9f-1341-4545-836d-bc6f1a1d8d4d service nova] Lock "b5170e9e-66e3-4df1-9807-4958cac6480e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:50:47 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-fe3a30cc-83de-4465-b602-f95abc92e18f req-f4696f9f-1341-4545-836d-bc6f1a1d8d4d service nova] Lock "b5170e9e-66e3-4df1-9807-4958cac6480e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:50:47 user nova-compute[75229]: DEBUG nova.compute.manager [req-fe3a30cc-83de-4465-b602-f95abc92e18f req-f4696f9f-1341-4545-836d-bc6f1a1d8d4d service nova] [instance: b5170e9e-66e3-4df1-9807-4958cac6480e] No waiting events found dispatching network-vif-plugged-bed3fc1c-227e-44d2-85e1-589501a2e9dc {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 09:50:47 user nova-compute[75229]: WARNING nova.compute.manager [req-fe3a30cc-83de-4465-b602-f95abc92e18f req-f4696f9f-1341-4545-836d-bc6f1a1d8d4d service nova] [instance: b5170e9e-66e3-4df1-9807-4958cac6480e] Received unexpected event network-vif-plugged-bed3fc1c-227e-44d2-85e1-589501a2e9dc for instance with vm_state active and task_state rescuing.
Nov 14 09:50:47 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:50:47 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:50:47 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:50:47 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Auditing locally available compute resources for user (node: user) {{(pid=75229) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 09:50:47 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:50:47 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:50:47 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:50:47 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:50:48 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:50:48 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:50:48 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5abd12fe-e6fc-4cb1-9674-da08e13886be/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:50:48 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5abd12fe-e6fc-4cb1-9674-da08e13886be/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:50:48 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5abd12fe-e6fc-4cb1-9674-da08e13886be/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:50:48 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5abd12fe-e6fc-4cb1-9674-da08e13886be/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:50:48 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7750cbc-b3d0-44aa-8b88-c291ba007a8a/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:50:49 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7750cbc-b3d0-44aa-8b88-c291ba007a8a/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:50:49 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7750cbc-b3d0-44aa-8b88-c291ba007a8a/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:50:49 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:50:49 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7750cbc-b3d0-44aa-8b88-c291ba007a8a/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:50:49 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a60d339f-e134-477c-8505-bf8c79d2a21c/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:50:49 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a60d339f-e134-477c-8505-bf8c79d2a21c/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:50:49 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a60d339f-e134-477c-8505-bf8c79d2a21c/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:50:49 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a60d339f-e134-477c-8505-bf8c79d2a21c/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:50:49 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75229) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 09:50:49 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be813b28-133f-416a-b2b5-dc0b9e4064b7/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:50:49 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:50:49 user nova-compute[75229]: DEBUG nova.compute.manager [req-d3cc514f-4ebb-4f10-a13e-5a81034d0418 req-6fdb4ecf-2b73-4c0d-b680-ec7408285929 service nova] [instance: b5170e9e-66e3-4df1-9807-4958cac6480e] Received event network-vif-plugged-bed3fc1c-227e-44d2-85e1-589501a2e9dc {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:50:49 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-d3cc514f-4ebb-4f10-a13e-5a81034d0418 req-6fdb4ecf-2b73-4c0d-b680-ec7408285929 service nova] Acquiring lock "b5170e9e-66e3-4df1-9807-4958cac6480e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:50:49 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-d3cc514f-4ebb-4f10-a13e-5a81034d0418 req-6fdb4ecf-2b73-4c0d-b680-ec7408285929 service nova] Lock "b5170e9e-66e3-4df1-9807-4958cac6480e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:50:49 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-d3cc514f-4ebb-4f10-a13e-5a81034d0418 req-6fdb4ecf-2b73-4c0d-b680-ec7408285929 service nova] Lock "b5170e9e-66e3-4df1-9807-4958cac6480e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:50:49 user nova-compute[75229]: DEBUG nova.compute.manager [req-d3cc514f-4ebb-4f10-a13e-5a81034d0418 req-6fdb4ecf-2b73-4c0d-b680-ec7408285929 service nova] [instance: b5170e9e-66e3-4df1-9807-4958cac6480e] No waiting events found dispatching network-vif-plugged-bed3fc1c-227e-44d2-85e1-589501a2e9dc {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 09:50:49 user nova-compute[75229]: WARNING nova.compute.manager [req-d3cc514f-4ebb-4f10-a13e-5a81034d0418 req-6fdb4ecf-2b73-4c0d-b680-ec7408285929 service nova] [instance: b5170e9e-66e3-4df1-9807-4958cac6480e] Received unexpected event network-vif-plugged-bed3fc1c-227e-44d2-85e1-589501a2e9dc for instance with vm_state active and task_state rescuing.
Nov 14 09:50:49 user nova-compute[75229]: DEBUG nova.compute.manager [req-d3cc514f-4ebb-4f10-a13e-5a81034d0418 req-6fdb4ecf-2b73-4c0d-b680-ec7408285929 service nova] [instance: b5170e9e-66e3-4df1-9807-4958cac6480e] Received event network-vif-plugged-bed3fc1c-227e-44d2-85e1-589501a2e9dc {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:50:49 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-d3cc514f-4ebb-4f10-a13e-5a81034d0418 req-6fdb4ecf-2b73-4c0d-b680-ec7408285929 service nova] Acquiring lock "b5170e9e-66e3-4df1-9807-4958cac6480e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:50:49 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-d3cc514f-4ebb-4f10-a13e-5a81034d0418 req-6fdb4ecf-2b73-4c0d-b680-ec7408285929 service nova] Lock "b5170e9e-66e3-4df1-9807-4958cac6480e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:50:49 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-d3cc514f-4ebb-4f10-a13e-5a81034d0418 req-6fdb4ecf-2b73-4c0d-b680-ec7408285929 service nova] Lock "b5170e9e-66e3-4df1-9807-4958cac6480e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:50:49 user nova-compute[75229]: DEBUG nova.compute.manager [req-d3cc514f-4ebb-4f10-a13e-5a81034d0418 req-6fdb4ecf-2b73-4c0d-b680-ec7408285929 service nova] [instance: b5170e9e-66e3-4df1-9807-4958cac6480e] No waiting events found dispatching network-vif-plugged-bed3fc1c-227e-44d2-85e1-589501a2e9dc {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 09:50:49 user nova-compute[75229]: WARNING nova.compute.manager [req-d3cc514f-4ebb-4f10-a13e-5a81034d0418 req-6fdb4ecf-2b73-4c0d-b680-ec7408285929 service nova] [instance: b5170e9e-66e3-4df1-9807-4958cac6480e] Received unexpected event network-vif-plugged-bed3fc1c-227e-44d2-85e1-589501a2e9dc for instance with vm_state active and task_state rescuing.
Nov 14 09:50:49 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be813b28-133f-416a-b2b5-dc0b9e4064b7/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:50:49 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be813b28-133f-416a-b2b5-dc0b9e4064b7/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:50:50 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be813b28-133f-416a-b2b5-dc0b9e4064b7/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:50:50 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75229) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 09:50:50 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c9fe69e-3f9d-4b30-a9e4-efc3e83efa17/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:50:50 user nova-compute[75229]: DEBUG nova.compute.manager [None req-54fadb53-e5e0-4213-a4ee-4d3ae75e064c tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] [instance: b5170e9e-66e3-4df1-9807-4958cac6480e] Checking state {{(pid=75229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 09:50:50 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c9fe69e-3f9d-4b30-a9e4-efc3e83efa17/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:50:50 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c9fe69e-3f9d-4b30-a9e4-efc3e83efa17/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:50:50 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c9fe69e-3f9d-4b30-a9e4-efc3e83efa17/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:50:50 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4ce290f-6dd2-44b6-91be-8e775045837e/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:50:50 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4ce290f-6dd2-44b6-91be-8e775045837e/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:50:50 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4ce290f-6dd2-44b6-91be-8e775045837e/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:50:50 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4ce290f-6dd2-44b6-91be-8e775045837e/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:50:50 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e09b3809-2e23-401c-9a72-88feb2bb657c/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:50:51 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e09b3809-2e23-401c-9a72-88feb2bb657c/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:50:51 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e09b3809-2e23-401c-9a72-88feb2bb657c/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:50:51 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e09b3809-2e23-401c-9a72-88feb2bb657c/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:50:51 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94e2b266-2fe3-481a-bb1e-24f835a79ddf/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:50:51 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:50:51 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 09:50:51 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94e2b266-2fe3-481a-bb1e-24f835a79ddf/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:50:51 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94e2b266-2fe3-481a-bb1e-24f835a79ddf/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:50:51 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:50:51 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94e2b266-2fe3-481a-bb1e-24f835a79ddf/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:50:51 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4255af28-a111-4475-b207-67e335fd0835/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:50:51 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4255af28-a111-4475-b207-67e335fd0835/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:50:51 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4255af28-a111-4475-b207-67e335fd0835/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:50:52 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4255af28-a111-4475-b207-67e335fd0835/disk --force-share --output=json" returned: 0 in 0.268s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:50:52 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=75229) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 09:50:52 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5170e9e-66e3-4df1-9807-4958cac6480e/disk.rescue --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:50:52 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5170e9e-66e3-4df1-9807-4958cac6480e/disk.rescue --force-share --output=json" returned: 0 in 0.195s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:50:52 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5170e9e-66e3-4df1-9807-4958cac6480e/disk.rescue --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:50:52 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5170e9e-66e3-4df1-9807-4958cac6480e/disk.rescue --force-share --output=json" returned: 0 in 0.192s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:50:52 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5170e9e-66e3-4df1-9807-4958cac6480e/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:50:52 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5170e9e-66e3-4df1-9807-4958cac6480e/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:50:52 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5170e9e-66e3-4df1-9807-4958cac6480e/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:50:52 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5170e9e-66e3-4df1-9807-4958cac6480e/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:50:52 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-7d1894ea-a2ff-4601-b2fd-5507ab5aac2e tempest-ServersNegativeTestJSON-1483105767 tempest-ServersNegativeTestJSON-1483105767-project-member] Acquiring lock "e58500df-059a-4fce-afb7-ba36feca0697" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:50:52 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-7d1894ea-a2ff-4601-b2fd-5507ab5aac2e tempest-ServersNegativeTestJSON-1483105767 tempest-ServersNegativeTestJSON-1483105767-project-member] Lock "e58500df-059a-4fce-afb7-ba36feca0697" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:50:53 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:50:53 user nova-compute[75229]: DEBUG nova.compute.manager [None req-7d1894ea-a2ff-4601-b2fd-5507ab5aac2e tempest-ServersNegativeTestJSON-1483105767 tempest-ServersNegativeTestJSON-1483105767-project-member] [instance: e58500df-059a-4fce-afb7-ba36feca0697] Starting instance... {{(pid=75229) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 09:50:53 user nova-compute[75229]: WARNING nova.virt.libvirt.driver [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 09:50:53 user nova-compute[75229]: WARNING nova.virt.libvirt.driver [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 09:50:53 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Hypervisor/Node resource view: name=user free_ram=7243MB free_disk=25.227252960205078GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75229) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 09:50:53 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:50:53 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:50:53 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-7d1894ea-a2ff-4601-b2fd-5507ab5aac2e tempest-ServersNegativeTestJSON-1483105767 tempest-ServersNegativeTestJSON-1483105767-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:50:53 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Instance a7750cbc-b3d0-44aa-8b88-c291ba007a8a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 09:50:53 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Instance e09b3809-2e23-401c-9a72-88feb2bb657c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 09:50:53 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Instance be813b28-133f-416a-b2b5-dc0b9e4064b7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 09:50:53 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Instance a60d339f-e134-477c-8505-bf8c79d2a21c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 09:50:53 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Instance 4255af28-a111-4475-b207-67e335fd0835 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 09:50:53 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Instance 4c9fe69e-3f9d-4b30-a9e4-efc3e83efa17 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 09:50:53 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Instance b5170e9e-66e3-4df1-9807-4958cac6480e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 09:50:53 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Instance a4ce290f-6dd2-44b6-91be-8e775045837e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 09:50:53 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Instance 94e2b266-2fe3-481a-bb1e-24f835a79ddf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 09:50:53 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Instance 5abd12fe-e6fc-4cb1-9674-da08e13886be actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 09:50:53 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Instance e58500df-059a-4fce-afb7-ba36feca0697 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Nov 14 09:50:53 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75229) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 09:50:53 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75229) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 09:50:53 user nova-compute[75229]: DEBUG nova.compute.provider_tree [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Inventory has not changed in ProviderTree for provider: d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 {{(pid=75229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 09:50:53 user nova-compute[75229]: DEBUG nova.scheduler.client.report [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Inventory has not changed for provider d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 09:50:53 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Compute_service record updated for user:user {{(pid=75229) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 09:50:53 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.567s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:50:53 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-7d1894ea-a2ff-4601-b2fd-5507ab5aac2e tempest-ServersNegativeTestJSON-1483105767 tempest-ServersNegativeTestJSON-1483105767-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.483s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:50:53 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-7d1894ea-a2ff-4601-b2fd-5507ab5aac2e tempest-ServersNegativeTestJSON-1483105767 tempest-ServersNegativeTestJSON-1483105767-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75229) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 09:50:53 user nova-compute[75229]: INFO nova.compute.claims [None req-7d1894ea-a2ff-4601-b2fd-5507ab5aac2e tempest-ServersNegativeTestJSON-1483105767 tempest-ServersNegativeTestJSON-1483105767-project-member] [instance: e58500df-059a-4fce-afb7-ba36feca0697] Claim successful on node user
Nov 14 09:50:54 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-1a4116d2-a200-4043-a55a-b24cd3c58c48 tempest-VolumesActionsTest-480767440 tempest-VolumesActionsTest-480767440-project-member] Acquiring lock "bcd2eae5-1085-491f-925a-247c462d786a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:50:54 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-1a4116d2-a200-4043-a55a-b24cd3c58c48 tempest-VolumesActionsTest-480767440 tempest-VolumesActionsTest-480767440-project-member] Lock "bcd2eae5-1085-491f-925a-247c462d786a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:50:54 user nova-compute[75229]: DEBUG nova.compute.manager [None req-1a4116d2-a200-4043-a55a-b24cd3c58c48 tempest-VolumesActionsTest-480767440 tempest-VolumesActionsTest-480767440-project-member] [instance: bcd2eae5-1085-491f-925a-247c462d786a] Starting instance... {{(pid=75229) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 09:50:54 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-1a4116d2-a200-4043-a55a-b24cd3c58c48 tempest-VolumesActionsTest-480767440 tempest-VolumesActionsTest-480767440-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:50:54 user nova-compute[75229]: DEBUG nova.compute.provider_tree [None req-7d1894ea-a2ff-4601-b2fd-5507ab5aac2e tempest-ServersNegativeTestJSON-1483105767 tempest-ServersNegativeTestJSON-1483105767-project-member] Inventory has not changed in ProviderTree for provider: d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 {{(pid=75229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 09:50:54 user nova-compute[75229]: DEBUG nova.scheduler.client.report [None req-7d1894ea-a2ff-4601-b2fd-5507ab5aac2e tempest-ServersNegativeTestJSON-1483105767 tempest-ServersNegativeTestJSON-1483105767-project-member] Inventory has not changed for provider d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 09:50:54 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-7d1894ea-a2ff-4601-b2fd-5507ab5aac2e tempest-ServersNegativeTestJSON-1483105767 tempest-ServersNegativeTestJSON-1483105767-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.505s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:50:54 user nova-compute[75229]: DEBUG nova.compute.manager [None req-7d1894ea-a2ff-4601-b2fd-5507ab5aac2e tempest-ServersNegativeTestJSON-1483105767 tempest-ServersNegativeTestJSON-1483105767-project-member] [instance: e58500df-059a-4fce-afb7-ba36feca0697] Start building networks asynchronously for instance. {{(pid=75229) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 09:50:54 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-1a4116d2-a200-4043-a55a-b24cd3c58c48 tempest-VolumesActionsTest-480767440 tempest-VolumesActionsTest-480767440-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.142s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:50:54 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-1a4116d2-a200-4043-a55a-b24cd3c58c48 tempest-VolumesActionsTest-480767440 tempest-VolumesActionsTest-480767440-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75229) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 09:50:54 user nova-compute[75229]: INFO nova.compute.claims [None req-1a4116d2-a200-4043-a55a-b24cd3c58c48 tempest-VolumesActionsTest-480767440 tempest-VolumesActionsTest-480767440-project-member] [instance: bcd2eae5-1085-491f-925a-247c462d786a] Claim successful on node user
Nov 14 09:50:54 user nova-compute[75229]: DEBUG nova.compute.manager [None req-7d1894ea-a2ff-4601-b2fd-5507ab5aac2e tempest-ServersNegativeTestJSON-1483105767 tempest-ServersNegativeTestJSON-1483105767-project-member] [instance: e58500df-059a-4fce-afb7-ba36feca0697] Allocating IP information in the background. {{(pid=75229) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 09:50:54 user nova-compute[75229]: DEBUG nova.network.neutron [None req-7d1894ea-a2ff-4601-b2fd-5507ab5aac2e tempest-ServersNegativeTestJSON-1483105767 tempest-ServersNegativeTestJSON-1483105767-project-member] [instance: e58500df-059a-4fce-afb7-ba36feca0697] allocate_for_instance() {{(pid=75229) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 09:50:54 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-7d1894ea-a2ff-4601-b2fd-5507ab5aac2e tempest-ServersNegativeTestJSON-1483105767 tempest-ServersNegativeTestJSON-1483105767-project-member] [instance: e58500df-059a-4fce-afb7-ba36feca0697] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 09:50:54 user nova-compute[75229]: DEBUG nova.compute.manager [None req-7d1894ea-a2ff-4601-b2fd-5507ab5aac2e tempest-ServersNegativeTestJSON-1483105767 tempest-ServersNegativeTestJSON-1483105767-project-member] [instance: e58500df-059a-4fce-afb7-ba36feca0697] Start building block device mappings for instance. {{(pid=75229) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 09:50:54 user nova-compute[75229]: DEBUG nova.policy [None req-7d1894ea-a2ff-4601-b2fd-5507ab5aac2e tempest-ServersNegativeTestJSON-1483105767 tempest-ServersNegativeTestJSON-1483105767-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a479b16af2894f6388c73aaaa744ec6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '133a5fa644c24636bd2b334d7b95e4c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75229) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 09:50:54 user nova-compute[75229]: DEBUG nova.compute.manager [None req-7d1894ea-a2ff-4601-b2fd-5507ab5aac2e tempest-ServersNegativeTestJSON-1483105767 tempest-ServersNegativeTestJSON-1483105767-project-member] [instance: e58500df-059a-4fce-afb7-ba36feca0697] Start spawning the instance on the hypervisor. {{(pid=75229) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 09:50:54 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-7d1894ea-a2ff-4601-b2fd-5507ab5aac2e tempest-ServersNegativeTestJSON-1483105767 tempest-ServersNegativeTestJSON-1483105767-project-member] [instance: e58500df-059a-4fce-afb7-ba36feca0697] Creating instance directory {{(pid=75229) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 09:50:54 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-7d1894ea-a2ff-4601-b2fd-5507ab5aac2e tempest-ServersNegativeTestJSON-1483105767 tempest-ServersNegativeTestJSON-1483105767-project-member] [instance: e58500df-059a-4fce-afb7-ba36feca0697] Creating image(s)
Nov 14 09:50:54 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-7d1894ea-a2ff-4601-b2fd-5507ab5aac2e tempest-ServersNegativeTestJSON-1483105767 tempest-ServersNegativeTestJSON-1483105767-project-member] Acquiring lock "/opt/stack/data/nova/instances/e58500df-059a-4fce-afb7-ba36feca0697/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:50:54 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-7d1894ea-a2ff-4601-b2fd-5507ab5aac2e tempest-ServersNegativeTestJSON-1483105767 tempest-ServersNegativeTestJSON-1483105767-project-member] Lock "/opt/stack/data/nova/instances/e58500df-059a-4fce-afb7-ba36feca0697/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:50:54 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-7d1894ea-a2ff-4601-b2fd-5507ab5aac2e tempest-ServersNegativeTestJSON-1483105767 tempest-ServersNegativeTestJSON-1483105767-project-member] Lock "/opt/stack/data/nova/instances/e58500df-059a-4fce-afb7-ba36feca0697/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:50:54 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-7d1894ea-a2ff-4601-b2fd-5507ab5aac2e tempest-ServersNegativeTestJSON-1483105767 tempest-ServersNegativeTestJSON-1483105767-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6 --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:50:54 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 09:50:54 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 09:50:54 user nova-compute[75229]: DEBUG nova.compute.manager [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Starting heal instance info cache {{(pid=75229) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 09:50:54 user nova-compute[75229]: DEBUG nova.compute.manager [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Rebuilding the list of instances to heal {{(pid=75229) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 09:50:54 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-7d1894ea-a2ff-4601-b2fd-5507ab5aac2e tempest-ServersNegativeTestJSON-1483105767 tempest-ServersNegativeTestJSON-1483105767-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6 --force-share --output=json" returned: 0 in 0.224s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:50:54 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-7d1894ea-a2ff-4601-b2fd-5507ab5aac2e tempest-ServersNegativeTestJSON-1483105767 tempest-ServersNegativeTestJSON-1483105767-project-member] Acquiring lock "4f30e3fe703d2381679612a57b1fb80a467f60b6" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:50:54 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-7d1894ea-a2ff-4601-b2fd-5507ab5aac2e tempest-ServersNegativeTestJSON-1483105767 tempest-ServersNegativeTestJSON-1483105767-project-member] Lock "4f30e3fe703d2381679612a57b1fb80a467f60b6" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:50:54 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-7d1894ea-a2ff-4601-b2fd-5507ab5aac2e tempest-ServersNegativeTestJSON-1483105767 tempest-ServersNegativeTestJSON-1483105767-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6 --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:50:55 user nova-compute[75229]: DEBUG nova.compute.manager [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] [instance: e58500df-059a-4fce-afb7-ba36feca0697] Skipping network cache update for instance because it is Building. {{(pid=75229) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Nov 14 09:50:55 user nova-compute[75229]: DEBUG nova.compute.manager [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] [instance: bcd2eae5-1085-491f-925a-247c462d786a] Skipping network cache update for instance because it is Building. {{(pid=75229) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Nov 14 09:50:55 user nova-compute[75229]: DEBUG nova.compute.provider_tree [None req-1a4116d2-a200-4043-a55a-b24cd3c58c48 tempest-VolumesActionsTest-480767440 tempest-VolumesActionsTest-480767440-project-member] Inventory has not changed in ProviderTree for provider: d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 {{(pid=75229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 09:50:55 user nova-compute[75229]: DEBUG nova.scheduler.client.report [None req-1a4116d2-a200-4043-a55a-b24cd3c58c48 tempest-VolumesActionsTest-480767440 tempest-VolumesActionsTest-480767440-project-member] Inventory has not changed for provider d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 09:50:55 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Acquiring lock "refresh_cache-a7750cbc-b3d0-44aa-8b88-c291ba007a8a" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 09:50:55 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Acquired lock "refresh_cache-a7750cbc-b3d0-44aa-8b88-c291ba007a8a" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 09:50:55 user nova-compute[75229]: DEBUG nova.network.neutron [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] [instance: a7750cbc-b3d0-44aa-8b88-c291ba007a8a] Forcefully refreshing network info cache for instance {{(pid=75229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 09:50:55 user nova-compute[75229]: DEBUG nova.objects.instance [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Lazy-loading 'info_cache' on Instance uuid a7750cbc-b3d0-44aa-8b88-c291ba007a8a {{(pid=75229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 09:50:55 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-1a4116d2-a200-4043-a55a-b24cd3c58c48 tempest-VolumesActionsTest-480767440 tempest-VolumesActionsTest-480767440-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.649s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:50:55 user nova-compute[75229]: DEBUG nova.compute.manager [None req-1a4116d2-a200-4043-a55a-b24cd3c58c48 tempest-VolumesActionsTest-480767440 tempest-VolumesActionsTest-480767440-project-member] [instance: bcd2eae5-1085-491f-925a-247c462d786a] Start building networks asynchronously for instance. {{(pid=75229) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 09:50:55 user nova-compute[75229]: DEBUG nova.compute.manager [None req-1a4116d2-a200-4043-a55a-b24cd3c58c48 tempest-VolumesActionsTest-480767440 tempest-VolumesActionsTest-480767440-project-member] [instance: bcd2eae5-1085-491f-925a-247c462d786a] Allocating IP information in the background. {{(pid=75229) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 09:50:55 user nova-compute[75229]: DEBUG nova.network.neutron [None req-1a4116d2-a200-4043-a55a-b24cd3c58c48 tempest-VolumesActionsTest-480767440 tempest-VolumesActionsTest-480767440-project-member] [instance: bcd2eae5-1085-491f-925a-247c462d786a] allocate_for_instance() {{(pid=75229) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 09:50:55 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-7d1894ea-a2ff-4601-b2fd-5507ab5aac2e tempest-ServersNegativeTestJSON-1483105767 tempest-ServersNegativeTestJSON-1483105767-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6 --force-share --output=json" returned: 0 in 0.211s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:50:55 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-7d1894ea-a2ff-4601-b2fd-5507ab5aac2e tempest-ServersNegativeTestJSON-1483105767 tempest-ServersNegativeTestJSON-1483105767-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6,backing_fmt=raw /opt/stack/data/nova/instances/e58500df-059a-4fce-afb7-ba36feca0697/disk 1073741824 {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:50:55 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:50:55 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-1a4116d2-a200-4043-a55a-b24cd3c58c48 tempest-VolumesActionsTest-480767440 tempest-VolumesActionsTest-480767440-project-member] [instance: bcd2eae5-1085-491f-925a-247c462d786a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 09:50:55 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-7d1894ea-a2ff-4601-b2fd-5507ab5aac2e tempest-ServersNegativeTestJSON-1483105767 tempest-ServersNegativeTestJSON-1483105767-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6,backing_fmt=raw /opt/stack/data/nova/instances/e58500df-059a-4fce-afb7-ba36feca0697/disk 1073741824" returned: 0 in 0.073s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:50:55 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-7d1894ea-a2ff-4601-b2fd-5507ab5aac2e tempest-ServersNegativeTestJSON-1483105767 tempest-ServersNegativeTestJSON-1483105767-project-member] Lock "4f30e3fe703d2381679612a57b1fb80a467f60b6" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.287s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:50:55 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-7d1894ea-a2ff-4601-b2fd-5507ab5aac2e tempest-ServersNegativeTestJSON-1483105767 tempest-ServersNegativeTestJSON-1483105767-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6 --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:50:55 user nova-compute[75229]: DEBUG nova.compute.manager [None req-1a4116d2-a200-4043-a55a-b24cd3c58c48 tempest-VolumesActionsTest-480767440 tempest-VolumesActionsTest-480767440-project-member] [instance: bcd2eae5-1085-491f-925a-247c462d786a] Start building block device mappings for instance. {{(pid=75229) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 09:50:55 user nova-compute[75229]: DEBUG nova.policy [None req-1a4116d2-a200-4043-a55a-b24cd3c58c48 tempest-VolumesActionsTest-480767440 tempest-VolumesActionsTest-480767440-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c560169166e745ad9bb47e0c570c3ed8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76963cea909f48398eea96eefec38b0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75229) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 09:50:55 user nova-compute[75229]: DEBUG nova.compute.manager [None req-1a4116d2-a200-4043-a55a-b24cd3c58c48 tempest-VolumesActionsTest-480767440 tempest-VolumesActionsTest-480767440-project-member] [instance: bcd2eae5-1085-491f-925a-247c462d786a] Start spawning the instance on the hypervisor. {{(pid=75229) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 09:50:55 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-1a4116d2-a200-4043-a55a-b24cd3c58c48 tempest-VolumesActionsTest-480767440 tempest-VolumesActionsTest-480767440-project-member] [instance: bcd2eae5-1085-491f-925a-247c462d786a] Creating instance directory {{(pid=75229) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 09:50:55 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-1a4116d2-a200-4043-a55a-b24cd3c58c48 tempest-VolumesActionsTest-480767440 tempest-VolumesActionsTest-480767440-project-member] [instance: bcd2eae5-1085-491f-925a-247c462d786a] Creating image(s)
Nov 14 09:50:55 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-1a4116d2-a200-4043-a55a-b24cd3c58c48 tempest-VolumesActionsTest-480767440 tempest-VolumesActionsTest-480767440-project-member] Acquiring lock "/opt/stack/data/nova/instances/bcd2eae5-1085-491f-925a-247c462d786a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:50:55 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-1a4116d2-a200-4043-a55a-b24cd3c58c48 tempest-VolumesActionsTest-480767440 tempest-VolumesActionsTest-480767440-project-member] Lock "/opt/stack/data/nova/instances/bcd2eae5-1085-491f-925a-247c462d786a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:50:55 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-1a4116d2-a200-4043-a55a-b24cd3c58c48 tempest-VolumesActionsTest-480767440 tempest-VolumesActionsTest-480767440-project-member] Lock "/opt/stack/data/nova/instances/bcd2eae5-1085-491f-925a-247c462d786a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:50:55 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-7d1894ea-a2ff-4601-b2fd-5507ab5aac2e tempest-ServersNegativeTestJSON-1483105767 tempest-ServersNegativeTestJSON-1483105767-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6 --force-share --output=json" returned: 0 in 0.203s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:50:55 user nova-compute[75229]: DEBUG nova.virt.disk.api [None req-7d1894ea-a2ff-4601-b2fd-5507ab5aac2e tempest-ServersNegativeTestJSON-1483105767 tempest-ServersNegativeTestJSON-1483105767-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e58500df-059a-4fce-afb7-ba36feca0697/disk. size=1073741824 {{(pid=75229) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 09:50:55 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-7d1894ea-a2ff-4601-b2fd-5507ab5aac2e tempest-ServersNegativeTestJSON-1483105767 tempest-ServersNegativeTestJSON-1483105767-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e58500df-059a-4fce-afb7-ba36feca0697/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:50:55 user nova-compute[75229]: DEBUG nova.network.neutron [None req-7d1894ea-a2ff-4601-b2fd-5507ab5aac2e tempest-ServersNegativeTestJSON-1483105767 tempest-ServersNegativeTestJSON-1483105767-project-member] [instance: e58500df-059a-4fce-afb7-ba36feca0697] Successfully created port: 50ef44e5-e0bb-4def-9be3-2d528985d37c {{(pid=75229) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 09:50:55 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-1a4116d2-a200-4043-a55a-b24cd3c58c48 tempest-VolumesActionsTest-480767440 tempest-VolumesActionsTest-480767440-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6 --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:50:55 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-7d1894ea-a2ff-4601-b2fd-5507ab5aac2e tempest-ServersNegativeTestJSON-1483105767 tempest-ServersNegativeTestJSON-1483105767-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e58500df-059a-4fce-afb7-ba36feca0697/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:50:55 user nova-compute[75229]: DEBUG nova.virt.disk.api [None req-7d1894ea-a2ff-4601-b2fd-5507ab5aac2e tempest-ServersNegativeTestJSON-1483105767 tempest-ServersNegativeTestJSON-1483105767-project-member] Cannot resize image /opt/stack/data/nova/instances/e58500df-059a-4fce-afb7-ba36feca0697/disk to a smaller size. {{(pid=75229) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 09:50:55 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-7d1894ea-a2ff-4601-b2fd-5507ab5aac2e tempest-ServersNegativeTestJSON-1483105767 tempest-ServersNegativeTestJSON-1483105767-project-member] [instance: e58500df-059a-4fce-afb7-ba36feca0697] Created local disks {{(pid=75229) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 09:50:55 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-7d1894ea-a2ff-4601-b2fd-5507ab5aac2e tempest-ServersNegativeTestJSON-1483105767 tempest-ServersNegativeTestJSON-1483105767-project-member] [instance: e58500df-059a-4fce-afb7-ba36feca0697] Ensure instance console log exists: /opt/stack/data/nova/instances/e58500df-059a-4fce-afb7-ba36feca0697/console.log {{(pid=75229) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 09:50:55 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-7d1894ea-a2ff-4601-b2fd-5507ab5aac2e tempest-ServersNegativeTestJSON-1483105767 tempest-ServersNegativeTestJSON-1483105767-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:50:55 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-7d1894ea-a2ff-4601-b2fd-5507ab5aac2e tempest-ServersNegativeTestJSON-1483105767 tempest-ServersNegativeTestJSON-1483105767-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:50:55 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-7d1894ea-a2ff-4601-b2fd-5507ab5aac2e tempest-ServersNegativeTestJSON-1483105767 tempest-ServersNegativeTestJSON-1483105767-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:50:55 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-1a4116d2-a200-4043-a55a-b24cd3c58c48 tempest-VolumesActionsTest-480767440 tempest-VolumesActionsTest-480767440-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6 --force-share --output=json" returned: 0 in 0.182s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:50:55 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-1a4116d2-a200-4043-a55a-b24cd3c58c48 tempest-VolumesActionsTest-480767440 tempest-VolumesActionsTest-480767440-project-member] Acquiring lock "4f30e3fe703d2381679612a57b1fb80a467f60b6" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:50:55 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-1a4116d2-a200-4043-a55a-b24cd3c58c48 tempest-VolumesActionsTest-480767440 tempest-VolumesActionsTest-480767440-project-member] Lock "4f30e3fe703d2381679612a57b1fb80a467f60b6" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:50:55 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-1a4116d2-a200-4043-a55a-b24cd3c58c48 tempest-VolumesActionsTest-480767440 tempest-VolumesActionsTest-480767440-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6 --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:50:55 user nova-compute[75229]: DEBUG nova.network.neutron [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] [instance: a7750cbc-b3d0-44aa-8b88-c291ba007a8a] Updating instance_info_cache with network_info: [{"id": "e5b20e94-618c-4c51-b20f-1d3f1fb921b6", "address": "fa:16:3e:e5:e8:ed", "network": {"id": "5dfc532f-3d5d-4342-b7f1-12c9c3992a54", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1457278473-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.147", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46e65cdd021f4a3db7c9254bb6d98b46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5b20e94-61", "ovs_interfaceid": "e5b20e94-618c-4c51-b20f-1d3f1fb921b6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 09:50:55 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Releasing lock "refresh_cache-a7750cbc-b3d0-44aa-8b88-c291ba007a8a" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 09:50:55 user nova-compute[75229]: DEBUG nova.compute.manager [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] [instance: a7750cbc-b3d0-44aa-8b88-c291ba007a8a] Updated the network info_cache for instance {{(pid=75229) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 09:50:55 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 09:50:55 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 09:50:55 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 09:50:55 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 09:50:55 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 09:50:55 user nova-compute[75229]: DEBUG nova.compute.manager [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75229) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 09:50:55 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-1a4116d2-a200-4043-a55a-b24cd3c58c48 tempest-VolumesActionsTest-480767440 tempest-VolumesActionsTest-480767440-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6 --force-share --output=json" returned: 0 in 0.186s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:50:55 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-1a4116d2-a200-4043-a55a-b24cd3c58c48 tempest-VolumesActionsTest-480767440 tempest-VolumesActionsTest-480767440-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6,backing_fmt=raw /opt/stack/data/nova/instances/bcd2eae5-1085-491f-925a-247c462d786a/disk 1073741824 {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:50:55 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-1a4116d2-a200-4043-a55a-b24cd3c58c48 tempest-VolumesActionsTest-480767440 tempest-VolumesActionsTest-480767440-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6,backing_fmt=raw /opt/stack/data/nova/instances/bcd2eae5-1085-491f-925a-247c462d786a/disk 1073741824" returned: 0 in 0.055s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:50:55 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-1a4116d2-a200-4043-a55a-b24cd3c58c48 tempest-VolumesActionsTest-480767440 tempest-VolumesActionsTest-480767440-project-member] Lock "4f30e3fe703d2381679612a57b1fb80a467f60b6" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.246s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:50:55 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-1a4116d2-a200-4043-a55a-b24cd3c58c48 tempest-VolumesActionsTest-480767440 tempest-VolumesActionsTest-480767440-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6 --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:50:56 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-1a4116d2-a200-4043-a55a-b24cd3c58c48 tempest-VolumesActionsTest-480767440 tempest-VolumesActionsTest-480767440-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6 --force-share --output=json" returned: 0 in 0.173s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:50:56 user nova-compute[75229]: DEBUG nova.virt.disk.api [None req-1a4116d2-a200-4043-a55a-b24cd3c58c48 tempest-VolumesActionsTest-480767440 tempest-VolumesActionsTest-480767440-project-member] Checking if we can resize image /opt/stack/data/nova/instances/bcd2eae5-1085-491f-925a-247c462d786a/disk. size=1073741824 {{(pid=75229) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 09:50:56 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-1a4116d2-a200-4043-a55a-b24cd3c58c48 tempest-VolumesActionsTest-480767440 tempest-VolumesActionsTest-480767440-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcd2eae5-1085-491f-925a-247c462d786a/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:50:56 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-1a4116d2-a200-4043-a55a-b24cd3c58c48 tempest-VolumesActionsTest-480767440 tempest-VolumesActionsTest-480767440-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcd2eae5-1085-491f-925a-247c462d786a/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:50:56 user nova-compute[75229]: DEBUG nova.virt.disk.api [None req-1a4116d2-a200-4043-a55a-b24cd3c58c48 tempest-VolumesActionsTest-480767440 tempest-VolumesActionsTest-480767440-project-member] Cannot resize image /opt/stack/data/nova/instances/bcd2eae5-1085-491f-925a-247c462d786a/disk to a smaller size. {{(pid=75229) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 09:50:56 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-1a4116d2-a200-4043-a55a-b24cd3c58c48 tempest-VolumesActionsTest-480767440 tempest-VolumesActionsTest-480767440-project-member] [instance: bcd2eae5-1085-491f-925a-247c462d786a] Created local disks {{(pid=75229) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 09:50:56 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-1a4116d2-a200-4043-a55a-b24cd3c58c48 tempest-VolumesActionsTest-480767440 tempest-VolumesActionsTest-480767440-project-member] [instance: bcd2eae5-1085-491f-925a-247c462d786a] Ensure instance console log exists: /opt/stack/data/nova/instances/bcd2eae5-1085-491f-925a-247c462d786a/console.log {{(pid=75229) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 09:50:56 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-1a4116d2-a200-4043-a55a-b24cd3c58c48 tempest-VolumesActionsTest-480767440 tempest-VolumesActionsTest-480767440-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:50:56 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-1a4116d2-a200-4043-a55a-b24cd3c58c48 tempest-VolumesActionsTest-480767440 tempest-VolumesActionsTest-480767440-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:50:56 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-1a4116d2-a200-4043-a55a-b24cd3c58c48 tempest-VolumesActionsTest-480767440 tempest-VolumesActionsTest-480767440-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:50:56 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:50:56 user nova-compute[75229]: DEBUG nova.network.neutron [None req-1a4116d2-a200-4043-a55a-b24cd3c58c48 tempest-VolumesActionsTest-480767440 tempest-VolumesActionsTest-480767440-project-member] [instance: bcd2eae5-1085-491f-925a-247c462d786a] Successfully created port: a74e02ce-e9ec-46ff-971e-cf8502a86303 {{(pid=75229) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 09:50:57 user nova-compute[75229]: DEBUG nova.network.neutron [None req-7d1894ea-a2ff-4601-b2fd-5507ab5aac2e tempest-ServersNegativeTestJSON-1483105767 tempest-ServersNegativeTestJSON-1483105767-project-member] [instance: e58500df-059a-4fce-afb7-ba36feca0697] Successfully updated port: 50ef44e5-e0bb-4def-9be3-2d528985d37c {{(pid=75229) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 09:50:57 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-7d1894ea-a2ff-4601-b2fd-5507ab5aac2e tempest-ServersNegativeTestJSON-1483105767 tempest-ServersNegativeTestJSON-1483105767-project-member] Acquiring lock "refresh_cache-e58500df-059a-4fce-afb7-ba36feca0697" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 09:50:57 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-7d1894ea-a2ff-4601-b2fd-5507ab5aac2e tempest-ServersNegativeTestJSON-1483105767 tempest-ServersNegativeTestJSON-1483105767-project-member] Acquired lock "refresh_cache-e58500df-059a-4fce-afb7-ba36feca0697" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 09:50:57 user nova-compute[75229]: DEBUG nova.network.neutron [None req-7d1894ea-a2ff-4601-b2fd-5507ab5aac2e tempest-ServersNegativeTestJSON-1483105767 tempest-ServersNegativeTestJSON-1483105767-project-member] [instance: e58500df-059a-4fce-afb7-ba36feca0697] Building network info cache for instance {{(pid=75229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 09:50:57 user nova-compute[75229]: DEBUG nova.compute.manager [req-8d5c1a1e-02f1-49c3-9951-19c501688890 req-5e17ffe9-7232-43ee-99a8-5464472b60a5 service nova] [instance: e58500df-059a-4fce-afb7-ba36feca0697] Received event network-changed-50ef44e5-e0bb-4def-9be3-2d528985d37c {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:50:57 user nova-compute[75229]: DEBUG nova.compute.manager [req-8d5c1a1e-02f1-49c3-9951-19c501688890 req-5e17ffe9-7232-43ee-99a8-5464472b60a5 service nova] [instance: e58500df-059a-4fce-afb7-ba36feca0697] Refreshing instance network info cache due to event network-changed-50ef44e5-e0bb-4def-9be3-2d528985d37c. {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 09:50:57 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-8d5c1a1e-02f1-49c3-9951-19c501688890 req-5e17ffe9-7232-43ee-99a8-5464472b60a5 service nova] Acquiring lock "refresh_cache-e58500df-059a-4fce-afb7-ba36feca0697" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 09:50:57 user nova-compute[75229]: DEBUG nova.network.neutron [None req-7d1894ea-a2ff-4601-b2fd-5507ab5aac2e tempest-ServersNegativeTestJSON-1483105767 tempest-ServersNegativeTestJSON-1483105767-project-member] [instance: e58500df-059a-4fce-afb7-ba36feca0697] Instance cache missing network info. {{(pid=75229) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 09:50:57 user nova-compute[75229]: DEBUG nova.network.neutron [None req-7d1894ea-a2ff-4601-b2fd-5507ab5aac2e tempest-ServersNegativeTestJSON-1483105767 tempest-ServersNegativeTestJSON-1483105767-project-member] [instance: e58500df-059a-4fce-afb7-ba36feca0697] Updating instance_info_cache with network_info: [{"id": "50ef44e5-e0bb-4def-9be3-2d528985d37c", "address": "fa:16:3e:5d:6e:2c", "network": {"id": "b841fceb-4765-4e8e-b800-8651dcb1d867", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1867189200-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "133a5fa644c24636bd2b334d7b95e4c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50ef44e5-e0", "ovs_interfaceid": "50ef44e5-e0bb-4def-9be3-2d528985d37c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 09:50:57 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-7d1894ea-a2ff-4601-b2fd-5507ab5aac2e tempest-ServersNegativeTestJSON-1483105767 tempest-ServersNegativeTestJSON-1483105767-project-member] Releasing lock "refresh_cache-e58500df-059a-4fce-afb7-ba36feca0697" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 09:50:57 user nova-compute[75229]: DEBUG nova.compute.manager [None req-7d1894ea-a2ff-4601-b2fd-5507ab5aac2e tempest-ServersNegativeTestJSON-1483105767 tempest-ServersNegativeTestJSON-1483105767-project-member] [instance: e58500df-059a-4fce-afb7-ba36feca0697] Instance network_info: |[{"id": "50ef44e5-e0bb-4def-9be3-2d528985d37c", "address": "fa:16:3e:5d:6e:2c", "network": {"id": "b841fceb-4765-4e8e-b800-8651dcb1d867", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1867189200-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "133a5fa644c24636bd2b334d7b95e4c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50ef44e5-e0", "ovs_interfaceid": "50ef44e5-e0bb-4def-9be3-2d528985d37c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75229) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 09:50:57 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-8d5c1a1e-02f1-49c3-9951-19c501688890 req-5e17ffe9-7232-43ee-99a8-5464472b60a5 service nova] Acquired lock "refresh_cache-e58500df-059a-4fce-afb7-ba36feca0697" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 09:50:57 user nova-compute[75229]: DEBUG nova.network.neutron [req-8d5c1a1e-02f1-49c3-9951-19c501688890 req-5e17ffe9-7232-43ee-99a8-5464472b60a5 service nova] [instance: e58500df-059a-4fce-afb7-ba36feca0697] Refreshing network info cache for port 50ef44e5-e0bb-4def-9be3-2d528985d37c {{(pid=75229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 09:50:57 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-7d1894ea-a2ff-4601-b2fd-5507ab5aac2e tempest-ServersNegativeTestJSON-1483105767 tempest-ServersNegativeTestJSON-1483105767-project-member] [instance: e58500df-059a-4fce-afb7-ba36feca0697] Start _get_guest_xml network_info=[{"id": "50ef44e5-e0bb-4def-9be3-2d528985d37c", "address": "fa:16:3e:5d:6e:2c", "network": {"id": "b841fceb-4765-4e8e-b800-8651dcb1d867", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1867189200-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "133a5fa644c24636bd2b334d7b95e4c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50ef44e5-e0", "ovs_interfaceid": "50ef44e5-e0bb-4def-9be3-2d528985d37c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T09:40:10Z,direct_url=<?>,disk_format='qcow2',id=3bef8470-ecc7-40e3-95d4-9254348ea72d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='de5a91106b6948ed937a7178ff9464c4',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T09:40:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'disk_bus': 'virtio', 'guest_format': None, 'encryption_secret_uuid': None, 'size': 0, 'device_type': 'disk', 'image_id': '3bef8470-ecc7-40e3-95d4-9254348ea72d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75229) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 09:50:57 user nova-compute[75229]: WARNING nova.virt.libvirt.driver [None req-7d1894ea-a2ff-4601-b2fd-5507ab5aac2e tempest-ServersNegativeTestJSON-1483105767 tempest-ServersNegativeTestJSON-1483105767-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 09:50:57 user nova-compute[75229]: WARNING nova.virt.libvirt.driver [None req-7d1894ea-a2ff-4601-b2fd-5507ab5aac2e tempest-ServersNegativeTestJSON-1483105767 tempest-ServersNegativeTestJSON-1483105767-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 09:50:57 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-7d1894ea-a2ff-4601-b2fd-5507ab5aac2e tempest-ServersNegativeTestJSON-1483105767 tempest-ServersNegativeTestJSON-1483105767-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75229) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 09:50:57 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-7d1894ea-a2ff-4601-b2fd-5507ab5aac2e tempest-ServersNegativeTestJSON-1483105767 tempest-ServersNegativeTestJSON-1483105767-project-member] CPU controller missing on host. {{(pid=75229) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 09:50:57 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-7d1894ea-a2ff-4601-b2fd-5507ab5aac2e tempest-ServersNegativeTestJSON-1483105767 tempest-ServersNegativeTestJSON-1483105767-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75229) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 09:50:57 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-7d1894ea-a2ff-4601-b2fd-5507ab5aac2e tempest-ServersNegativeTestJSON-1483105767 tempest-ServersNegativeTestJSON-1483105767-project-member] CPU controller found on host. {{(pid=75229) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 09:50:57 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-7d1894ea-a2ff-4601-b2fd-5507ab5aac2e tempest-ServersNegativeTestJSON-1483105767 tempest-ServersNegativeTestJSON-1483105767-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75229) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 09:50:57 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-7d1894ea-a2ff-4601-b2fd-5507ab5aac2e tempest-ServersNegativeTestJSON-1483105767 tempest-ServersNegativeTestJSON-1483105767-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T09:39:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T09:40:10Z,direct_url=<?>,disk_format='qcow2',id=3bef8470-ecc7-40e3-95d4-9254348ea72d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='de5a91106b6948ed937a7178ff9464c4',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T09:40:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 09:50:57 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-7d1894ea-a2ff-4601-b2fd-5507ab5aac2e tempest-ServersNegativeTestJSON-1483105767 tempest-ServersNegativeTestJSON-1483105767-project-member] Flavor limits 0:0:0 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 09:50:57 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-7d1894ea-a2ff-4601-b2fd-5507ab5aac2e tempest-ServersNegativeTestJSON-1483105767 tempest-ServersNegativeTestJSON-1483105767-project-member] Image limits 0:0:0 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 09:50:57 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-7d1894ea-a2ff-4601-b2fd-5507ab5aac2e tempest-ServersNegativeTestJSON-1483105767 tempest-ServersNegativeTestJSON-1483105767-project-member] Flavor pref 0:0:0 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 09:50:57 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-7d1894ea-a2ff-4601-b2fd-5507ab5aac2e tempest-ServersNegativeTestJSON-1483105767 tempest-ServersNegativeTestJSON-1483105767-project-member] Image pref 0:0:0 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 09:50:57 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-7d1894ea-a2ff-4601-b2fd-5507ab5aac2e tempest-ServersNegativeTestJSON-1483105767 tempest-ServersNegativeTestJSON-1483105767-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 09:50:57 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-7d1894ea-a2ff-4601-b2fd-5507ab5aac2e tempest-ServersNegativeTestJSON-1483105767 tempest-ServersNegativeTestJSON-1483105767-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 09:50:57 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-7d1894ea-a2ff-4601-b2fd-5507ab5aac2e tempest-ServersNegativeTestJSON-1483105767 tempest-ServersNegativeTestJSON-1483105767-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75229) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 09:50:57 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-7d1894ea-a2ff-4601-b2fd-5507ab5aac2e tempest-ServersNegativeTestJSON-1483105767 tempest-ServersNegativeTestJSON-1483105767-project-member] Got 1 possible topologies {{(pid=75229) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 09:50:57 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-7d1894ea-a2ff-4601-b2fd-5507ab5aac2e tempest-ServersNegativeTestJSON-1483105767 tempest-ServersNegativeTestJSON-1483105767-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 09:50:57 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-7d1894ea-a2ff-4601-b2fd-5507ab5aac2e tempest-ServersNegativeTestJSON-1483105767 tempest-ServersNegativeTestJSON-1483105767-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 09:50:57 user nova-compute[75229]: DEBUG nova.virt.libvirt.vif [None req-7d1894ea-a2ff-4601-b2fd-5507ab5aac2e tempest-ServersNegativeTestJSON-1483105767 tempest-ServersNegativeTestJSON-1483105767-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T09:50:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1811166071',display_name='tempest-ServersNegativeTestJSON-server-1811166071',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1811166071',id=23,image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='133a5fa644c24636bd2b334d7b95e4c3',ramdisk_id='',reservation_id='r-0c6lypls',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1483105767',owner_user_name='tempest-ServersNegativeTestJSON-1483105767-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T09:50:55Z,user_data=None,user_id='a479b16af2894f6388c73aaaa744ec6b',uuid=e58500df-059a-4fce-afb7-ba36feca0697,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "50ef44e5-e0bb-4def-9be3-2d528985d37c", "address": "fa:16:3e:5d:6e:2c", "network": {"id": "b841fceb-4765-4e8e-b800-8651dcb1d867", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1867189200-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "133a5fa644c24636bd2b334d7b95e4c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50ef44e5-e0", "ovs_interfaceid": "50ef44e5-e0bb-4def-9be3-2d528985d37c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75229) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 09:50:57 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-7d1894ea-a2ff-4601-b2fd-5507ab5aac2e tempest-ServersNegativeTestJSON-1483105767 tempest-ServersNegativeTestJSON-1483105767-project-member] Converting VIF {"id": "50ef44e5-e0bb-4def-9be3-2d528985d37c", "address": "fa:16:3e:5d:6e:2c", "network": {"id": "b841fceb-4765-4e8e-b800-8651dcb1d867", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1867189200-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "133a5fa644c24636bd2b334d7b95e4c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50ef44e5-e0", "ovs_interfaceid": "50ef44e5-e0bb-4def-9be3-2d528985d37c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 09:50:57 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-7d1894ea-a2ff-4601-b2fd-5507ab5aac2e tempest-ServersNegativeTestJSON-1483105767 tempest-ServersNegativeTestJSON-1483105767-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5d:6e:2c,bridge_name='br-int',has_traffic_filtering=True,id=50ef44e5-e0bb-4def-9be3-2d528985d37c,network=Network(b841fceb-4765-4e8e-b800-8651dcb1d867),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50ef44e5-e0') {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 09:50:57 user nova-compute[75229]: DEBUG nova.objects.instance [None req-7d1894ea-a2ff-4601-b2fd-5507ab5aac2e tempest-ServersNegativeTestJSON-1483105767 tempest-ServersNegativeTestJSON-1483105767-project-member] Lazy-loading 'pci_devices' on Instance uuid e58500df-059a-4fce-afb7-ba36feca0697 {{(pid=75229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 09:50:57 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-7d1894ea-a2ff-4601-b2fd-5507ab5aac2e tempest-ServersNegativeTestJSON-1483105767 tempest-ServersNegativeTestJSON-1483105767-project-member] [instance: e58500df-059a-4fce-afb7-ba36feca0697] End _get_guest_xml xml=<domain type="kvm">
Nov 14 09:50:57 user nova-compute[75229]:   <uuid>e58500df-059a-4fce-afb7-ba36feca0697</uuid>
Nov 14 09:50:57 user nova-compute[75229]:   <name>instance-00000017</name>
Nov 14 09:50:57 user nova-compute[75229]:   <memory>524288</memory>
Nov 14 09:50:57 user nova-compute[75229]:   <vcpu>1</vcpu>
Nov 14 09:50:57 user nova-compute[75229]:   <metadata>
Nov 14 09:50:57 user nova-compute[75229]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 09:50:57 user nova-compute[75229]:       <nova:package version="0.0.0"/>
Nov 14 09:50:57 user nova-compute[75229]:       <nova:name>tempest-ServersNegativeTestJSON-server-1811166071</nova:name>
Nov 14 09:50:57 user nova-compute[75229]:       <nova:creationTime>2023-11-14 09:50:57</nova:creationTime>
Nov 14 09:50:57 user nova-compute[75229]:       <nova:flavor name="m1.tiny">
Nov 14 09:50:57 user nova-compute[75229]:         <nova:memory>512</nova:memory>
Nov 14 09:50:57 user nova-compute[75229]:         <nova:disk>1</nova:disk>
Nov 14 09:50:57 user nova-compute[75229]:         <nova:swap>0</nova:swap>
Nov 14 09:50:57 user nova-compute[75229]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 09:50:57 user nova-compute[75229]:         <nova:vcpus>1</nova:vcpus>
Nov 14 09:50:57 user nova-compute[75229]:       </nova:flavor>
Nov 14 09:50:57 user nova-compute[75229]:       <nova:owner>
Nov 14 09:50:57 user nova-compute[75229]:         <nova:user uuid="a479b16af2894f6388c73aaaa744ec6b">tempest-ServersNegativeTestJSON-1483105767-project-member</nova:user>
Nov 14 09:50:57 user nova-compute[75229]:         <nova:project uuid="133a5fa644c24636bd2b334d7b95e4c3">tempest-ServersNegativeTestJSON-1483105767</nova:project>
Nov 14 09:50:57 user nova-compute[75229]:       </nova:owner>
Nov 14 09:50:57 user nova-compute[75229]:       <nova:root type="image" uuid="3bef8470-ecc7-40e3-95d4-9254348ea72d"/>
Nov 14 09:50:57 user nova-compute[75229]:       <nova:ports>
Nov 14 09:50:57 user nova-compute[75229]:         <nova:port uuid="50ef44e5-e0bb-4def-9be3-2d528985d37c">
Nov 14 09:50:57 user nova-compute[75229]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 14 09:50:57 user nova-compute[75229]:         </nova:port>
Nov 14 09:50:57 user nova-compute[75229]:       </nova:ports>
Nov 14 09:50:57 user nova-compute[75229]:     </nova:instance>
Nov 14 09:50:57 user nova-compute[75229]:   </metadata>
Nov 14 09:50:57 user nova-compute[75229]:   <sysinfo type="smbios">
Nov 14 09:50:57 user nova-compute[75229]:     <system>
Nov 14 09:50:57 user nova-compute[75229]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 09:50:57 user nova-compute[75229]:       <entry name="product">OpenStack Nova</entry>
Nov 14 09:50:57 user nova-compute[75229]:       <entry name="version">0.0.0</entry>
Nov 14 09:50:57 user nova-compute[75229]:       <entry name="serial">e58500df-059a-4fce-afb7-ba36feca0697</entry>
Nov 14 09:50:57 user nova-compute[75229]:       <entry name="uuid">e58500df-059a-4fce-afb7-ba36feca0697</entry>
Nov 14 09:50:57 user nova-compute[75229]:       <entry name="family">Virtual Machine</entry>
Nov 14 09:50:57 user nova-compute[75229]:     </system>
Nov 14 09:50:57 user nova-compute[75229]:   </sysinfo>
Nov 14 09:50:57 user nova-compute[75229]:   <os>
Nov 14 09:50:57 user nova-compute[75229]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 09:50:57 user nova-compute[75229]:     <boot dev="hd"/>
Nov 14 09:50:57 user nova-compute[75229]:     <smbios mode="sysinfo"/>
Nov 14 09:50:57 user nova-compute[75229]:   </os>
Nov 14 09:50:57 user nova-compute[75229]:   <features>
Nov 14 09:50:57 user nova-compute[75229]:     <acpi/>
Nov 14 09:50:57 user nova-compute[75229]:     <apic/>
Nov 14 09:50:57 user nova-compute[75229]:     <vmcoreinfo/>
Nov 14 09:50:57 user nova-compute[75229]:   </features>
Nov 14 09:50:57 user nova-compute[75229]:   <clock offset="utc">
Nov 14 09:50:57 user nova-compute[75229]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 09:50:57 user nova-compute[75229]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 09:50:57 user nova-compute[75229]:     <timer name="hpet" present="no"/>
Nov 14 09:50:57 user nova-compute[75229]:   </clock>
Nov 14 09:50:57 user nova-compute[75229]:   <cpu mode="custom" match="exact">
Nov 14 09:50:57 user nova-compute[75229]:     <model>Nehalem</model>
Nov 14 09:50:57 user nova-compute[75229]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 09:50:57 user nova-compute[75229]:   </cpu>
Nov 14 09:50:57 user nova-compute[75229]:   <devices>
Nov 14 09:50:57 user nova-compute[75229]:     <disk type="file" device="disk">
Nov 14 09:50:57 user nova-compute[75229]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 09:50:57 user nova-compute[75229]:       <source file="/opt/stack/data/nova/instances/e58500df-059a-4fce-afb7-ba36feca0697/disk"/>
Nov 14 09:50:57 user nova-compute[75229]:       <target dev="vda" bus="virtio"/>
Nov 14 09:50:57 user nova-compute[75229]:     </disk>
Nov 14 09:50:57 user nova-compute[75229]:     <interface type="ethernet">
Nov 14 09:50:57 user nova-compute[75229]:       <mac address="fa:16:3e:5d:6e:2c"/>
Nov 14 09:50:57 user nova-compute[75229]:       <model type="virtio"/>
Nov 14 09:50:57 user nova-compute[75229]:       <mtu size="1442"/>
Nov 14 09:50:57 user nova-compute[75229]:       <target dev="tap50ef44e5-e0"/>
Nov 14 09:50:57 user nova-compute[75229]:     </interface>
Nov 14 09:50:57 user nova-compute[75229]:     <serial type="pty">
Nov 14 09:50:57 user nova-compute[75229]:       <log file="/opt/stack/data/nova/instances/e58500df-059a-4fce-afb7-ba36feca0697/console.log" append="off"/>
Nov 14 09:50:57 user nova-compute[75229]:     </serial>
Nov 14 09:50:57 user nova-compute[75229]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 09:50:57 user nova-compute[75229]:     <video>
Nov 14 09:50:57 user nova-compute[75229]:       <model type="virtio"/>
Nov 14 09:50:57 user nova-compute[75229]:     </video>
Nov 14 09:50:57 user nova-compute[75229]:     <rng model="virtio">
Nov 14 09:50:57 user nova-compute[75229]:       <backend model="random">/dev/urandom</backend>
Nov 14 09:50:57 user nova-compute[75229]:     </rng>
Nov 14 09:50:57 user nova-compute[75229]:     <controller type="usb" index="0" model="none"/>
Nov 14 09:50:57 user nova-compute[75229]:     <memballoon model="virtio">
Nov 14 09:50:57 user nova-compute[75229]:       <stats period="10"/>
Nov 14 09:50:57 user nova-compute[75229]:     </memballoon>
Nov 14 09:50:57 user nova-compute[75229]:   </devices>
Nov 14 09:50:57 user nova-compute[75229]: </domain>
Nov 14 09:50:57 user nova-compute[75229]:  {{(pid=75229) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 09:50:57 user nova-compute[75229]: DEBUG nova.virt.libvirt.vif [None req-7d1894ea-a2ff-4601-b2fd-5507ab5aac2e tempest-ServersNegativeTestJSON-1483105767 tempest-ServersNegativeTestJSON-1483105767-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T09:50:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1811166071',display_name='tempest-ServersNegativeTestJSON-server-1811166071',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1811166071',id=23,image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='133a5fa644c24636bd2b334d7b95e4c3',ramdisk_id='',reservation_id='r-0c6lypls',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1483105767',owner_user_name='tempest-ServersNegativeTestJSON-1483105767-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T09:50:55Z,user_data=None,user_id='a479b16af2894f6388c73aaaa744ec6b',uuid=e58500df-059a-4fce-afb7-ba36feca0697,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "50ef44e5-e0bb-4def-9be3-2d528985d37c", "address": "fa:16:3e:5d:6e:2c", "network": {"id": "b841fceb-4765-4e8e-b800-8651dcb1d867", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1867189200-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "133a5fa644c24636bd2b334d7b95e4c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50ef44e5-e0", "ovs_interfaceid": "50ef44e5-e0bb-4def-9be3-2d528985d37c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 09:50:57 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-7d1894ea-a2ff-4601-b2fd-5507ab5aac2e tempest-ServersNegativeTestJSON-1483105767 tempest-ServersNegativeTestJSON-1483105767-project-member] Converting VIF {"id": "50ef44e5-e0bb-4def-9be3-2d528985d37c", "address": "fa:16:3e:5d:6e:2c", "network": {"id": "b841fceb-4765-4e8e-b800-8651dcb1d867", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1867189200-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "133a5fa644c24636bd2b334d7b95e4c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50ef44e5-e0", "ovs_interfaceid": "50ef44e5-e0bb-4def-9be3-2d528985d37c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 09:50:57 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-7d1894ea-a2ff-4601-b2fd-5507ab5aac2e tempest-ServersNegativeTestJSON-1483105767 tempest-ServersNegativeTestJSON-1483105767-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5d:6e:2c,bridge_name='br-int',has_traffic_filtering=True,id=50ef44e5-e0bb-4def-9be3-2d528985d37c,network=Network(b841fceb-4765-4e8e-b800-8651dcb1d867),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50ef44e5-e0') {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 09:50:57 user nova-compute[75229]: DEBUG os_vif [None req-7d1894ea-a2ff-4601-b2fd-5507ab5aac2e tempest-ServersNegativeTestJSON-1483105767 tempest-ServersNegativeTestJSON-1483105767-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5d:6e:2c,bridge_name='br-int',has_traffic_filtering=True,id=50ef44e5-e0bb-4def-9be3-2d528985d37c,network=Network(b841fceb-4765-4e8e-b800-8651dcb1d867),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50ef44e5-e0') {{(pid=75229) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 09:50:57 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:50:57 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:50:57 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 09:50:57 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:50:57 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9ffab787-3302-511e-968d-369d722851da', '_type': 'linux-noop'}}, row=False) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:50:57 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:50:57 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 09:50:57 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:50:57 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap50ef44e5-e0, may_exist=True, interface_attrs={}) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:50:57 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap50ef44e5-e0, col_values=(('qos', UUID('62bfc0f4-2232-4502-8b82-c89a94f876c1')),), if_exists=True) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:50:57 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap50ef44e5-e0, col_values=(('external_ids', {'iface-id': '50ef44e5-e0bb-4def-9be3-2d528985d37c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5d:6e:2c', 'vm-uuid': 'e58500df-059a-4fce-afb7-ba36feca0697'}),), if_exists=True) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:50:57 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:50:57 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 09:50:57 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:50:57 user nova-compute[75229]: INFO os_vif [None req-7d1894ea-a2ff-4601-b2fd-5507ab5aac2e tempest-ServersNegativeTestJSON-1483105767 tempest-ServersNegativeTestJSON-1483105767-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5d:6e:2c,bridge_name='br-int',has_traffic_filtering=True,id=50ef44e5-e0bb-4def-9be3-2d528985d37c,network=Network(b841fceb-4765-4e8e-b800-8651dcb1d867),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50ef44e5-e0')
Nov 14 09:50:57 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-7d1894ea-a2ff-4601-b2fd-5507ab5aac2e tempest-ServersNegativeTestJSON-1483105767 tempest-ServersNegativeTestJSON-1483105767-project-member] No BDM found with device name vda, not building metadata. {{(pid=75229) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 09:50:57 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-7d1894ea-a2ff-4601-b2fd-5507ab5aac2e tempest-ServersNegativeTestJSON-1483105767 tempest-ServersNegativeTestJSON-1483105767-project-member] No VIF found with MAC fa:16:3e:5d:6e:2c, not building metadata {{(pid=75229) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 09:50:57 user nova-compute[75229]: DEBUG nova.network.neutron [None req-1a4116d2-a200-4043-a55a-b24cd3c58c48 tempest-VolumesActionsTest-480767440 tempest-VolumesActionsTest-480767440-project-member] [instance: bcd2eae5-1085-491f-925a-247c462d786a] Successfully updated port: a74e02ce-e9ec-46ff-971e-cf8502a86303 {{(pid=75229) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 09:50:57 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-1a4116d2-a200-4043-a55a-b24cd3c58c48 tempest-VolumesActionsTest-480767440 tempest-VolumesActionsTest-480767440-project-member] Acquiring lock "refresh_cache-bcd2eae5-1085-491f-925a-247c462d786a" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 09:50:57 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-1a4116d2-a200-4043-a55a-b24cd3c58c48 tempest-VolumesActionsTest-480767440 tempest-VolumesActionsTest-480767440-project-member] Acquired lock "refresh_cache-bcd2eae5-1085-491f-925a-247c462d786a" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 09:50:57 user nova-compute[75229]: DEBUG nova.network.neutron [None req-1a4116d2-a200-4043-a55a-b24cd3c58c48 tempest-VolumesActionsTest-480767440 tempest-VolumesActionsTest-480767440-project-member] [instance: bcd2eae5-1085-491f-925a-247c462d786a] Building network info cache for instance {{(pid=75229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 09:50:58 user nova-compute[75229]: DEBUG nova.network.neutron [None req-1a4116d2-a200-4043-a55a-b24cd3c58c48 tempest-VolumesActionsTest-480767440 tempest-VolumesActionsTest-480767440-project-member] [instance: bcd2eae5-1085-491f-925a-247c462d786a] Instance cache missing network info. {{(pid=75229) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 09:50:58 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:50:58 user nova-compute[75229]: DEBUG nova.network.neutron [req-8d5c1a1e-02f1-49c3-9951-19c501688890 req-5e17ffe9-7232-43ee-99a8-5464472b60a5 service nova] [instance: e58500df-059a-4fce-afb7-ba36feca0697] Updated VIF entry in instance network info cache for port 50ef44e5-e0bb-4def-9be3-2d528985d37c. {{(pid=75229) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 09:50:58 user nova-compute[75229]: DEBUG nova.network.neutron [req-8d5c1a1e-02f1-49c3-9951-19c501688890 req-5e17ffe9-7232-43ee-99a8-5464472b60a5 service nova] [instance: e58500df-059a-4fce-afb7-ba36feca0697] Updating instance_info_cache with network_info: [{"id": "50ef44e5-e0bb-4def-9be3-2d528985d37c", "address": "fa:16:3e:5d:6e:2c", "network": {"id": "b841fceb-4765-4e8e-b800-8651dcb1d867", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1867189200-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "133a5fa644c24636bd2b334d7b95e4c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50ef44e5-e0", "ovs_interfaceid": "50ef44e5-e0bb-4def-9be3-2d528985d37c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 09:50:58 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-8d5c1a1e-02f1-49c3-9951-19c501688890 req-5e17ffe9-7232-43ee-99a8-5464472b60a5 service nova] Releasing lock "refresh_cache-e58500df-059a-4fce-afb7-ba36feca0697" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 09:50:58 user nova-compute[75229]: DEBUG nova.network.neutron [None req-1a4116d2-a200-4043-a55a-b24cd3c58c48 tempest-VolumesActionsTest-480767440 tempest-VolumesActionsTest-480767440-project-member] [instance: bcd2eae5-1085-491f-925a-247c462d786a] Updating instance_info_cache with network_info: [{"id": "a74e02ce-e9ec-46ff-971e-cf8502a86303", "address": "fa:16:3e:02:f9:33", "network": {"id": "fedfe4bb-5b8c-4782-9df9-19cba1844f7c", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2139303642-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76963cea909f48398eea96eefec38b0f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa74e02ce-e9", "ovs_interfaceid": "a74e02ce-e9ec-46ff-971e-cf8502a86303", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 09:50:58 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-1a4116d2-a200-4043-a55a-b24cd3c58c48 tempest-VolumesActionsTest-480767440 tempest-VolumesActionsTest-480767440-project-member] Releasing lock "refresh_cache-bcd2eae5-1085-491f-925a-247c462d786a" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 09:50:58 user nova-compute[75229]: DEBUG nova.compute.manager [None req-1a4116d2-a200-4043-a55a-b24cd3c58c48 tempest-VolumesActionsTest-480767440 tempest-VolumesActionsTest-480767440-project-member] [instance: bcd2eae5-1085-491f-925a-247c462d786a] Instance network_info: |[{"id": "a74e02ce-e9ec-46ff-971e-cf8502a86303", "address": "fa:16:3e:02:f9:33", "network": {"id": "fedfe4bb-5b8c-4782-9df9-19cba1844f7c", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2139303642-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76963cea909f48398eea96eefec38b0f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa74e02ce-e9", "ovs_interfaceid": "a74e02ce-e9ec-46ff-971e-cf8502a86303", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75229) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 09:50:58 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-1a4116d2-a200-4043-a55a-b24cd3c58c48 tempest-VolumesActionsTest-480767440 tempest-VolumesActionsTest-480767440-project-member] [instance: bcd2eae5-1085-491f-925a-247c462d786a] Start _get_guest_xml network_info=[{"id": "a74e02ce-e9ec-46ff-971e-cf8502a86303", "address": "fa:16:3e:02:f9:33", "network": {"id": "fedfe4bb-5b8c-4782-9df9-19cba1844f7c", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2139303642-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76963cea909f48398eea96eefec38b0f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa74e02ce-e9", "ovs_interfaceid": "a74e02ce-e9ec-46ff-971e-cf8502a86303", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T09:40:10Z,direct_url=<?>,disk_format='qcow2',id=3bef8470-ecc7-40e3-95d4-9254348ea72d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='de5a91106b6948ed937a7178ff9464c4',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T09:40:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'disk_bus': 'virtio', 'guest_format': None, 'encryption_secret_uuid': None, 'size': 0, 'device_type': 'disk', 'image_id': '3bef8470-ecc7-40e3-95d4-9254348ea72d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75229) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 09:50:58 user nova-compute[75229]: WARNING nova.virt.libvirt.driver [None req-1a4116d2-a200-4043-a55a-b24cd3c58c48 tempest-VolumesActionsTest-480767440 tempest-VolumesActionsTest-480767440-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 09:50:58 user nova-compute[75229]: WARNING nova.virt.libvirt.driver [None req-1a4116d2-a200-4043-a55a-b24cd3c58c48 tempest-VolumesActionsTest-480767440 tempest-VolumesActionsTest-480767440-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 09:50:58 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-1a4116d2-a200-4043-a55a-b24cd3c58c48 tempest-VolumesActionsTest-480767440 tempest-VolumesActionsTest-480767440-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75229) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 09:50:58 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-1a4116d2-a200-4043-a55a-b24cd3c58c48 tempest-VolumesActionsTest-480767440 tempest-VolumesActionsTest-480767440-project-member] CPU controller missing on host. {{(pid=75229) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 09:50:58 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-1a4116d2-a200-4043-a55a-b24cd3c58c48 tempest-VolumesActionsTest-480767440 tempest-VolumesActionsTest-480767440-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75229) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 09:50:58 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-1a4116d2-a200-4043-a55a-b24cd3c58c48 tempest-VolumesActionsTest-480767440 tempest-VolumesActionsTest-480767440-project-member] CPU controller found on host. {{(pid=75229) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 09:50:58 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-1a4116d2-a200-4043-a55a-b24cd3c58c48 tempest-VolumesActionsTest-480767440 tempest-VolumesActionsTest-480767440-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75229) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 09:50:58 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-1a4116d2-a200-4043-a55a-b24cd3c58c48 tempest-VolumesActionsTest-480767440 tempest-VolumesActionsTest-480767440-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T09:39:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T09:40:10Z,direct_url=<?>,disk_format='qcow2',id=3bef8470-ecc7-40e3-95d4-9254348ea72d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='de5a91106b6948ed937a7178ff9464c4',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T09:40:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 09:50:58 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-1a4116d2-a200-4043-a55a-b24cd3c58c48 tempest-VolumesActionsTest-480767440 tempest-VolumesActionsTest-480767440-project-member] Flavor limits 0:0:0 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 09:50:58 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-1a4116d2-a200-4043-a55a-b24cd3c58c48 tempest-VolumesActionsTest-480767440 tempest-VolumesActionsTest-480767440-project-member] Image limits 0:0:0 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 09:50:58 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-1a4116d2-a200-4043-a55a-b24cd3c58c48 tempest-VolumesActionsTest-480767440 tempest-VolumesActionsTest-480767440-project-member] Flavor pref 0:0:0 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 09:50:58 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-1a4116d2-a200-4043-a55a-b24cd3c58c48 tempest-VolumesActionsTest-480767440 tempest-VolumesActionsTest-480767440-project-member] Image pref 0:0:0 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 09:50:58 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-1a4116d2-a200-4043-a55a-b24cd3c58c48 tempest-VolumesActionsTest-480767440 tempest-VolumesActionsTest-480767440-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 09:50:58 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-1a4116d2-a200-4043-a55a-b24cd3c58c48 tempest-VolumesActionsTest-480767440 tempest-VolumesActionsTest-480767440-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 09:50:58 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-1a4116d2-a200-4043-a55a-b24cd3c58c48 tempest-VolumesActionsTest-480767440 tempest-VolumesActionsTest-480767440-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75229) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 09:50:58 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-1a4116d2-a200-4043-a55a-b24cd3c58c48 tempest-VolumesActionsTest-480767440 tempest-VolumesActionsTest-480767440-project-member] Got 1 possible topologies {{(pid=75229) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 09:50:58 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-1a4116d2-a200-4043-a55a-b24cd3c58c48 tempest-VolumesActionsTest-480767440 tempest-VolumesActionsTest-480767440-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 09:50:58 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-1a4116d2-a200-4043-a55a-b24cd3c58c48 tempest-VolumesActionsTest-480767440 tempest-VolumesActionsTest-480767440-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 09:50:58 user nova-compute[75229]: DEBUG nova.virt.libvirt.vif [None req-1a4116d2-a200-4043-a55a-b24cd3c58c48 tempest-VolumesActionsTest-480767440 tempest-VolumesActionsTest-480767440-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T09:50:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1029902890',display_name='tempest-VolumesActionsTest-instance-1029902890',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1029902890',id=24,image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='76963cea909f48398eea96eefec38b0f',ramdisk_id='',reservation_id='r-xskjqb9o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-480767440',owner_user_name='tempest-VolumesActionsTest-480767440-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T09:50:55Z,user_data=None,user_id='c560169166e745ad9bb47e0c570c3ed8',uuid=bcd2eae5-1085-491f-925a-247c462d786a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a74e02ce-e9ec-46ff-971e-cf8502a86303", "address": "fa:16:3e:02:f9:33", "network": {"id": "fedfe4bb-5b8c-4782-9df9-19cba1844f7c", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2139303642-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76963cea909f48398eea96eefec38b0f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa74e02ce-e9", "ovs_interfaceid": "a74e02ce-e9ec-46ff-971e-cf8502a86303", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75229) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 09:50:58 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-1a4116d2-a200-4043-a55a-b24cd3c58c48 tempest-VolumesActionsTest-480767440 tempest-VolumesActionsTest-480767440-project-member] Converting VIF {"id": "a74e02ce-e9ec-46ff-971e-cf8502a86303", "address": "fa:16:3e:02:f9:33", "network": {"id": "fedfe4bb-5b8c-4782-9df9-19cba1844f7c", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2139303642-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76963cea909f48398eea96eefec38b0f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa74e02ce-e9", "ovs_interfaceid": "a74e02ce-e9ec-46ff-971e-cf8502a86303", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 09:50:58 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-1a4116d2-a200-4043-a55a-b24cd3c58c48 tempest-VolumesActionsTest-480767440 tempest-VolumesActionsTest-480767440-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:02:f9:33,bridge_name='br-int',has_traffic_filtering=True,id=a74e02ce-e9ec-46ff-971e-cf8502a86303,network=Network(fedfe4bb-5b8c-4782-9df9-19cba1844f7c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa74e02ce-e9') {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 09:50:58 user nova-compute[75229]: DEBUG nova.objects.instance [None req-1a4116d2-a200-4043-a55a-b24cd3c58c48 tempest-VolumesActionsTest-480767440 tempest-VolumesActionsTest-480767440-project-member] Lazy-loading 'pci_devices' on Instance uuid bcd2eae5-1085-491f-925a-247c462d786a {{(pid=75229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 09:50:58 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-1a4116d2-a200-4043-a55a-b24cd3c58c48 tempest-VolumesActionsTest-480767440 tempest-VolumesActionsTest-480767440-project-member] [instance: bcd2eae5-1085-491f-925a-247c462d786a] End _get_guest_xml xml=<domain type="kvm">
Nov 14 09:50:58 user nova-compute[75229]:   <uuid>bcd2eae5-1085-491f-925a-247c462d786a</uuid>
Nov 14 09:50:58 user nova-compute[75229]:   <name>instance-00000018</name>
Nov 14 09:50:58 user nova-compute[75229]:   <memory>524288</memory>
Nov 14 09:50:58 user nova-compute[75229]:   <vcpu>1</vcpu>
Nov 14 09:50:58 user nova-compute[75229]:   <metadata>
Nov 14 09:50:58 user nova-compute[75229]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 09:50:58 user nova-compute[75229]:       <nova:package version="0.0.0"/>
Nov 14 09:50:58 user nova-compute[75229]:       <nova:name>tempest-VolumesActionsTest-instance-1029902890</nova:name>
Nov 14 09:50:58 user nova-compute[75229]:       <nova:creationTime>2023-11-14 09:50:58</nova:creationTime>
Nov 14 09:50:58 user nova-compute[75229]:       <nova:flavor name="m1.tiny">
Nov 14 09:50:58 user nova-compute[75229]:         <nova:memory>512</nova:memory>
Nov 14 09:50:58 user nova-compute[75229]:         <nova:disk>1</nova:disk>
Nov 14 09:50:58 user nova-compute[75229]:         <nova:swap>0</nova:swap>
Nov 14 09:50:58 user nova-compute[75229]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 09:50:58 user nova-compute[75229]:         <nova:vcpus>1</nova:vcpus>
Nov 14 09:50:58 user nova-compute[75229]:       </nova:flavor>
Nov 14 09:50:58 user nova-compute[75229]:       <nova:owner>
Nov 14 09:50:58 user nova-compute[75229]:         <nova:user uuid="c560169166e745ad9bb47e0c570c3ed8">tempest-VolumesActionsTest-480767440-project-member</nova:user>
Nov 14 09:50:58 user nova-compute[75229]:         <nova:project uuid="76963cea909f48398eea96eefec38b0f">tempest-VolumesActionsTest-480767440</nova:project>
Nov 14 09:50:58 user nova-compute[75229]:       </nova:owner>
Nov 14 09:50:58 user nova-compute[75229]:       <nova:root type="image" uuid="3bef8470-ecc7-40e3-95d4-9254348ea72d"/>
Nov 14 09:50:58 user nova-compute[75229]:       <nova:ports>
Nov 14 09:50:58 user nova-compute[75229]:         <nova:port uuid="a74e02ce-e9ec-46ff-971e-cf8502a86303">
Nov 14 09:50:58 user nova-compute[75229]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 14 09:50:58 user nova-compute[75229]:         </nova:port>
Nov 14 09:50:58 user nova-compute[75229]:       </nova:ports>
Nov 14 09:50:58 user nova-compute[75229]:     </nova:instance>
Nov 14 09:50:58 user nova-compute[75229]:   </metadata>
Nov 14 09:50:58 user nova-compute[75229]:   <sysinfo type="smbios">
Nov 14 09:50:58 user nova-compute[75229]:     <system>
Nov 14 09:50:58 user nova-compute[75229]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 09:50:58 user nova-compute[75229]:       <entry name="product">OpenStack Nova</entry>
Nov 14 09:50:58 user nova-compute[75229]:       <entry name="version">0.0.0</entry>
Nov 14 09:50:58 user nova-compute[75229]:       <entry name="serial">bcd2eae5-1085-491f-925a-247c462d786a</entry>
Nov 14 09:50:58 user nova-compute[75229]:       <entry name="uuid">bcd2eae5-1085-491f-925a-247c462d786a</entry>
Nov 14 09:50:58 user nova-compute[75229]:       <entry name="family">Virtual Machine</entry>
Nov 14 09:50:58 user nova-compute[75229]:     </system>
Nov 14 09:50:58 user nova-compute[75229]:   </sysinfo>
Nov 14 09:50:58 user nova-compute[75229]:   <os>
Nov 14 09:50:58 user nova-compute[75229]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 09:50:58 user nova-compute[75229]:     <boot dev="hd"/>
Nov 14 09:50:58 user nova-compute[75229]:     <smbios mode="sysinfo"/>
Nov 14 09:50:58 user nova-compute[75229]:   </os>
Nov 14 09:50:58 user nova-compute[75229]:   <features>
Nov 14 09:50:58 user nova-compute[75229]:     <acpi/>
Nov 14 09:50:58 user nova-compute[75229]:     <apic/>
Nov 14 09:50:58 user nova-compute[75229]:     <vmcoreinfo/>
Nov 14 09:50:58 user nova-compute[75229]:   </features>
Nov 14 09:50:58 user nova-compute[75229]:   <clock offset="utc">
Nov 14 09:50:58 user nova-compute[75229]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 09:50:58 user nova-compute[75229]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 09:50:58 user nova-compute[75229]:     <timer name="hpet" present="no"/>
Nov 14 09:50:58 user nova-compute[75229]:   </clock>
Nov 14 09:50:58 user nova-compute[75229]:   <cpu mode="custom" match="exact">
Nov 14 09:50:58 user nova-compute[75229]:     <model>Nehalem</model>
Nov 14 09:50:58 user nova-compute[75229]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 09:50:58 user nova-compute[75229]:   </cpu>
Nov 14 09:50:58 user nova-compute[75229]:   <devices>
Nov 14 09:50:58 user nova-compute[75229]:     <disk type="file" device="disk">
Nov 14 09:50:58 user nova-compute[75229]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 09:50:58 user nova-compute[75229]:       <source file="/opt/stack/data/nova/instances/bcd2eae5-1085-491f-925a-247c462d786a/disk"/>
Nov 14 09:50:58 user nova-compute[75229]:       <target dev="vda" bus="virtio"/>
Nov 14 09:50:58 user nova-compute[75229]:     </disk>
Nov 14 09:50:58 user nova-compute[75229]:     <interface type="ethernet">
Nov 14 09:50:58 user nova-compute[75229]:       <mac address="fa:16:3e:02:f9:33"/>
Nov 14 09:50:58 user nova-compute[75229]:       <model type="virtio"/>
Nov 14 09:50:58 user nova-compute[75229]:       <mtu size="1442"/>
Nov 14 09:50:58 user nova-compute[75229]:       <target dev="tapa74e02ce-e9"/>
Nov 14 09:50:58 user nova-compute[75229]:     </interface>
Nov 14 09:50:58 user nova-compute[75229]:     <serial type="pty">
Nov 14 09:50:58 user nova-compute[75229]:       <log file="/opt/stack/data/nova/instances/bcd2eae5-1085-491f-925a-247c462d786a/console.log" append="off"/>
Nov 14 09:50:58 user nova-compute[75229]:     </serial>
Nov 14 09:50:58 user nova-compute[75229]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 09:50:58 user nova-compute[75229]:     <video>
Nov 14 09:50:58 user nova-compute[75229]:       <model type="virtio"/>
Nov 14 09:50:58 user nova-compute[75229]:     </video>
Nov 14 09:50:58 user nova-compute[75229]:     <rng model="virtio">
Nov 14 09:50:58 user nova-compute[75229]:       <backend model="random">/dev/urandom</backend>
Nov 14 09:50:58 user nova-compute[75229]:     </rng>
Nov 14 09:50:58 user nova-compute[75229]:     <controller type="usb" index="0" model="none"/>
Nov 14 09:50:58 user nova-compute[75229]:     <memballoon model="virtio">
Nov 14 09:50:58 user nova-compute[75229]:       <stats period="10"/>
Nov 14 09:50:58 user nova-compute[75229]:     </memballoon>
Nov 14 09:50:58 user nova-compute[75229]:   </devices>
Nov 14 09:50:58 user nova-compute[75229]: </domain>
Nov 14 09:50:58 user nova-compute[75229]:  {{(pid=75229) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 09:50:58 user nova-compute[75229]: DEBUG nova.virt.libvirt.vif [None req-1a4116d2-a200-4043-a55a-b24cd3c58c48 tempest-VolumesActionsTest-480767440 tempest-VolumesActionsTest-480767440-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T09:50:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1029902890',display_name='tempest-VolumesActionsTest-instance-1029902890',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1029902890',id=24,image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='76963cea909f48398eea96eefec38b0f',ramdisk_id='',reservation_id='r-xskjqb9o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-480767440',owner_user_name='tempest-VolumesActionsTest-480767440-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T09:50:55Z,user_data=None,user_id='c560169166e745ad9bb47e0c570c3ed8',uuid=bcd2eae5-1085-491f-925a-247c462d786a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a74e02ce-e9ec-46ff-971e-cf8502a86303", "address": "fa:16:3e:02:f9:33", "network": {"id": "fedfe4bb-5b8c-4782-9df9-19cba1844f7c", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2139303642-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76963cea909f48398eea96eefec38b0f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa74e02ce-e9", "ovs_interfaceid": "a74e02ce-e9ec-46ff-971e-cf8502a86303", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 09:50:58 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-1a4116d2-a200-4043-a55a-b24cd3c58c48 tempest-VolumesActionsTest-480767440 tempest-VolumesActionsTest-480767440-project-member] Converting VIF {"id": "a74e02ce-e9ec-46ff-971e-cf8502a86303", "address": "fa:16:3e:02:f9:33", "network": {"id": "fedfe4bb-5b8c-4782-9df9-19cba1844f7c", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2139303642-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76963cea909f48398eea96eefec38b0f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa74e02ce-e9", "ovs_interfaceid": "a74e02ce-e9ec-46ff-971e-cf8502a86303", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 09:50:58 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-1a4116d2-a200-4043-a55a-b24cd3c58c48 tempest-VolumesActionsTest-480767440 tempest-VolumesActionsTest-480767440-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:02:f9:33,bridge_name='br-int',has_traffic_filtering=True,id=a74e02ce-e9ec-46ff-971e-cf8502a86303,network=Network(fedfe4bb-5b8c-4782-9df9-19cba1844f7c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa74e02ce-e9') {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 09:50:58 user nova-compute[75229]: DEBUG os_vif [None req-1a4116d2-a200-4043-a55a-b24cd3c58c48 tempest-VolumesActionsTest-480767440 tempest-VolumesActionsTest-480767440-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:02:f9:33,bridge_name='br-int',has_traffic_filtering=True,id=a74e02ce-e9ec-46ff-971e-cf8502a86303,network=Network(fedfe4bb-5b8c-4782-9df9-19cba1844f7c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa74e02ce-e9') {{(pid=75229) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 09:50:58 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:50:58 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:50:58 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 09:50:58 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:50:58 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e1f6edc2-f23c-5a57-a3f9-84820792a72a', '_type': 'linux-noop'}}, row=False) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:50:58 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:50:58 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 09:50:58 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:50:58 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:50:58 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa74e02ce-e9, may_exist=True, interface_attrs={}) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:50:58 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa74e02ce-e9, col_values=(('qos', UUID('e322c8b8-efa4-4225-825f-93c87036fd92')),), if_exists=True) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:50:58 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa74e02ce-e9, col_values=(('external_ids', {'iface-id': 'a74e02ce-e9ec-46ff-971e-cf8502a86303', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:02:f9:33', 'vm-uuid': 'bcd2eae5-1085-491f-925a-247c462d786a'}),), if_exists=True) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:50:58 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:50:58 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 09:50:58 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:50:58 user nova-compute[75229]: INFO os_vif [None req-1a4116d2-a200-4043-a55a-b24cd3c58c48 tempest-VolumesActionsTest-480767440 tempest-VolumesActionsTest-480767440-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:02:f9:33,bridge_name='br-int',has_traffic_filtering=True,id=a74e02ce-e9ec-46ff-971e-cf8502a86303,network=Network(fedfe4bb-5b8c-4782-9df9-19cba1844f7c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa74e02ce-e9')
Nov 14 09:50:58 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-1a4116d2-a200-4043-a55a-b24cd3c58c48 tempest-VolumesActionsTest-480767440 tempest-VolumesActionsTest-480767440-project-member] No BDM found with device name vda, not building metadata. {{(pid=75229) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 09:50:58 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-1a4116d2-a200-4043-a55a-b24cd3c58c48 tempest-VolumesActionsTest-480767440 tempest-VolumesActionsTest-480767440-project-member] No VIF found with MAC fa:16:3e:02:f9:33, not building metadata {{(pid=75229) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 09:50:59 user nova-compute[75229]: DEBUG nova.compute.manager [req-2e8d8ca6-b38e-4a24-b899-4055a01f916b req-00ce09a3-45c2-4951-a26b-14acc0732172 service nova] [instance: bcd2eae5-1085-491f-925a-247c462d786a] Received event network-changed-a74e02ce-e9ec-46ff-971e-cf8502a86303 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:50:59 user nova-compute[75229]: DEBUG nova.compute.manager [req-2e8d8ca6-b38e-4a24-b899-4055a01f916b req-00ce09a3-45c2-4951-a26b-14acc0732172 service nova] [instance: bcd2eae5-1085-491f-925a-247c462d786a] Refreshing instance network info cache due to event network-changed-a74e02ce-e9ec-46ff-971e-cf8502a86303. {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 09:50:59 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-2e8d8ca6-b38e-4a24-b899-4055a01f916b req-00ce09a3-45c2-4951-a26b-14acc0732172 service nova] Acquiring lock "refresh_cache-bcd2eae5-1085-491f-925a-247c462d786a" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 09:50:59 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-2e8d8ca6-b38e-4a24-b899-4055a01f916b req-00ce09a3-45c2-4951-a26b-14acc0732172 service nova] Acquired lock "refresh_cache-bcd2eae5-1085-491f-925a-247c462d786a" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 09:50:59 user nova-compute[75229]: DEBUG nova.network.neutron [req-2e8d8ca6-b38e-4a24-b899-4055a01f916b req-00ce09a3-45c2-4951-a26b-14acc0732172 service nova] [instance: bcd2eae5-1085-491f-925a-247c462d786a] Refreshing network info cache for port a74e02ce-e9ec-46ff-971e-cf8502a86303 {{(pid=75229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 09:50:59 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:50:59 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:50:59 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:50:59 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:50:59 user nova-compute[75229]: DEBUG nova.network.neutron [req-2e8d8ca6-b38e-4a24-b899-4055a01f916b req-00ce09a3-45c2-4951-a26b-14acc0732172 service nova] [instance: bcd2eae5-1085-491f-925a-247c462d786a] Updated VIF entry in instance network info cache for port a74e02ce-e9ec-46ff-971e-cf8502a86303. {{(pid=75229) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 09:50:59 user nova-compute[75229]: DEBUG nova.network.neutron [req-2e8d8ca6-b38e-4a24-b899-4055a01f916b req-00ce09a3-45c2-4951-a26b-14acc0732172 service nova] [instance: bcd2eae5-1085-491f-925a-247c462d786a] Updating instance_info_cache with network_info: [{"id": "a74e02ce-e9ec-46ff-971e-cf8502a86303", "address": "fa:16:3e:02:f9:33", "network": {"id": "fedfe4bb-5b8c-4782-9df9-19cba1844f7c", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2139303642-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76963cea909f48398eea96eefec38b0f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa74e02ce-e9", "ovs_interfaceid": "a74e02ce-e9ec-46ff-971e-cf8502a86303", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 09:50:59 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-2e8d8ca6-b38e-4a24-b899-4055a01f916b req-00ce09a3-45c2-4951-a26b-14acc0732172 service nova] Releasing lock "refresh_cache-bcd2eae5-1085-491f-925a-247c462d786a" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 09:51:00 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:51:00 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:51:00 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:51:00 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:51:00 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:51:00 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:51:01 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:51:01 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:51:01 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:51:01 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:51:02 user nova-compute[75229]: DEBUG nova.compute.manager [req-029a6cf2-67ab-4dcd-be1b-b90d15edbeef req-d405acb8-405d-4587-87fe-8afdd0c0ef59 service nova] [instance: e58500df-059a-4fce-afb7-ba36feca0697] Received event network-vif-plugged-50ef44e5-e0bb-4def-9be3-2d528985d37c {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:51:02 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-029a6cf2-67ab-4dcd-be1b-b90d15edbeef req-d405acb8-405d-4587-87fe-8afdd0c0ef59 service nova] Acquiring lock "e58500df-059a-4fce-afb7-ba36feca0697-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:51:02 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-029a6cf2-67ab-4dcd-be1b-b90d15edbeef req-d405acb8-405d-4587-87fe-8afdd0c0ef59 service nova] Lock "e58500df-059a-4fce-afb7-ba36feca0697-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:51:02 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-029a6cf2-67ab-4dcd-be1b-b90d15edbeef req-d405acb8-405d-4587-87fe-8afdd0c0ef59 service nova] Lock "e58500df-059a-4fce-afb7-ba36feca0697-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:51:02 user nova-compute[75229]: DEBUG nova.compute.manager [req-029a6cf2-67ab-4dcd-be1b-b90d15edbeef req-d405acb8-405d-4587-87fe-8afdd0c0ef59 service nova] [instance: e58500df-059a-4fce-afb7-ba36feca0697] No waiting events found dispatching network-vif-plugged-50ef44e5-e0bb-4def-9be3-2d528985d37c {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 09:51:02 user nova-compute[75229]: WARNING nova.compute.manager [req-029a6cf2-67ab-4dcd-be1b-b90d15edbeef req-d405acb8-405d-4587-87fe-8afdd0c0ef59 service nova] [instance: e58500df-059a-4fce-afb7-ba36feca0697] Received unexpected event network-vif-plugged-50ef44e5-e0bb-4def-9be3-2d528985d37c for instance with vm_state building and task_state spawning.
Nov 14 09:51:02 user nova-compute[75229]: DEBUG nova.compute.manager [None req-7d1894ea-a2ff-4601-b2fd-5507ab5aac2e tempest-ServersNegativeTestJSON-1483105767 tempest-ServersNegativeTestJSON-1483105767-project-member] [instance: e58500df-059a-4fce-afb7-ba36feca0697] Instance event wait completed in 0 seconds for  {{(pid=75229) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 09:51:02 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-7d1894ea-a2ff-4601-b2fd-5507ab5aac2e tempest-ServersNegativeTestJSON-1483105767 tempest-ServersNegativeTestJSON-1483105767-project-member] [instance: e58500df-059a-4fce-afb7-ba36feca0697] Guest created on hypervisor {{(pid=75229) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 09:51:02 user nova-compute[75229]: INFO nova.virt.libvirt.driver [-] [instance: e58500df-059a-4fce-afb7-ba36feca0697] Instance spawned successfully.
Nov 14 09:51:02 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-7d1894ea-a2ff-4601-b2fd-5507ab5aac2e tempest-ServersNegativeTestJSON-1483105767 tempest-ServersNegativeTestJSON-1483105767-project-member] [instance: e58500df-059a-4fce-afb7-ba36feca0697] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 09:51:02 user nova-compute[75229]: DEBUG nova.compute.manager [None req-1a4116d2-a200-4043-a55a-b24cd3c58c48 tempest-VolumesActionsTest-480767440 tempest-VolumesActionsTest-480767440-project-member] [instance: bcd2eae5-1085-491f-925a-247c462d786a] Instance event wait completed in 0 seconds for  {{(pid=75229) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 09:51:02 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-1a4116d2-a200-4043-a55a-b24cd3c58c48 tempest-VolumesActionsTest-480767440 tempest-VolumesActionsTest-480767440-project-member] [instance: bcd2eae5-1085-491f-925a-247c462d786a] Guest created on hypervisor {{(pid=75229) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 09:51:02 user nova-compute[75229]: INFO nova.virt.libvirt.driver [-] [instance: bcd2eae5-1085-491f-925a-247c462d786a] Instance spawned successfully.
Nov 14 09:51:02 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-1a4116d2-a200-4043-a55a-b24cd3c58c48 tempest-VolumesActionsTest-480767440 tempest-VolumesActionsTest-480767440-project-member] [instance: bcd2eae5-1085-491f-925a-247c462d786a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 09:51:02 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-7d1894ea-a2ff-4601-b2fd-5507ab5aac2e tempest-ServersNegativeTestJSON-1483105767 tempest-ServersNegativeTestJSON-1483105767-project-member] [instance: e58500df-059a-4fce-afb7-ba36feca0697] Found default for hw_cdrom_bus of ide {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 09:51:02 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-7d1894ea-a2ff-4601-b2fd-5507ab5aac2e tempest-ServersNegativeTestJSON-1483105767 tempest-ServersNegativeTestJSON-1483105767-project-member] [instance: e58500df-059a-4fce-afb7-ba36feca0697] Found default for hw_disk_bus of virtio {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 09:51:02 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-7d1894ea-a2ff-4601-b2fd-5507ab5aac2e tempest-ServersNegativeTestJSON-1483105767 tempest-ServersNegativeTestJSON-1483105767-project-member] [instance: e58500df-059a-4fce-afb7-ba36feca0697] Found default for hw_input_bus of None {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 09:51:02 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-7d1894ea-a2ff-4601-b2fd-5507ab5aac2e tempest-ServersNegativeTestJSON-1483105767 tempest-ServersNegativeTestJSON-1483105767-project-member] [instance: e58500df-059a-4fce-afb7-ba36feca0697] Found default for hw_pointer_model of None {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 09:51:02 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-7d1894ea-a2ff-4601-b2fd-5507ab5aac2e tempest-ServersNegativeTestJSON-1483105767 tempest-ServersNegativeTestJSON-1483105767-project-member] [instance: e58500df-059a-4fce-afb7-ba36feca0697] Found default for hw_video_model of virtio {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 09:51:02 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-7d1894ea-a2ff-4601-b2fd-5507ab5aac2e tempest-ServersNegativeTestJSON-1483105767 tempest-ServersNegativeTestJSON-1483105767-project-member] [instance: e58500df-059a-4fce-afb7-ba36feca0697] Found default for hw_vif_model of virtio {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 09:51:02 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-1a4116d2-a200-4043-a55a-b24cd3c58c48 tempest-VolumesActionsTest-480767440 tempest-VolumesActionsTest-480767440-project-member] [instance: bcd2eae5-1085-491f-925a-247c462d786a] Found default for hw_cdrom_bus of ide {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 09:51:02 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-1a4116d2-a200-4043-a55a-b24cd3c58c48 tempest-VolumesActionsTest-480767440 tempest-VolumesActionsTest-480767440-project-member] [instance: bcd2eae5-1085-491f-925a-247c462d786a] Found default for hw_disk_bus of virtio {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 09:51:02 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-1a4116d2-a200-4043-a55a-b24cd3c58c48 tempest-VolumesActionsTest-480767440 tempest-VolumesActionsTest-480767440-project-member] [instance: bcd2eae5-1085-491f-925a-247c462d786a] Found default for hw_input_bus of None {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 09:51:02 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-1a4116d2-a200-4043-a55a-b24cd3c58c48 tempest-VolumesActionsTest-480767440 tempest-VolumesActionsTest-480767440-project-member] [instance: bcd2eae5-1085-491f-925a-247c462d786a] Found default for hw_pointer_model of None {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 09:51:02 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-1a4116d2-a200-4043-a55a-b24cd3c58c48 tempest-VolumesActionsTest-480767440 tempest-VolumesActionsTest-480767440-project-member] [instance: bcd2eae5-1085-491f-925a-247c462d786a] Found default for hw_video_model of virtio {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 09:51:02 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-1a4116d2-a200-4043-a55a-b24cd3c58c48 tempest-VolumesActionsTest-480767440 tempest-VolumesActionsTest-480767440-project-member] [instance: bcd2eae5-1085-491f-925a-247c462d786a] Found default for hw_vif_model of virtio {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 09:51:02 user nova-compute[75229]: INFO nova.compute.manager [None req-7d1894ea-a2ff-4601-b2fd-5507ab5aac2e tempest-ServersNegativeTestJSON-1483105767 tempest-ServersNegativeTestJSON-1483105767-project-member] [instance: e58500df-059a-4fce-afb7-ba36feca0697] Took 8.18 seconds to spawn the instance on the hypervisor.
Nov 14 09:51:02 user nova-compute[75229]: DEBUG nova.compute.manager [None req-7d1894ea-a2ff-4601-b2fd-5507ab5aac2e tempest-ServersNegativeTestJSON-1483105767 tempest-ServersNegativeTestJSON-1483105767-project-member] [instance: e58500df-059a-4fce-afb7-ba36feca0697] Checking state {{(pid=75229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 09:51:02 user nova-compute[75229]: INFO nova.compute.manager [None req-1a4116d2-a200-4043-a55a-b24cd3c58c48 tempest-VolumesActionsTest-480767440 tempest-VolumesActionsTest-480767440-project-member] [instance: bcd2eae5-1085-491f-925a-247c462d786a] Took 7.48 seconds to spawn the instance on the hypervisor.
Nov 14 09:51:02 user nova-compute[75229]: DEBUG nova.compute.manager [None req-1a4116d2-a200-4043-a55a-b24cd3c58c48 tempest-VolumesActionsTest-480767440 tempest-VolumesActionsTest-480767440-project-member] [instance: bcd2eae5-1085-491f-925a-247c462d786a] Checking state {{(pid=75229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 09:51:03 user nova-compute[75229]: INFO nova.compute.manager [None req-1a4116d2-a200-4043-a55a-b24cd3c58c48 tempest-VolumesActionsTest-480767440 tempest-VolumesActionsTest-480767440-project-member] [instance: bcd2eae5-1085-491f-925a-247c462d786a] Took 8.75 seconds to build instance.
Nov 14 09:51:03 user nova-compute[75229]: INFO nova.compute.manager [None req-7d1894ea-a2ff-4601-b2fd-5507ab5aac2e tempest-ServersNegativeTestJSON-1483105767 tempest-ServersNegativeTestJSON-1483105767-project-member] [instance: e58500df-059a-4fce-afb7-ba36feca0697] Took 9.62 seconds to build instance.
Nov 14 09:51:03 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-1a4116d2-a200-4043-a55a-b24cd3c58c48 tempest-VolumesActionsTest-480767440 tempest-VolumesActionsTest-480767440-project-member] Lock "bcd2eae5-1085-491f-925a-247c462d786a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.846s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:51:03 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-7d1894ea-a2ff-4601-b2fd-5507ab5aac2e tempest-ServersNegativeTestJSON-1483105767 tempest-ServersNegativeTestJSON-1483105767-project-member] Lock "e58500df-059a-4fce-afb7-ba36feca0697" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.148s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:51:03 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:51:03 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:51:04 user nova-compute[75229]: DEBUG nova.compute.manager [req-871aa590-6e5d-4a79-b353-9b3504422f71 req-13d280bd-f220-47e4-ac9e-2a4da2b3006d service nova] [instance: e58500df-059a-4fce-afb7-ba36feca0697] Received event network-vif-plugged-50ef44e5-e0bb-4def-9be3-2d528985d37c {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:51:04 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-871aa590-6e5d-4a79-b353-9b3504422f71 req-13d280bd-f220-47e4-ac9e-2a4da2b3006d service nova] Acquiring lock "e58500df-059a-4fce-afb7-ba36feca0697-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:51:04 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-871aa590-6e5d-4a79-b353-9b3504422f71 req-13d280bd-f220-47e4-ac9e-2a4da2b3006d service nova] Lock "e58500df-059a-4fce-afb7-ba36feca0697-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:51:04 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-871aa590-6e5d-4a79-b353-9b3504422f71 req-13d280bd-f220-47e4-ac9e-2a4da2b3006d service nova] Lock "e58500df-059a-4fce-afb7-ba36feca0697-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:51:04 user nova-compute[75229]: DEBUG nova.compute.manager [req-871aa590-6e5d-4a79-b353-9b3504422f71 req-13d280bd-f220-47e4-ac9e-2a4da2b3006d service nova] [instance: e58500df-059a-4fce-afb7-ba36feca0697] No waiting events found dispatching network-vif-plugged-50ef44e5-e0bb-4def-9be3-2d528985d37c {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 09:51:04 user nova-compute[75229]: WARNING nova.compute.manager [req-871aa590-6e5d-4a79-b353-9b3504422f71 req-13d280bd-f220-47e4-ac9e-2a4da2b3006d service nova] [instance: e58500df-059a-4fce-afb7-ba36feca0697] Received unexpected event network-vif-plugged-50ef44e5-e0bb-4def-9be3-2d528985d37c for instance with vm_state active and task_state None.
Nov 14 09:51:04 user nova-compute[75229]: DEBUG nova.compute.manager [req-871aa590-6e5d-4a79-b353-9b3504422f71 req-13d280bd-f220-47e4-ac9e-2a4da2b3006d service nova] [instance: bcd2eae5-1085-491f-925a-247c462d786a] Received event network-vif-plugged-a74e02ce-e9ec-46ff-971e-cf8502a86303 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:51:04 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-871aa590-6e5d-4a79-b353-9b3504422f71 req-13d280bd-f220-47e4-ac9e-2a4da2b3006d service nova] Acquiring lock "bcd2eae5-1085-491f-925a-247c462d786a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:51:04 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-871aa590-6e5d-4a79-b353-9b3504422f71 req-13d280bd-f220-47e4-ac9e-2a4da2b3006d service nova] Lock "bcd2eae5-1085-491f-925a-247c462d786a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:51:04 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-871aa590-6e5d-4a79-b353-9b3504422f71 req-13d280bd-f220-47e4-ac9e-2a4da2b3006d service nova] Lock "bcd2eae5-1085-491f-925a-247c462d786a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:51:04 user nova-compute[75229]: DEBUG nova.compute.manager [req-871aa590-6e5d-4a79-b353-9b3504422f71 req-13d280bd-f220-47e4-ac9e-2a4da2b3006d service nova] [instance: bcd2eae5-1085-491f-925a-247c462d786a] No waiting events found dispatching network-vif-plugged-a74e02ce-e9ec-46ff-971e-cf8502a86303 {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 09:51:04 user nova-compute[75229]: WARNING nova.compute.manager [req-871aa590-6e5d-4a79-b353-9b3504422f71 req-13d280bd-f220-47e4-ac9e-2a4da2b3006d service nova] [instance: bcd2eae5-1085-491f-925a-247c462d786a] Received unexpected event network-vif-plugged-a74e02ce-e9ec-46ff-971e-cf8502a86303 for instance with vm_state active and task_state None.
Nov 14 09:51:04 user nova-compute[75229]: DEBUG nova.compute.manager [req-871aa590-6e5d-4a79-b353-9b3504422f71 req-13d280bd-f220-47e4-ac9e-2a4da2b3006d service nova] [instance: bcd2eae5-1085-491f-925a-247c462d786a] Received event network-vif-plugged-a74e02ce-e9ec-46ff-971e-cf8502a86303 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:51:04 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-871aa590-6e5d-4a79-b353-9b3504422f71 req-13d280bd-f220-47e4-ac9e-2a4da2b3006d service nova] Acquiring lock "bcd2eae5-1085-491f-925a-247c462d786a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:51:04 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-871aa590-6e5d-4a79-b353-9b3504422f71 req-13d280bd-f220-47e4-ac9e-2a4da2b3006d service nova] Lock "bcd2eae5-1085-491f-925a-247c462d786a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:51:04 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-871aa590-6e5d-4a79-b353-9b3504422f71 req-13d280bd-f220-47e4-ac9e-2a4da2b3006d service nova] Lock "bcd2eae5-1085-491f-925a-247c462d786a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:51:04 user nova-compute[75229]: DEBUG nova.compute.manager [req-871aa590-6e5d-4a79-b353-9b3504422f71 req-13d280bd-f220-47e4-ac9e-2a4da2b3006d service nova] [instance: bcd2eae5-1085-491f-925a-247c462d786a] No waiting events found dispatching network-vif-plugged-a74e02ce-e9ec-46ff-971e-cf8502a86303 {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 09:51:04 user nova-compute[75229]: WARNING nova.compute.manager [req-871aa590-6e5d-4a79-b353-9b3504422f71 req-13d280bd-f220-47e4-ac9e-2a4da2b3006d service nova] [instance: bcd2eae5-1085-491f-925a-247c462d786a] Received unexpected event network-vif-plugged-a74e02ce-e9ec-46ff-971e-cf8502a86303 for instance with vm_state active and task_state None.
Nov 14 09:51:08 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:51:08 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:51:11 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-3b611fbc-3286-4aab-91be-38c5ede168bd tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Acquiring lock "d73f431b-d002-4206-8b52-7d313a43dccb" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:51:11 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-3b611fbc-3286-4aab-91be-38c5ede168bd tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Lock "d73f431b-d002-4206-8b52-7d313a43dccb" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:51:11 user nova-compute[75229]: DEBUG nova.compute.manager [None req-3b611fbc-3286-4aab-91be-38c5ede168bd tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] [instance: d73f431b-d002-4206-8b52-7d313a43dccb] Starting instance... {{(pid=75229) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 09:51:11 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-3b611fbc-3286-4aab-91be-38c5ede168bd tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:51:11 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-3b611fbc-3286-4aab-91be-38c5ede168bd tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:51:11 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-3b611fbc-3286-4aab-91be-38c5ede168bd tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75229) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 09:51:11 user nova-compute[75229]: INFO nova.compute.claims [None req-3b611fbc-3286-4aab-91be-38c5ede168bd tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] [instance: d73f431b-d002-4206-8b52-7d313a43dccb] Claim successful on node user
Nov 14 09:51:12 user nova-compute[75229]: DEBUG nova.compute.provider_tree [None req-3b611fbc-3286-4aab-91be-38c5ede168bd tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Inventory has not changed in ProviderTree for provider: d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 {{(pid=75229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 09:51:12 user nova-compute[75229]: DEBUG nova.scheduler.client.report [None req-3b611fbc-3286-4aab-91be-38c5ede168bd tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Inventory has not changed for provider d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 09:51:12 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-3b611fbc-3286-4aab-91be-38c5ede168bd tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.533s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:51:12 user nova-compute[75229]: DEBUG nova.compute.manager [None req-3b611fbc-3286-4aab-91be-38c5ede168bd tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] [instance: d73f431b-d002-4206-8b52-7d313a43dccb] Start building networks asynchronously for instance. {{(pid=75229) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 09:51:12 user nova-compute[75229]: DEBUG nova.compute.manager [None req-3b611fbc-3286-4aab-91be-38c5ede168bd tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] [instance: d73f431b-d002-4206-8b52-7d313a43dccb] Allocating IP information in the background. {{(pid=75229) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 09:51:12 user nova-compute[75229]: DEBUG nova.network.neutron [None req-3b611fbc-3286-4aab-91be-38c5ede168bd tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] [instance: d73f431b-d002-4206-8b52-7d313a43dccb] allocate_for_instance() {{(pid=75229) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 09:51:12 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-3b611fbc-3286-4aab-91be-38c5ede168bd tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] [instance: d73f431b-d002-4206-8b52-7d313a43dccb] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 09:51:12 user nova-compute[75229]: DEBUG nova.compute.manager [None req-3b611fbc-3286-4aab-91be-38c5ede168bd tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] [instance: d73f431b-d002-4206-8b52-7d313a43dccb] Start building block device mappings for instance. {{(pid=75229) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 09:51:12 user nova-compute[75229]: DEBUG nova.policy [None req-3b611fbc-3286-4aab-91be-38c5ede168bd tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '319a0a5ee47a426799d40e0ebb62a3b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9447f169de43829fe3ed51592752e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75229) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 09:51:12 user nova-compute[75229]: DEBUG nova.compute.manager [None req-3b611fbc-3286-4aab-91be-38c5ede168bd tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] [instance: d73f431b-d002-4206-8b52-7d313a43dccb] Start spawning the instance on the hypervisor. {{(pid=75229) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 09:51:12 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-3b611fbc-3286-4aab-91be-38c5ede168bd tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] [instance: d73f431b-d002-4206-8b52-7d313a43dccb] Creating instance directory {{(pid=75229) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 09:51:12 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-3b611fbc-3286-4aab-91be-38c5ede168bd tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] [instance: d73f431b-d002-4206-8b52-7d313a43dccb] Creating image(s)
Nov 14 09:51:12 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-3b611fbc-3286-4aab-91be-38c5ede168bd tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Acquiring lock "/opt/stack/data/nova/instances/d73f431b-d002-4206-8b52-7d313a43dccb/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:51:12 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-3b611fbc-3286-4aab-91be-38c5ede168bd tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Lock "/opt/stack/data/nova/instances/d73f431b-d002-4206-8b52-7d313a43dccb/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:51:12 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-3b611fbc-3286-4aab-91be-38c5ede168bd tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Lock "/opt/stack/data/nova/instances/d73f431b-d002-4206-8b52-7d313a43dccb/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:51:12 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-3b611fbc-3286-4aab-91be-38c5ede168bd tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6 --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:51:12 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-3b611fbc-3286-4aab-91be-38c5ede168bd tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6 --force-share --output=json" returned: 0 in 0.191s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:51:12 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-3b611fbc-3286-4aab-91be-38c5ede168bd tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Acquiring lock "4f30e3fe703d2381679612a57b1fb80a467f60b6" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:51:12 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-3b611fbc-3286-4aab-91be-38c5ede168bd tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Lock "4f30e3fe703d2381679612a57b1fb80a467f60b6" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:51:12 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-3b611fbc-3286-4aab-91be-38c5ede168bd tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6 --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:51:13 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-3b611fbc-3286-4aab-91be-38c5ede168bd tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6 --force-share --output=json" returned: 0 in 0.179s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:51:13 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-3b611fbc-3286-4aab-91be-38c5ede168bd tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6,backing_fmt=raw /opt/stack/data/nova/instances/d73f431b-d002-4206-8b52-7d313a43dccb/disk 1073741824 {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:51:13 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-3b611fbc-3286-4aab-91be-38c5ede168bd tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6,backing_fmt=raw /opt/stack/data/nova/instances/d73f431b-d002-4206-8b52-7d313a43dccb/disk 1073741824" returned: 0 in 0.052s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:51:13 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-3b611fbc-3286-4aab-91be-38c5ede168bd tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Lock "4f30e3fe703d2381679612a57b1fb80a467f60b6" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.239s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:51:13 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-3b611fbc-3286-4aab-91be-38c5ede168bd tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6 --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:51:13 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:51:13 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-63b85457-71cc-4b28-b339-f979fa6f3165 tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] Acquiring lock "e09b3809-2e23-401c-9a72-88feb2bb657c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:51:13 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-63b85457-71cc-4b28-b339-f979fa6f3165 tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] Lock "e09b3809-2e23-401c-9a72-88feb2bb657c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:51:13 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-63b85457-71cc-4b28-b339-f979fa6f3165 tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] Acquiring lock "e09b3809-2e23-401c-9a72-88feb2bb657c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:51:13 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-63b85457-71cc-4b28-b339-f979fa6f3165 tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] Lock "e09b3809-2e23-401c-9a72-88feb2bb657c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:51:13 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-63b85457-71cc-4b28-b339-f979fa6f3165 tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] Lock "e09b3809-2e23-401c-9a72-88feb2bb657c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:51:13 user nova-compute[75229]: INFO nova.compute.manager [None req-63b85457-71cc-4b28-b339-f979fa6f3165 tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] [instance: e09b3809-2e23-401c-9a72-88feb2bb657c] Terminating instance
Nov 14 09:51:13 user nova-compute[75229]: DEBUG nova.compute.manager [None req-63b85457-71cc-4b28-b339-f979fa6f3165 tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] [instance: e09b3809-2e23-401c-9a72-88feb2bb657c] Start destroying the instance on the hypervisor. {{(pid=75229) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 09:51:13 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-3b611fbc-3286-4aab-91be-38c5ede168bd tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6 --force-share --output=json" returned: 0 in 0.216s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:51:13 user nova-compute[75229]: DEBUG nova.virt.disk.api [None req-3b611fbc-3286-4aab-91be-38c5ede168bd tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d73f431b-d002-4206-8b52-7d313a43dccb/disk. size=1073741824 {{(pid=75229) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 09:51:13 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-3b611fbc-3286-4aab-91be-38c5ede168bd tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d73f431b-d002-4206-8b52-7d313a43dccb/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:51:13 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:51:13 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:51:13 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:51:13 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:51:13 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:51:13 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-3b611fbc-3286-4aab-91be-38c5ede168bd tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d73f431b-d002-4206-8b52-7d313a43dccb/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:51:13 user nova-compute[75229]: DEBUG nova.virt.disk.api [None req-3b611fbc-3286-4aab-91be-38c5ede168bd tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Cannot resize image /opt/stack/data/nova/instances/d73f431b-d002-4206-8b52-7d313a43dccb/disk to a smaller size. {{(pid=75229) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 09:51:13 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-3b611fbc-3286-4aab-91be-38c5ede168bd tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] [instance: d73f431b-d002-4206-8b52-7d313a43dccb] Created local disks {{(pid=75229) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 09:51:13 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-3b611fbc-3286-4aab-91be-38c5ede168bd tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] [instance: d73f431b-d002-4206-8b52-7d313a43dccb] Ensure instance console log exists: /opt/stack/data/nova/instances/d73f431b-d002-4206-8b52-7d313a43dccb/console.log {{(pid=75229) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 09:51:13 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-3b611fbc-3286-4aab-91be-38c5ede168bd tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:51:13 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-3b611fbc-3286-4aab-91be-38c5ede168bd tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:51:13 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-3b611fbc-3286-4aab-91be-38c5ede168bd tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:51:13 user nova-compute[75229]: DEBUG nova.compute.manager [req-f812619a-1859-4dae-8c7d-5adc5d1c37de req-dd165088-d52d-4c0b-871b-69140c8673e8 service nova] [instance: e09b3809-2e23-401c-9a72-88feb2bb657c] Received event network-vif-unplugged-472488d2-9453-4d74-a6b1-6966b835572d {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:51:13 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-f812619a-1859-4dae-8c7d-5adc5d1c37de req-dd165088-d52d-4c0b-871b-69140c8673e8 service nova] Acquiring lock "e09b3809-2e23-401c-9a72-88feb2bb657c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:51:13 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-f812619a-1859-4dae-8c7d-5adc5d1c37de req-dd165088-d52d-4c0b-871b-69140c8673e8 service nova] Lock "e09b3809-2e23-401c-9a72-88feb2bb657c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:51:13 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-f812619a-1859-4dae-8c7d-5adc5d1c37de req-dd165088-d52d-4c0b-871b-69140c8673e8 service nova] Lock "e09b3809-2e23-401c-9a72-88feb2bb657c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:51:13 user nova-compute[75229]: DEBUG nova.compute.manager [req-f812619a-1859-4dae-8c7d-5adc5d1c37de req-dd165088-d52d-4c0b-871b-69140c8673e8 service nova] [instance: e09b3809-2e23-401c-9a72-88feb2bb657c] No waiting events found dispatching network-vif-unplugged-472488d2-9453-4d74-a6b1-6966b835572d {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 09:51:13 user nova-compute[75229]: DEBUG nova.compute.manager [req-f812619a-1859-4dae-8c7d-5adc5d1c37de req-dd165088-d52d-4c0b-871b-69140c8673e8 service nova] [instance: e09b3809-2e23-401c-9a72-88feb2bb657c] Received event network-vif-unplugged-472488d2-9453-4d74-a6b1-6966b835572d for instance with task_state deleting. {{(pid=75229) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 09:51:14 user nova-compute[75229]: DEBUG nova.network.neutron [None req-3b611fbc-3286-4aab-91be-38c5ede168bd tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] [instance: d73f431b-d002-4206-8b52-7d313a43dccb] Successfully created port: 5a68432e-63fc-48e8-bc8c-62e0cd22033c {{(pid=75229) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 09:51:14 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-29f26623-0bb7-4d8a-b9b0-460355aef990 tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] Acquiring lock "673624b6-e830-45e0-9215-ba79fd4f881e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:51:14 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-29f26623-0bb7-4d8a-b9b0-460355aef990 tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] Lock "673624b6-e830-45e0-9215-ba79fd4f881e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:51:14 user nova-compute[75229]: DEBUG nova.compute.manager [None req-29f26623-0bb7-4d8a-b9b0-460355aef990 tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] [instance: 673624b6-e830-45e0-9215-ba79fd4f881e] Starting instance... {{(pid=75229) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 09:51:14 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:51:14 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:51:14 user nova-compute[75229]: INFO nova.virt.libvirt.driver [-] [instance: e09b3809-2e23-401c-9a72-88feb2bb657c] Instance destroyed successfully.
Nov 14 09:51:14 user nova-compute[75229]: DEBUG nova.objects.instance [None req-63b85457-71cc-4b28-b339-f979fa6f3165 tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] Lazy-loading 'resources' on Instance uuid e09b3809-2e23-401c-9a72-88feb2bb657c {{(pid=75229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 09:51:14 user nova-compute[75229]: DEBUG nova.virt.libvirt.vif [None req-63b85457-71cc-4b28-b339-f979fa6f3165 tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T09:43:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1726752268',display_name='tempest-ServerStableDeviceRescueTest-server-1726752268',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1726752268',id=4,image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNm5isUaPy6aeQRy5OrjJxFeGvdR3hP9hNCaGuAFXcrDHTuZbYjZaj7/pLtpuIgJqJ91hnf0ENeQ3ZP5Dwi5b6SQ5W5TR5kgPoLnxRfcQmwE6thKL5eCNtvCvPLZ4XIdRw==',key_name='tempest-keypair-1926094689',keypairs=<?>,launch_index=0,launched_at=2023-11-14T09:48:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='54dca06fda8b43d5bc92fa7c97a872a7',ramdisk_id='',reservation_id='r-fl9qbxad',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-1482859960',owner_user_name='tempest-ServerStableDeviceRescueTest-1482859960-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T09:49:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fbe8d49b2c9e43cf98f14f49fa8de80c',uuid=e09b3809-2e23-401c-9a72-88feb2bb657c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "472488d2-9453-4d74-a6b1-6966b835572d", "address": "fa:16:3e:9f:3a:e8", "network": {"id": "f5285ef5-fa74-4079-a8cd-f970d97c97c3", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-62550527-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.73", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54dca06fda8b43d5bc92fa7c97a872a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap472488d2-94", "ovs_interfaceid": "472488d2-9453-4d74-a6b1-6966b835572d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 09:51:14 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-63b85457-71cc-4b28-b339-f979fa6f3165 tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] Converting VIF {"id": "472488d2-9453-4d74-a6b1-6966b835572d", "address": "fa:16:3e:9f:3a:e8", "network": {"id": "f5285ef5-fa74-4079-a8cd-f970d97c97c3", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-62550527-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.73", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54dca06fda8b43d5bc92fa7c97a872a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap472488d2-94", "ovs_interfaceid": "472488d2-9453-4d74-a6b1-6966b835572d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 09:51:14 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-63b85457-71cc-4b28-b339-f979fa6f3165 tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9f:3a:e8,bridge_name='br-int',has_traffic_filtering=True,id=472488d2-9453-4d74-a6b1-6966b835572d,network=Network(f5285ef5-fa74-4079-a8cd-f970d97c97c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap472488d2-94') {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 09:51:14 user nova-compute[75229]: DEBUG os_vif [None req-63b85457-71cc-4b28-b339-f979fa6f3165 tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9f:3a:e8,bridge_name='br-int',has_traffic_filtering=True,id=472488d2-9453-4d74-a6b1-6966b835572d,network=Network(f5285ef5-fa74-4079-a8cd-f970d97c97c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap472488d2-94') {{(pid=75229) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 09:51:14 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:51:14 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap472488d2-94, bridge=br-int, if_exists=True) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:51:14 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:51:14 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-29f26623-0bb7-4d8a-b9b0-460355aef990 tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:51:14 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-29f26623-0bb7-4d8a-b9b0-460355aef990 tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:51:14 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 09:51:14 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:51:14 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2920fe2f-809b-4517-829d-cdfa7a0d014e) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:51:14 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:51:14 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:51:14 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-29f26623-0bb7-4d8a-b9b0-460355aef990 tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75229) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 09:51:14 user nova-compute[75229]: INFO nova.compute.claims [None req-29f26623-0bb7-4d8a-b9b0-460355aef990 tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] [instance: 673624b6-e830-45e0-9215-ba79fd4f881e] Claim successful on node user
Nov 14 09:51:14 user nova-compute[75229]: INFO os_vif [None req-63b85457-71cc-4b28-b339-f979fa6f3165 tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9f:3a:e8,bridge_name='br-int',has_traffic_filtering=True,id=472488d2-9453-4d74-a6b1-6966b835572d,network=Network(f5285ef5-fa74-4079-a8cd-f970d97c97c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap472488d2-94')
Nov 14 09:51:14 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-63b85457-71cc-4b28-b339-f979fa6f3165 tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] [instance: e09b3809-2e23-401c-9a72-88feb2bb657c] Deleting instance files /opt/stack/data/nova/instances/e09b3809-2e23-401c-9a72-88feb2bb657c_del
Nov 14 09:51:14 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-63b85457-71cc-4b28-b339-f979fa6f3165 tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] [instance: e09b3809-2e23-401c-9a72-88feb2bb657c] Deletion of /opt/stack/data/nova/instances/e09b3809-2e23-401c-9a72-88feb2bb657c_del complete
Nov 14 09:51:14 user nova-compute[75229]: INFO nova.compute.manager [None req-63b85457-71cc-4b28-b339-f979fa6f3165 tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] [instance: e09b3809-2e23-401c-9a72-88feb2bb657c] Took 0.92 seconds to destroy the instance on the hypervisor.
Nov 14 09:51:14 user nova-compute[75229]: DEBUG oslo.service.loopingcall [None req-63b85457-71cc-4b28-b339-f979fa6f3165 tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75229) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 09:51:14 user nova-compute[75229]: DEBUG nova.compute.manager [-] [instance: e09b3809-2e23-401c-9a72-88feb2bb657c] Deallocating network for instance {{(pid=75229) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 09:51:14 user nova-compute[75229]: DEBUG nova.network.neutron [-] [instance: e09b3809-2e23-401c-9a72-88feb2bb657c] deallocate_for_instance() {{(pid=75229) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 09:51:14 user nova-compute[75229]: DEBUG nova.compute.provider_tree [None req-29f26623-0bb7-4d8a-b9b0-460355aef990 tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] Inventory has not changed in ProviderTree for provider: d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 {{(pid=75229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 09:51:14 user nova-compute[75229]: DEBUG nova.scheduler.client.report [None req-29f26623-0bb7-4d8a-b9b0-460355aef990 tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] Inventory has not changed for provider d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 09:51:14 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-29f26623-0bb7-4d8a-b9b0-460355aef990 tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.532s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:51:14 user nova-compute[75229]: DEBUG nova.compute.manager [None req-29f26623-0bb7-4d8a-b9b0-460355aef990 tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] [instance: 673624b6-e830-45e0-9215-ba79fd4f881e] Start building networks asynchronously for instance. {{(pid=75229) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 09:51:14 user nova-compute[75229]: DEBUG nova.compute.manager [None req-29f26623-0bb7-4d8a-b9b0-460355aef990 tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] [instance: 673624b6-e830-45e0-9215-ba79fd4f881e] Allocating IP information in the background. {{(pid=75229) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 09:51:14 user nova-compute[75229]: DEBUG nova.network.neutron [None req-29f26623-0bb7-4d8a-b9b0-460355aef990 tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] [instance: 673624b6-e830-45e0-9215-ba79fd4f881e] allocate_for_instance() {{(pid=75229) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 09:51:14 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-29f26623-0bb7-4d8a-b9b0-460355aef990 tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] [instance: 673624b6-e830-45e0-9215-ba79fd4f881e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 09:51:14 user nova-compute[75229]: DEBUG nova.compute.manager [None req-29f26623-0bb7-4d8a-b9b0-460355aef990 tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] [instance: 673624b6-e830-45e0-9215-ba79fd4f881e] Start building block device mappings for instance. {{(pid=75229) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 09:51:14 user nova-compute[75229]: DEBUG nova.policy [None req-29f26623-0bb7-4d8a-b9b0-460355aef990 tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '915a9d3b56244777aba6ea938e150d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2e9dceab8a45eaa3adb619433b7cf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75229) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 09:51:14 user nova-compute[75229]: DEBUG nova.compute.manager [None req-29f26623-0bb7-4d8a-b9b0-460355aef990 tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] [instance: 673624b6-e830-45e0-9215-ba79fd4f881e] Start spawning the instance on the hypervisor. {{(pid=75229) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 09:51:14 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-29f26623-0bb7-4d8a-b9b0-460355aef990 tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] [instance: 673624b6-e830-45e0-9215-ba79fd4f881e] Creating instance directory {{(pid=75229) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 09:51:14 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-29f26623-0bb7-4d8a-b9b0-460355aef990 tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] [instance: 673624b6-e830-45e0-9215-ba79fd4f881e] Creating image(s)
Nov 14 09:51:14 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-29f26623-0bb7-4d8a-b9b0-460355aef990 tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] Acquiring lock "/opt/stack/data/nova/instances/673624b6-e830-45e0-9215-ba79fd4f881e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:51:14 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-29f26623-0bb7-4d8a-b9b0-460355aef990 tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] Lock "/opt/stack/data/nova/instances/673624b6-e830-45e0-9215-ba79fd4f881e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:51:14 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-29f26623-0bb7-4d8a-b9b0-460355aef990 tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] Lock "/opt/stack/data/nova/instances/673624b6-e830-45e0-9215-ba79fd4f881e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:51:14 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-29f26623-0bb7-4d8a-b9b0-460355aef990 tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6 --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:51:15 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-29f26623-0bb7-4d8a-b9b0-460355aef990 tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6 --force-share --output=json" returned: 0 in 0.188s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:51:15 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-29f26623-0bb7-4d8a-b9b0-460355aef990 tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] Acquiring lock "4f30e3fe703d2381679612a57b1fb80a467f60b6" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:51:15 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-29f26623-0bb7-4d8a-b9b0-460355aef990 tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] Lock "4f30e3fe703d2381679612a57b1fb80a467f60b6" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:51:15 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-29f26623-0bb7-4d8a-b9b0-460355aef990 tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6 --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:51:15 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-29f26623-0bb7-4d8a-b9b0-460355aef990 tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6 --force-share --output=json" returned: 0 in 0.209s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:51:15 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-29f26623-0bb7-4d8a-b9b0-460355aef990 tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6,backing_fmt=raw /opt/stack/data/nova/instances/673624b6-e830-45e0-9215-ba79fd4f881e/disk 1073741824 {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:51:15 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-29f26623-0bb7-4d8a-b9b0-460355aef990 tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6,backing_fmt=raw /opt/stack/data/nova/instances/673624b6-e830-45e0-9215-ba79fd4f881e/disk 1073741824" returned: 0 in 0.057s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:51:15 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-29f26623-0bb7-4d8a-b9b0-460355aef990 tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] Lock "4f30e3fe703d2381679612a57b1fb80a467f60b6" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.274s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:51:15 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-29f26623-0bb7-4d8a-b9b0-460355aef990 tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6 --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:51:15 user nova-compute[75229]: DEBUG nova.network.neutron [None req-29f26623-0bb7-4d8a-b9b0-460355aef990 tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] [instance: 673624b6-e830-45e0-9215-ba79fd4f881e] Successfully created port: 0102e03b-5b3a-46ab-84de-c836b2b46ca5 {{(pid=75229) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 09:51:15 user nova-compute[75229]: DEBUG nova.network.neutron [None req-3b611fbc-3286-4aab-91be-38c5ede168bd tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] [instance: d73f431b-d002-4206-8b52-7d313a43dccb] Successfully updated port: 5a68432e-63fc-48e8-bc8c-62e0cd22033c {{(pid=75229) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 09:51:15 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-3b611fbc-3286-4aab-91be-38c5ede168bd tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Acquiring lock "refresh_cache-d73f431b-d002-4206-8b52-7d313a43dccb" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 09:51:15 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-3b611fbc-3286-4aab-91be-38c5ede168bd tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Acquired lock "refresh_cache-d73f431b-d002-4206-8b52-7d313a43dccb" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 09:51:15 user nova-compute[75229]: DEBUG nova.network.neutron [None req-3b611fbc-3286-4aab-91be-38c5ede168bd tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] [instance: d73f431b-d002-4206-8b52-7d313a43dccb] Building network info cache for instance {{(pid=75229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 09:51:15 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-29f26623-0bb7-4d8a-b9b0-460355aef990 tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6 --force-share --output=json" returned: 0 in 0.202s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:51:15 user nova-compute[75229]: DEBUG nova.virt.disk.api [None req-29f26623-0bb7-4d8a-b9b0-460355aef990 tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] Checking if we can resize image /opt/stack/data/nova/instances/673624b6-e830-45e0-9215-ba79fd4f881e/disk. size=1073741824 {{(pid=75229) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 09:51:15 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-29f26623-0bb7-4d8a-b9b0-460355aef990 tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/673624b6-e830-45e0-9215-ba79fd4f881e/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:51:15 user nova-compute[75229]: DEBUG nova.network.neutron [None req-3b611fbc-3286-4aab-91be-38c5ede168bd tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] [instance: d73f431b-d002-4206-8b52-7d313a43dccb] Instance cache missing network info. {{(pid=75229) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 09:51:15 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-29f26623-0bb7-4d8a-b9b0-460355aef990 tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/673624b6-e830-45e0-9215-ba79fd4f881e/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:51:15 user nova-compute[75229]: DEBUG nova.virt.disk.api [None req-29f26623-0bb7-4d8a-b9b0-460355aef990 tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] Cannot resize image /opt/stack/data/nova/instances/673624b6-e830-45e0-9215-ba79fd4f881e/disk to a smaller size. {{(pid=75229) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 09:51:15 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-29f26623-0bb7-4d8a-b9b0-460355aef990 tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] [instance: 673624b6-e830-45e0-9215-ba79fd4f881e] Created local disks {{(pid=75229) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 09:51:15 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-29f26623-0bb7-4d8a-b9b0-460355aef990 tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] [instance: 673624b6-e830-45e0-9215-ba79fd4f881e] Ensure instance console log exists: /opt/stack/data/nova/instances/673624b6-e830-45e0-9215-ba79fd4f881e/console.log {{(pid=75229) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 09:51:15 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-29f26623-0bb7-4d8a-b9b0-460355aef990 tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:51:15 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-29f26623-0bb7-4d8a-b9b0-460355aef990 tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:51:15 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-29f26623-0bb7-4d8a-b9b0-460355aef990 tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:51:15 user nova-compute[75229]: DEBUG nova.compute.manager [req-1631ff42-0b67-40bb-a5af-6c1f34f9767e req-3b4f82b6-111a-442a-824c-18fefd512827 service nova] [instance: e09b3809-2e23-401c-9a72-88feb2bb657c] Received event network-vif-plugged-472488d2-9453-4d74-a6b1-6966b835572d {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:51:15 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-1631ff42-0b67-40bb-a5af-6c1f34f9767e req-3b4f82b6-111a-442a-824c-18fefd512827 service nova] Acquiring lock "e09b3809-2e23-401c-9a72-88feb2bb657c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:51:15 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-1631ff42-0b67-40bb-a5af-6c1f34f9767e req-3b4f82b6-111a-442a-824c-18fefd512827 service nova] Lock "e09b3809-2e23-401c-9a72-88feb2bb657c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:51:15 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-1631ff42-0b67-40bb-a5af-6c1f34f9767e req-3b4f82b6-111a-442a-824c-18fefd512827 service nova] Lock "e09b3809-2e23-401c-9a72-88feb2bb657c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:51:15 user nova-compute[75229]: DEBUG nova.compute.manager [req-1631ff42-0b67-40bb-a5af-6c1f34f9767e req-3b4f82b6-111a-442a-824c-18fefd512827 service nova] [instance: e09b3809-2e23-401c-9a72-88feb2bb657c] No waiting events found dispatching network-vif-plugged-472488d2-9453-4d74-a6b1-6966b835572d {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 09:51:15 user nova-compute[75229]: WARNING nova.compute.manager [req-1631ff42-0b67-40bb-a5af-6c1f34f9767e req-3b4f82b6-111a-442a-824c-18fefd512827 service nova] [instance: e09b3809-2e23-401c-9a72-88feb2bb657c] Received unexpected event network-vif-plugged-472488d2-9453-4d74-a6b1-6966b835572d for instance with vm_state active and task_state deleting.
Nov 14 09:51:15 user nova-compute[75229]: DEBUG nova.compute.manager [req-1631ff42-0b67-40bb-a5af-6c1f34f9767e req-3b4f82b6-111a-442a-824c-18fefd512827 service nova] [instance: d73f431b-d002-4206-8b52-7d313a43dccb] Received event network-changed-5a68432e-63fc-48e8-bc8c-62e0cd22033c {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:51:15 user nova-compute[75229]: DEBUG nova.compute.manager [req-1631ff42-0b67-40bb-a5af-6c1f34f9767e req-3b4f82b6-111a-442a-824c-18fefd512827 service nova] [instance: d73f431b-d002-4206-8b52-7d313a43dccb] Refreshing instance network info cache due to event network-changed-5a68432e-63fc-48e8-bc8c-62e0cd22033c. {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 09:51:15 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-1631ff42-0b67-40bb-a5af-6c1f34f9767e req-3b4f82b6-111a-442a-824c-18fefd512827 service nova] Acquiring lock "refresh_cache-d73f431b-d002-4206-8b52-7d313a43dccb" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 09:51:16 user nova-compute[75229]: DEBUG nova.network.neutron [-] [instance: e09b3809-2e23-401c-9a72-88feb2bb657c] Updating instance_info_cache with network_info: [] {{(pid=75229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 09:51:16 user nova-compute[75229]: INFO nova.compute.manager [-] [instance: e09b3809-2e23-401c-9a72-88feb2bb657c] Took 1.74 seconds to deallocate network for instance.
Nov 14 09:51:16 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-63b85457-71cc-4b28-b339-f979fa6f3165 tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:51:16 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-63b85457-71cc-4b28-b339-f979fa6f3165 tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:51:16 user nova-compute[75229]: DEBUG nova.network.neutron [None req-3b611fbc-3286-4aab-91be-38c5ede168bd tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] [instance: d73f431b-d002-4206-8b52-7d313a43dccb] Updating instance_info_cache with network_info: [{"id": "5a68432e-63fc-48e8-bc8c-62e0cd22033c", "address": "fa:16:3e:0c:97:35", "network": {"id": "589aea41-545f-4875-ab56-b7aa273dad6f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-785276916-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee9447f169de43829fe3ed51592752e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a68432e-63", "ovs_interfaceid": "5a68432e-63fc-48e8-bc8c-62e0cd22033c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 09:51:16 user nova-compute[75229]: DEBUG nova.network.neutron [None req-29f26623-0bb7-4d8a-b9b0-460355aef990 tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] [instance: 673624b6-e830-45e0-9215-ba79fd4f881e] Successfully updated port: 0102e03b-5b3a-46ab-84de-c836b2b46ca5 {{(pid=75229) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 09:51:16 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-3b611fbc-3286-4aab-91be-38c5ede168bd tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Releasing lock "refresh_cache-d73f431b-d002-4206-8b52-7d313a43dccb" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 09:51:16 user nova-compute[75229]: DEBUG nova.compute.manager [None req-3b611fbc-3286-4aab-91be-38c5ede168bd tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] [instance: d73f431b-d002-4206-8b52-7d313a43dccb] Instance network_info: |[{"id": "5a68432e-63fc-48e8-bc8c-62e0cd22033c", "address": "fa:16:3e:0c:97:35", "network": {"id": "589aea41-545f-4875-ab56-b7aa273dad6f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-785276916-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee9447f169de43829fe3ed51592752e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a68432e-63", "ovs_interfaceid": "5a68432e-63fc-48e8-bc8c-62e0cd22033c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75229) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 09:51:16 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-1631ff42-0b67-40bb-a5af-6c1f34f9767e req-3b4f82b6-111a-442a-824c-18fefd512827 service nova] Acquired lock "refresh_cache-d73f431b-d002-4206-8b52-7d313a43dccb" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 09:51:16 user nova-compute[75229]: DEBUG nova.network.neutron [req-1631ff42-0b67-40bb-a5af-6c1f34f9767e req-3b4f82b6-111a-442a-824c-18fefd512827 service nova] [instance: d73f431b-d002-4206-8b52-7d313a43dccb] Refreshing network info cache for port 5a68432e-63fc-48e8-bc8c-62e0cd22033c {{(pid=75229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 09:51:16 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-3b611fbc-3286-4aab-91be-38c5ede168bd tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] [instance: d73f431b-d002-4206-8b52-7d313a43dccb] Start _get_guest_xml network_info=[{"id": "5a68432e-63fc-48e8-bc8c-62e0cd22033c", "address": "fa:16:3e:0c:97:35", "network": {"id": "589aea41-545f-4875-ab56-b7aa273dad6f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-785276916-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee9447f169de43829fe3ed51592752e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a68432e-63", "ovs_interfaceid": "5a68432e-63fc-48e8-bc8c-62e0cd22033c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T09:40:10Z,direct_url=<?>,disk_format='qcow2',id=3bef8470-ecc7-40e3-95d4-9254348ea72d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='de5a91106b6948ed937a7178ff9464c4',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T09:40:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'disk_bus': 'virtio', 'guest_format': None, 'encryption_secret_uuid': None, 'size': 0, 'device_type': 'disk', 'image_id': '3bef8470-ecc7-40e3-95d4-9254348ea72d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75229) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 09:51:16 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-29f26623-0bb7-4d8a-b9b0-460355aef990 tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] Acquiring lock "refresh_cache-673624b6-e830-45e0-9215-ba79fd4f881e" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 09:51:16 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-29f26623-0bb7-4d8a-b9b0-460355aef990 tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] Acquired lock "refresh_cache-673624b6-e830-45e0-9215-ba79fd4f881e" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 09:51:16 user nova-compute[75229]: DEBUG nova.network.neutron [None req-29f26623-0bb7-4d8a-b9b0-460355aef990 tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] [instance: 673624b6-e830-45e0-9215-ba79fd4f881e] Building network info cache for instance {{(pid=75229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 09:51:16 user nova-compute[75229]: WARNING nova.virt.libvirt.driver [None req-3b611fbc-3286-4aab-91be-38c5ede168bd tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 09:51:16 user nova-compute[75229]: WARNING nova.virt.libvirt.driver [None req-3b611fbc-3286-4aab-91be-38c5ede168bd tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 09:51:16 user nova-compute[75229]: DEBUG nova.compute.manager [req-0315f283-4beb-4055-836e-3543a839a6b1 req-22def8e7-74ea-4bd8-b9c6-85fc584124e4 service nova] [instance: 673624b6-e830-45e0-9215-ba79fd4f881e] Received event network-changed-0102e03b-5b3a-46ab-84de-c836b2b46ca5 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:51:16 user nova-compute[75229]: DEBUG nova.compute.manager [req-0315f283-4beb-4055-836e-3543a839a6b1 req-22def8e7-74ea-4bd8-b9c6-85fc584124e4 service nova] [instance: 673624b6-e830-45e0-9215-ba79fd4f881e] Refreshing instance network info cache due to event network-changed-0102e03b-5b3a-46ab-84de-c836b2b46ca5. {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 09:51:16 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-0315f283-4beb-4055-836e-3543a839a6b1 req-22def8e7-74ea-4bd8-b9c6-85fc584124e4 service nova] Acquiring lock "refresh_cache-673624b6-e830-45e0-9215-ba79fd4f881e" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 09:51:16 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-3b611fbc-3286-4aab-91be-38c5ede168bd tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75229) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 09:51:16 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-3b611fbc-3286-4aab-91be-38c5ede168bd tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] CPU controller missing on host. {{(pid=75229) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 09:51:16 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-3b611fbc-3286-4aab-91be-38c5ede168bd tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75229) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 09:51:16 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-3b611fbc-3286-4aab-91be-38c5ede168bd tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] CPU controller found on host. {{(pid=75229) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 09:51:16 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-3b611fbc-3286-4aab-91be-38c5ede168bd tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75229) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 09:51:16 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-3b611fbc-3286-4aab-91be-38c5ede168bd tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T09:39:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T09:40:10Z,direct_url=<?>,disk_format='qcow2',id=3bef8470-ecc7-40e3-95d4-9254348ea72d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='de5a91106b6948ed937a7178ff9464c4',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T09:40:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 09:51:16 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-3b611fbc-3286-4aab-91be-38c5ede168bd tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Flavor limits 0:0:0 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 09:51:16 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-3b611fbc-3286-4aab-91be-38c5ede168bd tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Image limits 0:0:0 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 09:51:16 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-3b611fbc-3286-4aab-91be-38c5ede168bd tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Flavor pref 0:0:0 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 09:51:16 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-3b611fbc-3286-4aab-91be-38c5ede168bd tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Image pref 0:0:0 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 09:51:16 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-3b611fbc-3286-4aab-91be-38c5ede168bd tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 09:51:16 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-3b611fbc-3286-4aab-91be-38c5ede168bd tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 09:51:16 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-3b611fbc-3286-4aab-91be-38c5ede168bd tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75229) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 09:51:16 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-3b611fbc-3286-4aab-91be-38c5ede168bd tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Got 1 possible topologies {{(pid=75229) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 09:51:16 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-3b611fbc-3286-4aab-91be-38c5ede168bd tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 09:51:16 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-3b611fbc-3286-4aab-91be-38c5ede168bd tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 09:51:16 user nova-compute[75229]: DEBUG nova.virt.libvirt.vif [None req-3b611fbc-3286-4aab-91be-38c5ede168bd tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T09:51:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-96778093',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-96778093',id=25,image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGfyjtPtz5lNuu2b03L54iFuPjmej6LdqUyojatEh20moB6hOdLggbtYqXaWcz4OMc83XdzLg3C2/ZUNoKdUPjhidKL/ruNKttCIqPpB3mHVa3kiDodTu2gKDUCEwJvIxQ==',key_name='tempest-keypair-1883588312',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ee9447f169de43829fe3ed51592752e9',ramdisk_id='',reservation_id='r-9md5usva',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-730167895',owner_user_name='tempest-AttachVolumeShelveTestJSON-730167895-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T09:51:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='319a0a5ee47a426799d40e0ebb62a3b0',uuid=d73f431b-d002-4206-8b52-7d313a43dccb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5a68432e-63fc-48e8-bc8c-62e0cd22033c", "address": "fa:16:3e:0c:97:35", "network": {"id": "589aea41-545f-4875-ab56-b7aa273dad6f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-785276916-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee9447f169de43829fe3ed51592752e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a68432e-63", "ovs_interfaceid": "5a68432e-63fc-48e8-bc8c-62e0cd22033c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75229) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 09:51:16 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-3b611fbc-3286-4aab-91be-38c5ede168bd tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Converting VIF {"id": "5a68432e-63fc-48e8-bc8c-62e0cd22033c", "address": "fa:16:3e:0c:97:35", "network": {"id": "589aea41-545f-4875-ab56-b7aa273dad6f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-785276916-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee9447f169de43829fe3ed51592752e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a68432e-63", "ovs_interfaceid": "5a68432e-63fc-48e8-bc8c-62e0cd22033c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 09:51:16 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-3b611fbc-3286-4aab-91be-38c5ede168bd tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0c:97:35,bridge_name='br-int',has_traffic_filtering=True,id=5a68432e-63fc-48e8-bc8c-62e0cd22033c,network=Network(589aea41-545f-4875-ab56-b7aa273dad6f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a68432e-63') {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 09:51:16 user nova-compute[75229]: DEBUG nova.objects.instance [None req-3b611fbc-3286-4aab-91be-38c5ede168bd tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Lazy-loading 'pci_devices' on Instance uuid d73f431b-d002-4206-8b52-7d313a43dccb {{(pid=75229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 09:51:16 user nova-compute[75229]: DEBUG nova.network.neutron [None req-29f26623-0bb7-4d8a-b9b0-460355aef990 tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] [instance: 673624b6-e830-45e0-9215-ba79fd4f881e] Instance cache missing network info. {{(pid=75229) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 09:51:16 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-3b611fbc-3286-4aab-91be-38c5ede168bd tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] [instance: d73f431b-d002-4206-8b52-7d313a43dccb] End _get_guest_xml xml=<domain type="kvm">
Nov 14 09:51:16 user nova-compute[75229]:   <uuid>d73f431b-d002-4206-8b52-7d313a43dccb</uuid>
Nov 14 09:51:16 user nova-compute[75229]:   <name>instance-00000019</name>
Nov 14 09:51:16 user nova-compute[75229]:   <memory>524288</memory>
Nov 14 09:51:16 user nova-compute[75229]:   <vcpu>1</vcpu>
Nov 14 09:51:16 user nova-compute[75229]:   <metadata>
Nov 14 09:51:16 user nova-compute[75229]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 09:51:16 user nova-compute[75229]:       <nova:package version="0.0.0"/>
Nov 14 09:51:16 user nova-compute[75229]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-96778093</nova:name>
Nov 14 09:51:16 user nova-compute[75229]:       <nova:creationTime>2023-11-14 09:51:16</nova:creationTime>
Nov 14 09:51:16 user nova-compute[75229]:       <nova:flavor name="m1.tiny">
Nov 14 09:51:16 user nova-compute[75229]:         <nova:memory>512</nova:memory>
Nov 14 09:51:16 user nova-compute[75229]:         <nova:disk>1</nova:disk>
Nov 14 09:51:16 user nova-compute[75229]:         <nova:swap>0</nova:swap>
Nov 14 09:51:16 user nova-compute[75229]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 09:51:16 user nova-compute[75229]:         <nova:vcpus>1</nova:vcpus>
Nov 14 09:51:16 user nova-compute[75229]:       </nova:flavor>
Nov 14 09:51:16 user nova-compute[75229]:       <nova:owner>
Nov 14 09:51:16 user nova-compute[75229]:         <nova:user uuid="319a0a5ee47a426799d40e0ebb62a3b0">tempest-AttachVolumeShelveTestJSON-730167895-project-member</nova:user>
Nov 14 09:51:16 user nova-compute[75229]:         <nova:project uuid="ee9447f169de43829fe3ed51592752e9">tempest-AttachVolumeShelveTestJSON-730167895</nova:project>
Nov 14 09:51:16 user nova-compute[75229]:       </nova:owner>
Nov 14 09:51:16 user nova-compute[75229]:       <nova:root type="image" uuid="3bef8470-ecc7-40e3-95d4-9254348ea72d"/>
Nov 14 09:51:16 user nova-compute[75229]:       <nova:ports>
Nov 14 09:51:16 user nova-compute[75229]:         <nova:port uuid="5a68432e-63fc-48e8-bc8c-62e0cd22033c">
Nov 14 09:51:16 user nova-compute[75229]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 14 09:51:16 user nova-compute[75229]:         </nova:port>
Nov 14 09:51:16 user nova-compute[75229]:       </nova:ports>
Nov 14 09:51:16 user nova-compute[75229]:     </nova:instance>
Nov 14 09:51:16 user nova-compute[75229]:   </metadata>
Nov 14 09:51:16 user nova-compute[75229]:   <sysinfo type="smbios">
Nov 14 09:51:16 user nova-compute[75229]:     <system>
Nov 14 09:51:16 user nova-compute[75229]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 09:51:16 user nova-compute[75229]:       <entry name="product">OpenStack Nova</entry>
Nov 14 09:51:16 user nova-compute[75229]:       <entry name="version">0.0.0</entry>
Nov 14 09:51:16 user nova-compute[75229]:       <entry name="serial">d73f431b-d002-4206-8b52-7d313a43dccb</entry>
Nov 14 09:51:16 user nova-compute[75229]:       <entry name="uuid">d73f431b-d002-4206-8b52-7d313a43dccb</entry>
Nov 14 09:51:16 user nova-compute[75229]:       <entry name="family">Virtual Machine</entry>
Nov 14 09:51:16 user nova-compute[75229]:     </system>
Nov 14 09:51:16 user nova-compute[75229]:   </sysinfo>
Nov 14 09:51:16 user nova-compute[75229]:   <os>
Nov 14 09:51:16 user nova-compute[75229]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 09:51:16 user nova-compute[75229]:     <boot dev="hd"/>
Nov 14 09:51:16 user nova-compute[75229]:     <smbios mode="sysinfo"/>
Nov 14 09:51:16 user nova-compute[75229]:   </os>
Nov 14 09:51:16 user nova-compute[75229]:   <features>
Nov 14 09:51:16 user nova-compute[75229]:     <acpi/>
Nov 14 09:51:16 user nova-compute[75229]:     <apic/>
Nov 14 09:51:16 user nova-compute[75229]:     <vmcoreinfo/>
Nov 14 09:51:16 user nova-compute[75229]:   </features>
Nov 14 09:51:16 user nova-compute[75229]:   <clock offset="utc">
Nov 14 09:51:16 user nova-compute[75229]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 09:51:16 user nova-compute[75229]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 09:51:16 user nova-compute[75229]:     <timer name="hpet" present="no"/>
Nov 14 09:51:16 user nova-compute[75229]:   </clock>
Nov 14 09:51:16 user nova-compute[75229]:   <cpu mode="custom" match="exact">
Nov 14 09:51:16 user nova-compute[75229]:     <model>Nehalem</model>
Nov 14 09:51:16 user nova-compute[75229]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 09:51:16 user nova-compute[75229]:   </cpu>
Nov 14 09:51:16 user nova-compute[75229]:   <devices>
Nov 14 09:51:16 user nova-compute[75229]:     <disk type="file" device="disk">
Nov 14 09:51:16 user nova-compute[75229]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 09:51:16 user nova-compute[75229]:       <source file="/opt/stack/data/nova/instances/d73f431b-d002-4206-8b52-7d313a43dccb/disk"/>
Nov 14 09:51:16 user nova-compute[75229]:       <target dev="vda" bus="virtio"/>
Nov 14 09:51:16 user nova-compute[75229]:     </disk>
Nov 14 09:51:16 user nova-compute[75229]:     <interface type="ethernet">
Nov 14 09:51:16 user nova-compute[75229]:       <mac address="fa:16:3e:0c:97:35"/>
Nov 14 09:51:16 user nova-compute[75229]:       <model type="virtio"/>
Nov 14 09:51:16 user nova-compute[75229]:       <mtu size="1442"/>
Nov 14 09:51:16 user nova-compute[75229]:       <target dev="tap5a68432e-63"/>
Nov 14 09:51:16 user nova-compute[75229]:     </interface>
Nov 14 09:51:16 user nova-compute[75229]:     <serial type="pty">
Nov 14 09:51:16 user nova-compute[75229]:       <log file="/opt/stack/data/nova/instances/d73f431b-d002-4206-8b52-7d313a43dccb/console.log" append="off"/>
Nov 14 09:51:16 user nova-compute[75229]:     </serial>
Nov 14 09:51:16 user nova-compute[75229]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 09:51:16 user nova-compute[75229]:     <video>
Nov 14 09:51:16 user nova-compute[75229]:       <model type="virtio"/>
Nov 14 09:51:16 user nova-compute[75229]:     </video>
Nov 14 09:51:16 user nova-compute[75229]:     <rng model="virtio">
Nov 14 09:51:16 user nova-compute[75229]:       <backend model="random">/dev/urandom</backend>
Nov 14 09:51:16 user nova-compute[75229]:     </rng>
Nov 14 09:51:16 user nova-compute[75229]:     <controller type="usb" index="0" model="none"/>
Nov 14 09:51:16 user nova-compute[75229]:     <memballoon model="virtio">
Nov 14 09:51:16 user nova-compute[75229]:       <stats period="10"/>
Nov 14 09:51:16 user nova-compute[75229]:     </memballoon>
Nov 14 09:51:16 user nova-compute[75229]:   </devices>
Nov 14 09:51:16 user nova-compute[75229]: </domain>
Nov 14 09:51:16 user nova-compute[75229]:  {{(pid=75229) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 09:51:16 user nova-compute[75229]: DEBUG nova.virt.libvirt.vif [None req-3b611fbc-3286-4aab-91be-38c5ede168bd tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T09:51:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-96778093',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-96778093',id=25,image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGfyjtPtz5lNuu2b03L54iFuPjmej6LdqUyojatEh20moB6hOdLggbtYqXaWcz4OMc83XdzLg3C2/ZUNoKdUPjhidKL/ruNKttCIqPpB3mHVa3kiDodTu2gKDUCEwJvIxQ==',key_name='tempest-keypair-1883588312',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ee9447f169de43829fe3ed51592752e9',ramdisk_id='',reservation_id='r-9md5usva',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-730167895',owner_user_name='tempest-AttachVolumeShelveTestJSON-730167895-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T09:51:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='319a0a5ee47a426799d40e0ebb62a3b0',uuid=d73f431b-d002-4206-8b52-7d313a43dccb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5a68432e-63fc-48e8-bc8c-62e0cd22033c", "address": "fa:16:3e:0c:97:35", "network": {"id": "589aea41-545f-4875-ab56-b7aa273dad6f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-785276916-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee9447f169de43829fe3ed51592752e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a68432e-63", "ovs_interfaceid": "5a68432e-63fc-48e8-bc8c-62e0cd22033c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 09:51:16 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-3b611fbc-3286-4aab-91be-38c5ede168bd tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Converting VIF {"id": "5a68432e-63fc-48e8-bc8c-62e0cd22033c", "address": "fa:16:3e:0c:97:35", "network": {"id": "589aea41-545f-4875-ab56-b7aa273dad6f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-785276916-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee9447f169de43829fe3ed51592752e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a68432e-63", "ovs_interfaceid": "5a68432e-63fc-48e8-bc8c-62e0cd22033c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 09:51:16 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-3b611fbc-3286-4aab-91be-38c5ede168bd tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0c:97:35,bridge_name='br-int',has_traffic_filtering=True,id=5a68432e-63fc-48e8-bc8c-62e0cd22033c,network=Network(589aea41-545f-4875-ab56-b7aa273dad6f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a68432e-63') {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 09:51:16 user nova-compute[75229]: DEBUG os_vif [None req-3b611fbc-3286-4aab-91be-38c5ede168bd tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0c:97:35,bridge_name='br-int',has_traffic_filtering=True,id=5a68432e-63fc-48e8-bc8c-62e0cd22033c,network=Network(589aea41-545f-4875-ab56-b7aa273dad6f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a68432e-63') {{(pid=75229) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 09:51:16 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:51:16 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:51:16 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 09:51:16 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:51:16 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9b0f6f75-3666-51eb-bfbf-598a2db1d4c6', '_type': 'linux-noop'}}, row=False) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:51:16 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:51:16 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:51:16 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:51:16 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5a68432e-63, may_exist=True, interface_attrs={}) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:51:16 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5a68432e-63, col_values=(('qos', UUID('c09969d1-268a-480f-9322-2cdca3fb6bd7')),), if_exists=True) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:51:16 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5a68432e-63, col_values=(('external_ids', {'iface-id': '5a68432e-63fc-48e8-bc8c-62e0cd22033c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0c:97:35', 'vm-uuid': 'd73f431b-d002-4206-8b52-7d313a43dccb'}),), if_exists=True) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:51:16 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:51:16 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 09:51:16 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:51:16 user nova-compute[75229]: INFO os_vif [None req-3b611fbc-3286-4aab-91be-38c5ede168bd tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0c:97:35,bridge_name='br-int',has_traffic_filtering=True,id=5a68432e-63fc-48e8-bc8c-62e0cd22033c,network=Network(589aea41-545f-4875-ab56-b7aa273dad6f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a68432e-63')
Nov 14 09:51:16 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-3b611fbc-3286-4aab-91be-38c5ede168bd tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] No BDM found with device name vda, not building metadata. {{(pid=75229) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 09:51:16 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-3b611fbc-3286-4aab-91be-38c5ede168bd tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] No VIF found with MAC fa:16:3e:0c:97:35, not building metadata {{(pid=75229) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 09:51:16 user nova-compute[75229]: DEBUG nova.network.neutron [None req-29f26623-0bb7-4d8a-b9b0-460355aef990 tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] [instance: 673624b6-e830-45e0-9215-ba79fd4f881e] Updating instance_info_cache with network_info: [{"id": "0102e03b-5b3a-46ab-84de-c836b2b46ca5", "address": "fa:16:3e:b1:c1:9c", "network": {"id": "4bc624aa-efaf-45a9-b889-84d4bf2953b4", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-271284704-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d2e9dceab8a45eaa3adb619433b7cf0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0102e03b-5b", "ovs_interfaceid": "0102e03b-5b3a-46ab-84de-c836b2b46ca5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 09:51:16 user nova-compute[75229]: DEBUG nova.compute.provider_tree [None req-63b85457-71cc-4b28-b339-f979fa6f3165 tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] Inventory has not changed in ProviderTree for provider: d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 {{(pid=75229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 09:51:16 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-29f26623-0bb7-4d8a-b9b0-460355aef990 tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] Releasing lock "refresh_cache-673624b6-e830-45e0-9215-ba79fd4f881e" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 09:51:16 user nova-compute[75229]: DEBUG nova.compute.manager [None req-29f26623-0bb7-4d8a-b9b0-460355aef990 tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] [instance: 673624b6-e830-45e0-9215-ba79fd4f881e] Instance network_info: |[{"id": "0102e03b-5b3a-46ab-84de-c836b2b46ca5", "address": "fa:16:3e:b1:c1:9c", "network": {"id": "4bc624aa-efaf-45a9-b889-84d4bf2953b4", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-271284704-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d2e9dceab8a45eaa3adb619433b7cf0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0102e03b-5b", "ovs_interfaceid": "0102e03b-5b3a-46ab-84de-c836b2b46ca5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75229) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 09:51:16 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-0315f283-4beb-4055-836e-3543a839a6b1 req-22def8e7-74ea-4bd8-b9c6-85fc584124e4 service nova] Acquired lock "refresh_cache-673624b6-e830-45e0-9215-ba79fd4f881e" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 09:51:16 user nova-compute[75229]: DEBUG nova.network.neutron [req-0315f283-4beb-4055-836e-3543a839a6b1 req-22def8e7-74ea-4bd8-b9c6-85fc584124e4 service nova] [instance: 673624b6-e830-45e0-9215-ba79fd4f881e] Refreshing network info cache for port 0102e03b-5b3a-46ab-84de-c836b2b46ca5 {{(pid=75229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 09:51:16 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-29f26623-0bb7-4d8a-b9b0-460355aef990 tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] [instance: 673624b6-e830-45e0-9215-ba79fd4f881e] Start _get_guest_xml network_info=[{"id": "0102e03b-5b3a-46ab-84de-c836b2b46ca5", "address": "fa:16:3e:b1:c1:9c", "network": {"id": "4bc624aa-efaf-45a9-b889-84d4bf2953b4", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-271284704-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d2e9dceab8a45eaa3adb619433b7cf0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0102e03b-5b", "ovs_interfaceid": "0102e03b-5b3a-46ab-84de-c836b2b46ca5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T09:40:10Z,direct_url=<?>,disk_format='qcow2',id=3bef8470-ecc7-40e3-95d4-9254348ea72d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='de5a91106b6948ed937a7178ff9464c4',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T09:40:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'disk_bus': 'virtio', 'guest_format': None, 'encryption_secret_uuid': None, 'size': 0, 'device_type': 'disk', 'image_id': '3bef8470-ecc7-40e3-95d4-9254348ea72d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75229) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 09:51:16 user nova-compute[75229]: DEBUG nova.scheduler.client.report [None req-63b85457-71cc-4b28-b339-f979fa6f3165 tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] Inventory has not changed for provider d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 09:51:16 user nova-compute[75229]: DEBUG nova.network.neutron [req-1631ff42-0b67-40bb-a5af-6c1f34f9767e req-3b4f82b6-111a-442a-824c-18fefd512827 service nova] [instance: d73f431b-d002-4206-8b52-7d313a43dccb] Updated VIF entry in instance network info cache for port 5a68432e-63fc-48e8-bc8c-62e0cd22033c. {{(pid=75229) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 09:51:16 user nova-compute[75229]: DEBUG nova.network.neutron [req-1631ff42-0b67-40bb-a5af-6c1f34f9767e req-3b4f82b6-111a-442a-824c-18fefd512827 service nova] [instance: d73f431b-d002-4206-8b52-7d313a43dccb] Updating instance_info_cache with network_info: [{"id": "5a68432e-63fc-48e8-bc8c-62e0cd22033c", "address": "fa:16:3e:0c:97:35", "network": {"id": "589aea41-545f-4875-ab56-b7aa273dad6f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-785276916-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee9447f169de43829fe3ed51592752e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a68432e-63", "ovs_interfaceid": "5a68432e-63fc-48e8-bc8c-62e0cd22033c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 09:51:16 user nova-compute[75229]: WARNING nova.virt.libvirt.driver [None req-29f26623-0bb7-4d8a-b9b0-460355aef990 tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 09:51:16 user nova-compute[75229]: WARNING nova.virt.libvirt.driver [None req-29f26623-0bb7-4d8a-b9b0-460355aef990 tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 09:51:16 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-29f26623-0bb7-4d8a-b9b0-460355aef990 tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75229) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 09:51:16 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-29f26623-0bb7-4d8a-b9b0-460355aef990 tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] CPU controller missing on host. {{(pid=75229) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 09:51:16 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-1631ff42-0b67-40bb-a5af-6c1f34f9767e req-3b4f82b6-111a-442a-824c-18fefd512827 service nova] Releasing lock "refresh_cache-d73f431b-d002-4206-8b52-7d313a43dccb" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 09:51:16 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-29f26623-0bb7-4d8a-b9b0-460355aef990 tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75229) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 09:51:16 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-29f26623-0bb7-4d8a-b9b0-460355aef990 tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] CPU controller found on host. {{(pid=75229) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 09:51:16 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-29f26623-0bb7-4d8a-b9b0-460355aef990 tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75229) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 09:51:16 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-29f26623-0bb7-4d8a-b9b0-460355aef990 tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T09:39:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T09:40:10Z,direct_url=<?>,disk_format='qcow2',id=3bef8470-ecc7-40e3-95d4-9254348ea72d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='de5a91106b6948ed937a7178ff9464c4',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T09:40:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 09:51:16 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-29f26623-0bb7-4d8a-b9b0-460355aef990 tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] Flavor limits 0:0:0 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 09:51:16 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-29f26623-0bb7-4d8a-b9b0-460355aef990 tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] Image limits 0:0:0 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 09:51:16 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-29f26623-0bb7-4d8a-b9b0-460355aef990 tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] Flavor pref 0:0:0 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 09:51:16 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-29f26623-0bb7-4d8a-b9b0-460355aef990 tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] Image pref 0:0:0 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 09:51:16 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-29f26623-0bb7-4d8a-b9b0-460355aef990 tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 09:51:16 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-29f26623-0bb7-4d8a-b9b0-460355aef990 tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 09:51:16 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-29f26623-0bb7-4d8a-b9b0-460355aef990 tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75229) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 09:51:16 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-29f26623-0bb7-4d8a-b9b0-460355aef990 tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] Got 1 possible topologies {{(pid=75229) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 09:51:16 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-29f26623-0bb7-4d8a-b9b0-460355aef990 tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 09:51:16 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-29f26623-0bb7-4d8a-b9b0-460355aef990 tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 09:51:16 user nova-compute[75229]: DEBUG nova.virt.libvirt.vif [None req-29f26623-0bb7-4d8a-b9b0-460355aef990 tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T09:51:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-2060843632',display_name='tempest-VolumesSnapshotTestJSON-instance-2060843632',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-2060843632',id=26,image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNVoPiti4jcQ9HrE3b6XLn6nHzH73qOAOZ9O/lgVREYGI6hgEzCS3rKxX7uea7lmBsz30cIjPk3x92phZcoCIZakxbeg4wd66JThjFnPyMJNYvqbjbWBVVa+O+yUVlcEFg==',key_name='tempest-keypair-66224590',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9d2e9dceab8a45eaa3adb619433b7cf0',ramdisk_id='',reservation_id='r-j9hhn1lc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1180270100',owner_user_name='tempest-VolumesSnapshotTestJSON-1180270100-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T09:51:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='915a9d3b56244777aba6ea938e150d3d',uuid=673624b6-e830-45e0-9215-ba79fd4f881e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0102e03b-5b3a-46ab-84de-c836b2b46ca5", "address": "fa:16:3e:b1:c1:9c", "network": {"id": "4bc624aa-efaf-45a9-b889-84d4bf2953b4", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-271284704-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d2e9dceab8a45eaa3adb619433b7cf0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0102e03b-5b", "ovs_interfaceid": "0102e03b-5b3a-46ab-84de-c836b2b46ca5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75229) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 09:51:16 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-29f26623-0bb7-4d8a-b9b0-460355aef990 tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] Converting VIF {"id": "0102e03b-5b3a-46ab-84de-c836b2b46ca5", "address": "fa:16:3e:b1:c1:9c", "network": {"id": "4bc624aa-efaf-45a9-b889-84d4bf2953b4", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-271284704-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d2e9dceab8a45eaa3adb619433b7cf0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0102e03b-5b", "ovs_interfaceid": "0102e03b-5b3a-46ab-84de-c836b2b46ca5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 09:51:16 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-29f26623-0bb7-4d8a-b9b0-460355aef990 tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b1:c1:9c,bridge_name='br-int',has_traffic_filtering=True,id=0102e03b-5b3a-46ab-84de-c836b2b46ca5,network=Network(4bc624aa-efaf-45a9-b889-84d4bf2953b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0102e03b-5b') {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 09:51:16 user nova-compute[75229]: DEBUG nova.objects.instance [None req-29f26623-0bb7-4d8a-b9b0-460355aef990 tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] Lazy-loading 'pci_devices' on Instance uuid 673624b6-e830-45e0-9215-ba79fd4f881e {{(pid=75229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 09:51:16 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-63b85457-71cc-4b28-b339-f979fa6f3165 tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.638s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:51:16 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-29f26623-0bb7-4d8a-b9b0-460355aef990 tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] [instance: 673624b6-e830-45e0-9215-ba79fd4f881e] End _get_guest_xml xml=<domain type="kvm">
Nov 14 09:51:16 user nova-compute[75229]:   <uuid>673624b6-e830-45e0-9215-ba79fd4f881e</uuid>
Nov 14 09:51:16 user nova-compute[75229]:   <name>instance-0000001a</name>
Nov 14 09:51:16 user nova-compute[75229]:   <memory>524288</memory>
Nov 14 09:51:16 user nova-compute[75229]:   <vcpu>1</vcpu>
Nov 14 09:51:16 user nova-compute[75229]:   <metadata>
Nov 14 09:51:16 user nova-compute[75229]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 09:51:16 user nova-compute[75229]:       <nova:package version="0.0.0"/>
Nov 14 09:51:16 user nova-compute[75229]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-2060843632</nova:name>
Nov 14 09:51:16 user nova-compute[75229]:       <nova:creationTime>2023-11-14 09:51:16</nova:creationTime>
Nov 14 09:51:16 user nova-compute[75229]:       <nova:flavor name="m1.tiny">
Nov 14 09:51:16 user nova-compute[75229]:         <nova:memory>512</nova:memory>
Nov 14 09:51:16 user nova-compute[75229]:         <nova:disk>1</nova:disk>
Nov 14 09:51:16 user nova-compute[75229]:         <nova:swap>0</nova:swap>
Nov 14 09:51:16 user nova-compute[75229]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 09:51:16 user nova-compute[75229]:         <nova:vcpus>1</nova:vcpus>
Nov 14 09:51:16 user nova-compute[75229]:       </nova:flavor>
Nov 14 09:51:16 user nova-compute[75229]:       <nova:owner>
Nov 14 09:51:16 user nova-compute[75229]:         <nova:user uuid="915a9d3b56244777aba6ea938e150d3d">tempest-VolumesSnapshotTestJSON-1180270100-project-member</nova:user>
Nov 14 09:51:16 user nova-compute[75229]:         <nova:project uuid="9d2e9dceab8a45eaa3adb619433b7cf0">tempest-VolumesSnapshotTestJSON-1180270100</nova:project>
Nov 14 09:51:16 user nova-compute[75229]:       </nova:owner>
Nov 14 09:51:16 user nova-compute[75229]:       <nova:root type="image" uuid="3bef8470-ecc7-40e3-95d4-9254348ea72d"/>
Nov 14 09:51:16 user nova-compute[75229]:       <nova:ports>
Nov 14 09:51:16 user nova-compute[75229]:         <nova:port uuid="0102e03b-5b3a-46ab-84de-c836b2b46ca5">
Nov 14 09:51:16 user nova-compute[75229]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 14 09:51:16 user nova-compute[75229]:         </nova:port>
Nov 14 09:51:16 user nova-compute[75229]:       </nova:ports>
Nov 14 09:51:16 user nova-compute[75229]:     </nova:instance>
Nov 14 09:51:16 user nova-compute[75229]:   </metadata>
Nov 14 09:51:16 user nova-compute[75229]:   <sysinfo type="smbios">
Nov 14 09:51:16 user nova-compute[75229]:     <system>
Nov 14 09:51:16 user nova-compute[75229]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 09:51:16 user nova-compute[75229]:       <entry name="product">OpenStack Nova</entry>
Nov 14 09:51:16 user nova-compute[75229]:       <entry name="version">0.0.0</entry>
Nov 14 09:51:16 user nova-compute[75229]:       <entry name="serial">673624b6-e830-45e0-9215-ba79fd4f881e</entry>
Nov 14 09:51:16 user nova-compute[75229]:       <entry name="uuid">673624b6-e830-45e0-9215-ba79fd4f881e</entry>
Nov 14 09:51:16 user nova-compute[75229]:       <entry name="family">Virtual Machine</entry>
Nov 14 09:51:16 user nova-compute[75229]:     </system>
Nov 14 09:51:16 user nova-compute[75229]:   </sysinfo>
Nov 14 09:51:16 user nova-compute[75229]:   <os>
Nov 14 09:51:16 user nova-compute[75229]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 09:51:16 user nova-compute[75229]:     <boot dev="hd"/>
Nov 14 09:51:16 user nova-compute[75229]:     <smbios mode="sysinfo"/>
Nov 14 09:51:16 user nova-compute[75229]:   </os>
Nov 14 09:51:16 user nova-compute[75229]:   <features>
Nov 14 09:51:16 user nova-compute[75229]:     <acpi/>
Nov 14 09:51:16 user nova-compute[75229]:     <apic/>
Nov 14 09:51:16 user nova-compute[75229]:     <vmcoreinfo/>
Nov 14 09:51:16 user nova-compute[75229]:   </features>
Nov 14 09:51:16 user nova-compute[75229]:   <clock offset="utc">
Nov 14 09:51:16 user nova-compute[75229]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 09:51:16 user nova-compute[75229]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 09:51:16 user nova-compute[75229]:     <timer name="hpet" present="no"/>
Nov 14 09:51:16 user nova-compute[75229]:   </clock>
Nov 14 09:51:16 user nova-compute[75229]:   <cpu mode="custom" match="exact">
Nov 14 09:51:16 user nova-compute[75229]:     <model>Nehalem</model>
Nov 14 09:51:16 user nova-compute[75229]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 09:51:16 user nova-compute[75229]:   </cpu>
Nov 14 09:51:16 user nova-compute[75229]:   <devices>
Nov 14 09:51:16 user nova-compute[75229]:     <disk type="file" device="disk">
Nov 14 09:51:16 user nova-compute[75229]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 09:51:16 user nova-compute[75229]:       <source file="/opt/stack/data/nova/instances/673624b6-e830-45e0-9215-ba79fd4f881e/disk"/>
Nov 14 09:51:16 user nova-compute[75229]:       <target dev="vda" bus="virtio"/>
Nov 14 09:51:16 user nova-compute[75229]:     </disk>
Nov 14 09:51:16 user nova-compute[75229]:     <interface type="ethernet">
Nov 14 09:51:16 user nova-compute[75229]:       <mac address="fa:16:3e:b1:c1:9c"/>
Nov 14 09:51:16 user nova-compute[75229]:       <model type="virtio"/>
Nov 14 09:51:16 user nova-compute[75229]:       <mtu size="1442"/>
Nov 14 09:51:16 user nova-compute[75229]:       <target dev="tap0102e03b-5b"/>
Nov 14 09:51:16 user nova-compute[75229]:     </interface>
Nov 14 09:51:16 user nova-compute[75229]:     <serial type="pty">
Nov 14 09:51:16 user nova-compute[75229]:       <log file="/opt/stack/data/nova/instances/673624b6-e830-45e0-9215-ba79fd4f881e/console.log" append="off"/>
Nov 14 09:51:16 user nova-compute[75229]:     </serial>
Nov 14 09:51:16 user nova-compute[75229]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 09:51:16 user nova-compute[75229]:     <video>
Nov 14 09:51:16 user nova-compute[75229]:       <model type="virtio"/>
Nov 14 09:51:16 user nova-compute[75229]:     </video>
Nov 14 09:51:16 user nova-compute[75229]:     <rng model="virtio">
Nov 14 09:51:16 user nova-compute[75229]:       <backend model="random">/dev/urandom</backend>
Nov 14 09:51:16 user nova-compute[75229]:     </rng>
Nov 14 09:51:16 user nova-compute[75229]:     <controller type="usb" index="0" model="none"/>
Nov 14 09:51:16 user nova-compute[75229]:     <memballoon model="virtio">
Nov 14 09:51:16 user nova-compute[75229]:       <stats period="10"/>
Nov 14 09:51:16 user nova-compute[75229]:     </memballoon>
Nov 14 09:51:16 user nova-compute[75229]:   </devices>
Nov 14 09:51:16 user nova-compute[75229]: </domain>
Nov 14 09:51:16 user nova-compute[75229]:  {{(pid=75229) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 09:51:16 user nova-compute[75229]: DEBUG nova.virt.libvirt.vif [None req-29f26623-0bb7-4d8a-b9b0-460355aef990 tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T09:51:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-2060843632',display_name='tempest-VolumesSnapshotTestJSON-instance-2060843632',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-2060843632',id=26,image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNVoPiti4jcQ9HrE3b6XLn6nHzH73qOAOZ9O/lgVREYGI6hgEzCS3rKxX7uea7lmBsz30cIjPk3x92phZcoCIZakxbeg4wd66JThjFnPyMJNYvqbjbWBVVa+O+yUVlcEFg==',key_name='tempest-keypair-66224590',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9d2e9dceab8a45eaa3adb619433b7cf0',ramdisk_id='',reservation_id='r-j9hhn1lc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1180270100',owner_user_name='tempest-VolumesSnapshotTestJSON-1180270100-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T09:51:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='915a9d3b56244777aba6ea938e150d3d',uuid=673624b6-e830-45e0-9215-ba79fd4f881e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0102e03b-5b3a-46ab-84de-c836b2b46ca5", "address": "fa:16:3e:b1:c1:9c", "network": {"id": "4bc624aa-efaf-45a9-b889-84d4bf2953b4", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-271284704-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d2e9dceab8a45eaa3adb619433b7cf0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0102e03b-5b", "ovs_interfaceid": "0102e03b-5b3a-46ab-84de-c836b2b46ca5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 09:51:16 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-29f26623-0bb7-4d8a-b9b0-460355aef990 tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] Converting VIF {"id": "0102e03b-5b3a-46ab-84de-c836b2b46ca5", "address": "fa:16:3e:b1:c1:9c", "network": {"id": "4bc624aa-efaf-45a9-b889-84d4bf2953b4", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-271284704-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d2e9dceab8a45eaa3adb619433b7cf0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0102e03b-5b", "ovs_interfaceid": "0102e03b-5b3a-46ab-84de-c836b2b46ca5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 09:51:16 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-29f26623-0bb7-4d8a-b9b0-460355aef990 tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b1:c1:9c,bridge_name='br-int',has_traffic_filtering=True,id=0102e03b-5b3a-46ab-84de-c836b2b46ca5,network=Network(4bc624aa-efaf-45a9-b889-84d4bf2953b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0102e03b-5b') {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 09:51:16 user nova-compute[75229]: DEBUG os_vif [None req-29f26623-0bb7-4d8a-b9b0-460355aef990 tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b1:c1:9c,bridge_name='br-int',has_traffic_filtering=True,id=0102e03b-5b3a-46ab-84de-c836b2b46ca5,network=Network(4bc624aa-efaf-45a9-b889-84d4bf2953b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0102e03b-5b') {{(pid=75229) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 09:51:16 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:51:16 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:51:16 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 09:51:16 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:51:16 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd4f51664-b344-5c32-8e54-ba8aaf99d310', '_type': 'linux-noop'}}, row=False) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:51:16 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:51:16 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 09:51:16 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:51:16 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:51:16 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0102e03b-5b, may_exist=True, interface_attrs={}) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:51:16 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0102e03b-5b, col_values=(('qos', UUID('8e1d2b87-5c5a-4ccc-80d5-8410012b8b72')),), if_exists=True) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:51:16 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0102e03b-5b, col_values=(('external_ids', {'iface-id': '0102e03b-5b3a-46ab-84de-c836b2b46ca5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b1:c1:9c', 'vm-uuid': '673624b6-e830-45e0-9215-ba79fd4f881e'}),), if_exists=True) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:51:16 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:51:16 user nova-compute[75229]: INFO nova.scheduler.client.report [None req-63b85457-71cc-4b28-b339-f979fa6f3165 tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] Deleted allocations for instance e09b3809-2e23-401c-9a72-88feb2bb657c
Nov 14 09:51:16 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 09:51:16 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:51:16 user nova-compute[75229]: INFO os_vif [None req-29f26623-0bb7-4d8a-b9b0-460355aef990 tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b1:c1:9c,bridge_name='br-int',has_traffic_filtering=True,id=0102e03b-5b3a-46ab-84de-c836b2b46ca5,network=Network(4bc624aa-efaf-45a9-b889-84d4bf2953b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0102e03b-5b')
Nov 14 09:51:16 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-29f26623-0bb7-4d8a-b9b0-460355aef990 tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] No BDM found with device name vda, not building metadata. {{(pid=75229) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 09:51:16 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-29f26623-0bb7-4d8a-b9b0-460355aef990 tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] No VIF found with MAC fa:16:3e:b1:c1:9c, not building metadata {{(pid=75229) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 09:51:16 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-63b85457-71cc-4b28-b339-f979fa6f3165 tempest-ServerStableDeviceRescueTest-1482859960 tempest-ServerStableDeviceRescueTest-1482859960-project-member] Lock "e09b3809-2e23-401c-9a72-88feb2bb657c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.623s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:51:17 user nova-compute[75229]: DEBUG nova.network.neutron [req-0315f283-4beb-4055-836e-3543a839a6b1 req-22def8e7-74ea-4bd8-b9c6-85fc584124e4 service nova] [instance: 673624b6-e830-45e0-9215-ba79fd4f881e] Updated VIF entry in instance network info cache for port 0102e03b-5b3a-46ab-84de-c836b2b46ca5. {{(pid=75229) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 09:51:17 user nova-compute[75229]: DEBUG nova.network.neutron [req-0315f283-4beb-4055-836e-3543a839a6b1 req-22def8e7-74ea-4bd8-b9c6-85fc584124e4 service nova] [instance: 673624b6-e830-45e0-9215-ba79fd4f881e] Updating instance_info_cache with network_info: [{"id": "0102e03b-5b3a-46ab-84de-c836b2b46ca5", "address": "fa:16:3e:b1:c1:9c", "network": {"id": "4bc624aa-efaf-45a9-b889-84d4bf2953b4", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-271284704-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d2e9dceab8a45eaa3adb619433b7cf0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0102e03b-5b", "ovs_interfaceid": "0102e03b-5b3a-46ab-84de-c836b2b46ca5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 09:51:17 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-0315f283-4beb-4055-836e-3543a839a6b1 req-22def8e7-74ea-4bd8-b9c6-85fc584124e4 service nova] Releasing lock "refresh_cache-673624b6-e830-45e0-9215-ba79fd4f881e" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 09:51:18 user nova-compute[75229]: DEBUG nova.compute.manager [req-a0b9b366-4515-481d-bfad-147241f82325 req-f37d0e9d-3dc4-4469-b64a-89f9bed0e10a service nova] [instance: e09b3809-2e23-401c-9a72-88feb2bb657c] Received event network-vif-deleted-472488d2-9453-4d74-a6b1-6966b835572d {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:51:18 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:51:18 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:51:18 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:51:18 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:51:18 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:51:18 user nova-compute[75229]: DEBUG nova.compute.manager [req-bf5788cb-f736-4794-8294-f1c71c637ce4 req-3ed6d99e-d944-4cf5-a922-a7f2ad888060 service nova] [instance: d73f431b-d002-4206-8b52-7d313a43dccb] Received event network-vif-plugged-5a68432e-63fc-48e8-bc8c-62e0cd22033c {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:51:18 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-bf5788cb-f736-4794-8294-f1c71c637ce4 req-3ed6d99e-d944-4cf5-a922-a7f2ad888060 service nova] Acquiring lock "d73f431b-d002-4206-8b52-7d313a43dccb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:51:18 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-bf5788cb-f736-4794-8294-f1c71c637ce4 req-3ed6d99e-d944-4cf5-a922-a7f2ad888060 service nova] Lock "d73f431b-d002-4206-8b52-7d313a43dccb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:51:18 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-bf5788cb-f736-4794-8294-f1c71c637ce4 req-3ed6d99e-d944-4cf5-a922-a7f2ad888060 service nova] Lock "d73f431b-d002-4206-8b52-7d313a43dccb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:51:18 user nova-compute[75229]: DEBUG nova.compute.manager [req-bf5788cb-f736-4794-8294-f1c71c637ce4 req-3ed6d99e-d944-4cf5-a922-a7f2ad888060 service nova] [instance: d73f431b-d002-4206-8b52-7d313a43dccb] No waiting events found dispatching network-vif-plugged-5a68432e-63fc-48e8-bc8c-62e0cd22033c {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 09:51:18 user nova-compute[75229]: WARNING nova.compute.manager [req-bf5788cb-f736-4794-8294-f1c71c637ce4 req-3ed6d99e-d944-4cf5-a922-a7f2ad888060 service nova] [instance: d73f431b-d002-4206-8b52-7d313a43dccb] Received unexpected event network-vif-plugged-5a68432e-63fc-48e8-bc8c-62e0cd22033c for instance with vm_state building and task_state spawning.
Nov 14 09:51:19 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:51:19 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:51:19 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:51:19 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:51:19 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:51:19 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:51:19 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:51:19 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:51:20 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:51:20 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:51:20 user nova-compute[75229]: DEBUG nova.compute.manager [req-35fee769-eaf3-409c-8a07-e5295e61fd25 req-d448c39c-7551-4f3a-8c67-db09e8716277 service nova] [instance: d73f431b-d002-4206-8b52-7d313a43dccb] Received event network-vif-plugged-5a68432e-63fc-48e8-bc8c-62e0cd22033c {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:51:20 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-35fee769-eaf3-409c-8a07-e5295e61fd25 req-d448c39c-7551-4f3a-8c67-db09e8716277 service nova] Acquiring lock "d73f431b-d002-4206-8b52-7d313a43dccb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:51:20 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-35fee769-eaf3-409c-8a07-e5295e61fd25 req-d448c39c-7551-4f3a-8c67-db09e8716277 service nova] Lock "d73f431b-d002-4206-8b52-7d313a43dccb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:51:20 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-35fee769-eaf3-409c-8a07-e5295e61fd25 req-d448c39c-7551-4f3a-8c67-db09e8716277 service nova] Lock "d73f431b-d002-4206-8b52-7d313a43dccb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:51:20 user nova-compute[75229]: DEBUG nova.compute.manager [req-35fee769-eaf3-409c-8a07-e5295e61fd25 req-d448c39c-7551-4f3a-8c67-db09e8716277 service nova] [instance: d73f431b-d002-4206-8b52-7d313a43dccb] No waiting events found dispatching network-vif-plugged-5a68432e-63fc-48e8-bc8c-62e0cd22033c {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 09:51:20 user nova-compute[75229]: WARNING nova.compute.manager [req-35fee769-eaf3-409c-8a07-e5295e61fd25 req-d448c39c-7551-4f3a-8c67-db09e8716277 service nova] [instance: d73f431b-d002-4206-8b52-7d313a43dccb] Received unexpected event network-vif-plugged-5a68432e-63fc-48e8-bc8c-62e0cd22033c for instance with vm_state building and task_state spawning.
Nov 14 09:51:20 user nova-compute[75229]: DEBUG nova.compute.manager [req-35fee769-eaf3-409c-8a07-e5295e61fd25 req-d448c39c-7551-4f3a-8c67-db09e8716277 service nova] [instance: 673624b6-e830-45e0-9215-ba79fd4f881e] Received event network-vif-plugged-0102e03b-5b3a-46ab-84de-c836b2b46ca5 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:51:20 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-35fee769-eaf3-409c-8a07-e5295e61fd25 req-d448c39c-7551-4f3a-8c67-db09e8716277 service nova] Acquiring lock "673624b6-e830-45e0-9215-ba79fd4f881e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:51:20 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-35fee769-eaf3-409c-8a07-e5295e61fd25 req-d448c39c-7551-4f3a-8c67-db09e8716277 service nova] Lock "673624b6-e830-45e0-9215-ba79fd4f881e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:51:20 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-35fee769-eaf3-409c-8a07-e5295e61fd25 req-d448c39c-7551-4f3a-8c67-db09e8716277 service nova] Lock "673624b6-e830-45e0-9215-ba79fd4f881e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:51:20 user nova-compute[75229]: DEBUG nova.compute.manager [req-35fee769-eaf3-409c-8a07-e5295e61fd25 req-d448c39c-7551-4f3a-8c67-db09e8716277 service nova] [instance: 673624b6-e830-45e0-9215-ba79fd4f881e] No waiting events found dispatching network-vif-plugged-0102e03b-5b3a-46ab-84de-c836b2b46ca5 {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 09:51:20 user nova-compute[75229]: WARNING nova.compute.manager [req-35fee769-eaf3-409c-8a07-e5295e61fd25 req-d448c39c-7551-4f3a-8c67-db09e8716277 service nova] [instance: 673624b6-e830-45e0-9215-ba79fd4f881e] Received unexpected event network-vif-plugged-0102e03b-5b3a-46ab-84de-c836b2b46ca5 for instance with vm_state building and task_state spawning.
Nov 14 09:51:20 user nova-compute[75229]: DEBUG nova.compute.manager [req-35fee769-eaf3-409c-8a07-e5295e61fd25 req-d448c39c-7551-4f3a-8c67-db09e8716277 service nova] [instance: 673624b6-e830-45e0-9215-ba79fd4f881e] Received event network-vif-plugged-0102e03b-5b3a-46ab-84de-c836b2b46ca5 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:51:20 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-35fee769-eaf3-409c-8a07-e5295e61fd25 req-d448c39c-7551-4f3a-8c67-db09e8716277 service nova] Acquiring lock "673624b6-e830-45e0-9215-ba79fd4f881e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:51:20 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-35fee769-eaf3-409c-8a07-e5295e61fd25 req-d448c39c-7551-4f3a-8c67-db09e8716277 service nova] Lock "673624b6-e830-45e0-9215-ba79fd4f881e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:51:20 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-35fee769-eaf3-409c-8a07-e5295e61fd25 req-d448c39c-7551-4f3a-8c67-db09e8716277 service nova] Lock "673624b6-e830-45e0-9215-ba79fd4f881e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:51:20 user nova-compute[75229]: DEBUG nova.compute.manager [req-35fee769-eaf3-409c-8a07-e5295e61fd25 req-d448c39c-7551-4f3a-8c67-db09e8716277 service nova] [instance: 673624b6-e830-45e0-9215-ba79fd4f881e] No waiting events found dispatching network-vif-plugged-0102e03b-5b3a-46ab-84de-c836b2b46ca5 {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 09:51:20 user nova-compute[75229]: WARNING nova.compute.manager [req-35fee769-eaf3-409c-8a07-e5295e61fd25 req-d448c39c-7551-4f3a-8c67-db09e8716277 service nova] [instance: 673624b6-e830-45e0-9215-ba79fd4f881e] Received unexpected event network-vif-plugged-0102e03b-5b3a-46ab-84de-c836b2b46ca5 for instance with vm_state building and task_state spawning.
Nov 14 09:51:21 user nova-compute[75229]: DEBUG nova.compute.manager [None req-29f26623-0bb7-4d8a-b9b0-460355aef990 tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] [instance: 673624b6-e830-45e0-9215-ba79fd4f881e] Instance event wait completed in 0 seconds for  {{(pid=75229) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 09:51:21 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-29f26623-0bb7-4d8a-b9b0-460355aef990 tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] [instance: 673624b6-e830-45e0-9215-ba79fd4f881e] Guest created on hypervisor {{(pid=75229) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 09:51:21 user nova-compute[75229]: INFO nova.virt.libvirt.driver [-] [instance: 673624b6-e830-45e0-9215-ba79fd4f881e] Instance spawned successfully.
Nov 14 09:51:21 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-29f26623-0bb7-4d8a-b9b0-460355aef990 tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] [instance: 673624b6-e830-45e0-9215-ba79fd4f881e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 09:51:21 user nova-compute[75229]: DEBUG nova.compute.manager [None req-3b611fbc-3286-4aab-91be-38c5ede168bd tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] [instance: d73f431b-d002-4206-8b52-7d313a43dccb] Instance event wait completed in 0 seconds for  {{(pid=75229) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 09:51:21 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-3b611fbc-3286-4aab-91be-38c5ede168bd tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] [instance: d73f431b-d002-4206-8b52-7d313a43dccb] Guest created on hypervisor {{(pid=75229) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 09:51:21 user nova-compute[75229]: INFO nova.virt.libvirt.driver [-] [instance: d73f431b-d002-4206-8b52-7d313a43dccb] Instance spawned successfully.
Nov 14 09:51:21 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-3b611fbc-3286-4aab-91be-38c5ede168bd tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] [instance: d73f431b-d002-4206-8b52-7d313a43dccb] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 09:51:21 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-29f26623-0bb7-4d8a-b9b0-460355aef990 tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] [instance: 673624b6-e830-45e0-9215-ba79fd4f881e] Found default for hw_cdrom_bus of ide {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 09:51:21 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-29f26623-0bb7-4d8a-b9b0-460355aef990 tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] [instance: 673624b6-e830-45e0-9215-ba79fd4f881e] Found default for hw_disk_bus of virtio {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 09:51:21 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-29f26623-0bb7-4d8a-b9b0-460355aef990 tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] [instance: 673624b6-e830-45e0-9215-ba79fd4f881e] Found default for hw_input_bus of None {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 09:51:21 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-29f26623-0bb7-4d8a-b9b0-460355aef990 tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] [instance: 673624b6-e830-45e0-9215-ba79fd4f881e] Found default for hw_pointer_model of None {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 09:51:21 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-29f26623-0bb7-4d8a-b9b0-460355aef990 tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] [instance: 673624b6-e830-45e0-9215-ba79fd4f881e] Found default for hw_video_model of virtio {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 09:51:21 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-29f26623-0bb7-4d8a-b9b0-460355aef990 tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] [instance: 673624b6-e830-45e0-9215-ba79fd4f881e] Found default for hw_vif_model of virtio {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 09:51:21 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-3b611fbc-3286-4aab-91be-38c5ede168bd tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] [instance: d73f431b-d002-4206-8b52-7d313a43dccb] Found default for hw_cdrom_bus of ide {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 09:51:21 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-3b611fbc-3286-4aab-91be-38c5ede168bd tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] [instance: d73f431b-d002-4206-8b52-7d313a43dccb] Found default for hw_disk_bus of virtio {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 09:51:21 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-3b611fbc-3286-4aab-91be-38c5ede168bd tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] [instance: d73f431b-d002-4206-8b52-7d313a43dccb] Found default for hw_input_bus of None {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 09:51:21 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-3b611fbc-3286-4aab-91be-38c5ede168bd tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] [instance: d73f431b-d002-4206-8b52-7d313a43dccb] Found default for hw_pointer_model of None {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 09:51:21 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-3b611fbc-3286-4aab-91be-38c5ede168bd tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] [instance: d73f431b-d002-4206-8b52-7d313a43dccb] Found default for hw_video_model of virtio {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 09:51:21 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-3b611fbc-3286-4aab-91be-38c5ede168bd tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] [instance: d73f431b-d002-4206-8b52-7d313a43dccb] Found default for hw_vif_model of virtio {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 09:51:21 user nova-compute[75229]: INFO nova.compute.manager [None req-29f26623-0bb7-4d8a-b9b0-460355aef990 tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] [instance: 673624b6-e830-45e0-9215-ba79fd4f881e] Took 6.72 seconds to spawn the instance on the hypervisor.
Nov 14 09:51:21 user nova-compute[75229]: DEBUG nova.compute.manager [None req-29f26623-0bb7-4d8a-b9b0-460355aef990 tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] [instance: 673624b6-e830-45e0-9215-ba79fd4f881e] Checking state {{(pid=75229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 09:51:21 user nova-compute[75229]: INFO nova.compute.manager [None req-3b611fbc-3286-4aab-91be-38c5ede168bd tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] [instance: d73f431b-d002-4206-8b52-7d313a43dccb] Took 8.98 seconds to spawn the instance on the hypervisor.
Nov 14 09:51:21 user nova-compute[75229]: DEBUG nova.compute.manager [None req-3b611fbc-3286-4aab-91be-38c5ede168bd tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] [instance: d73f431b-d002-4206-8b52-7d313a43dccb] Checking state {{(pid=75229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 09:51:21 user nova-compute[75229]: INFO nova.compute.manager [None req-29f26623-0bb7-4d8a-b9b0-460355aef990 tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] [instance: 673624b6-e830-45e0-9215-ba79fd4f881e] Took 7.64 seconds to build instance.
Nov 14 09:51:21 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:51:21 user nova-compute[75229]: INFO nova.compute.manager [None req-3b611fbc-3286-4aab-91be-38c5ede168bd tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] [instance: d73f431b-d002-4206-8b52-7d313a43dccb] Took 9.88 seconds to build instance.
Nov 14 09:51:21 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-29f26623-0bb7-4d8a-b9b0-460355aef990 tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] Lock "673624b6-e830-45e0-9215-ba79fd4f881e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.768s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:51:21 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-3b611fbc-3286-4aab-91be-38c5ede168bd tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Lock "d73f431b-d002-4206-8b52-7d313a43dccb" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.978s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:51:23 user nova-compute[75229]: DEBUG nova.compute.manager [req-db885e4a-f8a5-4df5-9793-8df99d9806c6 req-7a098a7a-db97-4c12-94e7-8dcc6e0b87ce service nova] [instance: a4ce290f-6dd2-44b6-91be-8e775045837e] Received event network-changed-0621f697-c41d-49da-9b80-6a2879fef41e {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:51:23 user nova-compute[75229]: DEBUG nova.compute.manager [req-db885e4a-f8a5-4df5-9793-8df99d9806c6 req-7a098a7a-db97-4c12-94e7-8dcc6e0b87ce service nova] [instance: a4ce290f-6dd2-44b6-91be-8e775045837e] Refreshing instance network info cache due to event network-changed-0621f697-c41d-49da-9b80-6a2879fef41e. {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 09:51:23 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-db885e4a-f8a5-4df5-9793-8df99d9806c6 req-7a098a7a-db97-4c12-94e7-8dcc6e0b87ce service nova] Acquiring lock "refresh_cache-a4ce290f-6dd2-44b6-91be-8e775045837e" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 09:51:23 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-db885e4a-f8a5-4df5-9793-8df99d9806c6 req-7a098a7a-db97-4c12-94e7-8dcc6e0b87ce service nova] Acquired lock "refresh_cache-a4ce290f-6dd2-44b6-91be-8e775045837e" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 09:51:23 user nova-compute[75229]: DEBUG nova.network.neutron [req-db885e4a-f8a5-4df5-9793-8df99d9806c6 req-7a098a7a-db97-4c12-94e7-8dcc6e0b87ce service nova] [instance: a4ce290f-6dd2-44b6-91be-8e775045837e] Refreshing network info cache for port 0621f697-c41d-49da-9b80-6a2879fef41e {{(pid=75229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 09:51:23 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:51:23 user nova-compute[75229]: DEBUG nova.network.neutron [req-db885e4a-f8a5-4df5-9793-8df99d9806c6 req-7a098a7a-db97-4c12-94e7-8dcc6e0b87ce service nova] [instance: a4ce290f-6dd2-44b6-91be-8e775045837e] Updated VIF entry in instance network info cache for port 0621f697-c41d-49da-9b80-6a2879fef41e. {{(pid=75229) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 09:51:23 user nova-compute[75229]: DEBUG nova.network.neutron [req-db885e4a-f8a5-4df5-9793-8df99d9806c6 req-7a098a7a-db97-4c12-94e7-8dcc6e0b87ce service nova] [instance: a4ce290f-6dd2-44b6-91be-8e775045837e] Updating instance_info_cache with network_info: [{"id": "0621f697-c41d-49da-9b80-6a2879fef41e", "address": "fa:16:3e:34:59:a9", "network": {"id": "8d89f286-0349-4334-b27a-873f684d3652", "bridge": "br-int", "label": "tempest-TestStampPattern-841799214-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.44", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a196548d9de4e18b8bab9fefdab0861", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0621f697-c4", "ovs_interfaceid": "0621f697-c41d-49da-9b80-6a2879fef41e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 09:51:23 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-7637ebe1-2a72-42be-9254-8f6a6f756d36 tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] Acquiring lock "a4ce290f-6dd2-44b6-91be-8e775045837e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:51:23 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-7637ebe1-2a72-42be-9254-8f6a6f756d36 tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] Lock "a4ce290f-6dd2-44b6-91be-8e775045837e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:51:23 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-db885e4a-f8a5-4df5-9793-8df99d9806c6 req-7a098a7a-db97-4c12-94e7-8dcc6e0b87ce service nova] Releasing lock "refresh_cache-a4ce290f-6dd2-44b6-91be-8e775045837e" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 09:51:23 user nova-compute[75229]: DEBUG nova.objects.instance [None req-7637ebe1-2a72-42be-9254-8f6a6f756d36 tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] Lazy-loading 'flavor' on Instance uuid a4ce290f-6dd2-44b6-91be-8e775045837e {{(pid=75229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 09:51:23 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-7637ebe1-2a72-42be-9254-8f6a6f756d36 tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] Lock "a4ce290f-6dd2-44b6-91be-8e775045837e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.073s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:51:23 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-7637ebe1-2a72-42be-9254-8f6a6f756d36 tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] Acquiring lock "a4ce290f-6dd2-44b6-91be-8e775045837e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:51:23 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-7637ebe1-2a72-42be-9254-8f6a6f756d36 tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] Lock "a4ce290f-6dd2-44b6-91be-8e775045837e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.003s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:51:23 user nova-compute[75229]: INFO nova.compute.manager [None req-7637ebe1-2a72-42be-9254-8f6a6f756d36 tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] [instance: a4ce290f-6dd2-44b6-91be-8e775045837e] Attaching volume 00fbc288-68ce-437c-b00d-3f9c5af4c820 to /dev/vdb
Nov 14 09:51:23 user nova-compute[75229]: DEBUG os_brick.utils [None req-7637ebe1-2a72-42be-9254-8f6a6f756d36 tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 09:51:23 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:51:23 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:51:23 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[a35822eb-2092-4831-b09a-9a170d9f9e0a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f1154031c835\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:51:23 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:51:23 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:51:23 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[0567b384-5804-43c4-a194-b21d4534ca1e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:51:24 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:51:24 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:51:24 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdb6434c-bee7-4c18-8cdf-dbacb8c58829]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:51:24 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b3ca208-1d4f-4e59-a5be-0d0b993abc59]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:51:24 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-7637ebe1-2a72-42be-9254-8f6a6f756d36 tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] Running cmd (subprocess): nvme version {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:51:24 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-7637ebe1-2a72-42be-9254-8f6a6f756d36 tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] 'nvme version' failed. Not Retrying. {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 09:51:24 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7637ebe1-2a72-42be-9254-8f6a6f756d36 tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] nvme not present on system {{(pid=75229) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 09:51:24 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:51:24 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 09:51:24 user nova-compute[75229]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 09:51:24 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[af5ef30d-487f-4382-b715-941caa8bc10e]: (4, '') {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:51:24 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.lightos [None req-7637ebe1-2a72-42be-9254-8f6a6f756d36 tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75229) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 09:51:24 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.lightos [None req-7637ebe1-2a72-42be-9254-8f6a6f756d36 tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75229) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 09:51:24 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.lightos [None req-7637ebe1-2a72-42be-9254-8f6a6f756d36 tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] LIGHTOS: no hostnqn found. {{(pid=75229) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 09:51:24 user nova-compute[75229]: DEBUG os_brick.utils [None req-7637ebe1-2a72-42be-9254-8f6a6f756d36 tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] <== get_connector_properties: return (139ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f1154031c835', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 09:51:24 user nova-compute[75229]: DEBUG nova.virt.block_device [None req-7637ebe1-2a72-42be-9254-8f6a6f756d36 tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] [instance: a4ce290f-6dd2-44b6-91be-8e775045837e] Updating existing volume attachment record: 48000617-e966-4699-bdb8-8a8d771a9c28 {{(pid=75229) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 09:51:26 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:51:28 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:51:28 user nova-compute[75229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7637ebe1-2a72-42be-9254-8f6a6f756d36 tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] [instance: a4ce290f-6dd2-44b6-91be-8e775045837e] Calling os-brick to attach iSCSI Volume {{(pid=75229) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 09:51:28 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-7637ebe1-2a72-42be-9254-8f6a6f756d36 tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f73f85151b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:00fbc288-68ce-437c-b00d-3f9c5af4c820', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cuMBzAXO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 09:51:28 user nova-compute[75229]: WARNING os_brick.initiator.connectors.base [None req-7637ebe1-2a72-42be-9254-8f6a6f756d36 tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 09:51:28 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-7637ebe1-2a72-42be-9254-8f6a6f756d36 tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 09:51:28 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-7637ebe1-2a72-42be-9254-8f6a6f756d36 tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 09:51:28 user nova-compute[75229]: WARNING os_brick.initiator.connectors.base [None req-7637ebe1-2a72-42be-9254-8f6a6f756d36 tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 09:51:28 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-7637ebe1-2a72-42be-9254-8f6a6f756d36 tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:00fbc288-68ce-437c-b00d-3f9c5af4c820" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 09:51:28 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-7637ebe1-2a72-42be-9254-8f6a6f756d36 tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:00fbc288-68ce-437c-b00d-3f9c5af4c820" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 09:51:28 user nova-compute[75229]: INFO os_brick.initiator.connectors.iscsi [None req-7637ebe1-2a72-42be-9254-8f6a6f756d36 tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 09:51:28 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00fbc288-68ce-437c-b00d-3f9c5af4c820 -p 172.16.0.220:3260 {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:51:28 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00fbc288-68ce-437c-b00d-3f9c5af4c820 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:51:28 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c46d7fc-ddf9-4778-8f71-676a55668b1c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:51:28 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-7637ebe1-2a72-42be-9254-8f6a6f756d36 tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 09:51:28 user nova-compute[75229]:  {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:51:28 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00fbc288-68ce-437c-b00d-3f9c5af4c820 -p 172.16.0.220:3260 --interface default --op new {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:51:28 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00fbc288-68ce-437c-b00d-3f9c5af4c820 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:51:28 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c375068-0091-492b-8407-b1a47f48fd6b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:00fbc288-68ce-437c-b00d-3f9c5af4c820] added\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:51:28 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-7637ebe1-2a72-42be-9254-8f6a6f756d36 tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:00fbc288-68ce-437c-b00d-3f9c5af4c820] added
Nov 14 09:51:28 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:51:28 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00fbc288-68ce-437c-b00d-3f9c5af4c820 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:51:28 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00fbc288-68ce-437c-b00d-3f9c5af4c820 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:51:28 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[6712aaca-a171-4401-bab3-b7f314a97ab9]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:51:28 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-7637ebe1-2a72-42be-9254-8f6a6f756d36 tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:51:28 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00fbc288-68ce-437c-b00d-3f9c5af4c820 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:51:28 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00fbc288-68ce-437c-b00d-3f9c5af4c820 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:51:28 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[adf9cb7c-06a7-4972-9c18-b30e13d660b0]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:51:28 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-7637ebe1-2a72-42be-9254-8f6a6f756d36 tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:51:28 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00fbc288-68ce-437c-b00d-3f9c5af4c820 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cuMBzAXO {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:51:28 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00fbc288-68ce-437c-b00d-3f9c5af4c820 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cuMBzAXO" returned: 0 in 0.018s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:51:28 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[441db280-e6bf-4adc-8f61-c426b78c9f0b]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:51:28 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-7637ebe1-2a72-42be-9254-8f6a6f756d36 tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'cuMBzAXO'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:51:28 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00fbc288-68ce-437c-b00d-3f9c5af4c820 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:51:28 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00fbc288-68ce-437c-b00d-3f9c5af4c820 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:51:28 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ea5c66c-4826-48f3-875a-3eb1d5cfafa9]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:51:28 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-7637ebe1-2a72-42be-9254-8f6a6f756d36 tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:51:28 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:51:28 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:51:28 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[43124460-5593-4d7e-9171-fbcc2191ebc5]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7902ab8-168d-4c8a-90e9-bf44d669ce2b (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aca09258-022b-4f04-b418-f2a170332755 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bae4836-52c2-428b-b299-a6a72899197d (non-flash)\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:51:28 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-7637ebe1-2a72-42be-9254-8f6a6f756d36 tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7902ab8-168d-4c8a-90e9-bf44d669ce2b (non-flash)
Nov 14 09:51:28 user nova-compute[75229]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aca09258-022b-4f04-b418-f2a170332755 (non-flash)
Nov 14 09:51:28 user nova-compute[75229]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bae4836-52c2-428b-b299-a6a72899197d (non-flash)
Nov 14 09:51:28 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 09:51:28 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-7637ebe1-2a72-42be-9254-8f6a6f756d36 tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7902ab8-168d-4c8a-90e9-bf44d669ce2b (non-flash)
Nov 14 09:51:28 user nova-compute[75229]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aca09258-022b-4f04-b418-f2a170332755 (non-flash)
Nov 14 09:51:28 user nova-compute[75229]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bae4836-52c2-428b-b299-a6a72899197d (non-flash)
Nov 14 09:51:28 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 09:51:28 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00fbc288-68ce-437c-b00d-3f9c5af4c820 -p 172.16.0.220:3260 --login {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:51:29 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00fbc288-68ce-437c-b00d-3f9c5af4c820 -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:51:29 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[e87e51a4-de11-4402-b497-4a0260ffbd74]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:00fbc288-68ce-437c-b00d-3f9c5af4c820, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:00fbc288-68ce-437c-b00d-3f9c5af4c820, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:51:29 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-7637ebe1-2a72-42be-9254-8f6a6f756d36 tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:00fbc288-68ce-437c-b00d-3f9c5af4c820, portal: 172.16.0.220,3260]
Nov 14 09:51:29 user nova-compute[75229]: Login to [iface: default, target: iqn.2010-10.org.openstack:00fbc288-68ce-437c-b00d-3f9c5af4c820, portal: 172.16.0.220,3260] successful.
Nov 14 09:51:29 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:51:29 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00fbc288-68ce-437c-b00d-3f9c5af4c820 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:51:29 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00fbc288-68ce-437c-b00d-3f9c5af4c820 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:51:29 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[a913b31f-d14e-4669-8063-732cec56d638]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:51:29 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-7637ebe1-2a72-42be-9254-8f6a6f756d36 tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:51:29 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:51:29 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:51:29 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[393f55c5-1bf7-4597-9b76-30e99c30a020]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7902ab8-168d-4c8a-90e9-bf44d669ce2b (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aca09258-022b-4f04-b418-f2a170332755 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bae4836-52c2-428b-b299-a6a72899197d (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00fbc288-68ce-437c-b00d-3f9c5af4c820 (non-flash)\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:51:29 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-7637ebe1-2a72-42be-9254-8f6a6f756d36 tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7902ab8-168d-4c8a-90e9-bf44d669ce2b (non-flash)
Nov 14 09:51:29 user nova-compute[75229]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aca09258-022b-4f04-b418-f2a170332755 (non-flash)
Nov 14 09:51:29 user nova-compute[75229]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bae4836-52c2-428b-b299-a6a72899197d (non-flash)
Nov 14 09:51:29 user nova-compute[75229]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00fbc288-68ce-437c-b00d-3f9c5af4c820 (non-flash)
Nov 14 09:51:29 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 09:51:29 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-7637ebe1-2a72-42be-9254-8f6a6f756d36 tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7902ab8-168d-4c8a-90e9-bf44d669ce2b (non-flash)
Nov 14 09:51:29 user nova-compute[75229]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aca09258-022b-4f04-b418-f2a170332755 (non-flash)
Nov 14 09:51:29 user nova-compute[75229]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bae4836-52c2-428b-b299-a6a72899197d (non-flash)
Nov 14 09:51:29 user nova-compute[75229]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00fbc288-68ce-437c-b00d-3f9c5af4c820 (non-flash)
Nov 14 09:51:29 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 09:51:29 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-7637ebe1-2a72-42be-9254-8f6a6f756d36 tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:00fbc288-68ce-437c-b00d-3f9c5af4c820" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.300s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 09:51:29 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-7637ebe1-2a72-42be-9254-8f6a6f756d36 tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] Connected to 172.16.0.220:3260 {{(pid=75229) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 09:51:29 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-7637ebe1-2a72-42be-9254-8f6a6f756d36 tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] HCTL ('34', '-', '-', 0) found on session 25 with lun 0 {{(pid=75229) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 09:51:29 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-7637ebe1-2a72-42be-9254-8f6a6f756d36 tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75229) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 09:51:29 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:51:29 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.026s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:51:29 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c83473f-d5e4-49ad-a4ad-6d45b32fde93]: (4, ('- - 0', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:51:29 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-7637ebe1-2a72-42be-9254-8f6a6f756d36 tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] Searching for a device in session 25 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75229) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 09:51:29 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-7637ebe1-2a72-42be-9254-8f6a6f756d36 tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:00fbc288-68ce-437c-b00d-3f9c5af4c820', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cuMBzAXO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75229) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 09:51:30 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-7637ebe1-2a72-42be-9254-8f6a6f756d36 tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.339s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 09:51:30 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-7637ebe1-2a72-42be-9254-8f6a6f756d36 tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] <== connect_volume: return (1342ms) {'type': 'block', 'scsi_wwn': '23733353333613365', 'path': '/dev/sdc'} {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 09:51:30 user nova-compute[75229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7637ebe1-2a72-42be-9254-8f6a6f756d36 tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] [instance: a4ce290f-6dd2-44b6-91be-8e775045837e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23733353333613365', 'path': '/dev/sdc'} {{(pid=75229) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 09:51:30 user nova-compute[75229]: DEBUG nova.objects.instance [None req-7637ebe1-2a72-42be-9254-8f6a6f756d36 tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] Lazy-loading 'flavor' on Instance uuid a4ce290f-6dd2-44b6-91be-8e775045837e {{(pid=75229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 09:51:30 user nova-compute[75229]: DEBUG nova.virt.libvirt.guest [None req-7637ebe1-2a72-42be-9254-8f6a6f756d36 tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 09:51:30 user nova-compute[75229]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 09:51:30 user nova-compute[75229]:   <source dev="/dev/sdc"/>
Nov 14 09:51:30 user nova-compute[75229]:   <target dev="vdb" bus="virtio"/>
Nov 14 09:51:30 user nova-compute[75229]:   <serial>00fbc288-68ce-437c-b00d-3f9c5af4c820</serial>
Nov 14 09:51:30 user nova-compute[75229]: </disk>
Nov 14 09:51:30 user nova-compute[75229]:  {{(pid=75229) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 09:51:30 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-7637ebe1-2a72-42be-9254-8f6a6f756d36 tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] No BDM found with device name vda, not building metadata. {{(pid=75229) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 09:51:30 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-7637ebe1-2a72-42be-9254-8f6a6f756d36 tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75229) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 09:51:30 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-7637ebe1-2a72-42be-9254-8f6a6f756d36 tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] No VIF found with MAC fa:16:3e:34:59:a9, not building metadata {{(pid=75229) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 09:51:30 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-7637ebe1-2a72-42be-9254-8f6a6f756d36 tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] Lock "a4ce290f-6dd2-44b6-91be-8e775045837e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.817s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:51:31 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:51:33 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-6ab746fb-a1a0-49bd-9fa1-26890fd0086d tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] Acquiring lock "a4ce290f-6dd2-44b6-91be-8e775045837e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:51:33 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-6ab746fb-a1a0-49bd-9fa1-26890fd0086d tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] Lock "a4ce290f-6dd2-44b6-91be-8e775045837e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:51:33 user nova-compute[75229]: INFO nova.compute.manager [None req-6ab746fb-a1a0-49bd-9fa1-26890fd0086d tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] [instance: a4ce290f-6dd2-44b6-91be-8e775045837e] Detaching volume 00fbc288-68ce-437c-b00d-3f9c5af4c820
Nov 14 09:51:33 user nova-compute[75229]: INFO nova.virt.block_device [None req-6ab746fb-a1a0-49bd-9fa1-26890fd0086d tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] [instance: a4ce290f-6dd2-44b6-91be-8e775045837e] Attempting to driver detach volume 00fbc288-68ce-437c-b00d-3f9c5af4c820 from mountpoint /dev/vdb
Nov 14 09:51:33 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-6ab746fb-a1a0-49bd-9fa1-26890fd0086d tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] Attempting to detach device vdb from instance a4ce290f-6dd2-44b6-91be-8e775045837e from the persistent domain config. {{(pid=75229) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 09:51:33 user nova-compute[75229]: DEBUG nova.virt.libvirt.guest [None req-6ab746fb-a1a0-49bd-9fa1-26890fd0086d tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 09:51:33 user nova-compute[75229]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 09:51:33 user nova-compute[75229]:   <source dev="/dev/sdc"/>
Nov 14 09:51:33 user nova-compute[75229]:   <target dev="vdb" bus="virtio"/>
Nov 14 09:51:33 user nova-compute[75229]:   <serial>00fbc288-68ce-437c-b00d-3f9c5af4c820</serial>
Nov 14 09:51:33 user nova-compute[75229]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 09:51:33 user nova-compute[75229]: </disk>
Nov 14 09:51:33 user nova-compute[75229]:  {{(pid=75229) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 09:51:33 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-6ab746fb-a1a0-49bd-9fa1-26890fd0086d tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] Successfully detached device vdb from instance a4ce290f-6dd2-44b6-91be-8e775045837e from the persistent domain config.
Nov 14 09:51:33 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-6ab746fb-a1a0-49bd-9fa1-26890fd0086d tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance a4ce290f-6dd2-44b6-91be-8e775045837e from the live domain config. {{(pid=75229) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 09:51:33 user nova-compute[75229]: DEBUG nova.virt.libvirt.guest [None req-6ab746fb-a1a0-49bd-9fa1-26890fd0086d tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 09:51:33 user nova-compute[75229]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 09:51:33 user nova-compute[75229]:   <source dev="/dev/sdc"/>
Nov 14 09:51:33 user nova-compute[75229]:   <target dev="vdb" bus="virtio"/>
Nov 14 09:51:33 user nova-compute[75229]:   <serial>00fbc288-68ce-437c-b00d-3f9c5af4c820</serial>
Nov 14 09:51:33 user nova-compute[75229]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 09:51:33 user nova-compute[75229]: </disk>
Nov 14 09:51:33 user nova-compute[75229]:  {{(pid=75229) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 09:51:33 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:51:33 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-6ab746fb-a1a0-49bd-9fa1-26890fd0086d tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance a4ce290f-6dd2-44b6-91be-8e775045837e {{(pid=75229) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 09:51:36 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:51:37 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-20b432de-c921-43a3-9074-debb2b58a659 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] Acquiring lock "94e2b266-2fe3-481a-bb1e-24f835a79ddf" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:51:37 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-20b432de-c921-43a3-9074-debb2b58a659 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] Lock "94e2b266-2fe3-481a-bb1e-24f835a79ddf" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:51:37 user nova-compute[75229]: DEBUG nova.objects.instance [None req-20b432de-c921-43a3-9074-debb2b58a659 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] Lazy-loading 'flavor' on Instance uuid 94e2b266-2fe3-481a-bb1e-24f835a79ddf {{(pid=75229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 09:51:37 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-20b432de-c921-43a3-9074-debb2b58a659 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] Lock "94e2b266-2fe3-481a-bb1e-24f835a79ddf" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.048s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:51:38 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-20b432de-c921-43a3-9074-debb2b58a659 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] Acquiring lock "94e2b266-2fe3-481a-bb1e-24f835a79ddf" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:51:38 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-20b432de-c921-43a3-9074-debb2b58a659 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] Lock "94e2b266-2fe3-481a-bb1e-24f835a79ddf" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:51:38 user nova-compute[75229]: INFO nova.compute.manager [None req-20b432de-c921-43a3-9074-debb2b58a659 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] [instance: 94e2b266-2fe3-481a-bb1e-24f835a79ddf] Attaching volume b590f04d-8a50-4810-8e66-05d846f4613f to /dev/vdb
Nov 14 09:51:38 user nova-compute[75229]: DEBUG os_brick.utils [None req-20b432de-c921-43a3-9074-debb2b58a659 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 09:51:38 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:51:38 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:51:38 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[88937966-23d5-465e-90a5-c85cea107c8a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f1154031c835\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:51:38 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:51:38 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:51:38 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9028daf-ac1d-44f5-a708-02b6cb7f595f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:51:38 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:51:38 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:51:38 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[983a399f-69da-4871-963a-453d8b8cc82e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:51:38 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dd189ae-22b8-4dae-96f8-57db6f362799]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:51:38 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-20b432de-c921-43a3-9074-debb2b58a659 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] Running cmd (subprocess): nvme version {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:51:38 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-20b432de-c921-43a3-9074-debb2b58a659 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] 'nvme version' failed. Not Retrying. {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 09:51:38 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.nvmeof [None req-20b432de-c921-43a3-9074-debb2b58a659 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] nvme not present on system {{(pid=75229) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 09:51:38 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:51:38 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 09:51:38 user nova-compute[75229]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 09:51:38 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[07f92c2d-e586-4d94-9131-967619260b5e]: (4, '') {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:51:38 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.lightos [None req-20b432de-c921-43a3-9074-debb2b58a659 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75229) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 09:51:38 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.lightos [None req-20b432de-c921-43a3-9074-debb2b58a659 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75229) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 09:51:38 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.lightos [None req-20b432de-c921-43a3-9074-debb2b58a659 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] LIGHTOS: no hostnqn found. {{(pid=75229) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 09:51:38 user nova-compute[75229]: DEBUG os_brick.utils [None req-20b432de-c921-43a3-9074-debb2b58a659 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f1154031c835', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 09:51:38 user nova-compute[75229]: DEBUG nova.virt.block_device [None req-20b432de-c921-43a3-9074-debb2b58a659 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] [instance: 94e2b266-2fe3-481a-bb1e-24f835a79ddf] Updating existing volume attachment record: 3f95fb35-ed02-4f3b-90d1-bfb04277c97c {{(pid=75229) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 09:51:38 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:51:41 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:51:42 user nova-compute[75229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-20b432de-c921-43a3-9074-debb2b58a659 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] [instance: 94e2b266-2fe3-481a-bb1e-24f835a79ddf] Calling os-brick to attach iSCSI Volume {{(pid=75229) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 09:51:42 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-20b432de-c921-43a3-9074-debb2b58a659 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f73f85151b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b590f04d-8a50-4810-8e66-05d846f4613f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PBamvgOl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 09:51:42 user nova-compute[75229]: WARNING os_brick.initiator.connectors.base [None req-20b432de-c921-43a3-9074-debb2b58a659 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 09:51:42 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-20b432de-c921-43a3-9074-debb2b58a659 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 09:51:42 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-20b432de-c921-43a3-9074-debb2b58a659 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 09:51:42 user nova-compute[75229]: WARNING os_brick.initiator.connectors.base [None req-20b432de-c921-43a3-9074-debb2b58a659 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 09:51:42 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-20b432de-c921-43a3-9074-debb2b58a659 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b590f04d-8a50-4810-8e66-05d846f4613f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 09:51:42 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-20b432de-c921-43a3-9074-debb2b58a659 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b590f04d-8a50-4810-8e66-05d846f4613f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 09:51:42 user nova-compute[75229]: INFO os_brick.initiator.connectors.iscsi [None req-20b432de-c921-43a3-9074-debb2b58a659 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 09:51:42 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b590f04d-8a50-4810-8e66-05d846f4613f -p 172.16.0.220:3260 {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:51:42 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b590f04d-8a50-4810-8e66-05d846f4613f -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:51:42 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[09b11183-152e-47b2-9c2d-99906d7335ca]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:51:42 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-20b432de-c921-43a3-9074-debb2b58a659 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 09:51:42 user nova-compute[75229]:  {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:51:42 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b590f04d-8a50-4810-8e66-05d846f4613f -p 172.16.0.220:3260 --interface default --op new {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:51:42 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b590f04d-8a50-4810-8e66-05d846f4613f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:51:42 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[889edcd4-fd06-43ed-a57a-6f71cf9f5e35]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b590f04d-8a50-4810-8e66-05d846f4613f] added\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:51:42 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-20b432de-c921-43a3-9074-debb2b58a659 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b590f04d-8a50-4810-8e66-05d846f4613f] added
Nov 14 09:51:42 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:51:42 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b590f04d-8a50-4810-8e66-05d846f4613f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:51:42 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b590f04d-8a50-4810-8e66-05d846f4613f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:51:42 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[66b1ed18-aecc-4a86-a232-a2d312469a6a]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:51:42 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-20b432de-c921-43a3-9074-debb2b58a659 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:51:42 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b590f04d-8a50-4810-8e66-05d846f4613f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:51:42 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b590f04d-8a50-4810-8e66-05d846f4613f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:51:42 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[a23aee48-a770-404b-94e6-96efe682b5f7]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:51:42 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-20b432de-c921-43a3-9074-debb2b58a659 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:51:42 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b590f04d-8a50-4810-8e66-05d846f4613f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PBamvgOl {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:51:42 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b590f04d-8a50-4810-8e66-05d846f4613f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PBamvgOl" returned: 0 in 0.019s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:51:42 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4e4cb67-2659-463e-a957-9b027f164e7e]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:51:42 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-20b432de-c921-43a3-9074-debb2b58a659 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PBamvgOl'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:51:42 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b590f04d-8a50-4810-8e66-05d846f4613f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:51:42 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b590f04d-8a50-4810-8e66-05d846f4613f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:51:42 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdc34f89-0da3-4843-a03b-94db3b6a6922]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:51:42 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-20b432de-c921-43a3-9074-debb2b58a659 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:51:42 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:51:42 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:51:42 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d1e0ac6-39da-4b60-b38b-b4b12662e965]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7902ab8-168d-4c8a-90e9-bf44d669ce2b (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aca09258-022b-4f04-b418-f2a170332755 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bae4836-52c2-428b-b299-a6a72899197d (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00fbc288-68ce-437c-b00d-3f9c5af4c820 (non-flash)\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:51:42 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-20b432de-c921-43a3-9074-debb2b58a659 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7902ab8-168d-4c8a-90e9-bf44d669ce2b (non-flash)
Nov 14 09:51:42 user nova-compute[75229]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aca09258-022b-4f04-b418-f2a170332755 (non-flash)
Nov 14 09:51:42 user nova-compute[75229]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bae4836-52c2-428b-b299-a6a72899197d (non-flash)
Nov 14 09:51:42 user nova-compute[75229]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00fbc288-68ce-437c-b00d-3f9c5af4c820 (non-flash)
Nov 14 09:51:42 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 09:51:42 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-20b432de-c921-43a3-9074-debb2b58a659 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7902ab8-168d-4c8a-90e9-bf44d669ce2b (non-flash)
Nov 14 09:51:42 user nova-compute[75229]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aca09258-022b-4f04-b418-f2a170332755 (non-flash)
Nov 14 09:51:42 user nova-compute[75229]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bae4836-52c2-428b-b299-a6a72899197d (non-flash)
Nov 14 09:51:42 user nova-compute[75229]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00fbc288-68ce-437c-b00d-3f9c5af4c820 (non-flash)
Nov 14 09:51:42 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 09:51:42 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b590f04d-8a50-4810-8e66-05d846f4613f -p 172.16.0.220:3260 --login {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:51:42 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b590f04d-8a50-4810-8e66-05d846f4613f -p 172.16.0.220:3260 --login" returned: 0 in 0.077s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:51:42 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f2566bd-a204-4790-9b94-b03500e91555]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b590f04d-8a50-4810-8e66-05d846f4613f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b590f04d-8a50-4810-8e66-05d846f4613f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:51:42 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-20b432de-c921-43a3-9074-debb2b58a659 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b590f04d-8a50-4810-8e66-05d846f4613f, portal: 172.16.0.220,3260]
Nov 14 09:51:42 user nova-compute[75229]: Login to [iface: default, target: iqn.2010-10.org.openstack:b590f04d-8a50-4810-8e66-05d846f4613f, portal: 172.16.0.220,3260] successful.
Nov 14 09:51:42 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:51:42 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b590f04d-8a50-4810-8e66-05d846f4613f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:51:42 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b590f04d-8a50-4810-8e66-05d846f4613f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:51:42 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd4e315c-d21b-47eb-8e04-c65f46c25f40]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:51:42 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-20b432de-c921-43a3-9074-debb2b58a659 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:51:42 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:51:42 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:51:42 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[987661ce-7aae-46ba-b9a2-82619cb061dc]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7902ab8-168d-4c8a-90e9-bf44d669ce2b (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aca09258-022b-4f04-b418-f2a170332755 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bae4836-52c2-428b-b299-a6a72899197d (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00fbc288-68ce-437c-b00d-3f9c5af4c820 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b590f04d-8a50-4810-8e66-05d846f4613f (non-flash)\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:51:42 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-20b432de-c921-43a3-9074-debb2b58a659 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7902ab8-168d-4c8a-90e9-bf44d669ce2b (non-flash)
Nov 14 09:51:42 user nova-compute[75229]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aca09258-022b-4f04-b418-f2a170332755 (non-flash)
Nov 14 09:51:42 user nova-compute[75229]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bae4836-52c2-428b-b299-a6a72899197d (non-flash)
Nov 14 09:51:42 user nova-compute[75229]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00fbc288-68ce-437c-b00d-3f9c5af4c820 (non-flash)
Nov 14 09:51:42 user nova-compute[75229]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b590f04d-8a50-4810-8e66-05d846f4613f (non-flash)
Nov 14 09:51:42 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 09:51:42 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-20b432de-c921-43a3-9074-debb2b58a659 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7902ab8-168d-4c8a-90e9-bf44d669ce2b (non-flash)
Nov 14 09:51:42 user nova-compute[75229]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aca09258-022b-4f04-b418-f2a170332755 (non-flash)
Nov 14 09:51:42 user nova-compute[75229]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bae4836-52c2-428b-b299-a6a72899197d (non-flash)
Nov 14 09:51:42 user nova-compute[75229]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00fbc288-68ce-437c-b00d-3f9c5af4c820 (non-flash)
Nov 14 09:51:42 user nova-compute[75229]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b590f04d-8a50-4810-8e66-05d846f4613f (non-flash)
Nov 14 09:51:42 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 09:51:42 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-20b432de-c921-43a3-9074-debb2b58a659 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b590f04d-8a50-4810-8e66-05d846f4613f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.313s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 09:51:42 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-20b432de-c921-43a3-9074-debb2b58a659 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] Connected to 172.16.0.220:3260 {{(pid=75229) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 09:51:42 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-20b432de-c921-43a3-9074-debb2b58a659 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] HCTL ('36', '-', '-', 0) found on session 26 with lun 0 {{(pid=75229) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 09:51:42 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-20b432de-c921-43a3-9074-debb2b58a659 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75229) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 09:51:42 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:51:42 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.016s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:51:42 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[17c09bc1-ae65-42b2-ad96-e678a1ceaa5d]: (4, ('- - 0', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:51:42 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-20b432de-c921-43a3-9074-debb2b58a659 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] Searching for a device in session 26 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75229) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 09:51:42 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-20b432de-c921-43a3-9074-debb2b58a659 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:b590f04d-8a50-4810-8e66-05d846f4613f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PBamvgOl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75229) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 09:51:43 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:51:43 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-20b432de-c921-43a3-9074-debb2b58a659 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.347s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 09:51:43 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-20b432de-c921-43a3-9074-debb2b58a659 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] <== connect_volume: return (1349ms) {'type': 'block', 'scsi_wwn': '23937313838326635', 'path': '/dev/sde'} {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 09:51:43 user nova-compute[75229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-20b432de-c921-43a3-9074-debb2b58a659 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] [instance: 94e2b266-2fe3-481a-bb1e-24f835a79ddf] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23937313838326635', 'path': '/dev/sde'} {{(pid=75229) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 09:51:43 user nova-compute[75229]: DEBUG nova.objects.instance [None req-20b432de-c921-43a3-9074-debb2b58a659 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] Lazy-loading 'flavor' on Instance uuid 94e2b266-2fe3-481a-bb1e-24f835a79ddf {{(pid=75229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 09:51:43 user nova-compute[75229]: DEBUG nova.virt.libvirt.guest [None req-20b432de-c921-43a3-9074-debb2b58a659 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 09:51:43 user nova-compute[75229]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 09:51:43 user nova-compute[75229]:   <source dev="/dev/sde"/>
Nov 14 09:51:43 user nova-compute[75229]:   <target dev="vdb" bus="virtio"/>
Nov 14 09:51:43 user nova-compute[75229]:   <serial>b590f04d-8a50-4810-8e66-05d846f4613f</serial>
Nov 14 09:51:43 user nova-compute[75229]: </disk>
Nov 14 09:51:43 user nova-compute[75229]:  {{(pid=75229) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 09:51:44 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-20b432de-c921-43a3-9074-debb2b58a659 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] No BDM found with device name vda, not building metadata. {{(pid=75229) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 09:51:44 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-20b432de-c921-43a3-9074-debb2b58a659 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75229) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 09:51:44 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-20b432de-c921-43a3-9074-debb2b58a659 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] No VIF found with MAC fa:16:3e:dc:24:42, not building metadata {{(pid=75229) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 09:51:44 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-20b432de-c921-43a3-9074-debb2b58a659 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] Lock "94e2b266-2fe3-481a-bb1e-24f835a79ddf" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.299s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:51:46 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 09:51:46 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:51:47 user nova-compute[75229]: DEBUG nova.compute.manager [req-c4a2e879-ea40-481c-8fc8-8abd9d5e79e0 req-a7b7d880-50ec-429a-ae92-6f12b98fb0bf service nova] [instance: 94e2b266-2fe3-481a-bb1e-24f835a79ddf] Received event network-changed-be0352bd-a149-4097-b049-8445f895d993 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:51:47 user nova-compute[75229]: DEBUG nova.compute.manager [req-c4a2e879-ea40-481c-8fc8-8abd9d5e79e0 req-a7b7d880-50ec-429a-ae92-6f12b98fb0bf service nova] [instance: 94e2b266-2fe3-481a-bb1e-24f835a79ddf] Refreshing instance network info cache due to event network-changed-be0352bd-a149-4097-b049-8445f895d993. {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 09:51:47 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-c4a2e879-ea40-481c-8fc8-8abd9d5e79e0 req-a7b7d880-50ec-429a-ae92-6f12b98fb0bf service nova] Acquiring lock "refresh_cache-94e2b266-2fe3-481a-bb1e-24f835a79ddf" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 09:51:47 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-c4a2e879-ea40-481c-8fc8-8abd9d5e79e0 req-a7b7d880-50ec-429a-ae92-6f12b98fb0bf service nova] Acquired lock "refresh_cache-94e2b266-2fe3-481a-bb1e-24f835a79ddf" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 09:51:47 user nova-compute[75229]: DEBUG nova.network.neutron [req-c4a2e879-ea40-481c-8fc8-8abd9d5e79e0 req-a7b7d880-50ec-429a-ae92-6f12b98fb0bf service nova] [instance: 94e2b266-2fe3-481a-bb1e-24f835a79ddf] Refreshing network info cache for port be0352bd-a149-4097-b049-8445f895d993 {{(pid=75229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 09:51:47 user nova-compute[75229]: DEBUG nova.network.neutron [req-c4a2e879-ea40-481c-8fc8-8abd9d5e79e0 req-a7b7d880-50ec-429a-ae92-6f12b98fb0bf service nova] [instance: 94e2b266-2fe3-481a-bb1e-24f835a79ddf] Updated VIF entry in instance network info cache for port be0352bd-a149-4097-b049-8445f895d993. {{(pid=75229) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 09:51:47 user nova-compute[75229]: DEBUG nova.network.neutron [req-c4a2e879-ea40-481c-8fc8-8abd9d5e79e0 req-a7b7d880-50ec-429a-ae92-6f12b98fb0bf service nova] [instance: 94e2b266-2fe3-481a-bb1e-24f835a79ddf] Updating instance_info_cache with network_info: [{"id": "be0352bd-a149-4097-b049-8445f895d993", "address": "fa:16:3e:dc:24:42", "network": {"id": "1687d918-9f70-4099-b44c-97f92f90e6ff", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2074208460-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a6157b9827b44d2bab197220b635fd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe0352bd-a1", "ovs_interfaceid": "be0352bd-a149-4097-b049-8445f895d993", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 09:51:47 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-c4a2e879-ea40-481c-8fc8-8abd9d5e79e0 req-a7b7d880-50ec-429a-ae92-6f12b98fb0bf service nova] Releasing lock "refresh_cache-94e2b266-2fe3-481a-bb1e-24f835a79ddf" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 09:51:48 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:51:49 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 09:51:49 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:51:49 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:51:49 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:51:49 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Auditing locally available compute resources for user (node: user) {{(pid=75229) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 09:51:49 user nova-compute[75229]: DEBUG nova.compute.manager [req-db2f241a-7b78-4ee1-8779-81a6898f8ee3 req-2c1fb047-c83c-4430-bd14-e4d812d48206 service nova] [instance: 94e2b266-2fe3-481a-bb1e-24f835a79ddf] Received event network-changed-be0352bd-a149-4097-b049-8445f895d993 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:51:49 user nova-compute[75229]: DEBUG nova.compute.manager [req-db2f241a-7b78-4ee1-8779-81a6898f8ee3 req-2c1fb047-c83c-4430-bd14-e4d812d48206 service nova] [instance: 94e2b266-2fe3-481a-bb1e-24f835a79ddf] Refreshing instance network info cache due to event network-changed-be0352bd-a149-4097-b049-8445f895d993. {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 09:51:49 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-db2f241a-7b78-4ee1-8779-81a6898f8ee3 req-2c1fb047-c83c-4430-bd14-e4d812d48206 service nova] Acquiring lock "refresh_cache-94e2b266-2fe3-481a-bb1e-24f835a79ddf" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 09:51:49 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-db2f241a-7b78-4ee1-8779-81a6898f8ee3 req-2c1fb047-c83c-4430-bd14-e4d812d48206 service nova] Acquired lock "refresh_cache-94e2b266-2fe3-481a-bb1e-24f835a79ddf" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 09:51:49 user nova-compute[75229]: DEBUG nova.network.neutron [req-db2f241a-7b78-4ee1-8779-81a6898f8ee3 req-2c1fb047-c83c-4430-bd14-e4d812d48206 service nova] [instance: 94e2b266-2fe3-481a-bb1e-24f835a79ddf] Refreshing network info cache for port be0352bd-a149-4097-b049-8445f895d993 {{(pid=75229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 09:51:49 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5abd12fe-e6fc-4cb1-9674-da08e13886be/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:51:50 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5abd12fe-e6fc-4cb1-9674-da08e13886be/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:51:50 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5abd12fe-e6fc-4cb1-9674-da08e13886be/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:51:50 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5abd12fe-e6fc-4cb1-9674-da08e13886be/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:51:50 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d73f431b-d002-4206-8b52-7d313a43dccb/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:51:50 user nova-compute[75229]: DEBUG nova.network.neutron [req-db2f241a-7b78-4ee1-8779-81a6898f8ee3 req-2c1fb047-c83c-4430-bd14-e4d812d48206 service nova] [instance: 94e2b266-2fe3-481a-bb1e-24f835a79ddf] Updated VIF entry in instance network info cache for port be0352bd-a149-4097-b049-8445f895d993. {{(pid=75229) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 09:51:50 user nova-compute[75229]: DEBUG nova.network.neutron [req-db2f241a-7b78-4ee1-8779-81a6898f8ee3 req-2c1fb047-c83c-4430-bd14-e4d812d48206 service nova] [instance: 94e2b266-2fe3-481a-bb1e-24f835a79ddf] Updating instance_info_cache with network_info: [{"id": "be0352bd-a149-4097-b049-8445f895d993", "address": "fa:16:3e:dc:24:42", "network": {"id": "1687d918-9f70-4099-b44c-97f92f90e6ff", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2074208460-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a6157b9827b44d2bab197220b635fd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe0352bd-a1", "ovs_interfaceid": "be0352bd-a149-4097-b049-8445f895d993", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 09:51:50 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-db2f241a-7b78-4ee1-8779-81a6898f8ee3 req-2c1fb047-c83c-4430-bd14-e4d812d48206 service nova] Releasing lock "refresh_cache-94e2b266-2fe3-481a-bb1e-24f835a79ddf" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 09:51:50 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d73f431b-d002-4206-8b52-7d313a43dccb/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:51:50 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d73f431b-d002-4206-8b52-7d313a43dccb/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:51:50 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d73f431b-d002-4206-8b52-7d313a43dccb/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:51:50 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7750cbc-b3d0-44aa-8b88-c291ba007a8a/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:51:50 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7750cbc-b3d0-44aa-8b88-c291ba007a8a/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:51:50 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7750cbc-b3d0-44aa-8b88-c291ba007a8a/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:51:51 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7750cbc-b3d0-44aa-8b88-c291ba007a8a/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:51:51 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a60d339f-e134-477c-8505-bf8c79d2a21c/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:51:51 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a60d339f-e134-477c-8505-bf8c79d2a21c/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:51:51 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a60d339f-e134-477c-8505-bf8c79d2a21c/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:51:51 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a60d339f-e134-477c-8505-bf8c79d2a21c/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:51:51 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75229) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 09:51:51 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be813b28-133f-416a-b2b5-dc0b9e4064b7/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:51:51 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be813b28-133f-416a-b2b5-dc0b9e4064b7/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:51:51 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be813b28-133f-416a-b2b5-dc0b9e4064b7/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:51:51 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:51:51 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be813b28-133f-416a-b2b5-dc0b9e4064b7/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:51:51 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75229) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 09:51:51 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/673624b6-e830-45e0-9215-ba79fd4f881e/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:51:52 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/673624b6-e830-45e0-9215-ba79fd4f881e/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:51:52 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/673624b6-e830-45e0-9215-ba79fd4f881e/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:51:52 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-abfa7012-edb3-4c18-94f3-67c3a5a03e82 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] Acquiring lock "94e2b266-2fe3-481a-bb1e-24f835a79ddf" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:51:52 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-abfa7012-edb3-4c18-94f3-67c3a5a03e82 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] Lock "94e2b266-2fe3-481a-bb1e-24f835a79ddf" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.002s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:51:52 user nova-compute[75229]: INFO nova.compute.manager [None req-abfa7012-edb3-4c18-94f3-67c3a5a03e82 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] [instance: 94e2b266-2fe3-481a-bb1e-24f835a79ddf] Rebooting instance
Nov 14 09:51:52 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-abfa7012-edb3-4c18-94f3-67c3a5a03e82 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] Acquiring lock "refresh_cache-94e2b266-2fe3-481a-bb1e-24f835a79ddf" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 09:51:52 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-abfa7012-edb3-4c18-94f3-67c3a5a03e82 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] Acquired lock "refresh_cache-94e2b266-2fe3-481a-bb1e-24f835a79ddf" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 09:51:52 user nova-compute[75229]: DEBUG nova.network.neutron [None req-abfa7012-edb3-4c18-94f3-67c3a5a03e82 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] [instance: 94e2b266-2fe3-481a-bb1e-24f835a79ddf] Building network info cache for instance {{(pid=75229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 09:51:52 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/673624b6-e830-45e0-9215-ba79fd4f881e/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:51:52 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e58500df-059a-4fce-afb7-ba36feca0697/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:51:52 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e58500df-059a-4fce-afb7-ba36feca0697/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:51:52 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e58500df-059a-4fce-afb7-ba36feca0697/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:51:52 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e58500df-059a-4fce-afb7-ba36feca0697/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:51:52 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c9fe69e-3f9d-4b30-a9e4-efc3e83efa17/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:51:52 user nova-compute[75229]: DEBUG nova.network.neutron [None req-abfa7012-edb3-4c18-94f3-67c3a5a03e82 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] [instance: 94e2b266-2fe3-481a-bb1e-24f835a79ddf] Updating instance_info_cache with network_info: [{"id": "be0352bd-a149-4097-b049-8445f895d993", "address": "fa:16:3e:dc:24:42", "network": {"id": "1687d918-9f70-4099-b44c-97f92f90e6ff", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2074208460-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a6157b9827b44d2bab197220b635fd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe0352bd-a1", "ovs_interfaceid": "be0352bd-a149-4097-b049-8445f895d993", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 09:51:52 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-abfa7012-edb3-4c18-94f3-67c3a5a03e82 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] Releasing lock "refresh_cache-94e2b266-2fe3-481a-bb1e-24f835a79ddf" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 09:51:52 user nova-compute[75229]: DEBUG nova.compute.manager [None req-abfa7012-edb3-4c18-94f3-67c3a5a03e82 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] [instance: 94e2b266-2fe3-481a-bb1e-24f835a79ddf] Checking state {{(pid=75229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 09:51:52 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c9fe69e-3f9d-4b30-a9e4-efc3e83efa17/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:51:52 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c9fe69e-3f9d-4b30-a9e4-efc3e83efa17/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:51:52 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:51:52 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:51:52 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:51:52 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c9fe69e-3f9d-4b30-a9e4-efc3e83efa17/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:51:52 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4ce290f-6dd2-44b6-91be-8e775045837e/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:51:53 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:51:53 user nova-compute[75229]: DEBUG nova.compute.manager [req-d92614d6-571b-4912-8511-3a3d9ad97e26 req-67805076-1e22-406b-b494-347edf9f73c5 service nova] [instance: 94e2b266-2fe3-481a-bb1e-24f835a79ddf] Received event network-vif-unplugged-be0352bd-a149-4097-b049-8445f895d993 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:51:53 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-d92614d6-571b-4912-8511-3a3d9ad97e26 req-67805076-1e22-406b-b494-347edf9f73c5 service nova] Acquiring lock "94e2b266-2fe3-481a-bb1e-24f835a79ddf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:51:53 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-d92614d6-571b-4912-8511-3a3d9ad97e26 req-67805076-1e22-406b-b494-347edf9f73c5 service nova] Lock "94e2b266-2fe3-481a-bb1e-24f835a79ddf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:51:53 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-d92614d6-571b-4912-8511-3a3d9ad97e26 req-67805076-1e22-406b-b494-347edf9f73c5 service nova] Lock "94e2b266-2fe3-481a-bb1e-24f835a79ddf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:51:53 user nova-compute[75229]: DEBUG nova.compute.manager [req-d92614d6-571b-4912-8511-3a3d9ad97e26 req-67805076-1e22-406b-b494-347edf9f73c5 service nova] [instance: 94e2b266-2fe3-481a-bb1e-24f835a79ddf] No waiting events found dispatching network-vif-unplugged-be0352bd-a149-4097-b049-8445f895d993 {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 09:51:53 user nova-compute[75229]: WARNING nova.compute.manager [req-d92614d6-571b-4912-8511-3a3d9ad97e26 req-67805076-1e22-406b-b494-347edf9f73c5 service nova] [instance: 94e2b266-2fe3-481a-bb1e-24f835a79ddf] Received unexpected event network-vif-unplugged-be0352bd-a149-4097-b049-8445f895d993 for instance with vm_state active and task_state reboot_started_hard.
Nov 14 09:51:53 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4ce290f-6dd2-44b6-91be-8e775045837e/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:51:53 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4ce290f-6dd2-44b6-91be-8e775045837e/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:51:53 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:51:53 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4ce290f-6dd2-44b6-91be-8e775045837e/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:51:53 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94e2b266-2fe3-481a-bb1e-24f835a79ddf/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:51:53 user nova-compute[75229]: INFO nova.virt.libvirt.driver [-] [instance: 94e2b266-2fe3-481a-bb1e-24f835a79ddf] Instance destroyed successfully.
Nov 14 09:51:53 user nova-compute[75229]: DEBUG nova.objects.instance [None req-abfa7012-edb3-4c18-94f3-67c3a5a03e82 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] Lazy-loading 'resources' on Instance uuid 94e2b266-2fe3-481a-bb1e-24f835a79ddf {{(pid=75229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 09:51:53 user nova-compute[75229]: DEBUG nova.virt.libvirt.vif [None req-abfa7012-edb3-4c18-94f3-67c3a5a03e82 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T09:49:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1624451670',display_name='tempest-TestMinimumBasicScenario-server-1624451670',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1624451670',id=21,image_ref='efab0bf3-e7ec-4953-8a54-2c5bb0a3baf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHLGyqy66WiitWeWLqujQDO7dBN6UvLDY3R5qVL6duh6Uqwoj1b+NfY0QC2GN9l+L9VeminYuv9MwxoPfEZ4V+l+UlMp+6JyFrnRt14AE/ia/51KfvySly2NYmpfm1yFaw==',key_name='tempest-TestMinimumBasicScenario-185710581',keypairs=<?>,launch_index=0,launched_at=2023-11-14T09:49:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4a6157b9827b44d2bab197220b635fd3',ramdisk_id='',reservation_id='r-0ro875yg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='efab0bf3-e7ec-4953-8a54-2c5bb0a3baf6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-284611138',owner_user_name='tempest-TestMinimumBasicScenario-284611138-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T09:51:53Z,user_data=None,user_id='3603da40a87149478458797ea9aedfe2',uuid=94e2b266-2fe3-481a-bb1e-24f835a79ddf,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "be0352bd-a149-4097-b049-8445f895d993", "address": "fa:16:3e:dc:24:42", "network": {"id": "1687d918-9f70-4099-b44c-97f92f90e6ff", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2074208460-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a6157b9827b44d2bab197220b635fd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe0352bd-a1", "ovs_interfaceid": "be0352bd-a149-4097-b049-8445f895d993", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 09:51:53 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-abfa7012-edb3-4c18-94f3-67c3a5a03e82 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] Converting VIF {"id": "be0352bd-a149-4097-b049-8445f895d993", "address": "fa:16:3e:dc:24:42", "network": {"id": "1687d918-9f70-4099-b44c-97f92f90e6ff", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2074208460-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a6157b9827b44d2bab197220b635fd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe0352bd-a1", "ovs_interfaceid": "be0352bd-a149-4097-b049-8445f895d993", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 09:51:53 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-abfa7012-edb3-4c18-94f3-67c3a5a03e82 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:dc:24:42,bridge_name='br-int',has_traffic_filtering=True,id=be0352bd-a149-4097-b049-8445f895d993,network=Network(1687d918-9f70-4099-b44c-97f92f90e6ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe0352bd-a1') {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 09:51:53 user nova-compute[75229]: DEBUG os_vif [None req-abfa7012-edb3-4c18-94f3-67c3a5a03e82 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:dc:24:42,bridge_name='br-int',has_traffic_filtering=True,id=be0352bd-a149-4097-b049-8445f895d993,network=Network(1687d918-9f70-4099-b44c-97f92f90e6ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe0352bd-a1') {{(pid=75229) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 09:51:53 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:51:53 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbe0352bd-a1, bridge=br-int, if_exists=True) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:51:53 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:51:53 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 09:51:53 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:51:53 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3185c932-fa0c-4b31-921a-4a8f9c443129) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:51:53 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:51:53 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:51:53 user nova-compute[75229]: INFO os_vif [None req-abfa7012-edb3-4c18-94f3-67c3a5a03e82 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:dc:24:42,bridge_name='br-int',has_traffic_filtering=True,id=be0352bd-a149-4097-b049-8445f895d993,network=Network(1687d918-9f70-4099-b44c-97f92f90e6ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe0352bd-a1')
Nov 14 09:51:53 user nova-compute[75229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-abfa7012-edb3-4c18-94f3-67c3a5a03e82 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] [instance: 94e2b266-2fe3-481a-bb1e-24f835a79ddf] calling os-brick to detach iSCSI Volume {{(pid=75229) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 09:51:53 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-abfa7012-edb3-4c18-94f3-67c3a5a03e82 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f73f85151b0>, {'target_iqn': 'iqn.2010-10.org.openstack:b590f04d-8a50-4810-8e66-05d846f4613f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PBamvgOl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 09:51:53 user nova-compute[75229]: WARNING os_brick.initiator.connectors.base [None req-abfa7012-edb3-4c18-94f3-67c3a5a03e82 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 09:51:53 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-abfa7012-edb3-4c18-94f3-67c3a5a03e82 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 09:51:53 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-abfa7012-edb3-4c18-94f3-67c3a5a03e82 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 09:51:53 user nova-compute[75229]: WARNING nova.virt.libvirt.driver [None req-6ab746fb-a1a0-49bd-9fa1-26890fd0086d tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance a4ce290f-6dd2-44b6-91be-8e775045837e is timed out.
Nov 14 09:51:53 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:51:53 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-6ab746fb-a1a0-49bd-9fa1-26890fd0086d tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] Successfully detached device vdb from instance a4ce290f-6dd2-44b6-91be-8e775045837e from the live domain config.
Nov 14 09:51:53 user nova-compute[75229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6ab746fb-a1a0-49bd-9fa1-26890fd0086d tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] [instance: a4ce290f-6dd2-44b6-91be-8e775045837e] calling os-brick to detach iSCSI Volume {{(pid=75229) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 09:51:53 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ab746fb-a1a0-49bd-9fa1-26890fd0086d tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f73f85151b0>, {'target_iqn': 'iqn.2010-10.org.openstack:00fbc288-68ce-437c-b00d-3f9c5af4c820', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cuMBzAXO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 09:51:53 user nova-compute[75229]: WARNING os_brick.initiator.connectors.base [None req-6ab746fb-a1a0-49bd-9fa1-26890fd0086d tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 09:51:53 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-6ab746fb-a1a0-49bd-9fa1-26890fd0086d tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 09:51:53 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:51:53 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[027768f7-cc21-4257-90b4-3203c42080b3]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:00fbc288-68ce-437c-b00d-3f9c5af4c820\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2bae4836-52c2-428b-b299-a6a72899197d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:aca09258-022b-4f04-b418-f2a170332755\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a7902ab8-168d-4c8a-90e9-bf44d669ce2b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b590f04d-8a50-4810-8e66-05d846f4613f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:51:53 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-abfa7012-edb3-4c18-94f3-67c3a5a03e82 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 09:51:53 user nova-compute[75229]: No targets found.
Nov 14 09:51:53 user nova-compute[75229]: iSNS:
Nov 14 09:51:53 user nova-compute[75229]: No targets found.
Nov 14 09:51:53 user nova-compute[75229]: STATIC:
Nov 14 09:51:53 user nova-compute[75229]: Target: iqn.2010-10.org.openstack:00fbc288-68ce-437c-b00d-3f9c5af4c820
Nov 14 09:51:53 user nova-compute[75229]:         Portal: 172.16.0.220:3260,-1
Nov 14 09:51:53 user nova-compute[75229]:                 Iface Name: default
Nov 14 09:51:53 user nova-compute[75229]: Target: iqn.2010-10.org.openstack:2bae4836-52c2-428b-b299-a6a72899197d
Nov 14 09:51:53 user nova-compute[75229]:         Portal: 172.16.0.220:3260,-1
Nov 14 09:51:53 user nova-compute[75229]:                 Iface Name: default
Nov 14 09:51:53 user nova-compute[75229]: Target: iqn.2010-10.org.openstack:aca09258-022b-4f04-b418-f2a170332755
Nov 14 09:51:53 user nova-compute[75229]:         Portal: 172.16.0.220:3260,-1
Nov 14 09:51:53 user nova-compute[75229]:                 Iface Name: default
Nov 14 09:51:53 user nova-compute[75229]: Target: iqn.2010-10.org.openstack:a7902ab8-168d-4c8a-90e9-bf44d669ce2b
Nov 14 09:51:53 user nova-compute[75229]:         Portal: 172.16.0.220:3260,-1
Nov 14 09:51:53 user nova-compute[75229]:                 Iface Name: default
Nov 14 09:51:53 user nova-compute[75229]: Target: iqn.2010-10.org.openstack:b590f04d-8a50-4810-8e66-05d846f4613f
Nov 14 09:51:53 user nova-compute[75229]:         Portal: 172.16.0.220:3260,-1
Nov 14 09:51:53 user nova-compute[75229]:                 Iface Name: default
Nov 14 09:51:53 user nova-compute[75229]: FIRMWARE:
Nov 14 09:51:53 user nova-compute[75229]: No targets found.
Nov 14 09:51:53 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 09:51:53 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-abfa7012-edb3-4c18-94f3-67c3a5a03e82 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 09:51:53 user nova-compute[75229]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 09:51:53 user nova-compute[75229]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75229) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 09:51:53 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-abfa7012-edb3-4c18-94f3-67c3a5a03e82 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b590f04d-8a50-4810-8e66-05d846f4613f', 0)] {{(pid=75229) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 09:51:53 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:51:53 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:51:53 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fee4140-7d8b-45ae-99f1-6254b4cdeffd]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:00fbc288-68ce-437c-b00d-3f9c5af4c820\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2bae4836-52c2-428b-b299-a6a72899197d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a7902ab8-168d-4c8a-90e9-bf44d669ce2b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aca09258-022b-4f04-b418-f2a170332755\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b590f04d-8a50-4810-8e66-05d846f4613f\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:51:53 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:51:53 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:51:53 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[68bbc6c7-fa56-4556-ba1e-0e6f9eb75d95]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7902ab8-168d-4c8a-90e9-bf44d669ce2b (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aca09258-022b-4f04-b418-f2a170332755 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bae4836-52c2-428b-b299-a6a72899197d (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00fbc288-68ce-437c-b00d-3f9c5af4c820 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b590f04d-8a50-4810-8e66-05d846f4613f (non-flash)\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:51:53 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-abfa7012-edb3-4c18-94f3-67c3a5a03e82 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7902ab8-168d-4c8a-90e9-bf44d669ce2b (non-flash)
Nov 14 09:51:53 user nova-compute[75229]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aca09258-022b-4f04-b418-f2a170332755 (non-flash)
Nov 14 09:51:53 user nova-compute[75229]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bae4836-52c2-428b-b299-a6a72899197d (non-flash)
Nov 14 09:51:53 user nova-compute[75229]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00fbc288-68ce-437c-b00d-3f9c5af4c820 (non-flash)
Nov 14 09:51:53 user nova-compute[75229]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b590f04d-8a50-4810-8e66-05d846f4613f (non-flash)
Nov 14 09:51:53 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 09:51:53 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-abfa7012-edb3-4c18-94f3-67c3a5a03e82 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7902ab8-168d-4c8a-90e9-bf44d669ce2b (non-flash)
Nov 14 09:51:53 user nova-compute[75229]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aca09258-022b-4f04-b418-f2a170332755 (non-flash)
Nov 14 09:51:53 user nova-compute[75229]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bae4836-52c2-428b-b299-a6a72899197d (non-flash)
Nov 14 09:51:53 user nova-compute[75229]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00fbc288-68ce-437c-b00d-3f9c5af4c820 (non-flash)
Nov 14 09:51:53 user nova-compute[75229]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b590f04d-8a50-4810-8e66-05d846f4613f (non-flash)
Nov 14 09:51:53 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 09:51:53 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-abfa7012-edb3-4c18-94f3-67c3a5a03e82 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f73f8299ea0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b590f04d-8a50-4810-8e66-05d846f4613f'): ({'sde'}, set())}) {{(pid=75229) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 09:51:53 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-abfa7012-edb3-4c18-94f3-67c3a5a03e82 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] Removing single pathed devices sde {{(pid=75229) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 09:51:53 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94e2b266-2fe3-481a-bb1e-24f835a79ddf/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:51:53 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94e2b266-2fe3-481a-bb1e-24f835a79ddf/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:51:53 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:51:53 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:51:53 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae6709fa-fc78-4180-9855-9867bebc1a3c]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:51:53 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:51:53 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.021s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:51:53 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[95b07ebb-03ac-41a2-985b-a32210b79497]: (4, ('ok\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:51:53 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-abfa7012-edb3-4c18-94f3-67c3a5a03e82 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] Flushing IO for device /dev/sde {{(pid=75229) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 09:51:53 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:51:53 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:51:53 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[2eac42d5-b94b-4bd7-a6fa-6201a4e3a00e]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:51:53 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-abfa7012-edb3-4c18-94f3-67c3a5a03e82 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75229) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 09:51:53 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:51:53 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.046s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:51:53 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[4320d789-55f4-49c4-8177-a7d05c49a327]: (4, ('1', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:51:53 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-abfa7012-edb3-4c18-94f3-67c3a5a03e82 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75229) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 09:51:53 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-abfa7012-edb3-4c18-94f3-67c3a5a03e82 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] SCSI volumes sde have been removed. {{(pid=75229) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 09:51:53 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-abfa7012-edb3-4c18-94f3-67c3a5a03e82 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b590f04d-8a50-4810-8e66-05d846f4613f')] {{(pid=75229) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 09:51:53 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b590f04d-8a50-4810-8e66-05d846f4613f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:51:53 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b590f04d-8a50-4810-8e66-05d846f4613f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:51:53 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[f99b6b50-eb9b-4149-8204-3422e3f58d63]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:51:53 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-abfa7012-edb3-4c18-94f3-67c3a5a03e82 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:51:53 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b590f04d-8a50-4810-8e66-05d846f4613f -p 172.16.0.220:3260 --logout {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:51:53 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94e2b266-2fe3-481a-bb1e-24f835a79ddf/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:51:53 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75229) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 09:51:53 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4255af28-a111-4475-b207-67e335fd0835/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:51:53 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b590f04d-8a50-4810-8e66-05d846f4613f -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:51:53 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[01b5399e-9a6a-4593-99fe-5ddd30056c02]: (4, ('Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:b590f04d-8a50-4810-8e66-05d846f4613f, portal: 172.16.0.220,3260]\nLogout of [sid: 26, target: iqn.2010-10.org.openstack:b590f04d-8a50-4810-8e66-05d846f4613f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:51:53 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-abfa7012-edb3-4c18-94f3-67c3a5a03e82 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:b590f04d-8a50-4810-8e66-05d846f4613f, portal: 172.16.0.220,3260]
Nov 14 09:51:53 user nova-compute[75229]: Logout of [sid: 26, target: iqn.2010-10.org.openstack:b590f04d-8a50-4810-8e66-05d846f4613f, portal: 172.16.0.220,3260] successful.
Nov 14 09:51:53 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:51:54 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b590f04d-8a50-4810-8e66-05d846f4613f -p 172.16.0.220:3260 --op delete {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:51:54 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b590f04d-8a50-4810-8e66-05d846f4613f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:51:54 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[d11b075b-6586-46e6-a443-c89770cb6b66]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:51:54 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-abfa7012-edb3-4c18-94f3-67c3a5a03e82 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:51:54 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-abfa7012-edb3-4c18-94f3-67c3a5a03e82 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.334s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 09:51:54 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-abfa7012-edb3-4c18-94f3-67c3a5a03e82 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] <== disconnect_volume: return (335ms) None {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 09:51:54 user nova-compute[75229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-abfa7012-edb3-4c18-94f3-67c3a5a03e82 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] [instance: 94e2b266-2fe3-481a-bb1e-24f835a79ddf] Disconnected iSCSI Volume {{(pid=75229) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 09:51:54 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-6ab746fb-a1a0-49bd-9fa1-26890fd0086d tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.325s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 09:51:54 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:51:54 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-abfa7012-edb3-4c18-94f3-67c3a5a03e82 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] [instance: 94e2b266-2fe3-481a-bb1e-24f835a79ddf] Start _get_guest_xml network_info=[{"id": "be0352bd-a149-4097-b049-8445f895d993", "address": "fa:16:3e:dc:24:42", "network": {"id": "1687d918-9f70-4099-b44c-97f92f90e6ff", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2074208460-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a6157b9827b44d2bab197220b635fd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe0352bd-a1", "ovs_interfaceid": "be0352bd-a149-4097-b049-8445f895d993", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=efab0bf3-e7ec-4953-8a54-2c5bb0a3baf6,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'disk_bus': 'virtio', 'guest_format': None, 'encryption_secret_uuid': None, 'size': 0, 'device_type': 'disk', 'image_id': 'efab0bf3-e7ec-4953-8a54-2c5bb0a3baf6'}], 'ephemerals': [], 'block_device_mapping': [{'boot_index': None, 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:b590f04d-8a50-4810-8e66-05d846f4613f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PBamvgOl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, 'status': 'reserved', 'instance': '94e2b266-2fe3-481a-bb1e-24f835a79ddf', 'attached_at': '', 'detached_at': '', 'volume_id': 'b590f04d-8a50-4810-8e66-05d846f4613f', 'serial': 'b590f04d-8a50-4810-8e66-05d846f4613f'}, 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'attachment_id': '3f95fb35-ed02-4f3b-90d1-bfb04277c97c', 'guest_format': None, 'device_type': 'disk', 'volume_type': None} {{(pid=75229) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 09:51:54 user nova-compute[75229]: WARNING nova.virt.libvirt.driver [None req-abfa7012-edb3-4c18-94f3-67c3a5a03e82 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 09:51:54 user nova-compute[75229]: WARNING nova.virt.libvirt.driver [None req-abfa7012-edb3-4c18-94f3-67c3a5a03e82 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 09:51:54 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:51:54 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[322cad53-3d99-492d-aace-657f75be716d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:00fbc288-68ce-437c-b00d-3f9c5af4c820\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2bae4836-52c2-428b-b299-a6a72899197d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:aca09258-022b-4f04-b418-f2a170332755\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a7902ab8-168d-4c8a-90e9-bf44d669ce2b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:51:54 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ab746fb-a1a0-49bd-9fa1-26890fd0086d tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 09:51:54 user nova-compute[75229]: No targets found.
Nov 14 09:51:54 user nova-compute[75229]: iSNS:
Nov 14 09:51:54 user nova-compute[75229]: No targets found.
Nov 14 09:51:54 user nova-compute[75229]: STATIC:
Nov 14 09:51:54 user nova-compute[75229]: Target: iqn.2010-10.org.openstack:00fbc288-68ce-437c-b00d-3f9c5af4c820
Nov 14 09:51:54 user nova-compute[75229]:         Portal: 172.16.0.220:3260,-1
Nov 14 09:51:54 user nova-compute[75229]:                 Iface Name: default
Nov 14 09:51:54 user nova-compute[75229]: Target: iqn.2010-10.org.openstack:2bae4836-52c2-428b-b299-a6a72899197d
Nov 14 09:51:54 user nova-compute[75229]:         Portal: 172.16.0.220:3260,-1
Nov 14 09:51:54 user nova-compute[75229]:                 Iface Name: default
Nov 14 09:51:54 user nova-compute[75229]: Target: iqn.2010-10.org.openstack:aca09258-022b-4f04-b418-f2a170332755
Nov 14 09:51:54 user nova-compute[75229]:         Portal: 172.16.0.220:3260,-1
Nov 14 09:51:54 user nova-compute[75229]:                 Iface Name: default
Nov 14 09:51:54 user nova-compute[75229]: Target: iqn.2010-10.org.openstack:a7902ab8-168d-4c8a-90e9-bf44d669ce2b
Nov 14 09:51:54 user nova-compute[75229]:         Portal: 172.16.0.220:3260,-1
Nov 14 09:51:54 user nova-compute[75229]:                 Iface Name: default
Nov 14 09:51:54 user nova-compute[75229]: FIRMWARE:
Nov 14 09:51:54 user nova-compute[75229]: No targets found.
Nov 14 09:51:54 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 09:51:54 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ab746fb-a1a0-49bd-9fa1-26890fd0086d tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 09:51:54 user nova-compute[75229]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 09:51:54 user nova-compute[75229]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75229) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 09:51:54 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ab746fb-a1a0-49bd-9fa1-26890fd0086d tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:00fbc288-68ce-437c-b00d-3f9c5af4c820', 0)] {{(pid=75229) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 09:51:54 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-abfa7012-edb3-4c18-94f3-67c3a5a03e82 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75229) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 09:51:54 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-abfa7012-edb3-4c18-94f3-67c3a5a03e82 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] CPU controller missing on host. {{(pid=75229) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 09:51:54 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:51:54 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-abfa7012-edb3-4c18-94f3-67c3a5a03e82 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75229) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 09:51:54 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-abfa7012-edb3-4c18-94f3-67c3a5a03e82 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] CPU controller found on host. {{(pid=75229) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 09:51:54 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-abfa7012-edb3-4c18-94f3-67c3a5a03e82 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75229) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 09:51:54 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-abfa7012-edb3-4c18-94f3-67c3a5a03e82 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T09:39:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=efab0bf3-e7ec-4953-8a54-2c5bb0a3baf6,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 09:51:54 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-abfa7012-edb3-4c18-94f3-67c3a5a03e82 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] Flavor limits 0:0:0 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 09:51:54 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-abfa7012-edb3-4c18-94f3-67c3a5a03e82 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] Image limits 0:0:0 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 09:51:54 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-abfa7012-edb3-4c18-94f3-67c3a5a03e82 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] Flavor pref 0:0:0 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 09:51:54 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-abfa7012-edb3-4c18-94f3-67c3a5a03e82 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] Image pref 0:0:0 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 09:51:54 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-abfa7012-edb3-4c18-94f3-67c3a5a03e82 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 09:51:54 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-abfa7012-edb3-4c18-94f3-67c3a5a03e82 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 09:51:54 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-abfa7012-edb3-4c18-94f3-67c3a5a03e82 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75229) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 09:51:54 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-abfa7012-edb3-4c18-94f3-67c3a5a03e82 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] Got 1 possible topologies {{(pid=75229) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 09:51:54 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-abfa7012-edb3-4c18-94f3-67c3a5a03e82 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 09:51:54 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-abfa7012-edb3-4c18-94f3-67c3a5a03e82 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 09:51:54 user nova-compute[75229]: DEBUG nova.objects.instance [None req-abfa7012-edb3-4c18-94f3-67c3a5a03e82 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] Lazy-loading 'vcpu_model' on Instance uuid 94e2b266-2fe3-481a-bb1e-24f835a79ddf {{(pid=75229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 09:51:54 user nova-compute[75229]: DEBUG nova.objects.base [None req-abfa7012-edb3-4c18-94f3-67c3a5a03e82 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] Object Instance<94e2b266-2fe3-481a-bb1e-24f835a79ddf> lazy-loaded attributes: resources,vcpu_model {{(pid=75229) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 09:51:54 user nova-compute[75229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-abfa7012-edb3-4c18-94f3-67c3a5a03e82 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] [instance: 94e2b266-2fe3-481a-bb1e-24f835a79ddf] Calling os-brick to attach iSCSI Volume {{(pid=75229) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 09:51:54 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-abfa7012-edb3-4c18-94f3-67c3a5a03e82 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f73f85151b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b590f04d-8a50-4810-8e66-05d846f4613f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PBamvgOl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 09:51:54 user nova-compute[75229]: WARNING os_brick.initiator.connectors.base [None req-abfa7012-edb3-4c18-94f3-67c3a5a03e82 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 09:51:54 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-abfa7012-edb3-4c18-94f3-67c3a5a03e82 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 09:51:54 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:51:54 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[51875fcf-369a-4d98-839d-12ba8e5ea462]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:00fbc288-68ce-437c-b00d-3f9c5af4c820\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2bae4836-52c2-428b-b299-a6a72899197d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a7902ab8-168d-4c8a-90e9-bf44d669ce2b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aca09258-022b-4f04-b418-f2a170332755\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:51:54 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:51:54 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4255af28-a111-4475-b207-67e335fd0835/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:51:54 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4255af28-a111-4475-b207-67e335fd0835/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:51:54 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:51:54 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3ad4438-6d6d-4b94-96c7-76d37ba28aef]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7902ab8-168d-4c8a-90e9-bf44d669ce2b (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aca09258-022b-4f04-b418-f2a170332755 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bae4836-52c2-428b-b299-a6a72899197d (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00fbc288-68ce-437c-b00d-3f9c5af4c820 (non-flash)\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:51:54 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ab746fb-a1a0-49bd-9fa1-26890fd0086d tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7902ab8-168d-4c8a-90e9-bf44d669ce2b (non-flash)
Nov 14 09:51:54 user nova-compute[75229]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aca09258-022b-4f04-b418-f2a170332755 (non-flash)
Nov 14 09:51:54 user nova-compute[75229]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bae4836-52c2-428b-b299-a6a72899197d (non-flash)
Nov 14 09:51:54 user nova-compute[75229]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00fbc288-68ce-437c-b00d-3f9c5af4c820 (non-flash)
Nov 14 09:51:54 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 09:51:54 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ab746fb-a1a0-49bd-9fa1-26890fd0086d tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7902ab8-168d-4c8a-90e9-bf44d669ce2b (non-flash)
Nov 14 09:51:54 user nova-compute[75229]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aca09258-022b-4f04-b418-f2a170332755 (non-flash)
Nov 14 09:51:54 user nova-compute[75229]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bae4836-52c2-428b-b299-a6a72899197d (non-flash)
Nov 14 09:51:54 user nova-compute[75229]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00fbc288-68ce-437c-b00d-3f9c5af4c820 (non-flash)
Nov 14 09:51:54 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 09:51:54 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ab746fb-a1a0-49bd-9fa1-26890fd0086d tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f73d4f22440>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:00fbc288-68ce-437c-b00d-3f9c5af4c820'): ({'sdc'}, set())}) {{(pid=75229) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 09:51:54 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-6ab746fb-a1a0-49bd-9fa1-26890fd0086d tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] Removing single pathed devices sdc {{(pid=75229) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 09:51:54 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:51:54 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:51:54 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[75992ecf-d3a4-4e8d-97af-43c37e139793]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:51:54 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:51:54 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:51:54 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[80086d38-17be-4071-97a9-f97789e6bb78]: (4, ('ok\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:51:54 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-6ab746fb-a1a0-49bd-9fa1-26890fd0086d tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] Flushing IO for device /dev/sdc {{(pid=75229) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 09:51:54 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:51:54 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:51:54 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[87d2f823-9e09-4077-a8ad-e50b80f4f8bb]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:51:54 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-6ab746fb-a1a0-49bd-9fa1-26890fd0086d tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75229) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 09:51:54 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:51:54 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.044s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:51:54 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[48321dd8-3efe-4331-8923-ab9b770d2125]: (4, ('1', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:51:54 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-6ab746fb-a1a0-49bd-9fa1-26890fd0086d tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75229) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 09:51:54 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-6ab746fb-a1a0-49bd-9fa1-26890fd0086d tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] SCSI volumes sdc have been removed. {{(pid=75229) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 09:51:54 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ab746fb-a1a0-49bd-9fa1-26890fd0086d tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:00fbc288-68ce-437c-b00d-3f9c5af4c820')] {{(pid=75229) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 09:51:54 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00fbc288-68ce-437c-b00d-3f9c5af4c820 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:51:54 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4255af28-a111-4475-b207-67e335fd0835/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:51:54 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=75229) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 09:51:54 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00fbc288-68ce-437c-b00d-3f9c5af4c820 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:51:54 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5dd6542-6e71-473b-bc77-fb5a349ef724]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:51:54 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ab746fb-a1a0-49bd-9fa1-26890fd0086d tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:51:54 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00fbc288-68ce-437c-b00d-3f9c5af4c820 -p 172.16.0.220:3260 --logout {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:51:54 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcd2eae5-1085-491f-925a-247c462d786a/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:51:54 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00fbc288-68ce-437c-b00d-3f9c5af4c820 -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:51:54 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[d60fb4ac-585f-4171-93bf-035ccf7f1822]: (4, ('Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:00fbc288-68ce-437c-b00d-3f9c5af4c820, portal: 172.16.0.220,3260]\nLogout of [sid: 25, target: iqn.2010-10.org.openstack:00fbc288-68ce-437c-b00d-3f9c5af4c820, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:51:54 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ab746fb-a1a0-49bd-9fa1-26890fd0086d tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:00fbc288-68ce-437c-b00d-3f9c5af4c820, portal: 172.16.0.220,3260]
Nov 14 09:51:54 user nova-compute[75229]: Logout of [sid: 25, target: iqn.2010-10.org.openstack:00fbc288-68ce-437c-b00d-3f9c5af4c820, portal: 172.16.0.220,3260] successful.
Nov 14 09:51:54 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:51:54 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00fbc288-68ce-437c-b00d-3f9c5af4c820 -p 172.16.0.220:3260 --op delete {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:51:54 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00fbc288-68ce-437c-b00d-3f9c5af4c820 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:51:54 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a590a47-0788-4358-ad28-0a7813c213f4]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:51:54 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ab746fb-a1a0-49bd-9fa1-26890fd0086d tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:51:54 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-6ab746fb-a1a0-49bd-9fa1-26890fd0086d tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.393s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 09:51:54 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ab746fb-a1a0-49bd-9fa1-26890fd0086d tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] <== disconnect_volume: return (719ms) None {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 09:51:54 user nova-compute[75229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6ab746fb-a1a0-49bd-9fa1-26890fd0086d tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] [instance: a4ce290f-6dd2-44b6-91be-8e775045837e] Disconnected iSCSI Volume {{(pid=75229) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 09:51:54 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-abfa7012-edb3-4c18-94f3-67c3a5a03e82 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.322s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 09:51:54 user nova-compute[75229]: WARNING os_brick.initiator.connectors.base [None req-abfa7012-edb3-4c18-94f3-67c3a5a03e82 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 09:51:54 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-abfa7012-edb3-4c18-94f3-67c3a5a03e82 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b590f04d-8a50-4810-8e66-05d846f4613f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 09:51:54 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-abfa7012-edb3-4c18-94f3-67c3a5a03e82 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b590f04d-8a50-4810-8e66-05d846f4613f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 09:51:54 user nova-compute[75229]: INFO os_brick.initiator.connectors.iscsi [None req-abfa7012-edb3-4c18-94f3-67c3a5a03e82 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 09:51:54 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b590f04d-8a50-4810-8e66-05d846f4613f -p 172.16.0.220:3260 {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:51:54 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b590f04d-8a50-4810-8e66-05d846f4613f -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:51:54 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1433c59-8f8d-46ad-8938-9be3cae14d84]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:51:54 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-abfa7012-edb3-4c18-94f3-67c3a5a03e82 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 09:51:54 user nova-compute[75229]:  {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:51:54 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b590f04d-8a50-4810-8e66-05d846f4613f -p 172.16.0.220:3260 --interface default --op new {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:51:54 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b590f04d-8a50-4810-8e66-05d846f4613f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:51:54 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[22dbc964-279d-494d-82f5-0ebbe0408cbc]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b590f04d-8a50-4810-8e66-05d846f4613f] added\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:51:54 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-abfa7012-edb3-4c18-94f3-67c3a5a03e82 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b590f04d-8a50-4810-8e66-05d846f4613f] added
Nov 14 09:51:54 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:51:54 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b590f04d-8a50-4810-8e66-05d846f4613f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:51:54 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcd2eae5-1085-491f-925a-247c462d786a/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:51:54 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcd2eae5-1085-491f-925a-247c462d786a/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:51:54 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b590f04d-8a50-4810-8e66-05d846f4613f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:51:54 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[6787942e-a4c1-4b70-86fa-cbace5116512]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:51:54 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-abfa7012-edb3-4c18-94f3-67c3a5a03e82 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:51:54 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b590f04d-8a50-4810-8e66-05d846f4613f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:51:54 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b590f04d-8a50-4810-8e66-05d846f4613f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.071s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:51:54 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7a23696-c15f-432b-a185-33e68fbd9f34]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:51:54 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-abfa7012-edb3-4c18-94f3-67c3a5a03e82 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:51:54 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b590f04d-8a50-4810-8e66-05d846f4613f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PBamvgOl {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:51:54 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b590f04d-8a50-4810-8e66-05d846f4613f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PBamvgOl" returned: 0 in 0.021s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:51:54 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3b59a8a-71cc-4178-bfad-b9c11ea4914c]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:51:54 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-abfa7012-edb3-4c18-94f3-67c3a5a03e82 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PBamvgOl'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:51:54 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b590f04d-8a50-4810-8e66-05d846f4613f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:51:54 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b590f04d-8a50-4810-8e66-05d846f4613f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:51:54 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3547fef-256a-484b-9d19-a02e73ebb5ba]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:51:54 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-abfa7012-edb3-4c18-94f3-67c3a5a03e82 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:51:54 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:51:54 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcd2eae5-1085-491f-925a-247c462d786a/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:51:54 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:51:54 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[2df4eef1-57de-4733-9537-b1184ee3e696]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7902ab8-168d-4c8a-90e9-bf44d669ce2b (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aca09258-022b-4f04-b418-f2a170332755 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bae4836-52c2-428b-b299-a6a72899197d (non-flash)\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:51:54 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-abfa7012-edb3-4c18-94f3-67c3a5a03e82 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7902ab8-168d-4c8a-90e9-bf44d669ce2b (non-flash)
Nov 14 09:51:54 user nova-compute[75229]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aca09258-022b-4f04-b418-f2a170332755 (non-flash)
Nov 14 09:51:54 user nova-compute[75229]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bae4836-52c2-428b-b299-a6a72899197d (non-flash)
Nov 14 09:51:54 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 09:51:54 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-abfa7012-edb3-4c18-94f3-67c3a5a03e82 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7902ab8-168d-4c8a-90e9-bf44d669ce2b (non-flash)
Nov 14 09:51:54 user nova-compute[75229]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aca09258-022b-4f04-b418-f2a170332755 (non-flash)
Nov 14 09:51:54 user nova-compute[75229]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bae4836-52c2-428b-b299-a6a72899197d (non-flash)
Nov 14 09:51:54 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 09:51:54 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b590f04d-8a50-4810-8e66-05d846f4613f -p 172.16.0.220:3260 --login {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:51:54 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5170e9e-66e3-4df1-9807-4958cac6480e/disk.rescue --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:51:54 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b590f04d-8a50-4810-8e66-05d846f4613f -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:51:54 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[663f2385-842a-4521-8887-76035874f150]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b590f04d-8a50-4810-8e66-05d846f4613f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b590f04d-8a50-4810-8e66-05d846f4613f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:51:54 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-abfa7012-edb3-4c18-94f3-67c3a5a03e82 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b590f04d-8a50-4810-8e66-05d846f4613f, portal: 172.16.0.220,3260]
Nov 14 09:51:54 user nova-compute[75229]: Login to [iface: default, target: iqn.2010-10.org.openstack:b590f04d-8a50-4810-8e66-05d846f4613f, portal: 172.16.0.220,3260] successful.
Nov 14 09:51:54 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:51:54 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b590f04d-8a50-4810-8e66-05d846f4613f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:51:54 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b590f04d-8a50-4810-8e66-05d846f4613f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:51:54 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9566ea0-d320-410d-b18f-bb92f8098a4e]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:51:54 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-abfa7012-edb3-4c18-94f3-67c3a5a03e82 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:51:54 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:51:54 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:51:54 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[42cfda9c-fc98-4715-8d4f-8da7696aa589]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7902ab8-168d-4c8a-90e9-bf44d669ce2b (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aca09258-022b-4f04-b418-f2a170332755 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bae4836-52c2-428b-b299-a6a72899197d (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b590f04d-8a50-4810-8e66-05d846f4613f (non-flash)\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:51:54 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-abfa7012-edb3-4c18-94f3-67c3a5a03e82 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7902ab8-168d-4c8a-90e9-bf44d669ce2b (non-flash)
Nov 14 09:51:54 user nova-compute[75229]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aca09258-022b-4f04-b418-f2a170332755 (non-flash)
Nov 14 09:51:54 user nova-compute[75229]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bae4836-52c2-428b-b299-a6a72899197d (non-flash)
Nov 14 09:51:54 user nova-compute[75229]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b590f04d-8a50-4810-8e66-05d846f4613f (non-flash)
Nov 14 09:51:54 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 09:51:54 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-abfa7012-edb3-4c18-94f3-67c3a5a03e82 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7902ab8-168d-4c8a-90e9-bf44d669ce2b (non-flash)
Nov 14 09:51:54 user nova-compute[75229]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aca09258-022b-4f04-b418-f2a170332755 (non-flash)
Nov 14 09:51:54 user nova-compute[75229]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bae4836-52c2-428b-b299-a6a72899197d (non-flash)
Nov 14 09:51:54 user nova-compute[75229]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b590f04d-8a50-4810-8e66-05d846f4613f (non-flash)
Nov 14 09:51:54 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 09:51:54 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-abfa7012-edb3-4c18-94f3-67c3a5a03e82 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b590f04d-8a50-4810-8e66-05d846f4613f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.379s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 09:51:54 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-abfa7012-edb3-4c18-94f3-67c3a5a03e82 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] Connected to 172.16.0.220:3260 {{(pid=75229) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 09:51:54 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-abfa7012-edb3-4c18-94f3-67c3a5a03e82 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] HCTL ('34', '-', '-', 0) found on session 27 with lun 0 {{(pid=75229) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 09:51:54 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-abfa7012-edb3-4c18-94f3-67c3a5a03e82 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75229) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 09:51:54 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:51:54 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:51:54 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bd48883-5dbf-40a9-98de-8582cfae9e8b]: (4, ('- - 0', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:51:54 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-abfa7012-edb3-4c18-94f3-67c3a5a03e82 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] Searching for a device in session 27 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75229) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 09:51:54 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-abfa7012-edb3-4c18-94f3-67c3a5a03e82 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:b590f04d-8a50-4810-8e66-05d846f4613f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PBamvgOl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75229) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 09:51:54 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5170e9e-66e3-4df1-9807-4958cac6480e/disk.rescue --force-share --output=json" returned: 0 in 0.192s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:51:54 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5170e9e-66e3-4df1-9807-4958cac6480e/disk.rescue --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:51:55 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5170e9e-66e3-4df1-9807-4958cac6480e/disk.rescue --force-share --output=json" returned: 0 in 0.170s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:51:55 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5170e9e-66e3-4df1-9807-4958cac6480e/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:51:55 user nova-compute[75229]: DEBUG nova.compute.manager [req-ba3cc4bf-650b-47a9-a3e4-d20ac83a01a6 req-fcd50c4c-31f0-4e02-a4c9-4b5692975f63 service nova] [instance: 94e2b266-2fe3-481a-bb1e-24f835a79ddf] Received event network-vif-plugged-be0352bd-a149-4097-b049-8445f895d993 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:51:55 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-ba3cc4bf-650b-47a9-a3e4-d20ac83a01a6 req-fcd50c4c-31f0-4e02-a4c9-4b5692975f63 service nova] Acquiring lock "94e2b266-2fe3-481a-bb1e-24f835a79ddf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:51:55 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-ba3cc4bf-650b-47a9-a3e4-d20ac83a01a6 req-fcd50c4c-31f0-4e02-a4c9-4b5692975f63 service nova] Lock "94e2b266-2fe3-481a-bb1e-24f835a79ddf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:51:55 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-ba3cc4bf-650b-47a9-a3e4-d20ac83a01a6 req-fcd50c4c-31f0-4e02-a4c9-4b5692975f63 service nova] Lock "94e2b266-2fe3-481a-bb1e-24f835a79ddf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:51:55 user nova-compute[75229]: DEBUG nova.compute.manager [req-ba3cc4bf-650b-47a9-a3e4-d20ac83a01a6 req-fcd50c4c-31f0-4e02-a4c9-4b5692975f63 service nova] [instance: 94e2b266-2fe3-481a-bb1e-24f835a79ddf] No waiting events found dispatching network-vif-plugged-be0352bd-a149-4097-b049-8445f895d993 {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 09:51:55 user nova-compute[75229]: WARNING nova.compute.manager [req-ba3cc4bf-650b-47a9-a3e4-d20ac83a01a6 req-fcd50c4c-31f0-4e02-a4c9-4b5692975f63 service nova] [instance: 94e2b266-2fe3-481a-bb1e-24f835a79ddf] Received unexpected event network-vif-plugged-be0352bd-a149-4097-b049-8445f895d993 for instance with vm_state active and task_state reboot_started_hard.
Nov 14 09:51:55 user nova-compute[75229]: DEBUG nova.objects.instance [None req-6ab746fb-a1a0-49bd-9fa1-26890fd0086d tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] Lazy-loading 'flavor' on Instance uuid a4ce290f-6dd2-44b6-91be-8e775045837e {{(pid=75229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 09:51:55 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-6ab746fb-a1a0-49bd-9fa1-26890fd0086d tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] Lock "a4ce290f-6dd2-44b6-91be-8e775045837e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.072s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:51:55 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5170e9e-66e3-4df1-9807-4958cac6480e/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:51:55 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5170e9e-66e3-4df1-9807-4958cac6480e/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:51:55 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5170e9e-66e3-4df1-9807-4958cac6480e/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:51:55 user nova-compute[75229]: WARNING nova.virt.libvirt.driver [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 09:51:55 user nova-compute[75229]: WARNING nova.virt.libvirt.driver [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 09:51:55 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Hypervisor/Node resource view: name=user free_ram=6772MB free_disk=25.224315643310547GB free_vcpus=-1 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75229) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 09:51:55 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:51:55 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:51:55 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-abfa7012-edb3-4c18-94f3-67c3a5a03e82 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.426s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 09:51:55 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-abfa7012-edb3-4c18-94f3-67c3a5a03e82 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] <== connect_volume: return (1748ms) {'type': 'block', 'scsi_wwn': '23937313838326635', 'path': '/dev/sdc'} {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 09:51:55 user nova-compute[75229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-abfa7012-edb3-4c18-94f3-67c3a5a03e82 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] [instance: 94e2b266-2fe3-481a-bb1e-24f835a79ddf] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23937313838326635', 'path': '/dev/sdc'} {{(pid=75229) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 09:51:55 user nova-compute[75229]: DEBUG nova.virt.libvirt.vif [None req-abfa7012-edb3-4c18-94f3-67c3a5a03e82 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T09:49:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1624451670',display_name='tempest-TestMinimumBasicScenario-server-1624451670',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1624451670',id=21,image_ref='efab0bf3-e7ec-4953-8a54-2c5bb0a3baf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHLGyqy66WiitWeWLqujQDO7dBN6UvLDY3R5qVL6duh6Uqwoj1b+NfY0QC2GN9l+L9VeminYuv9MwxoPfEZ4V+l+UlMp+6JyFrnRt14AE/ia/51KfvySly2NYmpfm1yFaw==',key_name='tempest-TestMinimumBasicScenario-185710581',keypairs=<?>,launch_index=0,launched_at=2023-11-14T09:49:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4a6157b9827b44d2bab197220b635fd3',ramdisk_id='',reservation_id='r-0ro875yg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='efab0bf3-e7ec-4953-8a54-2c5bb0a3baf6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-284611138',owner_user_name='tempest-TestMinimumBasicScenario-284611138-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T09:51:53Z,user_data=None,user_id='3603da40a87149478458797ea9aedfe2',uuid=94e2b266-2fe3-481a-bb1e-24f835a79ddf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "be0352bd-a149-4097-b049-8445f895d993", "address": "fa:16:3e:dc:24:42", "network": {"id": "1687d918-9f70-4099-b44c-97f92f90e6ff", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2074208460-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a6157b9827b44d2bab197220b635fd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe0352bd-a1", "ovs_interfaceid": "be0352bd-a149-4097-b049-8445f895d993", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75229) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 09:51:55 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-abfa7012-edb3-4c18-94f3-67c3a5a03e82 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] Converting VIF {"id": "be0352bd-a149-4097-b049-8445f895d993", "address": "fa:16:3e:dc:24:42", "network": {"id": "1687d918-9f70-4099-b44c-97f92f90e6ff", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2074208460-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a6157b9827b44d2bab197220b635fd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe0352bd-a1", "ovs_interfaceid": "be0352bd-a149-4097-b049-8445f895d993", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 09:51:55 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-abfa7012-edb3-4c18-94f3-67c3a5a03e82 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:dc:24:42,bridge_name='br-int',has_traffic_filtering=True,id=be0352bd-a149-4097-b049-8445f895d993,network=Network(1687d918-9f70-4099-b44c-97f92f90e6ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe0352bd-a1') {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 09:51:55 user nova-compute[75229]: DEBUG nova.objects.instance [None req-abfa7012-edb3-4c18-94f3-67c3a5a03e82 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] Lazy-loading 'pci_devices' on Instance uuid 94e2b266-2fe3-481a-bb1e-24f835a79ddf {{(pid=75229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 09:51:55 user nova-compute[75229]: DEBUG nova.objects.base [None req-abfa7012-edb3-4c18-94f3-67c3a5a03e82 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] Object Instance<94e2b266-2fe3-481a-bb1e-24f835a79ddf> lazy-loaded attributes: resources,vcpu_model,pci_devices {{(pid=75229) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 09:51:55 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-abfa7012-edb3-4c18-94f3-67c3a5a03e82 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] [instance: 94e2b266-2fe3-481a-bb1e-24f835a79ddf] End _get_guest_xml xml=<domain type="kvm">
Nov 14 09:51:55 user nova-compute[75229]:   <uuid>94e2b266-2fe3-481a-bb1e-24f835a79ddf</uuid>
Nov 14 09:51:55 user nova-compute[75229]:   <name>instance-00000015</name>
Nov 14 09:51:55 user nova-compute[75229]:   <memory>524288</memory>
Nov 14 09:51:55 user nova-compute[75229]:   <vcpu>1</vcpu>
Nov 14 09:51:55 user nova-compute[75229]:   <metadata>
Nov 14 09:51:55 user nova-compute[75229]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 09:51:55 user nova-compute[75229]:       <nova:package version="0.0.0"/>
Nov 14 09:51:55 user nova-compute[75229]:       <nova:name>tempest-TestMinimumBasicScenario-server-1624451670</nova:name>
Nov 14 09:51:55 user nova-compute[75229]:       <nova:creationTime>2023-11-14 09:51:54</nova:creationTime>
Nov 14 09:51:55 user nova-compute[75229]:       <nova:flavor name="m1.tiny">
Nov 14 09:51:55 user nova-compute[75229]:         <nova:memory>512</nova:memory>
Nov 14 09:51:55 user nova-compute[75229]:         <nova:disk>1</nova:disk>
Nov 14 09:51:55 user nova-compute[75229]:         <nova:swap>0</nova:swap>
Nov 14 09:51:55 user nova-compute[75229]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 09:51:55 user nova-compute[75229]:         <nova:vcpus>1</nova:vcpus>
Nov 14 09:51:55 user nova-compute[75229]:       </nova:flavor>
Nov 14 09:51:55 user nova-compute[75229]:       <nova:owner>
Nov 14 09:51:55 user nova-compute[75229]:         <nova:user uuid="3603da40a87149478458797ea9aedfe2">tempest-TestMinimumBasicScenario-284611138-project-member</nova:user>
Nov 14 09:51:55 user nova-compute[75229]:         <nova:project uuid="4a6157b9827b44d2bab197220b635fd3">tempest-TestMinimumBasicScenario-284611138</nova:project>
Nov 14 09:51:55 user nova-compute[75229]:       </nova:owner>
Nov 14 09:51:55 user nova-compute[75229]:       <nova:root type="image" uuid="efab0bf3-e7ec-4953-8a54-2c5bb0a3baf6"/>
Nov 14 09:51:55 user nova-compute[75229]:       <nova:ports>
Nov 14 09:51:55 user nova-compute[75229]:         <nova:port uuid="be0352bd-a149-4097-b049-8445f895d993">
Nov 14 09:51:55 user nova-compute[75229]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 14 09:51:55 user nova-compute[75229]:         </nova:port>
Nov 14 09:51:55 user nova-compute[75229]:       </nova:ports>
Nov 14 09:51:55 user nova-compute[75229]:     </nova:instance>
Nov 14 09:51:55 user nova-compute[75229]:   </metadata>
Nov 14 09:51:55 user nova-compute[75229]:   <sysinfo type="smbios">
Nov 14 09:51:55 user nova-compute[75229]:     <system>
Nov 14 09:51:55 user nova-compute[75229]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 09:51:55 user nova-compute[75229]:       <entry name="product">OpenStack Nova</entry>
Nov 14 09:51:55 user nova-compute[75229]:       <entry name="version">0.0.0</entry>
Nov 14 09:51:55 user nova-compute[75229]:       <entry name="serial">94e2b266-2fe3-481a-bb1e-24f835a79ddf</entry>
Nov 14 09:51:55 user nova-compute[75229]:       <entry name="uuid">94e2b266-2fe3-481a-bb1e-24f835a79ddf</entry>
Nov 14 09:51:55 user nova-compute[75229]:       <entry name="family">Virtual Machine</entry>
Nov 14 09:51:55 user nova-compute[75229]:     </system>
Nov 14 09:51:55 user nova-compute[75229]:   </sysinfo>
Nov 14 09:51:55 user nova-compute[75229]:   <os>
Nov 14 09:51:55 user nova-compute[75229]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 09:51:55 user nova-compute[75229]:     <boot dev="hd"/>
Nov 14 09:51:55 user nova-compute[75229]:     <smbios mode="sysinfo"/>
Nov 14 09:51:55 user nova-compute[75229]:   </os>
Nov 14 09:51:55 user nova-compute[75229]:   <features>
Nov 14 09:51:55 user nova-compute[75229]:     <acpi/>
Nov 14 09:51:55 user nova-compute[75229]:     <apic/>
Nov 14 09:51:55 user nova-compute[75229]:     <vmcoreinfo/>
Nov 14 09:51:55 user nova-compute[75229]:   </features>
Nov 14 09:51:55 user nova-compute[75229]:   <clock offset="utc">
Nov 14 09:51:55 user nova-compute[75229]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 09:51:55 user nova-compute[75229]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 09:51:55 user nova-compute[75229]:     <timer name="hpet" present="no"/>
Nov 14 09:51:55 user nova-compute[75229]:   </clock>
Nov 14 09:51:55 user nova-compute[75229]:   <cpu mode="custom" match="exact">
Nov 14 09:51:55 user nova-compute[75229]:     <model>Nehalem</model>
Nov 14 09:51:55 user nova-compute[75229]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 09:51:55 user nova-compute[75229]:   </cpu>
Nov 14 09:51:55 user nova-compute[75229]:   <devices>
Nov 14 09:51:55 user nova-compute[75229]:     <disk type="file" device="disk">
Nov 14 09:51:55 user nova-compute[75229]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 09:51:55 user nova-compute[75229]:       <source file="/opt/stack/data/nova/instances/94e2b266-2fe3-481a-bb1e-24f835a79ddf/disk"/>
Nov 14 09:51:55 user nova-compute[75229]:       <target dev="vda" bus="virtio"/>
Nov 14 09:51:55 user nova-compute[75229]:     </disk>
Nov 14 09:51:55 user nova-compute[75229]:     <disk type="block" device="disk">
Nov 14 09:51:55 user nova-compute[75229]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 09:51:55 user nova-compute[75229]:       <source dev="/dev/sdc"/>
Nov 14 09:51:55 user nova-compute[75229]:       <target dev="vdb" bus="virtio"/>
Nov 14 09:51:55 user nova-compute[75229]:       <serial>b590f04d-8a50-4810-8e66-05d846f4613f</serial>
Nov 14 09:51:55 user nova-compute[75229]:     </disk>
Nov 14 09:51:55 user nova-compute[75229]:     <interface type="ethernet">
Nov 14 09:51:55 user nova-compute[75229]:       <mac address="fa:16:3e:dc:24:42"/>
Nov 14 09:51:55 user nova-compute[75229]:       <model type="virtio"/>
Nov 14 09:51:55 user nova-compute[75229]:       <mtu size="1442"/>
Nov 14 09:51:55 user nova-compute[75229]:       <target dev="tapbe0352bd-a1"/>
Nov 14 09:51:55 user nova-compute[75229]:     </interface>
Nov 14 09:51:55 user nova-compute[75229]:     <serial type="pty">
Nov 14 09:51:55 user nova-compute[75229]:       <log file="/opt/stack/data/nova/instances/94e2b266-2fe3-481a-bb1e-24f835a79ddf/console.log" append="off"/>
Nov 14 09:51:55 user nova-compute[75229]:     </serial>
Nov 14 09:51:55 user nova-compute[75229]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 09:51:55 user nova-compute[75229]:     <video>
Nov 14 09:51:55 user nova-compute[75229]:       <model type="virtio"/>
Nov 14 09:51:55 user nova-compute[75229]:     </video>
Nov 14 09:51:55 user nova-compute[75229]:     <rng model="virtio">
Nov 14 09:51:55 user nova-compute[75229]:       <backend model="random">/dev/urandom</backend>
Nov 14 09:51:55 user nova-compute[75229]:     </rng>
Nov 14 09:51:55 user nova-compute[75229]:     <controller type="usb" index="0" model="none"/>
Nov 14 09:51:55 user nova-compute[75229]:     <memballoon model="virtio">
Nov 14 09:51:55 user nova-compute[75229]:       <stats period="10"/>
Nov 14 09:51:55 user nova-compute[75229]:     </memballoon>
Nov 14 09:51:55 user nova-compute[75229]:   </devices>
Nov 14 09:51:55 user nova-compute[75229]: </domain>
Nov 14 09:51:55 user nova-compute[75229]:  {{(pid=75229) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 09:51:55 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-abfa7012-edb3-4c18-94f3-67c3a5a03e82 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94e2b266-2fe3-481a-bb1e-24f835a79ddf/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:51:56 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Instance a7750cbc-b3d0-44aa-8b88-c291ba007a8a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 09:51:56 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Instance be813b28-133f-416a-b2b5-dc0b9e4064b7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 09:51:56 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Instance a60d339f-e134-477c-8505-bf8c79d2a21c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 09:51:56 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Instance 4255af28-a111-4475-b207-67e335fd0835 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 09:51:56 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Instance 4c9fe69e-3f9d-4b30-a9e4-efc3e83efa17 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 09:51:56 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Instance b5170e9e-66e3-4df1-9807-4958cac6480e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 09:51:56 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Instance a4ce290f-6dd2-44b6-91be-8e775045837e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 09:51:56 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Instance 94e2b266-2fe3-481a-bb1e-24f835a79ddf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 09:51:56 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Instance 5abd12fe-e6fc-4cb1-9674-da08e13886be actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 09:51:56 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Instance e58500df-059a-4fce-afb7-ba36feca0697 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 09:51:56 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Instance bcd2eae5-1085-491f-925a-247c462d786a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 09:51:56 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Instance d73f431b-d002-4206-8b52-7d313a43dccb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 09:51:56 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Instance 673624b6-e830-45e0-9215-ba79fd4f881e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 09:51:56 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=75229) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 09:51:56 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=13GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=75229) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 09:51:56 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-abfa7012-edb3-4c18-94f3-67c3a5a03e82 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94e2b266-2fe3-481a-bb1e-24f835a79ddf/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:51:56 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-abfa7012-edb3-4c18-94f3-67c3a5a03e82 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94e2b266-2fe3-481a-bb1e-24f835a79ddf/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:51:56 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-abfa7012-edb3-4c18-94f3-67c3a5a03e82 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94e2b266-2fe3-481a-bb1e-24f835a79ddf/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:51:56 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-abfa7012-edb3-4c18-94f3-67c3a5a03e82 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75229) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 09:51:56 user nova-compute[75229]: DEBUG nova.objects.instance [None req-abfa7012-edb3-4c18-94f3-67c3a5a03e82 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] Lazy-loading 'trusted_certs' on Instance uuid 94e2b266-2fe3-481a-bb1e-24f835a79ddf {{(pid=75229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 09:51:56 user nova-compute[75229]: DEBUG nova.objects.base [None req-abfa7012-edb3-4c18-94f3-67c3a5a03e82 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] Object Instance<94e2b266-2fe3-481a-bb1e-24f835a79ddf> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs {{(pid=75229) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 09:51:56 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-abfa7012-edb3-4c18-94f3-67c3a5a03e82 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4fef5d435559eee5483c7cb62e0076a8e2f37001 --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:51:56 user nova-compute[75229]: DEBUG nova.compute.provider_tree [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Inventory has not changed in ProviderTree for provider: d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 {{(pid=75229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 09:51:56 user nova-compute[75229]: DEBUG nova.scheduler.client.report [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Inventory has not changed for provider d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 09:51:56 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Compute_service record updated for user:user {{(pid=75229) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 09:51:56 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.604s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:51:56 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-abfa7012-edb3-4c18-94f3-67c3a5a03e82 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4fef5d435559eee5483c7cb62e0076a8e2f37001 --force-share --output=json" returned: 0 in 0.176s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:51:56 user nova-compute[75229]: DEBUG nova.virt.disk.api [None req-abfa7012-edb3-4c18-94f3-67c3a5a03e82 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] Checking if we can resize image /opt/stack/data/nova/instances/94e2b266-2fe3-481a-bb1e-24f835a79ddf/disk. size=1073741824 {{(pid=75229) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 09:51:56 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-abfa7012-edb3-4c18-94f3-67c3a5a03e82 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94e2b266-2fe3-481a-bb1e-24f835a79ddf/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:51:56 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-abfa7012-edb3-4c18-94f3-67c3a5a03e82 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94e2b266-2fe3-481a-bb1e-24f835a79ddf/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:51:56 user nova-compute[75229]: DEBUG nova.virt.disk.api [None req-abfa7012-edb3-4c18-94f3-67c3a5a03e82 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] Cannot resize image /opt/stack/data/nova/instances/94e2b266-2fe3-481a-bb1e-24f835a79ddf/disk to a smaller size. {{(pid=75229) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 09:51:56 user nova-compute[75229]: DEBUG nova.objects.instance [None req-abfa7012-edb3-4c18-94f3-67c3a5a03e82 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] Lazy-loading 'migration_context' on Instance uuid 94e2b266-2fe3-481a-bb1e-24f835a79ddf {{(pid=75229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 09:51:56 user nova-compute[75229]: DEBUG nova.objects.base [None req-abfa7012-edb3-4c18-94f3-67c3a5a03e82 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] Object Instance<94e2b266-2fe3-481a-bb1e-24f835a79ddf> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=75229) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 09:51:56 user nova-compute[75229]: DEBUG nova.virt.libvirt.vif [None req-abfa7012-edb3-4c18-94f3-67c3a5a03e82 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T09:49:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1624451670',display_name='tempest-TestMinimumBasicScenario-server-1624451670',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1624451670',id=21,image_ref='efab0bf3-e7ec-4953-8a54-2c5bb0a3baf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHLGyqy66WiitWeWLqujQDO7dBN6UvLDY3R5qVL6duh6Uqwoj1b+NfY0QC2GN9l+L9VeminYuv9MwxoPfEZ4V+l+UlMp+6JyFrnRt14AE/ia/51KfvySly2NYmpfm1yFaw==',key_name='tempest-TestMinimumBasicScenario-185710581',keypairs=<?>,launch_index=0,launched_at=2023-11-14T09:49:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=1,progress=0,project_id='4a6157b9827b44d2bab197220b635fd3',ramdisk_id='',reservation_id='r-0ro875yg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='efab0bf3-e7ec-4953-8a54-2c5bb0a3baf6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-284611138',owner_user_name='tempest-TestMinimumBasicScenario-284611138-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T09:51:53Z,user_data=None,user_id='3603da40a87149478458797ea9aedfe2',uuid=94e2b266-2fe3-481a-bb1e-24f835a79ddf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "be0352bd-a149-4097-b049-8445f895d993", "address": "fa:16:3e:dc:24:42", "network": {"id": "1687d918-9f70-4099-b44c-97f92f90e6ff", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2074208460-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a6157b9827b44d2bab197220b635fd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe0352bd-a1", "ovs_interfaceid": "be0352bd-a149-4097-b049-8445f895d993", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 09:51:56 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-abfa7012-edb3-4c18-94f3-67c3a5a03e82 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] Converting VIF {"id": "be0352bd-a149-4097-b049-8445f895d993", "address": "fa:16:3e:dc:24:42", "network": {"id": "1687d918-9f70-4099-b44c-97f92f90e6ff", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2074208460-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a6157b9827b44d2bab197220b635fd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe0352bd-a1", "ovs_interfaceid": "be0352bd-a149-4097-b049-8445f895d993", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 09:51:56 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-abfa7012-edb3-4c18-94f3-67c3a5a03e82 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:dc:24:42,bridge_name='br-int',has_traffic_filtering=True,id=be0352bd-a149-4097-b049-8445f895d993,network=Network(1687d918-9f70-4099-b44c-97f92f90e6ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe0352bd-a1') {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 09:51:56 user nova-compute[75229]: DEBUG os_vif [None req-abfa7012-edb3-4c18-94f3-67c3a5a03e82 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:dc:24:42,bridge_name='br-int',has_traffic_filtering=True,id=be0352bd-a149-4097-b049-8445f895d993,network=Network(1687d918-9f70-4099-b44c-97f92f90e6ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe0352bd-a1') {{(pid=75229) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 09:51:56 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:51:56 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:51:56 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 09:51:56 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:51:56 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '65344a75-82d0-5e13-8545-55072b208337', '_type': 'linux-noop'}}, row=False) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:51:56 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 09:51:56 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:51:56 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbe0352bd-a1, may_exist=True, interface_attrs={}) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:51:56 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapbe0352bd-a1, col_values=(('qos', UUID('f4918cfc-5d13-4b05-9085-da561f9874dc')),), if_exists=True) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:51:56 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapbe0352bd-a1, col_values=(('external_ids', {'iface-id': 'be0352bd-a149-4097-b049-8445f895d993', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:dc:24:42', 'vm-uuid': '94e2b266-2fe3-481a-bb1e-24f835a79ddf'}),), if_exists=True) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:51:56 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:51:56 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 09:51:56 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:51:56 user nova-compute[75229]: INFO os_vif [None req-abfa7012-edb3-4c18-94f3-67c3a5a03e82 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:dc:24:42,bridge_name='br-int',has_traffic_filtering=True,id=be0352bd-a149-4097-b049-8445f895d993,network=Network(1687d918-9f70-4099-b44c-97f92f90e6ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe0352bd-a1')
Nov 14 09:51:57 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 09:51:57 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 09:51:57 user nova-compute[75229]: DEBUG nova.compute.manager [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Starting heal instance info cache {{(pid=75229) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 09:51:57 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Acquiring lock "refresh_cache-a60d339f-e134-477c-8505-bf8c79d2a21c" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 09:51:57 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Acquired lock "refresh_cache-a60d339f-e134-477c-8505-bf8c79d2a21c" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 09:51:57 user nova-compute[75229]: DEBUG nova.network.neutron [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] [instance: a60d339f-e134-477c-8505-bf8c79d2a21c] Forcefully refreshing network info cache for instance {{(pid=75229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 09:51:57 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:51:57 user nova-compute[75229]: DEBUG nova.network.neutron [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] [instance: a60d339f-e134-477c-8505-bf8c79d2a21c] Updating instance_info_cache with network_info: [{"id": "cb98fc47-7b69-4bde-9a4c-717cd44ba908", "address": "fa:16:3e:6c:f4:6d", "network": {"id": "2b667d50-4579-4453-b4d3-a818a0d2c6fc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1719812180-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.24", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32e17c7c586542139cdbc5bfda57e075", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb98fc47-7b", "ovs_interfaceid": "cb98fc47-7b69-4bde-9a4c-717cd44ba908", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 09:51:57 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Releasing lock "refresh_cache-a60d339f-e134-477c-8505-bf8c79d2a21c" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 09:51:57 user nova-compute[75229]: DEBUG nova.compute.manager [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] [instance: a60d339f-e134-477c-8505-bf8c79d2a21c] Updated the network info_cache for instance {{(pid=75229) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 09:51:57 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 09:51:57 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 09:51:57 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 09:51:57 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 09:51:57 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 09:51:57 user nova-compute[75229]: DEBUG nova.compute.manager [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75229) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 09:51:57 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:51:57 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:51:58 user nova-compute[75229]: DEBUG nova.compute.manager [req-78ebd4bb-9548-4811-bd39-7102d8c7c13f req-77a61dcb-c142-4a0f-8c3d-2271009f3880 service nova] [instance: 94e2b266-2fe3-481a-bb1e-24f835a79ddf] Received event network-vif-plugged-be0352bd-a149-4097-b049-8445f895d993 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:51:58 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-78ebd4bb-9548-4811-bd39-7102d8c7c13f req-77a61dcb-c142-4a0f-8c3d-2271009f3880 service nova] Acquiring lock "94e2b266-2fe3-481a-bb1e-24f835a79ddf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:51:58 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-78ebd4bb-9548-4811-bd39-7102d8c7c13f req-77a61dcb-c142-4a0f-8c3d-2271009f3880 service nova] Lock "94e2b266-2fe3-481a-bb1e-24f835a79ddf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:51:58 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-78ebd4bb-9548-4811-bd39-7102d8c7c13f req-77a61dcb-c142-4a0f-8c3d-2271009f3880 service nova] Lock "94e2b266-2fe3-481a-bb1e-24f835a79ddf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:51:58 user nova-compute[75229]: DEBUG nova.compute.manager [req-78ebd4bb-9548-4811-bd39-7102d8c7c13f req-77a61dcb-c142-4a0f-8c3d-2271009f3880 service nova] [instance: 94e2b266-2fe3-481a-bb1e-24f835a79ddf] No waiting events found dispatching network-vif-plugged-be0352bd-a149-4097-b049-8445f895d993 {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 09:51:58 user nova-compute[75229]: WARNING nova.compute.manager [req-78ebd4bb-9548-4811-bd39-7102d8c7c13f req-77a61dcb-c142-4a0f-8c3d-2271009f3880 service nova] [instance: 94e2b266-2fe3-481a-bb1e-24f835a79ddf] Received unexpected event network-vif-plugged-be0352bd-a149-4097-b049-8445f895d993 for instance with vm_state active and task_state reboot_started_hard.
Nov 14 09:51:58 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:51:58 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:51:58 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:51:58 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:51:58 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:52:00 user nova-compute[75229]: DEBUG nova.compute.manager [None req-abfa7012-edb3-4c18-94f3-67c3a5a03e82 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] [instance: 94e2b266-2fe3-481a-bb1e-24f835a79ddf] Instance event wait completed in 0 seconds for  {{(pid=75229) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 09:52:00 user nova-compute[75229]: INFO nova.virt.libvirt.driver [-] [instance: 94e2b266-2fe3-481a-bb1e-24f835a79ddf] Instance rebooted successfully.
Nov 14 09:52:00 user nova-compute[75229]: DEBUG nova.compute.manager [None req-abfa7012-edb3-4c18-94f3-67c3a5a03e82 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] [instance: 94e2b266-2fe3-481a-bb1e-24f835a79ddf] Checking state {{(pid=75229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 09:52:00 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-abfa7012-edb3-4c18-94f3-67c3a5a03e82 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] Lock "94e2b266-2fe3-481a-bb1e-24f835a79ddf" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 8.059s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:52:00 user nova-compute[75229]: DEBUG nova.compute.manager [req-b9ab9017-791d-4ddd-b9e8-53c44c231601 req-4a5e802e-92fb-439f-9a66-39dee06eda73 service nova] [instance: 94e2b266-2fe3-481a-bb1e-24f835a79ddf] Received event network-vif-plugged-be0352bd-a149-4097-b049-8445f895d993 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:52:00 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-b9ab9017-791d-4ddd-b9e8-53c44c231601 req-4a5e802e-92fb-439f-9a66-39dee06eda73 service nova] Acquiring lock "94e2b266-2fe3-481a-bb1e-24f835a79ddf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:52:00 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-b9ab9017-791d-4ddd-b9e8-53c44c231601 req-4a5e802e-92fb-439f-9a66-39dee06eda73 service nova] Lock "94e2b266-2fe3-481a-bb1e-24f835a79ddf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:52:00 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-b9ab9017-791d-4ddd-b9e8-53c44c231601 req-4a5e802e-92fb-439f-9a66-39dee06eda73 service nova] Lock "94e2b266-2fe3-481a-bb1e-24f835a79ddf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:52:00 user nova-compute[75229]: DEBUG nova.compute.manager [req-b9ab9017-791d-4ddd-b9e8-53c44c231601 req-4a5e802e-92fb-439f-9a66-39dee06eda73 service nova] [instance: 94e2b266-2fe3-481a-bb1e-24f835a79ddf] No waiting events found dispatching network-vif-plugged-be0352bd-a149-4097-b049-8445f895d993 {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 09:52:00 user nova-compute[75229]: WARNING nova.compute.manager [req-b9ab9017-791d-4ddd-b9e8-53c44c231601 req-4a5e802e-92fb-439f-9a66-39dee06eda73 service nova] [instance: 94e2b266-2fe3-481a-bb1e-24f835a79ddf] Received unexpected event network-vif-plugged-be0352bd-a149-4097-b049-8445f895d993 for instance with vm_state active and task_state None.
Nov 14 09:52:01 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:52:02 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 09:52:03 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:52:03 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:52:05 user nova-compute[75229]: DEBUG nova.compute.manager [req-3f30f5b6-af07-4e7e-88b1-33a56cf01cdb req-aaf546a4-95d8-483e-88c5-7c190c11eb9f service nova] [instance: 5abd12fe-e6fc-4cb1-9674-da08e13886be] Received event network-changed-dff81e5d-68b7-41dc-a6ce-7fda9da3b718 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:52:05 user nova-compute[75229]: DEBUG nova.compute.manager [req-3f30f5b6-af07-4e7e-88b1-33a56cf01cdb req-aaf546a4-95d8-483e-88c5-7c190c11eb9f service nova] [instance: 5abd12fe-e6fc-4cb1-9674-da08e13886be] Refreshing instance network info cache due to event network-changed-dff81e5d-68b7-41dc-a6ce-7fda9da3b718. {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 09:52:05 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-3f30f5b6-af07-4e7e-88b1-33a56cf01cdb req-aaf546a4-95d8-483e-88c5-7c190c11eb9f service nova] Acquiring lock "refresh_cache-5abd12fe-e6fc-4cb1-9674-da08e13886be" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 09:52:05 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-3f30f5b6-af07-4e7e-88b1-33a56cf01cdb req-aaf546a4-95d8-483e-88c5-7c190c11eb9f service nova] Acquired lock "refresh_cache-5abd12fe-e6fc-4cb1-9674-da08e13886be" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 09:52:05 user nova-compute[75229]: DEBUG nova.network.neutron [req-3f30f5b6-af07-4e7e-88b1-33a56cf01cdb req-aaf546a4-95d8-483e-88c5-7c190c11eb9f service nova] [instance: 5abd12fe-e6fc-4cb1-9674-da08e13886be] Refreshing network info cache for port dff81e5d-68b7-41dc-a6ce-7fda9da3b718 {{(pid=75229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 09:52:06 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-60adc6df-4129-4280-875a-a4096ac30429 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Acquiring lock "5abd12fe-e6fc-4cb1-9674-da08e13886be" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:52:06 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-60adc6df-4129-4280-875a-a4096ac30429 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Lock "5abd12fe-e6fc-4cb1-9674-da08e13886be" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:52:06 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-60adc6df-4129-4280-875a-a4096ac30429 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Acquiring lock "5abd12fe-e6fc-4cb1-9674-da08e13886be-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:52:06 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-60adc6df-4129-4280-875a-a4096ac30429 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Lock "5abd12fe-e6fc-4cb1-9674-da08e13886be-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:52:06 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-60adc6df-4129-4280-875a-a4096ac30429 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Lock "5abd12fe-e6fc-4cb1-9674-da08e13886be-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:52:06 user nova-compute[75229]: INFO nova.compute.manager [None req-60adc6df-4129-4280-875a-a4096ac30429 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] [instance: 5abd12fe-e6fc-4cb1-9674-da08e13886be] Terminating instance
Nov 14 09:52:06 user nova-compute[75229]: DEBUG nova.compute.manager [None req-60adc6df-4129-4280-875a-a4096ac30429 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] [instance: 5abd12fe-e6fc-4cb1-9674-da08e13886be] Start destroying the instance on the hypervisor. {{(pid=75229) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 09:52:06 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:52:06 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:52:06 user nova-compute[75229]: DEBUG nova.compute.manager [req-83de448f-2193-42c1-94cc-c54147f1e409 req-e69e4fcc-3478-47d0-8d0e-3531239dce07 service nova] [instance: 5abd12fe-e6fc-4cb1-9674-da08e13886be] Received event network-vif-unplugged-dff81e5d-68b7-41dc-a6ce-7fda9da3b718 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:52:06 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-83de448f-2193-42c1-94cc-c54147f1e409 req-e69e4fcc-3478-47d0-8d0e-3531239dce07 service nova] Acquiring lock "5abd12fe-e6fc-4cb1-9674-da08e13886be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:52:06 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-83de448f-2193-42c1-94cc-c54147f1e409 req-e69e4fcc-3478-47d0-8d0e-3531239dce07 service nova] Lock "5abd12fe-e6fc-4cb1-9674-da08e13886be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:52:06 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-83de448f-2193-42c1-94cc-c54147f1e409 req-e69e4fcc-3478-47d0-8d0e-3531239dce07 service nova] Lock "5abd12fe-e6fc-4cb1-9674-da08e13886be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:52:06 user nova-compute[75229]: DEBUG nova.compute.manager [req-83de448f-2193-42c1-94cc-c54147f1e409 req-e69e4fcc-3478-47d0-8d0e-3531239dce07 service nova] [instance: 5abd12fe-e6fc-4cb1-9674-da08e13886be] No waiting events found dispatching network-vif-unplugged-dff81e5d-68b7-41dc-a6ce-7fda9da3b718 {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 09:52:06 user nova-compute[75229]: DEBUG nova.compute.manager [req-83de448f-2193-42c1-94cc-c54147f1e409 req-e69e4fcc-3478-47d0-8d0e-3531239dce07 service nova] [instance: 5abd12fe-e6fc-4cb1-9674-da08e13886be] Received event network-vif-unplugged-dff81e5d-68b7-41dc-a6ce-7fda9da3b718 for instance with task_state deleting. {{(pid=75229) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 09:52:06 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:52:06 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:52:06 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:52:06 user nova-compute[75229]: DEBUG nova.network.neutron [req-3f30f5b6-af07-4e7e-88b1-33a56cf01cdb req-aaf546a4-95d8-483e-88c5-7c190c11eb9f service nova] [instance: 5abd12fe-e6fc-4cb1-9674-da08e13886be] Updated VIF entry in instance network info cache for port dff81e5d-68b7-41dc-a6ce-7fda9da3b718. {{(pid=75229) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 09:52:06 user nova-compute[75229]: DEBUG nova.network.neutron [req-3f30f5b6-af07-4e7e-88b1-33a56cf01cdb req-aaf546a4-95d8-483e-88c5-7c190c11eb9f service nova] [instance: 5abd12fe-e6fc-4cb1-9674-da08e13886be] Updating instance_info_cache with network_info: [{"id": "dff81e5d-68b7-41dc-a6ce-7fda9da3b718", "address": "fa:16:3e:bb:19:d4", "network": {"id": "bd407caa-6ef6-400d-9327-3179dc1d8da4", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-29933774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.61", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b8d48c38c7344f5b12d0ed5b9392554", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdff81e5d-68", "ovs_interfaceid": "dff81e5d-68b7-41dc-a6ce-7fda9da3b718", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 09:52:06 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-3f30f5b6-af07-4e7e-88b1-33a56cf01cdb req-aaf546a4-95d8-483e-88c5-7c190c11eb9f service nova] Releasing lock "refresh_cache-5abd12fe-e6fc-4cb1-9674-da08e13886be" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 09:52:07 user nova-compute[75229]: INFO nova.virt.libvirt.driver [-] [instance: 5abd12fe-e6fc-4cb1-9674-da08e13886be] Instance destroyed successfully.
Nov 14 09:52:07 user nova-compute[75229]: DEBUG nova.objects.instance [None req-60adc6df-4129-4280-875a-a4096ac30429 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Lazy-loading 'resources' on Instance uuid 5abd12fe-e6fc-4cb1-9674-da08e13886be {{(pid=75229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 09:52:07 user nova-compute[75229]: DEBUG nova.virt.libvirt.vif [None req-60adc6df-4129-4280-875a-a4096ac30429 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T09:50:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-194804866',display_name='tempest-AttachVolumeNegativeTest-server-194804866',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-194804866',id=22,image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCH+ISYLuegqrbiRaGCaTLv5WJjPfOkoNb9QL15VoZ9ywRDwfO4Pjwl3HygOM1y1gAP3vd9UvUZSkQ3oDf9U60JcBir566GFrToUKfNOu6e6O78mAKueTXDnMCXFfFB+bg==',key_name='tempest-keypair-371679735',keypairs=<?>,launch_index=0,launched_at=2023-11-14T09:50:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8b8d48c38c7344f5b12d0ed5b9392554',ramdisk_id='',reservation_id='r-w5r6qttw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-140392099',owner_user_name='tempest-AttachVolumeNegativeTest-140392099-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T09:50:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3b8313e365eb4970a58c412768e959bf',uuid=5abd12fe-e6fc-4cb1-9674-da08e13886be,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dff81e5d-68b7-41dc-a6ce-7fda9da3b718", "address": "fa:16:3e:bb:19:d4", "network": {"id": "bd407caa-6ef6-400d-9327-3179dc1d8da4", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-29933774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b8d48c38c7344f5b12d0ed5b9392554", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdff81e5d-68", "ovs_interfaceid": "dff81e5d-68b7-41dc-a6ce-7fda9da3b718", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 09:52:07 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-60adc6df-4129-4280-875a-a4096ac30429 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Converting VIF {"id": "dff81e5d-68b7-41dc-a6ce-7fda9da3b718", "address": "fa:16:3e:bb:19:d4", "network": {"id": "bd407caa-6ef6-400d-9327-3179dc1d8da4", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-29933774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b8d48c38c7344f5b12d0ed5b9392554", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdff81e5d-68", "ovs_interfaceid": "dff81e5d-68b7-41dc-a6ce-7fda9da3b718", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 09:52:07 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-60adc6df-4129-4280-875a-a4096ac30429 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bb:19:d4,bridge_name='br-int',has_traffic_filtering=True,id=dff81e5d-68b7-41dc-a6ce-7fda9da3b718,network=Network(bd407caa-6ef6-400d-9327-3179dc1d8da4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdff81e5d-68') {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 09:52:07 user nova-compute[75229]: DEBUG os_vif [None req-60adc6df-4129-4280-875a-a4096ac30429 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bb:19:d4,bridge_name='br-int',has_traffic_filtering=True,id=dff81e5d-68b7-41dc-a6ce-7fda9da3b718,network=Network(bd407caa-6ef6-400d-9327-3179dc1d8da4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdff81e5d-68') {{(pid=75229) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 09:52:07 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:52:07 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdff81e5d-68, bridge=br-int, if_exists=True) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:52:07 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:52:07 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 09:52:07 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:52:07 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d7a4a7b7-6270-478e-8685-90005baa92bb) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:52:07 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:52:07 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 09:52:07 user nova-compute[75229]: INFO os_vif [None req-60adc6df-4129-4280-875a-a4096ac30429 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bb:19:d4,bridge_name='br-int',has_traffic_filtering=True,id=dff81e5d-68b7-41dc-a6ce-7fda9da3b718,network=Network(bd407caa-6ef6-400d-9327-3179dc1d8da4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdff81e5d-68')
Nov 14 09:52:07 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-60adc6df-4129-4280-875a-a4096ac30429 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] [instance: 5abd12fe-e6fc-4cb1-9674-da08e13886be] Deleting instance files /opt/stack/data/nova/instances/5abd12fe-e6fc-4cb1-9674-da08e13886be_del
Nov 14 09:52:07 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-60adc6df-4129-4280-875a-a4096ac30429 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] [instance: 5abd12fe-e6fc-4cb1-9674-da08e13886be] Deletion of /opt/stack/data/nova/instances/5abd12fe-e6fc-4cb1-9674-da08e13886be_del complete
Nov 14 09:52:07 user nova-compute[75229]: INFO nova.compute.manager [None req-60adc6df-4129-4280-875a-a4096ac30429 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] [instance: 5abd12fe-e6fc-4cb1-9674-da08e13886be] Took 0.85 seconds to destroy the instance on the hypervisor.
Nov 14 09:52:07 user nova-compute[75229]: DEBUG oslo.service.loopingcall [None req-60adc6df-4129-4280-875a-a4096ac30429 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75229) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 09:52:07 user nova-compute[75229]: DEBUG nova.compute.manager [-] [instance: 5abd12fe-e6fc-4cb1-9674-da08e13886be] Deallocating network for instance {{(pid=75229) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 09:52:07 user nova-compute[75229]: DEBUG nova.network.neutron [-] [instance: 5abd12fe-e6fc-4cb1-9674-da08e13886be] deallocate_for_instance() {{(pid=75229) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 09:52:07 user nova-compute[75229]: DEBUG nova.network.neutron [-] [instance: 5abd12fe-e6fc-4cb1-9674-da08e13886be] Updating instance_info_cache with network_info: [] {{(pid=75229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 09:52:07 user nova-compute[75229]: INFO nova.compute.manager [-] [instance: 5abd12fe-e6fc-4cb1-9674-da08e13886be] Took 0.66 seconds to deallocate network for instance.
Nov 14 09:52:07 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-60adc6df-4129-4280-875a-a4096ac30429 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:52:07 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-60adc6df-4129-4280-875a-a4096ac30429 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:52:07 user nova-compute[75229]: DEBUG nova.compute.manager [req-e5cf6278-0460-441b-a29c-9dc869d0780f req-2f011783-a9b0-4478-9403-40b76f07474b service nova] [instance: 5abd12fe-e6fc-4cb1-9674-da08e13886be] Received event network-vif-deleted-dff81e5d-68b7-41dc-a6ce-7fda9da3b718 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:52:08 user nova-compute[75229]: DEBUG nova.compute.provider_tree [None req-60adc6df-4129-4280-875a-a4096ac30429 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Inventory has not changed in ProviderTree for provider: d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 {{(pid=75229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 09:52:08 user nova-compute[75229]: DEBUG nova.scheduler.client.report [None req-60adc6df-4129-4280-875a-a4096ac30429 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Inventory has not changed for provider d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 09:52:08 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-60adc6df-4129-4280-875a-a4096ac30429 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.354s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:52:08 user nova-compute[75229]: INFO nova.scheduler.client.report [None req-60adc6df-4129-4280-875a-a4096ac30429 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Deleted allocations for instance 5abd12fe-e6fc-4cb1-9674-da08e13886be
Nov 14 09:52:08 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-60adc6df-4129-4280-875a-a4096ac30429 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Lock "5abd12fe-e6fc-4cb1-9674-da08e13886be" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.037s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:52:08 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:52:08 user nova-compute[75229]: DEBUG nova.compute.manager [req-9e52a7a2-6080-47c7-9cb5-296de5d5179c req-c40fe8dc-d6b0-48a4-b4b8-0a6d466fd6e9 service nova] [instance: 5abd12fe-e6fc-4cb1-9674-da08e13886be] Received event network-vif-plugged-dff81e5d-68b7-41dc-a6ce-7fda9da3b718 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:52:08 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-9e52a7a2-6080-47c7-9cb5-296de5d5179c req-c40fe8dc-d6b0-48a4-b4b8-0a6d466fd6e9 service nova] Acquiring lock "5abd12fe-e6fc-4cb1-9674-da08e13886be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:52:08 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-9e52a7a2-6080-47c7-9cb5-296de5d5179c req-c40fe8dc-d6b0-48a4-b4b8-0a6d466fd6e9 service nova] Lock "5abd12fe-e6fc-4cb1-9674-da08e13886be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:52:08 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-9e52a7a2-6080-47c7-9cb5-296de5d5179c req-c40fe8dc-d6b0-48a4-b4b8-0a6d466fd6e9 service nova] Lock "5abd12fe-e6fc-4cb1-9674-da08e13886be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:52:08 user nova-compute[75229]: DEBUG nova.compute.manager [req-9e52a7a2-6080-47c7-9cb5-296de5d5179c req-c40fe8dc-d6b0-48a4-b4b8-0a6d466fd6e9 service nova] [instance: 5abd12fe-e6fc-4cb1-9674-da08e13886be] No waiting events found dispatching network-vif-plugged-dff81e5d-68b7-41dc-a6ce-7fda9da3b718 {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 09:52:08 user nova-compute[75229]: WARNING nova.compute.manager [req-9e52a7a2-6080-47c7-9cb5-296de5d5179c req-c40fe8dc-d6b0-48a4-b4b8-0a6d466fd6e9 service nova] [instance: 5abd12fe-e6fc-4cb1-9674-da08e13886be] Received unexpected event network-vif-plugged-dff81e5d-68b7-41dc-a6ce-7fda9da3b718 for instance with vm_state deleted and task_state None.
Nov 14 09:52:08 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:52:12 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:52:17 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 09:52:18 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:52:22 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:52:23 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:52:25 user nova-compute[75229]: DEBUG nova.compute.manager [None req-7a2f86fd-df4e-4680-a59e-bab06da7426b tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] [instance: a4ce290f-6dd2-44b6-91be-8e775045837e] Checking state {{(pid=75229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 09:52:25 user nova-compute[75229]: INFO nova.compute.manager [None req-7a2f86fd-df4e-4680-a59e-bab06da7426b tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] [instance: a4ce290f-6dd2-44b6-91be-8e775045837e] instance snapshotting
Nov 14 09:52:25 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-7a2f86fd-df4e-4680-a59e-bab06da7426b tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] [instance: a4ce290f-6dd2-44b6-91be-8e775045837e] Beginning live snapshot process
Nov 14 09:52:25 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-7a2f86fd-df4e-4680-a59e-bab06da7426b tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4ce290f-6dd2-44b6-91be-8e775045837e/disk --force-share --output=json -f qcow2 {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:52:26 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-7a2f86fd-df4e-4680-a59e-bab06da7426b tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4ce290f-6dd2-44b6-91be-8e775045837e/disk --force-share --output=json -f qcow2" returned: 0 in 0.181s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:52:26 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-7a2f86fd-df4e-4680-a59e-bab06da7426b tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4ce290f-6dd2-44b6-91be-8e775045837e/disk --force-share --output=json -f qcow2 {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:52:26 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-7a2f86fd-df4e-4680-a59e-bab06da7426b tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4ce290f-6dd2-44b6-91be-8e775045837e/disk --force-share --output=json -f qcow2" returned: 0 in 0.174s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:52:26 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-7a2f86fd-df4e-4680-a59e-bab06da7426b tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6 --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:52:26 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-7a2f86fd-df4e-4680-a59e-bab06da7426b tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6 --force-share --output=json" returned: 0 in 0.171s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:52:26 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-7a2f86fd-df4e-4680-a59e-bab06da7426b tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpggos8uvh/651757a047ab4cd9aa9a860cecaca17f.delta 1073741824 {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:52:26 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-7a2f86fd-df4e-4680-a59e-bab06da7426b tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpggos8uvh/651757a047ab4cd9aa9a860cecaca17f.delta 1073741824" returned: 0 in 0.049s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:52:26 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-7a2f86fd-df4e-4680-a59e-bab06da7426b tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] [instance: a4ce290f-6dd2-44b6-91be-8e775045837e] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 14 09:52:27 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:52:27 user nova-compute[75229]: DEBUG nova.virt.libvirt.guest [None req-7a2f86fd-df4e-4680-a59e-bab06da7426b tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] COPY block job progress, current cursor: 0 final cursor: 75563008 {{(pid=75229) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 09:52:27 user nova-compute[75229]: DEBUG nova.virt.libvirt.guest [None req-7a2f86fd-df4e-4680-a59e-bab06da7426b tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] COPY block job progress, current cursor: 75563008 final cursor: 75563008 {{(pid=75229) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 09:52:27 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-7a2f86fd-df4e-4680-a59e-bab06da7426b tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] [instance: a4ce290f-6dd2-44b6-91be-8e775045837e] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 14 09:52:27 user nova-compute[75229]: DEBUG nova.privsep.utils [None req-7a2f86fd-df4e-4680-a59e-bab06da7426b tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75229) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 14 09:52:27 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-7a2f86fd-df4e-4680-a59e-bab06da7426b tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpggos8uvh/651757a047ab4cd9aa9a860cecaca17f.delta /opt/stack/data/nova/instances/snapshots/tmpggos8uvh/651757a047ab4cd9aa9a860cecaca17f {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:52:28 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-7a2f86fd-df4e-4680-a59e-bab06da7426b tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpggos8uvh/651757a047ab4cd9aa9a860cecaca17f.delta /opt/stack/data/nova/instances/snapshots/tmpggos8uvh/651757a047ab4cd9aa9a860cecaca17f" returned: 0 in 0.460s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:52:28 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-7a2f86fd-df4e-4680-a59e-bab06da7426b tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] [instance: a4ce290f-6dd2-44b6-91be-8e775045837e] Snapshot extracted, beginning image upload
Nov 14 09:52:28 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:52:30 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-7a2f86fd-df4e-4680-a59e-bab06da7426b tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] [instance: a4ce290f-6dd2-44b6-91be-8e775045837e] Snapshot image upload complete
Nov 14 09:52:30 user nova-compute[75229]: INFO nova.compute.manager [None req-7a2f86fd-df4e-4680-a59e-bab06da7426b tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] [instance: a4ce290f-6dd2-44b6-91be-8e775045837e] Took 5.07 seconds to snapshot the instance on the hypervisor.
Nov 14 09:52:32 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:52:32 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-1903659f-d404-4352-8235-236d9467b6ab tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] Acquiring lock "564d95eb-81c0-47a5-9979-2318fced06f5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:52:32 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-1903659f-d404-4352-8235-236d9467b6ab tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] Lock "564d95eb-81c0-47a5-9979-2318fced06f5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:52:32 user nova-compute[75229]: DEBUG nova.compute.manager [None req-1903659f-d404-4352-8235-236d9467b6ab tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] [instance: 564d95eb-81c0-47a5-9979-2318fced06f5] Starting instance... {{(pid=75229) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 09:52:32 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-1903659f-d404-4352-8235-236d9467b6ab tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:52:32 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-1903659f-d404-4352-8235-236d9467b6ab tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:52:32 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-1903659f-d404-4352-8235-236d9467b6ab tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75229) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 09:52:32 user nova-compute[75229]: INFO nova.compute.claims [None req-1903659f-d404-4352-8235-236d9467b6ab tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] [instance: 564d95eb-81c0-47a5-9979-2318fced06f5] Claim successful on node user
Nov 14 09:52:32 user nova-compute[75229]: DEBUG nova.compute.provider_tree [None req-1903659f-d404-4352-8235-236d9467b6ab tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] Inventory has not changed in ProviderTree for provider: d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 {{(pid=75229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 09:52:32 user nova-compute[75229]: DEBUG nova.scheduler.client.report [None req-1903659f-d404-4352-8235-236d9467b6ab tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] Inventory has not changed for provider d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 09:52:32 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-1903659f-d404-4352-8235-236d9467b6ab tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.472s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:52:32 user nova-compute[75229]: DEBUG nova.compute.manager [None req-1903659f-d404-4352-8235-236d9467b6ab tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] [instance: 564d95eb-81c0-47a5-9979-2318fced06f5] Start building networks asynchronously for instance. {{(pid=75229) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 09:52:32 user nova-compute[75229]: DEBUG nova.compute.manager [None req-1903659f-d404-4352-8235-236d9467b6ab tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] [instance: 564d95eb-81c0-47a5-9979-2318fced06f5] Allocating IP information in the background. {{(pid=75229) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 09:52:32 user nova-compute[75229]: DEBUG nova.network.neutron [None req-1903659f-d404-4352-8235-236d9467b6ab tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] [instance: 564d95eb-81c0-47a5-9979-2318fced06f5] allocate_for_instance() {{(pid=75229) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 09:52:32 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-1903659f-d404-4352-8235-236d9467b6ab tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] [instance: 564d95eb-81c0-47a5-9979-2318fced06f5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 09:52:32 user nova-compute[75229]: DEBUG nova.compute.manager [None req-1903659f-d404-4352-8235-236d9467b6ab tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] [instance: 564d95eb-81c0-47a5-9979-2318fced06f5] Start building block device mappings for instance. {{(pid=75229) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 09:52:32 user nova-compute[75229]: DEBUG nova.policy [None req-1903659f-d404-4352-8235-236d9467b6ab tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9b525334713e47ceb8f71035116d5c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a196548d9de4e18b8bab9fefdab0861', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75229) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 09:52:32 user nova-compute[75229]: DEBUG nova.compute.manager [None req-1903659f-d404-4352-8235-236d9467b6ab tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] [instance: 564d95eb-81c0-47a5-9979-2318fced06f5] Start spawning the instance on the hypervisor. {{(pid=75229) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 09:52:32 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-1903659f-d404-4352-8235-236d9467b6ab tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] [instance: 564d95eb-81c0-47a5-9979-2318fced06f5] Creating instance directory {{(pid=75229) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 09:52:32 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-1903659f-d404-4352-8235-236d9467b6ab tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] [instance: 564d95eb-81c0-47a5-9979-2318fced06f5] Creating image(s)
Nov 14 09:52:32 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-1903659f-d404-4352-8235-236d9467b6ab tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] Acquiring lock "/opt/stack/data/nova/instances/564d95eb-81c0-47a5-9979-2318fced06f5/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:52:32 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-1903659f-d404-4352-8235-236d9467b6ab tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] Lock "/opt/stack/data/nova/instances/564d95eb-81c0-47a5-9979-2318fced06f5/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:52:32 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-1903659f-d404-4352-8235-236d9467b6ab tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] Lock "/opt/stack/data/nova/instances/564d95eb-81c0-47a5-9979-2318fced06f5/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:52:32 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-1903659f-d404-4352-8235-236d9467b6ab tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] Acquiring lock "d9970b2a3da011a0c3b2a5911c5bbe3e1973d4c7" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:52:32 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-1903659f-d404-4352-8235-236d9467b6ab tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] Lock "d9970b2a3da011a0c3b2a5911c5bbe3e1973d4c7" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:52:33 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-1903659f-d404-4352-8235-236d9467b6ab tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d9970b2a3da011a0c3b2a5911c5bbe3e1973d4c7.part --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:52:34 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-1903659f-d404-4352-8235-236d9467b6ab tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d9970b2a3da011a0c3b2a5911c5bbe3e1973d4c7.part --force-share --output=json" returned: 0 in 0.175s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:52:34 user nova-compute[75229]: DEBUG nova.virt.images [None req-1903659f-d404-4352-8235-236d9467b6ab tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] 219fc96b-99d8-4658-ba51-02adfcfd4a2a was qcow2, converting to raw {{(pid=75229) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 14 09:52:34 user nova-compute[75229]: DEBUG nova.privsep.utils [None req-1903659f-d404-4352-8235-236d9467b6ab tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75229) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 14 09:52:34 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-1903659f-d404-4352-8235-236d9467b6ab tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/d9970b2a3da011a0c3b2a5911c5bbe3e1973d4c7.part /opt/stack/data/nova/instances/_base/d9970b2a3da011a0c3b2a5911c5bbe3e1973d4c7.converted {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:52:34 user nova-compute[75229]: DEBUG nova.network.neutron [None req-1903659f-d404-4352-8235-236d9467b6ab tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] [instance: 564d95eb-81c0-47a5-9979-2318fced06f5] Successfully created port: 81c08c89-9d11-4321-b1c6-d61800dac599 {{(pid=75229) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 09:52:34 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-1903659f-d404-4352-8235-236d9467b6ab tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/d9970b2a3da011a0c3b2a5911c5bbe3e1973d4c7.part /opt/stack/data/nova/instances/_base/d9970b2a3da011a0c3b2a5911c5bbe3e1973d4c7.converted" returned: 0 in 0.510s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:52:34 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-1903659f-d404-4352-8235-236d9467b6ab tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d9970b2a3da011a0c3b2a5911c5bbe3e1973d4c7.converted --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:52:34 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-1903659f-d404-4352-8235-236d9467b6ab tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d9970b2a3da011a0c3b2a5911c5bbe3e1973d4c7.converted --force-share --output=json" returned: 0 in 0.183s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:52:34 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-1903659f-d404-4352-8235-236d9467b6ab tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] Lock "d9970b2a3da011a0c3b2a5911c5bbe3e1973d4c7" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.914s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:52:34 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-1903659f-d404-4352-8235-236d9467b6ab tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d9970b2a3da011a0c3b2a5911c5bbe3e1973d4c7 --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:52:35 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-1903659f-d404-4352-8235-236d9467b6ab tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d9970b2a3da011a0c3b2a5911c5bbe3e1973d4c7 --force-share --output=json" returned: 0 in 0.211s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:52:35 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-1903659f-d404-4352-8235-236d9467b6ab tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] Acquiring lock "d9970b2a3da011a0c3b2a5911c5bbe3e1973d4c7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:52:35 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-1903659f-d404-4352-8235-236d9467b6ab tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] Lock "d9970b2a3da011a0c3b2a5911c5bbe3e1973d4c7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:52:35 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-1903659f-d404-4352-8235-236d9467b6ab tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d9970b2a3da011a0c3b2a5911c5bbe3e1973d4c7 --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:52:35 user nova-compute[75229]: DEBUG nova.network.neutron [None req-1903659f-d404-4352-8235-236d9467b6ab tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] [instance: 564d95eb-81c0-47a5-9979-2318fced06f5] Successfully updated port: 81c08c89-9d11-4321-b1c6-d61800dac599 {{(pid=75229) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 09:52:35 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-1903659f-d404-4352-8235-236d9467b6ab tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] Acquiring lock "refresh_cache-564d95eb-81c0-47a5-9979-2318fced06f5" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 09:52:35 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-1903659f-d404-4352-8235-236d9467b6ab tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] Acquired lock "refresh_cache-564d95eb-81c0-47a5-9979-2318fced06f5" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 09:52:35 user nova-compute[75229]: DEBUG nova.network.neutron [None req-1903659f-d404-4352-8235-236d9467b6ab tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] [instance: 564d95eb-81c0-47a5-9979-2318fced06f5] Building network info cache for instance {{(pid=75229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 09:52:35 user nova-compute[75229]: DEBUG nova.compute.manager [req-3a2f4636-ba67-46c3-a501-2ffe0dd48468 req-a8add7d8-27d1-419b-bf24-dd9ce8aceacd service nova] [instance: 564d95eb-81c0-47a5-9979-2318fced06f5] Received event network-changed-81c08c89-9d11-4321-b1c6-d61800dac599 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:52:35 user nova-compute[75229]: DEBUG nova.compute.manager [req-3a2f4636-ba67-46c3-a501-2ffe0dd48468 req-a8add7d8-27d1-419b-bf24-dd9ce8aceacd service nova] [instance: 564d95eb-81c0-47a5-9979-2318fced06f5] Refreshing instance network info cache due to event network-changed-81c08c89-9d11-4321-b1c6-d61800dac599. {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 09:52:35 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-3a2f4636-ba67-46c3-a501-2ffe0dd48468 req-a8add7d8-27d1-419b-bf24-dd9ce8aceacd service nova] Acquiring lock "refresh_cache-564d95eb-81c0-47a5-9979-2318fced06f5" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 09:52:35 user nova-compute[75229]: DEBUG nova.network.neutron [None req-1903659f-d404-4352-8235-236d9467b6ab tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] [instance: 564d95eb-81c0-47a5-9979-2318fced06f5] Instance cache missing network info. {{(pid=75229) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 09:52:35 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-1903659f-d404-4352-8235-236d9467b6ab tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d9970b2a3da011a0c3b2a5911c5bbe3e1973d4c7 --force-share --output=json" returned: 0 in 0.188s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:52:35 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-1903659f-d404-4352-8235-236d9467b6ab tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d9970b2a3da011a0c3b2a5911c5bbe3e1973d4c7,backing_fmt=raw /opt/stack/data/nova/instances/564d95eb-81c0-47a5-9979-2318fced06f5/disk 1073741824 {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:52:35 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-1903659f-d404-4352-8235-236d9467b6ab tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d9970b2a3da011a0c3b2a5911c5bbe3e1973d4c7,backing_fmt=raw /opt/stack/data/nova/instances/564d95eb-81c0-47a5-9979-2318fced06f5/disk 1073741824" returned: 0 in 0.051s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:52:35 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-1903659f-d404-4352-8235-236d9467b6ab tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] Lock "d9970b2a3da011a0c3b2a5911c5bbe3e1973d4c7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.244s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:52:35 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-1903659f-d404-4352-8235-236d9467b6ab tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d9970b2a3da011a0c3b2a5911c5bbe3e1973d4c7 --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:52:35 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-1903659f-d404-4352-8235-236d9467b6ab tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d9970b2a3da011a0c3b2a5911c5bbe3e1973d4c7 --force-share --output=json" returned: 0 in 0.195s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:52:35 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-1903659f-d404-4352-8235-236d9467b6ab tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] [instance: 564d95eb-81c0-47a5-9979-2318fced06f5] Created local disks {{(pid=75229) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 09:52:35 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-1903659f-d404-4352-8235-236d9467b6ab tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] [instance: 564d95eb-81c0-47a5-9979-2318fced06f5] Ensure instance console log exists: /opt/stack/data/nova/instances/564d95eb-81c0-47a5-9979-2318fced06f5/console.log {{(pid=75229) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 09:52:35 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-1903659f-d404-4352-8235-236d9467b6ab tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:52:35 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-1903659f-d404-4352-8235-236d9467b6ab tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:52:35 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-1903659f-d404-4352-8235-236d9467b6ab tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:52:35 user nova-compute[75229]: DEBUG nova.network.neutron [None req-1903659f-d404-4352-8235-236d9467b6ab tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] [instance: 564d95eb-81c0-47a5-9979-2318fced06f5] Updating instance_info_cache with network_info: [{"id": "81c08c89-9d11-4321-b1c6-d61800dac599", "address": "fa:16:3e:36:da:ae", "network": {"id": "8d89f286-0349-4334-b27a-873f684d3652", "bridge": "br-int", "label": "tempest-TestStampPattern-841799214-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a196548d9de4e18b8bab9fefdab0861", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81c08c89-9d", "ovs_interfaceid": "81c08c89-9d11-4321-b1c6-d61800dac599", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 09:52:35 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-1903659f-d404-4352-8235-236d9467b6ab tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] Releasing lock "refresh_cache-564d95eb-81c0-47a5-9979-2318fced06f5" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 09:52:35 user nova-compute[75229]: DEBUG nova.compute.manager [None req-1903659f-d404-4352-8235-236d9467b6ab tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] [instance: 564d95eb-81c0-47a5-9979-2318fced06f5] Instance network_info: |[{"id": "81c08c89-9d11-4321-b1c6-d61800dac599", "address": "fa:16:3e:36:da:ae", "network": {"id": "8d89f286-0349-4334-b27a-873f684d3652", "bridge": "br-int", "label": "tempest-TestStampPattern-841799214-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a196548d9de4e18b8bab9fefdab0861", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81c08c89-9d", "ovs_interfaceid": "81c08c89-9d11-4321-b1c6-d61800dac599", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75229) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 09:52:35 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-3a2f4636-ba67-46c3-a501-2ffe0dd48468 req-a8add7d8-27d1-419b-bf24-dd9ce8aceacd service nova] Acquired lock "refresh_cache-564d95eb-81c0-47a5-9979-2318fced06f5" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 09:52:35 user nova-compute[75229]: DEBUG nova.network.neutron [req-3a2f4636-ba67-46c3-a501-2ffe0dd48468 req-a8add7d8-27d1-419b-bf24-dd9ce8aceacd service nova] [instance: 564d95eb-81c0-47a5-9979-2318fced06f5] Refreshing network info cache for port 81c08c89-9d11-4321-b1c6-d61800dac599 {{(pid=75229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 09:52:35 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-1903659f-d404-4352-8235-236d9467b6ab tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] [instance: 564d95eb-81c0-47a5-9979-2318fced06f5] Start _get_guest_xml network_info=[{"id": "81c08c89-9d11-4321-b1c6-d61800dac599", "address": "fa:16:3e:36:da:ae", "network": {"id": "8d89f286-0349-4334-b27a-873f684d3652", "bridge": "br-int", "label": "tempest-TestStampPattern-841799214-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a196548d9de4e18b8bab9fefdab0861", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81c08c89-9d", "ovs_interfaceid": "81c08c89-9d11-4321-b1c6-d61800dac599", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='fc84a410f686936813ea8ac662643317',container_format='bare',created_at=2023-11-14T09:52:25Z,direct_url=<?>,disk_format='qcow2',id=219fc96b-99d8-4658-ba51-02adfcfd4a2a,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-1128969294',owner='6a196548d9de4e18b8bab9fefdab0861',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-14T09:52:31Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'disk_bus': 'virtio', 'guest_format': None, 'encryption_secret_uuid': None, 'size': 0, 'device_type': 'disk', 'image_id': '219fc96b-99d8-4658-ba51-02adfcfd4a2a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75229) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 09:52:35 user nova-compute[75229]: WARNING nova.virt.libvirt.driver [None req-1903659f-d404-4352-8235-236d9467b6ab tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 09:52:35 user nova-compute[75229]: WARNING nova.virt.libvirt.driver [None req-1903659f-d404-4352-8235-236d9467b6ab tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 09:52:35 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-1903659f-d404-4352-8235-236d9467b6ab tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75229) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 09:52:35 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-1903659f-d404-4352-8235-236d9467b6ab tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] CPU controller missing on host. {{(pid=75229) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 09:52:35 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-1903659f-d404-4352-8235-236d9467b6ab tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75229) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 09:52:35 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-1903659f-d404-4352-8235-236d9467b6ab tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] CPU controller found on host. {{(pid=75229) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 09:52:35 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-1903659f-d404-4352-8235-236d9467b6ab tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75229) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 09:52:35 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-1903659f-d404-4352-8235-236d9467b6ab tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T09:39:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='fc84a410f686936813ea8ac662643317',container_format='bare',created_at=2023-11-14T09:52:25Z,direct_url=<?>,disk_format='qcow2',id=219fc96b-99d8-4658-ba51-02adfcfd4a2a,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-1128969294',owner='6a196548d9de4e18b8bab9fefdab0861',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-14T09:52:31Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 09:52:35 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-1903659f-d404-4352-8235-236d9467b6ab tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] Flavor limits 0:0:0 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 09:52:35 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-1903659f-d404-4352-8235-236d9467b6ab tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] Image limits 0:0:0 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 09:52:35 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-1903659f-d404-4352-8235-236d9467b6ab tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] Flavor pref 0:0:0 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 09:52:35 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-1903659f-d404-4352-8235-236d9467b6ab tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] Image pref 0:0:0 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 09:52:35 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-1903659f-d404-4352-8235-236d9467b6ab tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 09:52:35 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-1903659f-d404-4352-8235-236d9467b6ab tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 09:52:35 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-1903659f-d404-4352-8235-236d9467b6ab tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75229) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 09:52:35 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-1903659f-d404-4352-8235-236d9467b6ab tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] Got 1 possible topologies {{(pid=75229) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 09:52:35 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-1903659f-d404-4352-8235-236d9467b6ab tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 09:52:35 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-1903659f-d404-4352-8235-236d9467b6ab tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 09:52:35 user nova-compute[75229]: DEBUG nova.virt.libvirt.vif [None req-1903659f-d404-4352-8235-236d9467b6ab tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T09:52:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1367355019',display_name='tempest-TestStampPattern-server-1367355019',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1367355019',id=27,image_ref='219fc96b-99d8-4658-ba51-02adfcfd4a2a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC4/xEtZHm9Yk+8VKGmlmnaP2DqqxnCgXK/PuxMNYGLOnEJxt/VGvxZAFawEytkJILlGgczmBioMsbqPdSyGvSqffIJvSQLFesfq/9wXT8F6tu1JAnyvbNVNg8/xsFVJ6w==',key_name='tempest-TestStampPattern-1732599618',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6a196548d9de4e18b8bab9fefdab0861',ramdisk_id='',reservation_id='r-p8tnzoym',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='a4ce290f-6dd2-44b6-91be-8e775045837e',image_min_disk='1',image_min_ram='0',image_owner_id='6a196548d9de4e18b8bab9fefdab0861',image_owner_project_name='tempest-TestStampPattern-1637982262',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1637982262-project-member',image_user_id='9b525334713e47ceb8f71035116d5c36',network_allocated='True',owner_project_name='tempest-TestStampPattern-1637982262',owner_user_name='tempest-TestStampPattern-1637982262-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T09:52:33Z,user_data=None,user_id='9b525334713e47ceb8f71035116d5c36',uuid=564d95eb-81c0-47a5-9979-2318fced06f5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "81c08c89-9d11-4321-b1c6-d61800dac599", "address": "fa:16:3e:36:da:ae", "network": {"id": "8d89f286-0349-4334-b27a-873f684d3652", "bridge": "br-int", "label": "tempest-TestStampPattern-841799214-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a196548d9de4e18b8bab9fefdab0861", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81c08c89-9d", "ovs_interfaceid": "81c08c89-9d11-4321-b1c6-d61800dac599", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75229) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 09:52:35 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-1903659f-d404-4352-8235-236d9467b6ab tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] Converting VIF {"id": "81c08c89-9d11-4321-b1c6-d61800dac599", "address": "fa:16:3e:36:da:ae", "network": {"id": "8d89f286-0349-4334-b27a-873f684d3652", "bridge": "br-int", "label": "tempest-TestStampPattern-841799214-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a196548d9de4e18b8bab9fefdab0861", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81c08c89-9d", "ovs_interfaceid": "81c08c89-9d11-4321-b1c6-d61800dac599", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 09:52:35 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-1903659f-d404-4352-8235-236d9467b6ab tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:36:da:ae,bridge_name='br-int',has_traffic_filtering=True,id=81c08c89-9d11-4321-b1c6-d61800dac599,network=Network(8d89f286-0349-4334-b27a-873f684d3652),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap81c08c89-9d') {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 09:52:35 user nova-compute[75229]: DEBUG nova.objects.instance [None req-1903659f-d404-4352-8235-236d9467b6ab tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] Lazy-loading 'pci_devices' on Instance uuid 564d95eb-81c0-47a5-9979-2318fced06f5 {{(pid=75229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 09:52:35 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-1903659f-d404-4352-8235-236d9467b6ab tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] [instance: 564d95eb-81c0-47a5-9979-2318fced06f5] End _get_guest_xml xml=<domain type="kvm">
Nov 14 09:52:35 user nova-compute[75229]:   <uuid>564d95eb-81c0-47a5-9979-2318fced06f5</uuid>
Nov 14 09:52:35 user nova-compute[75229]:   <name>instance-0000001b</name>
Nov 14 09:52:35 user nova-compute[75229]:   <memory>524288</memory>
Nov 14 09:52:35 user nova-compute[75229]:   <vcpu>1</vcpu>
Nov 14 09:52:35 user nova-compute[75229]:   <metadata>
Nov 14 09:52:35 user nova-compute[75229]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 09:52:35 user nova-compute[75229]:       <nova:package version="0.0.0"/>
Nov 14 09:52:35 user nova-compute[75229]:       <nova:name>tempest-TestStampPattern-server-1367355019</nova:name>
Nov 14 09:52:35 user nova-compute[75229]:       <nova:creationTime>2023-11-14 09:52:35</nova:creationTime>
Nov 14 09:52:35 user nova-compute[75229]:       <nova:flavor name="m1.tiny">
Nov 14 09:52:35 user nova-compute[75229]:         <nova:memory>512</nova:memory>
Nov 14 09:52:35 user nova-compute[75229]:         <nova:disk>1</nova:disk>
Nov 14 09:52:35 user nova-compute[75229]:         <nova:swap>0</nova:swap>
Nov 14 09:52:35 user nova-compute[75229]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 09:52:35 user nova-compute[75229]:         <nova:vcpus>1</nova:vcpus>
Nov 14 09:52:35 user nova-compute[75229]:       </nova:flavor>
Nov 14 09:52:35 user nova-compute[75229]:       <nova:owner>
Nov 14 09:52:35 user nova-compute[75229]:         <nova:user uuid="9b525334713e47ceb8f71035116d5c36">tempest-TestStampPattern-1637982262-project-member</nova:user>
Nov 14 09:52:35 user nova-compute[75229]:         <nova:project uuid="6a196548d9de4e18b8bab9fefdab0861">tempest-TestStampPattern-1637982262</nova:project>
Nov 14 09:52:35 user nova-compute[75229]:       </nova:owner>
Nov 14 09:52:35 user nova-compute[75229]:       <nova:root type="image" uuid="219fc96b-99d8-4658-ba51-02adfcfd4a2a"/>
Nov 14 09:52:35 user nova-compute[75229]:       <nova:ports>
Nov 14 09:52:35 user nova-compute[75229]:         <nova:port uuid="81c08c89-9d11-4321-b1c6-d61800dac599">
Nov 14 09:52:35 user nova-compute[75229]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 14 09:52:35 user nova-compute[75229]:         </nova:port>
Nov 14 09:52:35 user nova-compute[75229]:       </nova:ports>
Nov 14 09:52:35 user nova-compute[75229]:     </nova:instance>
Nov 14 09:52:35 user nova-compute[75229]:   </metadata>
Nov 14 09:52:35 user nova-compute[75229]:   <sysinfo type="smbios">
Nov 14 09:52:35 user nova-compute[75229]:     <system>
Nov 14 09:52:35 user nova-compute[75229]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 09:52:35 user nova-compute[75229]:       <entry name="product">OpenStack Nova</entry>
Nov 14 09:52:35 user nova-compute[75229]:       <entry name="version">0.0.0</entry>
Nov 14 09:52:35 user nova-compute[75229]:       <entry name="serial">564d95eb-81c0-47a5-9979-2318fced06f5</entry>
Nov 14 09:52:35 user nova-compute[75229]:       <entry name="uuid">564d95eb-81c0-47a5-9979-2318fced06f5</entry>
Nov 14 09:52:35 user nova-compute[75229]:       <entry name="family">Virtual Machine</entry>
Nov 14 09:52:35 user nova-compute[75229]:     </system>
Nov 14 09:52:35 user nova-compute[75229]:   </sysinfo>
Nov 14 09:52:35 user nova-compute[75229]:   <os>
Nov 14 09:52:35 user nova-compute[75229]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 09:52:35 user nova-compute[75229]:     <boot dev="hd"/>
Nov 14 09:52:35 user nova-compute[75229]:     <smbios mode="sysinfo"/>
Nov 14 09:52:35 user nova-compute[75229]:   </os>
Nov 14 09:52:35 user nova-compute[75229]:   <features>
Nov 14 09:52:35 user nova-compute[75229]:     <acpi/>
Nov 14 09:52:35 user nova-compute[75229]:     <apic/>
Nov 14 09:52:35 user nova-compute[75229]:     <vmcoreinfo/>
Nov 14 09:52:35 user nova-compute[75229]:   </features>
Nov 14 09:52:35 user nova-compute[75229]:   <clock offset="utc">
Nov 14 09:52:35 user nova-compute[75229]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 09:52:35 user nova-compute[75229]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 09:52:35 user nova-compute[75229]:     <timer name="hpet" present="no"/>
Nov 14 09:52:35 user nova-compute[75229]:   </clock>
Nov 14 09:52:35 user nova-compute[75229]:   <cpu mode="custom" match="exact">
Nov 14 09:52:35 user nova-compute[75229]:     <model>Nehalem</model>
Nov 14 09:52:35 user nova-compute[75229]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 09:52:35 user nova-compute[75229]:   </cpu>
Nov 14 09:52:35 user nova-compute[75229]:   <devices>
Nov 14 09:52:35 user nova-compute[75229]:     <disk type="file" device="disk">
Nov 14 09:52:35 user nova-compute[75229]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 09:52:35 user nova-compute[75229]:       <source file="/opt/stack/data/nova/instances/564d95eb-81c0-47a5-9979-2318fced06f5/disk"/>
Nov 14 09:52:35 user nova-compute[75229]:       <target dev="vda" bus="virtio"/>
Nov 14 09:52:35 user nova-compute[75229]:     </disk>
Nov 14 09:52:35 user nova-compute[75229]:     <interface type="ethernet">
Nov 14 09:52:35 user nova-compute[75229]:       <mac address="fa:16:3e:36:da:ae"/>
Nov 14 09:52:35 user nova-compute[75229]:       <model type="virtio"/>
Nov 14 09:52:35 user nova-compute[75229]:       <mtu size="1442"/>
Nov 14 09:52:35 user nova-compute[75229]:       <target dev="tap81c08c89-9d"/>
Nov 14 09:52:35 user nova-compute[75229]:     </interface>
Nov 14 09:52:35 user nova-compute[75229]:     <serial type="pty">
Nov 14 09:52:35 user nova-compute[75229]:       <log file="/opt/stack/data/nova/instances/564d95eb-81c0-47a5-9979-2318fced06f5/console.log" append="off"/>
Nov 14 09:52:35 user nova-compute[75229]:     </serial>
Nov 14 09:52:35 user nova-compute[75229]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 09:52:35 user nova-compute[75229]:     <video>
Nov 14 09:52:35 user nova-compute[75229]:       <model type="virtio"/>
Nov 14 09:52:35 user nova-compute[75229]:     </video>
Nov 14 09:52:35 user nova-compute[75229]:     <rng model="virtio">
Nov 14 09:52:35 user nova-compute[75229]:       <backend model="random">/dev/urandom</backend>
Nov 14 09:52:35 user nova-compute[75229]:     </rng>
Nov 14 09:52:35 user nova-compute[75229]:     <controller type="usb" index="0" model="none"/>
Nov 14 09:52:35 user nova-compute[75229]:     <memballoon model="virtio">
Nov 14 09:52:35 user nova-compute[75229]:       <stats period="10"/>
Nov 14 09:52:35 user nova-compute[75229]:     </memballoon>
Nov 14 09:52:35 user nova-compute[75229]:   </devices>
Nov 14 09:52:35 user nova-compute[75229]: </domain>
Nov 14 09:52:35 user nova-compute[75229]:  {{(pid=75229) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 09:52:35 user nova-compute[75229]: DEBUG nova.virt.libvirt.vif [None req-1903659f-d404-4352-8235-236d9467b6ab tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T09:52:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1367355019',display_name='tempest-TestStampPattern-server-1367355019',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1367355019',id=27,image_ref='219fc96b-99d8-4658-ba51-02adfcfd4a2a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC4/xEtZHm9Yk+8VKGmlmnaP2DqqxnCgXK/PuxMNYGLOnEJxt/VGvxZAFawEytkJILlGgczmBioMsbqPdSyGvSqffIJvSQLFesfq/9wXT8F6tu1JAnyvbNVNg8/xsFVJ6w==',key_name='tempest-TestStampPattern-1732599618',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6a196548d9de4e18b8bab9fefdab0861',ramdisk_id='',reservation_id='r-p8tnzoym',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='a4ce290f-6dd2-44b6-91be-8e775045837e',image_min_disk='1',image_min_ram='0',image_owner_id='6a196548d9de4e18b8bab9fefdab0861',image_owner_project_name='tempest-TestStampPattern-1637982262',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1637982262-project-member',image_user_id='9b525334713e47ceb8f71035116d5c36',network_allocated='True',owner_project_name='tempest-TestStampPattern-1637982262',owner_user_name='tempest-TestStampPattern-1637982262-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T09:52:33Z,user_data=None,user_id='9b525334713e47ceb8f71035116d5c36',uuid=564d95eb-81c0-47a5-9979-2318fced06f5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "81c08c89-9d11-4321-b1c6-d61800dac599", "address": "fa:16:3e:36:da:ae", "network": {"id": "8d89f286-0349-4334-b27a-873f684d3652", "bridge": "br-int", "label": "tempest-TestStampPattern-841799214-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a196548d9de4e18b8bab9fefdab0861", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81c08c89-9d", "ovs_interfaceid": "81c08c89-9d11-4321-b1c6-d61800dac599", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 09:52:35 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-1903659f-d404-4352-8235-236d9467b6ab tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] Converting VIF {"id": "81c08c89-9d11-4321-b1c6-d61800dac599", "address": "fa:16:3e:36:da:ae", "network": {"id": "8d89f286-0349-4334-b27a-873f684d3652", "bridge": "br-int", "label": "tempest-TestStampPattern-841799214-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a196548d9de4e18b8bab9fefdab0861", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81c08c89-9d", "ovs_interfaceid": "81c08c89-9d11-4321-b1c6-d61800dac599", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 09:52:35 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-1903659f-d404-4352-8235-236d9467b6ab tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:36:da:ae,bridge_name='br-int',has_traffic_filtering=True,id=81c08c89-9d11-4321-b1c6-d61800dac599,network=Network(8d89f286-0349-4334-b27a-873f684d3652),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap81c08c89-9d') {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 09:52:35 user nova-compute[75229]: DEBUG os_vif [None req-1903659f-d404-4352-8235-236d9467b6ab tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:36:da:ae,bridge_name='br-int',has_traffic_filtering=True,id=81c08c89-9d11-4321-b1c6-d61800dac599,network=Network(8d89f286-0349-4334-b27a-873f684d3652),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap81c08c89-9d') {{(pid=75229) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 09:52:35 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:52:35 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:52:35 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 09:52:35 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:52:35 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8edb4798-c287-599a-b42a-5fa624e191bf', '_type': 'linux-noop'}}, row=False) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:52:35 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:52:35 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:52:35 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:52:35 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap81c08c89-9d, may_exist=True, interface_attrs={}) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:52:35 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap81c08c89-9d, col_values=(('qos', UUID('5819ebf5-def9-44ca-aa3e-eca8a6b785d3')),), if_exists=True) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:52:35 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap81c08c89-9d, col_values=(('external_ids', {'iface-id': '81c08c89-9d11-4321-b1c6-d61800dac599', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:36:da:ae', 'vm-uuid': '564d95eb-81c0-47a5-9979-2318fced06f5'}),), if_exists=True) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:52:35 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:52:35 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 09:52:35 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:52:35 user nova-compute[75229]: INFO os_vif [None req-1903659f-d404-4352-8235-236d9467b6ab tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:36:da:ae,bridge_name='br-int',has_traffic_filtering=True,id=81c08c89-9d11-4321-b1c6-d61800dac599,network=Network(8d89f286-0349-4334-b27a-873f684d3652),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap81c08c89-9d')
Nov 14 09:52:35 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-1903659f-d404-4352-8235-236d9467b6ab tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] No BDM found with device name vda, not building metadata. {{(pid=75229) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 09:52:35 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-1903659f-d404-4352-8235-236d9467b6ab tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] No VIF found with MAC fa:16:3e:36:da:ae, not building metadata {{(pid=75229) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 09:52:35 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-76645a83-9d4e-493c-b66b-f163587e840d tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Acquiring lock "be813b28-133f-416a-b2b5-dc0b9e4064b7" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:52:35 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-76645a83-9d4e-493c-b66b-f163587e840d tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Lock "be813b28-133f-416a-b2b5-dc0b9e4064b7" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:52:35 user nova-compute[75229]: INFO nova.compute.manager [None req-76645a83-9d4e-493c-b66b-f163587e840d tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] [instance: be813b28-133f-416a-b2b5-dc0b9e4064b7] Detaching volume a7902ab8-168d-4c8a-90e9-bf44d669ce2b
Nov 14 09:52:36 user nova-compute[75229]: INFO nova.virt.block_device [None req-76645a83-9d4e-493c-b66b-f163587e840d tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] [instance: be813b28-133f-416a-b2b5-dc0b9e4064b7] Attempting to driver detach volume a7902ab8-168d-4c8a-90e9-bf44d669ce2b from mountpoint /dev/vdb
Nov 14 09:52:36 user nova-compute[75229]: DEBUG nova.network.neutron [req-3a2f4636-ba67-46c3-a501-2ffe0dd48468 req-a8add7d8-27d1-419b-bf24-dd9ce8aceacd service nova] [instance: 564d95eb-81c0-47a5-9979-2318fced06f5] Updated VIF entry in instance network info cache for port 81c08c89-9d11-4321-b1c6-d61800dac599. {{(pid=75229) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 09:52:36 user nova-compute[75229]: DEBUG nova.network.neutron [req-3a2f4636-ba67-46c3-a501-2ffe0dd48468 req-a8add7d8-27d1-419b-bf24-dd9ce8aceacd service nova] [instance: 564d95eb-81c0-47a5-9979-2318fced06f5] Updating instance_info_cache with network_info: [{"id": "81c08c89-9d11-4321-b1c6-d61800dac599", "address": "fa:16:3e:36:da:ae", "network": {"id": "8d89f286-0349-4334-b27a-873f684d3652", "bridge": "br-int", "label": "tempest-TestStampPattern-841799214-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a196548d9de4e18b8bab9fefdab0861", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81c08c89-9d", "ovs_interfaceid": "81c08c89-9d11-4321-b1c6-d61800dac599", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 09:52:36 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-76645a83-9d4e-493c-b66b-f163587e840d tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Attempting to detach device vdb from instance be813b28-133f-416a-b2b5-dc0b9e4064b7 from the persistent domain config. {{(pid=75229) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 09:52:36 user nova-compute[75229]: DEBUG nova.virt.libvirt.guest [None req-76645a83-9d4e-493c-b66b-f163587e840d tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 09:52:36 user nova-compute[75229]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 09:52:36 user nova-compute[75229]:   <source dev="/dev/sdb"/>
Nov 14 09:52:36 user nova-compute[75229]:   <target dev="vdb" bus="virtio"/>
Nov 14 09:52:36 user nova-compute[75229]:   <serial>a7902ab8-168d-4c8a-90e9-bf44d669ce2b</serial>
Nov 14 09:52:36 user nova-compute[75229]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 14 09:52:36 user nova-compute[75229]: </disk>
Nov 14 09:52:36 user nova-compute[75229]:  {{(pid=75229) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 09:52:36 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-3a2f4636-ba67-46c3-a501-2ffe0dd48468 req-a8add7d8-27d1-419b-bf24-dd9ce8aceacd service nova] Releasing lock "refresh_cache-564d95eb-81c0-47a5-9979-2318fced06f5" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 09:52:36 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-76645a83-9d4e-493c-b66b-f163587e840d tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Successfully detached device vdb from instance be813b28-133f-416a-b2b5-dc0b9e4064b7 from the persistent domain config.
Nov 14 09:52:36 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-76645a83-9d4e-493c-b66b-f163587e840d tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance be813b28-133f-416a-b2b5-dc0b9e4064b7 from the live domain config. {{(pid=75229) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 09:52:36 user nova-compute[75229]: DEBUG nova.virt.libvirt.guest [None req-76645a83-9d4e-493c-b66b-f163587e840d tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 09:52:36 user nova-compute[75229]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 09:52:36 user nova-compute[75229]:   <source dev="/dev/sdb"/>
Nov 14 09:52:36 user nova-compute[75229]:   <target dev="vdb" bus="virtio"/>
Nov 14 09:52:36 user nova-compute[75229]:   <serial>a7902ab8-168d-4c8a-90e9-bf44d669ce2b</serial>
Nov 14 09:52:36 user nova-compute[75229]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 14 09:52:36 user nova-compute[75229]: </disk>
Nov 14 09:52:36 user nova-compute[75229]:  {{(pid=75229) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 09:52:36 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-76645a83-9d4e-493c-b66b-f163587e840d tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance be813b28-133f-416a-b2b5-dc0b9e4064b7 {{(pid=75229) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 09:52:37 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:52:37 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:52:37 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:52:37 user nova-compute[75229]: DEBUG nova.compute.manager [req-6fc8cd36-4814-49a6-b32f-6e7b210c29cf req-31d10f6c-a9f3-4c96-a140-2063066c1a35 service nova] [instance: 564d95eb-81c0-47a5-9979-2318fced06f5] Received event network-vif-plugged-81c08c89-9d11-4321-b1c6-d61800dac599 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:52:37 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-6fc8cd36-4814-49a6-b32f-6e7b210c29cf req-31d10f6c-a9f3-4c96-a140-2063066c1a35 service nova] Acquiring lock "564d95eb-81c0-47a5-9979-2318fced06f5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:52:37 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-6fc8cd36-4814-49a6-b32f-6e7b210c29cf req-31d10f6c-a9f3-4c96-a140-2063066c1a35 service nova] Lock "564d95eb-81c0-47a5-9979-2318fced06f5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:52:37 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-6fc8cd36-4814-49a6-b32f-6e7b210c29cf req-31d10f6c-a9f3-4c96-a140-2063066c1a35 service nova] Lock "564d95eb-81c0-47a5-9979-2318fced06f5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:52:37 user nova-compute[75229]: DEBUG nova.compute.manager [req-6fc8cd36-4814-49a6-b32f-6e7b210c29cf req-31d10f6c-a9f3-4c96-a140-2063066c1a35 service nova] [instance: 564d95eb-81c0-47a5-9979-2318fced06f5] No waiting events found dispatching network-vif-plugged-81c08c89-9d11-4321-b1c6-d61800dac599 {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 09:52:37 user nova-compute[75229]: WARNING nova.compute.manager [req-6fc8cd36-4814-49a6-b32f-6e7b210c29cf req-31d10f6c-a9f3-4c96-a140-2063066c1a35 service nova] [instance: 564d95eb-81c0-47a5-9979-2318fced06f5] Received unexpected event network-vif-plugged-81c08c89-9d11-4321-b1c6-d61800dac599 for instance with vm_state building and task_state spawning.
Nov 14 09:52:37 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:52:37 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:52:38 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:52:39 user nova-compute[75229]: DEBUG nova.compute.manager [None req-1903659f-d404-4352-8235-236d9467b6ab tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] [instance: 564d95eb-81c0-47a5-9979-2318fced06f5] Instance event wait completed in 0 seconds for  {{(pid=75229) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 09:52:39 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-1903659f-d404-4352-8235-236d9467b6ab tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] [instance: 564d95eb-81c0-47a5-9979-2318fced06f5] Guest created on hypervisor {{(pid=75229) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 09:52:39 user nova-compute[75229]: INFO nova.virt.libvirt.driver [-] [instance: 564d95eb-81c0-47a5-9979-2318fced06f5] Instance spawned successfully.
Nov 14 09:52:39 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-1903659f-d404-4352-8235-236d9467b6ab tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] [instance: 564d95eb-81c0-47a5-9979-2318fced06f5] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 09:52:39 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-1903659f-d404-4352-8235-236d9467b6ab tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] [instance: 564d95eb-81c0-47a5-9979-2318fced06f5] Found default for hw_input_bus of None {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 09:52:39 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-1903659f-d404-4352-8235-236d9467b6ab tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] [instance: 564d95eb-81c0-47a5-9979-2318fced06f5] Found default for hw_pointer_model of None {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 09:52:39 user nova-compute[75229]: INFO nova.compute.manager [None req-1903659f-d404-4352-8235-236d9467b6ab tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] [instance: 564d95eb-81c0-47a5-9979-2318fced06f5] Took 6.60 seconds to spawn the instance on the hypervisor.
Nov 14 09:52:39 user nova-compute[75229]: DEBUG nova.compute.manager [None req-1903659f-d404-4352-8235-236d9467b6ab tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] [instance: 564d95eb-81c0-47a5-9979-2318fced06f5] Checking state {{(pid=75229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 09:52:39 user nova-compute[75229]: DEBUG nova.compute.manager [req-f9b128ce-99b8-4141-8361-75f5fb629233 req-994aa9c2-7690-4b56-ab95-bfd40d8c1f98 service nova] [instance: 564d95eb-81c0-47a5-9979-2318fced06f5] Received event network-vif-plugged-81c08c89-9d11-4321-b1c6-d61800dac599 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:52:39 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-f9b128ce-99b8-4141-8361-75f5fb629233 req-994aa9c2-7690-4b56-ab95-bfd40d8c1f98 service nova] Acquiring lock "564d95eb-81c0-47a5-9979-2318fced06f5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:52:39 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-f9b128ce-99b8-4141-8361-75f5fb629233 req-994aa9c2-7690-4b56-ab95-bfd40d8c1f98 service nova] Lock "564d95eb-81c0-47a5-9979-2318fced06f5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:52:39 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-f9b128ce-99b8-4141-8361-75f5fb629233 req-994aa9c2-7690-4b56-ab95-bfd40d8c1f98 service nova] Lock "564d95eb-81c0-47a5-9979-2318fced06f5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:52:39 user nova-compute[75229]: DEBUG nova.compute.manager [req-f9b128ce-99b8-4141-8361-75f5fb629233 req-994aa9c2-7690-4b56-ab95-bfd40d8c1f98 service nova] [instance: 564d95eb-81c0-47a5-9979-2318fced06f5] No waiting events found dispatching network-vif-plugged-81c08c89-9d11-4321-b1c6-d61800dac599 {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 09:52:39 user nova-compute[75229]: WARNING nova.compute.manager [req-f9b128ce-99b8-4141-8361-75f5fb629233 req-994aa9c2-7690-4b56-ab95-bfd40d8c1f98 service nova] [instance: 564d95eb-81c0-47a5-9979-2318fced06f5] Received unexpected event network-vif-plugged-81c08c89-9d11-4321-b1c6-d61800dac599 for instance with vm_state building and task_state spawning.
Nov 14 09:52:39 user nova-compute[75229]: INFO nova.compute.manager [None req-1903659f-d404-4352-8235-236d9467b6ab tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] [instance: 564d95eb-81c0-47a5-9979-2318fced06f5] Took 7.43 seconds to build instance.
Nov 14 09:52:39 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-1903659f-d404-4352-8235-236d9467b6ab tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] Lock "564d95eb-81c0-47a5-9979-2318fced06f5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.550s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:52:40 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-86b43064-6890-4dd7-9397-8d37b68fdc15 tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] Acquiring lock "a60d339f-e134-477c-8505-bf8c79d2a21c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:52:40 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-86b43064-6890-4dd7-9397-8d37b68fdc15 tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] Lock "a60d339f-e134-477c-8505-bf8c79d2a21c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:52:40 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-86b43064-6890-4dd7-9397-8d37b68fdc15 tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] Acquiring lock "a60d339f-e134-477c-8505-bf8c79d2a21c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:52:40 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-86b43064-6890-4dd7-9397-8d37b68fdc15 tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] Lock "a60d339f-e134-477c-8505-bf8c79d2a21c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:52:40 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-86b43064-6890-4dd7-9397-8d37b68fdc15 tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] Lock "a60d339f-e134-477c-8505-bf8c79d2a21c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:52:40 user nova-compute[75229]: INFO nova.compute.manager [None req-86b43064-6890-4dd7-9397-8d37b68fdc15 tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] [instance: a60d339f-e134-477c-8505-bf8c79d2a21c] Terminating instance
Nov 14 09:52:40 user nova-compute[75229]: DEBUG nova.compute.manager [None req-86b43064-6890-4dd7-9397-8d37b68fdc15 tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] [instance: a60d339f-e134-477c-8505-bf8c79d2a21c] Start destroying the instance on the hypervisor. {{(pid=75229) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 09:52:40 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:52:40 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:52:40 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:52:40 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:52:40 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:52:41 user nova-compute[75229]: INFO nova.virt.libvirt.driver [-] [instance: a60d339f-e134-477c-8505-bf8c79d2a21c] Instance destroyed successfully.
Nov 14 09:52:41 user nova-compute[75229]: DEBUG nova.objects.instance [None req-86b43064-6890-4dd7-9397-8d37b68fdc15 tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] Lazy-loading 'resources' on Instance uuid a60d339f-e134-477c-8505-bf8c79d2a21c {{(pid=75229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 09:52:41 user nova-compute[75229]: DEBUG nova.virt.libvirt.vif [None req-86b43064-6890-4dd7-9397-8d37b68fdc15 tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T09:43:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-285833760',display_name='tempest-ServerActionsTestOtherB-server-285833760',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-285833760',id=5,image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLBqRiXBmoqcQBqBQflJnJ0Bni+p+JlFtve2BlM0X9wLvjWsKzu7TCQo3Ot5hzNFvzwCz/gEUspFHpyxxEkScMIm/fUvYWhxYR4DsojCDDatjjGg5V63rlfYUre+iymhFw==',key_name='tempest-keypair-1362974744',keypairs=<?>,launch_index=0,launched_at=2023-11-14T09:50:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='32e17c7c586542139cdbc5bfda57e075',ramdisk_id='',reservation_id='r-vw8kxtrn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherB-45710955',owner_user_name='tempest-ServerActionsTestOtherB-45710955-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T09:50:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='39c6903e2d154e838835eb5265776521',uuid=a60d339f-e134-477c-8505-bf8c79d2a21c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cb98fc47-7b69-4bde-9a4c-717cd44ba908", "address": "fa:16:3e:6c:f4:6d", "network": {"id": "2b667d50-4579-4453-b4d3-a818a0d2c6fc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1719812180-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.24", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32e17c7c586542139cdbc5bfda57e075", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb98fc47-7b", "ovs_interfaceid": "cb98fc47-7b69-4bde-9a4c-717cd44ba908", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 09:52:41 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-86b43064-6890-4dd7-9397-8d37b68fdc15 tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] Converting VIF {"id": "cb98fc47-7b69-4bde-9a4c-717cd44ba908", "address": "fa:16:3e:6c:f4:6d", "network": {"id": "2b667d50-4579-4453-b4d3-a818a0d2c6fc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1719812180-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.24", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32e17c7c586542139cdbc5bfda57e075", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb98fc47-7b", "ovs_interfaceid": "cb98fc47-7b69-4bde-9a4c-717cd44ba908", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 09:52:41 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-86b43064-6890-4dd7-9397-8d37b68fdc15 tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6c:f4:6d,bridge_name='br-int',has_traffic_filtering=True,id=cb98fc47-7b69-4bde-9a4c-717cd44ba908,network=Network(2b667d50-4579-4453-b4d3-a818a0d2c6fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb98fc47-7b') {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 09:52:41 user nova-compute[75229]: DEBUG os_vif [None req-86b43064-6890-4dd7-9397-8d37b68fdc15 tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6c:f4:6d,bridge_name='br-int',has_traffic_filtering=True,id=cb98fc47-7b69-4bde-9a4c-717cd44ba908,network=Network(2b667d50-4579-4453-b4d3-a818a0d2c6fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb98fc47-7b') {{(pid=75229) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 09:52:41 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:52:41 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcb98fc47-7b, bridge=br-int, if_exists=True) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:52:41 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:52:41 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 09:52:41 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:52:41 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c397fc03-06f7-41c4-ad05-ae462c9d324a) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:52:41 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:52:41 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 09:52:41 user nova-compute[75229]: INFO os_vif [None req-86b43064-6890-4dd7-9397-8d37b68fdc15 tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6c:f4:6d,bridge_name='br-int',has_traffic_filtering=True,id=cb98fc47-7b69-4bde-9a4c-717cd44ba908,network=Network(2b667d50-4579-4453-b4d3-a818a0d2c6fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb98fc47-7b')
Nov 14 09:52:41 user nova-compute[75229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-86b43064-6890-4dd7-9397-8d37b68fdc15 tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] [instance: a60d339f-e134-477c-8505-bf8c79d2a21c] calling os-brick to detach iSCSI Volume {{(pid=75229) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 09:52:41 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-86b43064-6890-4dd7-9397-8d37b68fdc15 tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f73f85151b0>, {'target_iqn': 'iqn.2010-10.org.openstack:aca09258-022b-4f04-b418-f2a170332755', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BrhyGdAv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 09:52:41 user nova-compute[75229]: WARNING os_brick.initiator.connectors.base [None req-86b43064-6890-4dd7-9397-8d37b68fdc15 tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 09:52:41 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-86b43064-6890-4dd7-9397-8d37b68fdc15 tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 09:52:41 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-86b43064-6890-4dd7-9397-8d37b68fdc15 tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 09:52:41 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:52:41 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:52:41 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[88d817c8-0bc6-4a02-9859-33ceff3760a4]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2bae4836-52c2-428b-b299-a6a72899197d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:aca09258-022b-4f04-b418-f2a170332755\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a7902ab8-168d-4c8a-90e9-bf44d669ce2b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b590f04d-8a50-4810-8e66-05d846f4613f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:52:41 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-86b43064-6890-4dd7-9397-8d37b68fdc15 tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 09:52:41 user nova-compute[75229]: No targets found.
Nov 14 09:52:41 user nova-compute[75229]: iSNS:
Nov 14 09:52:41 user nova-compute[75229]: No targets found.
Nov 14 09:52:41 user nova-compute[75229]: STATIC:
Nov 14 09:52:41 user nova-compute[75229]: Target: iqn.2010-10.org.openstack:2bae4836-52c2-428b-b299-a6a72899197d
Nov 14 09:52:41 user nova-compute[75229]:         Portal: 172.16.0.220:3260,-1
Nov 14 09:52:41 user nova-compute[75229]:                 Iface Name: default
Nov 14 09:52:41 user nova-compute[75229]: Target: iqn.2010-10.org.openstack:aca09258-022b-4f04-b418-f2a170332755
Nov 14 09:52:41 user nova-compute[75229]:         Portal: 172.16.0.220:3260,-1
Nov 14 09:52:41 user nova-compute[75229]:                 Iface Name: default
Nov 14 09:52:41 user nova-compute[75229]: Target: iqn.2010-10.org.openstack:a7902ab8-168d-4c8a-90e9-bf44d669ce2b
Nov 14 09:52:41 user nova-compute[75229]:         Portal: 172.16.0.220:3260,-1
Nov 14 09:52:41 user nova-compute[75229]:                 Iface Name: default
Nov 14 09:52:41 user nova-compute[75229]: Target: iqn.2010-10.org.openstack:b590f04d-8a50-4810-8e66-05d846f4613f
Nov 14 09:52:41 user nova-compute[75229]:         Portal: 172.16.0.220:3260,-1
Nov 14 09:52:41 user nova-compute[75229]:                 Iface Name: default
Nov 14 09:52:41 user nova-compute[75229]: FIRMWARE:
Nov 14 09:52:41 user nova-compute[75229]: No targets found.
Nov 14 09:52:41 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 09:52:41 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-86b43064-6890-4dd7-9397-8d37b68fdc15 tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 09:52:41 user nova-compute[75229]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 09:52:41 user nova-compute[75229]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75229) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 09:52:41 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-86b43064-6890-4dd7-9397-8d37b68fdc15 tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:aca09258-022b-4f04-b418-f2a170332755', 0)] {{(pid=75229) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 09:52:41 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:52:41 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:52:41 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c1669ae-c4be-4f35-a553-fd403d76bc85]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2bae4836-52c2-428b-b299-a6a72899197d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a7902ab8-168d-4c8a-90e9-bf44d669ce2b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aca09258-022b-4f04-b418-f2a170332755\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b590f04d-8a50-4810-8e66-05d846f4613f\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:52:41 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:52:41 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:52:41 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8a95f58-3f56-4fbf-bedf-978cff3120a9]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7902ab8-168d-4c8a-90e9-bf44d669ce2b (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aca09258-022b-4f04-b418-f2a170332755 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bae4836-52c2-428b-b299-a6a72899197d (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b590f04d-8a50-4810-8e66-05d846f4613f (non-flash)\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:52:41 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-86b43064-6890-4dd7-9397-8d37b68fdc15 tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7902ab8-168d-4c8a-90e9-bf44d669ce2b (non-flash)
Nov 14 09:52:41 user nova-compute[75229]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aca09258-022b-4f04-b418-f2a170332755 (non-flash)
Nov 14 09:52:41 user nova-compute[75229]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bae4836-52c2-428b-b299-a6a72899197d (non-flash)
Nov 14 09:52:41 user nova-compute[75229]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b590f04d-8a50-4810-8e66-05d846f4613f (non-flash)
Nov 14 09:52:41 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 09:52:41 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-86b43064-6890-4dd7-9397-8d37b68fdc15 tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7902ab8-168d-4c8a-90e9-bf44d669ce2b (non-flash)
Nov 14 09:52:41 user nova-compute[75229]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aca09258-022b-4f04-b418-f2a170332755 (non-flash)
Nov 14 09:52:41 user nova-compute[75229]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bae4836-52c2-428b-b299-a6a72899197d (non-flash)
Nov 14 09:52:41 user nova-compute[75229]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b590f04d-8a50-4810-8e66-05d846f4613f (non-flash)
Nov 14 09:52:41 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 09:52:41 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-86b43064-6890-4dd7-9397-8d37b68fdc15 tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f73f825b250>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:aca09258-022b-4f04-b418-f2a170332755'): ({'sdd'}, set())}) {{(pid=75229) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 09:52:41 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-86b43064-6890-4dd7-9397-8d37b68fdc15 tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] Removing single pathed devices sdd {{(pid=75229) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 09:52:41 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:52:41 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:52:41 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae1fe1c2-93c1-4a70-b797-76d9db80007d]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:52:41 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:52:41 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.025s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:52:41 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[4865c700-1536-431d-bfe0-6d955ece4c6e]: (4, ('ok\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:52:41 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-86b43064-6890-4dd7-9397-8d37b68fdc15 tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] Flushing IO for device /dev/sdd {{(pid=75229) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 09:52:41 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:52:41 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:52:41 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[da6719ac-f432-49ad-bd6f-c2ad8b4bd3be]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:52:41 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-86b43064-6890-4dd7-9397-8d37b68fdc15 tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75229) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 09:52:41 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:52:41 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.039s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:52:41 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[32e75ecf-6ce3-408e-a11a-575d7e5b995c]: (4, ('1', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:52:41 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-86b43064-6890-4dd7-9397-8d37b68fdc15 tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75229) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 09:52:41 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-86b43064-6890-4dd7-9397-8d37b68fdc15 tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] SCSI volumes sdd have been removed. {{(pid=75229) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 09:52:41 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-86b43064-6890-4dd7-9397-8d37b68fdc15 tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:aca09258-022b-4f04-b418-f2a170332755')] {{(pid=75229) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 09:52:41 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aca09258-022b-4f04-b418-f2a170332755 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:52:41 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aca09258-022b-4f04-b418-f2a170332755 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:52:41 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[052b9af9-0e38-42d8-9be9-6a3d45f72bfb]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:52:41 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-86b43064-6890-4dd7-9397-8d37b68fdc15 tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:52:41 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aca09258-022b-4f04-b418-f2a170332755 -p 172.16.0.220:3260 --logout {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:52:41 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aca09258-022b-4f04-b418-f2a170332755 -p 172.16.0.220:3260 --logout" returned: 0 in 0.079s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:52:41 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b382431-c71c-4b7a-b995-47fbccdc3e77]: (4, ('Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:aca09258-022b-4f04-b418-f2a170332755, portal: 172.16.0.220,3260]\nLogout of [sid: 23, target: iqn.2010-10.org.openstack:aca09258-022b-4f04-b418-f2a170332755, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:52:41 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-86b43064-6890-4dd7-9397-8d37b68fdc15 tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:aca09258-022b-4f04-b418-f2a170332755, portal: 172.16.0.220,3260]
Nov 14 09:52:41 user nova-compute[75229]: Logout of [sid: 23, target: iqn.2010-10.org.openstack:aca09258-022b-4f04-b418-f2a170332755, portal: 172.16.0.220,3260] successful.
Nov 14 09:52:41 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:52:41 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aca09258-022b-4f04-b418-f2a170332755 -p 172.16.0.220:3260 --op delete {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:52:41 user nova-compute[75229]: DEBUG nova.compute.manager [req-0778db10-92c1-4cde-82c4-50ddc98a41cd req-720aa65c-15c7-47ff-b45a-f22067a682f4 service nova] [instance: a60d339f-e134-477c-8505-bf8c79d2a21c] Received event network-vif-unplugged-cb98fc47-7b69-4bde-9a4c-717cd44ba908 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:52:41 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-0778db10-92c1-4cde-82c4-50ddc98a41cd req-720aa65c-15c7-47ff-b45a-f22067a682f4 service nova] Acquiring lock "a60d339f-e134-477c-8505-bf8c79d2a21c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:52:41 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-0778db10-92c1-4cde-82c4-50ddc98a41cd req-720aa65c-15c7-47ff-b45a-f22067a682f4 service nova] Lock "a60d339f-e134-477c-8505-bf8c79d2a21c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:52:41 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-0778db10-92c1-4cde-82c4-50ddc98a41cd req-720aa65c-15c7-47ff-b45a-f22067a682f4 service nova] Lock "a60d339f-e134-477c-8505-bf8c79d2a21c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:52:41 user nova-compute[75229]: DEBUG nova.compute.manager [req-0778db10-92c1-4cde-82c4-50ddc98a41cd req-720aa65c-15c7-47ff-b45a-f22067a682f4 service nova] [instance: a60d339f-e134-477c-8505-bf8c79d2a21c] No waiting events found dispatching network-vif-unplugged-cb98fc47-7b69-4bde-9a4c-717cd44ba908 {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 09:52:41 user nova-compute[75229]: DEBUG nova.compute.manager [req-0778db10-92c1-4cde-82c4-50ddc98a41cd req-720aa65c-15c7-47ff-b45a-f22067a682f4 service nova] [instance: a60d339f-e134-477c-8505-bf8c79d2a21c] Received event network-vif-unplugged-cb98fc47-7b69-4bde-9a4c-717cd44ba908 for instance with task_state deleting. {{(pid=75229) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 09:52:41 user nova-compute[75229]: DEBUG nova.compute.manager [req-0778db10-92c1-4cde-82c4-50ddc98a41cd req-720aa65c-15c7-47ff-b45a-f22067a682f4 service nova] [instance: a60d339f-e134-477c-8505-bf8c79d2a21c] Received event network-vif-plugged-cb98fc47-7b69-4bde-9a4c-717cd44ba908 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:52:41 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-0778db10-92c1-4cde-82c4-50ddc98a41cd req-720aa65c-15c7-47ff-b45a-f22067a682f4 service nova] Acquiring lock "a60d339f-e134-477c-8505-bf8c79d2a21c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:52:41 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-0778db10-92c1-4cde-82c4-50ddc98a41cd req-720aa65c-15c7-47ff-b45a-f22067a682f4 service nova] Lock "a60d339f-e134-477c-8505-bf8c79d2a21c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:52:41 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-0778db10-92c1-4cde-82c4-50ddc98a41cd req-720aa65c-15c7-47ff-b45a-f22067a682f4 service nova] Lock "a60d339f-e134-477c-8505-bf8c79d2a21c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:52:41 user nova-compute[75229]: DEBUG nova.compute.manager [req-0778db10-92c1-4cde-82c4-50ddc98a41cd req-720aa65c-15c7-47ff-b45a-f22067a682f4 service nova] [instance: a60d339f-e134-477c-8505-bf8c79d2a21c] No waiting events found dispatching network-vif-plugged-cb98fc47-7b69-4bde-9a4c-717cd44ba908 {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 09:52:41 user nova-compute[75229]: WARNING nova.compute.manager [req-0778db10-92c1-4cde-82c4-50ddc98a41cd req-720aa65c-15c7-47ff-b45a-f22067a682f4 service nova] [instance: a60d339f-e134-477c-8505-bf8c79d2a21c] Received unexpected event network-vif-plugged-cb98fc47-7b69-4bde-9a4c-717cd44ba908 for instance with vm_state active and task_state deleting.
Nov 14 09:52:41 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aca09258-022b-4f04-b418-f2a170332755 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:52:41 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[1aefa76f-a336-4f90-952d-6d95113b477e]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:52:41 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-86b43064-6890-4dd7-9397-8d37b68fdc15 tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:52:41 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-86b43064-6890-4dd7-9397-8d37b68fdc15 tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.343s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 09:52:41 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-86b43064-6890-4dd7-9397-8d37b68fdc15 tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] <== disconnect_volume: return (345ms) None {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 09:52:41 user nova-compute[75229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-86b43064-6890-4dd7-9397-8d37b68fdc15 tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] [instance: a60d339f-e134-477c-8505-bf8c79d2a21c] Disconnected iSCSI Volume {{(pid=75229) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 09:52:41 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-86b43064-6890-4dd7-9397-8d37b68fdc15 tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] [instance: a60d339f-e134-477c-8505-bf8c79d2a21c] Deleting instance files /opt/stack/data/nova/instances/a60d339f-e134-477c-8505-bf8c79d2a21c_del
Nov 14 09:52:41 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-86b43064-6890-4dd7-9397-8d37b68fdc15 tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] [instance: a60d339f-e134-477c-8505-bf8c79d2a21c] Deletion of /opt/stack/data/nova/instances/a60d339f-e134-477c-8505-bf8c79d2a21c_del complete
Nov 14 09:52:41 user nova-compute[75229]: INFO nova.compute.manager [None req-86b43064-6890-4dd7-9397-8d37b68fdc15 tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] [instance: a60d339f-e134-477c-8505-bf8c79d2a21c] Took 1.26 seconds to destroy the instance on the hypervisor.
Nov 14 09:52:41 user nova-compute[75229]: DEBUG oslo.service.loopingcall [None req-86b43064-6890-4dd7-9397-8d37b68fdc15 tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75229) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 09:52:41 user nova-compute[75229]: DEBUG nova.compute.manager [-] [instance: a60d339f-e134-477c-8505-bf8c79d2a21c] Deallocating network for instance {{(pid=75229) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 09:52:41 user nova-compute[75229]: DEBUG nova.network.neutron [-] [instance: a60d339f-e134-477c-8505-bf8c79d2a21c] deallocate_for_instance() {{(pid=75229) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 09:52:42 user nova-compute[75229]: DEBUG nova.network.neutron [-] [instance: a60d339f-e134-477c-8505-bf8c79d2a21c] Updating instance_info_cache with network_info: [] {{(pid=75229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 09:52:42 user nova-compute[75229]: INFO nova.compute.manager [-] [instance: a60d339f-e134-477c-8505-bf8c79d2a21c] Took 0.90 seconds to deallocate network for instance.
Nov 14 09:52:42 user nova-compute[75229]: DEBUG nova.compute.manager [req-d9f71c5f-36d5-49b2-9b07-ff3f1827a944 req-152552d4-e4cb-49bb-8955-32dc7d3f06cb service nova] [instance: a60d339f-e134-477c-8505-bf8c79d2a21c] Received event network-vif-deleted-cb98fc47-7b69-4bde-9a4c-717cd44ba908 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:52:43 user nova-compute[75229]: INFO nova.compute.manager [None req-86b43064-6890-4dd7-9397-8d37b68fdc15 tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] [instance: a60d339f-e134-477c-8505-bf8c79d2a21c] Took 0.75 seconds to detach 1 volumes for instance.
Nov 14 09:52:43 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-86b43064-6890-4dd7-9397-8d37b68fdc15 tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:52:43 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-86b43064-6890-4dd7-9397-8d37b68fdc15 tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:52:43 user nova-compute[75229]: DEBUG nova.compute.provider_tree [None req-86b43064-6890-4dd7-9397-8d37b68fdc15 tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] Inventory has not changed in ProviderTree for provider: d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 {{(pid=75229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 09:52:43 user nova-compute[75229]: DEBUG nova.scheduler.client.report [None req-86b43064-6890-4dd7-9397-8d37b68fdc15 tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] Inventory has not changed for provider d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 09:52:44 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-86b43064-6890-4dd7-9397-8d37b68fdc15 tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.452s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:52:44 user nova-compute[75229]: INFO nova.scheduler.client.report [None req-86b43064-6890-4dd7-9397-8d37b68fdc15 tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] Deleted allocations for instance a60d339f-e134-477c-8505-bf8c79d2a21c
Nov 14 09:52:44 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-86b43064-6890-4dd7-9397-8d37b68fdc15 tempest-ServerActionsTestOtherB-45710955 tempest-ServerActionsTestOtherB-45710955-project-member] Lock "a60d339f-e134-477c-8505-bf8c79d2a21c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.672s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:52:44 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-c25a03ba-4af2-4c6c-bab0-688b8c9871ea tempest-ServersNegativeTestJSON-1483105767 tempest-ServersNegativeTestJSON-1483105767-project-member] Acquiring lock "cc486509-4506-415c-a2b4-986d05da2317" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:52:44 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-c25a03ba-4af2-4c6c-bab0-688b8c9871ea tempest-ServersNegativeTestJSON-1483105767 tempest-ServersNegativeTestJSON-1483105767-project-member] Lock "cc486509-4506-415c-a2b4-986d05da2317" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:52:44 user nova-compute[75229]: DEBUG nova.compute.manager [None req-c25a03ba-4af2-4c6c-bab0-688b8c9871ea tempest-ServersNegativeTestJSON-1483105767 tempest-ServersNegativeTestJSON-1483105767-project-member] [instance: cc486509-4506-415c-a2b4-986d05da2317] Starting instance... {{(pid=75229) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 09:52:44 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-c25a03ba-4af2-4c6c-bab0-688b8c9871ea tempest-ServersNegativeTestJSON-1483105767 tempest-ServersNegativeTestJSON-1483105767-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:52:44 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-c25a03ba-4af2-4c6c-bab0-688b8c9871ea tempest-ServersNegativeTestJSON-1483105767 tempest-ServersNegativeTestJSON-1483105767-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:52:44 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-c25a03ba-4af2-4c6c-bab0-688b8c9871ea tempest-ServersNegativeTestJSON-1483105767 tempest-ServersNegativeTestJSON-1483105767-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75229) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 09:52:44 user nova-compute[75229]: INFO nova.compute.claims [None req-c25a03ba-4af2-4c6c-bab0-688b8c9871ea tempest-ServersNegativeTestJSON-1483105767 tempest-ServersNegativeTestJSON-1483105767-project-member] [instance: cc486509-4506-415c-a2b4-986d05da2317] Claim successful on node user
Nov 14 09:52:44 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-a1e91a40-5d10-445e-b9e3-0dec7cc8b1f3 tempest-VolumesActionsTest-480767440 tempest-VolumesActionsTest-480767440-project-member] Acquiring lock "bcd2eae5-1085-491f-925a-247c462d786a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:52:44 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-a1e91a40-5d10-445e-b9e3-0dec7cc8b1f3 tempest-VolumesActionsTest-480767440 tempest-VolumesActionsTest-480767440-project-member] Lock "bcd2eae5-1085-491f-925a-247c462d786a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:52:44 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-a1e91a40-5d10-445e-b9e3-0dec7cc8b1f3 tempest-VolumesActionsTest-480767440 tempest-VolumesActionsTest-480767440-project-member] Acquiring lock "bcd2eae5-1085-491f-925a-247c462d786a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:52:44 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-a1e91a40-5d10-445e-b9e3-0dec7cc8b1f3 tempest-VolumesActionsTest-480767440 tempest-VolumesActionsTest-480767440-project-member] Lock "bcd2eae5-1085-491f-925a-247c462d786a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:52:44 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-a1e91a40-5d10-445e-b9e3-0dec7cc8b1f3 tempest-VolumesActionsTest-480767440 tempest-VolumesActionsTest-480767440-project-member] Lock "bcd2eae5-1085-491f-925a-247c462d786a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:52:44 user nova-compute[75229]: INFO nova.compute.manager [None req-a1e91a40-5d10-445e-b9e3-0dec7cc8b1f3 tempest-VolumesActionsTest-480767440 tempest-VolumesActionsTest-480767440-project-member] [instance: bcd2eae5-1085-491f-925a-247c462d786a] Terminating instance
Nov 14 09:52:44 user nova-compute[75229]: DEBUG nova.compute.manager [None req-a1e91a40-5d10-445e-b9e3-0dec7cc8b1f3 tempest-VolumesActionsTest-480767440 tempest-VolumesActionsTest-480767440-project-member] [instance: bcd2eae5-1085-491f-925a-247c462d786a] Start destroying the instance on the hypervisor. {{(pid=75229) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 09:52:45 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:52:45 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:52:45 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:52:45 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:52:45 user nova-compute[75229]: DEBUG nova.compute.manager [req-cb6256b2-ec5d-4fa6-9884-b6284088395d req-980fdad9-1b3b-4cbb-af01-68806f48d81a service nova] [instance: bcd2eae5-1085-491f-925a-247c462d786a] Received event network-vif-unplugged-a74e02ce-e9ec-46ff-971e-cf8502a86303 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:52:45 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-cb6256b2-ec5d-4fa6-9884-b6284088395d req-980fdad9-1b3b-4cbb-af01-68806f48d81a service nova] Acquiring lock "bcd2eae5-1085-491f-925a-247c462d786a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:52:45 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-cb6256b2-ec5d-4fa6-9884-b6284088395d req-980fdad9-1b3b-4cbb-af01-68806f48d81a service nova] Lock "bcd2eae5-1085-491f-925a-247c462d786a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:52:45 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-cb6256b2-ec5d-4fa6-9884-b6284088395d req-980fdad9-1b3b-4cbb-af01-68806f48d81a service nova] Lock "bcd2eae5-1085-491f-925a-247c462d786a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:52:45 user nova-compute[75229]: DEBUG nova.compute.manager [req-cb6256b2-ec5d-4fa6-9884-b6284088395d req-980fdad9-1b3b-4cbb-af01-68806f48d81a service nova] [instance: bcd2eae5-1085-491f-925a-247c462d786a] No waiting events found dispatching network-vif-unplugged-a74e02ce-e9ec-46ff-971e-cf8502a86303 {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 09:52:45 user nova-compute[75229]: DEBUG nova.compute.manager [req-cb6256b2-ec5d-4fa6-9884-b6284088395d req-980fdad9-1b3b-4cbb-af01-68806f48d81a service nova] [instance: bcd2eae5-1085-491f-925a-247c462d786a] Received event network-vif-unplugged-a74e02ce-e9ec-46ff-971e-cf8502a86303 for instance with task_state deleting. {{(pid=75229) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 09:52:45 user nova-compute[75229]: DEBUG nova.compute.provider_tree [None req-c25a03ba-4af2-4c6c-bab0-688b8c9871ea tempest-ServersNegativeTestJSON-1483105767 tempest-ServersNegativeTestJSON-1483105767-project-member] Inventory has not changed in ProviderTree for provider: d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 {{(pid=75229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 09:52:45 user nova-compute[75229]: DEBUG nova.scheduler.client.report [None req-c25a03ba-4af2-4c6c-bab0-688b8c9871ea tempest-ServersNegativeTestJSON-1483105767 tempest-ServersNegativeTestJSON-1483105767-project-member] Inventory has not changed for provider d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 09:52:45 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-c25a03ba-4af2-4c6c-bab0-688b8c9871ea tempest-ServersNegativeTestJSON-1483105767 tempest-ServersNegativeTestJSON-1483105767-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.561s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:52:45 user nova-compute[75229]: DEBUG nova.compute.manager [None req-c25a03ba-4af2-4c6c-bab0-688b8c9871ea tempest-ServersNegativeTestJSON-1483105767 tempest-ServersNegativeTestJSON-1483105767-project-member] [instance: cc486509-4506-415c-a2b4-986d05da2317] Start building networks asynchronously for instance. {{(pid=75229) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 09:52:45 user nova-compute[75229]: DEBUG nova.compute.manager [None req-c25a03ba-4af2-4c6c-bab0-688b8c9871ea tempest-ServersNegativeTestJSON-1483105767 tempest-ServersNegativeTestJSON-1483105767-project-member] [instance: cc486509-4506-415c-a2b4-986d05da2317] Allocating IP information in the background. {{(pid=75229) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 09:52:45 user nova-compute[75229]: DEBUG nova.network.neutron [None req-c25a03ba-4af2-4c6c-bab0-688b8c9871ea tempest-ServersNegativeTestJSON-1483105767 tempest-ServersNegativeTestJSON-1483105767-project-member] [instance: cc486509-4506-415c-a2b4-986d05da2317] allocate_for_instance() {{(pid=75229) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 09:52:45 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-c25a03ba-4af2-4c6c-bab0-688b8c9871ea tempest-ServersNegativeTestJSON-1483105767 tempest-ServersNegativeTestJSON-1483105767-project-member] [instance: cc486509-4506-415c-a2b4-986d05da2317] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 09:52:45 user nova-compute[75229]: DEBUG nova.compute.manager [None req-c25a03ba-4af2-4c6c-bab0-688b8c9871ea tempest-ServersNegativeTestJSON-1483105767 tempest-ServersNegativeTestJSON-1483105767-project-member] [instance: cc486509-4506-415c-a2b4-986d05da2317] Start building block device mappings for instance. {{(pid=75229) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 09:52:45 user nova-compute[75229]: DEBUG nova.policy [None req-c25a03ba-4af2-4c6c-bab0-688b8c9871ea tempest-ServersNegativeTestJSON-1483105767 tempest-ServersNegativeTestJSON-1483105767-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a479b16af2894f6388c73aaaa744ec6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '133a5fa644c24636bd2b334d7b95e4c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75229) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 09:52:46 user nova-compute[75229]: INFO nova.virt.libvirt.driver [-] [instance: bcd2eae5-1085-491f-925a-247c462d786a] Instance destroyed successfully.
Nov 14 09:52:46 user nova-compute[75229]: DEBUG nova.objects.instance [None req-a1e91a40-5d10-445e-b9e3-0dec7cc8b1f3 tempest-VolumesActionsTest-480767440 tempest-VolumesActionsTest-480767440-project-member] Lazy-loading 'resources' on Instance uuid bcd2eae5-1085-491f-925a-247c462d786a {{(pid=75229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 09:52:46 user nova-compute[75229]: DEBUG nova.virt.libvirt.vif [None req-a1e91a40-5d10-445e-b9e3-0dec7cc8b1f3 tempest-VolumesActionsTest-480767440 tempest-VolumesActionsTest-480767440-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T09:50:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1029902890',display_name='tempest-VolumesActionsTest-instance-1029902890',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1029902890',id=24,image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-14T09:51:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='76963cea909f48398eea96eefec38b0f',ramdisk_id='',reservation_id='r-xskjqb9o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-480767440',owner_user_name='tempest-VolumesActionsTest-480767440-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T09:51:03Z,user_data=None,user_id='c560169166e745ad9bb47e0c570c3ed8',uuid=bcd2eae5-1085-491f-925a-247c462d786a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a74e02ce-e9ec-46ff-971e-cf8502a86303", "address": "fa:16:3e:02:f9:33", "network": {"id": "fedfe4bb-5b8c-4782-9df9-19cba1844f7c", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2139303642-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76963cea909f48398eea96eefec38b0f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa74e02ce-e9", "ovs_interfaceid": "a74e02ce-e9ec-46ff-971e-cf8502a86303", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 09:52:46 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-a1e91a40-5d10-445e-b9e3-0dec7cc8b1f3 tempest-VolumesActionsTest-480767440 tempest-VolumesActionsTest-480767440-project-member] Converting VIF {"id": "a74e02ce-e9ec-46ff-971e-cf8502a86303", "address": "fa:16:3e:02:f9:33", "network": {"id": "fedfe4bb-5b8c-4782-9df9-19cba1844f7c", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2139303642-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76963cea909f48398eea96eefec38b0f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa74e02ce-e9", "ovs_interfaceid": "a74e02ce-e9ec-46ff-971e-cf8502a86303", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 09:52:46 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-a1e91a40-5d10-445e-b9e3-0dec7cc8b1f3 tempest-VolumesActionsTest-480767440 tempest-VolumesActionsTest-480767440-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:02:f9:33,bridge_name='br-int',has_traffic_filtering=True,id=a74e02ce-e9ec-46ff-971e-cf8502a86303,network=Network(fedfe4bb-5b8c-4782-9df9-19cba1844f7c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa74e02ce-e9') {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 09:52:46 user nova-compute[75229]: DEBUG os_vif [None req-a1e91a40-5d10-445e-b9e3-0dec7cc8b1f3 tempest-VolumesActionsTest-480767440 tempest-VolumesActionsTest-480767440-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:02:f9:33,bridge_name='br-int',has_traffic_filtering=True,id=a74e02ce-e9ec-46ff-971e-cf8502a86303,network=Network(fedfe4bb-5b8c-4782-9df9-19cba1844f7c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa74e02ce-e9') {{(pid=75229) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 09:52:46 user nova-compute[75229]: DEBUG nova.compute.manager [None req-c25a03ba-4af2-4c6c-bab0-688b8c9871ea tempest-ServersNegativeTestJSON-1483105767 tempest-ServersNegativeTestJSON-1483105767-project-member] [instance: cc486509-4506-415c-a2b4-986d05da2317] Start spawning the instance on the hypervisor. {{(pid=75229) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 09:52:46 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-c25a03ba-4af2-4c6c-bab0-688b8c9871ea tempest-ServersNegativeTestJSON-1483105767 tempest-ServersNegativeTestJSON-1483105767-project-member] [instance: cc486509-4506-415c-a2b4-986d05da2317] Creating instance directory {{(pid=75229) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 09:52:46 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-c25a03ba-4af2-4c6c-bab0-688b8c9871ea tempest-ServersNegativeTestJSON-1483105767 tempest-ServersNegativeTestJSON-1483105767-project-member] [instance: cc486509-4506-415c-a2b4-986d05da2317] Creating image(s)
Nov 14 09:52:46 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-c25a03ba-4af2-4c6c-bab0-688b8c9871ea tempest-ServersNegativeTestJSON-1483105767 tempest-ServersNegativeTestJSON-1483105767-project-member] Acquiring lock "/opt/stack/data/nova/instances/cc486509-4506-415c-a2b4-986d05da2317/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:52:46 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-c25a03ba-4af2-4c6c-bab0-688b8c9871ea tempest-ServersNegativeTestJSON-1483105767 tempest-ServersNegativeTestJSON-1483105767-project-member] Lock "/opt/stack/data/nova/instances/cc486509-4506-415c-a2b4-986d05da2317/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:52:46 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-c25a03ba-4af2-4c6c-bab0-688b8c9871ea tempest-ServersNegativeTestJSON-1483105767 tempest-ServersNegativeTestJSON-1483105767-project-member] Lock "/opt/stack/data/nova/instances/cc486509-4506-415c-a2b4-986d05da2317/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:52:46 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:52:46 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa74e02ce-e9, bridge=br-int, if_exists=True) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:52:46 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-c25a03ba-4af2-4c6c-bab0-688b8c9871ea tempest-ServersNegativeTestJSON-1483105767 tempest-ServersNegativeTestJSON-1483105767-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6 --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:52:46 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:52:46 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 09:52:46 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:52:46 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e322c8b8-efa4-4225-825f-93c87036fd92) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:52:46 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:52:46 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:52:46 user nova-compute[75229]: INFO os_vif [None req-a1e91a40-5d10-445e-b9e3-0dec7cc8b1f3 tempest-VolumesActionsTest-480767440 tempest-VolumesActionsTest-480767440-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:02:f9:33,bridge_name='br-int',has_traffic_filtering=True,id=a74e02ce-e9ec-46ff-971e-cf8502a86303,network=Network(fedfe4bb-5b8c-4782-9df9-19cba1844f7c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa74e02ce-e9')
Nov 14 09:52:46 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-a1e91a40-5d10-445e-b9e3-0dec7cc8b1f3 tempest-VolumesActionsTest-480767440 tempest-VolumesActionsTest-480767440-project-member] [instance: bcd2eae5-1085-491f-925a-247c462d786a] Deleting instance files /opt/stack/data/nova/instances/bcd2eae5-1085-491f-925a-247c462d786a_del
Nov 14 09:52:46 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-a1e91a40-5d10-445e-b9e3-0dec7cc8b1f3 tempest-VolumesActionsTest-480767440 tempest-VolumesActionsTest-480767440-project-member] [instance: bcd2eae5-1085-491f-925a-247c462d786a] Deletion of /opt/stack/data/nova/instances/bcd2eae5-1085-491f-925a-247c462d786a_del complete
Nov 14 09:52:46 user nova-compute[75229]: INFO nova.compute.manager [None req-a1e91a40-5d10-445e-b9e3-0dec7cc8b1f3 tempest-VolumesActionsTest-480767440 tempest-VolumesActionsTest-480767440-project-member] [instance: bcd2eae5-1085-491f-925a-247c462d786a] Took 1.26 seconds to destroy the instance on the hypervisor.
Nov 14 09:52:46 user nova-compute[75229]: DEBUG oslo.service.loopingcall [None req-a1e91a40-5d10-445e-b9e3-0dec7cc8b1f3 tempest-VolumesActionsTest-480767440 tempest-VolumesActionsTest-480767440-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75229) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 09:52:46 user nova-compute[75229]: DEBUG nova.compute.manager [-] [instance: bcd2eae5-1085-491f-925a-247c462d786a] Deallocating network for instance {{(pid=75229) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 09:52:46 user nova-compute[75229]: DEBUG nova.network.neutron [-] [instance: bcd2eae5-1085-491f-925a-247c462d786a] deallocate_for_instance() {{(pid=75229) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 09:52:46 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-c25a03ba-4af2-4c6c-bab0-688b8c9871ea tempest-ServersNegativeTestJSON-1483105767 tempest-ServersNegativeTestJSON-1483105767-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6 --force-share --output=json" returned: 0 in 0.182s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:52:46 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-c25a03ba-4af2-4c6c-bab0-688b8c9871ea tempest-ServersNegativeTestJSON-1483105767 tempest-ServersNegativeTestJSON-1483105767-project-member] Acquiring lock "4f30e3fe703d2381679612a57b1fb80a467f60b6" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:52:46 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-c25a03ba-4af2-4c6c-bab0-688b8c9871ea tempest-ServersNegativeTestJSON-1483105767 tempest-ServersNegativeTestJSON-1483105767-project-member] Lock "4f30e3fe703d2381679612a57b1fb80a467f60b6" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:52:46 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-c25a03ba-4af2-4c6c-bab0-688b8c9871ea tempest-ServersNegativeTestJSON-1483105767 tempest-ServersNegativeTestJSON-1483105767-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6 --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:52:46 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-c25a03ba-4af2-4c6c-bab0-688b8c9871ea tempest-ServersNegativeTestJSON-1483105767 tempest-ServersNegativeTestJSON-1483105767-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6 --force-share --output=json" returned: 0 in 0.169s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:52:46 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-c25a03ba-4af2-4c6c-bab0-688b8c9871ea tempest-ServersNegativeTestJSON-1483105767 tempest-ServersNegativeTestJSON-1483105767-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6,backing_fmt=raw /opt/stack/data/nova/instances/cc486509-4506-415c-a2b4-986d05da2317/disk 1073741824 {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:52:46 user nova-compute[75229]: DEBUG nova.network.neutron [None req-c25a03ba-4af2-4c6c-bab0-688b8c9871ea tempest-ServersNegativeTestJSON-1483105767 tempest-ServersNegativeTestJSON-1483105767-project-member] [instance: cc486509-4506-415c-a2b4-986d05da2317] Successfully created port: 3091254d-fbc8-4c82-9e16-3afe6485f1f6 {{(pid=75229) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 09:52:46 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-c25a03ba-4af2-4c6c-bab0-688b8c9871ea tempest-ServersNegativeTestJSON-1483105767 tempest-ServersNegativeTestJSON-1483105767-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6,backing_fmt=raw /opt/stack/data/nova/instances/cc486509-4506-415c-a2b4-986d05da2317/disk 1073741824" returned: 0 in 0.053s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:52:46 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-c25a03ba-4af2-4c6c-bab0-688b8c9871ea tempest-ServersNegativeTestJSON-1483105767 tempest-ServersNegativeTestJSON-1483105767-project-member] Lock "4f30e3fe703d2381679612a57b1fb80a467f60b6" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.226s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:52:46 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-c25a03ba-4af2-4c6c-bab0-688b8c9871ea tempest-ServersNegativeTestJSON-1483105767 tempest-ServersNegativeTestJSON-1483105767-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6 --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:52:46 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-c25a03ba-4af2-4c6c-bab0-688b8c9871ea tempest-ServersNegativeTestJSON-1483105767 tempest-ServersNegativeTestJSON-1483105767-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6 --force-share --output=json" returned: 0 in 0.173s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:52:46 user nova-compute[75229]: DEBUG nova.virt.disk.api [None req-c25a03ba-4af2-4c6c-bab0-688b8c9871ea tempest-ServersNegativeTestJSON-1483105767 tempest-ServersNegativeTestJSON-1483105767-project-member] Checking if we can resize image /opt/stack/data/nova/instances/cc486509-4506-415c-a2b4-986d05da2317/disk. size=1073741824 {{(pid=75229) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 09:52:46 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-c25a03ba-4af2-4c6c-bab0-688b8c9871ea tempest-ServersNegativeTestJSON-1483105767 tempest-ServersNegativeTestJSON-1483105767-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc486509-4506-415c-a2b4-986d05da2317/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:52:46 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 09:52:46 user nova-compute[75229]: DEBUG nova.network.neutron [-] [instance: bcd2eae5-1085-491f-925a-247c462d786a] Updating instance_info_cache with network_info: [] {{(pid=75229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 09:52:46 user nova-compute[75229]: INFO nova.compute.manager [-] [instance: bcd2eae5-1085-491f-925a-247c462d786a] Took 0.51 seconds to deallocate network for instance.
Nov 14 09:52:46 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-c25a03ba-4af2-4c6c-bab0-688b8c9871ea tempest-ServersNegativeTestJSON-1483105767 tempest-ServersNegativeTestJSON-1483105767-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc486509-4506-415c-a2b4-986d05da2317/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:52:46 user nova-compute[75229]: DEBUG nova.virt.disk.api [None req-c25a03ba-4af2-4c6c-bab0-688b8c9871ea tempest-ServersNegativeTestJSON-1483105767 tempest-ServersNegativeTestJSON-1483105767-project-member] Cannot resize image /opt/stack/data/nova/instances/cc486509-4506-415c-a2b4-986d05da2317/disk to a smaller size. {{(pid=75229) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 09:52:46 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-c25a03ba-4af2-4c6c-bab0-688b8c9871ea tempest-ServersNegativeTestJSON-1483105767 tempest-ServersNegativeTestJSON-1483105767-project-member] [instance: cc486509-4506-415c-a2b4-986d05da2317] Created local disks {{(pid=75229) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 09:52:46 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-c25a03ba-4af2-4c6c-bab0-688b8c9871ea tempest-ServersNegativeTestJSON-1483105767 tempest-ServersNegativeTestJSON-1483105767-project-member] [instance: cc486509-4506-415c-a2b4-986d05da2317] Ensure instance console log exists: /opt/stack/data/nova/instances/cc486509-4506-415c-a2b4-986d05da2317/console.log {{(pid=75229) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 09:52:46 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-c25a03ba-4af2-4c6c-bab0-688b8c9871ea tempest-ServersNegativeTestJSON-1483105767 tempest-ServersNegativeTestJSON-1483105767-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:52:46 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-c25a03ba-4af2-4c6c-bab0-688b8c9871ea tempest-ServersNegativeTestJSON-1483105767 tempest-ServersNegativeTestJSON-1483105767-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:52:46 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-c25a03ba-4af2-4c6c-bab0-688b8c9871ea tempest-ServersNegativeTestJSON-1483105767 tempest-ServersNegativeTestJSON-1483105767-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:52:46 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-a1e91a40-5d10-445e-b9e3-0dec7cc8b1f3 tempest-VolumesActionsTest-480767440 tempest-VolumesActionsTest-480767440-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:52:46 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-a1e91a40-5d10-445e-b9e3-0dec7cc8b1f3 tempest-VolumesActionsTest-480767440 tempest-VolumesActionsTest-480767440-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:52:47 user nova-compute[75229]: DEBUG nova.network.neutron [None req-c25a03ba-4af2-4c6c-bab0-688b8c9871ea tempest-ServersNegativeTestJSON-1483105767 tempest-ServersNegativeTestJSON-1483105767-project-member] [instance: cc486509-4506-415c-a2b4-986d05da2317] Successfully updated port: 3091254d-fbc8-4c82-9e16-3afe6485f1f6 {{(pid=75229) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 09:52:47 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-c25a03ba-4af2-4c6c-bab0-688b8c9871ea tempest-ServersNegativeTestJSON-1483105767 tempest-ServersNegativeTestJSON-1483105767-project-member] Acquiring lock "refresh_cache-cc486509-4506-415c-a2b4-986d05da2317" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 09:52:47 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-c25a03ba-4af2-4c6c-bab0-688b8c9871ea tempest-ServersNegativeTestJSON-1483105767 tempest-ServersNegativeTestJSON-1483105767-project-member] Acquired lock "refresh_cache-cc486509-4506-415c-a2b4-986d05da2317" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 09:52:47 user nova-compute[75229]: DEBUG nova.network.neutron [None req-c25a03ba-4af2-4c6c-bab0-688b8c9871ea tempest-ServersNegativeTestJSON-1483105767 tempest-ServersNegativeTestJSON-1483105767-project-member] [instance: cc486509-4506-415c-a2b4-986d05da2317] Building network info cache for instance {{(pid=75229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 09:52:47 user nova-compute[75229]: DEBUG nova.compute.manager [req-48f6a6de-eef6-426f-9fd3-92051a99e178 req-e4389ea1-c0e0-49b8-b9d1-8741c10f40a5 service nova] [instance: cc486509-4506-415c-a2b4-986d05da2317] Received event network-changed-3091254d-fbc8-4c82-9e16-3afe6485f1f6 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:52:47 user nova-compute[75229]: DEBUG nova.compute.manager [req-48f6a6de-eef6-426f-9fd3-92051a99e178 req-e4389ea1-c0e0-49b8-b9d1-8741c10f40a5 service nova] [instance: cc486509-4506-415c-a2b4-986d05da2317] Refreshing instance network info cache due to event network-changed-3091254d-fbc8-4c82-9e16-3afe6485f1f6. {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 09:52:47 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-48f6a6de-eef6-426f-9fd3-92051a99e178 req-e4389ea1-c0e0-49b8-b9d1-8741c10f40a5 service nova] Acquiring lock "refresh_cache-cc486509-4506-415c-a2b4-986d05da2317" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 09:52:47 user nova-compute[75229]: DEBUG nova.network.neutron [None req-c25a03ba-4af2-4c6c-bab0-688b8c9871ea tempest-ServersNegativeTestJSON-1483105767 tempest-ServersNegativeTestJSON-1483105767-project-member] [instance: cc486509-4506-415c-a2b4-986d05da2317] Instance cache missing network info. {{(pid=75229) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 09:52:47 user nova-compute[75229]: DEBUG nova.compute.provider_tree [None req-a1e91a40-5d10-445e-b9e3-0dec7cc8b1f3 tempest-VolumesActionsTest-480767440 tempest-VolumesActionsTest-480767440-project-member] Inventory has not changed in ProviderTree for provider: d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 {{(pid=75229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 09:52:47 user nova-compute[75229]: DEBUG nova.scheduler.client.report [None req-a1e91a40-5d10-445e-b9e3-0dec7cc8b1f3 tempest-VolumesActionsTest-480767440 tempest-VolumesActionsTest-480767440-project-member] Inventory has not changed for provider d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 09:52:47 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-a1e91a40-5d10-445e-b9e3-0dec7cc8b1f3 tempest-VolumesActionsTest-480767440 tempest-VolumesActionsTest-480767440-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.395s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:52:47 user nova-compute[75229]: INFO nova.scheduler.client.report [None req-a1e91a40-5d10-445e-b9e3-0dec7cc8b1f3 tempest-VolumesActionsTest-480767440 tempest-VolumesActionsTest-480767440-project-member] Deleted allocations for instance bcd2eae5-1085-491f-925a-247c462d786a
Nov 14 09:52:47 user nova-compute[75229]: DEBUG nova.compute.manager [req-2d16b73b-f201-4ec4-9416-466f3cda90bc req-f4d25886-cc54-4e9c-b135-861eb9be3290 service nova] [instance: bcd2eae5-1085-491f-925a-247c462d786a] Received event network-vif-plugged-a74e02ce-e9ec-46ff-971e-cf8502a86303 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:52:47 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-2d16b73b-f201-4ec4-9416-466f3cda90bc req-f4d25886-cc54-4e9c-b135-861eb9be3290 service nova] Acquiring lock "bcd2eae5-1085-491f-925a-247c462d786a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:52:47 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-2d16b73b-f201-4ec4-9416-466f3cda90bc req-f4d25886-cc54-4e9c-b135-861eb9be3290 service nova] Lock "bcd2eae5-1085-491f-925a-247c462d786a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:52:47 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-2d16b73b-f201-4ec4-9416-466f3cda90bc req-f4d25886-cc54-4e9c-b135-861eb9be3290 service nova] Lock "bcd2eae5-1085-491f-925a-247c462d786a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:52:47 user nova-compute[75229]: DEBUG nova.compute.manager [req-2d16b73b-f201-4ec4-9416-466f3cda90bc req-f4d25886-cc54-4e9c-b135-861eb9be3290 service nova] [instance: bcd2eae5-1085-491f-925a-247c462d786a] No waiting events found dispatching network-vif-plugged-a74e02ce-e9ec-46ff-971e-cf8502a86303 {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 09:52:47 user nova-compute[75229]: WARNING nova.compute.manager [req-2d16b73b-f201-4ec4-9416-466f3cda90bc req-f4d25886-cc54-4e9c-b135-861eb9be3290 service nova] [instance: bcd2eae5-1085-491f-925a-247c462d786a] Received unexpected event network-vif-plugged-a74e02ce-e9ec-46ff-971e-cf8502a86303 for instance with vm_state deleted and task_state None.
Nov 14 09:52:47 user nova-compute[75229]: DEBUG nova.compute.manager [req-2d16b73b-f201-4ec4-9416-466f3cda90bc req-f4d25886-cc54-4e9c-b135-861eb9be3290 service nova] [instance: bcd2eae5-1085-491f-925a-247c462d786a] Received event network-vif-deleted-a74e02ce-e9ec-46ff-971e-cf8502a86303 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:52:47 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-a1e91a40-5d10-445e-b9e3-0dec7cc8b1f3 tempest-VolumesActionsTest-480767440 tempest-VolumesActionsTest-480767440-project-member] Lock "bcd2eae5-1085-491f-925a-247c462d786a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.402s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:52:47 user nova-compute[75229]: DEBUG nova.network.neutron [None req-c25a03ba-4af2-4c6c-bab0-688b8c9871ea tempest-ServersNegativeTestJSON-1483105767 tempest-ServersNegativeTestJSON-1483105767-project-member] [instance: cc486509-4506-415c-a2b4-986d05da2317] Updating instance_info_cache with network_info: [{"id": "3091254d-fbc8-4c82-9e16-3afe6485f1f6", "address": "fa:16:3e:29:e0:3c", "network": {"id": "b841fceb-4765-4e8e-b800-8651dcb1d867", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1867189200-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "133a5fa644c24636bd2b334d7b95e4c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3091254d-fb", "ovs_interfaceid": "3091254d-fbc8-4c82-9e16-3afe6485f1f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 09:52:47 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-c25a03ba-4af2-4c6c-bab0-688b8c9871ea tempest-ServersNegativeTestJSON-1483105767 tempest-ServersNegativeTestJSON-1483105767-project-member] Releasing lock "refresh_cache-cc486509-4506-415c-a2b4-986d05da2317" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 09:52:47 user nova-compute[75229]: DEBUG nova.compute.manager [None req-c25a03ba-4af2-4c6c-bab0-688b8c9871ea tempest-ServersNegativeTestJSON-1483105767 tempest-ServersNegativeTestJSON-1483105767-project-member] [instance: cc486509-4506-415c-a2b4-986d05da2317] Instance network_info: |[{"id": "3091254d-fbc8-4c82-9e16-3afe6485f1f6", "address": "fa:16:3e:29:e0:3c", "network": {"id": "b841fceb-4765-4e8e-b800-8651dcb1d867", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1867189200-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "133a5fa644c24636bd2b334d7b95e4c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3091254d-fb", "ovs_interfaceid": "3091254d-fbc8-4c82-9e16-3afe6485f1f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75229) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 09:52:47 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-48f6a6de-eef6-426f-9fd3-92051a99e178 req-e4389ea1-c0e0-49b8-b9d1-8741c10f40a5 service nova] Acquired lock "refresh_cache-cc486509-4506-415c-a2b4-986d05da2317" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 09:52:47 user nova-compute[75229]: DEBUG nova.network.neutron [req-48f6a6de-eef6-426f-9fd3-92051a99e178 req-e4389ea1-c0e0-49b8-b9d1-8741c10f40a5 service nova] [instance: cc486509-4506-415c-a2b4-986d05da2317] Refreshing network info cache for port 3091254d-fbc8-4c82-9e16-3afe6485f1f6 {{(pid=75229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 09:52:47 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-c25a03ba-4af2-4c6c-bab0-688b8c9871ea tempest-ServersNegativeTestJSON-1483105767 tempest-ServersNegativeTestJSON-1483105767-project-member] [instance: cc486509-4506-415c-a2b4-986d05da2317] Start _get_guest_xml network_info=[{"id": "3091254d-fbc8-4c82-9e16-3afe6485f1f6", "address": "fa:16:3e:29:e0:3c", "network": {"id": "b841fceb-4765-4e8e-b800-8651dcb1d867", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1867189200-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "133a5fa644c24636bd2b334d7b95e4c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3091254d-fb", "ovs_interfaceid": "3091254d-fbc8-4c82-9e16-3afe6485f1f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T09:40:10Z,direct_url=<?>,disk_format='qcow2',id=3bef8470-ecc7-40e3-95d4-9254348ea72d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='de5a91106b6948ed937a7178ff9464c4',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T09:40:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'disk_bus': 'virtio', 'guest_format': None, 'encryption_secret_uuid': None, 'size': 0, 'device_type': 'disk', 'image_id': '3bef8470-ecc7-40e3-95d4-9254348ea72d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75229) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 09:52:47 user nova-compute[75229]: WARNING nova.virt.libvirt.driver [None req-c25a03ba-4af2-4c6c-bab0-688b8c9871ea tempest-ServersNegativeTestJSON-1483105767 tempest-ServersNegativeTestJSON-1483105767-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 09:52:47 user nova-compute[75229]: WARNING nova.virt.libvirt.driver [None req-c25a03ba-4af2-4c6c-bab0-688b8c9871ea tempest-ServersNegativeTestJSON-1483105767 tempest-ServersNegativeTestJSON-1483105767-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 09:52:47 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-c25a03ba-4af2-4c6c-bab0-688b8c9871ea tempest-ServersNegativeTestJSON-1483105767 tempest-ServersNegativeTestJSON-1483105767-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75229) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 09:52:47 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-c25a03ba-4af2-4c6c-bab0-688b8c9871ea tempest-ServersNegativeTestJSON-1483105767 tempest-ServersNegativeTestJSON-1483105767-project-member] CPU controller missing on host. {{(pid=75229) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 09:52:47 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-c25a03ba-4af2-4c6c-bab0-688b8c9871ea tempest-ServersNegativeTestJSON-1483105767 tempest-ServersNegativeTestJSON-1483105767-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75229) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 09:52:47 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-c25a03ba-4af2-4c6c-bab0-688b8c9871ea tempest-ServersNegativeTestJSON-1483105767 tempest-ServersNegativeTestJSON-1483105767-project-member] CPU controller found on host. {{(pid=75229) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 09:52:47 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-c25a03ba-4af2-4c6c-bab0-688b8c9871ea tempest-ServersNegativeTestJSON-1483105767 tempest-ServersNegativeTestJSON-1483105767-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75229) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 09:52:47 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-c25a03ba-4af2-4c6c-bab0-688b8c9871ea tempest-ServersNegativeTestJSON-1483105767 tempest-ServersNegativeTestJSON-1483105767-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T09:39:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T09:40:10Z,direct_url=<?>,disk_format='qcow2',id=3bef8470-ecc7-40e3-95d4-9254348ea72d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='de5a91106b6948ed937a7178ff9464c4',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T09:40:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 09:52:47 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-c25a03ba-4af2-4c6c-bab0-688b8c9871ea tempest-ServersNegativeTestJSON-1483105767 tempest-ServersNegativeTestJSON-1483105767-project-member] Flavor limits 0:0:0 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 09:52:47 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-c25a03ba-4af2-4c6c-bab0-688b8c9871ea tempest-ServersNegativeTestJSON-1483105767 tempest-ServersNegativeTestJSON-1483105767-project-member] Image limits 0:0:0 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 09:52:47 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-c25a03ba-4af2-4c6c-bab0-688b8c9871ea tempest-ServersNegativeTestJSON-1483105767 tempest-ServersNegativeTestJSON-1483105767-project-member] Flavor pref 0:0:0 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 09:52:47 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-c25a03ba-4af2-4c6c-bab0-688b8c9871ea tempest-ServersNegativeTestJSON-1483105767 tempest-ServersNegativeTestJSON-1483105767-project-member] Image pref 0:0:0 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 09:52:47 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-c25a03ba-4af2-4c6c-bab0-688b8c9871ea tempest-ServersNegativeTestJSON-1483105767 tempest-ServersNegativeTestJSON-1483105767-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 09:52:47 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-c25a03ba-4af2-4c6c-bab0-688b8c9871ea tempest-ServersNegativeTestJSON-1483105767 tempest-ServersNegativeTestJSON-1483105767-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 09:52:47 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-c25a03ba-4af2-4c6c-bab0-688b8c9871ea tempest-ServersNegativeTestJSON-1483105767 tempest-ServersNegativeTestJSON-1483105767-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75229) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 09:52:47 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-c25a03ba-4af2-4c6c-bab0-688b8c9871ea tempest-ServersNegativeTestJSON-1483105767 tempest-ServersNegativeTestJSON-1483105767-project-member] Got 1 possible topologies {{(pid=75229) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 09:52:47 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-c25a03ba-4af2-4c6c-bab0-688b8c9871ea tempest-ServersNegativeTestJSON-1483105767 tempest-ServersNegativeTestJSON-1483105767-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 09:52:47 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-c25a03ba-4af2-4c6c-bab0-688b8c9871ea tempest-ServersNegativeTestJSON-1483105767 tempest-ServersNegativeTestJSON-1483105767-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 09:52:47 user nova-compute[75229]: DEBUG nova.virt.libvirt.vif [None req-c25a03ba-4af2-4c6c-bab0-688b8c9871ea tempest-ServersNegativeTestJSON-1483105767 tempest-ServersNegativeTestJSON-1483105767-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T09:52:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1408502155',display_name='tempest-ServersNegativeTestJSON-server-1408502155',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1408502155',id=28,image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='133a5fa644c24636bd2b334d7b95e4c3',ramdisk_id='',reservation_id='r-jm0q5c82',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1483105767',owner_user_name='tempest-ServersNegativeTestJSON-1483105767-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T09:52:46Z,user_data=None,user_id='a479b16af2894f6388c73aaaa744ec6b',uuid=cc486509-4506-415c-a2b4-986d05da2317,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3091254d-fbc8-4c82-9e16-3afe6485f1f6", "address": "fa:16:3e:29:e0:3c", "network": {"id": "b841fceb-4765-4e8e-b800-8651dcb1d867", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1867189200-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "133a5fa644c24636bd2b334d7b95e4c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3091254d-fb", "ovs_interfaceid": "3091254d-fbc8-4c82-9e16-3afe6485f1f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75229) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 09:52:47 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-c25a03ba-4af2-4c6c-bab0-688b8c9871ea tempest-ServersNegativeTestJSON-1483105767 tempest-ServersNegativeTestJSON-1483105767-project-member] Converting VIF {"id": "3091254d-fbc8-4c82-9e16-3afe6485f1f6", "address": "fa:16:3e:29:e0:3c", "network": {"id": "b841fceb-4765-4e8e-b800-8651dcb1d867", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1867189200-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "133a5fa644c24636bd2b334d7b95e4c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3091254d-fb", "ovs_interfaceid": "3091254d-fbc8-4c82-9e16-3afe6485f1f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 09:52:47 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-c25a03ba-4af2-4c6c-bab0-688b8c9871ea tempest-ServersNegativeTestJSON-1483105767 tempest-ServersNegativeTestJSON-1483105767-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:29:e0:3c,bridge_name='br-int',has_traffic_filtering=True,id=3091254d-fbc8-4c82-9e16-3afe6485f1f6,network=Network(b841fceb-4765-4e8e-b800-8651dcb1d867),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3091254d-fb') {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 09:52:47 user nova-compute[75229]: DEBUG nova.objects.instance [None req-c25a03ba-4af2-4c6c-bab0-688b8c9871ea tempest-ServersNegativeTestJSON-1483105767 tempest-ServersNegativeTestJSON-1483105767-project-member] Lazy-loading 'pci_devices' on Instance uuid cc486509-4506-415c-a2b4-986d05da2317 {{(pid=75229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 09:52:47 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-c25a03ba-4af2-4c6c-bab0-688b8c9871ea tempest-ServersNegativeTestJSON-1483105767 tempest-ServersNegativeTestJSON-1483105767-project-member] [instance: cc486509-4506-415c-a2b4-986d05da2317] End _get_guest_xml xml=<domain type="kvm">
Nov 14 09:52:47 user nova-compute[75229]:   <uuid>cc486509-4506-415c-a2b4-986d05da2317</uuid>
Nov 14 09:52:47 user nova-compute[75229]:   <name>instance-0000001c</name>
Nov 14 09:52:47 user nova-compute[75229]:   <memory>524288</memory>
Nov 14 09:52:47 user nova-compute[75229]:   <vcpu>1</vcpu>
Nov 14 09:52:47 user nova-compute[75229]:   <metadata>
Nov 14 09:52:47 user nova-compute[75229]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 09:52:47 user nova-compute[75229]:       <nova:package version="0.0.0"/>
Nov 14 09:52:47 user nova-compute[75229]:       <nova:name>tempest-ServersNegativeTestJSON-server-1408502155</nova:name>
Nov 14 09:52:47 user nova-compute[75229]:       <nova:creationTime>2023-11-14 09:52:47</nova:creationTime>
Nov 14 09:52:47 user nova-compute[75229]:       <nova:flavor name="m1.tiny">
Nov 14 09:52:47 user nova-compute[75229]:         <nova:memory>512</nova:memory>
Nov 14 09:52:47 user nova-compute[75229]:         <nova:disk>1</nova:disk>
Nov 14 09:52:47 user nova-compute[75229]:         <nova:swap>0</nova:swap>
Nov 14 09:52:47 user nova-compute[75229]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 09:52:47 user nova-compute[75229]:         <nova:vcpus>1</nova:vcpus>
Nov 14 09:52:47 user nova-compute[75229]:       </nova:flavor>
Nov 14 09:52:47 user nova-compute[75229]:       <nova:owner>
Nov 14 09:52:47 user nova-compute[75229]:         <nova:user uuid="a479b16af2894f6388c73aaaa744ec6b">tempest-ServersNegativeTestJSON-1483105767-project-member</nova:user>
Nov 14 09:52:47 user nova-compute[75229]:         <nova:project uuid="133a5fa644c24636bd2b334d7b95e4c3">tempest-ServersNegativeTestJSON-1483105767</nova:project>
Nov 14 09:52:47 user nova-compute[75229]:       </nova:owner>
Nov 14 09:52:47 user nova-compute[75229]:       <nova:root type="image" uuid="3bef8470-ecc7-40e3-95d4-9254348ea72d"/>
Nov 14 09:52:47 user nova-compute[75229]:       <nova:ports>
Nov 14 09:52:47 user nova-compute[75229]:         <nova:port uuid="3091254d-fbc8-4c82-9e16-3afe6485f1f6">
Nov 14 09:52:47 user nova-compute[75229]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 14 09:52:47 user nova-compute[75229]:         </nova:port>
Nov 14 09:52:47 user nova-compute[75229]:       </nova:ports>
Nov 14 09:52:47 user nova-compute[75229]:     </nova:instance>
Nov 14 09:52:47 user nova-compute[75229]:   </metadata>
Nov 14 09:52:47 user nova-compute[75229]:   <sysinfo type="smbios">
Nov 14 09:52:47 user nova-compute[75229]:     <system>
Nov 14 09:52:47 user nova-compute[75229]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 09:52:47 user nova-compute[75229]:       <entry name="product">OpenStack Nova</entry>
Nov 14 09:52:47 user nova-compute[75229]:       <entry name="version">0.0.0</entry>
Nov 14 09:52:47 user nova-compute[75229]:       <entry name="serial">cc486509-4506-415c-a2b4-986d05da2317</entry>
Nov 14 09:52:47 user nova-compute[75229]:       <entry name="uuid">cc486509-4506-415c-a2b4-986d05da2317</entry>
Nov 14 09:52:47 user nova-compute[75229]:       <entry name="family">Virtual Machine</entry>
Nov 14 09:52:47 user nova-compute[75229]:     </system>
Nov 14 09:52:47 user nova-compute[75229]:   </sysinfo>
Nov 14 09:52:47 user nova-compute[75229]:   <os>
Nov 14 09:52:47 user nova-compute[75229]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 09:52:47 user nova-compute[75229]:     <boot dev="hd"/>
Nov 14 09:52:47 user nova-compute[75229]:     <smbios mode="sysinfo"/>
Nov 14 09:52:47 user nova-compute[75229]:   </os>
Nov 14 09:52:47 user nova-compute[75229]:   <features>
Nov 14 09:52:47 user nova-compute[75229]:     <acpi/>
Nov 14 09:52:47 user nova-compute[75229]:     <apic/>
Nov 14 09:52:47 user nova-compute[75229]:     <vmcoreinfo/>
Nov 14 09:52:47 user nova-compute[75229]:   </features>
Nov 14 09:52:47 user nova-compute[75229]:   <clock offset="utc">
Nov 14 09:52:47 user nova-compute[75229]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 09:52:47 user nova-compute[75229]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 09:52:47 user nova-compute[75229]:     <timer name="hpet" present="no"/>
Nov 14 09:52:47 user nova-compute[75229]:   </clock>
Nov 14 09:52:47 user nova-compute[75229]:   <cpu mode="custom" match="exact">
Nov 14 09:52:47 user nova-compute[75229]:     <model>Nehalem</model>
Nov 14 09:52:47 user nova-compute[75229]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 09:52:47 user nova-compute[75229]:   </cpu>
Nov 14 09:52:47 user nova-compute[75229]:   <devices>
Nov 14 09:52:47 user nova-compute[75229]:     <disk type="file" device="disk">
Nov 14 09:52:47 user nova-compute[75229]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 09:52:47 user nova-compute[75229]:       <source file="/opt/stack/data/nova/instances/cc486509-4506-415c-a2b4-986d05da2317/disk"/>
Nov 14 09:52:47 user nova-compute[75229]:       <target dev="vda" bus="virtio"/>
Nov 14 09:52:47 user nova-compute[75229]:     </disk>
Nov 14 09:52:47 user nova-compute[75229]:     <interface type="ethernet">
Nov 14 09:52:47 user nova-compute[75229]:       <mac address="fa:16:3e:29:e0:3c"/>
Nov 14 09:52:47 user nova-compute[75229]:       <model type="virtio"/>
Nov 14 09:52:47 user nova-compute[75229]:       <mtu size="1442"/>
Nov 14 09:52:47 user nova-compute[75229]:       <target dev="tap3091254d-fb"/>
Nov 14 09:52:47 user nova-compute[75229]:     </interface>
Nov 14 09:52:47 user nova-compute[75229]:     <serial type="pty">
Nov 14 09:52:47 user nova-compute[75229]:       <log file="/opt/stack/data/nova/instances/cc486509-4506-415c-a2b4-986d05da2317/console.log" append="off"/>
Nov 14 09:52:47 user nova-compute[75229]:     </serial>
Nov 14 09:52:47 user nova-compute[75229]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 09:52:47 user nova-compute[75229]:     <video>
Nov 14 09:52:47 user nova-compute[75229]:       <model type="virtio"/>
Nov 14 09:52:47 user nova-compute[75229]:     </video>
Nov 14 09:52:47 user nova-compute[75229]:     <rng model="virtio">
Nov 14 09:52:47 user nova-compute[75229]:       <backend model="random">/dev/urandom</backend>
Nov 14 09:52:47 user nova-compute[75229]:     </rng>
Nov 14 09:52:47 user nova-compute[75229]:     <controller type="usb" index="0" model="none"/>
Nov 14 09:52:47 user nova-compute[75229]:     <memballoon model="virtio">
Nov 14 09:52:47 user nova-compute[75229]:       <stats period="10"/>
Nov 14 09:52:47 user nova-compute[75229]:     </memballoon>
Nov 14 09:52:47 user nova-compute[75229]:   </devices>
Nov 14 09:52:47 user nova-compute[75229]: </domain>
Nov 14 09:52:47 user nova-compute[75229]:  {{(pid=75229) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 09:52:47 user nova-compute[75229]: DEBUG nova.virt.libvirt.vif [None req-c25a03ba-4af2-4c6c-bab0-688b8c9871ea tempest-ServersNegativeTestJSON-1483105767 tempest-ServersNegativeTestJSON-1483105767-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T09:52:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1408502155',display_name='tempest-ServersNegativeTestJSON-server-1408502155',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1408502155',id=28,image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='133a5fa644c24636bd2b334d7b95e4c3',ramdisk_id='',reservation_id='r-jm0q5c82',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1483105767',owner_user_name='tempest-ServersNegativeTestJSON-1483105767-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T09:52:46Z,user_data=None,user_id='a479b16af2894f6388c73aaaa744ec6b',uuid=cc486509-4506-415c-a2b4-986d05da2317,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3091254d-fbc8-4c82-9e16-3afe6485f1f6", "address": "fa:16:3e:29:e0:3c", "network": {"id": "b841fceb-4765-4e8e-b800-8651dcb1d867", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1867189200-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "133a5fa644c24636bd2b334d7b95e4c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3091254d-fb", "ovs_interfaceid": "3091254d-fbc8-4c82-9e16-3afe6485f1f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 09:52:47 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-c25a03ba-4af2-4c6c-bab0-688b8c9871ea tempest-ServersNegativeTestJSON-1483105767 tempest-ServersNegativeTestJSON-1483105767-project-member] Converting VIF {"id": "3091254d-fbc8-4c82-9e16-3afe6485f1f6", "address": "fa:16:3e:29:e0:3c", "network": {"id": "b841fceb-4765-4e8e-b800-8651dcb1d867", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1867189200-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "133a5fa644c24636bd2b334d7b95e4c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3091254d-fb", "ovs_interfaceid": "3091254d-fbc8-4c82-9e16-3afe6485f1f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 09:52:47 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-c25a03ba-4af2-4c6c-bab0-688b8c9871ea tempest-ServersNegativeTestJSON-1483105767 tempest-ServersNegativeTestJSON-1483105767-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:29:e0:3c,bridge_name='br-int',has_traffic_filtering=True,id=3091254d-fbc8-4c82-9e16-3afe6485f1f6,network=Network(b841fceb-4765-4e8e-b800-8651dcb1d867),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3091254d-fb') {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 09:52:47 user nova-compute[75229]: DEBUG os_vif [None req-c25a03ba-4af2-4c6c-bab0-688b8c9871ea tempest-ServersNegativeTestJSON-1483105767 tempest-ServersNegativeTestJSON-1483105767-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:29:e0:3c,bridge_name='br-int',has_traffic_filtering=True,id=3091254d-fbc8-4c82-9e16-3afe6485f1f6,network=Network(b841fceb-4765-4e8e-b800-8651dcb1d867),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3091254d-fb') {{(pid=75229) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 09:52:47 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:52:47 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:52:47 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 09:52:47 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:52:47 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0415767e-6a65-532b-a155-1780282b5764', '_type': 'linux-noop'}}, row=False) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:52:47 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:52:47 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 09:52:47 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:52:47 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3091254d-fb, may_exist=True, interface_attrs={}) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:52:47 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3091254d-fb, col_values=(('qos', UUID('5020cc42-36ab-4d12-a516-747b030949d5')),), if_exists=True) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:52:47 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3091254d-fb, col_values=(('external_ids', {'iface-id': '3091254d-fbc8-4c82-9e16-3afe6485f1f6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:29:e0:3c', 'vm-uuid': 'cc486509-4506-415c-a2b4-986d05da2317'}),), if_exists=True) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:52:47 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:52:47 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 09:52:47 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:52:47 user nova-compute[75229]: INFO os_vif [None req-c25a03ba-4af2-4c6c-bab0-688b8c9871ea tempest-ServersNegativeTestJSON-1483105767 tempest-ServersNegativeTestJSON-1483105767-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:29:e0:3c,bridge_name='br-int',has_traffic_filtering=True,id=3091254d-fbc8-4c82-9e16-3afe6485f1f6,network=Network(b841fceb-4765-4e8e-b800-8651dcb1d867),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3091254d-fb')
Nov 14 09:52:47 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-c25a03ba-4af2-4c6c-bab0-688b8c9871ea tempest-ServersNegativeTestJSON-1483105767 tempest-ServersNegativeTestJSON-1483105767-project-member] No BDM found with device name vda, not building metadata. {{(pid=75229) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 09:52:47 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-c25a03ba-4af2-4c6c-bab0-688b8c9871ea tempest-ServersNegativeTestJSON-1483105767 tempest-ServersNegativeTestJSON-1483105767-project-member] No VIF found with MAC fa:16:3e:29:e0:3c, not building metadata {{(pid=75229) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 09:52:47 user nova-compute[75229]: DEBUG nova.network.neutron [req-48f6a6de-eef6-426f-9fd3-92051a99e178 req-e4389ea1-c0e0-49b8-b9d1-8741c10f40a5 service nova] [instance: cc486509-4506-415c-a2b4-986d05da2317] Updated VIF entry in instance network info cache for port 3091254d-fbc8-4c82-9e16-3afe6485f1f6. {{(pid=75229) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 09:52:47 user nova-compute[75229]: DEBUG nova.network.neutron [req-48f6a6de-eef6-426f-9fd3-92051a99e178 req-e4389ea1-c0e0-49b8-b9d1-8741c10f40a5 service nova] [instance: cc486509-4506-415c-a2b4-986d05da2317] Updating instance_info_cache with network_info: [{"id": "3091254d-fbc8-4c82-9e16-3afe6485f1f6", "address": "fa:16:3e:29:e0:3c", "network": {"id": "b841fceb-4765-4e8e-b800-8651dcb1d867", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1867189200-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "133a5fa644c24636bd2b334d7b95e4c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3091254d-fb", "ovs_interfaceid": "3091254d-fbc8-4c82-9e16-3afe6485f1f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 09:52:47 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-48f6a6de-eef6-426f-9fd3-92051a99e178 req-e4389ea1-c0e0-49b8-b9d1-8741c10f40a5 service nova] Releasing lock "refresh_cache-cc486509-4506-415c-a2b4-986d05da2317" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 09:52:48 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:52:48 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:52:48 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:52:49 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:52:49 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:52:49 user nova-compute[75229]: DEBUG nova.compute.manager [req-193c6ee1-0d7e-421a-9565-60419245745e req-f57a35f3-46c1-487a-87a9-6d6bd93d8247 service nova] [instance: cc486509-4506-415c-a2b4-986d05da2317] Received event network-vif-plugged-3091254d-fbc8-4c82-9e16-3afe6485f1f6 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:52:49 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-193c6ee1-0d7e-421a-9565-60419245745e req-f57a35f3-46c1-487a-87a9-6d6bd93d8247 service nova] Acquiring lock "cc486509-4506-415c-a2b4-986d05da2317-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:52:49 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-193c6ee1-0d7e-421a-9565-60419245745e req-f57a35f3-46c1-487a-87a9-6d6bd93d8247 service nova] Lock "cc486509-4506-415c-a2b4-986d05da2317-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:52:49 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-193c6ee1-0d7e-421a-9565-60419245745e req-f57a35f3-46c1-487a-87a9-6d6bd93d8247 service nova] Lock "cc486509-4506-415c-a2b4-986d05da2317-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:52:49 user nova-compute[75229]: DEBUG nova.compute.manager [req-193c6ee1-0d7e-421a-9565-60419245745e req-f57a35f3-46c1-487a-87a9-6d6bd93d8247 service nova] [instance: cc486509-4506-415c-a2b4-986d05da2317] No waiting events found dispatching network-vif-plugged-3091254d-fbc8-4c82-9e16-3afe6485f1f6 {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 09:52:49 user nova-compute[75229]: WARNING nova.compute.manager [req-193c6ee1-0d7e-421a-9565-60419245745e req-f57a35f3-46c1-487a-87a9-6d6bd93d8247 service nova] [instance: cc486509-4506-415c-a2b4-986d05da2317] Received unexpected event network-vif-plugged-3091254d-fbc8-4c82-9e16-3afe6485f1f6 for instance with vm_state building and task_state spawning.
Nov 14 09:52:50 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 09:52:50 user nova-compute[75229]: DEBUG nova.compute.manager [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Starting heal instance info cache {{(pid=75229) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 09:52:50 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Acquiring lock "refresh_cache-4255af28-a111-4475-b207-67e335fd0835" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 09:52:50 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Acquired lock "refresh_cache-4255af28-a111-4475-b207-67e335fd0835" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 09:52:50 user nova-compute[75229]: DEBUG nova.network.neutron [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] [instance: 4255af28-a111-4475-b207-67e335fd0835] Forcefully refreshing network info cache for instance {{(pid=75229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 09:52:51 user nova-compute[75229]: DEBUG nova.compute.manager [None req-c25a03ba-4af2-4c6c-bab0-688b8c9871ea tempest-ServersNegativeTestJSON-1483105767 tempest-ServersNegativeTestJSON-1483105767-project-member] [instance: cc486509-4506-415c-a2b4-986d05da2317] Instance event wait completed in 0 seconds for  {{(pid=75229) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 09:52:51 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-c25a03ba-4af2-4c6c-bab0-688b8c9871ea tempest-ServersNegativeTestJSON-1483105767 tempest-ServersNegativeTestJSON-1483105767-project-member] [instance: cc486509-4506-415c-a2b4-986d05da2317] Guest created on hypervisor {{(pid=75229) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 09:52:51 user nova-compute[75229]: INFO nova.virt.libvirt.driver [-] [instance: cc486509-4506-415c-a2b4-986d05da2317] Instance spawned successfully.
Nov 14 09:52:51 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-c25a03ba-4af2-4c6c-bab0-688b8c9871ea tempest-ServersNegativeTestJSON-1483105767 tempest-ServersNegativeTestJSON-1483105767-project-member] [instance: cc486509-4506-415c-a2b4-986d05da2317] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 09:52:51 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-c25a03ba-4af2-4c6c-bab0-688b8c9871ea tempest-ServersNegativeTestJSON-1483105767 tempest-ServersNegativeTestJSON-1483105767-project-member] [instance: cc486509-4506-415c-a2b4-986d05da2317] Found default for hw_cdrom_bus of ide {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 09:52:51 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-c25a03ba-4af2-4c6c-bab0-688b8c9871ea tempest-ServersNegativeTestJSON-1483105767 tempest-ServersNegativeTestJSON-1483105767-project-member] [instance: cc486509-4506-415c-a2b4-986d05da2317] Found default for hw_disk_bus of virtio {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 09:52:51 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-c25a03ba-4af2-4c6c-bab0-688b8c9871ea tempest-ServersNegativeTestJSON-1483105767 tempest-ServersNegativeTestJSON-1483105767-project-member] [instance: cc486509-4506-415c-a2b4-986d05da2317] Found default for hw_input_bus of None {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 09:52:51 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-c25a03ba-4af2-4c6c-bab0-688b8c9871ea tempest-ServersNegativeTestJSON-1483105767 tempest-ServersNegativeTestJSON-1483105767-project-member] [instance: cc486509-4506-415c-a2b4-986d05da2317] Found default for hw_pointer_model of None {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 09:52:51 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-c25a03ba-4af2-4c6c-bab0-688b8c9871ea tempest-ServersNegativeTestJSON-1483105767 tempest-ServersNegativeTestJSON-1483105767-project-member] [instance: cc486509-4506-415c-a2b4-986d05da2317] Found default for hw_video_model of virtio {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 09:52:51 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-c25a03ba-4af2-4c6c-bab0-688b8c9871ea tempest-ServersNegativeTestJSON-1483105767 tempest-ServersNegativeTestJSON-1483105767-project-member] [instance: cc486509-4506-415c-a2b4-986d05da2317] Found default for hw_vif_model of virtio {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 09:52:51 user nova-compute[75229]: DEBUG nova.network.neutron [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] [instance: 4255af28-a111-4475-b207-67e335fd0835] Updating instance_info_cache with network_info: [{"id": "8d218cec-b5d6-46ed-94be-4802fcdd0388", "address": "fa:16:3e:3d:eb:0f", "network": {"id": "bd407caa-6ef6-400d-9327-3179dc1d8da4", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-29933774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.175", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b8d48c38c7344f5b12d0ed5b9392554", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d218cec-b5", "ovs_interfaceid": "8d218cec-b5d6-46ed-94be-4802fcdd0388", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 09:52:51 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Releasing lock "refresh_cache-4255af28-a111-4475-b207-67e335fd0835" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 09:52:51 user nova-compute[75229]: DEBUG nova.compute.manager [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] [instance: 4255af28-a111-4475-b207-67e335fd0835] Updated the network info_cache for instance {{(pid=75229) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 09:52:51 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 09:52:51 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 09:52:51 user nova-compute[75229]: DEBUG nova.compute.manager [req-0cb1e4d0-a2da-40bd-aa6c-100fc5badd52 req-3602c92c-7c96-4088-88b5-565bcc0c5476 service nova] [instance: cc486509-4506-415c-a2b4-986d05da2317] Received event network-vif-plugged-3091254d-fbc8-4c82-9e16-3afe6485f1f6 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:52:51 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-0cb1e4d0-a2da-40bd-aa6c-100fc5badd52 req-3602c92c-7c96-4088-88b5-565bcc0c5476 service nova] Acquiring lock "cc486509-4506-415c-a2b4-986d05da2317-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:52:51 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-0cb1e4d0-a2da-40bd-aa6c-100fc5badd52 req-3602c92c-7c96-4088-88b5-565bcc0c5476 service nova] Lock "cc486509-4506-415c-a2b4-986d05da2317-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:52:51 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-0cb1e4d0-a2da-40bd-aa6c-100fc5badd52 req-3602c92c-7c96-4088-88b5-565bcc0c5476 service nova] Lock "cc486509-4506-415c-a2b4-986d05da2317-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:52:51 user nova-compute[75229]: DEBUG nova.compute.manager [req-0cb1e4d0-a2da-40bd-aa6c-100fc5badd52 req-3602c92c-7c96-4088-88b5-565bcc0c5476 service nova] [instance: cc486509-4506-415c-a2b4-986d05da2317] No waiting events found dispatching network-vif-plugged-3091254d-fbc8-4c82-9e16-3afe6485f1f6 {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 09:52:51 user nova-compute[75229]: WARNING nova.compute.manager [req-0cb1e4d0-a2da-40bd-aa6c-100fc5badd52 req-3602c92c-7c96-4088-88b5-565bcc0c5476 service nova] [instance: cc486509-4506-415c-a2b4-986d05da2317] Received unexpected event network-vif-plugged-3091254d-fbc8-4c82-9e16-3afe6485f1f6 for instance with vm_state building and task_state spawning.
Nov 14 09:52:51 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:52:51 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:52:51 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:52:51 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Auditing locally available compute resources for user (node: user) {{(pid=75229) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 09:52:51 user nova-compute[75229]: INFO nova.compute.manager [None req-c25a03ba-4af2-4c6c-bab0-688b8c9871ea tempest-ServersNegativeTestJSON-1483105767 tempest-ServersNegativeTestJSON-1483105767-project-member] [instance: cc486509-4506-415c-a2b4-986d05da2317] Took 5.25 seconds to spawn the instance on the hypervisor.
Nov 14 09:52:51 user nova-compute[75229]: DEBUG nova.compute.manager [None req-c25a03ba-4af2-4c6c-bab0-688b8c9871ea tempest-ServersNegativeTestJSON-1483105767 tempest-ServersNegativeTestJSON-1483105767-project-member] [instance: cc486509-4506-415c-a2b4-986d05da2317] Checking state {{(pid=75229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 09:52:51 user nova-compute[75229]: INFO nova.compute.manager [None req-c25a03ba-4af2-4c6c-bab0-688b8c9871ea tempest-ServersNegativeTestJSON-1483105767 tempest-ServersNegativeTestJSON-1483105767-project-member] [instance: cc486509-4506-415c-a2b4-986d05da2317] Took 6.51 seconds to build instance.
Nov 14 09:52:51 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-c25a03ba-4af2-4c6c-bab0-688b8c9871ea tempest-ServersNegativeTestJSON-1483105767 tempest-ServersNegativeTestJSON-1483105767-project-member] Lock "cc486509-4506-415c-a2b4-986d05da2317" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.628s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:52:51 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d73f431b-d002-4206-8b52-7d313a43dccb/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:52:51 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d73f431b-d002-4206-8b52-7d313a43dccb/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:52:51 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d73f431b-d002-4206-8b52-7d313a43dccb/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:52:51 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d73f431b-d002-4206-8b52-7d313a43dccb/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:52:51 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7750cbc-b3d0-44aa-8b88-c291ba007a8a/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:52:52 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7750cbc-b3d0-44aa-8b88-c291ba007a8a/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:52:52 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7750cbc-b3d0-44aa-8b88-c291ba007a8a/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:52:52 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7750cbc-b3d0-44aa-8b88-c291ba007a8a/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:52:52 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc486509-4506-415c-a2b4-986d05da2317/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:52:52 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc486509-4506-415c-a2b4-986d05da2317/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:52:52 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc486509-4506-415c-a2b4-986d05da2317/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:52:52 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:52:52 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc486509-4506-415c-a2b4-986d05da2317/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:52:52 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be813b28-133f-416a-b2b5-dc0b9e4064b7/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:52:52 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be813b28-133f-416a-b2b5-dc0b9e4064b7/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:52:52 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be813b28-133f-416a-b2b5-dc0b9e4064b7/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:52:52 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be813b28-133f-416a-b2b5-dc0b9e4064b7/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:52:52 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/564d95eb-81c0-47a5-9979-2318fced06f5/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:52:53 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/564d95eb-81c0-47a5-9979-2318fced06f5/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:52:53 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/564d95eb-81c0-47a5-9979-2318fced06f5/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:52:53 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/564d95eb-81c0-47a5-9979-2318fced06f5/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:52:53 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/673624b6-e830-45e0-9215-ba79fd4f881e/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:52:53 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:52:53 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/673624b6-e830-45e0-9215-ba79fd4f881e/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:52:53 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/673624b6-e830-45e0-9215-ba79fd4f881e/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:52:53 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/673624b6-e830-45e0-9215-ba79fd4f881e/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:52:53 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e58500df-059a-4fce-afb7-ba36feca0697/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:52:53 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e58500df-059a-4fce-afb7-ba36feca0697/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:52:53 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e58500df-059a-4fce-afb7-ba36feca0697/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:52:54 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e58500df-059a-4fce-afb7-ba36feca0697/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:52:54 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c9fe69e-3f9d-4b30-a9e4-efc3e83efa17/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:52:54 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c9fe69e-3f9d-4b30-a9e4-efc3e83efa17/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:52:54 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c9fe69e-3f9d-4b30-a9e4-efc3e83efa17/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:52:54 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c9fe69e-3f9d-4b30-a9e4-efc3e83efa17/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:52:54 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4ce290f-6dd2-44b6-91be-8e775045837e/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:52:54 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4ce290f-6dd2-44b6-91be-8e775045837e/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:52:54 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4ce290f-6dd2-44b6-91be-8e775045837e/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:52:54 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4ce290f-6dd2-44b6-91be-8e775045837e/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:52:54 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94e2b266-2fe3-481a-bb1e-24f835a79ddf/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:52:55 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94e2b266-2fe3-481a-bb1e-24f835a79ddf/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:52:55 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94e2b266-2fe3-481a-bb1e-24f835a79ddf/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:52:55 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94e2b266-2fe3-481a-bb1e-24f835a79ddf/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:52:55 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75229) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 09:52:55 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4255af28-a111-4475-b207-67e335fd0835/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:52:55 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4255af28-a111-4475-b207-67e335fd0835/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:52:55 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4255af28-a111-4475-b207-67e335fd0835/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:52:55 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4255af28-a111-4475-b207-67e335fd0835/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:52:55 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=75229) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 09:52:55 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5170e9e-66e3-4df1-9807-4958cac6480e/disk.rescue --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:52:55 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5170e9e-66e3-4df1-9807-4958cac6480e/disk.rescue --force-share --output=json" returned: 0 in 0.172s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:52:55 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5170e9e-66e3-4df1-9807-4958cac6480e/disk.rescue --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:52:55 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5170e9e-66e3-4df1-9807-4958cac6480e/disk.rescue --force-share --output=json" returned: 0 in 0.178s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:52:55 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5170e9e-66e3-4df1-9807-4958cac6480e/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:52:56 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5170e9e-66e3-4df1-9807-4958cac6480e/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:52:56 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5170e9e-66e3-4df1-9807-4958cac6480e/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:52:56 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5170e9e-66e3-4df1-9807-4958cac6480e/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:52:56 user nova-compute[75229]: WARNING nova.virt.libvirt.driver [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 09:52:56 user nova-compute[75229]: WARNING nova.virt.libvirt.driver [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 09:52:56 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Hypervisor/Node resource view: name=user free_ram=7187MB free_disk=25.14987564086914GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75229) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 09:52:56 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:52:56 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:52:56 user nova-compute[75229]: WARNING nova.virt.libvirt.driver [None req-76645a83-9d4e-493c-b66b-f163587e840d tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance be813b28-133f-416a-b2b5-dc0b9e4064b7 is timed out.
Nov 14 09:52:56 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-76645a83-9d4e-493c-b66b-f163587e840d tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Successfully detached device vdb from instance be813b28-133f-416a-b2b5-dc0b9e4064b7 from the live domain config.
Nov 14 09:52:56 user nova-compute[75229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-76645a83-9d4e-493c-b66b-f163587e840d tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] [instance: be813b28-133f-416a-b2b5-dc0b9e4064b7] calling os-brick to detach iSCSI Volume {{(pid=75229) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 09:52:56 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-76645a83-9d4e-493c-b66b-f163587e840d tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f73f85151b0>, {'target_iqn': 'iqn.2010-10.org.openstack:a7902ab8-168d-4c8a-90e9-bf44d669ce2b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HBhZNQjK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 09:52:56 user nova-compute[75229]: WARNING os_brick.initiator.connectors.base [None req-76645a83-9d4e-493c-b66b-f163587e840d tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 09:52:56 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-76645a83-9d4e-493c-b66b-f163587e840d tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 09:52:56 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-76645a83-9d4e-493c-b66b-f163587e840d tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 09:52:56 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:52:56 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:52:56 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[241d8950-d464-462b-bebc-c3cf2a8c026b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2bae4836-52c2-428b-b299-a6a72899197d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a7902ab8-168d-4c8a-90e9-bf44d669ce2b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b590f04d-8a50-4810-8e66-05d846f4613f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:52:56 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-76645a83-9d4e-493c-b66b-f163587e840d tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 09:52:56 user nova-compute[75229]: No targets found.
Nov 14 09:52:56 user nova-compute[75229]: iSNS:
Nov 14 09:52:56 user nova-compute[75229]: No targets found.
Nov 14 09:52:56 user nova-compute[75229]: STATIC:
Nov 14 09:52:56 user nova-compute[75229]: Target: iqn.2010-10.org.openstack:2bae4836-52c2-428b-b299-a6a72899197d
Nov 14 09:52:56 user nova-compute[75229]:         Portal: 172.16.0.220:3260,-1
Nov 14 09:52:56 user nova-compute[75229]:                 Iface Name: default
Nov 14 09:52:56 user nova-compute[75229]: Target: iqn.2010-10.org.openstack:a7902ab8-168d-4c8a-90e9-bf44d669ce2b
Nov 14 09:52:56 user nova-compute[75229]:         Portal: 172.16.0.220:3260,-1
Nov 14 09:52:56 user nova-compute[75229]:                 Iface Name: default
Nov 14 09:52:56 user nova-compute[75229]: Target: iqn.2010-10.org.openstack:b590f04d-8a50-4810-8e66-05d846f4613f
Nov 14 09:52:56 user nova-compute[75229]:         Portal: 172.16.0.220:3260,-1
Nov 14 09:52:56 user nova-compute[75229]:                 Iface Name: default
Nov 14 09:52:56 user nova-compute[75229]: FIRMWARE:
Nov 14 09:52:56 user nova-compute[75229]: No targets found.
Nov 14 09:52:56 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 09:52:56 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-76645a83-9d4e-493c-b66b-f163587e840d tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 09:52:56 user nova-compute[75229]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 09:52:56 user nova-compute[75229]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75229) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 09:52:56 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-76645a83-9d4e-493c-b66b-f163587e840d tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a7902ab8-168d-4c8a-90e9-bf44d669ce2b', 0)] {{(pid=75229) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 09:52:56 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:52:56 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:52:56 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[81bd5965-4476-4e2a-9c2d-d33f7c74d125]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2bae4836-52c2-428b-b299-a6a72899197d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a7902ab8-168d-4c8a-90e9-bf44d669ce2b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b590f04d-8a50-4810-8e66-05d846f4613f\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:52:56 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:52:56 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:52:56 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4b8b931-a830-4f38-bb40-d9184e958ae1]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7902ab8-168d-4c8a-90e9-bf44d669ce2b (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bae4836-52c2-428b-b299-a6a72899197d (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b590f04d-8a50-4810-8e66-05d846f4613f (non-flash)\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:52:56 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-76645a83-9d4e-493c-b66b-f163587e840d tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7902ab8-168d-4c8a-90e9-bf44d669ce2b (non-flash)
Nov 14 09:52:56 user nova-compute[75229]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bae4836-52c2-428b-b299-a6a72899197d (non-flash)
Nov 14 09:52:56 user nova-compute[75229]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b590f04d-8a50-4810-8e66-05d846f4613f (non-flash)
Nov 14 09:52:56 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 09:52:56 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-76645a83-9d4e-493c-b66b-f163587e840d tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7902ab8-168d-4c8a-90e9-bf44d669ce2b (non-flash)
Nov 14 09:52:56 user nova-compute[75229]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bae4836-52c2-428b-b299-a6a72899197d (non-flash)
Nov 14 09:52:56 user nova-compute[75229]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b590f04d-8a50-4810-8e66-05d846f4613f (non-flash)
Nov 14 09:52:56 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 09:52:56 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-76645a83-9d4e-493c-b66b-f163587e840d tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f73d4c50280>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a7902ab8-168d-4c8a-90e9-bf44d669ce2b'): ({'sdb'}, set())}) {{(pid=75229) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 09:52:56 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-76645a83-9d4e-493c-b66b-f163587e840d tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Removing single pathed devices sdb {{(pid=75229) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 09:52:56 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:52:56 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:52:56 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ef2bf36-b72c-4224-81a5-50bcbde3d460]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:52:56 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:52:56 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:52:56 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[128bfff5-6fd3-43a3-9fd0-702835c6b8c9]: (4, ('ok\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:52:56 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-76645a83-9d4e-493c-b66b-f163587e840d tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Flushing IO for device /dev/sdb {{(pid=75229) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 09:52:56 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:52:56 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:52:56 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[a004ec23-cc95-43b6-acd9-20dd588a2908]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:52:56 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-76645a83-9d4e-493c-b66b-f163587e840d tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75229) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 09:52:56 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:52:56 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.045s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:52:56 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[22585a14-82cc-4020-a09f-d5f476d544ee]: (4, ('1', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:52:56 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-76645a83-9d4e-493c-b66b-f163587e840d tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75229) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 09:52:56 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-76645a83-9d4e-493c-b66b-f163587e840d tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] SCSI volumes sdb have been removed. {{(pid=75229) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 09:52:56 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-76645a83-9d4e-493c-b66b-f163587e840d tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a7902ab8-168d-4c8a-90e9-bf44d669ce2b')] {{(pid=75229) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 09:52:56 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7902ab8-168d-4c8a-90e9-bf44d669ce2b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:52:56 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7902ab8-168d-4c8a-90e9-bf44d669ce2b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:52:56 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[30570808-63d5-4c3f-9d41-4063bcba2b88]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:52:56 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-76645a83-9d4e-493c-b66b-f163587e840d tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:52:56 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7902ab8-168d-4c8a-90e9-bf44d669ce2b -p 172.16.0.220:3260 --logout {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:52:56 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Instance a7750cbc-b3d0-44aa-8b88-c291ba007a8a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 09:52:56 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Instance be813b28-133f-416a-b2b5-dc0b9e4064b7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 09:52:56 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Instance 4255af28-a111-4475-b207-67e335fd0835 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 09:52:56 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Instance 4c9fe69e-3f9d-4b30-a9e4-efc3e83efa17 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 09:52:56 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Instance b5170e9e-66e3-4df1-9807-4958cac6480e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 09:52:56 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Instance a4ce290f-6dd2-44b6-91be-8e775045837e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 09:52:56 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Instance 94e2b266-2fe3-481a-bb1e-24f835a79ddf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 09:52:56 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Instance e58500df-059a-4fce-afb7-ba36feca0697 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 09:52:56 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Instance d73f431b-d002-4206-8b52-7d313a43dccb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 09:52:56 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Instance 673624b6-e830-45e0-9215-ba79fd4f881e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 09:52:56 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Instance 564d95eb-81c0-47a5-9979-2318fced06f5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 09:52:56 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Instance cc486509-4506-415c-a2b4-986d05da2317 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 09:52:56 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=75229) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 09:52:56 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=12GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=75229) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 09:52:57 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7902ab8-168d-4c8a-90e9-bf44d669ce2b -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:52:57 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[b509e88a-71dd-4553-aac4-e2040c12dc82]: (4, ('Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:a7902ab8-168d-4c8a-90e9-bf44d669ce2b, portal: 172.16.0.220,3260]\nLogout of [sid: 21, target: iqn.2010-10.org.openstack:a7902ab8-168d-4c8a-90e9-bf44d669ce2b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:52:57 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-76645a83-9d4e-493c-b66b-f163587e840d tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:a7902ab8-168d-4c8a-90e9-bf44d669ce2b, portal: 172.16.0.220,3260]
Nov 14 09:52:57 user nova-compute[75229]: Logout of [sid: 21, target: iqn.2010-10.org.openstack:a7902ab8-168d-4c8a-90e9-bf44d669ce2b, portal: 172.16.0.220,3260] successful.
Nov 14 09:52:57 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:52:57 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7902ab8-168d-4c8a-90e9-bf44d669ce2b -p 172.16.0.220:3260 --op delete {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:52:57 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7902ab8-168d-4c8a-90e9-bf44d669ce2b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:52:57 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[87670d70-65d1-4b55-accb-0a2165d15e19]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:52:57 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-76645a83-9d4e-493c-b66b-f163587e840d tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:52:57 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-76645a83-9d4e-493c-b66b-f163587e840d tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.306s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 09:52:57 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-76645a83-9d4e-493c-b66b-f163587e840d tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] <== disconnect_volume: return (307ms) None {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 09:52:57 user nova-compute[75229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-76645a83-9d4e-493c-b66b-f163587e840d tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] [instance: be813b28-133f-416a-b2b5-dc0b9e4064b7] Disconnected iSCSI Volume {{(pid=75229) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 09:52:57 user nova-compute[75229]: DEBUG nova.compute.provider_tree [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Inventory has not changed in ProviderTree for provider: d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 {{(pid=75229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 09:52:57 user nova-compute[75229]: DEBUG nova.scheduler.client.report [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Inventory has not changed for provider d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 09:52:57 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Compute_service record updated for user:user {{(pid=75229) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 09:52:57 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.695s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:52:57 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-1b79a5e6-402e-495a-9b0b-f33a6d987d0c tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Acquiring lock "4255af28-a111-4475-b207-67e335fd0835" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:52:57 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-1b79a5e6-402e-495a-9b0b-f33a6d987d0c tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Lock "4255af28-a111-4475-b207-67e335fd0835" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:52:57 user nova-compute[75229]: INFO nova.compute.manager [None req-1b79a5e6-402e-495a-9b0b-f33a6d987d0c tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] [instance: 4255af28-a111-4475-b207-67e335fd0835] Detaching volume 2bae4836-52c2-428b-b299-a6a72899197d
Nov 14 09:52:57 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:52:57 user nova-compute[75229]: INFO nova.virt.block_device [None req-1b79a5e6-402e-495a-9b0b-f33a6d987d0c tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] [instance: 4255af28-a111-4475-b207-67e335fd0835] Attempting to driver detach volume 2bae4836-52c2-428b-b299-a6a72899197d from mountpoint /dev/vdb
Nov 14 09:52:57 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-1b79a5e6-402e-495a-9b0b-f33a6d987d0c tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Attempting to detach device vdb from instance 4255af28-a111-4475-b207-67e335fd0835 from the persistent domain config. {{(pid=75229) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 09:52:57 user nova-compute[75229]: DEBUG nova.virt.libvirt.guest [None req-1b79a5e6-402e-495a-9b0b-f33a6d987d0c tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 09:52:57 user nova-compute[75229]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 09:52:57 user nova-compute[75229]:   <source dev="/dev/sdf"/>
Nov 14 09:52:57 user nova-compute[75229]:   <target dev="vdb" bus="virtio"/>
Nov 14 09:52:57 user nova-compute[75229]:   <serial>2bae4836-52c2-428b-b299-a6a72899197d</serial>
Nov 14 09:52:57 user nova-compute[75229]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 09:52:57 user nova-compute[75229]: </disk>
Nov 14 09:52:57 user nova-compute[75229]:  {{(pid=75229) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 09:52:57 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-1b79a5e6-402e-495a-9b0b-f33a6d987d0c tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Successfully detached device vdb from instance 4255af28-a111-4475-b207-67e335fd0835 from the persistent domain config.
Nov 14 09:52:57 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-1b79a5e6-402e-495a-9b0b-f33a6d987d0c tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 4255af28-a111-4475-b207-67e335fd0835 from the live domain config. {{(pid=75229) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 09:52:57 user nova-compute[75229]: DEBUG nova.virt.libvirt.guest [None req-1b79a5e6-402e-495a-9b0b-f33a6d987d0c tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 09:52:57 user nova-compute[75229]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 09:52:57 user nova-compute[75229]:   <source dev="/dev/sdf"/>
Nov 14 09:52:57 user nova-compute[75229]:   <target dev="vdb" bus="virtio"/>
Nov 14 09:52:57 user nova-compute[75229]:   <serial>2bae4836-52c2-428b-b299-a6a72899197d</serial>
Nov 14 09:52:57 user nova-compute[75229]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 09:52:57 user nova-compute[75229]: </disk>
Nov 14 09:52:57 user nova-compute[75229]:  {{(pid=75229) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 09:52:57 user nova-compute[75229]: DEBUG nova.objects.instance [None req-76645a83-9d4e-493c-b66b-f163587e840d tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Lazy-loading 'flavor' on Instance uuid be813b28-133f-416a-b2b5-dc0b9e4064b7 {{(pid=75229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 09:52:57 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-76645a83-9d4e-493c-b66b-f163587e840d tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Lock "be813b28-133f-416a-b2b5-dc0b9e4064b7" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.878s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:52:57 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 09:52:57 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 09:52:57 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 09:52:57 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 09:52:57 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 09:52:57 user nova-compute[75229]: DEBUG nova.compute.manager [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75229) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 09:52:57 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-1b79a5e6-402e-495a-9b0b-f33a6d987d0c tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 4255af28-a111-4475-b207-67e335fd0835 {{(pid=75229) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 09:52:58 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:53:02 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:53:03 user nova-compute[75229]: DEBUG nova.compute.manager [req-22749cfa-a288-47af-a088-ea848014e5c8 req-ec9444fa-23a3-4c2e-853d-efc867f31274 service nova] [instance: d73f431b-d002-4206-8b52-7d313a43dccb] Received event network-changed-5a68432e-63fc-48e8-bc8c-62e0cd22033c {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:53:03 user nova-compute[75229]: DEBUG nova.compute.manager [req-22749cfa-a288-47af-a088-ea848014e5c8 req-ec9444fa-23a3-4c2e-853d-efc867f31274 service nova] [instance: d73f431b-d002-4206-8b52-7d313a43dccb] Refreshing instance network info cache due to event network-changed-5a68432e-63fc-48e8-bc8c-62e0cd22033c. {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 09:53:03 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-22749cfa-a288-47af-a088-ea848014e5c8 req-ec9444fa-23a3-4c2e-853d-efc867f31274 service nova] Acquiring lock "refresh_cache-d73f431b-d002-4206-8b52-7d313a43dccb" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 09:53:03 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-22749cfa-a288-47af-a088-ea848014e5c8 req-ec9444fa-23a3-4c2e-853d-efc867f31274 service nova] Acquired lock "refresh_cache-d73f431b-d002-4206-8b52-7d313a43dccb" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 09:53:03 user nova-compute[75229]: DEBUG nova.network.neutron [req-22749cfa-a288-47af-a088-ea848014e5c8 req-ec9444fa-23a3-4c2e-853d-efc867f31274 service nova] [instance: d73f431b-d002-4206-8b52-7d313a43dccb] Refreshing network info cache for port 5a68432e-63fc-48e8-bc8c-62e0cd22033c {{(pid=75229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 09:53:03 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:53:03 user nova-compute[75229]: DEBUG nova.network.neutron [req-22749cfa-a288-47af-a088-ea848014e5c8 req-ec9444fa-23a3-4c2e-853d-efc867f31274 service nova] [instance: d73f431b-d002-4206-8b52-7d313a43dccb] Updated VIF entry in instance network info cache for port 5a68432e-63fc-48e8-bc8c-62e0cd22033c. {{(pid=75229) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 09:53:03 user nova-compute[75229]: DEBUG nova.network.neutron [req-22749cfa-a288-47af-a088-ea848014e5c8 req-ec9444fa-23a3-4c2e-853d-efc867f31274 service nova] [instance: d73f431b-d002-4206-8b52-7d313a43dccb] Updating instance_info_cache with network_info: [{"id": "5a68432e-63fc-48e8-bc8c-62e0cd22033c", "address": "fa:16:3e:0c:97:35", "network": {"id": "589aea41-545f-4875-ab56-b7aa273dad6f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-785276916-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.92", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee9447f169de43829fe3ed51592752e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a68432e-63", "ovs_interfaceid": "5a68432e-63fc-48e8-bc8c-62e0cd22033c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 09:53:03 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-22749cfa-a288-47af-a088-ea848014e5c8 req-ec9444fa-23a3-4c2e-853d-efc867f31274 service nova] Releasing lock "refresh_cache-d73f431b-d002-4206-8b52-7d313a43dccb" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 09:53:05 user nova-compute[75229]: DEBUG nova.compute.manager [req-0bbb2564-bbf0-4f97-866d-1fbbba84a86a req-52e48a0b-e614-44c2-8a17-d7489a27e87a service nova] [instance: 673624b6-e830-45e0-9215-ba79fd4f881e] Received event network-changed-0102e03b-5b3a-46ab-84de-c836b2b46ca5 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:53:05 user nova-compute[75229]: DEBUG nova.compute.manager [req-0bbb2564-bbf0-4f97-866d-1fbbba84a86a req-52e48a0b-e614-44c2-8a17-d7489a27e87a service nova] [instance: 673624b6-e830-45e0-9215-ba79fd4f881e] Refreshing instance network info cache due to event network-changed-0102e03b-5b3a-46ab-84de-c836b2b46ca5. {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 09:53:05 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-0bbb2564-bbf0-4f97-866d-1fbbba84a86a req-52e48a0b-e614-44c2-8a17-d7489a27e87a service nova] Acquiring lock "refresh_cache-673624b6-e830-45e0-9215-ba79fd4f881e" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 09:53:05 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-0bbb2564-bbf0-4f97-866d-1fbbba84a86a req-52e48a0b-e614-44c2-8a17-d7489a27e87a service nova] Acquired lock "refresh_cache-673624b6-e830-45e0-9215-ba79fd4f881e" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 09:53:05 user nova-compute[75229]: DEBUG nova.network.neutron [req-0bbb2564-bbf0-4f97-866d-1fbbba84a86a req-52e48a0b-e614-44c2-8a17-d7489a27e87a service nova] [instance: 673624b6-e830-45e0-9215-ba79fd4f881e] Refreshing network info cache for port 0102e03b-5b3a-46ab-84de-c836b2b46ca5 {{(pid=75229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 09:53:05 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-7b6a282a-27a5-485a-be6a-bfb32bf39919 tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] Acquiring lock "673624b6-e830-45e0-9215-ba79fd4f881e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:53:05 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-7b6a282a-27a5-485a-be6a-bfb32bf39919 tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] Lock "673624b6-e830-45e0-9215-ba79fd4f881e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:53:05 user nova-compute[75229]: DEBUG nova.objects.instance [None req-7b6a282a-27a5-485a-be6a-bfb32bf39919 tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] Lazy-loading 'flavor' on Instance uuid 673624b6-e830-45e0-9215-ba79fd4f881e {{(pid=75229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 09:53:05 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-7b6a282a-27a5-485a-be6a-bfb32bf39919 tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] [instance: 673624b6-e830-45e0-9215-ba79fd4f881e] Ignoring supplied device name: /dev/vdb
Nov 14 09:53:05 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-7b6a282a-27a5-485a-be6a-bfb32bf39919 tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] Lock "673624b6-e830-45e0-9215-ba79fd4f881e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:53:05 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-7b6a282a-27a5-485a-be6a-bfb32bf39919 tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] Acquiring lock "673624b6-e830-45e0-9215-ba79fd4f881e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:53:05 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-7b6a282a-27a5-485a-be6a-bfb32bf39919 tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] Lock "673624b6-e830-45e0-9215-ba79fd4f881e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:53:05 user nova-compute[75229]: INFO nova.compute.manager [None req-7b6a282a-27a5-485a-be6a-bfb32bf39919 tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] [instance: 673624b6-e830-45e0-9215-ba79fd4f881e] Attaching volume c545a289-274d-485e-8787-3c8cb01f244e to /dev/vdb
Nov 14 09:53:05 user nova-compute[75229]: DEBUG os_brick.utils [None req-7b6a282a-27a5-485a-be6a-bfb32bf39919 tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 09:53:05 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:53:05 user nova-compute[75229]: DEBUG nova.network.neutron [req-0bbb2564-bbf0-4f97-866d-1fbbba84a86a req-52e48a0b-e614-44c2-8a17-d7489a27e87a service nova] [instance: 673624b6-e830-45e0-9215-ba79fd4f881e] Updated VIF entry in instance network info cache for port 0102e03b-5b3a-46ab-84de-c836b2b46ca5. {{(pid=75229) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 09:53:05 user nova-compute[75229]: DEBUG nova.network.neutron [req-0bbb2564-bbf0-4f97-866d-1fbbba84a86a req-52e48a0b-e614-44c2-8a17-d7489a27e87a service nova] [instance: 673624b6-e830-45e0-9215-ba79fd4f881e] Updating instance_info_cache with network_info: [{"id": "0102e03b-5b3a-46ab-84de-c836b2b46ca5", "address": "fa:16:3e:b1:c1:9c", "network": {"id": "4bc624aa-efaf-45a9-b889-84d4bf2953b4", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-271284704-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d2e9dceab8a45eaa3adb619433b7cf0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0102e03b-5b", "ovs_interfaceid": "0102e03b-5b3a-46ab-84de-c836b2b46ca5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 09:53:05 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:53:05 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2f72bec-0ff6-4270-bf1a-8e5506c1e260]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f1154031c835\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:53:05 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:53:05 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-0bbb2564-bbf0-4f97-866d-1fbbba84a86a req-52e48a0b-e614-44c2-8a17-d7489a27e87a service nova] Releasing lock "refresh_cache-673624b6-e830-45e0-9215-ba79fd4f881e" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 09:53:05 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.025s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:53:05 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[75f19a3e-0bda-4ff1-aa68-a7a74dbd91ec]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:53:05 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:53:05 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:53:05 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[554e65e4-b94c-4ff6-91e1-6847b02b6494]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:53:05 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[edb75831-2a04-4252-ae47-9f9669afb354]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:53:05 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-7b6a282a-27a5-485a-be6a-bfb32bf39919 tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] Running cmd (subprocess): nvme version {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:53:05 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-7b6a282a-27a5-485a-be6a-bfb32bf39919 tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] 'nvme version' failed. Not Retrying. {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 09:53:05 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7b6a282a-27a5-485a-be6a-bfb32bf39919 tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] nvme not present on system {{(pid=75229) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 09:53:05 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:53:05 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 09:53:05 user nova-compute[75229]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 09:53:05 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[55ada350-bbf1-49cd-afc8-6fba0812be67]: (4, '') {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:53:05 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.lightos [None req-7b6a282a-27a5-485a-be6a-bfb32bf39919 tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75229) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 09:53:05 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.lightos [None req-7b6a282a-27a5-485a-be6a-bfb32bf39919 tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75229) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 09:53:05 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.lightos [None req-7b6a282a-27a5-485a-be6a-bfb32bf39919 tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] LIGHTOS: no hostnqn found. {{(pid=75229) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 09:53:05 user nova-compute[75229]: DEBUG os_brick.utils [None req-7b6a282a-27a5-485a-be6a-bfb32bf39919 tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] <== get_connector_properties: return (136ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f1154031c835', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 09:53:05 user nova-compute[75229]: DEBUG nova.virt.block_device [None req-7b6a282a-27a5-485a-be6a-bfb32bf39919 tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] [instance: 673624b6-e830-45e0-9215-ba79fd4f881e] Updating existing volume attachment record: a257d125-2332-4cdd-9a47-1923d4948632 {{(pid=75229) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 09:53:05 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-be76230d-3644-409c-abb4-c77bafe394f8 tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Acquiring lock "d73f431b-d002-4206-8b52-7d313a43dccb" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:53:05 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-be76230d-3644-409c-abb4-c77bafe394f8 tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Lock "d73f431b-d002-4206-8b52-7d313a43dccb" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:53:05 user nova-compute[75229]: INFO nova.compute.manager [None req-be76230d-3644-409c-abb4-c77bafe394f8 tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] [instance: d73f431b-d002-4206-8b52-7d313a43dccb] Shelving
Nov 14 09:53:05 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:53:06 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:53:06 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:53:06 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:53:06 user nova-compute[75229]: DEBUG nova.compute.manager [req-34cec551-f8e0-416f-b985-170a62e61a8c req-f94af2cd-6fb7-4b29-ba3e-df3d60262a32 service nova] [instance: d73f431b-d002-4206-8b52-7d313a43dccb] Received event network-vif-unplugged-5a68432e-63fc-48e8-bc8c-62e0cd22033c {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:53:06 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-34cec551-f8e0-416f-b985-170a62e61a8c req-f94af2cd-6fb7-4b29-ba3e-df3d60262a32 service nova] Acquiring lock "d73f431b-d002-4206-8b52-7d313a43dccb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:53:06 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-34cec551-f8e0-416f-b985-170a62e61a8c req-f94af2cd-6fb7-4b29-ba3e-df3d60262a32 service nova] Lock "d73f431b-d002-4206-8b52-7d313a43dccb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:53:06 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-34cec551-f8e0-416f-b985-170a62e61a8c req-f94af2cd-6fb7-4b29-ba3e-df3d60262a32 service nova] Lock "d73f431b-d002-4206-8b52-7d313a43dccb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:53:06 user nova-compute[75229]: DEBUG nova.compute.manager [req-34cec551-f8e0-416f-b985-170a62e61a8c req-f94af2cd-6fb7-4b29-ba3e-df3d60262a32 service nova] [instance: d73f431b-d002-4206-8b52-7d313a43dccb] No waiting events found dispatching network-vif-unplugged-5a68432e-63fc-48e8-bc8c-62e0cd22033c {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 09:53:06 user nova-compute[75229]: WARNING nova.compute.manager [req-34cec551-f8e0-416f-b985-170a62e61a8c req-f94af2cd-6fb7-4b29-ba3e-df3d60262a32 service nova] [instance: d73f431b-d002-4206-8b52-7d313a43dccb] Received unexpected event network-vif-unplugged-5a68432e-63fc-48e8-bc8c-62e0cd22033c for instance with vm_state active and task_state shelving.
Nov 14 09:53:06 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:53:06 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:53:06 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:53:06 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:53:06 user nova-compute[75229]: INFO nova.virt.libvirt.driver [-] [instance: d73f431b-d002-4206-8b52-7d313a43dccb] Instance destroyed successfully.
Nov 14 09:53:06 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:53:06 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-be76230d-3644-409c-abb4-c77bafe394f8 tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] [instance: d73f431b-d002-4206-8b52-7d313a43dccb] Beginning cold snapshot process
Nov 14 09:53:06 user nova-compute[75229]: DEBUG nova.privsep.utils [None req-be76230d-3644-409c-abb4-c77bafe394f8 tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75229) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 14 09:53:06 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-be76230d-3644-409c-abb4-c77bafe394f8 tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/d73f431b-d002-4206-8b52-7d313a43dccb/disk /opt/stack/data/nova/instances/snapshots/tmpuahr3a5i/59f92d4775cf447c82e886b148ee3bea {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:53:07 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:53:07 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:53:07 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:53:07 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:53:07 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:53:07 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:53:07 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:53:07 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:53:07 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-be76230d-3644-409c-abb4-c77bafe394f8 tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/d73f431b-d002-4206-8b52-7d313a43dccb/disk /opt/stack/data/nova/instances/snapshots/tmpuahr3a5i/59f92d4775cf447c82e886b148ee3bea" returned: 0 in 0.586s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:53:07 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-be76230d-3644-409c-abb4-c77bafe394f8 tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] [instance: d73f431b-d002-4206-8b52-7d313a43dccb] Snapshot extracted, beginning image upload
Nov 14 09:53:07 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:53:08 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:53:08 user nova-compute[75229]: DEBUG nova.compute.manager [req-2375fce9-32be-41e2-8ae7-436129e109f8 req-6fac8215-a69f-4c01-b883-63be761874e7 service nova] [instance: d73f431b-d002-4206-8b52-7d313a43dccb] Received event network-vif-plugged-5a68432e-63fc-48e8-bc8c-62e0cd22033c {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:53:08 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-2375fce9-32be-41e2-8ae7-436129e109f8 req-6fac8215-a69f-4c01-b883-63be761874e7 service nova] Acquiring lock "d73f431b-d002-4206-8b52-7d313a43dccb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:53:08 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-2375fce9-32be-41e2-8ae7-436129e109f8 req-6fac8215-a69f-4c01-b883-63be761874e7 service nova] Lock "d73f431b-d002-4206-8b52-7d313a43dccb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:53:08 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-2375fce9-32be-41e2-8ae7-436129e109f8 req-6fac8215-a69f-4c01-b883-63be761874e7 service nova] Lock "d73f431b-d002-4206-8b52-7d313a43dccb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:53:08 user nova-compute[75229]: DEBUG nova.compute.manager [req-2375fce9-32be-41e2-8ae7-436129e109f8 req-6fac8215-a69f-4c01-b883-63be761874e7 service nova] [instance: d73f431b-d002-4206-8b52-7d313a43dccb] No waiting events found dispatching network-vif-plugged-5a68432e-63fc-48e8-bc8c-62e0cd22033c {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 09:53:08 user nova-compute[75229]: WARNING nova.compute.manager [req-2375fce9-32be-41e2-8ae7-436129e109f8 req-6fac8215-a69f-4c01-b883-63be761874e7 service nova] [instance: d73f431b-d002-4206-8b52-7d313a43dccb] Received unexpected event network-vif-plugged-5a68432e-63fc-48e8-bc8c-62e0cd22033c for instance with vm_state active and task_state shelving_image_uploading.
Nov 14 09:53:08 user nova-compute[75229]: DEBUG nova.compute.manager [req-2375fce9-32be-41e2-8ae7-436129e109f8 req-6fac8215-a69f-4c01-b883-63be761874e7 service nova] [instance: d73f431b-d002-4206-8b52-7d313a43dccb] Received event network-vif-plugged-5a68432e-63fc-48e8-bc8c-62e0cd22033c {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:53:08 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-2375fce9-32be-41e2-8ae7-436129e109f8 req-6fac8215-a69f-4c01-b883-63be761874e7 service nova] Acquiring lock "d73f431b-d002-4206-8b52-7d313a43dccb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:53:08 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-2375fce9-32be-41e2-8ae7-436129e109f8 req-6fac8215-a69f-4c01-b883-63be761874e7 service nova] Lock "d73f431b-d002-4206-8b52-7d313a43dccb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:53:08 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-2375fce9-32be-41e2-8ae7-436129e109f8 req-6fac8215-a69f-4c01-b883-63be761874e7 service nova] Lock "d73f431b-d002-4206-8b52-7d313a43dccb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:53:08 user nova-compute[75229]: DEBUG nova.compute.manager [req-2375fce9-32be-41e2-8ae7-436129e109f8 req-6fac8215-a69f-4c01-b883-63be761874e7 service nova] [instance: d73f431b-d002-4206-8b52-7d313a43dccb] No waiting events found dispatching network-vif-plugged-5a68432e-63fc-48e8-bc8c-62e0cd22033c {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 09:53:08 user nova-compute[75229]: WARNING nova.compute.manager [req-2375fce9-32be-41e2-8ae7-436129e109f8 req-6fac8215-a69f-4c01-b883-63be761874e7 service nova] [instance: d73f431b-d002-4206-8b52-7d313a43dccb] Received unexpected event network-vif-plugged-5a68432e-63fc-48e8-bc8c-62e0cd22033c for instance with vm_state active and task_state shelving_image_uploading.
Nov 14 09:53:08 user nova-compute[75229]: DEBUG nova.compute.manager [req-2375fce9-32be-41e2-8ae7-436129e109f8 req-6fac8215-a69f-4c01-b883-63be761874e7 service nova] [instance: d73f431b-d002-4206-8b52-7d313a43dccb] Received event network-vif-plugged-5a68432e-63fc-48e8-bc8c-62e0cd22033c {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:53:08 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-2375fce9-32be-41e2-8ae7-436129e109f8 req-6fac8215-a69f-4c01-b883-63be761874e7 service nova] Acquiring lock "d73f431b-d002-4206-8b52-7d313a43dccb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:53:08 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-2375fce9-32be-41e2-8ae7-436129e109f8 req-6fac8215-a69f-4c01-b883-63be761874e7 service nova] Lock "d73f431b-d002-4206-8b52-7d313a43dccb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:53:08 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-2375fce9-32be-41e2-8ae7-436129e109f8 req-6fac8215-a69f-4c01-b883-63be761874e7 service nova] Lock "d73f431b-d002-4206-8b52-7d313a43dccb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:53:08 user nova-compute[75229]: DEBUG nova.compute.manager [req-2375fce9-32be-41e2-8ae7-436129e109f8 req-6fac8215-a69f-4c01-b883-63be761874e7 service nova] [instance: d73f431b-d002-4206-8b52-7d313a43dccb] No waiting events found dispatching network-vif-plugged-5a68432e-63fc-48e8-bc8c-62e0cd22033c {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 09:53:08 user nova-compute[75229]: WARNING nova.compute.manager [req-2375fce9-32be-41e2-8ae7-436129e109f8 req-6fac8215-a69f-4c01-b883-63be761874e7 service nova] [instance: d73f431b-d002-4206-8b52-7d313a43dccb] Received unexpected event network-vif-plugged-5a68432e-63fc-48e8-bc8c-62e0cd22033c for instance with vm_state active and task_state shelving_image_uploading.
Nov 14 09:53:08 user nova-compute[75229]: DEBUG nova.compute.manager [req-2375fce9-32be-41e2-8ae7-436129e109f8 req-6fac8215-a69f-4c01-b883-63be761874e7 service nova] [instance: d73f431b-d002-4206-8b52-7d313a43dccb] Received event network-vif-unplugged-5a68432e-63fc-48e8-bc8c-62e0cd22033c {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:53:08 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-2375fce9-32be-41e2-8ae7-436129e109f8 req-6fac8215-a69f-4c01-b883-63be761874e7 service nova] Acquiring lock "d73f431b-d002-4206-8b52-7d313a43dccb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:53:08 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-2375fce9-32be-41e2-8ae7-436129e109f8 req-6fac8215-a69f-4c01-b883-63be761874e7 service nova] Lock "d73f431b-d002-4206-8b52-7d313a43dccb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:53:08 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-2375fce9-32be-41e2-8ae7-436129e109f8 req-6fac8215-a69f-4c01-b883-63be761874e7 service nova] Lock "d73f431b-d002-4206-8b52-7d313a43dccb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:53:08 user nova-compute[75229]: DEBUG nova.compute.manager [req-2375fce9-32be-41e2-8ae7-436129e109f8 req-6fac8215-a69f-4c01-b883-63be761874e7 service nova] [instance: d73f431b-d002-4206-8b52-7d313a43dccb] No waiting events found dispatching network-vif-unplugged-5a68432e-63fc-48e8-bc8c-62e0cd22033c {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 09:53:08 user nova-compute[75229]: WARNING nova.compute.manager [req-2375fce9-32be-41e2-8ae7-436129e109f8 req-6fac8215-a69f-4c01-b883-63be761874e7 service nova] [instance: d73f431b-d002-4206-8b52-7d313a43dccb] Received unexpected event network-vif-unplugged-5a68432e-63fc-48e8-bc8c-62e0cd22033c for instance with vm_state active and task_state shelving_image_uploading.
Nov 14 09:53:08 user nova-compute[75229]: DEBUG nova.compute.manager [req-2375fce9-32be-41e2-8ae7-436129e109f8 req-6fac8215-a69f-4c01-b883-63be761874e7 service nova] [instance: d73f431b-d002-4206-8b52-7d313a43dccb] Received event network-vif-plugged-5a68432e-63fc-48e8-bc8c-62e0cd22033c {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:53:08 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-2375fce9-32be-41e2-8ae7-436129e109f8 req-6fac8215-a69f-4c01-b883-63be761874e7 service nova] Acquiring lock "d73f431b-d002-4206-8b52-7d313a43dccb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:53:08 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-2375fce9-32be-41e2-8ae7-436129e109f8 req-6fac8215-a69f-4c01-b883-63be761874e7 service nova] Lock "d73f431b-d002-4206-8b52-7d313a43dccb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:53:08 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-2375fce9-32be-41e2-8ae7-436129e109f8 req-6fac8215-a69f-4c01-b883-63be761874e7 service nova] Lock "d73f431b-d002-4206-8b52-7d313a43dccb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:53:08 user nova-compute[75229]: DEBUG nova.compute.manager [req-2375fce9-32be-41e2-8ae7-436129e109f8 req-6fac8215-a69f-4c01-b883-63be761874e7 service nova] [instance: d73f431b-d002-4206-8b52-7d313a43dccb] No waiting events found dispatching network-vif-plugged-5a68432e-63fc-48e8-bc8c-62e0cd22033c {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 09:53:08 user nova-compute[75229]: WARNING nova.compute.manager [req-2375fce9-32be-41e2-8ae7-436129e109f8 req-6fac8215-a69f-4c01-b883-63be761874e7 service nova] [instance: d73f431b-d002-4206-8b52-7d313a43dccb] Received unexpected event network-vif-plugged-5a68432e-63fc-48e8-bc8c-62e0cd22033c for instance with vm_state active and task_state shelving_image_uploading.
Nov 14 09:53:10 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-be76230d-3644-409c-abb4-c77bafe394f8 tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] [instance: d73f431b-d002-4206-8b52-7d313a43dccb] Snapshot image upload complete
Nov 14 09:53:10 user nova-compute[75229]: DEBUG nova.compute.manager [None req-be76230d-3644-409c-abb4-c77bafe394f8 tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] [instance: d73f431b-d002-4206-8b52-7d313a43dccb] Checking state {{(pid=75229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 09:53:10 user nova-compute[75229]: INFO nova.compute.manager [None req-be76230d-3644-409c-abb4-c77bafe394f8 tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] [instance: d73f431b-d002-4206-8b52-7d313a43dccb] Shelve offloading
Nov 14 09:53:10 user nova-compute[75229]: INFO nova.virt.libvirt.driver [-] [instance: d73f431b-d002-4206-8b52-7d313a43dccb] Instance destroyed successfully.
Nov 14 09:53:10 user nova-compute[75229]: DEBUG nova.compute.manager [None req-be76230d-3644-409c-abb4-c77bafe394f8 tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] [instance: d73f431b-d002-4206-8b52-7d313a43dccb] Checking state {{(pid=75229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 09:53:10 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-be76230d-3644-409c-abb4-c77bafe394f8 tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Acquiring lock "refresh_cache-d73f431b-d002-4206-8b52-7d313a43dccb" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 09:53:10 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-be76230d-3644-409c-abb4-c77bafe394f8 tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Acquired lock "refresh_cache-d73f431b-d002-4206-8b52-7d313a43dccb" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 09:53:10 user nova-compute[75229]: DEBUG nova.network.neutron [None req-be76230d-3644-409c-abb4-c77bafe394f8 tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] [instance: d73f431b-d002-4206-8b52-7d313a43dccb] Building network info cache for instance {{(pid=75229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 09:53:10 user nova-compute[75229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7b6a282a-27a5-485a-be6a-bfb32bf39919 tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] [instance: 673624b6-e830-45e0-9215-ba79fd4f881e] Calling os-brick to attach iSCSI Volume {{(pid=75229) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 09:53:10 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b6a282a-27a5-485a-be6a-bfb32bf39919 tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f73f85151b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c545a289-274d-485e-8787-3c8cb01f244e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ygvpNczb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 09:53:10 user nova-compute[75229]: WARNING os_brick.initiator.connectors.base [None req-7b6a282a-27a5-485a-be6a-bfb32bf39919 tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 09:53:10 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-7b6a282a-27a5-485a-be6a-bfb32bf39919 tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 09:53:10 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-7b6a282a-27a5-485a-be6a-bfb32bf39919 tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 09:53:10 user nova-compute[75229]: WARNING os_brick.initiator.connectors.base [None req-7b6a282a-27a5-485a-be6a-bfb32bf39919 tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 09:53:10 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-7b6a282a-27a5-485a-be6a-bfb32bf39919 tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c545a289-274d-485e-8787-3c8cb01f244e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 09:53:10 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-7b6a282a-27a5-485a-be6a-bfb32bf39919 tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c545a289-274d-485e-8787-3c8cb01f244e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 09:53:10 user nova-compute[75229]: INFO os_brick.initiator.connectors.iscsi [None req-7b6a282a-27a5-485a-be6a-bfb32bf39919 tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 09:53:10 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c545a289-274d-485e-8787-3c8cb01f244e -p 172.16.0.220:3260 {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:53:10 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c545a289-274d-485e-8787-3c8cb01f244e -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:53:10 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[91b9fe9b-6b2e-4607-89a2-e40d87a99b76]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:53:10 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b6a282a-27a5-485a-be6a-bfb32bf39919 tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 09:53:10 user nova-compute[75229]:  {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:53:10 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c545a289-274d-485e-8787-3c8cb01f244e -p 172.16.0.220:3260 --interface default --op new {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:53:10 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c545a289-274d-485e-8787-3c8cb01f244e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:53:10 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[317fe58e-27e6-4192-bbaa-40665df53509]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c545a289-274d-485e-8787-3c8cb01f244e] added\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:53:10 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b6a282a-27a5-485a-be6a-bfb32bf39919 tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c545a289-274d-485e-8787-3c8cb01f244e] added
Nov 14 09:53:10 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:53:10 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c545a289-274d-485e-8787-3c8cb01f244e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:53:10 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c545a289-274d-485e-8787-3c8cb01f244e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:53:10 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8e47f0c-84e9-4216-8c8e-e27468e921bd]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:53:10 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b6a282a-27a5-485a-be6a-bfb32bf39919 tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:53:10 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c545a289-274d-485e-8787-3c8cb01f244e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:53:10 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c545a289-274d-485e-8787-3c8cb01f244e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:53:10 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[e024520f-ef1f-477f-b40d-052fbb7faf8c]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:53:10 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b6a282a-27a5-485a-be6a-bfb32bf39919 tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:53:10 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c545a289-274d-485e-8787-3c8cb01f244e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ygvpNczb {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:53:10 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c545a289-274d-485e-8787-3c8cb01f244e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ygvpNczb" returned: 0 in 0.018s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:53:10 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[da5bba04-6a5b-4dd9-85fc-794a9ac05775]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:53:10 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b6a282a-27a5-485a-be6a-bfb32bf39919 tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ygvpNczb'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:53:10 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c545a289-274d-485e-8787-3c8cb01f244e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:53:10 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c545a289-274d-485e-8787-3c8cb01f244e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:53:10 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[74955f88-675a-4d29-8a0e-93b05b582b7e]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:53:10 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b6a282a-27a5-485a-be6a-bfb32bf39919 tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:53:10 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:53:10 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:53:10 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[be27e649-76bf-41b2-9c0f-84b2810f0a8f]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bae4836-52c2-428b-b299-a6a72899197d (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b590f04d-8a50-4810-8e66-05d846f4613f (non-flash)\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:53:10 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b6a282a-27a5-485a-be6a-bfb32bf39919 tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bae4836-52c2-428b-b299-a6a72899197d (non-flash)
Nov 14 09:53:10 user nova-compute[75229]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b590f04d-8a50-4810-8e66-05d846f4613f (non-flash)
Nov 14 09:53:10 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 09:53:10 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b6a282a-27a5-485a-be6a-bfb32bf39919 tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bae4836-52c2-428b-b299-a6a72899197d (non-flash)
Nov 14 09:53:10 user nova-compute[75229]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b590f04d-8a50-4810-8e66-05d846f4613f (non-flash)
Nov 14 09:53:10 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 09:53:10 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c545a289-274d-485e-8787-3c8cb01f244e -p 172.16.0.220:3260 --login {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:53:10 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c545a289-274d-485e-8787-3c8cb01f244e -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:53:10 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fdfa98b-3b22-41b6-9b9e-17b86f802b42]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c545a289-274d-485e-8787-3c8cb01f244e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c545a289-274d-485e-8787-3c8cb01f244e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:53:10 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b6a282a-27a5-485a-be6a-bfb32bf39919 tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c545a289-274d-485e-8787-3c8cb01f244e, portal: 172.16.0.220,3260]
Nov 14 09:53:10 user nova-compute[75229]: Login to [iface: default, target: iqn.2010-10.org.openstack:c545a289-274d-485e-8787-3c8cb01f244e, portal: 172.16.0.220,3260] successful.
Nov 14 09:53:10 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:53:10 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c545a289-274d-485e-8787-3c8cb01f244e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:53:10 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c545a289-274d-485e-8787-3c8cb01f244e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:53:10 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[09639564-ff88-48d1-8a8c-1c9e4e62cdae]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:53:10 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b6a282a-27a5-485a-be6a-bfb32bf39919 tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:53:10 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:53:10 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:53:10 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9bb9fa3-60ba-4acb-960c-13190a446fd5]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bae4836-52c2-428b-b299-a6a72899197d (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b590f04d-8a50-4810-8e66-05d846f4613f (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c545a289-274d-485e-8787-3c8cb01f244e (non-flash)\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:53:10 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b6a282a-27a5-485a-be6a-bfb32bf39919 tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bae4836-52c2-428b-b299-a6a72899197d (non-flash)
Nov 14 09:53:10 user nova-compute[75229]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b590f04d-8a50-4810-8e66-05d846f4613f (non-flash)
Nov 14 09:53:10 user nova-compute[75229]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c545a289-274d-485e-8787-3c8cb01f244e (non-flash)
Nov 14 09:53:10 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 09:53:10 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b6a282a-27a5-485a-be6a-bfb32bf39919 tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bae4836-52c2-428b-b299-a6a72899197d (non-flash)
Nov 14 09:53:10 user nova-compute[75229]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b590f04d-8a50-4810-8e66-05d846f4613f (non-flash)
Nov 14 09:53:10 user nova-compute[75229]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c545a289-274d-485e-8787-3c8cb01f244e (non-flash)
Nov 14 09:53:10 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 09:53:10 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-7b6a282a-27a5-485a-be6a-bfb32bf39919 tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c545a289-274d-485e-8787-3c8cb01f244e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.275s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 09:53:10 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b6a282a-27a5-485a-be6a-bfb32bf39919 tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] Connected to 172.16.0.220:3260 {{(pid=75229) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 09:53:10 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-7b6a282a-27a5-485a-be6a-bfb32bf39919 tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] HCTL ('33', '-', '-', 0) found on session 28 with lun 0 {{(pid=75229) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 09:53:10 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-7b6a282a-27a5-485a-be6a-bfb32bf39919 tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75229) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 09:53:10 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:53:10 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:53:10 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[313558b5-4da3-4825-95a1-dc66226140f0]: (4, ('- - 0', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:53:10 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-7b6a282a-27a5-485a-be6a-bfb32bf39919 tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] Searching for a device in session 28 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75229) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 09:53:10 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b6a282a-27a5-485a-be6a-bfb32bf39919 tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:c545a289-274d-485e-8787-3c8cb01f244e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ygvpNczb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75229) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 09:53:10 user nova-compute[75229]: DEBUG nova.network.neutron [None req-be76230d-3644-409c-abb4-c77bafe394f8 tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] [instance: d73f431b-d002-4206-8b52-7d313a43dccb] Updating instance_info_cache with network_info: [{"id": "5a68432e-63fc-48e8-bc8c-62e0cd22033c", "address": "fa:16:3e:0c:97:35", "network": {"id": "589aea41-545f-4875-ab56-b7aa273dad6f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-785276916-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.92", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee9447f169de43829fe3ed51592752e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a68432e-63", "ovs_interfaceid": "5a68432e-63fc-48e8-bc8c-62e0cd22033c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 09:53:10 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-be76230d-3644-409c-abb4-c77bafe394f8 tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Releasing lock "refresh_cache-d73f431b-d002-4206-8b52-7d313a43dccb" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 09:53:11 user nova-compute[75229]: INFO nova.virt.libvirt.driver [-] [instance: d73f431b-d002-4206-8b52-7d313a43dccb] Instance destroyed successfully.
Nov 14 09:53:11 user nova-compute[75229]: DEBUG nova.objects.instance [None req-be76230d-3644-409c-abb4-c77bafe394f8 tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Lazy-loading 'resources' on Instance uuid d73f431b-d002-4206-8b52-7d313a43dccb {{(pid=75229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 09:53:11 user nova-compute[75229]: DEBUG nova.virt.libvirt.vif [None req-be76230d-3644-409c-abb4-c77bafe394f8 tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T09:51:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-96778093',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-96778093',id=25,image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGfyjtPtz5lNuu2b03L54iFuPjmej6LdqUyojatEh20moB6hOdLggbtYqXaWcz4OMc83XdzLg3C2/ZUNoKdUPjhidKL/ruNKttCIqPpB3mHVa3kiDodTu2gKDUCEwJvIxQ==',key_name='tempest-keypair-1883588312',keypairs=<?>,launch_index=0,launched_at=2023-11-14T09:51:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='ee9447f169de43829fe3ed51592752e9',ramdisk_id='',reservation_id='r-9md5usva',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-730167895',owner_user_name='tempest-AttachVolumeShelveTestJSON-730167895-project-member',shelved_at='2023-11-14T09:53:10.065426',shelved_host='user',shelved_image_id='172b5bd6-0f99-4c5b-b24e-002da5ca6798'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T09:53:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='319a0a5ee47a426799d40e0ebb62a3b0',uuid=d73f431b-d002-4206-8b52-7d313a43dccb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "5a68432e-63fc-48e8-bc8c-62e0cd22033c", "address": "fa:16:3e:0c:97:35", "network": {"id": "589aea41-545f-4875-ab56-b7aa273dad6f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-785276916-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.92", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee9447f169de43829fe3ed51592752e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a68432e-63", "ovs_interfaceid": "5a68432e-63fc-48e8-bc8c-62e0cd22033c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 09:53:11 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-be76230d-3644-409c-abb4-c77bafe394f8 tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Converting VIF {"id": "5a68432e-63fc-48e8-bc8c-62e0cd22033c", "address": "fa:16:3e:0c:97:35", "network": {"id": "589aea41-545f-4875-ab56-b7aa273dad6f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-785276916-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.92", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee9447f169de43829fe3ed51592752e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a68432e-63", "ovs_interfaceid": "5a68432e-63fc-48e8-bc8c-62e0cd22033c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 09:53:11 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-be76230d-3644-409c-abb4-c77bafe394f8 tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0c:97:35,bridge_name='br-int',has_traffic_filtering=True,id=5a68432e-63fc-48e8-bc8c-62e0cd22033c,network=Network(589aea41-545f-4875-ab56-b7aa273dad6f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a68432e-63') {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 09:53:11 user nova-compute[75229]: DEBUG os_vif [None req-be76230d-3644-409c-abb4-c77bafe394f8 tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0c:97:35,bridge_name='br-int',has_traffic_filtering=True,id=5a68432e-63fc-48e8-bc8c-62e0cd22033c,network=Network(589aea41-545f-4875-ab56-b7aa273dad6f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a68432e-63') {{(pid=75229) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 09:53:11 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:53:11 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5a68432e-63, bridge=br-int, if_exists=True) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:53:11 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:53:11 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:53:11 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:53:11 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c09969d1-268a-480f-9322-2cdca3fb6bd7) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:53:11 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:53:11 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:53:11 user nova-compute[75229]: DEBUG nova.compute.manager [req-47947638-6374-4429-b129-712ede3ef798 req-e6f58127-6ebf-453a-b042-c9ab5cc5ab06 service nova] [instance: d73f431b-d002-4206-8b52-7d313a43dccb] Received event network-changed-5a68432e-63fc-48e8-bc8c-62e0cd22033c {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:53:11 user nova-compute[75229]: DEBUG nova.compute.manager [req-47947638-6374-4429-b129-712ede3ef798 req-e6f58127-6ebf-453a-b042-c9ab5cc5ab06 service nova] [instance: d73f431b-d002-4206-8b52-7d313a43dccb] Refreshing instance network info cache due to event network-changed-5a68432e-63fc-48e8-bc8c-62e0cd22033c. {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 09:53:11 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-47947638-6374-4429-b129-712ede3ef798 req-e6f58127-6ebf-453a-b042-c9ab5cc5ab06 service nova] Acquiring lock "refresh_cache-d73f431b-d002-4206-8b52-7d313a43dccb" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 09:53:11 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-47947638-6374-4429-b129-712ede3ef798 req-e6f58127-6ebf-453a-b042-c9ab5cc5ab06 service nova] Acquired lock "refresh_cache-d73f431b-d002-4206-8b52-7d313a43dccb" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 09:53:11 user nova-compute[75229]: DEBUG nova.network.neutron [req-47947638-6374-4429-b129-712ede3ef798 req-e6f58127-6ebf-453a-b042-c9ab5cc5ab06 service nova] [instance: d73f431b-d002-4206-8b52-7d313a43dccb] Refreshing network info cache for port 5a68432e-63fc-48e8-bc8c-62e0cd22033c {{(pid=75229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 09:53:11 user nova-compute[75229]: INFO os_vif [None req-be76230d-3644-409c-abb4-c77bafe394f8 tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0c:97:35,bridge_name='br-int',has_traffic_filtering=True,id=5a68432e-63fc-48e8-bc8c-62e0cd22033c,network=Network(589aea41-545f-4875-ab56-b7aa273dad6f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a68432e-63')
Nov 14 09:53:11 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-be76230d-3644-409c-abb4-c77bafe394f8 tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] [instance: d73f431b-d002-4206-8b52-7d313a43dccb] Deleting instance files /opt/stack/data/nova/instances/d73f431b-d002-4206-8b52-7d313a43dccb_del
Nov 14 09:53:11 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-be76230d-3644-409c-abb4-c77bafe394f8 tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] [instance: d73f431b-d002-4206-8b52-7d313a43dccb] Deletion of /opt/stack/data/nova/instances/d73f431b-d002-4206-8b52-7d313a43dccb_del complete
Nov 14 09:53:11 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-7b6a282a-27a5-485a-be6a-bfb32bf39919 tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.309s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 09:53:11 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b6a282a-27a5-485a-be6a-bfb32bf39919 tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] <== connect_volume: return (1311ms) {'type': 'block', 'scsi_wwn': '26533323434376564', 'path': '/dev/sdb'} {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 09:53:11 user nova-compute[75229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7b6a282a-27a5-485a-be6a-bfb32bf39919 tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] [instance: 673624b6-e830-45e0-9215-ba79fd4f881e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26533323434376564', 'path': '/dev/sdb'} {{(pid=75229) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 09:53:11 user nova-compute[75229]: DEBUG nova.objects.instance [None req-7b6a282a-27a5-485a-be6a-bfb32bf39919 tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] Lazy-loading 'flavor' on Instance uuid 673624b6-e830-45e0-9215-ba79fd4f881e {{(pid=75229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 09:53:11 user nova-compute[75229]: DEBUG nova.virt.libvirt.guest [None req-7b6a282a-27a5-485a-be6a-bfb32bf39919 tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 09:53:11 user nova-compute[75229]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 09:53:11 user nova-compute[75229]:   <source dev="/dev/sdb"/>
Nov 14 09:53:11 user nova-compute[75229]:   <target dev="vdb" bus="virtio"/>
Nov 14 09:53:11 user nova-compute[75229]:   <serial>c545a289-274d-485e-8787-3c8cb01f244e</serial>
Nov 14 09:53:11 user nova-compute[75229]: </disk>
Nov 14 09:53:11 user nova-compute[75229]:  {{(pid=75229) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 09:53:11 user nova-compute[75229]: INFO nova.scheduler.client.report [None req-be76230d-3644-409c-abb4-c77bafe394f8 tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Deleted allocations for instance d73f431b-d002-4206-8b52-7d313a43dccb
Nov 14 09:53:11 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-be76230d-3644-409c-abb4-c77bafe394f8 tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:53:11 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-be76230d-3644-409c-abb4-c77bafe394f8 tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:53:11 user nova-compute[75229]: DEBUG nova.objects.instance [None req-be76230d-3644-409c-abb4-c77bafe394f8 tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Lazy-loading 'numa_topology' on Instance uuid d73f431b-d002-4206-8b52-7d313a43dccb {{(pid=75229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 09:53:11 user nova-compute[75229]: DEBUG nova.objects.base [None req-be76230d-3644-409c-abb4-c77bafe394f8 tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Object Instance<d73f431b-d002-4206-8b52-7d313a43dccb> lazy-loaded attributes: resources,numa_topology {{(pid=75229) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 09:53:12 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-7b6a282a-27a5-485a-be6a-bfb32bf39919 tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] No BDM found with device name vda, not building metadata. {{(pid=75229) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 09:53:12 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-7b6a282a-27a5-485a-be6a-bfb32bf39919 tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75229) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 09:53:12 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-7b6a282a-27a5-485a-be6a-bfb32bf39919 tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] No VIF found with MAC fa:16:3e:b1:c1:9c, not building metadata {{(pid=75229) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 09:53:12 user nova-compute[75229]: DEBUG nova.network.neutron [req-47947638-6374-4429-b129-712ede3ef798 req-e6f58127-6ebf-453a-b042-c9ab5cc5ab06 service nova] [instance: d73f431b-d002-4206-8b52-7d313a43dccb] Updated VIF entry in instance network info cache for port 5a68432e-63fc-48e8-bc8c-62e0cd22033c. {{(pid=75229) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 09:53:12 user nova-compute[75229]: DEBUG nova.network.neutron [req-47947638-6374-4429-b129-712ede3ef798 req-e6f58127-6ebf-453a-b042-c9ab5cc5ab06 service nova] [instance: d73f431b-d002-4206-8b52-7d313a43dccb] Updating instance_info_cache with network_info: [{"id": "5a68432e-63fc-48e8-bc8c-62e0cd22033c", "address": "fa:16:3e:0c:97:35", "network": {"id": "589aea41-545f-4875-ab56-b7aa273dad6f", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-785276916-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.92", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee9447f169de43829fe3ed51592752e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap5a68432e-63", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 09:53:12 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-47947638-6374-4429-b129-712ede3ef798 req-e6f58127-6ebf-453a-b042-c9ab5cc5ab06 service nova] Releasing lock "refresh_cache-d73f431b-d002-4206-8b52-7d313a43dccb" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 09:53:12 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-7b6a282a-27a5-485a-be6a-bfb32bf39919 tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] Lock "673624b6-e830-45e0-9215-ba79fd4f881e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.602s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:53:12 user nova-compute[75229]: DEBUG nova.compute.provider_tree [None req-be76230d-3644-409c-abb4-c77bafe394f8 tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Inventory has not changed in ProviderTree for provider: d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 {{(pid=75229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 09:53:12 user nova-compute[75229]: DEBUG nova.scheduler.client.report [None req-be76230d-3644-409c-abb4-c77bafe394f8 tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Inventory has not changed for provider d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 09:53:12 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-be76230d-3644-409c-abb4-c77bafe394f8 tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.715s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:53:12 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-be76230d-3644-409c-abb4-c77bafe394f8 tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Lock "d73f431b-d002-4206-8b52-7d313a43dccb" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 6.640s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:53:13 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:53:16 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:53:17 user nova-compute[75229]: WARNING nova.virt.libvirt.driver [None req-1b79a5e6-402e-495a-9b0b-f33a6d987d0c tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 4255af28-a111-4475-b207-67e335fd0835 is timed out.
Nov 14 09:53:17 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-1b79a5e6-402e-495a-9b0b-f33a6d987d0c tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Successfully detached device vdb from instance 4255af28-a111-4475-b207-67e335fd0835 from the live domain config.
Nov 14 09:53:17 user nova-compute[75229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1b79a5e6-402e-495a-9b0b-f33a6d987d0c tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] [instance: 4255af28-a111-4475-b207-67e335fd0835] calling os-brick to detach iSCSI Volume {{(pid=75229) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 09:53:17 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b79a5e6-402e-495a-9b0b-f33a6d987d0c tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f73f85151b0>, {'target_iqn': 'iqn.2010-10.org.openstack:2bae4836-52c2-428b-b299-a6a72899197d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IWJXKaHp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 09:53:17 user nova-compute[75229]: WARNING os_brick.initiator.connectors.base [None req-1b79a5e6-402e-495a-9b0b-f33a6d987d0c tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 09:53:17 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-1b79a5e6-402e-495a-9b0b-f33a6d987d0c tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 09:53:17 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-1b79a5e6-402e-495a-9b0b-f33a6d987d0c tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 09:53:17 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:53:17 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:53:17 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[d443e08a-264c-4cb0-bc2b-e52a87bed7ac]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c545a289-274d-485e-8787-3c8cb01f244e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2bae4836-52c2-428b-b299-a6a72899197d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b590f04d-8a50-4810-8e66-05d846f4613f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:53:17 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b79a5e6-402e-495a-9b0b-f33a6d987d0c tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 09:53:17 user nova-compute[75229]: No targets found.
Nov 14 09:53:17 user nova-compute[75229]: iSNS:
Nov 14 09:53:17 user nova-compute[75229]: No targets found.
Nov 14 09:53:17 user nova-compute[75229]: STATIC:
Nov 14 09:53:17 user nova-compute[75229]: Target: iqn.2010-10.org.openstack:c545a289-274d-485e-8787-3c8cb01f244e
Nov 14 09:53:17 user nova-compute[75229]:         Portal: 172.16.0.220:3260,-1
Nov 14 09:53:17 user nova-compute[75229]:                 Iface Name: default
Nov 14 09:53:17 user nova-compute[75229]: Target: iqn.2010-10.org.openstack:2bae4836-52c2-428b-b299-a6a72899197d
Nov 14 09:53:17 user nova-compute[75229]:         Portal: 172.16.0.220:3260,-1
Nov 14 09:53:17 user nova-compute[75229]:                 Iface Name: default
Nov 14 09:53:17 user nova-compute[75229]: Target: iqn.2010-10.org.openstack:b590f04d-8a50-4810-8e66-05d846f4613f
Nov 14 09:53:17 user nova-compute[75229]:         Portal: 172.16.0.220:3260,-1
Nov 14 09:53:17 user nova-compute[75229]:                 Iface Name: default
Nov 14 09:53:17 user nova-compute[75229]: FIRMWARE:
Nov 14 09:53:17 user nova-compute[75229]: No targets found.
Nov 14 09:53:17 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 09:53:17 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b79a5e6-402e-495a-9b0b-f33a6d987d0c tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 09:53:17 user nova-compute[75229]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 09:53:17 user nova-compute[75229]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75229) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 09:53:17 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b79a5e6-402e-495a-9b0b-f33a6d987d0c tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2bae4836-52c2-428b-b299-a6a72899197d', 0)] {{(pid=75229) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 09:53:17 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:53:18 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:53:18 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[78845898-a9f8-4418-a7b6-5391ffc7f3e6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2bae4836-52c2-428b-b299-a6a72899197d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b590f04d-8a50-4810-8e66-05d846f4613f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c545a289-274d-485e-8787-3c8cb01f244e\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:53:18 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:53:18 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:53:18 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e374c41-4044-4466-8c98-2c4435be586e]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bae4836-52c2-428b-b299-a6a72899197d (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b590f04d-8a50-4810-8e66-05d846f4613f (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c545a289-274d-485e-8787-3c8cb01f244e (non-flash)\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:53:18 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b79a5e6-402e-495a-9b0b-f33a6d987d0c tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bae4836-52c2-428b-b299-a6a72899197d (non-flash)
Nov 14 09:53:18 user nova-compute[75229]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b590f04d-8a50-4810-8e66-05d846f4613f (non-flash)
Nov 14 09:53:18 user nova-compute[75229]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c545a289-274d-485e-8787-3c8cb01f244e (non-flash)
Nov 14 09:53:18 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 09:53:18 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b79a5e6-402e-495a-9b0b-f33a6d987d0c tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bae4836-52c2-428b-b299-a6a72899197d (non-flash)
Nov 14 09:53:18 user nova-compute[75229]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b590f04d-8a50-4810-8e66-05d846f4613f (non-flash)
Nov 14 09:53:18 user nova-compute[75229]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c545a289-274d-485e-8787-3c8cb01f244e (non-flash)
Nov 14 09:53:18 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 09:53:18 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b79a5e6-402e-495a-9b0b-f33a6d987d0c tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f73f8526ef0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2bae4836-52c2-428b-b299-a6a72899197d'): ({'sdf'}, set())}) {{(pid=75229) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 09:53:18 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-1b79a5e6-402e-495a-9b0b-f33a6d987d0c tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Removing single pathed devices sdf {{(pid=75229) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 09:53:18 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:53:18 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:53:18 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[c28ce356-49ca-48ee-9ee9-991cd3b77846]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:53:18 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:53:18 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.018s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:53:18 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0be9e30-0f11-4630-8853-ef9633cf9bb7]: (4, ('ok\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:53:18 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-1b79a5e6-402e-495a-9b0b-f33a6d987d0c tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Flushing IO for device /dev/sdf {{(pid=75229) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 09:53:18 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:53:18 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.013s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:53:18 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d619983-92fe-4be5-abbe-97e2ae56abdb]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:53:18 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-1b79a5e6-402e-495a-9b0b-f33a6d987d0c tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75229) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 09:53:18 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:53:18 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.038s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:53:18 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4862c4a-118e-4f55-aaf8-a210a20d5f3f]: (4, ('1', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:53:18 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-1b79a5e6-402e-495a-9b0b-f33a6d987d0c tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75229) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 09:53:18 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-1b79a5e6-402e-495a-9b0b-f33a6d987d0c tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] SCSI volumes sdf have been removed. {{(pid=75229) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 09:53:18 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b79a5e6-402e-495a-9b0b-f33a6d987d0c tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2bae4836-52c2-428b-b299-a6a72899197d')] {{(pid=75229) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 09:53:18 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2bae4836-52c2-428b-b299-a6a72899197d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:53:18 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2bae4836-52c2-428b-b299-a6a72899197d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:53:18 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3caa919-3163-4d90-9a5b-b0b907632405]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:53:18 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b79a5e6-402e-495a-9b0b-f33a6d987d0c tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:53:18 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2bae4836-52c2-428b-b299-a6a72899197d -p 172.16.0.220:3260 --logout {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:53:18 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2bae4836-52c2-428b-b299-a6a72899197d -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:53:18 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ba7a436-f993-45f9-bf56-8ed6a2587eb9]: (4, ('Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:2bae4836-52c2-428b-b299-a6a72899197d, portal: 172.16.0.220,3260]\nLogout of [sid: 24, target: iqn.2010-10.org.openstack:2bae4836-52c2-428b-b299-a6a72899197d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:53:18 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b79a5e6-402e-495a-9b0b-f33a6d987d0c tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:2bae4836-52c2-428b-b299-a6a72899197d, portal: 172.16.0.220,3260]
Nov 14 09:53:18 user nova-compute[75229]: Logout of [sid: 24, target: iqn.2010-10.org.openstack:2bae4836-52c2-428b-b299-a6a72899197d, portal: 172.16.0.220,3260] successful.
Nov 14 09:53:18 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:53:18 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2bae4836-52c2-428b-b299-a6a72899197d -p 172.16.0.220:3260 --op delete {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:53:18 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2bae4836-52c2-428b-b299-a6a72899197d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:53:18 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1f5011c-4d17-47d8-87d6-ac3a98f3b5c9]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:53:18 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b79a5e6-402e-495a-9b0b-f33a6d987d0c tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:53:18 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-1b79a5e6-402e-495a-9b0b-f33a6d987d0c tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.289s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 09:53:18 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b79a5e6-402e-495a-9b0b-f33a6d987d0c tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] <== disconnect_volume: return (290ms) None {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 09:53:18 user nova-compute[75229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1b79a5e6-402e-495a-9b0b-f33a6d987d0c tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] [instance: 4255af28-a111-4475-b207-67e335fd0835] Disconnected iSCSI Volume {{(pid=75229) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 09:53:18 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:53:19 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc0393e9-3e50-4e2e-a5ce-07d86e9cffad tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] Acquiring lock "673624b6-e830-45e0-9215-ba79fd4f881e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:53:19 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc0393e9-3e50-4e2e-a5ce-07d86e9cffad tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] Lock "673624b6-e830-45e0-9215-ba79fd4f881e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:53:19 user nova-compute[75229]: DEBUG nova.objects.instance [None req-1b79a5e6-402e-495a-9b0b-f33a6d987d0c tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Lazy-loading 'flavor' on Instance uuid 4255af28-a111-4475-b207-67e335fd0835 {{(pid=75229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 09:53:19 user nova-compute[75229]: INFO nova.compute.manager [None req-bc0393e9-3e50-4e2e-a5ce-07d86e9cffad tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] [instance: 673624b6-e830-45e0-9215-ba79fd4f881e] Detaching volume c545a289-274d-485e-8787-3c8cb01f244e
Nov 14 09:53:19 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-1b79a5e6-402e-495a-9b0b-f33a6d987d0c tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Lock "4255af28-a111-4475-b207-67e335fd0835" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.740s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:53:19 user nova-compute[75229]: INFO nova.virt.block_device [None req-bc0393e9-3e50-4e2e-a5ce-07d86e9cffad tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] [instance: 673624b6-e830-45e0-9215-ba79fd4f881e] Attempting to driver detach volume c545a289-274d-485e-8787-3c8cb01f244e from mountpoint /dev/vdb
Nov 14 09:53:19 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-bc0393e9-3e50-4e2e-a5ce-07d86e9cffad tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] Attempting to detach device vdb from instance 673624b6-e830-45e0-9215-ba79fd4f881e from the persistent domain config. {{(pid=75229) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 09:53:19 user nova-compute[75229]: DEBUG nova.virt.libvirt.guest [None req-bc0393e9-3e50-4e2e-a5ce-07d86e9cffad tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 09:53:19 user nova-compute[75229]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 09:53:19 user nova-compute[75229]:   <source dev="/dev/sdb"/>
Nov 14 09:53:19 user nova-compute[75229]:   <target dev="vdb" bus="virtio"/>
Nov 14 09:53:19 user nova-compute[75229]:   <serial>c545a289-274d-485e-8787-3c8cb01f244e</serial>
Nov 14 09:53:19 user nova-compute[75229]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 09:53:19 user nova-compute[75229]: </disk>
Nov 14 09:53:19 user nova-compute[75229]:  {{(pid=75229) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 09:53:19 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-bc0393e9-3e50-4e2e-a5ce-07d86e9cffad tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] Successfully detached device vdb from instance 673624b6-e830-45e0-9215-ba79fd4f881e from the persistent domain config.
Nov 14 09:53:19 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-bc0393e9-3e50-4e2e-a5ce-07d86e9cffad tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 673624b6-e830-45e0-9215-ba79fd4f881e from the live domain config. {{(pid=75229) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 09:53:19 user nova-compute[75229]: DEBUG nova.virt.libvirt.guest [None req-bc0393e9-3e50-4e2e-a5ce-07d86e9cffad tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 09:53:19 user nova-compute[75229]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 09:53:19 user nova-compute[75229]:   <source dev="/dev/sdb"/>
Nov 14 09:53:19 user nova-compute[75229]:   <target dev="vdb" bus="virtio"/>
Nov 14 09:53:19 user nova-compute[75229]:   <serial>c545a289-274d-485e-8787-3c8cb01f244e</serial>
Nov 14 09:53:19 user nova-compute[75229]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 09:53:19 user nova-compute[75229]: </disk>
Nov 14 09:53:19 user nova-compute[75229]:  {{(pid=75229) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 09:53:19 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-f94fd950-bcbe-46b3-9fa3-5c3ff6a6e3ee tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] Acquiring lock "673624b6-e830-45e0-9215-ba79fd4f881e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:53:19 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-bc0393e9-3e50-4e2e-a5ce-07d86e9cffad tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 673624b6-e830-45e0-9215-ba79fd4f881e {{(pid=75229) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 09:53:21 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:53:23 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:53:26 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-78bfc3ab-b1d4-48e4-975e-8761ab8dcd3e tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Acquiring lock "be813b28-133f-416a-b2b5-dc0b9e4064b7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:53:26 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-78bfc3ab-b1d4-48e4-975e-8761ab8dcd3e tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Lock "be813b28-133f-416a-b2b5-dc0b9e4064b7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:53:26 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-78bfc3ab-b1d4-48e4-975e-8761ab8dcd3e tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Acquiring lock "be813b28-133f-416a-b2b5-dc0b9e4064b7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:53:26 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-78bfc3ab-b1d4-48e4-975e-8761ab8dcd3e tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Lock "be813b28-133f-416a-b2b5-dc0b9e4064b7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:53:26 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-78bfc3ab-b1d4-48e4-975e-8761ab8dcd3e tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Lock "be813b28-133f-416a-b2b5-dc0b9e4064b7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:53:26 user nova-compute[75229]: INFO nova.compute.manager [None req-78bfc3ab-b1d4-48e4-975e-8761ab8dcd3e tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] [instance: be813b28-133f-416a-b2b5-dc0b9e4064b7] Terminating instance
Nov 14 09:53:26 user nova-compute[75229]: DEBUG nova.compute.manager [None req-78bfc3ab-b1d4-48e4-975e-8761ab8dcd3e tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] [instance: be813b28-133f-416a-b2b5-dc0b9e4064b7] Start destroying the instance on the hypervisor. {{(pid=75229) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 09:53:26 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:53:26 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:53:26 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:53:26 user nova-compute[75229]: DEBUG nova.compute.manager [req-42260f9b-9f5e-470a-8084-792eb13c8b6a req-3653bc74-82fc-4b8e-8c53-d644b54ef8da service nova] [instance: be813b28-133f-416a-b2b5-dc0b9e4064b7] Received event network-vif-unplugged-d9a42cb3-5297-4aaf-bf16-9e591cab2fdc {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:53:26 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-42260f9b-9f5e-470a-8084-792eb13c8b6a req-3653bc74-82fc-4b8e-8c53-d644b54ef8da service nova] Acquiring lock "be813b28-133f-416a-b2b5-dc0b9e4064b7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:53:26 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-42260f9b-9f5e-470a-8084-792eb13c8b6a req-3653bc74-82fc-4b8e-8c53-d644b54ef8da service nova] Lock "be813b28-133f-416a-b2b5-dc0b9e4064b7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:53:26 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-42260f9b-9f5e-470a-8084-792eb13c8b6a req-3653bc74-82fc-4b8e-8c53-d644b54ef8da service nova] Lock "be813b28-133f-416a-b2b5-dc0b9e4064b7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:53:26 user nova-compute[75229]: DEBUG nova.compute.manager [req-42260f9b-9f5e-470a-8084-792eb13c8b6a req-3653bc74-82fc-4b8e-8c53-d644b54ef8da service nova] [instance: be813b28-133f-416a-b2b5-dc0b9e4064b7] No waiting events found dispatching network-vif-unplugged-d9a42cb3-5297-4aaf-bf16-9e591cab2fdc {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 09:53:26 user nova-compute[75229]: DEBUG nova.compute.manager [req-42260f9b-9f5e-470a-8084-792eb13c8b6a req-3653bc74-82fc-4b8e-8c53-d644b54ef8da service nova] [instance: be813b28-133f-416a-b2b5-dc0b9e4064b7] Received event network-vif-unplugged-d9a42cb3-5297-4aaf-bf16-9e591cab2fdc for instance with task_state deleting. {{(pid=75229) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 09:53:26 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:53:26 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:53:26 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:53:27 user nova-compute[75229]: INFO nova.virt.libvirt.driver [-] [instance: be813b28-133f-416a-b2b5-dc0b9e4064b7] Instance destroyed successfully.
Nov 14 09:53:27 user nova-compute[75229]: DEBUG nova.objects.instance [None req-78bfc3ab-b1d4-48e4-975e-8761ab8dcd3e tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Lazy-loading 'resources' on Instance uuid be813b28-133f-416a-b2b5-dc0b9e4064b7 {{(pid=75229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 09:53:27 user nova-compute[75229]: DEBUG nova.virt.libvirt.vif [None req-78bfc3ab-b1d4-48e4-975e-8761ab8dcd3e tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-14T09:47:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-266135781',display_name='tempest-ServerActionsTestOtherA-server-179119578',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-266135781',id=15,image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI5pWGQ4KaFZcOEff0OXqhHA6X74NcsQbIGrT1blkx1Y+aHHl7DvQb7afEPRDoAhltmJD8qcavQNRjJLbmHNs+eYeK4dOL8IJQfu1ghTHpot7XRacUK1z4qoyxfCdssM8g==',key_name='tempest-keypair-865166921',keypairs=<?>,launch_index=0,launched_at=2023-11-14T09:50:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='46e65cdd021f4a3db7c9254bb6d98b46',ramdisk_id='',reservation_id='r-0oyrmh9m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-280196295',owner_user_name='tempest-ServerActionsTestOtherA-280196295-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T09:50:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c0c381a0f6124f1ca6ce85c057b9143a',uuid=be813b28-133f-416a-b2b5-dc0b9e4064b7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d9a42cb3-5297-4aaf-bf16-9e591cab2fdc", "address": "fa:16:3e:27:a8:b8", "network": {"id": "5dfc532f-3d5d-4342-b7f1-12c9c3992a54", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1457278473-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.17", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46e65cdd021f4a3db7c9254bb6d98b46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9a42cb3-52", "ovs_interfaceid": "d9a42cb3-5297-4aaf-bf16-9e591cab2fdc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 09:53:27 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-78bfc3ab-b1d4-48e4-975e-8761ab8dcd3e tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Converting VIF {"id": "d9a42cb3-5297-4aaf-bf16-9e591cab2fdc", "address": "fa:16:3e:27:a8:b8", "network": {"id": "5dfc532f-3d5d-4342-b7f1-12c9c3992a54", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1457278473-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.17", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46e65cdd021f4a3db7c9254bb6d98b46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9a42cb3-52", "ovs_interfaceid": "d9a42cb3-5297-4aaf-bf16-9e591cab2fdc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 09:53:27 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-78bfc3ab-b1d4-48e4-975e-8761ab8dcd3e tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:27:a8:b8,bridge_name='br-int',has_traffic_filtering=True,id=d9a42cb3-5297-4aaf-bf16-9e591cab2fdc,network=Network(5dfc532f-3d5d-4342-b7f1-12c9c3992a54),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9a42cb3-52') {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 09:53:27 user nova-compute[75229]: DEBUG os_vif [None req-78bfc3ab-b1d4-48e4-975e-8761ab8dcd3e tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:27:a8:b8,bridge_name='br-int',has_traffic_filtering=True,id=d9a42cb3-5297-4aaf-bf16-9e591cab2fdc,network=Network(5dfc532f-3d5d-4342-b7f1-12c9c3992a54),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9a42cb3-52') {{(pid=75229) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 09:53:27 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:53:27 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd9a42cb3-52, bridge=br-int, if_exists=True) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:53:27 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:53:27 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 09:53:27 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:53:27 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6225e968-cf93-4038-b466-e8e1e7ec7e9a) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:53:27 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:53:27 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:53:27 user nova-compute[75229]: INFO os_vif [None req-78bfc3ab-b1d4-48e4-975e-8761ab8dcd3e tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:27:a8:b8,bridge_name='br-int',has_traffic_filtering=True,id=d9a42cb3-5297-4aaf-bf16-9e591cab2fdc,network=Network(5dfc532f-3d5d-4342-b7f1-12c9c3992a54),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9a42cb3-52')
Nov 14 09:53:27 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-78bfc3ab-b1d4-48e4-975e-8761ab8dcd3e tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] [instance: be813b28-133f-416a-b2b5-dc0b9e4064b7] Deleting instance files /opt/stack/data/nova/instances/be813b28-133f-416a-b2b5-dc0b9e4064b7_del
Nov 14 09:53:27 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-78bfc3ab-b1d4-48e4-975e-8761ab8dcd3e tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] [instance: be813b28-133f-416a-b2b5-dc0b9e4064b7] Deletion of /opt/stack/data/nova/instances/be813b28-133f-416a-b2b5-dc0b9e4064b7_del complete
Nov 14 09:53:27 user nova-compute[75229]: INFO nova.compute.manager [None req-78bfc3ab-b1d4-48e4-975e-8761ab8dcd3e tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] [instance: be813b28-133f-416a-b2b5-dc0b9e4064b7] Took 0.86 seconds to destroy the instance on the hypervisor.
Nov 14 09:53:27 user nova-compute[75229]: DEBUG oslo.service.loopingcall [None req-78bfc3ab-b1d4-48e4-975e-8761ab8dcd3e tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75229) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 09:53:27 user nova-compute[75229]: DEBUG nova.compute.manager [-] [instance: be813b28-133f-416a-b2b5-dc0b9e4064b7] Deallocating network for instance {{(pid=75229) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 09:53:27 user nova-compute[75229]: DEBUG nova.network.neutron [-] [instance: be813b28-133f-416a-b2b5-dc0b9e4064b7] deallocate_for_instance() {{(pid=75229) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 09:53:27 user nova-compute[75229]: DEBUG nova.network.neutron [-] [instance: be813b28-133f-416a-b2b5-dc0b9e4064b7] Updating instance_info_cache with network_info: [] {{(pid=75229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 09:53:27 user nova-compute[75229]: INFO nova.compute.manager [-] [instance: be813b28-133f-416a-b2b5-dc0b9e4064b7] Took 0.64 seconds to deallocate network for instance.
Nov 14 09:53:27 user nova-compute[75229]: DEBUG nova.compute.manager [req-9a6220ad-112d-49c4-b082-dbc8010423e6 req-daa04463-1384-4024-8bce-4e7e9cb566e9 service nova] [instance: be813b28-133f-416a-b2b5-dc0b9e4064b7] Received event network-vif-deleted-d9a42cb3-5297-4aaf-bf16-9e591cab2fdc {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:53:27 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-78bfc3ab-b1d4-48e4-975e-8761ab8dcd3e tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:53:27 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-78bfc3ab-b1d4-48e4-975e-8761ab8dcd3e tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:53:28 user nova-compute[75229]: DEBUG nova.compute.provider_tree [None req-78bfc3ab-b1d4-48e4-975e-8761ab8dcd3e tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Inventory has not changed in ProviderTree for provider: d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 {{(pid=75229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 09:53:28 user nova-compute[75229]: DEBUG nova.scheduler.client.report [None req-78bfc3ab-b1d4-48e4-975e-8761ab8dcd3e tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Inventory has not changed for provider d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 09:53:28 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-78bfc3ab-b1d4-48e4-975e-8761ab8dcd3e tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.367s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:53:28 user nova-compute[75229]: INFO nova.scheduler.client.report [None req-78bfc3ab-b1d4-48e4-975e-8761ab8dcd3e tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Deleted allocations for instance be813b28-133f-416a-b2b5-dc0b9e4064b7
Nov 14 09:53:28 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-78bfc3ab-b1d4-48e4-975e-8761ab8dcd3e tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Lock "be813b28-133f-416a-b2b5-dc0b9e4064b7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.106s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:53:28 user nova-compute[75229]: DEBUG nova.compute.manager [req-4d452003-c549-4a23-89cf-1cf919a0fc3a req-fedefb23-0ed9-4eef-8e22-ef4105a754b1 service nova] [instance: be813b28-133f-416a-b2b5-dc0b9e4064b7] Received event network-vif-plugged-d9a42cb3-5297-4aaf-bf16-9e591cab2fdc {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:53:28 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-4d452003-c549-4a23-89cf-1cf919a0fc3a req-fedefb23-0ed9-4eef-8e22-ef4105a754b1 service nova] Acquiring lock "be813b28-133f-416a-b2b5-dc0b9e4064b7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:53:28 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-4d452003-c549-4a23-89cf-1cf919a0fc3a req-fedefb23-0ed9-4eef-8e22-ef4105a754b1 service nova] Lock "be813b28-133f-416a-b2b5-dc0b9e4064b7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:53:28 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-4d452003-c549-4a23-89cf-1cf919a0fc3a req-fedefb23-0ed9-4eef-8e22-ef4105a754b1 service nova] Lock "be813b28-133f-416a-b2b5-dc0b9e4064b7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:53:28 user nova-compute[75229]: DEBUG nova.compute.manager [req-4d452003-c549-4a23-89cf-1cf919a0fc3a req-fedefb23-0ed9-4eef-8e22-ef4105a754b1 service nova] [instance: be813b28-133f-416a-b2b5-dc0b9e4064b7] No waiting events found dispatching network-vif-plugged-d9a42cb3-5297-4aaf-bf16-9e591cab2fdc {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 09:53:28 user nova-compute[75229]: WARNING nova.compute.manager [req-4d452003-c549-4a23-89cf-1cf919a0fc3a req-fedefb23-0ed9-4eef-8e22-ef4105a754b1 service nova] [instance: be813b28-133f-416a-b2b5-dc0b9e4064b7] Received unexpected event network-vif-plugged-d9a42cb3-5297-4aaf-bf16-9e591cab2fdc for instance with vm_state deleted and task_state None.
Nov 14 09:53:32 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:53:36 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-06e70a1f-47e2-4d18-a44d-4ddd9a7a94b8 tempest-VolumesActionsTest-480767440 tempest-VolumesActionsTest-480767440-project-member] Acquiring lock "200e8be8-516b-4344-a584-e88ee79b21a6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:53:36 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-06e70a1f-47e2-4d18-a44d-4ddd9a7a94b8 tempest-VolumesActionsTest-480767440 tempest-VolumesActionsTest-480767440-project-member] Lock "200e8be8-516b-4344-a584-e88ee79b21a6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:53:36 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:53:36 user nova-compute[75229]: DEBUG nova.compute.manager [None req-06e70a1f-47e2-4d18-a44d-4ddd9a7a94b8 tempest-VolumesActionsTest-480767440 tempest-VolumesActionsTest-480767440-project-member] [instance: 200e8be8-516b-4344-a584-e88ee79b21a6] Starting instance... {{(pid=75229) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 09:53:36 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-06e70a1f-47e2-4d18-a44d-4ddd9a7a94b8 tempest-VolumesActionsTest-480767440 tempest-VolumesActionsTest-480767440-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:53:36 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-06e70a1f-47e2-4d18-a44d-4ddd9a7a94b8 tempest-VolumesActionsTest-480767440 tempest-VolumesActionsTest-480767440-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:53:36 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-06e70a1f-47e2-4d18-a44d-4ddd9a7a94b8 tempest-VolumesActionsTest-480767440 tempest-VolumesActionsTest-480767440-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75229) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 09:53:36 user nova-compute[75229]: INFO nova.compute.claims [None req-06e70a1f-47e2-4d18-a44d-4ddd9a7a94b8 tempest-VolumesActionsTest-480767440 tempest-VolumesActionsTest-480767440-project-member] [instance: 200e8be8-516b-4344-a584-e88ee79b21a6] Claim successful on node user
Nov 14 09:53:37 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:53:37 user nova-compute[75229]: DEBUG nova.compute.provider_tree [None req-06e70a1f-47e2-4d18-a44d-4ddd9a7a94b8 tempest-VolumesActionsTest-480767440 tempest-VolumesActionsTest-480767440-project-member] Inventory has not changed in ProviderTree for provider: d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 {{(pid=75229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 09:53:37 user nova-compute[75229]: DEBUG nova.scheduler.client.report [None req-06e70a1f-47e2-4d18-a44d-4ddd9a7a94b8 tempest-VolumesActionsTest-480767440 tempest-VolumesActionsTest-480767440-project-member] Inventory has not changed for provider d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 09:53:37 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-06e70a1f-47e2-4d18-a44d-4ddd9a7a94b8 tempest-VolumesActionsTest-480767440 tempest-VolumesActionsTest-480767440-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.417s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:53:37 user nova-compute[75229]: DEBUG nova.compute.manager [None req-06e70a1f-47e2-4d18-a44d-4ddd9a7a94b8 tempest-VolumesActionsTest-480767440 tempest-VolumesActionsTest-480767440-project-member] [instance: 200e8be8-516b-4344-a584-e88ee79b21a6] Start building networks asynchronously for instance. {{(pid=75229) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 09:53:37 user nova-compute[75229]: DEBUG nova.compute.manager [None req-06e70a1f-47e2-4d18-a44d-4ddd9a7a94b8 tempest-VolumesActionsTest-480767440 tempest-VolumesActionsTest-480767440-project-member] [instance: 200e8be8-516b-4344-a584-e88ee79b21a6] Allocating IP information in the background. {{(pid=75229) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 09:53:37 user nova-compute[75229]: DEBUG nova.network.neutron [None req-06e70a1f-47e2-4d18-a44d-4ddd9a7a94b8 tempest-VolumesActionsTest-480767440 tempest-VolumesActionsTest-480767440-project-member] [instance: 200e8be8-516b-4344-a584-e88ee79b21a6] allocate_for_instance() {{(pid=75229) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 09:53:37 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-06e70a1f-47e2-4d18-a44d-4ddd9a7a94b8 tempest-VolumesActionsTest-480767440 tempest-VolumesActionsTest-480767440-project-member] [instance: 200e8be8-516b-4344-a584-e88ee79b21a6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 09:53:37 user nova-compute[75229]: DEBUG nova.compute.manager [None req-06e70a1f-47e2-4d18-a44d-4ddd9a7a94b8 tempest-VolumesActionsTest-480767440 tempest-VolumesActionsTest-480767440-project-member] [instance: 200e8be8-516b-4344-a584-e88ee79b21a6] Start building block device mappings for instance. {{(pid=75229) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 09:53:37 user nova-compute[75229]: DEBUG nova.policy [None req-06e70a1f-47e2-4d18-a44d-4ddd9a7a94b8 tempest-VolumesActionsTest-480767440 tempest-VolumesActionsTest-480767440-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c560169166e745ad9bb47e0c570c3ed8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76963cea909f48398eea96eefec38b0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75229) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 09:53:37 user nova-compute[75229]: INFO nova.compute.manager [None req-1dee5dbf-1c05-4a7e-8bb7-0d5c42e27a09 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] [instance: 4c9fe69e-3f9d-4b30-a9e4-efc3e83efa17] Rescuing
Nov 14 09:53:37 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-1dee5dbf-1c05-4a7e-8bb7-0d5c42e27a09 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Acquiring lock "refresh_cache-4c9fe69e-3f9d-4b30-a9e4-efc3e83efa17" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 09:53:37 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-1dee5dbf-1c05-4a7e-8bb7-0d5c42e27a09 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Acquired lock "refresh_cache-4c9fe69e-3f9d-4b30-a9e4-efc3e83efa17" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 09:53:37 user nova-compute[75229]: DEBUG nova.network.neutron [None req-1dee5dbf-1c05-4a7e-8bb7-0d5c42e27a09 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] [instance: 4c9fe69e-3f9d-4b30-a9e4-efc3e83efa17] Building network info cache for instance {{(pid=75229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 09:53:37 user nova-compute[75229]: DEBUG nova.compute.manager [None req-06e70a1f-47e2-4d18-a44d-4ddd9a7a94b8 tempest-VolumesActionsTest-480767440 tempest-VolumesActionsTest-480767440-project-member] [instance: 200e8be8-516b-4344-a584-e88ee79b21a6] Start spawning the instance on the hypervisor. {{(pid=75229) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 09:53:37 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-06e70a1f-47e2-4d18-a44d-4ddd9a7a94b8 tempest-VolumesActionsTest-480767440 tempest-VolumesActionsTest-480767440-project-member] [instance: 200e8be8-516b-4344-a584-e88ee79b21a6] Creating instance directory {{(pid=75229) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 09:53:37 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-06e70a1f-47e2-4d18-a44d-4ddd9a7a94b8 tempest-VolumesActionsTest-480767440 tempest-VolumesActionsTest-480767440-project-member] [instance: 200e8be8-516b-4344-a584-e88ee79b21a6] Creating image(s)
Nov 14 09:53:37 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-06e70a1f-47e2-4d18-a44d-4ddd9a7a94b8 tempest-VolumesActionsTest-480767440 tempest-VolumesActionsTest-480767440-project-member] Acquiring lock "/opt/stack/data/nova/instances/200e8be8-516b-4344-a584-e88ee79b21a6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:53:37 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-06e70a1f-47e2-4d18-a44d-4ddd9a7a94b8 tempest-VolumesActionsTest-480767440 tempest-VolumesActionsTest-480767440-project-member] Lock "/opt/stack/data/nova/instances/200e8be8-516b-4344-a584-e88ee79b21a6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:53:37 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-06e70a1f-47e2-4d18-a44d-4ddd9a7a94b8 tempest-VolumesActionsTest-480767440 tempest-VolumesActionsTest-480767440-project-member] Lock "/opt/stack/data/nova/instances/200e8be8-516b-4344-a584-e88ee79b21a6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:53:37 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-06e70a1f-47e2-4d18-a44d-4ddd9a7a94b8 tempest-VolumesActionsTest-480767440 tempest-VolumesActionsTest-480767440-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6 --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:53:37 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-06e70a1f-47e2-4d18-a44d-4ddd9a7a94b8 tempest-VolumesActionsTest-480767440 tempest-VolumesActionsTest-480767440-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6 --force-share --output=json" returned: 0 in 0.182s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:53:37 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-06e70a1f-47e2-4d18-a44d-4ddd9a7a94b8 tempest-VolumesActionsTest-480767440 tempest-VolumesActionsTest-480767440-project-member] Acquiring lock "4f30e3fe703d2381679612a57b1fb80a467f60b6" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:53:37 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-06e70a1f-47e2-4d18-a44d-4ddd9a7a94b8 tempest-VolumesActionsTest-480767440 tempest-VolumesActionsTest-480767440-project-member] Lock "4f30e3fe703d2381679612a57b1fb80a467f60b6" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:53:37 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-06e70a1f-47e2-4d18-a44d-4ddd9a7a94b8 tempest-VolumesActionsTest-480767440 tempest-VolumesActionsTest-480767440-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6 --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:53:37 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-06e70a1f-47e2-4d18-a44d-4ddd9a7a94b8 tempest-VolumesActionsTest-480767440 tempest-VolumesActionsTest-480767440-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6 --force-share --output=json" returned: 0 in 0.171s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:53:37 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-06e70a1f-47e2-4d18-a44d-4ddd9a7a94b8 tempest-VolumesActionsTest-480767440 tempest-VolumesActionsTest-480767440-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6,backing_fmt=raw /opt/stack/data/nova/instances/200e8be8-516b-4344-a584-e88ee79b21a6/disk 1073741824 {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:53:37 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-06e70a1f-47e2-4d18-a44d-4ddd9a7a94b8 tempest-VolumesActionsTest-480767440 tempest-VolumesActionsTest-480767440-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6,backing_fmt=raw /opt/stack/data/nova/instances/200e8be8-516b-4344-a584-e88ee79b21a6/disk 1073741824" returned: 0 in 0.048s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:53:37 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-06e70a1f-47e2-4d18-a44d-4ddd9a7a94b8 tempest-VolumesActionsTest-480767440 tempest-VolumesActionsTest-480767440-project-member] Lock "4f30e3fe703d2381679612a57b1fb80a467f60b6" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.224s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:53:37 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-06e70a1f-47e2-4d18-a44d-4ddd9a7a94b8 tempest-VolumesActionsTest-480767440 tempest-VolumesActionsTest-480767440-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6 --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:53:38 user nova-compute[75229]: DEBUG nova.network.neutron [None req-1dee5dbf-1c05-4a7e-8bb7-0d5c42e27a09 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] [instance: 4c9fe69e-3f9d-4b30-a9e4-efc3e83efa17] Updating instance_info_cache with network_info: [{"id": "235153d6-63c1-44d2-97cc-c083544e6790", "address": "fa:16:3e:a0:db:35", "network": {"id": "22eed29e-7148-42f9-b4c7-b97811cba8eb", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2000485731-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46457b27e3ed416e827c3c22449fb512", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap235153d6-63", "ovs_interfaceid": "235153d6-63c1-44d2-97cc-c083544e6790", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 09:53:38 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-1dee5dbf-1c05-4a7e-8bb7-0d5c42e27a09 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Releasing lock "refresh_cache-4c9fe69e-3f9d-4b30-a9e4-efc3e83efa17" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 09:53:38 user nova-compute[75229]: DEBUG nova.network.neutron [None req-06e70a1f-47e2-4d18-a44d-4ddd9a7a94b8 tempest-VolumesActionsTest-480767440 tempest-VolumesActionsTest-480767440-project-member] [instance: 200e8be8-516b-4344-a584-e88ee79b21a6] Successfully created port: 45b7b43f-1c69-4e7d-bbf9-3cad74f674ef {{(pid=75229) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 09:53:38 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-06e70a1f-47e2-4d18-a44d-4ddd9a7a94b8 tempest-VolumesActionsTest-480767440 tempest-VolumesActionsTest-480767440-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6 --force-share --output=json" returned: 0 in 0.182s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:53:38 user nova-compute[75229]: DEBUG nova.virt.disk.api [None req-06e70a1f-47e2-4d18-a44d-4ddd9a7a94b8 tempest-VolumesActionsTest-480767440 tempest-VolumesActionsTest-480767440-project-member] Checking if we can resize image /opt/stack/data/nova/instances/200e8be8-516b-4344-a584-e88ee79b21a6/disk. size=1073741824 {{(pid=75229) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 09:53:38 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-06e70a1f-47e2-4d18-a44d-4ddd9a7a94b8 tempest-VolumesActionsTest-480767440 tempest-VolumesActionsTest-480767440-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/200e8be8-516b-4344-a584-e88ee79b21a6/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:53:38 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:53:38 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:53:38 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-06e70a1f-47e2-4d18-a44d-4ddd9a7a94b8 tempest-VolumesActionsTest-480767440 tempest-VolumesActionsTest-480767440-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/200e8be8-516b-4344-a584-e88ee79b21a6/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:53:38 user nova-compute[75229]: DEBUG nova.virt.disk.api [None req-06e70a1f-47e2-4d18-a44d-4ddd9a7a94b8 tempest-VolumesActionsTest-480767440 tempest-VolumesActionsTest-480767440-project-member] Cannot resize image /opt/stack/data/nova/instances/200e8be8-516b-4344-a584-e88ee79b21a6/disk to a smaller size. {{(pid=75229) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 09:53:38 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-06e70a1f-47e2-4d18-a44d-4ddd9a7a94b8 tempest-VolumesActionsTest-480767440 tempest-VolumesActionsTest-480767440-project-member] [instance: 200e8be8-516b-4344-a584-e88ee79b21a6] Created local disks {{(pid=75229) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 09:53:38 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-06e70a1f-47e2-4d18-a44d-4ddd9a7a94b8 tempest-VolumesActionsTest-480767440 tempest-VolumesActionsTest-480767440-project-member] [instance: 200e8be8-516b-4344-a584-e88ee79b21a6] Ensure instance console log exists: /opt/stack/data/nova/instances/200e8be8-516b-4344-a584-e88ee79b21a6/console.log {{(pid=75229) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 09:53:38 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-06e70a1f-47e2-4d18-a44d-4ddd9a7a94b8 tempest-VolumesActionsTest-480767440 tempest-VolumesActionsTest-480767440-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:53:38 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-06e70a1f-47e2-4d18-a44d-4ddd9a7a94b8 tempest-VolumesActionsTest-480767440 tempest-VolumesActionsTest-480767440-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:53:38 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-06e70a1f-47e2-4d18-a44d-4ddd9a7a94b8 tempest-VolumesActionsTest-480767440 tempest-VolumesActionsTest-480767440-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:53:38 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:53:38 user nova-compute[75229]: DEBUG nova.compute.manager [req-733ad8a2-68a0-4690-bddd-79ec6ad7611e req-7f74b037-0bc3-436c-badc-add6de971c55 service nova] [instance: 4c9fe69e-3f9d-4b30-a9e4-efc3e83efa17] Received event network-vif-unplugged-235153d6-63c1-44d2-97cc-c083544e6790 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:53:38 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-733ad8a2-68a0-4690-bddd-79ec6ad7611e req-7f74b037-0bc3-436c-badc-add6de971c55 service nova] Acquiring lock "4c9fe69e-3f9d-4b30-a9e4-efc3e83efa17-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:53:38 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-733ad8a2-68a0-4690-bddd-79ec6ad7611e req-7f74b037-0bc3-436c-badc-add6de971c55 service nova] Lock "4c9fe69e-3f9d-4b30-a9e4-efc3e83efa17-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:53:38 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-733ad8a2-68a0-4690-bddd-79ec6ad7611e req-7f74b037-0bc3-436c-badc-add6de971c55 service nova] Lock "4c9fe69e-3f9d-4b30-a9e4-efc3e83efa17-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:53:38 user nova-compute[75229]: DEBUG nova.compute.manager [req-733ad8a2-68a0-4690-bddd-79ec6ad7611e req-7f74b037-0bc3-436c-badc-add6de971c55 service nova] [instance: 4c9fe69e-3f9d-4b30-a9e4-efc3e83efa17] No waiting events found dispatching network-vif-unplugged-235153d6-63c1-44d2-97cc-c083544e6790 {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 09:53:38 user nova-compute[75229]: WARNING nova.compute.manager [req-733ad8a2-68a0-4690-bddd-79ec6ad7611e req-7f74b037-0bc3-436c-badc-add6de971c55 service nova] [instance: 4c9fe69e-3f9d-4b30-a9e4-efc3e83efa17] Received unexpected event network-vif-unplugged-235153d6-63c1-44d2-97cc-c083544e6790 for instance with vm_state active and task_state rescuing.
Nov 14 09:53:38 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:53:38 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:53:38 user nova-compute[75229]: DEBUG nova.network.neutron [None req-06e70a1f-47e2-4d18-a44d-4ddd9a7a94b8 tempest-VolumesActionsTest-480767440 tempest-VolumesActionsTest-480767440-project-member] [instance: 200e8be8-516b-4344-a584-e88ee79b21a6] Successfully updated port: 45b7b43f-1c69-4e7d-bbf9-3cad74f674ef {{(pid=75229) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 09:53:38 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-06e70a1f-47e2-4d18-a44d-4ddd9a7a94b8 tempest-VolumesActionsTest-480767440 tempest-VolumesActionsTest-480767440-project-member] Acquiring lock "refresh_cache-200e8be8-516b-4344-a584-e88ee79b21a6" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 09:53:38 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-06e70a1f-47e2-4d18-a44d-4ddd9a7a94b8 tempest-VolumesActionsTest-480767440 tempest-VolumesActionsTest-480767440-project-member] Acquired lock "refresh_cache-200e8be8-516b-4344-a584-e88ee79b21a6" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 09:53:38 user nova-compute[75229]: DEBUG nova.network.neutron [None req-06e70a1f-47e2-4d18-a44d-4ddd9a7a94b8 tempest-VolumesActionsTest-480767440 tempest-VolumesActionsTest-480767440-project-member] [instance: 200e8be8-516b-4344-a584-e88ee79b21a6] Building network info cache for instance {{(pid=75229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 09:53:38 user nova-compute[75229]: DEBUG nova.compute.manager [req-bcb147f7-1971-422c-b4c4-deb74702bef8 req-9eb5ab2e-c29c-428b-b0bb-f5c355edef89 service nova] [instance: 200e8be8-516b-4344-a584-e88ee79b21a6] Received event network-changed-45b7b43f-1c69-4e7d-bbf9-3cad74f674ef {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:53:38 user nova-compute[75229]: DEBUG nova.compute.manager [req-bcb147f7-1971-422c-b4c4-deb74702bef8 req-9eb5ab2e-c29c-428b-b0bb-f5c355edef89 service nova] [instance: 200e8be8-516b-4344-a584-e88ee79b21a6] Refreshing instance network info cache due to event network-changed-45b7b43f-1c69-4e7d-bbf9-3cad74f674ef. {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 09:53:38 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-bcb147f7-1971-422c-b4c4-deb74702bef8 req-9eb5ab2e-c29c-428b-b0bb-f5c355edef89 service nova] Acquiring lock "refresh_cache-200e8be8-516b-4344-a584-e88ee79b21a6" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 09:53:38 user nova-compute[75229]: DEBUG nova.network.neutron [None req-06e70a1f-47e2-4d18-a44d-4ddd9a7a94b8 tempest-VolumesActionsTest-480767440 tempest-VolumesActionsTest-480767440-project-member] [instance: 200e8be8-516b-4344-a584-e88ee79b21a6] Instance cache missing network info. {{(pid=75229) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 09:53:38 user nova-compute[75229]: INFO nova.virt.libvirt.driver [-] [instance: 4c9fe69e-3f9d-4b30-a9e4-efc3e83efa17] Instance destroyed successfully.
Nov 14 09:53:38 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-1dee5dbf-1c05-4a7e-8bb7-0d5c42e27a09 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] [instance: 4c9fe69e-3f9d-4b30-a9e4-efc3e83efa17] Attempting rescue
Nov 14 09:53:38 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-1dee5dbf-1c05-4a7e-8bb7-0d5c42e27a09 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75229) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 14 09:53:38 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-1dee5dbf-1c05-4a7e-8bb7-0d5c42e27a09 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] [instance: 4c9fe69e-3f9d-4b30-a9e4-efc3e83efa17] Instance directory exists: not creating {{(pid=75229) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 14 09:53:38 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-1dee5dbf-1c05-4a7e-8bb7-0d5c42e27a09 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] [instance: 4c9fe69e-3f9d-4b30-a9e4-efc3e83efa17] Creating image(s)
Nov 14 09:53:38 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-1dee5dbf-1c05-4a7e-8bb7-0d5c42e27a09 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Acquiring lock "/opt/stack/data/nova/instances/4c9fe69e-3f9d-4b30-a9e4-efc3e83efa17/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:53:38 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-1dee5dbf-1c05-4a7e-8bb7-0d5c42e27a09 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Lock "/opt/stack/data/nova/instances/4c9fe69e-3f9d-4b30-a9e4-efc3e83efa17/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:53:38 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-1dee5dbf-1c05-4a7e-8bb7-0d5c42e27a09 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Lock "/opt/stack/data/nova/instances/4c9fe69e-3f9d-4b30-a9e4-efc3e83efa17/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:53:38 user nova-compute[75229]: DEBUG nova.objects.instance [None req-1dee5dbf-1c05-4a7e-8bb7-0d5c42e27a09 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Lazy-loading 'trusted_certs' on Instance uuid 4c9fe69e-3f9d-4b30-a9e4-efc3e83efa17 {{(pid=75229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 09:53:38 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-1dee5dbf-1c05-4a7e-8bb7-0d5c42e27a09 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Acquiring lock "4f30e3fe703d2381679612a57b1fb80a467f60b6" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:53:38 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-1dee5dbf-1c05-4a7e-8bb7-0d5c42e27a09 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Lock "4f30e3fe703d2381679612a57b1fb80a467f60b6" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:53:38 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-1dee5dbf-1c05-4a7e-8bb7-0d5c42e27a09 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6 --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:53:39 user nova-compute[75229]: DEBUG nova.network.neutron [None req-06e70a1f-47e2-4d18-a44d-4ddd9a7a94b8 tempest-VolumesActionsTest-480767440 tempest-VolumesActionsTest-480767440-project-member] [instance: 200e8be8-516b-4344-a584-e88ee79b21a6] Updating instance_info_cache with network_info: [{"id": "45b7b43f-1c69-4e7d-bbf9-3cad74f674ef", "address": "fa:16:3e:b2:1d:1c", "network": {"id": "fedfe4bb-5b8c-4782-9df9-19cba1844f7c", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2139303642-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76963cea909f48398eea96eefec38b0f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45b7b43f-1c", "ovs_interfaceid": "45b7b43f-1c69-4e7d-bbf9-3cad74f674ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 09:53:39 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-06e70a1f-47e2-4d18-a44d-4ddd9a7a94b8 tempest-VolumesActionsTest-480767440 tempest-VolumesActionsTest-480767440-project-member] Releasing lock "refresh_cache-200e8be8-516b-4344-a584-e88ee79b21a6" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 09:53:39 user nova-compute[75229]: DEBUG nova.compute.manager [None req-06e70a1f-47e2-4d18-a44d-4ddd9a7a94b8 tempest-VolumesActionsTest-480767440 tempest-VolumesActionsTest-480767440-project-member] [instance: 200e8be8-516b-4344-a584-e88ee79b21a6] Instance network_info: |[{"id": "45b7b43f-1c69-4e7d-bbf9-3cad74f674ef", "address": "fa:16:3e:b2:1d:1c", "network": {"id": "fedfe4bb-5b8c-4782-9df9-19cba1844f7c", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2139303642-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76963cea909f48398eea96eefec38b0f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45b7b43f-1c", "ovs_interfaceid": "45b7b43f-1c69-4e7d-bbf9-3cad74f674ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75229) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 09:53:39 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-bcb147f7-1971-422c-b4c4-deb74702bef8 req-9eb5ab2e-c29c-428b-b0bb-f5c355edef89 service nova] Acquired lock "refresh_cache-200e8be8-516b-4344-a584-e88ee79b21a6" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 09:53:39 user nova-compute[75229]: DEBUG nova.network.neutron [req-bcb147f7-1971-422c-b4c4-deb74702bef8 req-9eb5ab2e-c29c-428b-b0bb-f5c355edef89 service nova] [instance: 200e8be8-516b-4344-a584-e88ee79b21a6] Refreshing network info cache for port 45b7b43f-1c69-4e7d-bbf9-3cad74f674ef {{(pid=75229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 09:53:39 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-06e70a1f-47e2-4d18-a44d-4ddd9a7a94b8 tempest-VolumesActionsTest-480767440 tempest-VolumesActionsTest-480767440-project-member] [instance: 200e8be8-516b-4344-a584-e88ee79b21a6] Start _get_guest_xml network_info=[{"id": "45b7b43f-1c69-4e7d-bbf9-3cad74f674ef", "address": "fa:16:3e:b2:1d:1c", "network": {"id": "fedfe4bb-5b8c-4782-9df9-19cba1844f7c", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2139303642-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76963cea909f48398eea96eefec38b0f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45b7b43f-1c", "ovs_interfaceid": "45b7b43f-1c69-4e7d-bbf9-3cad74f674ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T09:40:10Z,direct_url=<?>,disk_format='qcow2',id=3bef8470-ecc7-40e3-95d4-9254348ea72d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='de5a91106b6948ed937a7178ff9464c4',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T09:40:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'disk_bus': 'virtio', 'guest_format': None, 'encryption_secret_uuid': None, 'size': 0, 'device_type': 'disk', 'image_id': '3bef8470-ecc7-40e3-95d4-9254348ea72d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75229) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 09:53:39 user nova-compute[75229]: WARNING nova.virt.libvirt.driver [None req-06e70a1f-47e2-4d18-a44d-4ddd9a7a94b8 tempest-VolumesActionsTest-480767440 tempest-VolumesActionsTest-480767440-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 09:53:39 user nova-compute[75229]: WARNING nova.virt.libvirt.driver [None req-06e70a1f-47e2-4d18-a44d-4ddd9a7a94b8 tempest-VolumesActionsTest-480767440 tempest-VolumesActionsTest-480767440-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 09:53:39 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-06e70a1f-47e2-4d18-a44d-4ddd9a7a94b8 tempest-VolumesActionsTest-480767440 tempest-VolumesActionsTest-480767440-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75229) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 09:53:39 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-06e70a1f-47e2-4d18-a44d-4ddd9a7a94b8 tempest-VolumesActionsTest-480767440 tempest-VolumesActionsTest-480767440-project-member] CPU controller missing on host. {{(pid=75229) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 09:53:39 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-06e70a1f-47e2-4d18-a44d-4ddd9a7a94b8 tempest-VolumesActionsTest-480767440 tempest-VolumesActionsTest-480767440-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75229) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 09:53:39 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-06e70a1f-47e2-4d18-a44d-4ddd9a7a94b8 tempest-VolumesActionsTest-480767440 tempest-VolumesActionsTest-480767440-project-member] CPU controller found on host. {{(pid=75229) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 09:53:39 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-06e70a1f-47e2-4d18-a44d-4ddd9a7a94b8 tempest-VolumesActionsTest-480767440 tempest-VolumesActionsTest-480767440-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75229) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 09:53:39 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-06e70a1f-47e2-4d18-a44d-4ddd9a7a94b8 tempest-VolumesActionsTest-480767440 tempest-VolumesActionsTest-480767440-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T09:39:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T09:40:10Z,direct_url=<?>,disk_format='qcow2',id=3bef8470-ecc7-40e3-95d4-9254348ea72d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='de5a91106b6948ed937a7178ff9464c4',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T09:40:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 09:53:39 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-06e70a1f-47e2-4d18-a44d-4ddd9a7a94b8 tempest-VolumesActionsTest-480767440 tempest-VolumesActionsTest-480767440-project-member] Flavor limits 0:0:0 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 09:53:39 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-06e70a1f-47e2-4d18-a44d-4ddd9a7a94b8 tempest-VolumesActionsTest-480767440 tempest-VolumesActionsTest-480767440-project-member] Image limits 0:0:0 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 09:53:39 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-06e70a1f-47e2-4d18-a44d-4ddd9a7a94b8 tempest-VolumesActionsTest-480767440 tempest-VolumesActionsTest-480767440-project-member] Flavor pref 0:0:0 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 09:53:39 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-06e70a1f-47e2-4d18-a44d-4ddd9a7a94b8 tempest-VolumesActionsTest-480767440 tempest-VolumesActionsTest-480767440-project-member] Image pref 0:0:0 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 09:53:39 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-06e70a1f-47e2-4d18-a44d-4ddd9a7a94b8 tempest-VolumesActionsTest-480767440 tempest-VolumesActionsTest-480767440-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 09:53:39 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-06e70a1f-47e2-4d18-a44d-4ddd9a7a94b8 tempest-VolumesActionsTest-480767440 tempest-VolumesActionsTest-480767440-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 09:53:39 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-06e70a1f-47e2-4d18-a44d-4ddd9a7a94b8 tempest-VolumesActionsTest-480767440 tempest-VolumesActionsTest-480767440-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75229) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 09:53:39 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-06e70a1f-47e2-4d18-a44d-4ddd9a7a94b8 tempest-VolumesActionsTest-480767440 tempest-VolumesActionsTest-480767440-project-member] Got 1 possible topologies {{(pid=75229) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 09:53:39 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-06e70a1f-47e2-4d18-a44d-4ddd9a7a94b8 tempest-VolumesActionsTest-480767440 tempest-VolumesActionsTest-480767440-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 09:53:39 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-06e70a1f-47e2-4d18-a44d-4ddd9a7a94b8 tempest-VolumesActionsTest-480767440 tempest-VolumesActionsTest-480767440-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 09:53:39 user nova-compute[75229]: DEBUG nova.virt.libvirt.vif [None req-06e70a1f-47e2-4d18-a44d-4ddd9a7a94b8 tempest-VolumesActionsTest-480767440 tempest-VolumesActionsTest-480767440-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T09:53:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-2065351145',display_name='tempest-VolumesActionsTest-instance-2065351145',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-2065351145',id=29,image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='76963cea909f48398eea96eefec38b0f',ramdisk_id='',reservation_id='r-6g3ots57',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-480767440',owner_user_name='tempest-VolumesActionsTest-480767440-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T09:53:37Z,user_data=None,user_id='c560169166e745ad9bb47e0c570c3ed8',uuid=200e8be8-516b-4344-a584-e88ee79b21a6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "45b7b43f-1c69-4e7d-bbf9-3cad74f674ef", "address": "fa:16:3e:b2:1d:1c", "network": {"id": "fedfe4bb-5b8c-4782-9df9-19cba1844f7c", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2139303642-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76963cea909f48398eea96eefec38b0f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45b7b43f-1c", "ovs_interfaceid": "45b7b43f-1c69-4e7d-bbf9-3cad74f674ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75229) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 09:53:39 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-06e70a1f-47e2-4d18-a44d-4ddd9a7a94b8 tempest-VolumesActionsTest-480767440 tempest-VolumesActionsTest-480767440-project-member] Converting VIF {"id": "45b7b43f-1c69-4e7d-bbf9-3cad74f674ef", "address": "fa:16:3e:b2:1d:1c", "network": {"id": "fedfe4bb-5b8c-4782-9df9-19cba1844f7c", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2139303642-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76963cea909f48398eea96eefec38b0f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45b7b43f-1c", "ovs_interfaceid": "45b7b43f-1c69-4e7d-bbf9-3cad74f674ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 09:53:39 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-06e70a1f-47e2-4d18-a44d-4ddd9a7a94b8 tempest-VolumesActionsTest-480767440 tempest-VolumesActionsTest-480767440-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b2:1d:1c,bridge_name='br-int',has_traffic_filtering=True,id=45b7b43f-1c69-4e7d-bbf9-3cad74f674ef,network=Network(fedfe4bb-5b8c-4782-9df9-19cba1844f7c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap45b7b43f-1c') {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 09:53:39 user nova-compute[75229]: DEBUG nova.objects.instance [None req-06e70a1f-47e2-4d18-a44d-4ddd9a7a94b8 tempest-VolumesActionsTest-480767440 tempest-VolumesActionsTest-480767440-project-member] Lazy-loading 'pci_devices' on Instance uuid 200e8be8-516b-4344-a584-e88ee79b21a6 {{(pid=75229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 09:53:39 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-1dee5dbf-1c05-4a7e-8bb7-0d5c42e27a09 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6 --force-share --output=json" returned: 0 in 0.227s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:53:39 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-1dee5dbf-1c05-4a7e-8bb7-0d5c42e27a09 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6,backing_fmt=raw /opt/stack/data/nova/instances/4c9fe69e-3f9d-4b30-a9e4-efc3e83efa17/disk.rescue {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:53:39 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-06e70a1f-47e2-4d18-a44d-4ddd9a7a94b8 tempest-VolumesActionsTest-480767440 tempest-VolumesActionsTest-480767440-project-member] [instance: 200e8be8-516b-4344-a584-e88ee79b21a6] End _get_guest_xml xml=<domain type="kvm">
Nov 14 09:53:39 user nova-compute[75229]:   <uuid>200e8be8-516b-4344-a584-e88ee79b21a6</uuid>
Nov 14 09:53:39 user nova-compute[75229]:   <name>instance-0000001d</name>
Nov 14 09:53:39 user nova-compute[75229]:   <memory>524288</memory>
Nov 14 09:53:39 user nova-compute[75229]:   <vcpu>1</vcpu>
Nov 14 09:53:39 user nova-compute[75229]:   <metadata>
Nov 14 09:53:39 user nova-compute[75229]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 09:53:39 user nova-compute[75229]:       <nova:package version="0.0.0"/>
Nov 14 09:53:39 user nova-compute[75229]:       <nova:name>tempest-VolumesActionsTest-instance-2065351145</nova:name>
Nov 14 09:53:39 user nova-compute[75229]:       <nova:creationTime>2023-11-14 09:53:39</nova:creationTime>
Nov 14 09:53:39 user nova-compute[75229]:       <nova:flavor name="m1.tiny">
Nov 14 09:53:39 user nova-compute[75229]:         <nova:memory>512</nova:memory>
Nov 14 09:53:39 user nova-compute[75229]:         <nova:disk>1</nova:disk>
Nov 14 09:53:39 user nova-compute[75229]:         <nova:swap>0</nova:swap>
Nov 14 09:53:39 user nova-compute[75229]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 09:53:39 user nova-compute[75229]:         <nova:vcpus>1</nova:vcpus>
Nov 14 09:53:39 user nova-compute[75229]:       </nova:flavor>
Nov 14 09:53:39 user nova-compute[75229]:       <nova:owner>
Nov 14 09:53:39 user nova-compute[75229]:         <nova:user uuid="c560169166e745ad9bb47e0c570c3ed8">tempest-VolumesActionsTest-480767440-project-member</nova:user>
Nov 14 09:53:39 user nova-compute[75229]:         <nova:project uuid="76963cea909f48398eea96eefec38b0f">tempest-VolumesActionsTest-480767440</nova:project>
Nov 14 09:53:39 user nova-compute[75229]:       </nova:owner>
Nov 14 09:53:39 user nova-compute[75229]:       <nova:root type="image" uuid="3bef8470-ecc7-40e3-95d4-9254348ea72d"/>
Nov 14 09:53:39 user nova-compute[75229]:       <nova:ports>
Nov 14 09:53:39 user nova-compute[75229]:         <nova:port uuid="45b7b43f-1c69-4e7d-bbf9-3cad74f674ef">
Nov 14 09:53:39 user nova-compute[75229]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 14 09:53:39 user nova-compute[75229]:         </nova:port>
Nov 14 09:53:39 user nova-compute[75229]:       </nova:ports>
Nov 14 09:53:39 user nova-compute[75229]:     </nova:instance>
Nov 14 09:53:39 user nova-compute[75229]:   </metadata>
Nov 14 09:53:39 user nova-compute[75229]:   <sysinfo type="smbios">
Nov 14 09:53:39 user nova-compute[75229]:     <system>
Nov 14 09:53:39 user nova-compute[75229]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 09:53:39 user nova-compute[75229]:       <entry name="product">OpenStack Nova</entry>
Nov 14 09:53:39 user nova-compute[75229]:       <entry name="version">0.0.0</entry>
Nov 14 09:53:39 user nova-compute[75229]:       <entry name="serial">200e8be8-516b-4344-a584-e88ee79b21a6</entry>
Nov 14 09:53:39 user nova-compute[75229]:       <entry name="uuid">200e8be8-516b-4344-a584-e88ee79b21a6</entry>
Nov 14 09:53:39 user nova-compute[75229]:       <entry name="family">Virtual Machine</entry>
Nov 14 09:53:39 user nova-compute[75229]:     </system>
Nov 14 09:53:39 user nova-compute[75229]:   </sysinfo>
Nov 14 09:53:39 user nova-compute[75229]:   <os>
Nov 14 09:53:39 user nova-compute[75229]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 09:53:39 user nova-compute[75229]:     <boot dev="hd"/>
Nov 14 09:53:39 user nova-compute[75229]:     <smbios mode="sysinfo"/>
Nov 14 09:53:39 user nova-compute[75229]:   </os>
Nov 14 09:53:39 user nova-compute[75229]:   <features>
Nov 14 09:53:39 user nova-compute[75229]:     <acpi/>
Nov 14 09:53:39 user nova-compute[75229]:     <apic/>
Nov 14 09:53:39 user nova-compute[75229]:     <vmcoreinfo/>
Nov 14 09:53:39 user nova-compute[75229]:   </features>
Nov 14 09:53:39 user nova-compute[75229]:   <clock offset="utc">
Nov 14 09:53:39 user nova-compute[75229]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 09:53:39 user nova-compute[75229]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 09:53:39 user nova-compute[75229]:     <timer name="hpet" present="no"/>
Nov 14 09:53:39 user nova-compute[75229]:   </clock>
Nov 14 09:53:39 user nova-compute[75229]:   <cpu mode="custom" match="exact">
Nov 14 09:53:39 user nova-compute[75229]:     <model>Nehalem</model>
Nov 14 09:53:39 user nova-compute[75229]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 09:53:39 user nova-compute[75229]:   </cpu>
Nov 14 09:53:39 user nova-compute[75229]:   <devices>
Nov 14 09:53:39 user nova-compute[75229]:     <disk type="file" device="disk">
Nov 14 09:53:39 user nova-compute[75229]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 09:53:39 user nova-compute[75229]:       <source file="/opt/stack/data/nova/instances/200e8be8-516b-4344-a584-e88ee79b21a6/disk"/>
Nov 14 09:53:39 user nova-compute[75229]:       <target dev="vda" bus="virtio"/>
Nov 14 09:53:39 user nova-compute[75229]:     </disk>
Nov 14 09:53:39 user nova-compute[75229]:     <interface type="ethernet">
Nov 14 09:53:39 user nova-compute[75229]:       <mac address="fa:16:3e:b2:1d:1c"/>
Nov 14 09:53:39 user nova-compute[75229]:       <model type="virtio"/>
Nov 14 09:53:39 user nova-compute[75229]:       <mtu size="1442"/>
Nov 14 09:53:39 user nova-compute[75229]:       <target dev="tap45b7b43f-1c"/>
Nov 14 09:53:39 user nova-compute[75229]:     </interface>
Nov 14 09:53:39 user nova-compute[75229]:     <serial type="pty">
Nov 14 09:53:39 user nova-compute[75229]:       <log file="/opt/stack/data/nova/instances/200e8be8-516b-4344-a584-e88ee79b21a6/console.log" append="off"/>
Nov 14 09:53:39 user nova-compute[75229]:     </serial>
Nov 14 09:53:39 user nova-compute[75229]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 09:53:39 user nova-compute[75229]:     <video>
Nov 14 09:53:39 user nova-compute[75229]:       <model type="virtio"/>
Nov 14 09:53:39 user nova-compute[75229]:     </video>
Nov 14 09:53:39 user nova-compute[75229]:     <rng model="virtio">
Nov 14 09:53:39 user nova-compute[75229]:       <backend model="random">/dev/urandom</backend>
Nov 14 09:53:39 user nova-compute[75229]:     </rng>
Nov 14 09:53:39 user nova-compute[75229]:     <controller type="usb" index="0" model="none"/>
Nov 14 09:53:39 user nova-compute[75229]:     <memballoon model="virtio">
Nov 14 09:53:39 user nova-compute[75229]:       <stats period="10"/>
Nov 14 09:53:39 user nova-compute[75229]:     </memballoon>
Nov 14 09:53:39 user nova-compute[75229]:   </devices>
Nov 14 09:53:39 user nova-compute[75229]: </domain>
Nov 14 09:53:39 user nova-compute[75229]:  {{(pid=75229) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 09:53:39 user nova-compute[75229]: DEBUG nova.virt.libvirt.vif [None req-06e70a1f-47e2-4d18-a44d-4ddd9a7a94b8 tempest-VolumesActionsTest-480767440 tempest-VolumesActionsTest-480767440-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T09:53:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-2065351145',display_name='tempest-VolumesActionsTest-instance-2065351145',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-2065351145',id=29,image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='76963cea909f48398eea96eefec38b0f',ramdisk_id='',reservation_id='r-6g3ots57',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-480767440',owner_user_name='tempest-VolumesActionsTest-480767440-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T09:53:37Z,user_data=None,user_id='c560169166e745ad9bb47e0c570c3ed8',uuid=200e8be8-516b-4344-a584-e88ee79b21a6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "45b7b43f-1c69-4e7d-bbf9-3cad74f674ef", "address": "fa:16:3e:b2:1d:1c", "network": {"id": "fedfe4bb-5b8c-4782-9df9-19cba1844f7c", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2139303642-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76963cea909f48398eea96eefec38b0f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45b7b43f-1c", "ovs_interfaceid": "45b7b43f-1c69-4e7d-bbf9-3cad74f674ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 09:53:39 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-06e70a1f-47e2-4d18-a44d-4ddd9a7a94b8 tempest-VolumesActionsTest-480767440 tempest-VolumesActionsTest-480767440-project-member] Converting VIF {"id": "45b7b43f-1c69-4e7d-bbf9-3cad74f674ef", "address": "fa:16:3e:b2:1d:1c", "network": {"id": "fedfe4bb-5b8c-4782-9df9-19cba1844f7c", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2139303642-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76963cea909f48398eea96eefec38b0f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45b7b43f-1c", "ovs_interfaceid": "45b7b43f-1c69-4e7d-bbf9-3cad74f674ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 09:53:39 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-06e70a1f-47e2-4d18-a44d-4ddd9a7a94b8 tempest-VolumesActionsTest-480767440 tempest-VolumesActionsTest-480767440-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b2:1d:1c,bridge_name='br-int',has_traffic_filtering=True,id=45b7b43f-1c69-4e7d-bbf9-3cad74f674ef,network=Network(fedfe4bb-5b8c-4782-9df9-19cba1844f7c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap45b7b43f-1c') {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 09:53:39 user nova-compute[75229]: DEBUG os_vif [None req-06e70a1f-47e2-4d18-a44d-4ddd9a7a94b8 tempest-VolumesActionsTest-480767440 tempest-VolumesActionsTest-480767440-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b2:1d:1c,bridge_name='br-int',has_traffic_filtering=True,id=45b7b43f-1c69-4e7d-bbf9-3cad74f674ef,network=Network(fedfe4bb-5b8c-4782-9df9-19cba1844f7c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap45b7b43f-1c') {{(pid=75229) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 09:53:39 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:53:39 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:53:39 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 09:53:39 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-1dee5dbf-1c05-4a7e-8bb7-0d5c42e27a09 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6,backing_fmt=raw /opt/stack/data/nova/instances/4c9fe69e-3f9d-4b30-a9e4-efc3e83efa17/disk.rescue" returned: 0 in 0.076s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:53:39 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:53:39 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0dfb4c66-fd19-5528-83fa-8b348586d62d', '_type': 'linux-noop'}}, row=False) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:53:39 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-1dee5dbf-1c05-4a7e-8bb7-0d5c42e27a09 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Lock "4f30e3fe703d2381679612a57b1fb80a467f60b6" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.307s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:53:39 user nova-compute[75229]: DEBUG nova.objects.instance [None req-1dee5dbf-1c05-4a7e-8bb7-0d5c42e27a09 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Lazy-loading 'migration_context' on Instance uuid 4c9fe69e-3f9d-4b30-a9e4-efc3e83efa17 {{(pid=75229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 09:53:39 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:53:39 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 09:53:39 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:53:39 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:53:39 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap45b7b43f-1c, may_exist=True, interface_attrs={}) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:53:39 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap45b7b43f-1c, col_values=(('qos', UUID('79431ed6-dfbf-40d3-b5c7-fc72106b82f5')),), if_exists=True) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:53:39 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap45b7b43f-1c, col_values=(('external_ids', {'iface-id': '45b7b43f-1c69-4e7d-bbf9-3cad74f674ef', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b2:1d:1c', 'vm-uuid': '200e8be8-516b-4344-a584-e88ee79b21a6'}),), if_exists=True) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:53:39 user nova-compute[75229]: DEBUG nova.objects.base [None req-1dee5dbf-1c05-4a7e-8bb7-0d5c42e27a09 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Object Instance<4c9fe69e-3f9d-4b30-a9e4-efc3e83efa17> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75229) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 09:53:39 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-1dee5dbf-1c05-4a7e-8bb7-0d5c42e27a09 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] [instance: 4c9fe69e-3f9d-4b30-a9e4-efc3e83efa17] Created local disks {{(pid=75229) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 09:53:39 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-1dee5dbf-1c05-4a7e-8bb7-0d5c42e27a09 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] [instance: 4c9fe69e-3f9d-4b30-a9e4-efc3e83efa17] Start _get_guest_xml network_info=[{"id": "235153d6-63c1-44d2-97cc-c083544e6790", "address": "fa:16:3e:a0:db:35", "network": {"id": "22eed29e-7148-42f9-b4c7-b97811cba8eb", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2000485731-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-2000485731-network", "vif_mac": "fa:16:3e:a0:db:35"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46457b27e3ed416e827c3c22449fb512", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap235153d6-63", "ovs_interfaceid": "235153d6-63c1-44d2-97cc-c083544e6790", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T09:40:10Z,direct_url=<?>,disk_format='qcow2',id=3bef8470-ecc7-40e3-95d4-9254348ea72d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='de5a91106b6948ed937a7178ff9464c4',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T09:40:12Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '3bef8470-ecc7-40e3-95d4-9254348ea72d', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=75229) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 09:53:39 user nova-compute[75229]: DEBUG nova.objects.instance [None req-1dee5dbf-1c05-4a7e-8bb7-0d5c42e27a09 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Lazy-loading 'resources' on Instance uuid 4c9fe69e-3f9d-4b30-a9e4-efc3e83efa17 {{(pid=75229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 09:53:39 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:53:39 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 09:53:39 user nova-compute[75229]: DEBUG nova.objects.base [None req-1dee5dbf-1c05-4a7e-8bb7-0d5c42e27a09 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Object Instance<4c9fe69e-3f9d-4b30-a9e4-efc3e83efa17> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75229) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 09:53:39 user nova-compute[75229]: DEBUG nova.objects.instance [None req-1dee5dbf-1c05-4a7e-8bb7-0d5c42e27a09 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Lazy-loading 'numa_topology' on Instance uuid 4c9fe69e-3f9d-4b30-a9e4-efc3e83efa17 {{(pid=75229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 09:53:39 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:53:39 user nova-compute[75229]: INFO os_vif [None req-06e70a1f-47e2-4d18-a44d-4ddd9a7a94b8 tempest-VolumesActionsTest-480767440 tempest-VolumesActionsTest-480767440-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b2:1d:1c,bridge_name='br-int',has_traffic_filtering=True,id=45b7b43f-1c69-4e7d-bbf9-3cad74f674ef,network=Network(fedfe4bb-5b8c-4782-9df9-19cba1844f7c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap45b7b43f-1c')
Nov 14 09:53:39 user nova-compute[75229]: DEBUG nova.objects.base [None req-1dee5dbf-1c05-4a7e-8bb7-0d5c42e27a09 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Object Instance<4c9fe69e-3f9d-4b30-a9e4-efc3e83efa17> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75229) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 09:53:39 user nova-compute[75229]: WARNING nova.virt.libvirt.driver [None req-1dee5dbf-1c05-4a7e-8bb7-0d5c42e27a09 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 09:53:39 user nova-compute[75229]: WARNING nova.virt.libvirt.driver [None req-1dee5dbf-1c05-4a7e-8bb7-0d5c42e27a09 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 09:53:39 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-1dee5dbf-1c05-4a7e-8bb7-0d5c42e27a09 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75229) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 09:53:39 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-1dee5dbf-1c05-4a7e-8bb7-0d5c42e27a09 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] CPU controller missing on host. {{(pid=75229) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 09:53:39 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-1dee5dbf-1c05-4a7e-8bb7-0d5c42e27a09 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75229) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 09:53:39 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-1dee5dbf-1c05-4a7e-8bb7-0d5c42e27a09 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] CPU controller found on host. {{(pid=75229) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 09:53:39 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-1dee5dbf-1c05-4a7e-8bb7-0d5c42e27a09 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75229) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 09:53:39 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-1dee5dbf-1c05-4a7e-8bb7-0d5c42e27a09 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T09:39:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T09:40:10Z,direct_url=<?>,disk_format='qcow2',id=3bef8470-ecc7-40e3-95d4-9254348ea72d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='de5a91106b6948ed937a7178ff9464c4',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T09:40:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 09:53:39 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-1dee5dbf-1c05-4a7e-8bb7-0d5c42e27a09 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Flavor limits 0:0:0 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 09:53:39 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-1dee5dbf-1c05-4a7e-8bb7-0d5c42e27a09 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Image limits 0:0:0 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 09:53:39 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-1dee5dbf-1c05-4a7e-8bb7-0d5c42e27a09 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Flavor pref 0:0:0 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 09:53:39 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-1dee5dbf-1c05-4a7e-8bb7-0d5c42e27a09 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Image pref 0:0:0 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 09:53:39 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-1dee5dbf-1c05-4a7e-8bb7-0d5c42e27a09 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 09:53:39 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-1dee5dbf-1c05-4a7e-8bb7-0d5c42e27a09 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 09:53:39 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-1dee5dbf-1c05-4a7e-8bb7-0d5c42e27a09 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75229) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 09:53:39 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-1dee5dbf-1c05-4a7e-8bb7-0d5c42e27a09 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Got 1 possible topologies {{(pid=75229) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 09:53:39 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-1dee5dbf-1c05-4a7e-8bb7-0d5c42e27a09 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 09:53:39 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-1dee5dbf-1c05-4a7e-8bb7-0d5c42e27a09 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 09:53:39 user nova-compute[75229]: DEBUG nova.objects.instance [None req-1dee5dbf-1c05-4a7e-8bb7-0d5c42e27a09 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Lazy-loading 'vcpu_model' on Instance uuid 4c9fe69e-3f9d-4b30-a9e4-efc3e83efa17 {{(pid=75229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 09:53:39 user nova-compute[75229]: DEBUG nova.objects.base [None req-1dee5dbf-1c05-4a7e-8bb7-0d5c42e27a09 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Object Instance<4c9fe69e-3f9d-4b30-a9e4-efc3e83efa17> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75229) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 09:53:39 user nova-compute[75229]: DEBUG nova.virt.libvirt.vif [None req-1dee5dbf-1c05-4a7e-8bb7-0d5c42e27a09 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T09:48:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-2544538',display_name='tempest-ServerRescueNegativeTestJSON-server-2544538',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-2544538',id=18,image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-14T09:49:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='46457b27e3ed416e827c3c22449fb512',ramdisk_id='',reservation_id='r-4gsrvn1y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-557279920',owner_user_name='tempest-ServerRescueNegativeTestJSON-557279920-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T09:49:04Z,user_data=None,user_id='a3cb33a5c522499e8cd254edd5e15879',uuid=4c9fe69e-3f9d-4b30-a9e4-efc3e83efa17,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "235153d6-63c1-44d2-97cc-c083544e6790", "address": "fa:16:3e:a0:db:35", "network": {"id": "22eed29e-7148-42f9-b4c7-b97811cba8eb", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2000485731-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-2000485731-network", "vif_mac": "fa:16:3e:a0:db:35"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46457b27e3ed416e827c3c22449fb512", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap235153d6-63", "ovs_interfaceid": "235153d6-63c1-44d2-97cc-c083544e6790", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75229) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 09:53:39 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-1dee5dbf-1c05-4a7e-8bb7-0d5c42e27a09 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Converting VIF {"id": "235153d6-63c1-44d2-97cc-c083544e6790", "address": "fa:16:3e:a0:db:35", "network": {"id": "22eed29e-7148-42f9-b4c7-b97811cba8eb", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2000485731-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-2000485731-network", "vif_mac": "fa:16:3e:a0:db:35"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46457b27e3ed416e827c3c22449fb512", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap235153d6-63", "ovs_interfaceid": "235153d6-63c1-44d2-97cc-c083544e6790", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 09:53:39 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-1dee5dbf-1c05-4a7e-8bb7-0d5c42e27a09 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a0:db:35,bridge_name='br-int',has_traffic_filtering=True,id=235153d6-63c1-44d2-97cc-c083544e6790,network=Network(22eed29e-7148-42f9-b4c7-b97811cba8eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap235153d6-63') {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 09:53:39 user nova-compute[75229]: DEBUG nova.objects.instance [None req-1dee5dbf-1c05-4a7e-8bb7-0d5c42e27a09 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Lazy-loading 'pci_devices' on Instance uuid 4c9fe69e-3f9d-4b30-a9e4-efc3e83efa17 {{(pid=75229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 09:53:39 user nova-compute[75229]: DEBUG nova.objects.base [None req-1dee5dbf-1c05-4a7e-8bb7-0d5c42e27a09 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Object Instance<4c9fe69e-3f9d-4b30-a9e4-efc3e83efa17> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75229) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 09:53:39 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-1dee5dbf-1c05-4a7e-8bb7-0d5c42e27a09 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] [instance: 4c9fe69e-3f9d-4b30-a9e4-efc3e83efa17] End _get_guest_xml xml=<domain type="kvm">
Nov 14 09:53:39 user nova-compute[75229]:   <uuid>4c9fe69e-3f9d-4b30-a9e4-efc3e83efa17</uuid>
Nov 14 09:53:39 user nova-compute[75229]:   <name>instance-00000012</name>
Nov 14 09:53:39 user nova-compute[75229]:   <memory>524288</memory>
Nov 14 09:53:39 user nova-compute[75229]:   <vcpu>1</vcpu>
Nov 14 09:53:39 user nova-compute[75229]:   <metadata>
Nov 14 09:53:39 user nova-compute[75229]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 09:53:39 user nova-compute[75229]:       <nova:package version="0.0.0"/>
Nov 14 09:53:39 user nova-compute[75229]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-2544538</nova:name>
Nov 14 09:53:39 user nova-compute[75229]:       <nova:creationTime>2023-11-14 09:53:39</nova:creationTime>
Nov 14 09:53:39 user nova-compute[75229]:       <nova:flavor name="m1.tiny">
Nov 14 09:53:39 user nova-compute[75229]:         <nova:memory>512</nova:memory>
Nov 14 09:53:39 user nova-compute[75229]:         <nova:disk>1</nova:disk>
Nov 14 09:53:39 user nova-compute[75229]:         <nova:swap>0</nova:swap>
Nov 14 09:53:39 user nova-compute[75229]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 09:53:39 user nova-compute[75229]:         <nova:vcpus>1</nova:vcpus>
Nov 14 09:53:39 user nova-compute[75229]:       </nova:flavor>
Nov 14 09:53:39 user nova-compute[75229]:       <nova:owner>
Nov 14 09:53:39 user nova-compute[75229]:         <nova:user uuid="a3cb33a5c522499e8cd254edd5e15879">tempest-ServerRescueNegativeTestJSON-557279920-project-member</nova:user>
Nov 14 09:53:39 user nova-compute[75229]:         <nova:project uuid="46457b27e3ed416e827c3c22449fb512">tempest-ServerRescueNegativeTestJSON-557279920</nova:project>
Nov 14 09:53:39 user nova-compute[75229]:       </nova:owner>
Nov 14 09:53:39 user nova-compute[75229]:       <nova:root type="image" uuid="3bef8470-ecc7-40e3-95d4-9254348ea72d"/>
Nov 14 09:53:39 user nova-compute[75229]:       <nova:ports>
Nov 14 09:53:39 user nova-compute[75229]:         <nova:port uuid="235153d6-63c1-44d2-97cc-c083544e6790">
Nov 14 09:53:39 user nova-compute[75229]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 14 09:53:39 user nova-compute[75229]:         </nova:port>
Nov 14 09:53:39 user nova-compute[75229]:       </nova:ports>
Nov 14 09:53:39 user nova-compute[75229]:     </nova:instance>
Nov 14 09:53:39 user nova-compute[75229]:   </metadata>
Nov 14 09:53:39 user nova-compute[75229]:   <sysinfo type="smbios">
Nov 14 09:53:39 user nova-compute[75229]:     <system>
Nov 14 09:53:39 user nova-compute[75229]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 09:53:39 user nova-compute[75229]:       <entry name="product">OpenStack Nova</entry>
Nov 14 09:53:39 user nova-compute[75229]:       <entry name="version">0.0.0</entry>
Nov 14 09:53:39 user nova-compute[75229]:       <entry name="serial">4c9fe69e-3f9d-4b30-a9e4-efc3e83efa17</entry>
Nov 14 09:53:39 user nova-compute[75229]:       <entry name="uuid">4c9fe69e-3f9d-4b30-a9e4-efc3e83efa17</entry>
Nov 14 09:53:39 user nova-compute[75229]:       <entry name="family">Virtual Machine</entry>
Nov 14 09:53:39 user nova-compute[75229]:     </system>
Nov 14 09:53:39 user nova-compute[75229]:   </sysinfo>
Nov 14 09:53:39 user nova-compute[75229]:   <os>
Nov 14 09:53:39 user nova-compute[75229]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 09:53:39 user nova-compute[75229]:     <smbios mode="sysinfo"/>
Nov 14 09:53:39 user nova-compute[75229]:   </os>
Nov 14 09:53:39 user nova-compute[75229]:   <features>
Nov 14 09:53:39 user nova-compute[75229]:     <acpi/>
Nov 14 09:53:39 user nova-compute[75229]:     <apic/>
Nov 14 09:53:39 user nova-compute[75229]:     <vmcoreinfo/>
Nov 14 09:53:39 user nova-compute[75229]:   </features>
Nov 14 09:53:39 user nova-compute[75229]:   <clock offset="utc">
Nov 14 09:53:39 user nova-compute[75229]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 09:53:39 user nova-compute[75229]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 09:53:39 user nova-compute[75229]:     <timer name="hpet" present="no"/>
Nov 14 09:53:39 user nova-compute[75229]:   </clock>
Nov 14 09:53:39 user nova-compute[75229]:   <cpu mode="custom" match="exact">
Nov 14 09:53:39 user nova-compute[75229]:     <model>Nehalem</model>
Nov 14 09:53:39 user nova-compute[75229]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 09:53:39 user nova-compute[75229]:   </cpu>
Nov 14 09:53:39 user nova-compute[75229]:   <devices>
Nov 14 09:53:39 user nova-compute[75229]:     <disk type="file" device="disk">
Nov 14 09:53:39 user nova-compute[75229]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 09:53:39 user nova-compute[75229]:       <source file="/opt/stack/data/nova/instances/4c9fe69e-3f9d-4b30-a9e4-efc3e83efa17/disk.rescue"/>
Nov 14 09:53:39 user nova-compute[75229]:       <target dev="vda" bus="virtio"/>
Nov 14 09:53:39 user nova-compute[75229]:     </disk>
Nov 14 09:53:39 user nova-compute[75229]:     <disk type="file" device="disk">
Nov 14 09:53:39 user nova-compute[75229]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 09:53:39 user nova-compute[75229]:       <source file="/opt/stack/data/nova/instances/4c9fe69e-3f9d-4b30-a9e4-efc3e83efa17/disk"/>
Nov 14 09:53:39 user nova-compute[75229]:       <target dev="vdb" bus="virtio"/>
Nov 14 09:53:39 user nova-compute[75229]:     </disk>
Nov 14 09:53:39 user nova-compute[75229]:     <interface type="ethernet">
Nov 14 09:53:39 user nova-compute[75229]:       <mac address="fa:16:3e:a0:db:35"/>
Nov 14 09:53:39 user nova-compute[75229]:       <model type="virtio"/>
Nov 14 09:53:39 user nova-compute[75229]:       <mtu size="1442"/>
Nov 14 09:53:39 user nova-compute[75229]:       <target dev="tap235153d6-63"/>
Nov 14 09:53:39 user nova-compute[75229]:     </interface>
Nov 14 09:53:39 user nova-compute[75229]:     <serial type="pty">
Nov 14 09:53:39 user nova-compute[75229]:       <log file="/opt/stack/data/nova/instances/4c9fe69e-3f9d-4b30-a9e4-efc3e83efa17/console.log" append="off"/>
Nov 14 09:53:39 user nova-compute[75229]:     </serial>
Nov 14 09:53:39 user nova-compute[75229]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 09:53:39 user nova-compute[75229]:     <video>
Nov 14 09:53:39 user nova-compute[75229]:       <model type="virtio"/>
Nov 14 09:53:39 user nova-compute[75229]:     </video>
Nov 14 09:53:39 user nova-compute[75229]:     <rng model="virtio">
Nov 14 09:53:39 user nova-compute[75229]:       <backend model="random">/dev/urandom</backend>
Nov 14 09:53:39 user nova-compute[75229]:     </rng>
Nov 14 09:53:39 user nova-compute[75229]:     <controller type="usb" index="0" model="none"/>
Nov 14 09:53:39 user nova-compute[75229]:     <memballoon model="virtio">
Nov 14 09:53:39 user nova-compute[75229]:       <stats period="10"/>
Nov 14 09:53:39 user nova-compute[75229]:     </memballoon>
Nov 14 09:53:39 user nova-compute[75229]:   </devices>
Nov 14 09:53:39 user nova-compute[75229]: </domain>
Nov 14 09:53:39 user nova-compute[75229]:  {{(pid=75229) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 09:53:39 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-06e70a1f-47e2-4d18-a44d-4ddd9a7a94b8 tempest-VolumesActionsTest-480767440 tempest-VolumesActionsTest-480767440-project-member] No BDM found with device name vda, not building metadata. {{(pid=75229) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 09:53:39 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-06e70a1f-47e2-4d18-a44d-4ddd9a7a94b8 tempest-VolumesActionsTest-480767440 tempest-VolumesActionsTest-480767440-project-member] No VIF found with MAC fa:16:3e:b2:1d:1c, not building metadata {{(pid=75229) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 09:53:39 user nova-compute[75229]: INFO nova.virt.libvirt.driver [-] [instance: 4c9fe69e-3f9d-4b30-a9e4-efc3e83efa17] Instance destroyed successfully.
Nov 14 09:53:39 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-1dee5dbf-1c05-4a7e-8bb7-0d5c42e27a09 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] No BDM found with device name vda, not building metadata. {{(pid=75229) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 09:53:39 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-1dee5dbf-1c05-4a7e-8bb7-0d5c42e27a09 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75229) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 09:53:39 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-1dee5dbf-1c05-4a7e-8bb7-0d5c42e27a09 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] No VIF found with MAC fa:16:3e:a0:db:35, not building metadata {{(pid=75229) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 09:53:39 user nova-compute[75229]: WARNING nova.virt.libvirt.driver [None req-bc0393e9-3e50-4e2e-a5ce-07d86e9cffad tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 673624b6-e830-45e0-9215-ba79fd4f881e is timed out.
Nov 14 09:53:39 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-bc0393e9-3e50-4e2e-a5ce-07d86e9cffad tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] Successfully detached device vdb from instance 673624b6-e830-45e0-9215-ba79fd4f881e from the live domain config.
Nov 14 09:53:39 user nova-compute[75229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bc0393e9-3e50-4e2e-a5ce-07d86e9cffad tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] [instance: 673624b6-e830-45e0-9215-ba79fd4f881e] calling os-brick to detach iSCSI Volume {{(pid=75229) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 09:53:39 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc0393e9-3e50-4e2e-a5ce-07d86e9cffad tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f73f85151b0>, {'target_iqn': 'iqn.2010-10.org.openstack:c545a289-274d-485e-8787-3c8cb01f244e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ygvpNczb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 09:53:39 user nova-compute[75229]: WARNING os_brick.initiator.connectors.base [None req-bc0393e9-3e50-4e2e-a5ce-07d86e9cffad tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 09:53:39 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-bc0393e9-3e50-4e2e-a5ce-07d86e9cffad tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 09:53:39 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-bc0393e9-3e50-4e2e-a5ce-07d86e9cffad tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 09:53:39 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:53:39 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:53:39 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dd1e713-898b-4a81-b0cc-eaeb286bee04]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c545a289-274d-485e-8787-3c8cb01f244e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b590f04d-8a50-4810-8e66-05d846f4613f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:53:39 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc0393e9-3e50-4e2e-a5ce-07d86e9cffad tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 09:53:39 user nova-compute[75229]: No targets found.
Nov 14 09:53:39 user nova-compute[75229]: iSNS:
Nov 14 09:53:39 user nova-compute[75229]: No targets found.
Nov 14 09:53:39 user nova-compute[75229]: STATIC:
Nov 14 09:53:39 user nova-compute[75229]: Target: iqn.2010-10.org.openstack:c545a289-274d-485e-8787-3c8cb01f244e
Nov 14 09:53:39 user nova-compute[75229]:         Portal: 172.16.0.220:3260,-1
Nov 14 09:53:39 user nova-compute[75229]:                 Iface Name: default
Nov 14 09:53:39 user nova-compute[75229]: Target: iqn.2010-10.org.openstack:b590f04d-8a50-4810-8e66-05d846f4613f
Nov 14 09:53:39 user nova-compute[75229]:         Portal: 172.16.0.220:3260,-1
Nov 14 09:53:39 user nova-compute[75229]:                 Iface Name: default
Nov 14 09:53:39 user nova-compute[75229]: FIRMWARE:
Nov 14 09:53:39 user nova-compute[75229]: No targets found.
Nov 14 09:53:39 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 09:53:39 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc0393e9-3e50-4e2e-a5ce-07d86e9cffad tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 09:53:39 user nova-compute[75229]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 09:53:39 user nova-compute[75229]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75229) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 09:53:39 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc0393e9-3e50-4e2e-a5ce-07d86e9cffad tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c545a289-274d-485e-8787-3c8cb01f244e', 0)] {{(pid=75229) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 09:53:39 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:53:39 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:53:39 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a106cb2-a53b-4df7-b4cf-d1a37a893ba2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b590f04d-8a50-4810-8e66-05d846f4613f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c545a289-274d-485e-8787-3c8cb01f244e\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:53:39 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:53:39 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:53:39 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[c63a078a-ce43-4fd1-b41a-c22641ccec01]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b590f04d-8a50-4810-8e66-05d846f4613f (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c545a289-274d-485e-8787-3c8cb01f244e (non-flash)\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:53:39 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc0393e9-3e50-4e2e-a5ce-07d86e9cffad tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b590f04d-8a50-4810-8e66-05d846f4613f (non-flash)
Nov 14 09:53:39 user nova-compute[75229]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c545a289-274d-485e-8787-3c8cb01f244e (non-flash)
Nov 14 09:53:39 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 09:53:39 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc0393e9-3e50-4e2e-a5ce-07d86e9cffad tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b590f04d-8a50-4810-8e66-05d846f4613f (non-flash)
Nov 14 09:53:39 user nova-compute[75229]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c545a289-274d-485e-8787-3c8cb01f244e (non-flash)
Nov 14 09:53:39 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 09:53:39 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc0393e9-3e50-4e2e-a5ce-07d86e9cffad tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f73d4c53640>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c545a289-274d-485e-8787-3c8cb01f244e'): ({'sdb'}, set())}) {{(pid=75229) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 09:53:39 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-bc0393e9-3e50-4e2e-a5ce-07d86e9cffad tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] Removing single pathed devices sdb {{(pid=75229) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 09:53:39 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:53:39 user nova-compute[75229]: DEBUG nova.network.neutron [req-bcb147f7-1971-422c-b4c4-deb74702bef8 req-9eb5ab2e-c29c-428b-b0bb-f5c355edef89 service nova] [instance: 200e8be8-516b-4344-a584-e88ee79b21a6] Updated VIF entry in instance network info cache for port 45b7b43f-1c69-4e7d-bbf9-3cad74f674ef. {{(pid=75229) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 09:53:39 user nova-compute[75229]: DEBUG nova.network.neutron [req-bcb147f7-1971-422c-b4c4-deb74702bef8 req-9eb5ab2e-c29c-428b-b0bb-f5c355edef89 service nova] [instance: 200e8be8-516b-4344-a584-e88ee79b21a6] Updating instance_info_cache with network_info: [{"id": "45b7b43f-1c69-4e7d-bbf9-3cad74f674ef", "address": "fa:16:3e:b2:1d:1c", "network": {"id": "fedfe4bb-5b8c-4782-9df9-19cba1844f7c", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2139303642-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76963cea909f48398eea96eefec38b0f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45b7b43f-1c", "ovs_interfaceid": "45b7b43f-1c69-4e7d-bbf9-3cad74f674ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 09:53:39 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:53:39 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[dee8dfdc-5f76-4673-82eb-bef3e2e548ee]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:53:39 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:53:39 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-bcb147f7-1971-422c-b4c4-deb74702bef8 req-9eb5ab2e-c29c-428b-b0bb-f5c355edef89 service nova] Releasing lock "refresh_cache-200e8be8-516b-4344-a584-e88ee79b21a6" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 09:53:39 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:53:39 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[32a460b3-fe13-43e5-b051-c4be2a5964c1]: (4, ('ok\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:53:39 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-bc0393e9-3e50-4e2e-a5ce-07d86e9cffad tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] Flushing IO for device /dev/sdb {{(pid=75229) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 09:53:39 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:53:39 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:53:39 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9ee8819-b187-4d27-af07-83119cc72683]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:53:39 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-bc0393e9-3e50-4e2e-a5ce-07d86e9cffad tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75229) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 09:53:39 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:53:39 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.036s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:53:39 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee7fcac1-5924-4737-abf0-2fd605d665ed]: (4, ('1', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:53:39 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-bc0393e9-3e50-4e2e-a5ce-07d86e9cffad tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75229) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 09:53:39 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-bc0393e9-3e50-4e2e-a5ce-07d86e9cffad tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] SCSI volumes sdb have been removed. {{(pid=75229) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 09:53:39 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc0393e9-3e50-4e2e-a5ce-07d86e9cffad tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c545a289-274d-485e-8787-3c8cb01f244e')] {{(pid=75229) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 09:53:39 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c545a289-274d-485e-8787-3c8cb01f244e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:53:39 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c545a289-274d-485e-8787-3c8cb01f244e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:53:39 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[36fe3cf8-a71a-4761-8ccb-009bb09f1279]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:53:39 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc0393e9-3e50-4e2e-a5ce-07d86e9cffad tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:53:39 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c545a289-274d-485e-8787-3c8cb01f244e -p 172.16.0.220:3260 --logout {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:53:39 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c545a289-274d-485e-8787-3c8cb01f244e -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:53:39 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcd90ce0-66ce-4ccb-9004-3bf397d006d8]: (4, ('Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:c545a289-274d-485e-8787-3c8cb01f244e, portal: 172.16.0.220,3260]\nLogout of [sid: 28, target: iqn.2010-10.org.openstack:c545a289-274d-485e-8787-3c8cb01f244e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:53:39 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc0393e9-3e50-4e2e-a5ce-07d86e9cffad tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:c545a289-274d-485e-8787-3c8cb01f244e, portal: 172.16.0.220,3260]
Nov 14 09:53:39 user nova-compute[75229]: Logout of [sid: 28, target: iqn.2010-10.org.openstack:c545a289-274d-485e-8787-3c8cb01f244e, portal: 172.16.0.220,3260] successful.
Nov 14 09:53:39 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:53:39 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c545a289-274d-485e-8787-3c8cb01f244e -p 172.16.0.220:3260 --op delete {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:53:40 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c545a289-274d-485e-8787-3c8cb01f244e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:53:40 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9b3b90c-21db-4097-9a8d-a288218c70f4]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:53:40 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc0393e9-3e50-4e2e-a5ce-07d86e9cffad tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:53:40 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-bc0393e9-3e50-4e2e-a5ce-07d86e9cffad tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.288s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 09:53:40 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc0393e9-3e50-4e2e-a5ce-07d86e9cffad tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] <== disconnect_volume: return (290ms) None {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 09:53:40 user nova-compute[75229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bc0393e9-3e50-4e2e-a5ce-07d86e9cffad tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] [instance: 673624b6-e830-45e0-9215-ba79fd4f881e] Disconnected iSCSI Volume {{(pid=75229) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 09:53:40 user nova-compute[75229]: DEBUG nova.compute.manager [req-5ac8e850-c5de-4eda-8cef-0e98d2e1cf96 req-549b3c01-e99b-4264-b851-5568b7e1352d service nova] [instance: 4c9fe69e-3f9d-4b30-a9e4-efc3e83efa17] Received event network-vif-plugged-235153d6-63c1-44d2-97cc-c083544e6790 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:53:40 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-5ac8e850-c5de-4eda-8cef-0e98d2e1cf96 req-549b3c01-e99b-4264-b851-5568b7e1352d service nova] Acquiring lock "4c9fe69e-3f9d-4b30-a9e4-efc3e83efa17-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:53:40 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-5ac8e850-c5de-4eda-8cef-0e98d2e1cf96 req-549b3c01-e99b-4264-b851-5568b7e1352d service nova] Lock "4c9fe69e-3f9d-4b30-a9e4-efc3e83efa17-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:53:40 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-5ac8e850-c5de-4eda-8cef-0e98d2e1cf96 req-549b3c01-e99b-4264-b851-5568b7e1352d service nova] Lock "4c9fe69e-3f9d-4b30-a9e4-efc3e83efa17-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:53:40 user nova-compute[75229]: DEBUG nova.compute.manager [req-5ac8e850-c5de-4eda-8cef-0e98d2e1cf96 req-549b3c01-e99b-4264-b851-5568b7e1352d service nova] [instance: 4c9fe69e-3f9d-4b30-a9e4-efc3e83efa17] No waiting events found dispatching network-vif-plugged-235153d6-63c1-44d2-97cc-c083544e6790 {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 09:53:40 user nova-compute[75229]: WARNING nova.compute.manager [req-5ac8e850-c5de-4eda-8cef-0e98d2e1cf96 req-549b3c01-e99b-4264-b851-5568b7e1352d service nova] [instance: 4c9fe69e-3f9d-4b30-a9e4-efc3e83efa17] Received unexpected event network-vif-plugged-235153d6-63c1-44d2-97cc-c083544e6790 for instance with vm_state active and task_state rescuing.
Nov 14 09:53:40 user nova-compute[75229]: DEBUG nova.objects.instance [None req-bc0393e9-3e50-4e2e-a5ce-07d86e9cffad tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] Lazy-loading 'flavor' on Instance uuid 673624b6-e830-45e0-9215-ba79fd4f881e {{(pid=75229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 09:53:40 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc0393e9-3e50-4e2e-a5ce-07d86e9cffad tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] Lock "673624b6-e830-45e0-9215-ba79fd4f881e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.808s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:53:40 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-f94fd950-bcbe-46b3-9fa3-5c3ff6a6e3ee tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] Lock "673624b6-e830-45e0-9215-ba79fd4f881e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 21.633s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:53:40 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-f94fd950-bcbe-46b3-9fa3-5c3ff6a6e3ee tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] Acquiring lock "673624b6-e830-45e0-9215-ba79fd4f881e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:53:40 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-f94fd950-bcbe-46b3-9fa3-5c3ff6a6e3ee tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] Lock "673624b6-e830-45e0-9215-ba79fd4f881e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:53:40 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-f94fd950-bcbe-46b3-9fa3-5c3ff6a6e3ee tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] Lock "673624b6-e830-45e0-9215-ba79fd4f881e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:53:40 user nova-compute[75229]: INFO nova.compute.manager [None req-f94fd950-bcbe-46b3-9fa3-5c3ff6a6e3ee tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] [instance: 673624b6-e830-45e0-9215-ba79fd4f881e] Terminating instance
Nov 14 09:53:40 user nova-compute[75229]: DEBUG nova.compute.manager [None req-f94fd950-bcbe-46b3-9fa3-5c3ff6a6e3ee tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] [instance: 673624b6-e830-45e0-9215-ba79fd4f881e] Start destroying the instance on the hypervisor. {{(pid=75229) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 09:53:41 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:53:41 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:53:41 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:53:41 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:53:41 user nova-compute[75229]: DEBUG nova.compute.manager [req-2a741685-8b0f-4c98-a05e-d87829e13198 req-53049cfe-23c6-40d9-888e-e0cff84c6c1e service nova] [instance: 673624b6-e830-45e0-9215-ba79fd4f881e] Received event network-vif-unplugged-0102e03b-5b3a-46ab-84de-c836b2b46ca5 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:53:41 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-2a741685-8b0f-4c98-a05e-d87829e13198 req-53049cfe-23c6-40d9-888e-e0cff84c6c1e service nova] Acquiring lock "673624b6-e830-45e0-9215-ba79fd4f881e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:53:41 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-2a741685-8b0f-4c98-a05e-d87829e13198 req-53049cfe-23c6-40d9-888e-e0cff84c6c1e service nova] Lock "673624b6-e830-45e0-9215-ba79fd4f881e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:53:41 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-2a741685-8b0f-4c98-a05e-d87829e13198 req-53049cfe-23c6-40d9-888e-e0cff84c6c1e service nova] Lock "673624b6-e830-45e0-9215-ba79fd4f881e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:53:41 user nova-compute[75229]: DEBUG nova.compute.manager [req-2a741685-8b0f-4c98-a05e-d87829e13198 req-53049cfe-23c6-40d9-888e-e0cff84c6c1e service nova] [instance: 673624b6-e830-45e0-9215-ba79fd4f881e] No waiting events found dispatching network-vif-unplugged-0102e03b-5b3a-46ab-84de-c836b2b46ca5 {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 09:53:41 user nova-compute[75229]: DEBUG nova.compute.manager [req-2a741685-8b0f-4c98-a05e-d87829e13198 req-53049cfe-23c6-40d9-888e-e0cff84c6c1e service nova] [instance: 673624b6-e830-45e0-9215-ba79fd4f881e] Received event network-vif-unplugged-0102e03b-5b3a-46ab-84de-c836b2b46ca5 for instance with task_state deleting. {{(pid=75229) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 09:53:41 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:53:41 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:53:41 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:53:41 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:53:42 user nova-compute[75229]: INFO nova.virt.libvirt.driver [-] [instance: 673624b6-e830-45e0-9215-ba79fd4f881e] Instance destroyed successfully.
Nov 14 09:53:42 user nova-compute[75229]: DEBUG nova.objects.instance [None req-f94fd950-bcbe-46b3-9fa3-5c3ff6a6e3ee tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] Lazy-loading 'resources' on Instance uuid 673624b6-e830-45e0-9215-ba79fd4f881e {{(pid=75229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 09:53:42 user nova-compute[75229]: DEBUG nova.virt.libvirt.vif [None req-f94fd950-bcbe-46b3-9fa3-5c3ff6a6e3ee tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T09:51:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-2060843632',display_name='tempest-VolumesSnapshotTestJSON-instance-2060843632',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-2060843632',id=26,image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNVoPiti4jcQ9HrE3b6XLn6nHzH73qOAOZ9O/lgVREYGI6hgEzCS3rKxX7uea7lmBsz30cIjPk3x92phZcoCIZakxbeg4wd66JThjFnPyMJNYvqbjbWBVVa+O+yUVlcEFg==',key_name='tempest-keypair-66224590',keypairs=<?>,launch_index=0,launched_at=2023-11-14T09:51:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9d2e9dceab8a45eaa3adb619433b7cf0',ramdisk_id='',reservation_id='r-j9hhn1lc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-1180270100',owner_user_name='tempest-VolumesSnapshotTestJSON-1180270100-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T09:51:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='915a9d3b56244777aba6ea938e150d3d',uuid=673624b6-e830-45e0-9215-ba79fd4f881e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0102e03b-5b3a-46ab-84de-c836b2b46ca5", "address": "fa:16:3e:b1:c1:9c", "network": {"id": "4bc624aa-efaf-45a9-b889-84d4bf2953b4", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-271284704-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d2e9dceab8a45eaa3adb619433b7cf0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0102e03b-5b", "ovs_interfaceid": "0102e03b-5b3a-46ab-84de-c836b2b46ca5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 09:53:42 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-f94fd950-bcbe-46b3-9fa3-5c3ff6a6e3ee tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] Converting VIF {"id": "0102e03b-5b3a-46ab-84de-c836b2b46ca5", "address": "fa:16:3e:b1:c1:9c", "network": {"id": "4bc624aa-efaf-45a9-b889-84d4bf2953b4", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-271284704-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d2e9dceab8a45eaa3adb619433b7cf0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0102e03b-5b", "ovs_interfaceid": "0102e03b-5b3a-46ab-84de-c836b2b46ca5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 09:53:42 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-f94fd950-bcbe-46b3-9fa3-5c3ff6a6e3ee tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b1:c1:9c,bridge_name='br-int',has_traffic_filtering=True,id=0102e03b-5b3a-46ab-84de-c836b2b46ca5,network=Network(4bc624aa-efaf-45a9-b889-84d4bf2953b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0102e03b-5b') {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 09:53:42 user nova-compute[75229]: DEBUG os_vif [None req-f94fd950-bcbe-46b3-9fa3-5c3ff6a6e3ee tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b1:c1:9c,bridge_name='br-int',has_traffic_filtering=True,id=0102e03b-5b3a-46ab-84de-c836b2b46ca5,network=Network(4bc624aa-efaf-45a9-b889-84d4bf2953b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0102e03b-5b') {{(pid=75229) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 09:53:42 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:53:42 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0102e03b-5b, bridge=br-int, if_exists=True) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:53:42 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:53:42 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 09:53:42 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:53:42 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:53:42 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8e1d2b87-5c5a-4ccc-80d5-8410012b8b72) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:53:42 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:53:42 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 09:53:42 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:53:42 user nova-compute[75229]: INFO os_vif [None req-f94fd950-bcbe-46b3-9fa3-5c3ff6a6e3ee tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b1:c1:9c,bridge_name='br-int',has_traffic_filtering=True,id=0102e03b-5b3a-46ab-84de-c836b2b46ca5,network=Network(4bc624aa-efaf-45a9-b889-84d4bf2953b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0102e03b-5b')
Nov 14 09:53:42 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:53:42 user nova-compute[75229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f94fd950-bcbe-46b3-9fa3-5c3ff6a6e3ee tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] [instance: 673624b6-e830-45e0-9215-ba79fd4f881e] calling os-brick to detach iSCSI Volume {{(pid=75229) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 09:53:42 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-f94fd950-bcbe-46b3-9fa3-5c3ff6a6e3ee tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f73f85151b0>, {'target_iqn': 'iqn.2010-10.org.openstack:c545a289-274d-485e-8787-3c8cb01f244e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ygvpNczb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 09:53:42 user nova-compute[75229]: WARNING os_brick.initiator.connectors.base [None req-f94fd950-bcbe-46b3-9fa3-5c3ff6a6e3ee tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 09:53:42 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-f94fd950-bcbe-46b3-9fa3-5c3ff6a6e3ee tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 09:53:42 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-f94fd950-bcbe-46b3-9fa3-5c3ff6a6e3ee tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 09:53:42 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:53:42 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:53:42 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:53:42 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:53:42 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[767551c8-5b6d-4aac-ada0-e660152e89d3]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b590f04d-8a50-4810-8e66-05d846f4613f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:53:42 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-f94fd950-bcbe-46b3-9fa3-5c3ff6a6e3ee tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 09:53:42 user nova-compute[75229]: No targets found.
Nov 14 09:53:42 user nova-compute[75229]: iSNS:
Nov 14 09:53:42 user nova-compute[75229]: No targets found.
Nov 14 09:53:42 user nova-compute[75229]: STATIC:
Nov 14 09:53:42 user nova-compute[75229]: Target: iqn.2010-10.org.openstack:b590f04d-8a50-4810-8e66-05d846f4613f
Nov 14 09:53:42 user nova-compute[75229]:         Portal: 172.16.0.220:3260,-1
Nov 14 09:53:42 user nova-compute[75229]:                 Iface Name: default
Nov 14 09:53:42 user nova-compute[75229]: FIRMWARE:
Nov 14 09:53:42 user nova-compute[75229]: No targets found.
Nov 14 09:53:42 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 09:53:42 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-f94fd950-bcbe-46b3-9fa3-5c3ff6a6e3ee tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 09:53:42 user nova-compute[75229]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 09:53:42 user nova-compute[75229]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75229) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 09:53:42 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-f94fd950-bcbe-46b3-9fa3-5c3ff6a6e3ee tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c545a289-274d-485e-8787-3c8cb01f244e', 0)] {{(pid=75229) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 09:53:42 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:53:42 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:53:42 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:53:42 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:53:42 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[50df4ffb-b03f-4280-86e5-1470732b4786]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b590f04d-8a50-4810-8e66-05d846f4613f\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:53:42 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:53:42 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:53:42 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[df9409f8-7c69-47cf-837e-5afb0acc5f0f]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b590f04d-8a50-4810-8e66-05d846f4613f (non-flash)\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:53:42 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-f94fd950-bcbe-46b3-9fa3-5c3ff6a6e3ee tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b590f04d-8a50-4810-8e66-05d846f4613f (non-flash)
Nov 14 09:53:42 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 09:53:42 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-f94fd950-bcbe-46b3-9fa3-5c3ff6a6e3ee tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b590f04d-8a50-4810-8e66-05d846f4613f (non-flash)
Nov 14 09:53:42 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 09:53:42 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-f94fd950-bcbe-46b3-9fa3-5c3ff6a6e3ee tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f73f84c0a60>, {}) {{(pid=75229) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 09:53:42 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-f94fd950-bcbe-46b3-9fa3-5c3ff6a6e3ee tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] Disconnecting from: [] {{(pid=75229) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 09:53:42 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-f94fd950-bcbe-46b3-9fa3-5c3ff6a6e3ee tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.086s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 09:53:42 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-f94fd950-bcbe-46b3-9fa3-5c3ff6a6e3ee tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] <== disconnect_volume: return (87ms) None {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 09:53:42 user nova-compute[75229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f94fd950-bcbe-46b3-9fa3-5c3ff6a6e3ee tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] [instance: 673624b6-e830-45e0-9215-ba79fd4f881e] Disconnected iSCSI Volume {{(pid=75229) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 09:53:42 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-f94fd950-bcbe-46b3-9fa3-5c3ff6a6e3ee tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] [instance: 673624b6-e830-45e0-9215-ba79fd4f881e] Deleting instance files /opt/stack/data/nova/instances/673624b6-e830-45e0-9215-ba79fd4f881e_del
Nov 14 09:53:42 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-f94fd950-bcbe-46b3-9fa3-5c3ff6a6e3ee tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] [instance: 673624b6-e830-45e0-9215-ba79fd4f881e] Deletion of /opt/stack/data/nova/instances/673624b6-e830-45e0-9215-ba79fd4f881e_del complete
Nov 14 09:53:42 user nova-compute[75229]: INFO nova.compute.manager [None req-f94fd950-bcbe-46b3-9fa3-5c3ff6a6e3ee tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] [instance: 673624b6-e830-45e0-9215-ba79fd4f881e] Took 1.56 seconds to destroy the instance on the hypervisor.
Nov 14 09:53:42 user nova-compute[75229]: DEBUG oslo.service.loopingcall [None req-f94fd950-bcbe-46b3-9fa3-5c3ff6a6e3ee tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75229) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 09:53:42 user nova-compute[75229]: DEBUG nova.compute.manager [-] [instance: 673624b6-e830-45e0-9215-ba79fd4f881e] Deallocating network for instance {{(pid=75229) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 09:53:42 user nova-compute[75229]: DEBUG nova.network.neutron [-] [instance: 673624b6-e830-45e0-9215-ba79fd4f881e] deallocate_for_instance() {{(pid=75229) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 09:53:42 user nova-compute[75229]: DEBUG nova.compute.manager [req-dfdd6431-15af-488b-a473-79f3e407e842 req-0b0f3b63-7ec9-4651-918a-c213a93f45ca service nova] [instance: 200e8be8-516b-4344-a584-e88ee79b21a6] Received event network-vif-plugged-45b7b43f-1c69-4e7d-bbf9-3cad74f674ef {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:53:42 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-dfdd6431-15af-488b-a473-79f3e407e842 req-0b0f3b63-7ec9-4651-918a-c213a93f45ca service nova] Acquiring lock "200e8be8-516b-4344-a584-e88ee79b21a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:53:42 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-dfdd6431-15af-488b-a473-79f3e407e842 req-0b0f3b63-7ec9-4651-918a-c213a93f45ca service nova] Lock "200e8be8-516b-4344-a584-e88ee79b21a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:53:42 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-dfdd6431-15af-488b-a473-79f3e407e842 req-0b0f3b63-7ec9-4651-918a-c213a93f45ca service nova] Lock "200e8be8-516b-4344-a584-e88ee79b21a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:53:42 user nova-compute[75229]: DEBUG nova.compute.manager [req-dfdd6431-15af-488b-a473-79f3e407e842 req-0b0f3b63-7ec9-4651-918a-c213a93f45ca service nova] [instance: 200e8be8-516b-4344-a584-e88ee79b21a6] No waiting events found dispatching network-vif-plugged-45b7b43f-1c69-4e7d-bbf9-3cad74f674ef {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 09:53:42 user nova-compute[75229]: WARNING nova.compute.manager [req-dfdd6431-15af-488b-a473-79f3e407e842 req-0b0f3b63-7ec9-4651-918a-c213a93f45ca service nova] [instance: 200e8be8-516b-4344-a584-e88ee79b21a6] Received unexpected event network-vif-plugged-45b7b43f-1c69-4e7d-bbf9-3cad74f674ef for instance with vm_state building and task_state spawning.
Nov 14 09:53:42 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:53:42 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:53:42 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:53:42 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:53:42 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:53:42 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:53:42 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:53:43 user nova-compute[75229]: DEBUG nova.compute.manager [req-88ccc3fa-c2a7-4b89-a473-85b0ce490ec6 req-287a08d3-722f-4b2e-aba9-f74d63024c3f service nova] [instance: 673624b6-e830-45e0-9215-ba79fd4f881e] Received event network-vif-plugged-0102e03b-5b3a-46ab-84de-c836b2b46ca5 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:53:43 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-88ccc3fa-c2a7-4b89-a473-85b0ce490ec6 req-287a08d3-722f-4b2e-aba9-f74d63024c3f service nova] Acquiring lock "673624b6-e830-45e0-9215-ba79fd4f881e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:53:43 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-88ccc3fa-c2a7-4b89-a473-85b0ce490ec6 req-287a08d3-722f-4b2e-aba9-f74d63024c3f service nova] Lock "673624b6-e830-45e0-9215-ba79fd4f881e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:53:43 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-88ccc3fa-c2a7-4b89-a473-85b0ce490ec6 req-287a08d3-722f-4b2e-aba9-f74d63024c3f service nova] Lock "673624b6-e830-45e0-9215-ba79fd4f881e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:53:43 user nova-compute[75229]: DEBUG nova.compute.manager [req-88ccc3fa-c2a7-4b89-a473-85b0ce490ec6 req-287a08d3-722f-4b2e-aba9-f74d63024c3f service nova] [instance: 673624b6-e830-45e0-9215-ba79fd4f881e] No waiting events found dispatching network-vif-plugged-0102e03b-5b3a-46ab-84de-c836b2b46ca5 {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 09:53:43 user nova-compute[75229]: WARNING nova.compute.manager [req-88ccc3fa-c2a7-4b89-a473-85b0ce490ec6 req-287a08d3-722f-4b2e-aba9-f74d63024c3f service nova] [instance: 673624b6-e830-45e0-9215-ba79fd4f881e] Received unexpected event network-vif-plugged-0102e03b-5b3a-46ab-84de-c836b2b46ca5 for instance with vm_state active and task_state deleting.
Nov 14 09:53:43 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:53:43 user nova-compute[75229]: DEBUG nova.network.neutron [-] [instance: 673624b6-e830-45e0-9215-ba79fd4f881e] Updating instance_info_cache with network_info: [] {{(pid=75229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 09:53:43 user nova-compute[75229]: INFO nova.compute.manager [-] [instance: 673624b6-e830-45e0-9215-ba79fd4f881e] Took 0.96 seconds to deallocate network for instance.
Nov 14 09:53:43 user nova-compute[75229]: DEBUG nova.compute.manager [req-212e247e-14e1-432e-8e70-2aff2f9fd12c req-375270ba-b57a-4dd9-b150-205772c726ec service nova] [instance: 673624b6-e830-45e0-9215-ba79fd4f881e] Received event network-vif-deleted-0102e03b-5b3a-46ab-84de-c836b2b46ca5 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:53:43 user nova-compute[75229]: WARNING nova.volume.cinder [None req-f94fd950-bcbe-46b3-9fa3-5c3ff6a6e3ee tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] Attachment a257d125-2332-4cdd-9a47-1923d4948632 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = a257d125-2332-4cdd-9a47-1923d4948632. (HTTP 404) (Request-ID: req-66a831d9-6ba6-40d7-9787-af63faa4b4e5)
Nov 14 09:53:43 user nova-compute[75229]: INFO nova.compute.manager [None req-f94fd950-bcbe-46b3-9fa3-5c3ff6a6e3ee tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] [instance: 673624b6-e830-45e0-9215-ba79fd4f881e] Took 0.03 seconds to detach 1 volumes for instance.
Nov 14 09:53:43 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-f94fd950-bcbe-46b3-9fa3-5c3ff6a6e3ee tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:53:43 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-f94fd950-bcbe-46b3-9fa3-5c3ff6a6e3ee tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:53:43 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:53:43 user nova-compute[75229]: DEBUG nova.compute.provider_tree [None req-f94fd950-bcbe-46b3-9fa3-5c3ff6a6e3ee tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] Inventory has not changed in ProviderTree for provider: d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 {{(pid=75229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 09:53:43 user nova-compute[75229]: DEBUG nova.scheduler.client.report [None req-f94fd950-bcbe-46b3-9fa3-5c3ff6a6e3ee tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] Inventory has not changed for provider d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 09:53:43 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-f94fd950-bcbe-46b3-9fa3-5c3ff6a6e3ee tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.400s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:53:43 user nova-compute[75229]: INFO nova.scheduler.client.report [None req-f94fd950-bcbe-46b3-9fa3-5c3ff6a6e3ee tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] Deleted allocations for instance 673624b6-e830-45e0-9215-ba79fd4f881e
Nov 14 09:53:44 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-f94fd950-bcbe-46b3-9fa3-5c3ff6a6e3ee tempest-VolumesSnapshotTestJSON-1180270100 tempest-VolumesSnapshotTestJSON-1180270100-project-member] Lock "673624b6-e830-45e0-9215-ba79fd4f881e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.138s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:53:44 user nova-compute[75229]: DEBUG nova.compute.manager [None req-06e70a1f-47e2-4d18-a44d-4ddd9a7a94b8 tempest-VolumesActionsTest-480767440 tempest-VolumesActionsTest-480767440-project-member] [instance: 200e8be8-516b-4344-a584-e88ee79b21a6] Instance event wait completed in 0 seconds for  {{(pid=75229) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 09:53:44 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-06e70a1f-47e2-4d18-a44d-4ddd9a7a94b8 tempest-VolumesActionsTest-480767440 tempest-VolumesActionsTest-480767440-project-member] [instance: 200e8be8-516b-4344-a584-e88ee79b21a6] Guest created on hypervisor {{(pid=75229) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 09:53:44 user nova-compute[75229]: INFO nova.virt.libvirt.driver [-] [instance: 200e8be8-516b-4344-a584-e88ee79b21a6] Instance spawned successfully.
Nov 14 09:53:44 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-06e70a1f-47e2-4d18-a44d-4ddd9a7a94b8 tempest-VolumesActionsTest-480767440 tempest-VolumesActionsTest-480767440-project-member] [instance: 200e8be8-516b-4344-a584-e88ee79b21a6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 09:53:44 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-06e70a1f-47e2-4d18-a44d-4ddd9a7a94b8 tempest-VolumesActionsTest-480767440 tempest-VolumesActionsTest-480767440-project-member] [instance: 200e8be8-516b-4344-a584-e88ee79b21a6] Found default for hw_cdrom_bus of ide {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 09:53:44 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-06e70a1f-47e2-4d18-a44d-4ddd9a7a94b8 tempest-VolumesActionsTest-480767440 tempest-VolumesActionsTest-480767440-project-member] [instance: 200e8be8-516b-4344-a584-e88ee79b21a6] Found default for hw_disk_bus of virtio {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 09:53:44 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-06e70a1f-47e2-4d18-a44d-4ddd9a7a94b8 tempest-VolumesActionsTest-480767440 tempest-VolumesActionsTest-480767440-project-member] [instance: 200e8be8-516b-4344-a584-e88ee79b21a6] Found default for hw_input_bus of None {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 09:53:44 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-06e70a1f-47e2-4d18-a44d-4ddd9a7a94b8 tempest-VolumesActionsTest-480767440 tempest-VolumesActionsTest-480767440-project-member] [instance: 200e8be8-516b-4344-a584-e88ee79b21a6] Found default for hw_pointer_model of None {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 09:53:44 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-06e70a1f-47e2-4d18-a44d-4ddd9a7a94b8 tempest-VolumesActionsTest-480767440 tempest-VolumesActionsTest-480767440-project-member] [instance: 200e8be8-516b-4344-a584-e88ee79b21a6] Found default for hw_video_model of virtio {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 09:53:44 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-06e70a1f-47e2-4d18-a44d-4ddd9a7a94b8 tempest-VolumesActionsTest-480767440 tempest-VolumesActionsTest-480767440-project-member] [instance: 200e8be8-516b-4344-a584-e88ee79b21a6] Found default for hw_vif_model of virtio {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 09:53:44 user nova-compute[75229]: INFO nova.compute.manager [None req-06e70a1f-47e2-4d18-a44d-4ddd9a7a94b8 tempest-VolumesActionsTest-480767440 tempest-VolumesActionsTest-480767440-project-member] [instance: 200e8be8-516b-4344-a584-e88ee79b21a6] Took 7.02 seconds to spawn the instance on the hypervisor.
Nov 14 09:53:44 user nova-compute[75229]: DEBUG nova.compute.manager [None req-06e70a1f-47e2-4d18-a44d-4ddd9a7a94b8 tempest-VolumesActionsTest-480767440 tempest-VolumesActionsTest-480767440-project-member] [instance: 200e8be8-516b-4344-a584-e88ee79b21a6] Checking state {{(pid=75229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 09:53:44 user nova-compute[75229]: DEBUG nova.compute.manager [req-e13a729d-1bcb-4088-97ba-fb2a18088ace req-2d9626a1-de2f-4497-8232-a63b102ae052 service nova] [instance: 200e8be8-516b-4344-a584-e88ee79b21a6] Received event network-vif-plugged-45b7b43f-1c69-4e7d-bbf9-3cad74f674ef {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:53:44 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-e13a729d-1bcb-4088-97ba-fb2a18088ace req-2d9626a1-de2f-4497-8232-a63b102ae052 service nova] Acquiring lock "200e8be8-516b-4344-a584-e88ee79b21a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:53:44 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-e13a729d-1bcb-4088-97ba-fb2a18088ace req-2d9626a1-de2f-4497-8232-a63b102ae052 service nova] Lock "200e8be8-516b-4344-a584-e88ee79b21a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:53:44 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-e13a729d-1bcb-4088-97ba-fb2a18088ace req-2d9626a1-de2f-4497-8232-a63b102ae052 service nova] Lock "200e8be8-516b-4344-a584-e88ee79b21a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:53:44 user nova-compute[75229]: DEBUG nova.compute.manager [req-e13a729d-1bcb-4088-97ba-fb2a18088ace req-2d9626a1-de2f-4497-8232-a63b102ae052 service nova] [instance: 200e8be8-516b-4344-a584-e88ee79b21a6] No waiting events found dispatching network-vif-plugged-45b7b43f-1c69-4e7d-bbf9-3cad74f674ef {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 09:53:44 user nova-compute[75229]: WARNING nova.compute.manager [req-e13a729d-1bcb-4088-97ba-fb2a18088ace req-2d9626a1-de2f-4497-8232-a63b102ae052 service nova] [instance: 200e8be8-516b-4344-a584-e88ee79b21a6] Received unexpected event network-vif-plugged-45b7b43f-1c69-4e7d-bbf9-3cad74f674ef for instance with vm_state building and task_state spawning.
Nov 14 09:53:44 user nova-compute[75229]: DEBUG nova.compute.manager [req-e13a729d-1bcb-4088-97ba-fb2a18088ace req-2d9626a1-de2f-4497-8232-a63b102ae052 service nova] [instance: 4c9fe69e-3f9d-4b30-a9e4-efc3e83efa17] Received event network-vif-plugged-235153d6-63c1-44d2-97cc-c083544e6790 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:53:44 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-e13a729d-1bcb-4088-97ba-fb2a18088ace req-2d9626a1-de2f-4497-8232-a63b102ae052 service nova] Acquiring lock "4c9fe69e-3f9d-4b30-a9e4-efc3e83efa17-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:53:44 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-e13a729d-1bcb-4088-97ba-fb2a18088ace req-2d9626a1-de2f-4497-8232-a63b102ae052 service nova] Lock "4c9fe69e-3f9d-4b30-a9e4-efc3e83efa17-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:53:44 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-e13a729d-1bcb-4088-97ba-fb2a18088ace req-2d9626a1-de2f-4497-8232-a63b102ae052 service nova] Lock "4c9fe69e-3f9d-4b30-a9e4-efc3e83efa17-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:53:44 user nova-compute[75229]: DEBUG nova.compute.manager [req-e13a729d-1bcb-4088-97ba-fb2a18088ace req-2d9626a1-de2f-4497-8232-a63b102ae052 service nova] [instance: 4c9fe69e-3f9d-4b30-a9e4-efc3e83efa17] No waiting events found dispatching network-vif-plugged-235153d6-63c1-44d2-97cc-c083544e6790 {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 09:53:44 user nova-compute[75229]: WARNING nova.compute.manager [req-e13a729d-1bcb-4088-97ba-fb2a18088ace req-2d9626a1-de2f-4497-8232-a63b102ae052 service nova] [instance: 4c9fe69e-3f9d-4b30-a9e4-efc3e83efa17] Received unexpected event network-vif-plugged-235153d6-63c1-44d2-97cc-c083544e6790 for instance with vm_state active and task_state rescuing.
Nov 14 09:53:44 user nova-compute[75229]: DEBUG nova.compute.manager [req-e13a729d-1bcb-4088-97ba-fb2a18088ace req-2d9626a1-de2f-4497-8232-a63b102ae052 service nova] [instance: 4c9fe69e-3f9d-4b30-a9e4-efc3e83efa17] Received event network-vif-plugged-235153d6-63c1-44d2-97cc-c083544e6790 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:53:44 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-e13a729d-1bcb-4088-97ba-fb2a18088ace req-2d9626a1-de2f-4497-8232-a63b102ae052 service nova] Acquiring lock "4c9fe69e-3f9d-4b30-a9e4-efc3e83efa17-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:53:44 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-e13a729d-1bcb-4088-97ba-fb2a18088ace req-2d9626a1-de2f-4497-8232-a63b102ae052 service nova] Lock "4c9fe69e-3f9d-4b30-a9e4-efc3e83efa17-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:53:44 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-e13a729d-1bcb-4088-97ba-fb2a18088ace req-2d9626a1-de2f-4497-8232-a63b102ae052 service nova] Lock "4c9fe69e-3f9d-4b30-a9e4-efc3e83efa17-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:53:44 user nova-compute[75229]: DEBUG nova.compute.manager [req-e13a729d-1bcb-4088-97ba-fb2a18088ace req-2d9626a1-de2f-4497-8232-a63b102ae052 service nova] [instance: 4c9fe69e-3f9d-4b30-a9e4-efc3e83efa17] No waiting events found dispatching network-vif-plugged-235153d6-63c1-44d2-97cc-c083544e6790 {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 09:53:44 user nova-compute[75229]: WARNING nova.compute.manager [req-e13a729d-1bcb-4088-97ba-fb2a18088ace req-2d9626a1-de2f-4497-8232-a63b102ae052 service nova] [instance: 4c9fe69e-3f9d-4b30-a9e4-efc3e83efa17] Received unexpected event network-vif-plugged-235153d6-63c1-44d2-97cc-c083544e6790 for instance with vm_state active and task_state rescuing.
Nov 14 09:53:44 user nova-compute[75229]: INFO nova.compute.manager [None req-06e70a1f-47e2-4d18-a44d-4ddd9a7a94b8 tempest-VolumesActionsTest-480767440 tempest-VolumesActionsTest-480767440-project-member] [instance: 200e8be8-516b-4344-a584-e88ee79b21a6] Took 7.79 seconds to build instance.
Nov 14 09:53:44 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-06e70a1f-47e2-4d18-a44d-4ddd9a7a94b8 tempest-VolumesActionsTest-480767440 tempest-VolumesActionsTest-480767440-project-member] Lock "200e8be8-516b-4344-a584-e88ee79b21a6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.909s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:53:44 user nova-compute[75229]: DEBUG nova.compute.manager [None req-1dee5dbf-1c05-4a7e-8bb7-0d5c42e27a09 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] [instance: 4c9fe69e-3f9d-4b30-a9e4-efc3e83efa17] Checking state {{(pid=75229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 09:53:45 user nova-compute[75229]: DEBUG nova.compute.manager [req-6ea9f74f-a125-44cb-9d0d-e5191613a64f req-c13f5eca-d183-4dbb-800a-727db4bf1913 service nova] [instance: 94e2b266-2fe3-481a-bb1e-24f835a79ddf] Received event network-changed-be0352bd-a149-4097-b049-8445f895d993 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:53:45 user nova-compute[75229]: DEBUG nova.compute.manager [req-6ea9f74f-a125-44cb-9d0d-e5191613a64f req-c13f5eca-d183-4dbb-800a-727db4bf1913 service nova] [instance: 94e2b266-2fe3-481a-bb1e-24f835a79ddf] Refreshing instance network info cache due to event network-changed-be0352bd-a149-4097-b049-8445f895d993. {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 09:53:45 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-6ea9f74f-a125-44cb-9d0d-e5191613a64f req-c13f5eca-d183-4dbb-800a-727db4bf1913 service nova] Acquiring lock "refresh_cache-94e2b266-2fe3-481a-bb1e-24f835a79ddf" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 09:53:45 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-6ea9f74f-a125-44cb-9d0d-e5191613a64f req-c13f5eca-d183-4dbb-800a-727db4bf1913 service nova] Acquired lock "refresh_cache-94e2b266-2fe3-481a-bb1e-24f835a79ddf" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 09:53:45 user nova-compute[75229]: DEBUG nova.network.neutron [req-6ea9f74f-a125-44cb-9d0d-e5191613a64f req-c13f5eca-d183-4dbb-800a-727db4bf1913 service nova] [instance: 94e2b266-2fe3-481a-bb1e-24f835a79ddf] Refreshing network info cache for port be0352bd-a149-4097-b049-8445f895d993 {{(pid=75229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 09:53:45 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-093fcf37-671b-44c8-a9ad-213f1859e28c tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] Acquiring lock "94e2b266-2fe3-481a-bb1e-24f835a79ddf" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:53:45 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-093fcf37-671b-44c8-a9ad-213f1859e28c tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] Lock "94e2b266-2fe3-481a-bb1e-24f835a79ddf" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:53:45 user nova-compute[75229]: INFO nova.compute.manager [None req-093fcf37-671b-44c8-a9ad-213f1859e28c tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] [instance: 94e2b266-2fe3-481a-bb1e-24f835a79ddf] Detaching volume b590f04d-8a50-4810-8e66-05d846f4613f
Nov 14 09:53:45 user nova-compute[75229]: INFO nova.virt.block_device [None req-093fcf37-671b-44c8-a9ad-213f1859e28c tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] [instance: 94e2b266-2fe3-481a-bb1e-24f835a79ddf] Attempting to driver detach volume b590f04d-8a50-4810-8e66-05d846f4613f from mountpoint /dev/vdb
Nov 14 09:53:45 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-093fcf37-671b-44c8-a9ad-213f1859e28c tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] Attempting to detach device vdb from instance 94e2b266-2fe3-481a-bb1e-24f835a79ddf from the persistent domain config. {{(pid=75229) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 09:53:45 user nova-compute[75229]: DEBUG nova.virt.libvirt.guest [None req-093fcf37-671b-44c8-a9ad-213f1859e28c tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 09:53:45 user nova-compute[75229]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 09:53:45 user nova-compute[75229]:   <source dev="/dev/sdc"/>
Nov 14 09:53:45 user nova-compute[75229]:   <target dev="vdb" bus="virtio"/>
Nov 14 09:53:45 user nova-compute[75229]:   <serial>b590f04d-8a50-4810-8e66-05d846f4613f</serial>
Nov 14 09:53:45 user nova-compute[75229]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 14 09:53:45 user nova-compute[75229]: </disk>
Nov 14 09:53:45 user nova-compute[75229]:  {{(pid=75229) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 09:53:45 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-093fcf37-671b-44c8-a9ad-213f1859e28c tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] Successfully detached device vdb from instance 94e2b266-2fe3-481a-bb1e-24f835a79ddf from the persistent domain config.
Nov 14 09:53:45 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-093fcf37-671b-44c8-a9ad-213f1859e28c tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 94e2b266-2fe3-481a-bb1e-24f835a79ddf from the live domain config. {{(pid=75229) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 09:53:45 user nova-compute[75229]: DEBUG nova.virt.libvirt.guest [None req-093fcf37-671b-44c8-a9ad-213f1859e28c tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 09:53:45 user nova-compute[75229]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 09:53:45 user nova-compute[75229]:   <source dev="/dev/sdc"/>
Nov 14 09:53:45 user nova-compute[75229]:   <target dev="vdb" bus="virtio"/>
Nov 14 09:53:45 user nova-compute[75229]:   <serial>b590f04d-8a50-4810-8e66-05d846f4613f</serial>
Nov 14 09:53:45 user nova-compute[75229]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 14 09:53:45 user nova-compute[75229]: </disk>
Nov 14 09:53:45 user nova-compute[75229]:  {{(pid=75229) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 09:53:46 user nova-compute[75229]: DEBUG nova.network.neutron [req-6ea9f74f-a125-44cb-9d0d-e5191613a64f req-c13f5eca-d183-4dbb-800a-727db4bf1913 service nova] [instance: 94e2b266-2fe3-481a-bb1e-24f835a79ddf] Updated VIF entry in instance network info cache for port be0352bd-a149-4097-b049-8445f895d993. {{(pid=75229) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 09:53:46 user nova-compute[75229]: DEBUG nova.network.neutron [req-6ea9f74f-a125-44cb-9d0d-e5191613a64f req-c13f5eca-d183-4dbb-800a-727db4bf1913 service nova] [instance: 94e2b266-2fe3-481a-bb1e-24f835a79ddf] Updating instance_info_cache with network_info: [{"id": "be0352bd-a149-4097-b049-8445f895d993", "address": "fa:16:3e:dc:24:42", "network": {"id": "1687d918-9f70-4099-b44c-97f92f90e6ff", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2074208460-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a6157b9827b44d2bab197220b635fd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe0352bd-a1", "ovs_interfaceid": "be0352bd-a149-4097-b049-8445f895d993", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 09:53:46 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-6ea9f74f-a125-44cb-9d0d-e5191613a64f req-c13f5eca-d183-4dbb-800a-727db4bf1913 service nova] Releasing lock "refresh_cache-94e2b266-2fe3-481a-bb1e-24f835a79ddf" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 09:53:46 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-093fcf37-671b-44c8-a9ad-213f1859e28c tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 94e2b266-2fe3-481a-bb1e-24f835a79ddf {{(pid=75229) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 09:53:46 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:53:46 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 09:53:46 user nova-compute[75229]: DEBUG nova.compute.manager [req-5f153192-f370-46ae-bbc0-13035eef7394 req-3fa085aa-047b-4dad-ac86-909ee7487633 service nova] [instance: 94e2b266-2fe3-481a-bb1e-24f835a79ddf] Received event network-changed-be0352bd-a149-4097-b049-8445f895d993 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:53:46 user nova-compute[75229]: DEBUG nova.compute.manager [req-5f153192-f370-46ae-bbc0-13035eef7394 req-3fa085aa-047b-4dad-ac86-909ee7487633 service nova] [instance: 94e2b266-2fe3-481a-bb1e-24f835a79ddf] Refreshing instance network info cache due to event network-changed-be0352bd-a149-4097-b049-8445f895d993. {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 09:53:46 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-5f153192-f370-46ae-bbc0-13035eef7394 req-3fa085aa-047b-4dad-ac86-909ee7487633 service nova] Acquiring lock "refresh_cache-94e2b266-2fe3-481a-bb1e-24f835a79ddf" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 09:53:46 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-5f153192-f370-46ae-bbc0-13035eef7394 req-3fa085aa-047b-4dad-ac86-909ee7487633 service nova] Acquired lock "refresh_cache-94e2b266-2fe3-481a-bb1e-24f835a79ddf" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 09:53:46 user nova-compute[75229]: DEBUG nova.network.neutron [req-5f153192-f370-46ae-bbc0-13035eef7394 req-3fa085aa-047b-4dad-ac86-909ee7487633 service nova] [instance: 94e2b266-2fe3-481a-bb1e-24f835a79ddf] Refreshing network info cache for port be0352bd-a149-4097-b049-8445f895d993 {{(pid=75229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 09:53:47 user nova-compute[75229]: DEBUG nova.network.neutron [req-5f153192-f370-46ae-bbc0-13035eef7394 req-3fa085aa-047b-4dad-ac86-909ee7487633 service nova] [instance: 94e2b266-2fe3-481a-bb1e-24f835a79ddf] Updated VIF entry in instance network info cache for port be0352bd-a149-4097-b049-8445f895d993. {{(pid=75229) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 09:53:47 user nova-compute[75229]: DEBUG nova.network.neutron [req-5f153192-f370-46ae-bbc0-13035eef7394 req-3fa085aa-047b-4dad-ac86-909ee7487633 service nova] [instance: 94e2b266-2fe3-481a-bb1e-24f835a79ddf] Updating instance_info_cache with network_info: [{"id": "be0352bd-a149-4097-b049-8445f895d993", "address": "fa:16:3e:dc:24:42", "network": {"id": "1687d918-9f70-4099-b44c-97f92f90e6ff", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2074208460-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a6157b9827b44d2bab197220b635fd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe0352bd-a1", "ovs_interfaceid": "be0352bd-a149-4097-b049-8445f895d993", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 09:53:47 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-5f153192-f370-46ae-bbc0-13035eef7394 req-3fa085aa-047b-4dad-ac86-909ee7487633 service nova] Releasing lock "refresh_cache-94e2b266-2fe3-481a-bb1e-24f835a79ddf" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 09:53:47 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:53:47 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-a9441db5-2cd9-4cf6-b95a-25184513aab1 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Acquiring lock "4255af28-a111-4475-b207-67e335fd0835" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:53:47 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-a9441db5-2cd9-4cf6-b95a-25184513aab1 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Lock "4255af28-a111-4475-b207-67e335fd0835" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:53:47 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-a9441db5-2cd9-4cf6-b95a-25184513aab1 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Acquiring lock "4255af28-a111-4475-b207-67e335fd0835-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:53:47 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-a9441db5-2cd9-4cf6-b95a-25184513aab1 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Lock "4255af28-a111-4475-b207-67e335fd0835-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:53:47 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-a9441db5-2cd9-4cf6-b95a-25184513aab1 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Lock "4255af28-a111-4475-b207-67e335fd0835-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:53:47 user nova-compute[75229]: INFO nova.compute.manager [None req-a9441db5-2cd9-4cf6-b95a-25184513aab1 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] [instance: 4255af28-a111-4475-b207-67e335fd0835] Terminating instance
Nov 14 09:53:47 user nova-compute[75229]: DEBUG nova.compute.manager [None req-a9441db5-2cd9-4cf6-b95a-25184513aab1 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] [instance: 4255af28-a111-4475-b207-67e335fd0835] Start destroying the instance on the hypervisor. {{(pid=75229) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 09:53:47 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:53:47 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:53:47 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:53:47 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:53:48 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:53:48 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-c28e2e38-e0ab-4996-a0b7-9e1c2181b509 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Acquiring lock "cda8c5ad-e70c-4021-bace-d55831c4bc78" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:53:48 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-c28e2e38-e0ab-4996-a0b7-9e1c2181b509 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Lock "cda8c5ad-e70c-4021-bace-d55831c4bc78" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:53:48 user nova-compute[75229]: DEBUG nova.compute.manager [None req-c28e2e38-e0ab-4996-a0b7-9e1c2181b509 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] [instance: cda8c5ad-e70c-4021-bace-d55831c4bc78] Starting instance... {{(pid=75229) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 09:53:48 user nova-compute[75229]: INFO nova.virt.libvirt.driver [-] [instance: 4255af28-a111-4475-b207-67e335fd0835] Instance destroyed successfully.
Nov 14 09:53:48 user nova-compute[75229]: DEBUG nova.objects.instance [None req-a9441db5-2cd9-4cf6-b95a-25184513aab1 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Lazy-loading 'resources' on Instance uuid 4255af28-a111-4475-b207-67e335fd0835 {{(pid=75229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 09:53:48 user nova-compute[75229]: DEBUG nova.virt.libvirt.vif [None req-a9441db5-2cd9-4cf6-b95a-25184513aab1 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T09:48:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-489286667',display_name='tempest-AttachVolumeNegativeTest-server-489286667',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-489286667',id=17,image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIePywKDJu3c2ut6s3j5HhKF9jxepJwLQA4ynuwJiP0zyPDVN37yMeGM0c7z8ydx2gKHVn6mwDVxPIpAfh0tYpXrrmZ23wcEUCfMOtz6xS5SKKIUF/EkxDGiZlRLYJUjUw==',key_name='tempest-keypair-1284613226',keypairs=<?>,launch_index=0,launched_at=2023-11-14T09:48:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8b8d48c38c7344f5b12d0ed5b9392554',ramdisk_id='',reservation_id='r-m51zye0t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-140392099',owner_user_name='tempest-AttachVolumeNegativeTest-140392099-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T09:48:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3b8313e365eb4970a58c412768e959bf',uuid=4255af28-a111-4475-b207-67e335fd0835,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8d218cec-b5d6-46ed-94be-4802fcdd0388", "address": "fa:16:3e:3d:eb:0f", "network": {"id": "bd407caa-6ef6-400d-9327-3179dc1d8da4", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-29933774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.175", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b8d48c38c7344f5b12d0ed5b9392554", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d218cec-b5", "ovs_interfaceid": "8d218cec-b5d6-46ed-94be-4802fcdd0388", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 09:53:48 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-a9441db5-2cd9-4cf6-b95a-25184513aab1 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Converting VIF {"id": "8d218cec-b5d6-46ed-94be-4802fcdd0388", "address": "fa:16:3e:3d:eb:0f", "network": {"id": "bd407caa-6ef6-400d-9327-3179dc1d8da4", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-29933774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.175", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b8d48c38c7344f5b12d0ed5b9392554", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d218cec-b5", "ovs_interfaceid": "8d218cec-b5d6-46ed-94be-4802fcdd0388", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 09:53:48 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-a9441db5-2cd9-4cf6-b95a-25184513aab1 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3d:eb:0f,bridge_name='br-int',has_traffic_filtering=True,id=8d218cec-b5d6-46ed-94be-4802fcdd0388,network=Network(bd407caa-6ef6-400d-9327-3179dc1d8da4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d218cec-b5') {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 09:53:48 user nova-compute[75229]: DEBUG os_vif [None req-a9441db5-2cd9-4cf6-b95a-25184513aab1 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3d:eb:0f,bridge_name='br-int',has_traffic_filtering=True,id=8d218cec-b5d6-46ed-94be-4802fcdd0388,network=Network(bd407caa-6ef6-400d-9327-3179dc1d8da4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d218cec-b5') {{(pid=75229) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 09:53:48 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:53:48 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8d218cec-b5, bridge=br-int, if_exists=True) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:53:48 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:53:48 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:53:48 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:53:48 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=be905412-bff1-443b-831f-e1e26d8b37f2) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:53:48 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:53:48 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:53:48 user nova-compute[75229]: INFO os_vif [None req-a9441db5-2cd9-4cf6-b95a-25184513aab1 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3d:eb:0f,bridge_name='br-int',has_traffic_filtering=True,id=8d218cec-b5d6-46ed-94be-4802fcdd0388,network=Network(bd407caa-6ef6-400d-9327-3179dc1d8da4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d218cec-b5')
Nov 14 09:53:48 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-a9441db5-2cd9-4cf6-b95a-25184513aab1 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] [instance: 4255af28-a111-4475-b207-67e335fd0835] Deleting instance files /opt/stack/data/nova/instances/4255af28-a111-4475-b207-67e335fd0835_del
Nov 14 09:53:48 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-a9441db5-2cd9-4cf6-b95a-25184513aab1 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] [instance: 4255af28-a111-4475-b207-67e335fd0835] Deletion of /opt/stack/data/nova/instances/4255af28-a111-4475-b207-67e335fd0835_del complete
Nov 14 09:53:48 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-c28e2e38-e0ab-4996-a0b7-9e1c2181b509 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:53:48 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-c28e2e38-e0ab-4996-a0b7-9e1c2181b509 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:53:48 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-c28e2e38-e0ab-4996-a0b7-9e1c2181b509 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75229) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 09:53:48 user nova-compute[75229]: INFO nova.compute.claims [None req-c28e2e38-e0ab-4996-a0b7-9e1c2181b509 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] [instance: cda8c5ad-e70c-4021-bace-d55831c4bc78] Claim successful on node user
Nov 14 09:53:48 user nova-compute[75229]: INFO nova.compute.manager [None req-a9441db5-2cd9-4cf6-b95a-25184513aab1 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] [instance: 4255af28-a111-4475-b207-67e335fd0835] Took 0.97 seconds to destroy the instance on the hypervisor.
Nov 14 09:53:48 user nova-compute[75229]: DEBUG oslo.service.loopingcall [None req-a9441db5-2cd9-4cf6-b95a-25184513aab1 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75229) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 09:53:48 user nova-compute[75229]: DEBUG nova.compute.manager [-] [instance: 4255af28-a111-4475-b207-67e335fd0835] Deallocating network for instance {{(pid=75229) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 09:53:48 user nova-compute[75229]: DEBUG nova.network.neutron [-] [instance: 4255af28-a111-4475-b207-67e335fd0835] deallocate_for_instance() {{(pid=75229) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 09:53:49 user nova-compute[75229]: DEBUG nova.compute.provider_tree [None req-c28e2e38-e0ab-4996-a0b7-9e1c2181b509 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Inventory has not changed in ProviderTree for provider: d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 {{(pid=75229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 09:53:49 user nova-compute[75229]: DEBUG nova.scheduler.client.report [None req-c28e2e38-e0ab-4996-a0b7-9e1c2181b509 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Inventory has not changed for provider d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 09:53:49 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-c28e2e38-e0ab-4996-a0b7-9e1c2181b509 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.442s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:53:49 user nova-compute[75229]: DEBUG nova.compute.manager [None req-c28e2e38-e0ab-4996-a0b7-9e1c2181b509 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] [instance: cda8c5ad-e70c-4021-bace-d55831c4bc78] Start building networks asynchronously for instance. {{(pid=75229) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 09:53:49 user nova-compute[75229]: DEBUG nova.compute.manager [None req-c28e2e38-e0ab-4996-a0b7-9e1c2181b509 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] [instance: cda8c5ad-e70c-4021-bace-d55831c4bc78] Allocating IP information in the background. {{(pid=75229) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 09:53:49 user nova-compute[75229]: DEBUG nova.network.neutron [None req-c28e2e38-e0ab-4996-a0b7-9e1c2181b509 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] [instance: cda8c5ad-e70c-4021-bace-d55831c4bc78] allocate_for_instance() {{(pid=75229) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 09:53:49 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-c28e2e38-e0ab-4996-a0b7-9e1c2181b509 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] [instance: cda8c5ad-e70c-4021-bace-d55831c4bc78] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 09:53:49 user nova-compute[75229]: DEBUG nova.compute.manager [None req-c28e2e38-e0ab-4996-a0b7-9e1c2181b509 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] [instance: cda8c5ad-e70c-4021-bace-d55831c4bc78] Start building block device mappings for instance. {{(pid=75229) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 09:53:49 user nova-compute[75229]: DEBUG nova.policy [None req-c28e2e38-e0ab-4996-a0b7-9e1c2181b509 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a8825cd49e9349f28576b704c4c4d717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8babb73006da4977a1fe2bdb35e08d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75229) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 09:53:49 user nova-compute[75229]: DEBUG nova.compute.manager [None req-c28e2e38-e0ab-4996-a0b7-9e1c2181b509 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] [instance: cda8c5ad-e70c-4021-bace-d55831c4bc78] Start spawning the instance on the hypervisor. {{(pid=75229) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 09:53:49 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-c28e2e38-e0ab-4996-a0b7-9e1c2181b509 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] [instance: cda8c5ad-e70c-4021-bace-d55831c4bc78] Creating instance directory {{(pid=75229) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 09:53:49 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-c28e2e38-e0ab-4996-a0b7-9e1c2181b509 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] [instance: cda8c5ad-e70c-4021-bace-d55831c4bc78] Creating image(s)
Nov 14 09:53:49 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-c28e2e38-e0ab-4996-a0b7-9e1c2181b509 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Acquiring lock "/opt/stack/data/nova/instances/cda8c5ad-e70c-4021-bace-d55831c4bc78/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:53:49 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-c28e2e38-e0ab-4996-a0b7-9e1c2181b509 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Lock "/opt/stack/data/nova/instances/cda8c5ad-e70c-4021-bace-d55831c4bc78/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:53:49 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-c28e2e38-e0ab-4996-a0b7-9e1c2181b509 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Lock "/opt/stack/data/nova/instances/cda8c5ad-e70c-4021-bace-d55831c4bc78/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:53:49 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-c28e2e38-e0ab-4996-a0b7-9e1c2181b509 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6 --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:53:49 user nova-compute[75229]: DEBUG nova.network.neutron [-] [instance: 4255af28-a111-4475-b207-67e335fd0835] Updating instance_info_cache with network_info: [] {{(pid=75229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 09:53:49 user nova-compute[75229]: DEBUG nova.compute.manager [req-52718c38-59fa-4089-af17-ce453879744b req-ac2d5df6-336c-41e9-9de0-4e75d81435a1 service nova] [instance: 4255af28-a111-4475-b207-67e335fd0835] Received event network-vif-deleted-8d218cec-b5d6-46ed-94be-4802fcdd0388 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:53:49 user nova-compute[75229]: INFO nova.compute.manager [req-52718c38-59fa-4089-af17-ce453879744b req-ac2d5df6-336c-41e9-9de0-4e75d81435a1 service nova] [instance: 4255af28-a111-4475-b207-67e335fd0835] Neutron deleted interface 8d218cec-b5d6-46ed-94be-4802fcdd0388; detaching it from the instance and deleting it from the info cache
Nov 14 09:53:49 user nova-compute[75229]: DEBUG nova.network.neutron [req-52718c38-59fa-4089-af17-ce453879744b req-ac2d5df6-336c-41e9-9de0-4e75d81435a1 service nova] [instance: 4255af28-a111-4475-b207-67e335fd0835] Updating instance_info_cache with network_info: [] {{(pid=75229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 09:53:49 user nova-compute[75229]: INFO nova.compute.manager [-] [instance: 4255af28-a111-4475-b207-67e335fd0835] Took 0.78 seconds to deallocate network for instance.
Nov 14 09:53:49 user nova-compute[75229]: DEBUG nova.compute.manager [req-52718c38-59fa-4089-af17-ce453879744b req-ac2d5df6-336c-41e9-9de0-4e75d81435a1 service nova] [instance: 4255af28-a111-4475-b207-67e335fd0835] Detach interface failed, port_id=8d218cec-b5d6-46ed-94be-4802fcdd0388, reason: Instance 4255af28-a111-4475-b207-67e335fd0835 could not be found. {{(pid=75229) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 14 09:53:49 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-c28e2e38-e0ab-4996-a0b7-9e1c2181b509 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6 --force-share --output=json" returned: 0 in 0.199s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:53:49 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-c28e2e38-e0ab-4996-a0b7-9e1c2181b509 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Acquiring lock "4f30e3fe703d2381679612a57b1fb80a467f60b6" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:53:49 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-c28e2e38-e0ab-4996-a0b7-9e1c2181b509 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Lock "4f30e3fe703d2381679612a57b1fb80a467f60b6" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:53:49 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-c28e2e38-e0ab-4996-a0b7-9e1c2181b509 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6 --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:53:49 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-a9441db5-2cd9-4cf6-b95a-25184513aab1 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:53:49 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-a9441db5-2cd9-4cf6-b95a-25184513aab1 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.003s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:53:49 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-c28e2e38-e0ab-4996-a0b7-9e1c2181b509 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6 --force-share --output=json" returned: 0 in 0.194s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:53:49 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-c28e2e38-e0ab-4996-a0b7-9e1c2181b509 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6,backing_fmt=raw /opt/stack/data/nova/instances/cda8c5ad-e70c-4021-bace-d55831c4bc78/disk 1073741824 {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:53:49 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-c28e2e38-e0ab-4996-a0b7-9e1c2181b509 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6,backing_fmt=raw /opt/stack/data/nova/instances/cda8c5ad-e70c-4021-bace-d55831c4bc78/disk 1073741824" returned: 0 in 0.059s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:53:49 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-c28e2e38-e0ab-4996-a0b7-9e1c2181b509 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Lock "4f30e3fe703d2381679612a57b1fb80a467f60b6" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.258s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:53:49 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-c28e2e38-e0ab-4996-a0b7-9e1c2181b509 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6 --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:53:50 user nova-compute[75229]: DEBUG nova.network.neutron [None req-c28e2e38-e0ab-4996-a0b7-9e1c2181b509 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] [instance: cda8c5ad-e70c-4021-bace-d55831c4bc78] Successfully created port: c88498e8-25f8-4546-b007-b1dc853b3ccb {{(pid=75229) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 09:53:50 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-c28e2e38-e0ab-4996-a0b7-9e1c2181b509 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6 --force-share --output=json" returned: 0 in 0.216s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:53:50 user nova-compute[75229]: DEBUG nova.virt.disk.api [None req-c28e2e38-e0ab-4996-a0b7-9e1c2181b509 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Checking if we can resize image /opt/stack/data/nova/instances/cda8c5ad-e70c-4021-bace-d55831c4bc78/disk. size=1073741824 {{(pid=75229) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 09:53:50 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-c28e2e38-e0ab-4996-a0b7-9e1c2181b509 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cda8c5ad-e70c-4021-bace-d55831c4bc78/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:53:50 user nova-compute[75229]: DEBUG nova.compute.provider_tree [None req-a9441db5-2cd9-4cf6-b95a-25184513aab1 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Inventory has not changed in ProviderTree for provider: d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 {{(pid=75229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 09:53:50 user nova-compute[75229]: DEBUG nova.scheduler.client.report [None req-a9441db5-2cd9-4cf6-b95a-25184513aab1 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Inventory has not changed for provider d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 09:53:50 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-a9441db5-2cd9-4cf6-b95a-25184513aab1 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.566s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:53:50 user nova-compute[75229]: INFO nova.scheduler.client.report [None req-a9441db5-2cd9-4cf6-b95a-25184513aab1 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Deleted allocations for instance 4255af28-a111-4475-b207-67e335fd0835
Nov 14 09:53:50 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-c28e2e38-e0ab-4996-a0b7-9e1c2181b509 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cda8c5ad-e70c-4021-bace-d55831c4bc78/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:53:50 user nova-compute[75229]: DEBUG nova.virt.disk.api [None req-c28e2e38-e0ab-4996-a0b7-9e1c2181b509 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Cannot resize image /opt/stack/data/nova/instances/cda8c5ad-e70c-4021-bace-d55831c4bc78/disk to a smaller size. {{(pid=75229) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 09:53:50 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-c28e2e38-e0ab-4996-a0b7-9e1c2181b509 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] [instance: cda8c5ad-e70c-4021-bace-d55831c4bc78] Created local disks {{(pid=75229) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 09:53:50 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-c28e2e38-e0ab-4996-a0b7-9e1c2181b509 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] [instance: cda8c5ad-e70c-4021-bace-d55831c4bc78] Ensure instance console log exists: /opt/stack/data/nova/instances/cda8c5ad-e70c-4021-bace-d55831c4bc78/console.log {{(pid=75229) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 09:53:50 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-c28e2e38-e0ab-4996-a0b7-9e1c2181b509 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:53:50 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-c28e2e38-e0ab-4996-a0b7-9e1c2181b509 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:53:50 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-c28e2e38-e0ab-4996-a0b7-9e1c2181b509 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:53:50 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-a9441db5-2cd9-4cf6-b95a-25184513aab1 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Lock "4255af28-a111-4475-b207-67e335fd0835" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.588s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:53:50 user nova-compute[75229]: DEBUG nova.network.neutron [None req-c28e2e38-e0ab-4996-a0b7-9e1c2181b509 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] [instance: cda8c5ad-e70c-4021-bace-d55831c4bc78] Successfully updated port: c88498e8-25f8-4546-b007-b1dc853b3ccb {{(pid=75229) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 09:53:50 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 09:53:50 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-c28e2e38-e0ab-4996-a0b7-9e1c2181b509 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Acquiring lock "refresh_cache-cda8c5ad-e70c-4021-bace-d55831c4bc78" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 09:53:50 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-c28e2e38-e0ab-4996-a0b7-9e1c2181b509 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Acquired lock "refresh_cache-cda8c5ad-e70c-4021-bace-d55831c4bc78" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 09:53:50 user nova-compute[75229]: DEBUG nova.network.neutron [None req-c28e2e38-e0ab-4996-a0b7-9e1c2181b509 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] [instance: cda8c5ad-e70c-4021-bace-d55831c4bc78] Building network info cache for instance {{(pid=75229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 09:53:50 user nova-compute[75229]: DEBUG nova.compute.manager [req-d4ef7365-1b3e-4f0f-bf59-25ca5b0ec7a0 req-cd5b4ba6-8f01-4ba4-af05-e061b1157493 service nova] [instance: cda8c5ad-e70c-4021-bace-d55831c4bc78] Received event network-changed-c88498e8-25f8-4546-b007-b1dc853b3ccb {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:53:50 user nova-compute[75229]: DEBUG nova.compute.manager [req-d4ef7365-1b3e-4f0f-bf59-25ca5b0ec7a0 req-cd5b4ba6-8f01-4ba4-af05-e061b1157493 service nova] [instance: cda8c5ad-e70c-4021-bace-d55831c4bc78] Refreshing instance network info cache due to event network-changed-c88498e8-25f8-4546-b007-b1dc853b3ccb. {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 09:53:50 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-d4ef7365-1b3e-4f0f-bf59-25ca5b0ec7a0 req-cd5b4ba6-8f01-4ba4-af05-e061b1157493 service nova] Acquiring lock "refresh_cache-cda8c5ad-e70c-4021-bace-d55831c4bc78" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 09:53:50 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:53:50 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:53:50 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:53:50 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Auditing locally available compute resources for user (node: user) {{(pid=75229) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 09:53:50 user nova-compute[75229]: DEBUG nova.network.neutron [None req-c28e2e38-e0ab-4996-a0b7-9e1c2181b509 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] [instance: cda8c5ad-e70c-4021-bace-d55831c4bc78] Instance cache missing network info. {{(pid=75229) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 09:53:50 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7750cbc-b3d0-44aa-8b88-c291ba007a8a/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:53:51 user nova-compute[75229]: DEBUG nova.network.neutron [None req-c28e2e38-e0ab-4996-a0b7-9e1c2181b509 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] [instance: cda8c5ad-e70c-4021-bace-d55831c4bc78] Updating instance_info_cache with network_info: [{"id": "c88498e8-25f8-4546-b007-b1dc853b3ccb", "address": "fa:16:3e:c4:17:f3", "network": {"id": "6a700b61-4aa6-440b-87e6-a3525a5cb918", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-448680331-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8babb73006da4977a1fe2bdb35e08d8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc88498e8-25", "ovs_interfaceid": "c88498e8-25f8-4546-b007-b1dc853b3ccb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 09:53:51 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-c28e2e38-e0ab-4996-a0b7-9e1c2181b509 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Releasing lock "refresh_cache-cda8c5ad-e70c-4021-bace-d55831c4bc78" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 09:53:51 user nova-compute[75229]: DEBUG nova.compute.manager [None req-c28e2e38-e0ab-4996-a0b7-9e1c2181b509 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] [instance: cda8c5ad-e70c-4021-bace-d55831c4bc78] Instance network_info: |[{"id": "c88498e8-25f8-4546-b007-b1dc853b3ccb", "address": "fa:16:3e:c4:17:f3", "network": {"id": "6a700b61-4aa6-440b-87e6-a3525a5cb918", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-448680331-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8babb73006da4977a1fe2bdb35e08d8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc88498e8-25", "ovs_interfaceid": "c88498e8-25f8-4546-b007-b1dc853b3ccb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75229) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 09:53:51 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-d4ef7365-1b3e-4f0f-bf59-25ca5b0ec7a0 req-cd5b4ba6-8f01-4ba4-af05-e061b1157493 service nova] Acquired lock "refresh_cache-cda8c5ad-e70c-4021-bace-d55831c4bc78" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 09:53:51 user nova-compute[75229]: DEBUG nova.network.neutron [req-d4ef7365-1b3e-4f0f-bf59-25ca5b0ec7a0 req-cd5b4ba6-8f01-4ba4-af05-e061b1157493 service nova] [instance: cda8c5ad-e70c-4021-bace-d55831c4bc78] Refreshing network info cache for port c88498e8-25f8-4546-b007-b1dc853b3ccb {{(pid=75229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 09:53:51 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-c28e2e38-e0ab-4996-a0b7-9e1c2181b509 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] [instance: cda8c5ad-e70c-4021-bace-d55831c4bc78] Start _get_guest_xml network_info=[{"id": "c88498e8-25f8-4546-b007-b1dc853b3ccb", "address": "fa:16:3e:c4:17:f3", "network": {"id": "6a700b61-4aa6-440b-87e6-a3525a5cb918", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-448680331-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8babb73006da4977a1fe2bdb35e08d8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc88498e8-25", "ovs_interfaceid": "c88498e8-25f8-4546-b007-b1dc853b3ccb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T09:40:10Z,direct_url=<?>,disk_format='qcow2',id=3bef8470-ecc7-40e3-95d4-9254348ea72d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='de5a91106b6948ed937a7178ff9464c4',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T09:40:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'disk_bus': 'virtio', 'guest_format': None, 'encryption_secret_uuid': None, 'size': 0, 'device_type': 'disk', 'image_id': '3bef8470-ecc7-40e3-95d4-9254348ea72d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75229) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 09:53:51 user nova-compute[75229]: WARNING nova.virt.libvirt.driver [None req-c28e2e38-e0ab-4996-a0b7-9e1c2181b509 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 09:53:51 user nova-compute[75229]: WARNING nova.virt.libvirt.driver [None req-c28e2e38-e0ab-4996-a0b7-9e1c2181b509 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 09:53:51 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-c28e2e38-e0ab-4996-a0b7-9e1c2181b509 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75229) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 09:53:51 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-c28e2e38-e0ab-4996-a0b7-9e1c2181b509 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] CPU controller missing on host. {{(pid=75229) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 09:53:51 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7750cbc-b3d0-44aa-8b88-c291ba007a8a/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:53:51 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7750cbc-b3d0-44aa-8b88-c291ba007a8a/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:53:51 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-c28e2e38-e0ab-4996-a0b7-9e1c2181b509 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75229) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 09:53:51 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-c28e2e38-e0ab-4996-a0b7-9e1c2181b509 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] CPU controller found on host. {{(pid=75229) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 09:53:51 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-c28e2e38-e0ab-4996-a0b7-9e1c2181b509 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75229) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 09:53:51 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-c28e2e38-e0ab-4996-a0b7-9e1c2181b509 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T09:39:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T09:40:10Z,direct_url=<?>,disk_format='qcow2',id=3bef8470-ecc7-40e3-95d4-9254348ea72d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='de5a91106b6948ed937a7178ff9464c4',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T09:40:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 09:53:51 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-c28e2e38-e0ab-4996-a0b7-9e1c2181b509 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Flavor limits 0:0:0 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 09:53:51 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-c28e2e38-e0ab-4996-a0b7-9e1c2181b509 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Image limits 0:0:0 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 09:53:51 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-c28e2e38-e0ab-4996-a0b7-9e1c2181b509 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Flavor pref 0:0:0 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 09:53:51 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-c28e2e38-e0ab-4996-a0b7-9e1c2181b509 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Image pref 0:0:0 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 09:53:51 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-c28e2e38-e0ab-4996-a0b7-9e1c2181b509 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 09:53:51 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-c28e2e38-e0ab-4996-a0b7-9e1c2181b509 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 09:53:51 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-c28e2e38-e0ab-4996-a0b7-9e1c2181b509 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75229) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 09:53:51 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-c28e2e38-e0ab-4996-a0b7-9e1c2181b509 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Got 1 possible topologies {{(pid=75229) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 09:53:51 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-c28e2e38-e0ab-4996-a0b7-9e1c2181b509 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 09:53:51 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-c28e2e38-e0ab-4996-a0b7-9e1c2181b509 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 09:53:51 user nova-compute[75229]: DEBUG nova.virt.libvirt.vif [None req-c28e2e38-e0ab-4996-a0b7-9e1c2181b509 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T09:53:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-527422031',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-527422031',id=30,image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8babb73006da4977a1fe2bdb35e08d8f',ramdisk_id='',reservation_id='r-my61gj0x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-189750210',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T09:53:49Z,user_data=None,user_id='a8825cd49e9349f28576b704c4c4d717',uuid=cda8c5ad-e70c-4021-bace-d55831c4bc78,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c88498e8-25f8-4546-b007-b1dc853b3ccb", "address": "fa:16:3e:c4:17:f3", "network": {"id": "6a700b61-4aa6-440b-87e6-a3525a5cb918", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-448680331-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8babb73006da4977a1fe2bdb35e08d8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc88498e8-25", "ovs_interfaceid": "c88498e8-25f8-4546-b007-b1dc853b3ccb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75229) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 09:53:51 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-c28e2e38-e0ab-4996-a0b7-9e1c2181b509 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Converting VIF {"id": "c88498e8-25f8-4546-b007-b1dc853b3ccb", "address": "fa:16:3e:c4:17:f3", "network": {"id": "6a700b61-4aa6-440b-87e6-a3525a5cb918", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-448680331-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8babb73006da4977a1fe2bdb35e08d8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc88498e8-25", "ovs_interfaceid": "c88498e8-25f8-4546-b007-b1dc853b3ccb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 09:53:51 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-c28e2e38-e0ab-4996-a0b7-9e1c2181b509 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c4:17:f3,bridge_name='br-int',has_traffic_filtering=True,id=c88498e8-25f8-4546-b007-b1dc853b3ccb,network=Network(6a700b61-4aa6-440b-87e6-a3525a5cb918),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc88498e8-25') {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 09:53:51 user nova-compute[75229]: DEBUG nova.objects.instance [None req-c28e2e38-e0ab-4996-a0b7-9e1c2181b509 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Lazy-loading 'pci_devices' on Instance uuid cda8c5ad-e70c-4021-bace-d55831c4bc78 {{(pid=75229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 09:53:51 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-c28e2e38-e0ab-4996-a0b7-9e1c2181b509 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] [instance: cda8c5ad-e70c-4021-bace-d55831c4bc78] End _get_guest_xml xml=<domain type="kvm">
Nov 14 09:53:51 user nova-compute[75229]:   <uuid>cda8c5ad-e70c-4021-bace-d55831c4bc78</uuid>
Nov 14 09:53:51 user nova-compute[75229]:   <name>instance-0000001e</name>
Nov 14 09:53:51 user nova-compute[75229]:   <memory>524288</memory>
Nov 14 09:53:51 user nova-compute[75229]:   <vcpu>1</vcpu>
Nov 14 09:53:51 user nova-compute[75229]:   <metadata>
Nov 14 09:53:51 user nova-compute[75229]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 09:53:51 user nova-compute[75229]:       <nova:package version="0.0.0"/>
Nov 14 09:53:51 user nova-compute[75229]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-527422031</nova:name>
Nov 14 09:53:51 user nova-compute[75229]:       <nova:creationTime>2023-11-14 09:53:51</nova:creationTime>
Nov 14 09:53:51 user nova-compute[75229]:       <nova:flavor name="m1.tiny">
Nov 14 09:53:51 user nova-compute[75229]:         <nova:memory>512</nova:memory>
Nov 14 09:53:51 user nova-compute[75229]:         <nova:disk>1</nova:disk>
Nov 14 09:53:51 user nova-compute[75229]:         <nova:swap>0</nova:swap>
Nov 14 09:53:51 user nova-compute[75229]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 09:53:51 user nova-compute[75229]:         <nova:vcpus>1</nova:vcpus>
Nov 14 09:53:51 user nova-compute[75229]:       </nova:flavor>
Nov 14 09:53:51 user nova-compute[75229]:       <nova:owner>
Nov 14 09:53:51 user nova-compute[75229]:         <nova:user uuid="a8825cd49e9349f28576b704c4c4d717">tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member</nova:user>
Nov 14 09:53:51 user nova-compute[75229]:         <nova:project uuid="8babb73006da4977a1fe2bdb35e08d8f">tempest-ServerBootFromVolumeStableRescueTest-189750210</nova:project>
Nov 14 09:53:51 user nova-compute[75229]:       </nova:owner>
Nov 14 09:53:51 user nova-compute[75229]:       <nova:root type="image" uuid="3bef8470-ecc7-40e3-95d4-9254348ea72d"/>
Nov 14 09:53:51 user nova-compute[75229]:       <nova:ports>
Nov 14 09:53:51 user nova-compute[75229]:         <nova:port uuid="c88498e8-25f8-4546-b007-b1dc853b3ccb">
Nov 14 09:53:51 user nova-compute[75229]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 14 09:53:51 user nova-compute[75229]:         </nova:port>
Nov 14 09:53:51 user nova-compute[75229]:       </nova:ports>
Nov 14 09:53:51 user nova-compute[75229]:     </nova:instance>
Nov 14 09:53:51 user nova-compute[75229]:   </metadata>
Nov 14 09:53:51 user nova-compute[75229]:   <sysinfo type="smbios">
Nov 14 09:53:51 user nova-compute[75229]:     <system>
Nov 14 09:53:51 user nova-compute[75229]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 09:53:51 user nova-compute[75229]:       <entry name="product">OpenStack Nova</entry>
Nov 14 09:53:51 user nova-compute[75229]:       <entry name="version">0.0.0</entry>
Nov 14 09:53:51 user nova-compute[75229]:       <entry name="serial">cda8c5ad-e70c-4021-bace-d55831c4bc78</entry>
Nov 14 09:53:51 user nova-compute[75229]:       <entry name="uuid">cda8c5ad-e70c-4021-bace-d55831c4bc78</entry>
Nov 14 09:53:51 user nova-compute[75229]:       <entry name="family">Virtual Machine</entry>
Nov 14 09:53:51 user nova-compute[75229]:     </system>
Nov 14 09:53:51 user nova-compute[75229]:   </sysinfo>
Nov 14 09:53:51 user nova-compute[75229]:   <os>
Nov 14 09:53:51 user nova-compute[75229]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 09:53:51 user nova-compute[75229]:     <boot dev="hd"/>
Nov 14 09:53:51 user nova-compute[75229]:     <smbios mode="sysinfo"/>
Nov 14 09:53:51 user nova-compute[75229]:   </os>
Nov 14 09:53:51 user nova-compute[75229]:   <features>
Nov 14 09:53:51 user nova-compute[75229]:     <acpi/>
Nov 14 09:53:51 user nova-compute[75229]:     <apic/>
Nov 14 09:53:51 user nova-compute[75229]:     <vmcoreinfo/>
Nov 14 09:53:51 user nova-compute[75229]:   </features>
Nov 14 09:53:51 user nova-compute[75229]:   <clock offset="utc">
Nov 14 09:53:51 user nova-compute[75229]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 09:53:51 user nova-compute[75229]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 09:53:51 user nova-compute[75229]:     <timer name="hpet" present="no"/>
Nov 14 09:53:51 user nova-compute[75229]:   </clock>
Nov 14 09:53:51 user nova-compute[75229]:   <cpu mode="custom" match="exact">
Nov 14 09:53:51 user nova-compute[75229]:     <model>Nehalem</model>
Nov 14 09:53:51 user nova-compute[75229]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 09:53:51 user nova-compute[75229]:   </cpu>
Nov 14 09:53:51 user nova-compute[75229]:   <devices>
Nov 14 09:53:51 user nova-compute[75229]:     <disk type="file" device="disk">
Nov 14 09:53:51 user nova-compute[75229]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 09:53:51 user nova-compute[75229]:       <source file="/opt/stack/data/nova/instances/cda8c5ad-e70c-4021-bace-d55831c4bc78/disk"/>
Nov 14 09:53:51 user nova-compute[75229]:       <target dev="vda" bus="virtio"/>
Nov 14 09:53:51 user nova-compute[75229]:     </disk>
Nov 14 09:53:51 user nova-compute[75229]:     <interface type="ethernet">
Nov 14 09:53:51 user nova-compute[75229]:       <mac address="fa:16:3e:c4:17:f3"/>
Nov 14 09:53:51 user nova-compute[75229]:       <model type="virtio"/>
Nov 14 09:53:51 user nova-compute[75229]:       <mtu size="1442"/>
Nov 14 09:53:51 user nova-compute[75229]:       <target dev="tapc88498e8-25"/>
Nov 14 09:53:51 user nova-compute[75229]:     </interface>
Nov 14 09:53:51 user nova-compute[75229]:     <serial type="pty">
Nov 14 09:53:51 user nova-compute[75229]:       <log file="/opt/stack/data/nova/instances/cda8c5ad-e70c-4021-bace-d55831c4bc78/console.log" append="off"/>
Nov 14 09:53:51 user nova-compute[75229]:     </serial>
Nov 14 09:53:51 user nova-compute[75229]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 09:53:51 user nova-compute[75229]:     <video>
Nov 14 09:53:51 user nova-compute[75229]:       <model type="virtio"/>
Nov 14 09:53:51 user nova-compute[75229]:     </video>
Nov 14 09:53:51 user nova-compute[75229]:     <rng model="virtio">
Nov 14 09:53:51 user nova-compute[75229]:       <backend model="random">/dev/urandom</backend>
Nov 14 09:53:51 user nova-compute[75229]:     </rng>
Nov 14 09:53:51 user nova-compute[75229]:     <controller type="usb" index="0" model="none"/>
Nov 14 09:53:51 user nova-compute[75229]:     <memballoon model="virtio">
Nov 14 09:53:51 user nova-compute[75229]:       <stats period="10"/>
Nov 14 09:53:51 user nova-compute[75229]:     </memballoon>
Nov 14 09:53:51 user nova-compute[75229]:   </devices>
Nov 14 09:53:51 user nova-compute[75229]: </domain>
Nov 14 09:53:51 user nova-compute[75229]:  {{(pid=75229) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 09:53:51 user nova-compute[75229]: DEBUG nova.virt.libvirt.vif [None req-c28e2e38-e0ab-4996-a0b7-9e1c2181b509 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T09:53:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-527422031',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-527422031',id=30,image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8babb73006da4977a1fe2bdb35e08d8f',ramdisk_id='',reservation_id='r-my61gj0x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-189750210',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T09:53:49Z,user_data=None,user_id='a8825cd49e9349f28576b704c4c4d717',uuid=cda8c5ad-e70c-4021-bace-d55831c4bc78,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c88498e8-25f8-4546-b007-b1dc853b3ccb", "address": "fa:16:3e:c4:17:f3", "network": {"id": "6a700b61-4aa6-440b-87e6-a3525a5cb918", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-448680331-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8babb73006da4977a1fe2bdb35e08d8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc88498e8-25", "ovs_interfaceid": "c88498e8-25f8-4546-b007-b1dc853b3ccb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 09:53:51 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-c28e2e38-e0ab-4996-a0b7-9e1c2181b509 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Converting VIF {"id": "c88498e8-25f8-4546-b007-b1dc853b3ccb", "address": "fa:16:3e:c4:17:f3", "network": {"id": "6a700b61-4aa6-440b-87e6-a3525a5cb918", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-448680331-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8babb73006da4977a1fe2bdb35e08d8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc88498e8-25", "ovs_interfaceid": "c88498e8-25f8-4546-b007-b1dc853b3ccb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 09:53:51 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-c28e2e38-e0ab-4996-a0b7-9e1c2181b509 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c4:17:f3,bridge_name='br-int',has_traffic_filtering=True,id=c88498e8-25f8-4546-b007-b1dc853b3ccb,network=Network(6a700b61-4aa6-440b-87e6-a3525a5cb918),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc88498e8-25') {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 09:53:51 user nova-compute[75229]: DEBUG os_vif [None req-c28e2e38-e0ab-4996-a0b7-9e1c2181b509 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c4:17:f3,bridge_name='br-int',has_traffic_filtering=True,id=c88498e8-25f8-4546-b007-b1dc853b3ccb,network=Network(6a700b61-4aa6-440b-87e6-a3525a5cb918),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc88498e8-25') {{(pid=75229) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 09:53:51 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:53:51 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:53:51 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 09:53:51 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:53:51 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a49b6505-e31c-51b9-9de1-555a1ed14e94', '_type': 'linux-noop'}}, row=False) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:53:51 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:53:51 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 09:53:51 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:53:51 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc88498e8-25, may_exist=True, interface_attrs={}) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:53:51 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc88498e8-25, col_values=(('qos', UUID('0f7b7a61-5c80-47ca-9681-757431e97bbc')),), if_exists=True) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:53:51 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc88498e8-25, col_values=(('external_ids', {'iface-id': 'c88498e8-25f8-4546-b007-b1dc853b3ccb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c4:17:f3', 'vm-uuid': 'cda8c5ad-e70c-4021-bace-d55831c4bc78'}),), if_exists=True) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:53:51 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:53:51 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 09:53:51 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:53:51 user nova-compute[75229]: INFO os_vif [None req-c28e2e38-e0ab-4996-a0b7-9e1c2181b509 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c4:17:f3,bridge_name='br-int',has_traffic_filtering=True,id=c88498e8-25f8-4546-b007-b1dc853b3ccb,network=Network(6a700b61-4aa6-440b-87e6-a3525a5cb918),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc88498e8-25')
Nov 14 09:53:51 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-c28e2e38-e0ab-4996-a0b7-9e1c2181b509 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] No BDM found with device name vda, not building metadata. {{(pid=75229) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 09:53:51 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-c28e2e38-e0ab-4996-a0b7-9e1c2181b509 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] No VIF found with MAC fa:16:3e:c4:17:f3, not building metadata {{(pid=75229) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 09:53:51 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7750cbc-b3d0-44aa-8b88-c291ba007a8a/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:53:51 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc486509-4506-415c-a2b4-986d05da2317/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:53:51 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc486509-4506-415c-a2b4-986d05da2317/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:53:51 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc486509-4506-415c-a2b4-986d05da2317/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:53:51 user nova-compute[75229]: DEBUG nova.network.neutron [req-d4ef7365-1b3e-4f0f-bf59-25ca5b0ec7a0 req-cd5b4ba6-8f01-4ba4-af05-e061b1157493 service nova] [instance: cda8c5ad-e70c-4021-bace-d55831c4bc78] Updated VIF entry in instance network info cache for port c88498e8-25f8-4546-b007-b1dc853b3ccb. {{(pid=75229) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 09:53:51 user nova-compute[75229]: DEBUG nova.network.neutron [req-d4ef7365-1b3e-4f0f-bf59-25ca5b0ec7a0 req-cd5b4ba6-8f01-4ba4-af05-e061b1157493 service nova] [instance: cda8c5ad-e70c-4021-bace-d55831c4bc78] Updating instance_info_cache with network_info: [{"id": "c88498e8-25f8-4546-b007-b1dc853b3ccb", "address": "fa:16:3e:c4:17:f3", "network": {"id": "6a700b61-4aa6-440b-87e6-a3525a5cb918", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-448680331-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8babb73006da4977a1fe2bdb35e08d8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc88498e8-25", "ovs_interfaceid": "c88498e8-25f8-4546-b007-b1dc853b3ccb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 09:53:51 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-d4ef7365-1b3e-4f0f-bf59-25ca5b0ec7a0 req-cd5b4ba6-8f01-4ba4-af05-e061b1157493 service nova] Releasing lock "refresh_cache-cda8c5ad-e70c-4021-bace-d55831c4bc78" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 09:53:51 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc486509-4506-415c-a2b4-986d05da2317/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:53:51 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/564d95eb-81c0-47a5-9979-2318fced06f5/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:53:51 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/564d95eb-81c0-47a5-9979-2318fced06f5/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:53:51 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/564d95eb-81c0-47a5-9979-2318fced06f5/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:53:52 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/564d95eb-81c0-47a5-9979-2318fced06f5/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:53:52 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e58500df-059a-4fce-afb7-ba36feca0697/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:53:52 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e58500df-059a-4fce-afb7-ba36feca0697/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:53:52 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e58500df-059a-4fce-afb7-ba36feca0697/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:53:52 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e58500df-059a-4fce-afb7-ba36feca0697/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:53:52 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c9fe69e-3f9d-4b30-a9e4-efc3e83efa17/disk.rescue --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:53:52 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:53:52 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c9fe69e-3f9d-4b30-a9e4-efc3e83efa17/disk.rescue --force-share --output=json" returned: 0 in 0.179s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:53:52 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c9fe69e-3f9d-4b30-a9e4-efc3e83efa17/disk.rescue --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:53:52 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:53:52 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c9fe69e-3f9d-4b30-a9e4-efc3e83efa17/disk.rescue --force-share --output=json" returned: 0 in 0.186s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:53:52 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c9fe69e-3f9d-4b30-a9e4-efc3e83efa17/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:53:52 user nova-compute[75229]: DEBUG nova.compute.manager [req-5d24ab93-2870-46a8-8063-86eaa86f9388 req-232b9950-a1bd-43fb-9620-35ac6ab1b11d service nova] [instance: cda8c5ad-e70c-4021-bace-d55831c4bc78] Received event network-vif-plugged-c88498e8-25f8-4546-b007-b1dc853b3ccb {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:53:52 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-5d24ab93-2870-46a8-8063-86eaa86f9388 req-232b9950-a1bd-43fb-9620-35ac6ab1b11d service nova] Acquiring lock "cda8c5ad-e70c-4021-bace-d55831c4bc78-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:53:52 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-5d24ab93-2870-46a8-8063-86eaa86f9388 req-232b9950-a1bd-43fb-9620-35ac6ab1b11d service nova] Lock "cda8c5ad-e70c-4021-bace-d55831c4bc78-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:53:52 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-5d24ab93-2870-46a8-8063-86eaa86f9388 req-232b9950-a1bd-43fb-9620-35ac6ab1b11d service nova] Lock "cda8c5ad-e70c-4021-bace-d55831c4bc78-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:53:52 user nova-compute[75229]: DEBUG nova.compute.manager [req-5d24ab93-2870-46a8-8063-86eaa86f9388 req-232b9950-a1bd-43fb-9620-35ac6ab1b11d service nova] [instance: cda8c5ad-e70c-4021-bace-d55831c4bc78] No waiting events found dispatching network-vif-plugged-c88498e8-25f8-4546-b007-b1dc853b3ccb {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 09:53:52 user nova-compute[75229]: WARNING nova.compute.manager [req-5d24ab93-2870-46a8-8063-86eaa86f9388 req-232b9950-a1bd-43fb-9620-35ac6ab1b11d service nova] [instance: cda8c5ad-e70c-4021-bace-d55831c4bc78] Received unexpected event network-vif-plugged-c88498e8-25f8-4546-b007-b1dc853b3ccb for instance with vm_state building and task_state spawning.
Nov 14 09:53:52 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c9fe69e-3f9d-4b30-a9e4-efc3e83efa17/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:53:52 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c9fe69e-3f9d-4b30-a9e4-efc3e83efa17/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:53:53 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c9fe69e-3f9d-4b30-a9e4-efc3e83efa17/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:53:53 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4ce290f-6dd2-44b6-91be-8e775045837e/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:53:53 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:53:53 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:53:53 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:53:53 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4ce290f-6dd2-44b6-91be-8e775045837e/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:53:53 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4ce290f-6dd2-44b6-91be-8e775045837e/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:53:53 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:53:53 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4ce290f-6dd2-44b6-91be-8e775045837e/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:53:53 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94e2b266-2fe3-481a-bb1e-24f835a79ddf/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:53:53 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94e2b266-2fe3-481a-bb1e-24f835a79ddf/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:53:53 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94e2b266-2fe3-481a-bb1e-24f835a79ddf/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:53:53 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94e2b266-2fe3-481a-bb1e-24f835a79ddf/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:53:53 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/200e8be8-516b-4344-a584-e88ee79b21a6/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:53:54 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/200e8be8-516b-4344-a584-e88ee79b21a6/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:53:54 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/200e8be8-516b-4344-a584-e88ee79b21a6/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:53:54 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/200e8be8-516b-4344-a584-e88ee79b21a6/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:53:54 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5170e9e-66e3-4df1-9807-4958cac6480e/disk.rescue --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:53:54 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5170e9e-66e3-4df1-9807-4958cac6480e/disk.rescue --force-share --output=json" returned: 0 in 0.178s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:53:54 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5170e9e-66e3-4df1-9807-4958cac6480e/disk.rescue --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:53:54 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5170e9e-66e3-4df1-9807-4958cac6480e/disk.rescue --force-share --output=json" returned: 0 in 0.172s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:53:54 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5170e9e-66e3-4df1-9807-4958cac6480e/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:53:54 user nova-compute[75229]: DEBUG nova.compute.manager [None req-c28e2e38-e0ab-4996-a0b7-9e1c2181b509 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] [instance: cda8c5ad-e70c-4021-bace-d55831c4bc78] Instance event wait completed in 0 seconds for  {{(pid=75229) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 09:53:54 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-c28e2e38-e0ab-4996-a0b7-9e1c2181b509 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] [instance: cda8c5ad-e70c-4021-bace-d55831c4bc78] Guest created on hypervisor {{(pid=75229) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 09:53:54 user nova-compute[75229]: INFO nova.virt.libvirt.driver [-] [instance: cda8c5ad-e70c-4021-bace-d55831c4bc78] Instance spawned successfully.
Nov 14 09:53:54 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-c28e2e38-e0ab-4996-a0b7-9e1c2181b509 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] [instance: cda8c5ad-e70c-4021-bace-d55831c4bc78] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 09:53:54 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-c28e2e38-e0ab-4996-a0b7-9e1c2181b509 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] [instance: cda8c5ad-e70c-4021-bace-d55831c4bc78] Found default for hw_cdrom_bus of ide {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 09:53:54 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-c28e2e38-e0ab-4996-a0b7-9e1c2181b509 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] [instance: cda8c5ad-e70c-4021-bace-d55831c4bc78] Found default for hw_disk_bus of virtio {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 09:53:54 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-c28e2e38-e0ab-4996-a0b7-9e1c2181b509 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] [instance: cda8c5ad-e70c-4021-bace-d55831c4bc78] Found default for hw_input_bus of None {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 09:53:54 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-c28e2e38-e0ab-4996-a0b7-9e1c2181b509 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] [instance: cda8c5ad-e70c-4021-bace-d55831c4bc78] Found default for hw_pointer_model of None {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 09:53:54 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-c28e2e38-e0ab-4996-a0b7-9e1c2181b509 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] [instance: cda8c5ad-e70c-4021-bace-d55831c4bc78] Found default for hw_video_model of virtio {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 09:53:54 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-c28e2e38-e0ab-4996-a0b7-9e1c2181b509 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] [instance: cda8c5ad-e70c-4021-bace-d55831c4bc78] Found default for hw_vif_model of virtio {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 09:53:54 user nova-compute[75229]: INFO nova.compute.manager [None req-c28e2e38-e0ab-4996-a0b7-9e1c2181b509 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] [instance: cda8c5ad-e70c-4021-bace-d55831c4bc78] Took 5.35 seconds to spawn the instance on the hypervisor.
Nov 14 09:53:54 user nova-compute[75229]: DEBUG nova.compute.manager [None req-c28e2e38-e0ab-4996-a0b7-9e1c2181b509 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] [instance: cda8c5ad-e70c-4021-bace-d55831c4bc78] Checking state {{(pid=75229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 09:53:54 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5170e9e-66e3-4df1-9807-4958cac6480e/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:53:54 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5170e9e-66e3-4df1-9807-4958cac6480e/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:53:54 user nova-compute[75229]: DEBUG nova.compute.manager [req-2c03d511-4f22-4663-b5a5-f28f165a20a8 req-963936db-eac7-4578-b3f3-6289d758d6b9 service nova] [instance: cda8c5ad-e70c-4021-bace-d55831c4bc78] Received event network-vif-plugged-c88498e8-25f8-4546-b007-b1dc853b3ccb {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:53:54 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-2c03d511-4f22-4663-b5a5-f28f165a20a8 req-963936db-eac7-4578-b3f3-6289d758d6b9 service nova] Acquiring lock "cda8c5ad-e70c-4021-bace-d55831c4bc78-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:53:54 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-2c03d511-4f22-4663-b5a5-f28f165a20a8 req-963936db-eac7-4578-b3f3-6289d758d6b9 service nova] Lock "cda8c5ad-e70c-4021-bace-d55831c4bc78-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:53:54 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-2c03d511-4f22-4663-b5a5-f28f165a20a8 req-963936db-eac7-4578-b3f3-6289d758d6b9 service nova] Lock "cda8c5ad-e70c-4021-bace-d55831c4bc78-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:53:54 user nova-compute[75229]: DEBUG nova.compute.manager [req-2c03d511-4f22-4663-b5a5-f28f165a20a8 req-963936db-eac7-4578-b3f3-6289d758d6b9 service nova] [instance: cda8c5ad-e70c-4021-bace-d55831c4bc78] No waiting events found dispatching network-vif-plugged-c88498e8-25f8-4546-b007-b1dc853b3ccb {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 09:53:54 user nova-compute[75229]: WARNING nova.compute.manager [req-2c03d511-4f22-4663-b5a5-f28f165a20a8 req-963936db-eac7-4578-b3f3-6289d758d6b9 service nova] [instance: cda8c5ad-e70c-4021-bace-d55831c4bc78] Received unexpected event network-vif-plugged-c88498e8-25f8-4546-b007-b1dc853b3ccb for instance with vm_state building and task_state spawning.
Nov 14 09:53:54 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5170e9e-66e3-4df1-9807-4958cac6480e/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:53:55 user nova-compute[75229]: INFO nova.compute.manager [None req-c28e2e38-e0ab-4996-a0b7-9e1c2181b509 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] [instance: cda8c5ad-e70c-4021-bace-d55831c4bc78] Took 6.74 seconds to build instance.
Nov 14 09:53:55 user nova-compute[75229]: WARNING nova.virt.libvirt.driver [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 09:53:55 user nova-compute[75229]: WARNING nova.virt.libvirt.driver [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 09:53:55 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Hypervisor/Node resource view: name=user free_ram=7655MB free_disk=25.170223236083984GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75229) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 09:53:55 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:53:55 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:53:55 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-c28e2e38-e0ab-4996-a0b7-9e1c2181b509 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Lock "cda8c5ad-e70c-4021-bace-d55831c4bc78" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.845s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:53:55 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Instance a7750cbc-b3d0-44aa-8b88-c291ba007a8a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 09:53:55 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Instance 4c9fe69e-3f9d-4b30-a9e4-efc3e83efa17 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 09:53:55 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Instance b5170e9e-66e3-4df1-9807-4958cac6480e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 09:53:55 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Instance a4ce290f-6dd2-44b6-91be-8e775045837e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 09:53:55 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Instance 94e2b266-2fe3-481a-bb1e-24f835a79ddf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 09:53:55 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Instance e58500df-059a-4fce-afb7-ba36feca0697 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 09:53:55 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Instance 564d95eb-81c0-47a5-9979-2318fced06f5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 09:53:55 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Instance cc486509-4506-415c-a2b4-986d05da2317 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 09:53:55 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Instance 200e8be8-516b-4344-a584-e88ee79b21a6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 09:53:55 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Instance cda8c5ad-e70c-4021-bace-d55831c4bc78 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 09:53:55 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75229) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 09:53:55 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75229) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 09:53:55 user nova-compute[75229]: DEBUG nova.compute.provider_tree [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Inventory has not changed in ProviderTree for provider: d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 {{(pid=75229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 09:53:55 user nova-compute[75229]: DEBUG nova.scheduler.client.report [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Inventory has not changed for provider d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 09:53:56 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Compute_service record updated for user:user {{(pid=75229) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 09:53:56 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.537s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:53:56 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:53:57 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 09:53:57 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 09:53:57 user nova-compute[75229]: DEBUG nova.compute.manager [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Starting heal instance info cache {{(pid=75229) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 09:53:57 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Acquiring lock "refresh_cache-4c9fe69e-3f9d-4b30-a9e4-efc3e83efa17" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 09:53:57 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Acquired lock "refresh_cache-4c9fe69e-3f9d-4b30-a9e4-efc3e83efa17" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 09:53:57 user nova-compute[75229]: DEBUG nova.network.neutron [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] [instance: 4c9fe69e-3f9d-4b30-a9e4-efc3e83efa17] Forcefully refreshing network info cache for instance {{(pid=75229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 09:53:57 user nova-compute[75229]: DEBUG nova.network.neutron [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] [instance: 4c9fe69e-3f9d-4b30-a9e4-efc3e83efa17] Updating instance_info_cache with network_info: [{"id": "235153d6-63c1-44d2-97cc-c083544e6790", "address": "fa:16:3e:a0:db:35", "network": {"id": "22eed29e-7148-42f9-b4c7-b97811cba8eb", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2000485731-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46457b27e3ed416e827c3c22449fb512", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap235153d6-63", "ovs_interfaceid": "235153d6-63c1-44d2-97cc-c083544e6790", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 09:53:57 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Releasing lock "refresh_cache-4c9fe69e-3f9d-4b30-a9e4-efc3e83efa17" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 09:53:57 user nova-compute[75229]: DEBUG nova.compute.manager [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] [instance: 4c9fe69e-3f9d-4b30-a9e4-efc3e83efa17] Updated the network info_cache for instance {{(pid=75229) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 09:53:57 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 09:53:57 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 09:53:57 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 09:53:57 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 09:53:57 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 09:53:57 user nova-compute[75229]: DEBUG nova.compute.manager [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75229) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 09:53:58 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:54:01 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:54:03 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:54:06 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:54:06 user nova-compute[75229]: WARNING nova.virt.libvirt.driver [None req-093fcf37-671b-44c8-a9ad-213f1859e28c tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 94e2b266-2fe3-481a-bb1e-24f835a79ddf is timed out.
Nov 14 09:54:06 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-093fcf37-671b-44c8-a9ad-213f1859e28c tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] Successfully detached device vdb from instance 94e2b266-2fe3-481a-bb1e-24f835a79ddf from the live domain config.
Nov 14 09:54:06 user nova-compute[75229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-093fcf37-671b-44c8-a9ad-213f1859e28c tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] [instance: 94e2b266-2fe3-481a-bb1e-24f835a79ddf] calling os-brick to detach iSCSI Volume {{(pid=75229) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 09:54:06 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-093fcf37-671b-44c8-a9ad-213f1859e28c tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f73f85151b0>, {'target_iqn': 'iqn.2010-10.org.openstack:b590f04d-8a50-4810-8e66-05d846f4613f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PBamvgOl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 09:54:06 user nova-compute[75229]: WARNING os_brick.initiator.connectors.base [None req-093fcf37-671b-44c8-a9ad-213f1859e28c tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 09:54:06 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-093fcf37-671b-44c8-a9ad-213f1859e28c tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 09:54:06 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-093fcf37-671b-44c8-a9ad-213f1859e28c tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 09:54:06 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:54:06 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:54:06 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[d88aa3a8-da10-4e40-83b5-9e6b9b75d088]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b590f04d-8a50-4810-8e66-05d846f4613f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:54:06 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-093fcf37-671b-44c8-a9ad-213f1859e28c tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 09:54:06 user nova-compute[75229]: No targets found.
Nov 14 09:54:06 user nova-compute[75229]: iSNS:
Nov 14 09:54:06 user nova-compute[75229]: No targets found.
Nov 14 09:54:06 user nova-compute[75229]: STATIC:
Nov 14 09:54:06 user nova-compute[75229]: Target: iqn.2010-10.org.openstack:b590f04d-8a50-4810-8e66-05d846f4613f
Nov 14 09:54:06 user nova-compute[75229]:         Portal: 172.16.0.220:3260,-1
Nov 14 09:54:06 user nova-compute[75229]:                 Iface Name: default
Nov 14 09:54:06 user nova-compute[75229]: FIRMWARE:
Nov 14 09:54:06 user nova-compute[75229]: No targets found.
Nov 14 09:54:06 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 09:54:06 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-093fcf37-671b-44c8-a9ad-213f1859e28c tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 09:54:06 user nova-compute[75229]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 09:54:06 user nova-compute[75229]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75229) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 09:54:06 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-093fcf37-671b-44c8-a9ad-213f1859e28c tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b590f04d-8a50-4810-8e66-05d846f4613f', 0)] {{(pid=75229) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 09:54:06 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:54:06 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:54:06 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaa88567-a781-475b-b426-c5e74b9fee42]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b590f04d-8a50-4810-8e66-05d846f4613f\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:54:06 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:54:06 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:54:06 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[07ad32d9-c6db-4411-9768-3a5fb7b75c6e]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b590f04d-8a50-4810-8e66-05d846f4613f (non-flash)\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:54:06 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-093fcf37-671b-44c8-a9ad-213f1859e28c tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b590f04d-8a50-4810-8e66-05d846f4613f (non-flash)
Nov 14 09:54:06 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 09:54:06 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-093fcf37-671b-44c8-a9ad-213f1859e28c tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b590f04d-8a50-4810-8e66-05d846f4613f (non-flash)
Nov 14 09:54:06 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 09:54:06 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-093fcf37-671b-44c8-a9ad-213f1859e28c tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f73d4f5d240>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b590f04d-8a50-4810-8e66-05d846f4613f'): ({'sdc'}, set())}) {{(pid=75229) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 09:54:06 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-093fcf37-671b-44c8-a9ad-213f1859e28c tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] Removing single pathed devices sdc {{(pid=75229) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 09:54:06 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:54:06 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:54:06 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[56efa03e-2594-46cc-9225-7f4c0aeca1c0]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:54:06 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:54:06 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.017s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:54:06 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbcc9c24-bac9-4f86-83d0-6ac12e55220f]: (4, ('ok\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:54:06 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-093fcf37-671b-44c8-a9ad-213f1859e28c tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] Flushing IO for device /dev/sdc {{(pid=75229) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 09:54:06 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:54:06 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:54:06 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f52aea2-971d-4f0a-9099-43e63f2c43c2]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:54:06 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-093fcf37-671b-44c8-a9ad-213f1859e28c tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75229) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 09:54:06 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:54:06 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.034s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:54:06 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[49947801-84c4-43c7-8645-ace463ca5f5a]: (4, ('1', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:54:06 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-093fcf37-671b-44c8-a9ad-213f1859e28c tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75229) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 09:54:06 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-093fcf37-671b-44c8-a9ad-213f1859e28c tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] SCSI volumes sdc have been removed. {{(pid=75229) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 09:54:06 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-093fcf37-671b-44c8-a9ad-213f1859e28c tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b590f04d-8a50-4810-8e66-05d846f4613f')] {{(pid=75229) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 09:54:06 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b590f04d-8a50-4810-8e66-05d846f4613f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:54:06 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b590f04d-8a50-4810-8e66-05d846f4613f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:54:06 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[560c0717-4d85-45a5-9b1d-887c95f72650]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:54:06 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-093fcf37-671b-44c8-a9ad-213f1859e28c tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:54:06 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b590f04d-8a50-4810-8e66-05d846f4613f -p 172.16.0.220:3260 --logout {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:54:06 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b590f04d-8a50-4810-8e66-05d846f4613f -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:54:06 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d1ac724-1a69-4b77-a34c-a0804b81b01c]: (4, ('Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:b590f04d-8a50-4810-8e66-05d846f4613f, portal: 172.16.0.220,3260]\nLogout of [sid: 27, target: iqn.2010-10.org.openstack:b590f04d-8a50-4810-8e66-05d846f4613f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:54:06 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-093fcf37-671b-44c8-a9ad-213f1859e28c tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:b590f04d-8a50-4810-8e66-05d846f4613f, portal: 172.16.0.220,3260]
Nov 14 09:54:06 user nova-compute[75229]: Logout of [sid: 27, target: iqn.2010-10.org.openstack:b590f04d-8a50-4810-8e66-05d846f4613f, portal: 172.16.0.220,3260] successful.
Nov 14 09:54:06 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:54:06 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b590f04d-8a50-4810-8e66-05d846f4613f -p 172.16.0.220:3260 --op delete {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:54:06 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b590f04d-8a50-4810-8e66-05d846f4613f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:54:06 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a01a81c-3a7d-4a0f-b4bb-3dbe371debd9]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:54:06 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-093fcf37-671b-44c8-a9ad-213f1859e28c tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:54:06 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-093fcf37-671b-44c8-a9ad-213f1859e28c tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.287s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 09:54:06 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-093fcf37-671b-44c8-a9ad-213f1859e28c tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] <== disconnect_volume: return (288ms) None {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 09:54:06 user nova-compute[75229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-093fcf37-671b-44c8-a9ad-213f1859e28c tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] [instance: 94e2b266-2fe3-481a-bb1e-24f835a79ddf] Disconnected iSCSI Volume {{(pid=75229) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 09:54:07 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 09:54:07 user nova-compute[75229]: DEBUG nova.objects.instance [None req-093fcf37-671b-44c8-a9ad-213f1859e28c tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] Lazy-loading 'flavor' on Instance uuid 94e2b266-2fe3-481a-bb1e-24f835a79ddf {{(pid=75229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 09:54:07 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-093fcf37-671b-44c8-a9ad-213f1859e28c tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] Lock "94e2b266-2fe3-481a-bb1e-24f835a79ddf" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.965s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:54:08 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:54:09 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:54:11 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:54:13 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:54:16 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:54:18 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:54:21 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:54:23 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:54:24 user nova-compute[75229]: DEBUG nova.compute.manager [req-e0f74fad-5946-4b57-b672-30d6fa9a7878 req-9f1cac0d-d301-425c-83fe-e78d147f84e5 service nova] [instance: 564d95eb-81c0-47a5-9979-2318fced06f5] Received event network-changed-81c08c89-9d11-4321-b1c6-d61800dac599 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:54:24 user nova-compute[75229]: DEBUG nova.compute.manager [req-e0f74fad-5946-4b57-b672-30d6fa9a7878 req-9f1cac0d-d301-425c-83fe-e78d147f84e5 service nova] [instance: 564d95eb-81c0-47a5-9979-2318fced06f5] Refreshing instance network info cache due to event network-changed-81c08c89-9d11-4321-b1c6-d61800dac599. {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 09:54:24 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-e0f74fad-5946-4b57-b672-30d6fa9a7878 req-9f1cac0d-d301-425c-83fe-e78d147f84e5 service nova] Acquiring lock "refresh_cache-564d95eb-81c0-47a5-9979-2318fced06f5" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 09:54:24 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-e0f74fad-5946-4b57-b672-30d6fa9a7878 req-9f1cac0d-d301-425c-83fe-e78d147f84e5 service nova] Acquired lock "refresh_cache-564d95eb-81c0-47a5-9979-2318fced06f5" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 09:54:24 user nova-compute[75229]: DEBUG nova.network.neutron [req-e0f74fad-5946-4b57-b672-30d6fa9a7878 req-9f1cac0d-d301-425c-83fe-e78d147f84e5 service nova] [instance: 564d95eb-81c0-47a5-9979-2318fced06f5] Refreshing network info cache for port 81c08c89-9d11-4321-b1c6-d61800dac599 {{(pid=75229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 09:54:24 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-822a4e7a-7669-41ab-b051-3ef9fc2b4afc tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] Acquiring lock "564d95eb-81c0-47a5-9979-2318fced06f5" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:54:24 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-822a4e7a-7669-41ab-b051-3ef9fc2b4afc tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] Lock "564d95eb-81c0-47a5-9979-2318fced06f5" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:54:24 user nova-compute[75229]: DEBUG nova.objects.instance [None req-822a4e7a-7669-41ab-b051-3ef9fc2b4afc tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] Lazy-loading 'flavor' on Instance uuid 564d95eb-81c0-47a5-9979-2318fced06f5 {{(pid=75229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 09:54:24 user nova-compute[75229]: DEBUG nova.network.neutron [req-e0f74fad-5946-4b57-b672-30d6fa9a7878 req-9f1cac0d-d301-425c-83fe-e78d147f84e5 service nova] [instance: 564d95eb-81c0-47a5-9979-2318fced06f5] Updated VIF entry in instance network info cache for port 81c08c89-9d11-4321-b1c6-d61800dac599. {{(pid=75229) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 09:54:24 user nova-compute[75229]: DEBUG nova.network.neutron [req-e0f74fad-5946-4b57-b672-30d6fa9a7878 req-9f1cac0d-d301-425c-83fe-e78d147f84e5 service nova] [instance: 564d95eb-81c0-47a5-9979-2318fced06f5] Updating instance_info_cache with network_info: [{"id": "81c08c89-9d11-4321-b1c6-d61800dac599", "address": "fa:16:3e:36:da:ae", "network": {"id": "8d89f286-0349-4334-b27a-873f684d3652", "bridge": "br-int", "label": "tempest-TestStampPattern-841799214-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.235", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a196548d9de4e18b8bab9fefdab0861", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81c08c89-9d", "ovs_interfaceid": "81c08c89-9d11-4321-b1c6-d61800dac599", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 09:54:24 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-e0f74fad-5946-4b57-b672-30d6fa9a7878 req-9f1cac0d-d301-425c-83fe-e78d147f84e5 service nova] Releasing lock "refresh_cache-564d95eb-81c0-47a5-9979-2318fced06f5" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 09:54:25 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-822a4e7a-7669-41ab-b051-3ef9fc2b4afc tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] Lock "564d95eb-81c0-47a5-9979-2318fced06f5" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:54:25 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-822a4e7a-7669-41ab-b051-3ef9fc2b4afc tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] Acquiring lock "564d95eb-81c0-47a5-9979-2318fced06f5" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:54:25 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-822a4e7a-7669-41ab-b051-3ef9fc2b4afc tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] Lock "564d95eb-81c0-47a5-9979-2318fced06f5" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:54:25 user nova-compute[75229]: INFO nova.compute.manager [None req-822a4e7a-7669-41ab-b051-3ef9fc2b4afc tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] [instance: 564d95eb-81c0-47a5-9979-2318fced06f5] Attaching volume b81a5866-727c-4e21-952d-a1255d96dcfa to /dev/vdb
Nov 14 09:54:25 user nova-compute[75229]: DEBUG os_brick.utils [None req-822a4e7a-7669-41ab-b051-3ef9fc2b4afc tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 09:54:25 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:54:25 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:54:25 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e687f1f-602f-49bd-b1bd-752169a2dacd]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f1154031c835\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:54:25 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:54:25 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:54:25 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[80900186-7763-45df-ba57-19231bf1d1f8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:54:25 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:54:25 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:54:25 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[2256eaf5-1d3c-4c4e-acdd-4fb54ba5f0cd]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:54:25 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fa1614e-481e-4557-8671-27c54c039ae3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:54:25 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-822a4e7a-7669-41ab-b051-3ef9fc2b4afc tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] Running cmd (subprocess): nvme version {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:54:25 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-822a4e7a-7669-41ab-b051-3ef9fc2b4afc tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] 'nvme version' failed. Not Retrying. {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 09:54:25 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.nvmeof [None req-822a4e7a-7669-41ab-b051-3ef9fc2b4afc tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] nvme not present on system {{(pid=75229) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 09:54:25 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:54:25 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 09:54:25 user nova-compute[75229]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 09:54:25 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[13b2a683-38a8-4f63-8575-a04bdaf87024]: (4, '') {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:54:25 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.lightos [None req-822a4e7a-7669-41ab-b051-3ef9fc2b4afc tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75229) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 09:54:25 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.lightos [None req-822a4e7a-7669-41ab-b051-3ef9fc2b4afc tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75229) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 09:54:25 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.lightos [None req-822a4e7a-7669-41ab-b051-3ef9fc2b4afc tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] LIGHTOS: no hostnqn found. {{(pid=75229) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 09:54:25 user nova-compute[75229]: DEBUG os_brick.utils [None req-822a4e7a-7669-41ab-b051-3ef9fc2b4afc tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] <== get_connector_properties: return (139ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f1154031c835', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 09:54:25 user nova-compute[75229]: DEBUG nova.virt.block_device [None req-822a4e7a-7669-41ab-b051-3ef9fc2b4afc tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] [instance: 564d95eb-81c0-47a5-9979-2318fced06f5] Updating existing volume attachment record: 8be893b3-bbe3-487a-84a7-a2f55647d129 {{(pid=75229) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 09:54:26 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:54:28 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:54:29 user nova-compute[75229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-822a4e7a-7669-41ab-b051-3ef9fc2b4afc tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] [instance: 564d95eb-81c0-47a5-9979-2318fced06f5] Calling os-brick to attach iSCSI Volume {{(pid=75229) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 09:54:29 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-822a4e7a-7669-41ab-b051-3ef9fc2b4afc tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f73f85151b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b81a5866-727c-4e21-952d-a1255d96dcfa', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DkAdIFLE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 09:54:29 user nova-compute[75229]: WARNING os_brick.initiator.connectors.base [None req-822a4e7a-7669-41ab-b051-3ef9fc2b4afc tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 09:54:29 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-822a4e7a-7669-41ab-b051-3ef9fc2b4afc tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 09:54:29 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-822a4e7a-7669-41ab-b051-3ef9fc2b4afc tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.004s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 09:54:29 user nova-compute[75229]: WARNING os_brick.initiator.connectors.base [None req-822a4e7a-7669-41ab-b051-3ef9fc2b4afc tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 09:54:29 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-822a4e7a-7669-41ab-b051-3ef9fc2b4afc tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b81a5866-727c-4e21-952d-a1255d96dcfa" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 09:54:29 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-822a4e7a-7669-41ab-b051-3ef9fc2b4afc tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b81a5866-727c-4e21-952d-a1255d96dcfa" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 09:54:29 user nova-compute[75229]: INFO os_brick.initiator.connectors.iscsi [None req-822a4e7a-7669-41ab-b051-3ef9fc2b4afc tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 09:54:29 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b81a5866-727c-4e21-952d-a1255d96dcfa -p 172.16.0.220:3260 {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:54:29 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b81a5866-727c-4e21-952d-a1255d96dcfa -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:54:29 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[4663485a-642d-4b2d-943f-85e96a3e1900]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:54:29 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-822a4e7a-7669-41ab-b051-3ef9fc2b4afc tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 09:54:29 user nova-compute[75229]:  {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:54:29 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b81a5866-727c-4e21-952d-a1255d96dcfa -p 172.16.0.220:3260 --interface default --op new {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:54:29 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b81a5866-727c-4e21-952d-a1255d96dcfa -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:54:29 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa61f315-25b9-4ce8-a323-684bae337388]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b81a5866-727c-4e21-952d-a1255d96dcfa] added\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:54:29 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-822a4e7a-7669-41ab-b051-3ef9fc2b4afc tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b81a5866-727c-4e21-952d-a1255d96dcfa] added
Nov 14 09:54:29 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:54:29 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b81a5866-727c-4e21-952d-a1255d96dcfa -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:54:29 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b81a5866-727c-4e21-952d-a1255d96dcfa -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:54:29 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[24c81d0a-d37d-42a9-9852-d4476e5788c9]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:54:29 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-822a4e7a-7669-41ab-b051-3ef9fc2b4afc tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:54:29 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b81a5866-727c-4e21-952d-a1255d96dcfa -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:54:29 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b81a5866-727c-4e21-952d-a1255d96dcfa -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:54:29 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[038fc167-bd38-4d72-83b4-9fb8f33b5798]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:54:29 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-822a4e7a-7669-41ab-b051-3ef9fc2b4afc tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:54:29 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b81a5866-727c-4e21-952d-a1255d96dcfa -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DkAdIFLE {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:54:29 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b81a5866-727c-4e21-952d-a1255d96dcfa -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DkAdIFLE" returned: 0 in 0.018s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:54:29 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4064b5e-c41c-4dec-b6de-0147c65254fc]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:54:29 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-822a4e7a-7669-41ab-b051-3ef9fc2b4afc tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DkAdIFLE'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:54:29 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b81a5866-727c-4e21-952d-a1255d96dcfa -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:54:29 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b81a5866-727c-4e21-952d-a1255d96dcfa -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:54:29 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce6aba9c-43d4-4576-94c1-133eb129c4bb]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:54:29 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-822a4e7a-7669-41ab-b051-3ef9fc2b4afc tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:54:29 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:54:29 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:54:29 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[b777119d-0fda-4259-a7e3-3ca8c9a4bdba]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:54:29 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-822a4e7a-7669-41ab-b051-3ef9fc2b4afc tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 14 09:54:29 user nova-compute[75229]:  {{(pid=75229) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 09:54:29 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-822a4e7a-7669-41ab-b051-3ef9fc2b4afc tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 14 09:54:29 user nova-compute[75229]:  {{(pid=75229) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 09:54:29 user nova-compute[75229]: WARNING os_brick.initiator.connectors.iscsi [None req-822a4e7a-7669-41ab-b051-3ef9fc2b4afc tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 14 09:54:29 user nova-compute[75229]: 
Nov 14 09:54:29 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b81a5866-727c-4e21-952d-a1255d96dcfa -p 172.16.0.220:3260 --login {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:54:29 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b81a5866-727c-4e21-952d-a1255d96dcfa -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:54:29 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[7107eab5-39dc-468d-8daa-b5c49e289176]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b81a5866-727c-4e21-952d-a1255d96dcfa, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b81a5866-727c-4e21-952d-a1255d96dcfa, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:54:29 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-822a4e7a-7669-41ab-b051-3ef9fc2b4afc tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b81a5866-727c-4e21-952d-a1255d96dcfa, portal: 172.16.0.220,3260]
Nov 14 09:54:29 user nova-compute[75229]: Login to [iface: default, target: iqn.2010-10.org.openstack:b81a5866-727c-4e21-952d-a1255d96dcfa, portal: 172.16.0.220,3260] successful.
Nov 14 09:54:29 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:54:29 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b81a5866-727c-4e21-952d-a1255d96dcfa -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:54:29 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b81a5866-727c-4e21-952d-a1255d96dcfa -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:54:29 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[73a37d65-6efb-4abd-8e4b-a68d87593971]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:54:29 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-822a4e7a-7669-41ab-b051-3ef9fc2b4afc tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:54:29 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:54:29 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:54:29 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[706b00fa-272f-4ab4-90bf-547e4fdc6c50]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b81a5866-727c-4e21-952d-a1255d96dcfa (non-flash)\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:54:29 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-822a4e7a-7669-41ab-b051-3ef9fc2b4afc tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b81a5866-727c-4e21-952d-a1255d96dcfa (non-flash)
Nov 14 09:54:29 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 09:54:29 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-822a4e7a-7669-41ab-b051-3ef9fc2b4afc tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b81a5866-727c-4e21-952d-a1255d96dcfa (non-flash)
Nov 14 09:54:29 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 09:54:29 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-822a4e7a-7669-41ab-b051-3ef9fc2b4afc tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b81a5866-727c-4e21-952d-a1255d96dcfa" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.256s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 09:54:29 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-822a4e7a-7669-41ab-b051-3ef9fc2b4afc tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] Connected to 172.16.0.220:3260 {{(pid=75229) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 09:54:29 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-822a4e7a-7669-41ab-b051-3ef9fc2b4afc tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] HCTL ('33', '-', '-', 0) found on session 29 with lun 0 {{(pid=75229) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 09:54:29 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-822a4e7a-7669-41ab-b051-3ef9fc2b4afc tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75229) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 09:54:29 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:54:29 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:54:29 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[65e0ac11-0c48-4058-92a0-a4c43b10c30b]: (4, ('- - 0', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:54:29 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-822a4e7a-7669-41ab-b051-3ef9fc2b4afc tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] Searching for a device in session 29 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75229) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 09:54:29 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-822a4e7a-7669-41ab-b051-3ef9fc2b4afc tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:b81a5866-727c-4e21-952d-a1255d96dcfa', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DkAdIFLE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75229) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 09:54:30 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-822a4e7a-7669-41ab-b051-3ef9fc2b4afc tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.286s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 09:54:30 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-822a4e7a-7669-41ab-b051-3ef9fc2b4afc tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] <== connect_volume: return (1290ms) {'type': 'block', 'scsi_wwn': '23264333431643739', 'path': '/dev/sdb'} {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 09:54:30 user nova-compute[75229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-822a4e7a-7669-41ab-b051-3ef9fc2b4afc tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] [instance: 564d95eb-81c0-47a5-9979-2318fced06f5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23264333431643739', 'path': '/dev/sdb'} {{(pid=75229) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 09:54:30 user nova-compute[75229]: DEBUG nova.objects.instance [None req-822a4e7a-7669-41ab-b051-3ef9fc2b4afc tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] Lazy-loading 'flavor' on Instance uuid 564d95eb-81c0-47a5-9979-2318fced06f5 {{(pid=75229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 09:54:30 user nova-compute[75229]: DEBUG nova.virt.libvirt.guest [None req-822a4e7a-7669-41ab-b051-3ef9fc2b4afc tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 09:54:30 user nova-compute[75229]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 09:54:30 user nova-compute[75229]:   <source dev="/dev/sdb"/>
Nov 14 09:54:30 user nova-compute[75229]:   <target dev="vdb" bus="virtio"/>
Nov 14 09:54:30 user nova-compute[75229]:   <serial>b81a5866-727c-4e21-952d-a1255d96dcfa</serial>
Nov 14 09:54:30 user nova-compute[75229]: </disk>
Nov 14 09:54:30 user nova-compute[75229]:  {{(pid=75229) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 09:54:31 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:54:31 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-822a4e7a-7669-41ab-b051-3ef9fc2b4afc tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] No BDM found with device name vda, not building metadata. {{(pid=75229) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 09:54:31 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-822a4e7a-7669-41ab-b051-3ef9fc2b4afc tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75229) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 09:54:31 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-822a4e7a-7669-41ab-b051-3ef9fc2b4afc tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] No VIF found with MAC fa:16:3e:36:da:ae, not building metadata {{(pid=75229) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 09:54:31 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-822a4e7a-7669-41ab-b051-3ef9fc2b4afc tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] Lock "564d95eb-81c0-47a5-9979-2318fced06f5" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.433s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:54:32 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-4196650f-88ee-40d8-9de5-8d887d1dd5e5 tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] Acquiring lock "564d95eb-81c0-47a5-9979-2318fced06f5" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:54:32 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-4196650f-88ee-40d8-9de5-8d887d1dd5e5 tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] Lock "564d95eb-81c0-47a5-9979-2318fced06f5" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:54:32 user nova-compute[75229]: INFO nova.compute.manager [None req-4196650f-88ee-40d8-9de5-8d887d1dd5e5 tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] [instance: 564d95eb-81c0-47a5-9979-2318fced06f5] Detaching volume b81a5866-727c-4e21-952d-a1255d96dcfa
Nov 14 09:54:33 user nova-compute[75229]: INFO nova.virt.block_device [None req-4196650f-88ee-40d8-9de5-8d887d1dd5e5 tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] [instance: 564d95eb-81c0-47a5-9979-2318fced06f5] Attempting to driver detach volume b81a5866-727c-4e21-952d-a1255d96dcfa from mountpoint /dev/vdb
Nov 14 09:54:33 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-4196650f-88ee-40d8-9de5-8d887d1dd5e5 tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] Attempting to detach device vdb from instance 564d95eb-81c0-47a5-9979-2318fced06f5 from the persistent domain config. {{(pid=75229) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 09:54:33 user nova-compute[75229]: DEBUG nova.virt.libvirt.guest [None req-4196650f-88ee-40d8-9de5-8d887d1dd5e5 tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 09:54:33 user nova-compute[75229]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 09:54:33 user nova-compute[75229]:   <source dev="/dev/sdb"/>
Nov 14 09:54:33 user nova-compute[75229]:   <target dev="vdb" bus="virtio"/>
Nov 14 09:54:33 user nova-compute[75229]:   <serial>b81a5866-727c-4e21-952d-a1255d96dcfa</serial>
Nov 14 09:54:33 user nova-compute[75229]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 09:54:33 user nova-compute[75229]: </disk>
Nov 14 09:54:33 user nova-compute[75229]:  {{(pid=75229) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 09:54:33 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-4196650f-88ee-40d8-9de5-8d887d1dd5e5 tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] Successfully detached device vdb from instance 564d95eb-81c0-47a5-9979-2318fced06f5 from the persistent domain config.
Nov 14 09:54:33 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-4196650f-88ee-40d8-9de5-8d887d1dd5e5 tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 564d95eb-81c0-47a5-9979-2318fced06f5 from the live domain config. {{(pid=75229) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 09:54:33 user nova-compute[75229]: DEBUG nova.virt.libvirt.guest [None req-4196650f-88ee-40d8-9de5-8d887d1dd5e5 tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 09:54:33 user nova-compute[75229]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 09:54:33 user nova-compute[75229]:   <source dev="/dev/sdb"/>
Nov 14 09:54:33 user nova-compute[75229]:   <target dev="vdb" bus="virtio"/>
Nov 14 09:54:33 user nova-compute[75229]:   <serial>b81a5866-727c-4e21-952d-a1255d96dcfa</serial>
Nov 14 09:54:33 user nova-compute[75229]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 09:54:33 user nova-compute[75229]: </disk>
Nov 14 09:54:33 user nova-compute[75229]:  {{(pid=75229) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 09:54:33 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:54:33 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-4196650f-88ee-40d8-9de5-8d887d1dd5e5 tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 564d95eb-81c0-47a5-9979-2318fced06f5 {{(pid=75229) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 09:54:34 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:54:34 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-72dca773-8efb-4751-b393-5e715fcd15fa tempest-ServersNegativeTestJSON-1483105767 tempest-ServersNegativeTestJSON-1483105767-project-member] Acquiring lock "cc486509-4506-415c-a2b4-986d05da2317" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:54:34 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-72dca773-8efb-4751-b393-5e715fcd15fa tempest-ServersNegativeTestJSON-1483105767 tempest-ServersNegativeTestJSON-1483105767-project-member] Lock "cc486509-4506-415c-a2b4-986d05da2317" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:54:34 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-72dca773-8efb-4751-b393-5e715fcd15fa tempest-ServersNegativeTestJSON-1483105767 tempest-ServersNegativeTestJSON-1483105767-project-member] Acquiring lock "cc486509-4506-415c-a2b4-986d05da2317-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:54:34 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-72dca773-8efb-4751-b393-5e715fcd15fa tempest-ServersNegativeTestJSON-1483105767 tempest-ServersNegativeTestJSON-1483105767-project-member] Lock "cc486509-4506-415c-a2b4-986d05da2317-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:54:34 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-72dca773-8efb-4751-b393-5e715fcd15fa tempest-ServersNegativeTestJSON-1483105767 tempest-ServersNegativeTestJSON-1483105767-project-member] Lock "cc486509-4506-415c-a2b4-986d05da2317-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:54:34 user nova-compute[75229]: INFO nova.compute.manager [None req-72dca773-8efb-4751-b393-5e715fcd15fa tempest-ServersNegativeTestJSON-1483105767 tempest-ServersNegativeTestJSON-1483105767-project-member] [instance: cc486509-4506-415c-a2b4-986d05da2317] Terminating instance
Nov 14 09:54:34 user nova-compute[75229]: DEBUG nova.compute.manager [None req-72dca773-8efb-4751-b393-5e715fcd15fa tempest-ServersNegativeTestJSON-1483105767 tempest-ServersNegativeTestJSON-1483105767-project-member] [instance: cc486509-4506-415c-a2b4-986d05da2317] Start destroying the instance on the hypervisor. {{(pid=75229) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 09:54:34 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:54:34 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:54:35 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:54:35 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:54:35 user nova-compute[75229]: DEBUG nova.compute.manager [req-dbaef3a7-2077-4bed-abd1-282b1b8f4f39 req-e0159df3-5a0a-414d-b236-2a72891a3695 service nova] [instance: cc486509-4506-415c-a2b4-986d05da2317] Received event network-vif-unplugged-3091254d-fbc8-4c82-9e16-3afe6485f1f6 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:54:35 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-dbaef3a7-2077-4bed-abd1-282b1b8f4f39 req-e0159df3-5a0a-414d-b236-2a72891a3695 service nova] Acquiring lock "cc486509-4506-415c-a2b4-986d05da2317-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:54:35 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-dbaef3a7-2077-4bed-abd1-282b1b8f4f39 req-e0159df3-5a0a-414d-b236-2a72891a3695 service nova] Lock "cc486509-4506-415c-a2b4-986d05da2317-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:54:35 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-dbaef3a7-2077-4bed-abd1-282b1b8f4f39 req-e0159df3-5a0a-414d-b236-2a72891a3695 service nova] Lock "cc486509-4506-415c-a2b4-986d05da2317-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:54:35 user nova-compute[75229]: DEBUG nova.compute.manager [req-dbaef3a7-2077-4bed-abd1-282b1b8f4f39 req-e0159df3-5a0a-414d-b236-2a72891a3695 service nova] [instance: cc486509-4506-415c-a2b4-986d05da2317] No waiting events found dispatching network-vif-unplugged-3091254d-fbc8-4c82-9e16-3afe6485f1f6 {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 09:54:35 user nova-compute[75229]: DEBUG nova.compute.manager [req-dbaef3a7-2077-4bed-abd1-282b1b8f4f39 req-e0159df3-5a0a-414d-b236-2a72891a3695 service nova] [instance: cc486509-4506-415c-a2b4-986d05da2317] Received event network-vif-unplugged-3091254d-fbc8-4c82-9e16-3afe6485f1f6 for instance with task_state deleting. {{(pid=75229) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 09:54:35 user nova-compute[75229]: INFO nova.virt.libvirt.driver [-] [instance: cc486509-4506-415c-a2b4-986d05da2317] Instance destroyed successfully.
Nov 14 09:54:35 user nova-compute[75229]: DEBUG nova.objects.instance [None req-72dca773-8efb-4751-b393-5e715fcd15fa tempest-ServersNegativeTestJSON-1483105767 tempest-ServersNegativeTestJSON-1483105767-project-member] Lazy-loading 'resources' on Instance uuid cc486509-4506-415c-a2b4-986d05da2317 {{(pid=75229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 09:54:35 user nova-compute[75229]: DEBUG nova.virt.libvirt.vif [None req-72dca773-8efb-4751-b393-5e715fcd15fa tempest-ServersNegativeTestJSON-1483105767 tempest-ServersNegativeTestJSON-1483105767-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T09:52:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1408502155',display_name='tempest-ServersNegativeTestJSON-server-1408502155',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1408502155',id=28,image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-14T09:52:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='133a5fa644c24636bd2b334d7b95e4c3',ramdisk_id='',reservation_id='r-jm0q5c82',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-1483105767',owner_user_name='tempest-ServersNegativeTestJSON-1483105767-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T09:52:51Z,user_data=None,user_id='a479b16af2894f6388c73aaaa744ec6b',uuid=cc486509-4506-415c-a2b4-986d05da2317,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3091254d-fbc8-4c82-9e16-3afe6485f1f6", "address": "fa:16:3e:29:e0:3c", "network": {"id": "b841fceb-4765-4e8e-b800-8651dcb1d867", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1867189200-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "133a5fa644c24636bd2b334d7b95e4c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3091254d-fb", "ovs_interfaceid": "3091254d-fbc8-4c82-9e16-3afe6485f1f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 09:54:35 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-72dca773-8efb-4751-b393-5e715fcd15fa tempest-ServersNegativeTestJSON-1483105767 tempest-ServersNegativeTestJSON-1483105767-project-member] Converting VIF {"id": "3091254d-fbc8-4c82-9e16-3afe6485f1f6", "address": "fa:16:3e:29:e0:3c", "network": {"id": "b841fceb-4765-4e8e-b800-8651dcb1d867", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1867189200-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "133a5fa644c24636bd2b334d7b95e4c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3091254d-fb", "ovs_interfaceid": "3091254d-fbc8-4c82-9e16-3afe6485f1f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 09:54:35 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-72dca773-8efb-4751-b393-5e715fcd15fa tempest-ServersNegativeTestJSON-1483105767 tempest-ServersNegativeTestJSON-1483105767-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:29:e0:3c,bridge_name='br-int',has_traffic_filtering=True,id=3091254d-fbc8-4c82-9e16-3afe6485f1f6,network=Network(b841fceb-4765-4e8e-b800-8651dcb1d867),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3091254d-fb') {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 09:54:35 user nova-compute[75229]: DEBUG os_vif [None req-72dca773-8efb-4751-b393-5e715fcd15fa tempest-ServersNegativeTestJSON-1483105767 tempest-ServersNegativeTestJSON-1483105767-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:29:e0:3c,bridge_name='br-int',has_traffic_filtering=True,id=3091254d-fbc8-4c82-9e16-3afe6485f1f6,network=Network(b841fceb-4765-4e8e-b800-8651dcb1d867),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3091254d-fb') {{(pid=75229) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 09:54:35 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:54:35 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3091254d-fb, bridge=br-int, if_exists=True) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:54:35 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:54:35 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 09:54:35 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:54:35 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5020cc42-36ab-4d12-a516-747b030949d5) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:54:35 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:54:35 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:54:35 user nova-compute[75229]: INFO os_vif [None req-72dca773-8efb-4751-b393-5e715fcd15fa tempest-ServersNegativeTestJSON-1483105767 tempest-ServersNegativeTestJSON-1483105767-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:29:e0:3c,bridge_name='br-int',has_traffic_filtering=True,id=3091254d-fbc8-4c82-9e16-3afe6485f1f6,network=Network(b841fceb-4765-4e8e-b800-8651dcb1d867),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3091254d-fb')
Nov 14 09:54:35 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-72dca773-8efb-4751-b393-5e715fcd15fa tempest-ServersNegativeTestJSON-1483105767 tempest-ServersNegativeTestJSON-1483105767-project-member] [instance: cc486509-4506-415c-a2b4-986d05da2317] Deleting instance files /opt/stack/data/nova/instances/cc486509-4506-415c-a2b4-986d05da2317_del
Nov 14 09:54:35 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-72dca773-8efb-4751-b393-5e715fcd15fa tempest-ServersNegativeTestJSON-1483105767 tempest-ServersNegativeTestJSON-1483105767-project-member] [instance: cc486509-4506-415c-a2b4-986d05da2317] Deletion of /opt/stack/data/nova/instances/cc486509-4506-415c-a2b4-986d05da2317_del complete
Nov 14 09:54:35 user nova-compute[75229]: INFO nova.compute.manager [None req-72dca773-8efb-4751-b393-5e715fcd15fa tempest-ServersNegativeTestJSON-1483105767 tempest-ServersNegativeTestJSON-1483105767-project-member] [instance: cc486509-4506-415c-a2b4-986d05da2317] Took 0.68 seconds to destroy the instance on the hypervisor.
Nov 14 09:54:35 user nova-compute[75229]: DEBUG oslo.service.loopingcall [None req-72dca773-8efb-4751-b393-5e715fcd15fa tempest-ServersNegativeTestJSON-1483105767 tempest-ServersNegativeTestJSON-1483105767-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75229) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 09:54:35 user nova-compute[75229]: DEBUG nova.compute.manager [-] [instance: cc486509-4506-415c-a2b4-986d05da2317] Deallocating network for instance {{(pid=75229) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 09:54:35 user nova-compute[75229]: DEBUG nova.network.neutron [-] [instance: cc486509-4506-415c-a2b4-986d05da2317] deallocate_for_instance() {{(pid=75229) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 09:54:36 user nova-compute[75229]: DEBUG nova.network.neutron [-] [instance: cc486509-4506-415c-a2b4-986d05da2317] Updating instance_info_cache with network_info: [] {{(pid=75229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 09:54:36 user nova-compute[75229]: INFO nova.compute.manager [-] [instance: cc486509-4506-415c-a2b4-986d05da2317] Took 0.49 seconds to deallocate network for instance.
Nov 14 09:54:36 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-72dca773-8efb-4751-b393-5e715fcd15fa tempest-ServersNegativeTestJSON-1483105767 tempest-ServersNegativeTestJSON-1483105767-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:54:36 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-72dca773-8efb-4751-b393-5e715fcd15fa tempest-ServersNegativeTestJSON-1483105767 tempest-ServersNegativeTestJSON-1483105767-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:54:36 user nova-compute[75229]: DEBUG nova.compute.manager [req-7532c9e1-b3e5-4156-88cb-1a5b56341ee1 req-4d311403-1869-4832-8c27-ea02aa00fb23 service nova] [instance: cc486509-4506-415c-a2b4-986d05da2317] Received event network-vif-deleted-3091254d-fbc8-4c82-9e16-3afe6485f1f6 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:54:36 user nova-compute[75229]: DEBUG nova.compute.provider_tree [None req-72dca773-8efb-4751-b393-5e715fcd15fa tempest-ServersNegativeTestJSON-1483105767 tempest-ServersNegativeTestJSON-1483105767-project-member] Inventory has not changed in ProviderTree for provider: d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 {{(pid=75229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 09:54:36 user nova-compute[75229]: DEBUG nova.scheduler.client.report [None req-72dca773-8efb-4751-b393-5e715fcd15fa tempest-ServersNegativeTestJSON-1483105767 tempest-ServersNegativeTestJSON-1483105767-project-member] Inventory has not changed for provider d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 09:54:36 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-72dca773-8efb-4751-b393-5e715fcd15fa tempest-ServersNegativeTestJSON-1483105767 tempest-ServersNegativeTestJSON-1483105767-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.350s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:54:36 user nova-compute[75229]: INFO nova.scheduler.client.report [None req-72dca773-8efb-4751-b393-5e715fcd15fa tempest-ServersNegativeTestJSON-1483105767 tempest-ServersNegativeTestJSON-1483105767-project-member] Deleted allocations for instance cc486509-4506-415c-a2b4-986d05da2317
Nov 14 09:54:36 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-72dca773-8efb-4751-b393-5e715fcd15fa tempest-ServersNegativeTestJSON-1483105767 tempest-ServersNegativeTestJSON-1483105767-project-member] Lock "cc486509-4506-415c-a2b4-986d05da2317" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.721s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:54:37 user nova-compute[75229]: DEBUG nova.compute.manager [req-5a0eed5d-0841-43f0-9abc-a4d75a4fd23c req-221a8440-d6ac-45db-ae9e-2aa652676421 service nova] [instance: cc486509-4506-415c-a2b4-986d05da2317] Received event network-vif-plugged-3091254d-fbc8-4c82-9e16-3afe6485f1f6 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:54:37 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-5a0eed5d-0841-43f0-9abc-a4d75a4fd23c req-221a8440-d6ac-45db-ae9e-2aa652676421 service nova] Acquiring lock "cc486509-4506-415c-a2b4-986d05da2317-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:54:37 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-5a0eed5d-0841-43f0-9abc-a4d75a4fd23c req-221a8440-d6ac-45db-ae9e-2aa652676421 service nova] Lock "cc486509-4506-415c-a2b4-986d05da2317-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:54:37 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-5a0eed5d-0841-43f0-9abc-a4d75a4fd23c req-221a8440-d6ac-45db-ae9e-2aa652676421 service nova] Lock "cc486509-4506-415c-a2b4-986d05da2317-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:54:37 user nova-compute[75229]: DEBUG nova.compute.manager [req-5a0eed5d-0841-43f0-9abc-a4d75a4fd23c req-221a8440-d6ac-45db-ae9e-2aa652676421 service nova] [instance: cc486509-4506-415c-a2b4-986d05da2317] No waiting events found dispatching network-vif-plugged-3091254d-fbc8-4c82-9e16-3afe6485f1f6 {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 09:54:37 user nova-compute[75229]: WARNING nova.compute.manager [req-5a0eed5d-0841-43f0-9abc-a4d75a4fd23c req-221a8440-d6ac-45db-ae9e-2aa652676421 service nova] [instance: cc486509-4506-415c-a2b4-986d05da2317] Received unexpected event network-vif-plugged-3091254d-fbc8-4c82-9e16-3afe6485f1f6 for instance with vm_state deleted and task_state None.
Nov 14 09:54:38 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-c29d8e44-fb9c-4046-a0d4-c53d8f023dea tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] Acquiring lock "94e2b266-2fe3-481a-bb1e-24f835a79ddf" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:54:38 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-c29d8e44-fb9c-4046-a0d4-c53d8f023dea tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] Lock "94e2b266-2fe3-481a-bb1e-24f835a79ddf" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:54:38 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-c29d8e44-fb9c-4046-a0d4-c53d8f023dea tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] Acquiring lock "94e2b266-2fe3-481a-bb1e-24f835a79ddf-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:54:38 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-c29d8e44-fb9c-4046-a0d4-c53d8f023dea tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] Lock "94e2b266-2fe3-481a-bb1e-24f835a79ddf-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:54:38 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-c29d8e44-fb9c-4046-a0d4-c53d8f023dea tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] Lock "94e2b266-2fe3-481a-bb1e-24f835a79ddf-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:54:38 user nova-compute[75229]: INFO nova.compute.manager [None req-c29d8e44-fb9c-4046-a0d4-c53d8f023dea tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] [instance: 94e2b266-2fe3-481a-bb1e-24f835a79ddf] Terminating instance
Nov 14 09:54:38 user nova-compute[75229]: DEBUG nova.compute.manager [None req-c29d8e44-fb9c-4046-a0d4-c53d8f023dea tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] [instance: 94e2b266-2fe3-481a-bb1e-24f835a79ddf] Start destroying the instance on the hypervisor. {{(pid=75229) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 09:54:38 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:54:38 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:54:38 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:54:38 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:54:38 user nova-compute[75229]: DEBUG nova.compute.manager [req-64ae22c2-8b9a-4456-819d-0d500b463916 req-4d1072cd-d2e0-4a5d-9ec3-ac0018b838f7 service nova] [instance: 94e2b266-2fe3-481a-bb1e-24f835a79ddf] Received event network-vif-unplugged-be0352bd-a149-4097-b049-8445f895d993 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:54:38 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-64ae22c2-8b9a-4456-819d-0d500b463916 req-4d1072cd-d2e0-4a5d-9ec3-ac0018b838f7 service nova] Acquiring lock "94e2b266-2fe3-481a-bb1e-24f835a79ddf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:54:38 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-64ae22c2-8b9a-4456-819d-0d500b463916 req-4d1072cd-d2e0-4a5d-9ec3-ac0018b838f7 service nova] Lock "94e2b266-2fe3-481a-bb1e-24f835a79ddf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:54:38 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-64ae22c2-8b9a-4456-819d-0d500b463916 req-4d1072cd-d2e0-4a5d-9ec3-ac0018b838f7 service nova] Lock "94e2b266-2fe3-481a-bb1e-24f835a79ddf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:54:38 user nova-compute[75229]: DEBUG nova.compute.manager [req-64ae22c2-8b9a-4456-819d-0d500b463916 req-4d1072cd-d2e0-4a5d-9ec3-ac0018b838f7 service nova] [instance: 94e2b266-2fe3-481a-bb1e-24f835a79ddf] No waiting events found dispatching network-vif-unplugged-be0352bd-a149-4097-b049-8445f895d993 {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 09:54:38 user nova-compute[75229]: DEBUG nova.compute.manager [req-64ae22c2-8b9a-4456-819d-0d500b463916 req-4d1072cd-d2e0-4a5d-9ec3-ac0018b838f7 service nova] [instance: 94e2b266-2fe3-481a-bb1e-24f835a79ddf] Received event network-vif-unplugged-be0352bd-a149-4097-b049-8445f895d993 for instance with task_state deleting. {{(pid=75229) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 09:54:39 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:54:39 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:54:39 user nova-compute[75229]: INFO nova.virt.libvirt.driver [-] [instance: 94e2b266-2fe3-481a-bb1e-24f835a79ddf] Instance destroyed successfully.
Nov 14 09:54:39 user nova-compute[75229]: DEBUG nova.objects.instance [None req-c29d8e44-fb9c-4046-a0d4-c53d8f023dea tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] Lazy-loading 'resources' on Instance uuid 94e2b266-2fe3-481a-bb1e-24f835a79ddf {{(pid=75229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 09:54:39 user nova-compute[75229]: DEBUG nova.virt.libvirt.vif [None req-c29d8e44-fb9c-4046-a0d4-c53d8f023dea tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T09:49:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1624451670',display_name='tempest-TestMinimumBasicScenario-server-1624451670',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1624451670',id=21,image_ref='efab0bf3-e7ec-4953-8a54-2c5bb0a3baf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHLGyqy66WiitWeWLqujQDO7dBN6UvLDY3R5qVL6duh6Uqwoj1b+NfY0QC2GN9l+L9VeminYuv9MwxoPfEZ4V+l+UlMp+6JyFrnRt14AE/ia/51KfvySly2NYmpfm1yFaw==',key_name='tempest-TestMinimumBasicScenario-185710581',keypairs=<?>,launch_index=0,launched_at=2023-11-14T09:49:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4a6157b9827b44d2bab197220b635fd3',ramdisk_id='',reservation_id='r-0ro875yg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='efab0bf3-e7ec-4953-8a54-2c5bb0a3baf6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-284611138',owner_user_name='tempest-TestMinimumBasicScenario-284611138-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T09:52:00Z,user_data=None,user_id='3603da40a87149478458797ea9aedfe2',uuid=94e2b266-2fe3-481a-bb1e-24f835a79ddf,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "be0352bd-a149-4097-b049-8445f895d993", "address": "fa:16:3e:dc:24:42", "network": {"id": "1687d918-9f70-4099-b44c-97f92f90e6ff", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2074208460-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a6157b9827b44d2bab197220b635fd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe0352bd-a1", "ovs_interfaceid": "be0352bd-a149-4097-b049-8445f895d993", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 09:54:39 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-c29d8e44-fb9c-4046-a0d4-c53d8f023dea tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] Converting VIF {"id": "be0352bd-a149-4097-b049-8445f895d993", "address": "fa:16:3e:dc:24:42", "network": {"id": "1687d918-9f70-4099-b44c-97f92f90e6ff", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2074208460-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a6157b9827b44d2bab197220b635fd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe0352bd-a1", "ovs_interfaceid": "be0352bd-a149-4097-b049-8445f895d993", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 09:54:39 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-c29d8e44-fb9c-4046-a0d4-c53d8f023dea tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:dc:24:42,bridge_name='br-int',has_traffic_filtering=True,id=be0352bd-a149-4097-b049-8445f895d993,network=Network(1687d918-9f70-4099-b44c-97f92f90e6ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe0352bd-a1') {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 09:54:39 user nova-compute[75229]: DEBUG os_vif [None req-c29d8e44-fb9c-4046-a0d4-c53d8f023dea tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:dc:24:42,bridge_name='br-int',has_traffic_filtering=True,id=be0352bd-a149-4097-b049-8445f895d993,network=Network(1687d918-9f70-4099-b44c-97f92f90e6ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe0352bd-a1') {{(pid=75229) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 09:54:39 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:54:39 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbe0352bd-a1, bridge=br-int, if_exists=True) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:54:39 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:54:39 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 09:54:39 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:54:39 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f4918cfc-5d13-4b05-9085-da561f9874dc) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:54:39 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:54:39 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 09:54:39 user nova-compute[75229]: INFO os_vif [None req-c29d8e44-fb9c-4046-a0d4-c53d8f023dea tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:dc:24:42,bridge_name='br-int',has_traffic_filtering=True,id=be0352bd-a149-4097-b049-8445f895d993,network=Network(1687d918-9f70-4099-b44c-97f92f90e6ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe0352bd-a1')
Nov 14 09:54:39 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-c29d8e44-fb9c-4046-a0d4-c53d8f023dea tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] [instance: 94e2b266-2fe3-481a-bb1e-24f835a79ddf] Deleting instance files /opt/stack/data/nova/instances/94e2b266-2fe3-481a-bb1e-24f835a79ddf_del
Nov 14 09:54:39 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-c29d8e44-fb9c-4046-a0d4-c53d8f023dea tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] [instance: 94e2b266-2fe3-481a-bb1e-24f835a79ddf] Deletion of /opt/stack/data/nova/instances/94e2b266-2fe3-481a-bb1e-24f835a79ddf_del complete
Nov 14 09:54:39 user nova-compute[75229]: INFO nova.compute.manager [None req-c29d8e44-fb9c-4046-a0d4-c53d8f023dea tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] [instance: 94e2b266-2fe3-481a-bb1e-24f835a79ddf] Took 0.87 seconds to destroy the instance on the hypervisor.
Nov 14 09:54:39 user nova-compute[75229]: DEBUG oslo.service.loopingcall [None req-c29d8e44-fb9c-4046-a0d4-c53d8f023dea tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75229) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 09:54:39 user nova-compute[75229]: DEBUG nova.compute.manager [-] [instance: 94e2b266-2fe3-481a-bb1e-24f835a79ddf] Deallocating network for instance {{(pid=75229) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 09:54:39 user nova-compute[75229]: DEBUG nova.network.neutron [-] [instance: 94e2b266-2fe3-481a-bb1e-24f835a79ddf] deallocate_for_instance() {{(pid=75229) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 09:54:39 user nova-compute[75229]: DEBUG nova.network.neutron [-] [instance: 94e2b266-2fe3-481a-bb1e-24f835a79ddf] Updating instance_info_cache with network_info: [] {{(pid=75229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 09:54:39 user nova-compute[75229]: INFO nova.compute.manager [-] [instance: 94e2b266-2fe3-481a-bb1e-24f835a79ddf] Took 0.46 seconds to deallocate network for instance.
Nov 14 09:54:39 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-c29d8e44-fb9c-4046-a0d4-c53d8f023dea tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:54:39 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-c29d8e44-fb9c-4046-a0d4-c53d8f023dea tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:54:40 user nova-compute[75229]: DEBUG nova.compute.provider_tree [None req-c29d8e44-fb9c-4046-a0d4-c53d8f023dea tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] Inventory has not changed in ProviderTree for provider: d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 {{(pid=75229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 09:54:40 user nova-compute[75229]: DEBUG nova.scheduler.client.report [None req-c29d8e44-fb9c-4046-a0d4-c53d8f023dea tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] Inventory has not changed for provider d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 09:54:40 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-c29d8e44-fb9c-4046-a0d4-c53d8f023dea tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.287s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:54:40 user nova-compute[75229]: INFO nova.scheduler.client.report [None req-c29d8e44-fb9c-4046-a0d4-c53d8f023dea tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] Deleted allocations for instance 94e2b266-2fe3-481a-bb1e-24f835a79ddf
Nov 14 09:54:40 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-c29d8e44-fb9c-4046-a0d4-c53d8f023dea tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] Lock "94e2b266-2fe3-481a-bb1e-24f835a79ddf" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.805s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:54:40 user nova-compute[75229]: DEBUG nova.compute.manager [req-e95b2935-cdf4-4005-88d0-753012360b08 req-8957713e-5467-48d6-9c7a-f411172f3079 service nova] [instance: 94e2b266-2fe3-481a-bb1e-24f835a79ddf] Received event network-vif-plugged-be0352bd-a149-4097-b049-8445f895d993 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:54:40 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-e95b2935-cdf4-4005-88d0-753012360b08 req-8957713e-5467-48d6-9c7a-f411172f3079 service nova] Acquiring lock "94e2b266-2fe3-481a-bb1e-24f835a79ddf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:54:40 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-e95b2935-cdf4-4005-88d0-753012360b08 req-8957713e-5467-48d6-9c7a-f411172f3079 service nova] Lock "94e2b266-2fe3-481a-bb1e-24f835a79ddf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:54:40 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-e95b2935-cdf4-4005-88d0-753012360b08 req-8957713e-5467-48d6-9c7a-f411172f3079 service nova] Lock "94e2b266-2fe3-481a-bb1e-24f835a79ddf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:54:40 user nova-compute[75229]: DEBUG nova.compute.manager [req-e95b2935-cdf4-4005-88d0-753012360b08 req-8957713e-5467-48d6-9c7a-f411172f3079 service nova] [instance: 94e2b266-2fe3-481a-bb1e-24f835a79ddf] No waiting events found dispatching network-vif-plugged-be0352bd-a149-4097-b049-8445f895d993 {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 09:54:40 user nova-compute[75229]: WARNING nova.compute.manager [req-e95b2935-cdf4-4005-88d0-753012360b08 req-8957713e-5467-48d6-9c7a-f411172f3079 service nova] [instance: 94e2b266-2fe3-481a-bb1e-24f835a79ddf] Received unexpected event network-vif-plugged-be0352bd-a149-4097-b049-8445f895d993 for instance with vm_state deleted and task_state None.
Nov 14 09:54:40 user nova-compute[75229]: DEBUG nova.compute.manager [req-e95b2935-cdf4-4005-88d0-753012360b08 req-8957713e-5467-48d6-9c7a-f411172f3079 service nova] [instance: 94e2b266-2fe3-481a-bb1e-24f835a79ddf] Received event network-vif-deleted-be0352bd-a149-4097-b049-8445f895d993 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:54:41 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-fc1ce62d-a583-41bd-85d8-615e64c05853 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Acquiring lock "57da589c-863c-42a8-8802-314a499ebc29" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:54:41 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-fc1ce62d-a583-41bd-85d8-615e64c05853 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Lock "57da589c-863c-42a8-8802-314a499ebc29" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:54:41 user nova-compute[75229]: DEBUG nova.compute.manager [None req-fc1ce62d-a583-41bd-85d8-615e64c05853 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] [instance: 57da589c-863c-42a8-8802-314a499ebc29] Starting instance... {{(pid=75229) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 09:54:41 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-fc1ce62d-a583-41bd-85d8-615e64c05853 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:54:41 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-fc1ce62d-a583-41bd-85d8-615e64c05853 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:54:41 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-fc1ce62d-a583-41bd-85d8-615e64c05853 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75229) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 09:54:41 user nova-compute[75229]: INFO nova.compute.claims [None req-fc1ce62d-a583-41bd-85d8-615e64c05853 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] [instance: 57da589c-863c-42a8-8802-314a499ebc29] Claim successful on node user
Nov 14 09:54:42 user nova-compute[75229]: DEBUG nova.compute.provider_tree [None req-fc1ce62d-a583-41bd-85d8-615e64c05853 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Inventory has not changed in ProviderTree for provider: d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 {{(pid=75229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 09:54:42 user nova-compute[75229]: DEBUG nova.scheduler.client.report [None req-fc1ce62d-a583-41bd-85d8-615e64c05853 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Inventory has not changed for provider d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 09:54:42 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-fc1ce62d-a583-41bd-85d8-615e64c05853 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.349s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:54:42 user nova-compute[75229]: DEBUG nova.compute.manager [None req-fc1ce62d-a583-41bd-85d8-615e64c05853 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] [instance: 57da589c-863c-42a8-8802-314a499ebc29] Start building networks asynchronously for instance. {{(pid=75229) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 09:54:42 user nova-compute[75229]: DEBUG nova.compute.manager [None req-fc1ce62d-a583-41bd-85d8-615e64c05853 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] [instance: 57da589c-863c-42a8-8802-314a499ebc29] Allocating IP information in the background. {{(pid=75229) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 09:54:42 user nova-compute[75229]: DEBUG nova.network.neutron [None req-fc1ce62d-a583-41bd-85d8-615e64c05853 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] [instance: 57da589c-863c-42a8-8802-314a499ebc29] allocate_for_instance() {{(pid=75229) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 09:54:42 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-fc1ce62d-a583-41bd-85d8-615e64c05853 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] [instance: 57da589c-863c-42a8-8802-314a499ebc29] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 09:54:42 user nova-compute[75229]: DEBUG nova.compute.manager [None req-fc1ce62d-a583-41bd-85d8-615e64c05853 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] [instance: 57da589c-863c-42a8-8802-314a499ebc29] Start building block device mappings for instance. {{(pid=75229) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 09:54:42 user nova-compute[75229]: DEBUG nova.policy [None req-fc1ce62d-a583-41bd-85d8-615e64c05853 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3b8313e365eb4970a58c412768e959bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b8d48c38c7344f5b12d0ed5b9392554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75229) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 09:54:42 user nova-compute[75229]: DEBUG nova.compute.manager [None req-fc1ce62d-a583-41bd-85d8-615e64c05853 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] [instance: 57da589c-863c-42a8-8802-314a499ebc29] Start spawning the instance on the hypervisor. {{(pid=75229) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 09:54:42 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-fc1ce62d-a583-41bd-85d8-615e64c05853 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] [instance: 57da589c-863c-42a8-8802-314a499ebc29] Creating instance directory {{(pid=75229) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 09:54:42 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-fc1ce62d-a583-41bd-85d8-615e64c05853 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] [instance: 57da589c-863c-42a8-8802-314a499ebc29] Creating image(s)
Nov 14 09:54:42 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-fc1ce62d-a583-41bd-85d8-615e64c05853 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Acquiring lock "/opt/stack/data/nova/instances/57da589c-863c-42a8-8802-314a499ebc29/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:54:42 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-fc1ce62d-a583-41bd-85d8-615e64c05853 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Lock "/opt/stack/data/nova/instances/57da589c-863c-42a8-8802-314a499ebc29/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:54:42 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-fc1ce62d-a583-41bd-85d8-615e64c05853 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Lock "/opt/stack/data/nova/instances/57da589c-863c-42a8-8802-314a499ebc29/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:54:42 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-fc1ce62d-a583-41bd-85d8-615e64c05853 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6 --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:54:42 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-fc1ce62d-a583-41bd-85d8-615e64c05853 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6 --force-share --output=json" returned: 0 in 0.175s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:54:42 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-fc1ce62d-a583-41bd-85d8-615e64c05853 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Acquiring lock "4f30e3fe703d2381679612a57b1fb80a467f60b6" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:54:42 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-fc1ce62d-a583-41bd-85d8-615e64c05853 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Lock "4f30e3fe703d2381679612a57b1fb80a467f60b6" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:54:42 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-fc1ce62d-a583-41bd-85d8-615e64c05853 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6 --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:54:42 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-fc1ce62d-a583-41bd-85d8-615e64c05853 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6 --force-share --output=json" returned: 0 in 0.174s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:54:42 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-fc1ce62d-a583-41bd-85d8-615e64c05853 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6,backing_fmt=raw /opt/stack/data/nova/instances/57da589c-863c-42a8-8802-314a499ebc29/disk 1073741824 {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:54:42 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-fc1ce62d-a583-41bd-85d8-615e64c05853 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6,backing_fmt=raw /opt/stack/data/nova/instances/57da589c-863c-42a8-8802-314a499ebc29/disk 1073741824" returned: 0 in 0.075s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:54:42 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-fc1ce62d-a583-41bd-85d8-615e64c05853 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Lock "4f30e3fe703d2381679612a57b1fb80a467f60b6" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.257s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:54:42 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-fc1ce62d-a583-41bd-85d8-615e64c05853 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6 --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:54:42 user nova-compute[75229]: DEBUG nova.network.neutron [None req-fc1ce62d-a583-41bd-85d8-615e64c05853 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] [instance: 57da589c-863c-42a8-8802-314a499ebc29] Successfully created port: b570f667-506d-47ce-b69b-d4416514ef63 {{(pid=75229) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 09:54:43 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-fc1ce62d-a583-41bd-85d8-615e64c05853 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6 --force-share --output=json" returned: 0 in 0.196s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:54:43 user nova-compute[75229]: DEBUG nova.virt.disk.api [None req-fc1ce62d-a583-41bd-85d8-615e64c05853 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Checking if we can resize image /opt/stack/data/nova/instances/57da589c-863c-42a8-8802-314a499ebc29/disk. size=1073741824 {{(pid=75229) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 09:54:43 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-fc1ce62d-a583-41bd-85d8-615e64c05853 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57da589c-863c-42a8-8802-314a499ebc29/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:54:43 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-fc1ce62d-a583-41bd-85d8-615e64c05853 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57da589c-863c-42a8-8802-314a499ebc29/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:54:43 user nova-compute[75229]: DEBUG nova.virt.disk.api [None req-fc1ce62d-a583-41bd-85d8-615e64c05853 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Cannot resize image /opt/stack/data/nova/instances/57da589c-863c-42a8-8802-314a499ebc29/disk to a smaller size. {{(pid=75229) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 09:54:43 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-fc1ce62d-a583-41bd-85d8-615e64c05853 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] [instance: 57da589c-863c-42a8-8802-314a499ebc29] Created local disks {{(pid=75229) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 09:54:43 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-fc1ce62d-a583-41bd-85d8-615e64c05853 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] [instance: 57da589c-863c-42a8-8802-314a499ebc29] Ensure instance console log exists: /opt/stack/data/nova/instances/57da589c-863c-42a8-8802-314a499ebc29/console.log {{(pid=75229) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 09:54:43 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-fc1ce62d-a583-41bd-85d8-615e64c05853 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:54:43 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-fc1ce62d-a583-41bd-85d8-615e64c05853 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:54:43 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-fc1ce62d-a583-41bd-85d8-615e64c05853 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:54:43 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:54:43 user nova-compute[75229]: DEBUG nova.network.neutron [None req-fc1ce62d-a583-41bd-85d8-615e64c05853 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] [instance: 57da589c-863c-42a8-8802-314a499ebc29] Successfully updated port: b570f667-506d-47ce-b69b-d4416514ef63 {{(pid=75229) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 09:54:43 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-fc1ce62d-a583-41bd-85d8-615e64c05853 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Acquiring lock "refresh_cache-57da589c-863c-42a8-8802-314a499ebc29" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 09:54:43 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-fc1ce62d-a583-41bd-85d8-615e64c05853 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Acquired lock "refresh_cache-57da589c-863c-42a8-8802-314a499ebc29" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 09:54:43 user nova-compute[75229]: DEBUG nova.network.neutron [None req-fc1ce62d-a583-41bd-85d8-615e64c05853 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] [instance: 57da589c-863c-42a8-8802-314a499ebc29] Building network info cache for instance {{(pid=75229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 09:54:43 user nova-compute[75229]: DEBUG nova.compute.manager [req-6a88eeb0-2412-443a-8e09-8fadc69d1bb0 req-3f774a1d-a00b-4091-a691-1d6c2a4bd23d service nova] [instance: 57da589c-863c-42a8-8802-314a499ebc29] Received event network-changed-b570f667-506d-47ce-b69b-d4416514ef63 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:54:43 user nova-compute[75229]: DEBUG nova.compute.manager [req-6a88eeb0-2412-443a-8e09-8fadc69d1bb0 req-3f774a1d-a00b-4091-a691-1d6c2a4bd23d service nova] [instance: 57da589c-863c-42a8-8802-314a499ebc29] Refreshing instance network info cache due to event network-changed-b570f667-506d-47ce-b69b-d4416514ef63. {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 09:54:43 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-6a88eeb0-2412-443a-8e09-8fadc69d1bb0 req-3f774a1d-a00b-4091-a691-1d6c2a4bd23d service nova] Acquiring lock "refresh_cache-57da589c-863c-42a8-8802-314a499ebc29" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 09:54:43 user nova-compute[75229]: DEBUG nova.network.neutron [None req-fc1ce62d-a583-41bd-85d8-615e64c05853 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] [instance: 57da589c-863c-42a8-8802-314a499ebc29] Instance cache missing network info. {{(pid=75229) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 09:54:44 user nova-compute[75229]: DEBUG nova.network.neutron [None req-fc1ce62d-a583-41bd-85d8-615e64c05853 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] [instance: 57da589c-863c-42a8-8802-314a499ebc29] Updating instance_info_cache with network_info: [{"id": "b570f667-506d-47ce-b69b-d4416514ef63", "address": "fa:16:3e:c8:8e:cd", "network": {"id": "bd407caa-6ef6-400d-9327-3179dc1d8da4", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-29933774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b8d48c38c7344f5b12d0ed5b9392554", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb570f667-50", "ovs_interfaceid": "b570f667-506d-47ce-b69b-d4416514ef63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 09:54:44 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-fc1ce62d-a583-41bd-85d8-615e64c05853 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Releasing lock "refresh_cache-57da589c-863c-42a8-8802-314a499ebc29" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 09:54:44 user nova-compute[75229]: DEBUG nova.compute.manager [None req-fc1ce62d-a583-41bd-85d8-615e64c05853 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] [instance: 57da589c-863c-42a8-8802-314a499ebc29] Instance network_info: |[{"id": "b570f667-506d-47ce-b69b-d4416514ef63", "address": "fa:16:3e:c8:8e:cd", "network": {"id": "bd407caa-6ef6-400d-9327-3179dc1d8da4", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-29933774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b8d48c38c7344f5b12d0ed5b9392554", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb570f667-50", "ovs_interfaceid": "b570f667-506d-47ce-b69b-d4416514ef63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75229) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 09:54:44 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-6a88eeb0-2412-443a-8e09-8fadc69d1bb0 req-3f774a1d-a00b-4091-a691-1d6c2a4bd23d service nova] Acquired lock "refresh_cache-57da589c-863c-42a8-8802-314a499ebc29" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 09:54:44 user nova-compute[75229]: DEBUG nova.network.neutron [req-6a88eeb0-2412-443a-8e09-8fadc69d1bb0 req-3f774a1d-a00b-4091-a691-1d6c2a4bd23d service nova] [instance: 57da589c-863c-42a8-8802-314a499ebc29] Refreshing network info cache for port b570f667-506d-47ce-b69b-d4416514ef63 {{(pid=75229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 09:54:44 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-fc1ce62d-a583-41bd-85d8-615e64c05853 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] [instance: 57da589c-863c-42a8-8802-314a499ebc29] Start _get_guest_xml network_info=[{"id": "b570f667-506d-47ce-b69b-d4416514ef63", "address": "fa:16:3e:c8:8e:cd", "network": {"id": "bd407caa-6ef6-400d-9327-3179dc1d8da4", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-29933774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b8d48c38c7344f5b12d0ed5b9392554", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb570f667-50", "ovs_interfaceid": "b570f667-506d-47ce-b69b-d4416514ef63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T09:40:10Z,direct_url=<?>,disk_format='qcow2',id=3bef8470-ecc7-40e3-95d4-9254348ea72d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='de5a91106b6948ed937a7178ff9464c4',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T09:40:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'disk_bus': 'virtio', 'guest_format': None, 'encryption_secret_uuid': None, 'size': 0, 'device_type': 'disk', 'image_id': '3bef8470-ecc7-40e3-95d4-9254348ea72d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75229) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 09:54:44 user nova-compute[75229]: WARNING nova.virt.libvirt.driver [None req-fc1ce62d-a583-41bd-85d8-615e64c05853 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 09:54:44 user nova-compute[75229]: WARNING nova.virt.libvirt.driver [None req-fc1ce62d-a583-41bd-85d8-615e64c05853 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 09:54:44 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-fc1ce62d-a583-41bd-85d8-615e64c05853 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75229) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 09:54:44 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-fc1ce62d-a583-41bd-85d8-615e64c05853 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] CPU controller missing on host. {{(pid=75229) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 09:54:44 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-fc1ce62d-a583-41bd-85d8-615e64c05853 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75229) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 09:54:44 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-fc1ce62d-a583-41bd-85d8-615e64c05853 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] CPU controller found on host. {{(pid=75229) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 09:54:44 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-fc1ce62d-a583-41bd-85d8-615e64c05853 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75229) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 09:54:44 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-fc1ce62d-a583-41bd-85d8-615e64c05853 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T09:39:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T09:40:10Z,direct_url=<?>,disk_format='qcow2',id=3bef8470-ecc7-40e3-95d4-9254348ea72d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='de5a91106b6948ed937a7178ff9464c4',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T09:40:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 09:54:44 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-fc1ce62d-a583-41bd-85d8-615e64c05853 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Flavor limits 0:0:0 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 09:54:44 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-fc1ce62d-a583-41bd-85d8-615e64c05853 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Image limits 0:0:0 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 09:54:44 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-fc1ce62d-a583-41bd-85d8-615e64c05853 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Flavor pref 0:0:0 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 09:54:44 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-fc1ce62d-a583-41bd-85d8-615e64c05853 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Image pref 0:0:0 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 09:54:44 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-fc1ce62d-a583-41bd-85d8-615e64c05853 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 09:54:44 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-fc1ce62d-a583-41bd-85d8-615e64c05853 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 09:54:44 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-fc1ce62d-a583-41bd-85d8-615e64c05853 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75229) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 09:54:44 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-fc1ce62d-a583-41bd-85d8-615e64c05853 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Got 1 possible topologies {{(pid=75229) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 09:54:44 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-fc1ce62d-a583-41bd-85d8-615e64c05853 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 09:54:44 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-fc1ce62d-a583-41bd-85d8-615e64c05853 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 09:54:44 user nova-compute[75229]: DEBUG nova.virt.libvirt.vif [None req-fc1ce62d-a583-41bd-85d8-615e64c05853 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T09:54:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-623194614',display_name='tempest-AttachVolumeNegativeTest-server-623194614',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-623194614',id=31,image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIsfr8HU0VHYjIy5w1P2+mPftKRogBYBm9pEZK2RTD9jC+sVXq3vMmHy7GFbw68+sHuKrWbc4J/gU4gRIaVLJfSuuxaraEgdrz/NT1hTKfvcxI3hsx3LBJvKefJId6kOrg==',key_name='tempest-keypair-820004043',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8b8d48c38c7344f5b12d0ed5b9392554',ramdisk_id='',reservation_id='r-tr8jk5m0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-140392099',owner_user_name='tempest-AttachVolumeNegativeTest-140392099-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T09:54:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3b8313e365eb4970a58c412768e959bf',uuid=57da589c-863c-42a8-8802-314a499ebc29,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b570f667-506d-47ce-b69b-d4416514ef63", "address": "fa:16:3e:c8:8e:cd", "network": {"id": "bd407caa-6ef6-400d-9327-3179dc1d8da4", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-29933774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b8d48c38c7344f5b12d0ed5b9392554", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb570f667-50", "ovs_interfaceid": "b570f667-506d-47ce-b69b-d4416514ef63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75229) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 09:54:44 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-fc1ce62d-a583-41bd-85d8-615e64c05853 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Converting VIF {"id": "b570f667-506d-47ce-b69b-d4416514ef63", "address": "fa:16:3e:c8:8e:cd", "network": {"id": "bd407caa-6ef6-400d-9327-3179dc1d8da4", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-29933774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b8d48c38c7344f5b12d0ed5b9392554", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb570f667-50", "ovs_interfaceid": "b570f667-506d-47ce-b69b-d4416514ef63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 09:54:44 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-fc1ce62d-a583-41bd-85d8-615e64c05853 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c8:8e:cd,bridge_name='br-int',has_traffic_filtering=True,id=b570f667-506d-47ce-b69b-d4416514ef63,network=Network(bd407caa-6ef6-400d-9327-3179dc1d8da4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb570f667-50') {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 09:54:44 user nova-compute[75229]: DEBUG nova.objects.instance [None req-fc1ce62d-a583-41bd-85d8-615e64c05853 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Lazy-loading 'pci_devices' on Instance uuid 57da589c-863c-42a8-8802-314a499ebc29 {{(pid=75229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 09:54:44 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-fc1ce62d-a583-41bd-85d8-615e64c05853 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] [instance: 57da589c-863c-42a8-8802-314a499ebc29] End _get_guest_xml xml=<domain type="kvm">
Nov 14 09:54:44 user nova-compute[75229]:   <uuid>57da589c-863c-42a8-8802-314a499ebc29</uuid>
Nov 14 09:54:44 user nova-compute[75229]:   <name>instance-0000001f</name>
Nov 14 09:54:44 user nova-compute[75229]:   <memory>524288</memory>
Nov 14 09:54:44 user nova-compute[75229]:   <vcpu>1</vcpu>
Nov 14 09:54:44 user nova-compute[75229]:   <metadata>
Nov 14 09:54:44 user nova-compute[75229]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 09:54:44 user nova-compute[75229]:       <nova:package version="0.0.0"/>
Nov 14 09:54:44 user nova-compute[75229]:       <nova:name>tempest-AttachVolumeNegativeTest-server-623194614</nova:name>
Nov 14 09:54:44 user nova-compute[75229]:       <nova:creationTime>2023-11-14 09:54:44</nova:creationTime>
Nov 14 09:54:44 user nova-compute[75229]:       <nova:flavor name="m1.tiny">
Nov 14 09:54:44 user nova-compute[75229]:         <nova:memory>512</nova:memory>
Nov 14 09:54:44 user nova-compute[75229]:         <nova:disk>1</nova:disk>
Nov 14 09:54:44 user nova-compute[75229]:         <nova:swap>0</nova:swap>
Nov 14 09:54:44 user nova-compute[75229]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 09:54:44 user nova-compute[75229]:         <nova:vcpus>1</nova:vcpus>
Nov 14 09:54:44 user nova-compute[75229]:       </nova:flavor>
Nov 14 09:54:44 user nova-compute[75229]:       <nova:owner>
Nov 14 09:54:44 user nova-compute[75229]:         <nova:user uuid="3b8313e365eb4970a58c412768e959bf">tempest-AttachVolumeNegativeTest-140392099-project-member</nova:user>
Nov 14 09:54:44 user nova-compute[75229]:         <nova:project uuid="8b8d48c38c7344f5b12d0ed5b9392554">tempest-AttachVolumeNegativeTest-140392099</nova:project>
Nov 14 09:54:44 user nova-compute[75229]:       </nova:owner>
Nov 14 09:54:44 user nova-compute[75229]:       <nova:root type="image" uuid="3bef8470-ecc7-40e3-95d4-9254348ea72d"/>
Nov 14 09:54:44 user nova-compute[75229]:       <nova:ports>
Nov 14 09:54:44 user nova-compute[75229]:         <nova:port uuid="b570f667-506d-47ce-b69b-d4416514ef63">
Nov 14 09:54:44 user nova-compute[75229]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 14 09:54:44 user nova-compute[75229]:         </nova:port>
Nov 14 09:54:44 user nova-compute[75229]:       </nova:ports>
Nov 14 09:54:44 user nova-compute[75229]:     </nova:instance>
Nov 14 09:54:44 user nova-compute[75229]:   </metadata>
Nov 14 09:54:44 user nova-compute[75229]:   <sysinfo type="smbios">
Nov 14 09:54:44 user nova-compute[75229]:     <system>
Nov 14 09:54:44 user nova-compute[75229]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 09:54:44 user nova-compute[75229]:       <entry name="product">OpenStack Nova</entry>
Nov 14 09:54:44 user nova-compute[75229]:       <entry name="version">0.0.0</entry>
Nov 14 09:54:44 user nova-compute[75229]:       <entry name="serial">57da589c-863c-42a8-8802-314a499ebc29</entry>
Nov 14 09:54:44 user nova-compute[75229]:       <entry name="uuid">57da589c-863c-42a8-8802-314a499ebc29</entry>
Nov 14 09:54:44 user nova-compute[75229]:       <entry name="family">Virtual Machine</entry>
Nov 14 09:54:44 user nova-compute[75229]:     </system>
Nov 14 09:54:44 user nova-compute[75229]:   </sysinfo>
Nov 14 09:54:44 user nova-compute[75229]:   <os>
Nov 14 09:54:44 user nova-compute[75229]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 09:54:44 user nova-compute[75229]:     <boot dev="hd"/>
Nov 14 09:54:44 user nova-compute[75229]:     <smbios mode="sysinfo"/>
Nov 14 09:54:44 user nova-compute[75229]:   </os>
Nov 14 09:54:44 user nova-compute[75229]:   <features>
Nov 14 09:54:44 user nova-compute[75229]:     <acpi/>
Nov 14 09:54:44 user nova-compute[75229]:     <apic/>
Nov 14 09:54:44 user nova-compute[75229]:     <vmcoreinfo/>
Nov 14 09:54:44 user nova-compute[75229]:   </features>
Nov 14 09:54:44 user nova-compute[75229]:   <clock offset="utc">
Nov 14 09:54:44 user nova-compute[75229]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 09:54:44 user nova-compute[75229]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 09:54:44 user nova-compute[75229]:     <timer name="hpet" present="no"/>
Nov 14 09:54:44 user nova-compute[75229]:   </clock>
Nov 14 09:54:44 user nova-compute[75229]:   <cpu mode="custom" match="exact">
Nov 14 09:54:44 user nova-compute[75229]:     <model>Nehalem</model>
Nov 14 09:54:44 user nova-compute[75229]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 09:54:44 user nova-compute[75229]:   </cpu>
Nov 14 09:54:44 user nova-compute[75229]:   <devices>
Nov 14 09:54:44 user nova-compute[75229]:     <disk type="file" device="disk">
Nov 14 09:54:44 user nova-compute[75229]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 09:54:44 user nova-compute[75229]:       <source file="/opt/stack/data/nova/instances/57da589c-863c-42a8-8802-314a499ebc29/disk"/>
Nov 14 09:54:44 user nova-compute[75229]:       <target dev="vda" bus="virtio"/>
Nov 14 09:54:44 user nova-compute[75229]:     </disk>
Nov 14 09:54:44 user nova-compute[75229]:     <interface type="ethernet">
Nov 14 09:54:44 user nova-compute[75229]:       <mac address="fa:16:3e:c8:8e:cd"/>
Nov 14 09:54:44 user nova-compute[75229]:       <model type="virtio"/>
Nov 14 09:54:44 user nova-compute[75229]:       <mtu size="1442"/>
Nov 14 09:54:44 user nova-compute[75229]:       <target dev="tapb570f667-50"/>
Nov 14 09:54:44 user nova-compute[75229]:     </interface>
Nov 14 09:54:44 user nova-compute[75229]:     <serial type="pty">
Nov 14 09:54:44 user nova-compute[75229]:       <log file="/opt/stack/data/nova/instances/57da589c-863c-42a8-8802-314a499ebc29/console.log" append="off"/>
Nov 14 09:54:44 user nova-compute[75229]:     </serial>
Nov 14 09:54:44 user nova-compute[75229]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 09:54:44 user nova-compute[75229]:     <video>
Nov 14 09:54:44 user nova-compute[75229]:       <model type="virtio"/>
Nov 14 09:54:44 user nova-compute[75229]:     </video>
Nov 14 09:54:44 user nova-compute[75229]:     <rng model="virtio">
Nov 14 09:54:44 user nova-compute[75229]:       <backend model="random">/dev/urandom</backend>
Nov 14 09:54:44 user nova-compute[75229]:     </rng>
Nov 14 09:54:44 user nova-compute[75229]:     <controller type="usb" index="0" model="none"/>
Nov 14 09:54:44 user nova-compute[75229]:     <memballoon model="virtio">
Nov 14 09:54:44 user nova-compute[75229]:       <stats period="10"/>
Nov 14 09:54:44 user nova-compute[75229]:     </memballoon>
Nov 14 09:54:44 user nova-compute[75229]:   </devices>
Nov 14 09:54:44 user nova-compute[75229]: </domain>
Nov 14 09:54:44 user nova-compute[75229]:  {{(pid=75229) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 09:54:44 user nova-compute[75229]: DEBUG nova.virt.libvirt.vif [None req-fc1ce62d-a583-41bd-85d8-615e64c05853 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T09:54:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-623194614',display_name='tempest-AttachVolumeNegativeTest-server-623194614',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-623194614',id=31,image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIsfr8HU0VHYjIy5w1P2+mPftKRogBYBm9pEZK2RTD9jC+sVXq3vMmHy7GFbw68+sHuKrWbc4J/gU4gRIaVLJfSuuxaraEgdrz/NT1hTKfvcxI3hsx3LBJvKefJId6kOrg==',key_name='tempest-keypair-820004043',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8b8d48c38c7344f5b12d0ed5b9392554',ramdisk_id='',reservation_id='r-tr8jk5m0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-140392099',owner_user_name='tempest-AttachVolumeNegativeTest-140392099-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T09:54:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3b8313e365eb4970a58c412768e959bf',uuid=57da589c-863c-42a8-8802-314a499ebc29,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b570f667-506d-47ce-b69b-d4416514ef63", "address": "fa:16:3e:c8:8e:cd", "network": {"id": "bd407caa-6ef6-400d-9327-3179dc1d8da4", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-29933774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b8d48c38c7344f5b12d0ed5b9392554", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb570f667-50", "ovs_interfaceid": "b570f667-506d-47ce-b69b-d4416514ef63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 09:54:44 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-fc1ce62d-a583-41bd-85d8-615e64c05853 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Converting VIF {"id": "b570f667-506d-47ce-b69b-d4416514ef63", "address": "fa:16:3e:c8:8e:cd", "network": {"id": "bd407caa-6ef6-400d-9327-3179dc1d8da4", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-29933774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b8d48c38c7344f5b12d0ed5b9392554", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb570f667-50", "ovs_interfaceid": "b570f667-506d-47ce-b69b-d4416514ef63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 09:54:44 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-fc1ce62d-a583-41bd-85d8-615e64c05853 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c8:8e:cd,bridge_name='br-int',has_traffic_filtering=True,id=b570f667-506d-47ce-b69b-d4416514ef63,network=Network(bd407caa-6ef6-400d-9327-3179dc1d8da4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb570f667-50') {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 09:54:44 user nova-compute[75229]: DEBUG os_vif [None req-fc1ce62d-a583-41bd-85d8-615e64c05853 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c8:8e:cd,bridge_name='br-int',has_traffic_filtering=True,id=b570f667-506d-47ce-b69b-d4416514ef63,network=Network(bd407caa-6ef6-400d-9327-3179dc1d8da4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb570f667-50') {{(pid=75229) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 09:54:44 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:54:44 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:54:44 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 09:54:44 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:54:44 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '032cf608-1f0f-5b19-877a-9c787d13f9c5', '_type': 'linux-noop'}}, row=False) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:54:44 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:54:44 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 09:54:44 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:54:44 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb570f667-50, may_exist=True, interface_attrs={}) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:54:44 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb570f667-50, col_values=(('qos', UUID('c3eaddb9-6b07-438a-a9a0-b2f2f901d898')),), if_exists=True) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:54:44 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb570f667-50, col_values=(('external_ids', {'iface-id': 'b570f667-506d-47ce-b69b-d4416514ef63', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c8:8e:cd', 'vm-uuid': '57da589c-863c-42a8-8802-314a499ebc29'}),), if_exists=True) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:54:44 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:54:44 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 09:54:44 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:54:44 user nova-compute[75229]: INFO os_vif [None req-fc1ce62d-a583-41bd-85d8-615e64c05853 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c8:8e:cd,bridge_name='br-int',has_traffic_filtering=True,id=b570f667-506d-47ce-b69b-d4416514ef63,network=Network(bd407caa-6ef6-400d-9327-3179dc1d8da4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb570f667-50')
Nov 14 09:54:44 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-fc1ce62d-a583-41bd-85d8-615e64c05853 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] No BDM found with device name vda, not building metadata. {{(pid=75229) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 09:54:44 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-fc1ce62d-a583-41bd-85d8-615e64c05853 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] No VIF found with MAC fa:16:3e:c8:8e:cd, not building metadata {{(pid=75229) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 09:54:44 user nova-compute[75229]: DEBUG nova.network.neutron [req-6a88eeb0-2412-443a-8e09-8fadc69d1bb0 req-3f774a1d-a00b-4091-a691-1d6c2a4bd23d service nova] [instance: 57da589c-863c-42a8-8802-314a499ebc29] Updated VIF entry in instance network info cache for port b570f667-506d-47ce-b69b-d4416514ef63. {{(pid=75229) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 09:54:44 user nova-compute[75229]: DEBUG nova.network.neutron [req-6a88eeb0-2412-443a-8e09-8fadc69d1bb0 req-3f774a1d-a00b-4091-a691-1d6c2a4bd23d service nova] [instance: 57da589c-863c-42a8-8802-314a499ebc29] Updating instance_info_cache with network_info: [{"id": "b570f667-506d-47ce-b69b-d4416514ef63", "address": "fa:16:3e:c8:8e:cd", "network": {"id": "bd407caa-6ef6-400d-9327-3179dc1d8da4", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-29933774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b8d48c38c7344f5b12d0ed5b9392554", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb570f667-50", "ovs_interfaceid": "b570f667-506d-47ce-b69b-d4416514ef63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 09:54:44 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-6a88eeb0-2412-443a-8e09-8fadc69d1bb0 req-3f774a1d-a00b-4091-a691-1d6c2a4bd23d service nova] Releasing lock "refresh_cache-57da589c-863c-42a8-8802-314a499ebc29" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 09:54:45 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:54:45 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:54:45 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:54:45 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:54:45 user nova-compute[75229]: DEBUG nova.compute.manager [req-af9f0788-9d2c-4d21-ac9a-00cc13c71711 req-39d22716-73e3-472e-a0d1-5a6a7bfda886 service nova] [instance: 57da589c-863c-42a8-8802-314a499ebc29] Received event network-vif-plugged-b570f667-506d-47ce-b69b-d4416514ef63 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:54:45 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-af9f0788-9d2c-4d21-ac9a-00cc13c71711 req-39d22716-73e3-472e-a0d1-5a6a7bfda886 service nova] Acquiring lock "57da589c-863c-42a8-8802-314a499ebc29-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:54:45 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-af9f0788-9d2c-4d21-ac9a-00cc13c71711 req-39d22716-73e3-472e-a0d1-5a6a7bfda886 service nova] Lock "57da589c-863c-42a8-8802-314a499ebc29-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:54:45 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-af9f0788-9d2c-4d21-ac9a-00cc13c71711 req-39d22716-73e3-472e-a0d1-5a6a7bfda886 service nova] Lock "57da589c-863c-42a8-8802-314a499ebc29-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:54:45 user nova-compute[75229]: DEBUG nova.compute.manager [req-af9f0788-9d2c-4d21-ac9a-00cc13c71711 req-39d22716-73e3-472e-a0d1-5a6a7bfda886 service nova] [instance: 57da589c-863c-42a8-8802-314a499ebc29] No waiting events found dispatching network-vif-plugged-b570f667-506d-47ce-b69b-d4416514ef63 {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 09:54:45 user nova-compute[75229]: WARNING nova.compute.manager [req-af9f0788-9d2c-4d21-ac9a-00cc13c71711 req-39d22716-73e3-472e-a0d1-5a6a7bfda886 service nova] [instance: 57da589c-863c-42a8-8802-314a499ebc29] Received unexpected event network-vif-plugged-b570f667-506d-47ce-b69b-d4416514ef63 for instance with vm_state building and task_state spawning.
Nov 14 09:54:46 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:54:46 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:54:46 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:54:47 user nova-compute[75229]: DEBUG nova.compute.manager [None req-fc1ce62d-a583-41bd-85d8-615e64c05853 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] [instance: 57da589c-863c-42a8-8802-314a499ebc29] Instance event wait completed in 0 seconds for  {{(pid=75229) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 09:54:47 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-fc1ce62d-a583-41bd-85d8-615e64c05853 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] [instance: 57da589c-863c-42a8-8802-314a499ebc29] Guest created on hypervisor {{(pid=75229) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 09:54:47 user nova-compute[75229]: INFO nova.virt.libvirt.driver [-] [instance: 57da589c-863c-42a8-8802-314a499ebc29] Instance spawned successfully.
Nov 14 09:54:47 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-fc1ce62d-a583-41bd-85d8-615e64c05853 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] [instance: 57da589c-863c-42a8-8802-314a499ebc29] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 09:54:47 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-fc1ce62d-a583-41bd-85d8-615e64c05853 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] [instance: 57da589c-863c-42a8-8802-314a499ebc29] Found default for hw_cdrom_bus of ide {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 09:54:47 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-fc1ce62d-a583-41bd-85d8-615e64c05853 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] [instance: 57da589c-863c-42a8-8802-314a499ebc29] Found default for hw_disk_bus of virtio {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 09:54:47 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-fc1ce62d-a583-41bd-85d8-615e64c05853 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] [instance: 57da589c-863c-42a8-8802-314a499ebc29] Found default for hw_input_bus of None {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 09:54:47 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-fc1ce62d-a583-41bd-85d8-615e64c05853 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] [instance: 57da589c-863c-42a8-8802-314a499ebc29] Found default for hw_pointer_model of None {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 09:54:47 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-fc1ce62d-a583-41bd-85d8-615e64c05853 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] [instance: 57da589c-863c-42a8-8802-314a499ebc29] Found default for hw_video_model of virtio {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 09:54:47 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-fc1ce62d-a583-41bd-85d8-615e64c05853 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] [instance: 57da589c-863c-42a8-8802-314a499ebc29] Found default for hw_vif_model of virtio {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 09:54:47 user nova-compute[75229]: INFO nova.compute.manager [None req-fc1ce62d-a583-41bd-85d8-615e64c05853 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] [instance: 57da589c-863c-42a8-8802-314a499ebc29] Took 5.43 seconds to spawn the instance on the hypervisor.
Nov 14 09:54:47 user nova-compute[75229]: DEBUG nova.compute.manager [None req-fc1ce62d-a583-41bd-85d8-615e64c05853 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] [instance: 57da589c-863c-42a8-8802-314a499ebc29] Checking state {{(pid=75229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 09:54:47 user nova-compute[75229]: DEBUG nova.compute.manager [req-04d87a45-8d66-4123-9a02-1624177cfe70 req-465a1292-4407-4f88-a339-8ce8b49a508a service nova] [instance: 57da589c-863c-42a8-8802-314a499ebc29] Received event network-vif-plugged-b570f667-506d-47ce-b69b-d4416514ef63 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:54:47 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-04d87a45-8d66-4123-9a02-1624177cfe70 req-465a1292-4407-4f88-a339-8ce8b49a508a service nova] Acquiring lock "57da589c-863c-42a8-8802-314a499ebc29-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:54:47 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-04d87a45-8d66-4123-9a02-1624177cfe70 req-465a1292-4407-4f88-a339-8ce8b49a508a service nova] Lock "57da589c-863c-42a8-8802-314a499ebc29-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:54:47 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-04d87a45-8d66-4123-9a02-1624177cfe70 req-465a1292-4407-4f88-a339-8ce8b49a508a service nova] Lock "57da589c-863c-42a8-8802-314a499ebc29-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:54:47 user nova-compute[75229]: DEBUG nova.compute.manager [req-04d87a45-8d66-4123-9a02-1624177cfe70 req-465a1292-4407-4f88-a339-8ce8b49a508a service nova] [instance: 57da589c-863c-42a8-8802-314a499ebc29] No waiting events found dispatching network-vif-plugged-b570f667-506d-47ce-b69b-d4416514ef63 {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 09:54:47 user nova-compute[75229]: WARNING nova.compute.manager [req-04d87a45-8d66-4123-9a02-1624177cfe70 req-465a1292-4407-4f88-a339-8ce8b49a508a service nova] [instance: 57da589c-863c-42a8-8802-314a499ebc29] Received unexpected event network-vif-plugged-b570f667-506d-47ce-b69b-d4416514ef63 for instance with vm_state building and task_state spawning.
Nov 14 09:54:48 user nova-compute[75229]: INFO nova.compute.manager [None req-fc1ce62d-a583-41bd-85d8-615e64c05853 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] [instance: 57da589c-863c-42a8-8802-314a499ebc29] Took 6.16 seconds to build instance.
Nov 14 09:54:48 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-fc1ce62d-a583-41bd-85d8-615e64c05853 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Lock "57da589c-863c-42a8-8802-314a499ebc29" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.257s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:54:48 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:54:48 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 09:54:49 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:54:49 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 09:54:49 user nova-compute[75229]: DEBUG nova.compute.manager [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Cleaning up deleted instances {{(pid=75229) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 14 09:54:49 user nova-compute[75229]: DEBUG nova.compute.manager [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] There are 0 instances to clean {{(pid=75229) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 14 09:54:51 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 09:54:51 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:54:51 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:54:51 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:54:51 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Auditing locally available compute resources for user (node: user) {{(pid=75229) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 09:54:51 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cda8c5ad-e70c-4021-bace-d55831c4bc78/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:54:52 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cda8c5ad-e70c-4021-bace-d55831c4bc78/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:54:52 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cda8c5ad-e70c-4021-bace-d55831c4bc78/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:54:52 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cda8c5ad-e70c-4021-bace-d55831c4bc78/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:54:52 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7750cbc-b3d0-44aa-8b88-c291ba007a8a/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:54:52 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7750cbc-b3d0-44aa-8b88-c291ba007a8a/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:54:52 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7750cbc-b3d0-44aa-8b88-c291ba007a8a/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:54:52 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7750cbc-b3d0-44aa-8b88-c291ba007a8a/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:54:52 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/564d95eb-81c0-47a5-9979-2318fced06f5/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:54:52 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/564d95eb-81c0-47a5-9979-2318fced06f5/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:54:52 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/564d95eb-81c0-47a5-9979-2318fced06f5/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:54:53 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/564d95eb-81c0-47a5-9979-2318fced06f5/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:54:53 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e58500df-059a-4fce-afb7-ba36feca0697/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:54:53 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e58500df-059a-4fce-afb7-ba36feca0697/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:54:53 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e58500df-059a-4fce-afb7-ba36feca0697/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:54:53 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e58500df-059a-4fce-afb7-ba36feca0697/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:54:53 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c9fe69e-3f9d-4b30-a9e4-efc3e83efa17/disk.rescue --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:54:53 user nova-compute[75229]: WARNING nova.virt.libvirt.driver [None req-4196650f-88ee-40d8-9de5-8d887d1dd5e5 tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 564d95eb-81c0-47a5-9979-2318fced06f5 is timed out.
Nov 14 09:54:53 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-4196650f-88ee-40d8-9de5-8d887d1dd5e5 tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] Successfully detached device vdb from instance 564d95eb-81c0-47a5-9979-2318fced06f5 from the live domain config.
Nov 14 09:54:53 user nova-compute[75229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4196650f-88ee-40d8-9de5-8d887d1dd5e5 tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] [instance: 564d95eb-81c0-47a5-9979-2318fced06f5] calling os-brick to detach iSCSI Volume {{(pid=75229) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 09:54:53 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-4196650f-88ee-40d8-9de5-8d887d1dd5e5 tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f73f85151b0>, {'target_iqn': 'iqn.2010-10.org.openstack:b81a5866-727c-4e21-952d-a1255d96dcfa', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DkAdIFLE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 09:54:53 user nova-compute[75229]: WARNING os_brick.initiator.connectors.base [None req-4196650f-88ee-40d8-9de5-8d887d1dd5e5 tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 09:54:53 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-4196650f-88ee-40d8-9de5-8d887d1dd5e5 tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 09:54:53 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-4196650f-88ee-40d8-9de5-8d887d1dd5e5 tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 09:54:53 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:54:53 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:54:53 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2178994-6d28-4b1d-809e-95d4eea44d0b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b81a5866-727c-4e21-952d-a1255d96dcfa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:54:53 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-4196650f-88ee-40d8-9de5-8d887d1dd5e5 tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 09:54:53 user nova-compute[75229]: No targets found.
Nov 14 09:54:53 user nova-compute[75229]: iSNS:
Nov 14 09:54:53 user nova-compute[75229]: No targets found.
Nov 14 09:54:53 user nova-compute[75229]: STATIC:
Nov 14 09:54:53 user nova-compute[75229]: Target: iqn.2010-10.org.openstack:b81a5866-727c-4e21-952d-a1255d96dcfa
Nov 14 09:54:53 user nova-compute[75229]:         Portal: 172.16.0.220:3260,-1
Nov 14 09:54:53 user nova-compute[75229]:                 Iface Name: default
Nov 14 09:54:53 user nova-compute[75229]: FIRMWARE:
Nov 14 09:54:53 user nova-compute[75229]: No targets found.
Nov 14 09:54:53 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 09:54:53 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-4196650f-88ee-40d8-9de5-8d887d1dd5e5 tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 09:54:53 user nova-compute[75229]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 09:54:53 user nova-compute[75229]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75229) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 09:54:53 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-4196650f-88ee-40d8-9de5-8d887d1dd5e5 tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b81a5866-727c-4e21-952d-a1255d96dcfa', 0)] {{(pid=75229) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 09:54:53 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:54:53 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:54:53 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[614505a2-2775-46dc-837e-e7fc8ab0cd2b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b81a5866-727c-4e21-952d-a1255d96dcfa\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:54:53 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:54:53 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:54:53 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[81b93c7a-7175-4666-8e12-4bde03856ca1]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b81a5866-727c-4e21-952d-a1255d96dcfa (non-flash)\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:54:53 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-4196650f-88ee-40d8-9de5-8d887d1dd5e5 tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b81a5866-727c-4e21-952d-a1255d96dcfa (non-flash)
Nov 14 09:54:53 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 09:54:53 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-4196650f-88ee-40d8-9de5-8d887d1dd5e5 tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b81a5866-727c-4e21-952d-a1255d96dcfa (non-flash)
Nov 14 09:54:53 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 09:54:53 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-4196650f-88ee-40d8-9de5-8d887d1dd5e5 tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f73f8525fc0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b81a5866-727c-4e21-952d-a1255d96dcfa'): ({'sdb'}, set())}) {{(pid=75229) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 09:54:53 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-4196650f-88ee-40d8-9de5-8d887d1dd5e5 tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] Removing single pathed devices sdb {{(pid=75229) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 09:54:53 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:54:53 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:54:53 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed028f27-8ec4-4c52-a568-be40b61c088a]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:54:53 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:54:53 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c9fe69e-3f9d-4b30-a9e4-efc3e83efa17/disk.rescue --force-share --output=json" returned: 0 in 0.180s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:54:53 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c9fe69e-3f9d-4b30-a9e4-efc3e83efa17/disk.rescue --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:54:53 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:54:53 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[845d9bbb-70c4-4ea2-badd-3b5e41ffee62]: (4, ('ok\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:54:53 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-4196650f-88ee-40d8-9de5-8d887d1dd5e5 tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] Flushing IO for device /dev/sdb {{(pid=75229) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 09:54:53 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:54:53 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:54:53 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d37b10f-d12e-4a27-9595-26e5201105f4]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:54:53 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-4196650f-88ee-40d8-9de5-8d887d1dd5e5 tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75229) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 09:54:53 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:54:53 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.041s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:54:53 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b1584cc-69eb-427c-81cf-cf75e465c841]: (4, ('1', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:54:53 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-4196650f-88ee-40d8-9de5-8d887d1dd5e5 tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75229) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 09:54:53 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-4196650f-88ee-40d8-9de5-8d887d1dd5e5 tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] SCSI volumes sdb have been removed. {{(pid=75229) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 09:54:53 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-4196650f-88ee-40d8-9de5-8d887d1dd5e5 tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b81a5866-727c-4e21-952d-a1255d96dcfa')] {{(pid=75229) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 09:54:53 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b81a5866-727c-4e21-952d-a1255d96dcfa -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:54:53 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b81a5866-727c-4e21-952d-a1255d96dcfa -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:54:53 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[47cd321c-0876-4a4d-a464-8a0ee23c303b]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:54:53 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-4196650f-88ee-40d8-9de5-8d887d1dd5e5 tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:54:53 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b81a5866-727c-4e21-952d-a1255d96dcfa -p 172.16.0.220:3260 --logout {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:54:53 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b81a5866-727c-4e21-952d-a1255d96dcfa -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:54:53 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[64bde994-05e2-4374-be95-faa014509a06]: (4, ('Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:b81a5866-727c-4e21-952d-a1255d96dcfa, portal: 172.16.0.220,3260]\nLogout of [sid: 29, target: iqn.2010-10.org.openstack:b81a5866-727c-4e21-952d-a1255d96dcfa, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:54:53 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-4196650f-88ee-40d8-9de5-8d887d1dd5e5 tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:b81a5866-727c-4e21-952d-a1255d96dcfa, portal: 172.16.0.220,3260]
Nov 14 09:54:53 user nova-compute[75229]: Logout of [sid: 29, target: iqn.2010-10.org.openstack:b81a5866-727c-4e21-952d-a1255d96dcfa, portal: 172.16.0.220,3260] successful.
Nov 14 09:54:53 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:54:53 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c9fe69e-3f9d-4b30-a9e4-efc3e83efa17/disk.rescue --force-share --output=json" returned: 0 in 0.197s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:54:53 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c9fe69e-3f9d-4b30-a9e4-efc3e83efa17/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:54:53 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b81a5866-727c-4e21-952d-a1255d96dcfa -p 172.16.0.220:3260 --op delete {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:54:53 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b81a5866-727c-4e21-952d-a1255d96dcfa -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:54:53 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[883076e6-ea62-460d-869a-5d64a71aae9c]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:54:53 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-4196650f-88ee-40d8-9de5-8d887d1dd5e5 tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:54:53 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-4196650f-88ee-40d8-9de5-8d887d1dd5e5 tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.349s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 09:54:53 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-4196650f-88ee-40d8-9de5-8d887d1dd5e5 tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] <== disconnect_volume: return (352ms) None {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 09:54:53 user nova-compute[75229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4196650f-88ee-40d8-9de5-8d887d1dd5e5 tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] [instance: 564d95eb-81c0-47a5-9979-2318fced06f5] Disconnected iSCSI Volume {{(pid=75229) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 09:54:53 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c9fe69e-3f9d-4b30-a9e4-efc3e83efa17/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:54:53 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c9fe69e-3f9d-4b30-a9e4-efc3e83efa17/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:54:54 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c9fe69e-3f9d-4b30-a9e4-efc3e83efa17/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:54:54 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4ce290f-6dd2-44b6-91be-8e775045837e/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:54:54 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:54:54 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4ce290f-6dd2-44b6-91be-8e775045837e/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:54:54 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4ce290f-6dd2-44b6-91be-8e775045837e/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:54:54 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4ce290f-6dd2-44b6-91be-8e775045837e/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:54:54 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57da589c-863c-42a8-8802-314a499ebc29/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:54:54 user nova-compute[75229]: DEBUG nova.objects.instance [None req-4196650f-88ee-40d8-9de5-8d887d1dd5e5 tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] Lazy-loading 'flavor' on Instance uuid 564d95eb-81c0-47a5-9979-2318fced06f5 {{(pid=75229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 09:54:54 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-4196650f-88ee-40d8-9de5-8d887d1dd5e5 tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] Lock "564d95eb-81c0-47a5-9979-2318fced06f5" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.771s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:54:54 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57da589c-863c-42a8-8802-314a499ebc29/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:54:54 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57da589c-863c-42a8-8802-314a499ebc29/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:54:54 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57da589c-863c-42a8-8802-314a499ebc29/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:54:54 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/200e8be8-516b-4344-a584-e88ee79b21a6/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:54:55 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/200e8be8-516b-4344-a584-e88ee79b21a6/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:54:55 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/200e8be8-516b-4344-a584-e88ee79b21a6/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:54:55 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/200e8be8-516b-4344-a584-e88ee79b21a6/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:54:55 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5170e9e-66e3-4df1-9807-4958cac6480e/disk.rescue --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:54:55 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5170e9e-66e3-4df1-9807-4958cac6480e/disk.rescue --force-share --output=json" returned: 0 in 0.168s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:54:55 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5170e9e-66e3-4df1-9807-4958cac6480e/disk.rescue --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:54:55 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5170e9e-66e3-4df1-9807-4958cac6480e/disk.rescue --force-share --output=json" returned: 0 in 0.182s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:54:55 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5170e9e-66e3-4df1-9807-4958cac6480e/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:54:55 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5170e9e-66e3-4df1-9807-4958cac6480e/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:54:55 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5170e9e-66e3-4df1-9807-4958cac6480e/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:54:56 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5170e9e-66e3-4df1-9807-4958cac6480e/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:54:56 user nova-compute[75229]: WARNING nova.virt.libvirt.driver [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 09:54:56 user nova-compute[75229]: WARNING nova.virt.libvirt.driver [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 09:54:56 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Hypervisor/Node resource view: name=user free_ram=7658MB free_disk=25.16510009765625GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75229) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 09:54:56 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:54:56 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:54:56 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Instance a7750cbc-b3d0-44aa-8b88-c291ba007a8a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 09:54:56 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Instance 4c9fe69e-3f9d-4b30-a9e4-efc3e83efa17 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 09:54:56 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Instance b5170e9e-66e3-4df1-9807-4958cac6480e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 09:54:56 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Instance a4ce290f-6dd2-44b6-91be-8e775045837e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 09:54:56 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Instance e58500df-059a-4fce-afb7-ba36feca0697 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 09:54:56 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Instance 564d95eb-81c0-47a5-9979-2318fced06f5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 09:54:56 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Instance 200e8be8-516b-4344-a584-e88ee79b21a6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 09:54:56 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Instance cda8c5ad-e70c-4021-bace-d55831c4bc78 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 09:54:56 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Instance 57da589c-863c-42a8-8802-314a499ebc29 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 09:54:56 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=75229) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 09:54:56 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=75229) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 09:54:56 user nova-compute[75229]: DEBUG nova.scheduler.client.report [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Refreshing inventories for resource provider d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 {{(pid=75229) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 14 09:54:56 user nova-compute[75229]: DEBUG nova.scheduler.client.report [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Updating ProviderTree inventory for provider d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75229) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 14 09:54:56 user nova-compute[75229]: DEBUG nova.compute.provider_tree [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Updating inventory in ProviderTree for provider d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 14 09:54:56 user nova-compute[75229]: DEBUG nova.scheduler.client.report [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Refreshing aggregate associations for resource provider d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3, aggregates: None {{(pid=75229) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 14 09:54:56 user nova-compute[75229]: DEBUG nova.scheduler.client.report [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Refreshing trait associations for resource provider d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3, traits: COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_MMX,HW_CPU_X86_SSE42,HW_CPU_X86_SSSE3,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_TRUSTED_CERTS,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSE,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_USB,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_RESCUE_BFV {{(pid=75229) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 14 09:54:57 user nova-compute[75229]: DEBUG nova.compute.provider_tree [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Inventory has not changed in ProviderTree for provider: d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 {{(pid=75229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 09:54:57 user nova-compute[75229]: DEBUG nova.scheduler.client.report [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Inventory has not changed for provider d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 09:54:57 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Compute_service record updated for user:user {{(pid=75229) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 09:54:57 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.751s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:54:58 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 09:54:58 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 09:54:58 user nova-compute[75229]: DEBUG nova.compute.manager [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Starting heal instance info cache {{(pid=75229) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 09:54:58 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Acquiring lock "refresh_cache-b5170e9e-66e3-4df1-9807-4958cac6480e" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 09:54:58 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Acquired lock "refresh_cache-b5170e9e-66e3-4df1-9807-4958cac6480e" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 09:54:58 user nova-compute[75229]: DEBUG nova.network.neutron [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] [instance: b5170e9e-66e3-4df1-9807-4958cac6480e] Forcefully refreshing network info cache for instance {{(pid=75229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 09:54:58 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:54:58 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-6e10b008-a154-4717-b4b7-c10555132ebe tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Acquiring lock "d73f431b-d002-4206-8b52-7d313a43dccb" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:54:58 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-6e10b008-a154-4717-b4b7-c10555132ebe tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Lock "d73f431b-d002-4206-8b52-7d313a43dccb" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:54:58 user nova-compute[75229]: INFO nova.compute.manager [None req-6e10b008-a154-4717-b4b7-c10555132ebe tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] [instance: d73f431b-d002-4206-8b52-7d313a43dccb] Unshelving
Nov 14 09:54:58 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-6e10b008-a154-4717-b4b7-c10555132ebe tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:54:58 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-6e10b008-a154-4717-b4b7-c10555132ebe tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:54:58 user nova-compute[75229]: DEBUG nova.objects.instance [None req-6e10b008-a154-4717-b4b7-c10555132ebe tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Lazy-loading 'pci_requests' on Instance uuid d73f431b-d002-4206-8b52-7d313a43dccb {{(pid=75229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 09:54:58 user nova-compute[75229]: DEBUG nova.objects.instance [None req-6e10b008-a154-4717-b4b7-c10555132ebe tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Lazy-loading 'numa_topology' on Instance uuid d73f431b-d002-4206-8b52-7d313a43dccb {{(pid=75229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 09:54:58 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-6e10b008-a154-4717-b4b7-c10555132ebe tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75229) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 09:54:58 user nova-compute[75229]: INFO nova.compute.claims [None req-6e10b008-a154-4717-b4b7-c10555132ebe tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] [instance: d73f431b-d002-4206-8b52-7d313a43dccb] Claim successful on node user
Nov 14 09:54:58 user nova-compute[75229]: DEBUG nova.network.neutron [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] [instance: b5170e9e-66e3-4df1-9807-4958cac6480e] Updating instance_info_cache with network_info: [{"id": "bed3fc1c-227e-44d2-85e1-589501a2e9dc", "address": "fa:16:3e:26:85:42", "network": {"id": "22eed29e-7148-42f9-b4c7-b97811cba8eb", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2000485731-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46457b27e3ed416e827c3c22449fb512", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbed3fc1c-22", "ovs_interfaceid": "bed3fc1c-227e-44d2-85e1-589501a2e9dc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 09:54:58 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Releasing lock "refresh_cache-b5170e9e-66e3-4df1-9807-4958cac6480e" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 09:54:58 user nova-compute[75229]: DEBUG nova.compute.manager [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] [instance: b5170e9e-66e3-4df1-9807-4958cac6480e] Updated the network info_cache for instance {{(pid=75229) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 09:54:58 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 09:54:58 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 09:54:58 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 09:54:58 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 09:54:58 user nova-compute[75229]: DEBUG nova.compute.manager [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75229) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 09:54:58 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 09:54:58 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 09:54:58 user nova-compute[75229]: DEBUG nova.compute.manager [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75229) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 14 09:54:59 user nova-compute[75229]: DEBUG nova.compute.provider_tree [None req-6e10b008-a154-4717-b4b7-c10555132ebe tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Inventory has not changed in ProviderTree for provider: d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 {{(pid=75229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 09:54:59 user nova-compute[75229]: DEBUG nova.scheduler.client.report [None req-6e10b008-a154-4717-b4b7-c10555132ebe tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Inventory has not changed for provider d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 09:54:59 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-6e10b008-a154-4717-b4b7-c10555132ebe tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.468s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:54:59 user nova-compute[75229]: INFO nova.network.neutron [None req-6e10b008-a154-4717-b4b7-c10555132ebe tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] [instance: d73f431b-d002-4206-8b52-7d313a43dccb] Updating port 5a68432e-63fc-48e8-bc8c-62e0cd22033c with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 14 09:54:59 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:54:59 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-6e10b008-a154-4717-b4b7-c10555132ebe tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Acquiring lock "refresh_cache-d73f431b-d002-4206-8b52-7d313a43dccb" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 09:54:59 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-6e10b008-a154-4717-b4b7-c10555132ebe tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Acquired lock "refresh_cache-d73f431b-d002-4206-8b52-7d313a43dccb" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 09:54:59 user nova-compute[75229]: DEBUG nova.network.neutron [None req-6e10b008-a154-4717-b4b7-c10555132ebe tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] [instance: d73f431b-d002-4206-8b52-7d313a43dccb] Building network info cache for instance {{(pid=75229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 09:54:59 user nova-compute[75229]: DEBUG nova.compute.manager [req-970bc90c-c4cf-4efb-a6b9-d61369ed839e req-6a50048f-79d3-4c68-9b58-e27b164306c0 service nova] [instance: d73f431b-d002-4206-8b52-7d313a43dccb] Received event network-changed-5a68432e-63fc-48e8-bc8c-62e0cd22033c {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:54:59 user nova-compute[75229]: DEBUG nova.compute.manager [req-970bc90c-c4cf-4efb-a6b9-d61369ed839e req-6a50048f-79d3-4c68-9b58-e27b164306c0 service nova] [instance: d73f431b-d002-4206-8b52-7d313a43dccb] Refreshing instance network info cache due to event network-changed-5a68432e-63fc-48e8-bc8c-62e0cd22033c. {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 09:54:59 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-970bc90c-c4cf-4efb-a6b9-d61369ed839e req-6a50048f-79d3-4c68-9b58-e27b164306c0 service nova] Acquiring lock "refresh_cache-d73f431b-d002-4206-8b52-7d313a43dccb" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 09:55:00 user nova-compute[75229]: DEBUG nova.network.neutron [None req-6e10b008-a154-4717-b4b7-c10555132ebe tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] [instance: d73f431b-d002-4206-8b52-7d313a43dccb] Updating instance_info_cache with network_info: [{"id": "5a68432e-63fc-48e8-bc8c-62e0cd22033c", "address": "fa:16:3e:0c:97:35", "network": {"id": "589aea41-545f-4875-ab56-b7aa273dad6f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-785276916-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.92", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee9447f169de43829fe3ed51592752e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a68432e-63", "ovs_interfaceid": "5a68432e-63fc-48e8-bc8c-62e0cd22033c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 09:55:00 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-6e10b008-a154-4717-b4b7-c10555132ebe tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Releasing lock "refresh_cache-d73f431b-d002-4206-8b52-7d313a43dccb" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 09:55:00 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-6e10b008-a154-4717-b4b7-c10555132ebe tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] [instance: d73f431b-d002-4206-8b52-7d313a43dccb] Creating instance directory {{(pid=75229) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 09:55:00 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-6e10b008-a154-4717-b4b7-c10555132ebe tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] [instance: d73f431b-d002-4206-8b52-7d313a43dccb] Creating image(s)
Nov 14 09:55:00 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-6e10b008-a154-4717-b4b7-c10555132ebe tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Acquiring lock "/opt/stack/data/nova/instances/d73f431b-d002-4206-8b52-7d313a43dccb/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:55:00 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-6e10b008-a154-4717-b4b7-c10555132ebe tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Lock "/opt/stack/data/nova/instances/d73f431b-d002-4206-8b52-7d313a43dccb/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:55:00 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-6e10b008-a154-4717-b4b7-c10555132ebe tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Lock "/opt/stack/data/nova/instances/d73f431b-d002-4206-8b52-7d313a43dccb/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:55:00 user nova-compute[75229]: DEBUG nova.objects.instance [None req-6e10b008-a154-4717-b4b7-c10555132ebe tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Lazy-loading 'trusted_certs' on Instance uuid d73f431b-d002-4206-8b52-7d313a43dccb {{(pid=75229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 09:55:00 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-970bc90c-c4cf-4efb-a6b9-d61369ed839e req-6a50048f-79d3-4c68-9b58-e27b164306c0 service nova] Acquired lock "refresh_cache-d73f431b-d002-4206-8b52-7d313a43dccb" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 09:55:00 user nova-compute[75229]: DEBUG nova.network.neutron [req-970bc90c-c4cf-4efb-a6b9-d61369ed839e req-6a50048f-79d3-4c68-9b58-e27b164306c0 service nova] [instance: d73f431b-d002-4206-8b52-7d313a43dccb] Refreshing network info cache for port 5a68432e-63fc-48e8-bc8c-62e0cd22033c {{(pid=75229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 09:55:00 user nova-compute[75229]: DEBUG nova.objects.base [None req-6e10b008-a154-4717-b4b7-c10555132ebe tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Object Instance<d73f431b-d002-4206-8b52-7d313a43dccb> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=75229) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 09:55:00 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-6e10b008-a154-4717-b4b7-c10555132ebe tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Acquiring lock "6b044aeadd21f2b3d105ffe459475eb3e0be99fc" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:55:00 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-6e10b008-a154-4717-b4b7-c10555132ebe tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Lock "6b044aeadd21f2b3d105ffe459475eb3e0be99fc" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:55:01 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-6e10b008-a154-4717-b4b7-c10555132ebe tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6b044aeadd21f2b3d105ffe459475eb3e0be99fc.part --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:55:01 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 09:55:01 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-6e10b008-a154-4717-b4b7-c10555132ebe tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6b044aeadd21f2b3d105ffe459475eb3e0be99fc.part --force-share --output=json" returned: 0 in 0.181s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:55:01 user nova-compute[75229]: DEBUG nova.virt.images [None req-6e10b008-a154-4717-b4b7-c10555132ebe tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] 172b5bd6-0f99-4c5b-b24e-002da5ca6798 was qcow2, converting to raw {{(pid=75229) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 14 09:55:01 user nova-compute[75229]: DEBUG nova.privsep.utils [None req-6e10b008-a154-4717-b4b7-c10555132ebe tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75229) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 14 09:55:01 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-6e10b008-a154-4717-b4b7-c10555132ebe tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/6b044aeadd21f2b3d105ffe459475eb3e0be99fc.part /opt/stack/data/nova/instances/_base/6b044aeadd21f2b3d105ffe459475eb3e0be99fc.converted {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:55:01 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-6e10b008-a154-4717-b4b7-c10555132ebe tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/6b044aeadd21f2b3d105ffe459475eb3e0be99fc.part /opt/stack/data/nova/instances/_base/6b044aeadd21f2b3d105ffe459475eb3e0be99fc.converted" returned: 0 in 0.182s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:55:01 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-6e10b008-a154-4717-b4b7-c10555132ebe tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6b044aeadd21f2b3d105ffe459475eb3e0be99fc.converted --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:55:02 user nova-compute[75229]: DEBUG nova.network.neutron [req-970bc90c-c4cf-4efb-a6b9-d61369ed839e req-6a50048f-79d3-4c68-9b58-e27b164306c0 service nova] [instance: d73f431b-d002-4206-8b52-7d313a43dccb] Updated VIF entry in instance network info cache for port 5a68432e-63fc-48e8-bc8c-62e0cd22033c. {{(pid=75229) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 09:55:02 user nova-compute[75229]: DEBUG nova.network.neutron [req-970bc90c-c4cf-4efb-a6b9-d61369ed839e req-6a50048f-79d3-4c68-9b58-e27b164306c0 service nova] [instance: d73f431b-d002-4206-8b52-7d313a43dccb] Updating instance_info_cache with network_info: [{"id": "5a68432e-63fc-48e8-bc8c-62e0cd22033c", "address": "fa:16:3e:0c:97:35", "network": {"id": "589aea41-545f-4875-ab56-b7aa273dad6f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-785276916-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.92", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee9447f169de43829fe3ed51592752e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a68432e-63", "ovs_interfaceid": "5a68432e-63fc-48e8-bc8c-62e0cd22033c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 09:55:02 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-970bc90c-c4cf-4efb-a6b9-d61369ed839e req-6a50048f-79d3-4c68-9b58-e27b164306c0 service nova] Releasing lock "refresh_cache-d73f431b-d002-4206-8b52-7d313a43dccb" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 09:55:02 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-6e10b008-a154-4717-b4b7-c10555132ebe tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6b044aeadd21f2b3d105ffe459475eb3e0be99fc.converted --force-share --output=json" returned: 0 in 0.182s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:55:02 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-6e10b008-a154-4717-b4b7-c10555132ebe tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Lock "6b044aeadd21f2b3d105ffe459475eb3e0be99fc" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.666s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:55:02 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-6e10b008-a154-4717-b4b7-c10555132ebe tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6b044aeadd21f2b3d105ffe459475eb3e0be99fc --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:55:02 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-6e10b008-a154-4717-b4b7-c10555132ebe tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6b044aeadd21f2b3d105ffe459475eb3e0be99fc --force-share --output=json" returned: 0 in 0.178s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:55:02 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-6e10b008-a154-4717-b4b7-c10555132ebe tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Acquiring lock "6b044aeadd21f2b3d105ffe459475eb3e0be99fc" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:55:02 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-6e10b008-a154-4717-b4b7-c10555132ebe tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Lock "6b044aeadd21f2b3d105ffe459475eb3e0be99fc" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:55:02 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-6e10b008-a154-4717-b4b7-c10555132ebe tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6b044aeadd21f2b3d105ffe459475eb3e0be99fc --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:55:02 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-6e10b008-a154-4717-b4b7-c10555132ebe tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6b044aeadd21f2b3d105ffe459475eb3e0be99fc --force-share --output=json" returned: 0 in 0.166s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:55:02 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-6e10b008-a154-4717-b4b7-c10555132ebe tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6b044aeadd21f2b3d105ffe459475eb3e0be99fc,backing_fmt=raw /opt/stack/data/nova/instances/d73f431b-d002-4206-8b52-7d313a43dccb/disk 1073741824 {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:55:02 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-6e10b008-a154-4717-b4b7-c10555132ebe tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6b044aeadd21f2b3d105ffe459475eb3e0be99fc,backing_fmt=raw /opt/stack/data/nova/instances/d73f431b-d002-4206-8b52-7d313a43dccb/disk 1073741824" returned: 0 in 0.049s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:55:02 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-6e10b008-a154-4717-b4b7-c10555132ebe tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Lock "6b044aeadd21f2b3d105ffe459475eb3e0be99fc" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.224s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:55:02 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-6e10b008-a154-4717-b4b7-c10555132ebe tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6b044aeadd21f2b3d105ffe459475eb3e0be99fc --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:55:02 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-6e10b008-a154-4717-b4b7-c10555132ebe tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6b044aeadd21f2b3d105ffe459475eb3e0be99fc --force-share --output=json" returned: 0 in 0.198s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:55:02 user nova-compute[75229]: DEBUG nova.objects.instance [None req-6e10b008-a154-4717-b4b7-c10555132ebe tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Lazy-loading 'migration_context' on Instance uuid d73f431b-d002-4206-8b52-7d313a43dccb {{(pid=75229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 09:55:02 user nova-compute[75229]: DEBUG nova.objects.base [None req-6e10b008-a154-4717-b4b7-c10555132ebe tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Object Instance<d73f431b-d002-4206-8b52-7d313a43dccb> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=75229) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 09:55:02 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-6e10b008-a154-4717-b4b7-c10555132ebe tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] [instance: d73f431b-d002-4206-8b52-7d313a43dccb] Rebasing disk image.
Nov 14 09:55:02 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-6e10b008-a154-4717-b4b7-c10555132ebe tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6 --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:55:02 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-6e10b008-a154-4717-b4b7-c10555132ebe tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6 --force-share --output=json" returned: 0 in 0.171s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:55:02 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-6e10b008-a154-4717-b4b7-c10555132ebe tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6 -F raw /opt/stack/data/nova/instances/d73f431b-d002-4206-8b52-7d313a43dccb/disk {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:55:03 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:55:04 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:55:04 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-6e10b008-a154-4717-b4b7-c10555132ebe tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6 -F raw /opt/stack/data/nova/instances/d73f431b-d002-4206-8b52-7d313a43dccb/disk" returned: 0 in 1.870s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:55:04 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-6e10b008-a154-4717-b4b7-c10555132ebe tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] [instance: d73f431b-d002-4206-8b52-7d313a43dccb] Created local disks {{(pid=75229) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 09:55:04 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-6e10b008-a154-4717-b4b7-c10555132ebe tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] [instance: d73f431b-d002-4206-8b52-7d313a43dccb] Ensure instance console log exists: /opt/stack/data/nova/instances/d73f431b-d002-4206-8b52-7d313a43dccb/console.log {{(pid=75229) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 09:55:04 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-6e10b008-a154-4717-b4b7-c10555132ebe tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:55:04 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-6e10b008-a154-4717-b4b7-c10555132ebe tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:55:04 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-6e10b008-a154-4717-b4b7-c10555132ebe tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:55:04 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-6e10b008-a154-4717-b4b7-c10555132ebe tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] [instance: d73f431b-d002-4206-8b52-7d313a43dccb] Start _get_guest_xml network_info=[{"id": "5a68432e-63fc-48e8-bc8c-62e0cd22033c", "address": "fa:16:3e:0c:97:35", "network": {"id": "589aea41-545f-4875-ab56-b7aa273dad6f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-785276916-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.92", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee9447f169de43829fe3ed51592752e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a68432e-63", "ovs_interfaceid": "5a68432e-63fc-48e8-bc8c-62e0cd22033c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='e4178d92a1aa8067fedd318f41d3f76d',container_format='bare',created_at=2023-11-14T09:53:06Z,direct_url=<?>,disk_format='qcow2',id=172b5bd6-0f99-4c5b-b24e-002da5ca6798,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-96778093-shelved',owner='ee9447f169de43829fe3ed51592752e9',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-11-14T09:53:10Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'disk_bus': 'virtio', 'guest_format': None, 'encryption_secret_uuid': None, 'size': 0, 'device_type': 'disk', 'image_id': '3bef8470-ecc7-40e3-95d4-9254348ea72d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75229) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 09:55:04 user nova-compute[75229]: WARNING nova.virt.libvirt.driver [None req-6e10b008-a154-4717-b4b7-c10555132ebe tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 09:55:04 user nova-compute[75229]: WARNING nova.virt.libvirt.driver [None req-6e10b008-a154-4717-b4b7-c10555132ebe tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 09:55:04 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-6e10b008-a154-4717-b4b7-c10555132ebe tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75229) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 09:55:04 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-6e10b008-a154-4717-b4b7-c10555132ebe tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] CPU controller missing on host. {{(pid=75229) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 09:55:04 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-6e10b008-a154-4717-b4b7-c10555132ebe tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75229) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 09:55:04 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-6e10b008-a154-4717-b4b7-c10555132ebe tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] CPU controller found on host. {{(pid=75229) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 09:55:04 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-6e10b008-a154-4717-b4b7-c10555132ebe tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75229) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 09:55:04 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-6e10b008-a154-4717-b4b7-c10555132ebe tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T09:39:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='e4178d92a1aa8067fedd318f41d3f76d',container_format='bare',created_at=2023-11-14T09:53:06Z,direct_url=<?>,disk_format='qcow2',id=172b5bd6-0f99-4c5b-b24e-002da5ca6798,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-96778093-shelved',owner='ee9447f169de43829fe3ed51592752e9',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-11-14T09:53:10Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 09:55:04 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-6e10b008-a154-4717-b4b7-c10555132ebe tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Flavor limits 0:0:0 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 09:55:04 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-6e10b008-a154-4717-b4b7-c10555132ebe tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Image limits 0:0:0 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 09:55:04 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-6e10b008-a154-4717-b4b7-c10555132ebe tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Flavor pref 0:0:0 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 09:55:04 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-6e10b008-a154-4717-b4b7-c10555132ebe tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Image pref 0:0:0 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 09:55:04 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-6e10b008-a154-4717-b4b7-c10555132ebe tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 09:55:04 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-6e10b008-a154-4717-b4b7-c10555132ebe tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 09:55:04 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-6e10b008-a154-4717-b4b7-c10555132ebe tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75229) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 09:55:04 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-6e10b008-a154-4717-b4b7-c10555132ebe tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Got 1 possible topologies {{(pid=75229) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 09:55:04 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-6e10b008-a154-4717-b4b7-c10555132ebe tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 09:55:04 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-6e10b008-a154-4717-b4b7-c10555132ebe tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 09:55:04 user nova-compute[75229]: DEBUG nova.objects.instance [None req-6e10b008-a154-4717-b4b7-c10555132ebe tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Lazy-loading 'vcpu_model' on Instance uuid d73f431b-d002-4206-8b52-7d313a43dccb {{(pid=75229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 09:55:04 user nova-compute[75229]: DEBUG nova.objects.base [None req-6e10b008-a154-4717-b4b7-c10555132ebe tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Object Instance<d73f431b-d002-4206-8b52-7d313a43dccb> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=75229) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 09:55:04 user nova-compute[75229]: DEBUG nova.virt.libvirt.vif [None req-6e10b008-a154-4717-b4b7-c10555132ebe tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-14T09:51:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-96778093',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-96778093',id=25,image_ref='172b5bd6-0f99-4c5b-b24e-002da5ca6798',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1883588312',keypairs=<?>,launch_index=0,launched_at=2023-11-14T09:51:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='ee9447f169de43829fe3ed51592752e9',ramdisk_id='',reservation_id='r-9md5usva',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-730167895',owner_user_name='tempest-AttachVolumeShelveTestJSON-730167895-project-member',shelved_at='2023-11-14T09:53:10.065426',shelved_host='user',shelved_image_id='172b5bd6-0f99-4c5b-b24e-002da5ca6798'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T09:54:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='319a0a5ee47a426799d40e0ebb62a3b0',uuid=d73f431b-d002-4206-8b52-7d313a43dccb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "5a68432e-63fc-48e8-bc8c-62e0cd22033c", "address": "fa:16:3e:0c:97:35", "network": {"id": "589aea41-545f-4875-ab56-b7aa273dad6f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-785276916-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.92", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee9447f169de43829fe3ed51592752e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a68432e-63", "ovs_interfaceid": "5a68432e-63fc-48e8-bc8c-62e0cd22033c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75229) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 09:55:04 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-6e10b008-a154-4717-b4b7-c10555132ebe tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Converting VIF {"id": "5a68432e-63fc-48e8-bc8c-62e0cd22033c", "address": "fa:16:3e:0c:97:35", "network": {"id": "589aea41-545f-4875-ab56-b7aa273dad6f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-785276916-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.92", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee9447f169de43829fe3ed51592752e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a68432e-63", "ovs_interfaceid": "5a68432e-63fc-48e8-bc8c-62e0cd22033c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 09:55:04 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-6e10b008-a154-4717-b4b7-c10555132ebe tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0c:97:35,bridge_name='br-int',has_traffic_filtering=True,id=5a68432e-63fc-48e8-bc8c-62e0cd22033c,network=Network(589aea41-545f-4875-ab56-b7aa273dad6f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a68432e-63') {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 09:55:04 user nova-compute[75229]: DEBUG nova.objects.instance [None req-6e10b008-a154-4717-b4b7-c10555132ebe tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Lazy-loading 'pci_devices' on Instance uuid d73f431b-d002-4206-8b52-7d313a43dccb {{(pid=75229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 09:55:04 user nova-compute[75229]: DEBUG nova.objects.base [None req-6e10b008-a154-4717-b4b7-c10555132ebe tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Object Instance<d73f431b-d002-4206-8b52-7d313a43dccb> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=75229) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 09:55:04 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-6e10b008-a154-4717-b4b7-c10555132ebe tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] [instance: d73f431b-d002-4206-8b52-7d313a43dccb] End _get_guest_xml xml=<domain type="kvm">
Nov 14 09:55:04 user nova-compute[75229]:   <uuid>d73f431b-d002-4206-8b52-7d313a43dccb</uuid>
Nov 14 09:55:04 user nova-compute[75229]:   <name>instance-00000019</name>
Nov 14 09:55:04 user nova-compute[75229]:   <memory>524288</memory>
Nov 14 09:55:04 user nova-compute[75229]:   <vcpu>1</vcpu>
Nov 14 09:55:04 user nova-compute[75229]:   <metadata>
Nov 14 09:55:04 user nova-compute[75229]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 09:55:04 user nova-compute[75229]:       <nova:package version="0.0.0"/>
Nov 14 09:55:04 user nova-compute[75229]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-96778093</nova:name>
Nov 14 09:55:04 user nova-compute[75229]:       <nova:creationTime>2023-11-14 09:55:04</nova:creationTime>
Nov 14 09:55:04 user nova-compute[75229]:       <nova:flavor name="m1.tiny">
Nov 14 09:55:04 user nova-compute[75229]:         <nova:memory>512</nova:memory>
Nov 14 09:55:04 user nova-compute[75229]:         <nova:disk>1</nova:disk>
Nov 14 09:55:04 user nova-compute[75229]:         <nova:swap>0</nova:swap>
Nov 14 09:55:04 user nova-compute[75229]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 09:55:04 user nova-compute[75229]:         <nova:vcpus>1</nova:vcpus>
Nov 14 09:55:04 user nova-compute[75229]:       </nova:flavor>
Nov 14 09:55:04 user nova-compute[75229]:       <nova:owner>
Nov 14 09:55:04 user nova-compute[75229]:         <nova:user uuid="319a0a5ee47a426799d40e0ebb62a3b0">tempest-AttachVolumeShelveTestJSON-730167895-project-member</nova:user>
Nov 14 09:55:04 user nova-compute[75229]:         <nova:project uuid="ee9447f169de43829fe3ed51592752e9">tempest-AttachVolumeShelveTestJSON-730167895</nova:project>
Nov 14 09:55:04 user nova-compute[75229]:       </nova:owner>
Nov 14 09:55:04 user nova-compute[75229]:       <nova:root type="image" uuid="172b5bd6-0f99-4c5b-b24e-002da5ca6798"/>
Nov 14 09:55:04 user nova-compute[75229]:       <nova:ports>
Nov 14 09:55:04 user nova-compute[75229]:         <nova:port uuid="5a68432e-63fc-48e8-bc8c-62e0cd22033c">
Nov 14 09:55:04 user nova-compute[75229]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 14 09:55:04 user nova-compute[75229]:         </nova:port>
Nov 14 09:55:04 user nova-compute[75229]:       </nova:ports>
Nov 14 09:55:04 user nova-compute[75229]:     </nova:instance>
Nov 14 09:55:04 user nova-compute[75229]:   </metadata>
Nov 14 09:55:04 user nova-compute[75229]:   <sysinfo type="smbios">
Nov 14 09:55:04 user nova-compute[75229]:     <system>
Nov 14 09:55:04 user nova-compute[75229]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 09:55:04 user nova-compute[75229]:       <entry name="product">OpenStack Nova</entry>
Nov 14 09:55:04 user nova-compute[75229]:       <entry name="version">0.0.0</entry>
Nov 14 09:55:04 user nova-compute[75229]:       <entry name="serial">d73f431b-d002-4206-8b52-7d313a43dccb</entry>
Nov 14 09:55:04 user nova-compute[75229]:       <entry name="uuid">d73f431b-d002-4206-8b52-7d313a43dccb</entry>
Nov 14 09:55:04 user nova-compute[75229]:       <entry name="family">Virtual Machine</entry>
Nov 14 09:55:04 user nova-compute[75229]:     </system>
Nov 14 09:55:04 user nova-compute[75229]:   </sysinfo>
Nov 14 09:55:04 user nova-compute[75229]:   <os>
Nov 14 09:55:04 user nova-compute[75229]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 09:55:04 user nova-compute[75229]:     <boot dev="hd"/>
Nov 14 09:55:04 user nova-compute[75229]:     <smbios mode="sysinfo"/>
Nov 14 09:55:04 user nova-compute[75229]:   </os>
Nov 14 09:55:04 user nova-compute[75229]:   <features>
Nov 14 09:55:04 user nova-compute[75229]:     <acpi/>
Nov 14 09:55:04 user nova-compute[75229]:     <apic/>
Nov 14 09:55:04 user nova-compute[75229]:     <vmcoreinfo/>
Nov 14 09:55:04 user nova-compute[75229]:   </features>
Nov 14 09:55:04 user nova-compute[75229]:   <clock offset="utc">
Nov 14 09:55:04 user nova-compute[75229]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 09:55:04 user nova-compute[75229]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 09:55:04 user nova-compute[75229]:     <timer name="hpet" present="no"/>
Nov 14 09:55:04 user nova-compute[75229]:   </clock>
Nov 14 09:55:04 user nova-compute[75229]:   <cpu mode="custom" match="exact">
Nov 14 09:55:04 user nova-compute[75229]:     <model>Nehalem</model>
Nov 14 09:55:04 user nova-compute[75229]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 09:55:04 user nova-compute[75229]:   </cpu>
Nov 14 09:55:04 user nova-compute[75229]:   <devices>
Nov 14 09:55:04 user nova-compute[75229]:     <disk type="file" device="disk">
Nov 14 09:55:04 user nova-compute[75229]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 09:55:04 user nova-compute[75229]:       <source file="/opt/stack/data/nova/instances/d73f431b-d002-4206-8b52-7d313a43dccb/disk"/>
Nov 14 09:55:04 user nova-compute[75229]:       <target dev="vda" bus="virtio"/>
Nov 14 09:55:04 user nova-compute[75229]:     </disk>
Nov 14 09:55:04 user nova-compute[75229]:     <interface type="ethernet">
Nov 14 09:55:04 user nova-compute[75229]:       <mac address="fa:16:3e:0c:97:35"/>
Nov 14 09:55:04 user nova-compute[75229]:       <model type="virtio"/>
Nov 14 09:55:04 user nova-compute[75229]:       <mtu size="1442"/>
Nov 14 09:55:04 user nova-compute[75229]:       <target dev="tap5a68432e-63"/>
Nov 14 09:55:04 user nova-compute[75229]:     </interface>
Nov 14 09:55:04 user nova-compute[75229]:     <serial type="pty">
Nov 14 09:55:04 user nova-compute[75229]:       <log file="/opt/stack/data/nova/instances/d73f431b-d002-4206-8b52-7d313a43dccb/console.log" append="off"/>
Nov 14 09:55:04 user nova-compute[75229]:     </serial>
Nov 14 09:55:04 user nova-compute[75229]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 09:55:04 user nova-compute[75229]:     <video>
Nov 14 09:55:04 user nova-compute[75229]:       <model type="virtio"/>
Nov 14 09:55:04 user nova-compute[75229]:     </video>
Nov 14 09:55:04 user nova-compute[75229]:     <rng model="virtio">
Nov 14 09:55:04 user nova-compute[75229]:       <backend model="random">/dev/urandom</backend>
Nov 14 09:55:04 user nova-compute[75229]:     </rng>
Nov 14 09:55:04 user nova-compute[75229]:     <controller type="usb" index="0" model="none"/>
Nov 14 09:55:04 user nova-compute[75229]:     <memballoon model="virtio">
Nov 14 09:55:04 user nova-compute[75229]:       <stats period="10"/>
Nov 14 09:55:04 user nova-compute[75229]:     </memballoon>
Nov 14 09:55:04 user nova-compute[75229]:   </devices>
Nov 14 09:55:04 user nova-compute[75229]: </domain>
Nov 14 09:55:04 user nova-compute[75229]:  {{(pid=75229) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 09:55:04 user nova-compute[75229]: DEBUG nova.virt.libvirt.vif [None req-6e10b008-a154-4717-b4b7-c10555132ebe tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-14T09:51:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-96778093',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-96778093',id=25,image_ref='172b5bd6-0f99-4c5b-b24e-002da5ca6798',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1883588312',keypairs=<?>,launch_index=0,launched_at=2023-11-14T09:51:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='ee9447f169de43829fe3ed51592752e9',ramdisk_id='',reservation_id='r-9md5usva',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-730167895',owner_user_name='tempest-AttachVolumeShelveTestJSON-730167895-project-member',shelved_at='2023-11-14T09:53:10.065426',shelved_host='user',shelved_image_id='172b5bd6-0f99-4c5b-b24e-002da5ca6798'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T09:54:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='319a0a5ee47a426799d40e0ebb62a3b0',uuid=d73f431b-d002-4206-8b52-7d313a43dccb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "5a68432e-63fc-48e8-bc8c-62e0cd22033c", "address": "fa:16:3e:0c:97:35", "network": {"id": "589aea41-545f-4875-ab56-b7aa273dad6f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-785276916-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.92", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee9447f169de43829fe3ed51592752e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a68432e-63", "ovs_interfaceid": "5a68432e-63fc-48e8-bc8c-62e0cd22033c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 09:55:04 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-6e10b008-a154-4717-b4b7-c10555132ebe tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Converting VIF {"id": "5a68432e-63fc-48e8-bc8c-62e0cd22033c", "address": "fa:16:3e:0c:97:35", "network": {"id": "589aea41-545f-4875-ab56-b7aa273dad6f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-785276916-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.92", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee9447f169de43829fe3ed51592752e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a68432e-63", "ovs_interfaceid": "5a68432e-63fc-48e8-bc8c-62e0cd22033c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 09:55:04 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-6e10b008-a154-4717-b4b7-c10555132ebe tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0c:97:35,bridge_name='br-int',has_traffic_filtering=True,id=5a68432e-63fc-48e8-bc8c-62e0cd22033c,network=Network(589aea41-545f-4875-ab56-b7aa273dad6f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a68432e-63') {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 09:55:04 user nova-compute[75229]: DEBUG os_vif [None req-6e10b008-a154-4717-b4b7-c10555132ebe tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0c:97:35,bridge_name='br-int',has_traffic_filtering=True,id=5a68432e-63fc-48e8-bc8c-62e0cd22033c,network=Network(589aea41-545f-4875-ab56-b7aa273dad6f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a68432e-63') {{(pid=75229) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 09:55:04 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:55:04 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:55:04 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 09:55:04 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:55:04 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9b0f6f75-3666-51eb-bfbf-598a2db1d4c6', '_type': 'linux-noop'}}, row=False) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:55:04 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:55:04 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 09:55:04 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:55:04 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5a68432e-63, may_exist=True, interface_attrs={}) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:55:04 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5a68432e-63, col_values=(('qos', UUID('aab73209-5fe4-4d3f-bdd1-4f11a093aa90')),), if_exists=True) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:55:04 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5a68432e-63, col_values=(('external_ids', {'iface-id': '5a68432e-63fc-48e8-bc8c-62e0cd22033c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0c:97:35', 'vm-uuid': 'd73f431b-d002-4206-8b52-7d313a43dccb'}),), if_exists=True) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:55:04 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:55:04 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 09:55:04 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:55:04 user nova-compute[75229]: INFO os_vif [None req-6e10b008-a154-4717-b4b7-c10555132ebe tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0c:97:35,bridge_name='br-int',has_traffic_filtering=True,id=5a68432e-63fc-48e8-bc8c-62e0cd22033c,network=Network(589aea41-545f-4875-ab56-b7aa273dad6f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a68432e-63')
Nov 14 09:55:04 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-6e10b008-a154-4717-b4b7-c10555132ebe tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] No BDM found with device name vda, not building metadata. {{(pid=75229) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 09:55:04 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-6e10b008-a154-4717-b4b7-c10555132ebe tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] No VIF found with MAC fa:16:3e:0c:97:35, not building metadata {{(pid=75229) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 09:55:06 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:55:06 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:55:06 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:55:06 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:55:06 user nova-compute[75229]: DEBUG nova.compute.manager [req-74b2063a-b6bf-43da-a10c-b00655996fb5 req-8e6c8ed8-6053-4d5a-94a0-6f60863ff37b service nova] [instance: d73f431b-d002-4206-8b52-7d313a43dccb] Received event network-vif-plugged-5a68432e-63fc-48e8-bc8c-62e0cd22033c {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:55:06 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-74b2063a-b6bf-43da-a10c-b00655996fb5 req-8e6c8ed8-6053-4d5a-94a0-6f60863ff37b service nova] Acquiring lock "d73f431b-d002-4206-8b52-7d313a43dccb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:55:06 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-74b2063a-b6bf-43da-a10c-b00655996fb5 req-8e6c8ed8-6053-4d5a-94a0-6f60863ff37b service nova] Lock "d73f431b-d002-4206-8b52-7d313a43dccb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:55:06 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-74b2063a-b6bf-43da-a10c-b00655996fb5 req-8e6c8ed8-6053-4d5a-94a0-6f60863ff37b service nova] Lock "d73f431b-d002-4206-8b52-7d313a43dccb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:55:06 user nova-compute[75229]: DEBUG nova.compute.manager [req-74b2063a-b6bf-43da-a10c-b00655996fb5 req-8e6c8ed8-6053-4d5a-94a0-6f60863ff37b service nova] [instance: d73f431b-d002-4206-8b52-7d313a43dccb] No waiting events found dispatching network-vif-plugged-5a68432e-63fc-48e8-bc8c-62e0cd22033c {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 09:55:06 user nova-compute[75229]: WARNING nova.compute.manager [req-74b2063a-b6bf-43da-a10c-b00655996fb5 req-8e6c8ed8-6053-4d5a-94a0-6f60863ff37b service nova] [instance: d73f431b-d002-4206-8b52-7d313a43dccb] Received unexpected event network-vif-plugged-5a68432e-63fc-48e8-bc8c-62e0cd22033c for instance with vm_state shelved_offloaded and task_state spawning.
Nov 14 09:55:06 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:55:06 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:55:07 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:55:07 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:55:08 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:55:08 user nova-compute[75229]: DEBUG nova.compute.manager [None req-6e10b008-a154-4717-b4b7-c10555132ebe tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] [instance: d73f431b-d002-4206-8b52-7d313a43dccb] Instance event wait completed in 0 seconds for  {{(pid=75229) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 09:55:08 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-6e10b008-a154-4717-b4b7-c10555132ebe tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] [instance: d73f431b-d002-4206-8b52-7d313a43dccb] Guest created on hypervisor {{(pid=75229) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 09:55:08 user nova-compute[75229]: INFO nova.virt.libvirt.driver [-] [instance: d73f431b-d002-4206-8b52-7d313a43dccb] Instance spawned successfully.
Nov 14 09:55:08 user nova-compute[75229]: DEBUG nova.compute.manager [req-81bd1507-f227-4f8b-932c-c0071f3b0732 req-16522d29-189b-47d5-9fb5-7f528e373a0d service nova] [instance: d73f431b-d002-4206-8b52-7d313a43dccb] Received event network-vif-plugged-5a68432e-63fc-48e8-bc8c-62e0cd22033c {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:55:08 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-81bd1507-f227-4f8b-932c-c0071f3b0732 req-16522d29-189b-47d5-9fb5-7f528e373a0d service nova] Acquiring lock "d73f431b-d002-4206-8b52-7d313a43dccb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:55:08 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-81bd1507-f227-4f8b-932c-c0071f3b0732 req-16522d29-189b-47d5-9fb5-7f528e373a0d service nova] Lock "d73f431b-d002-4206-8b52-7d313a43dccb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:55:08 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-81bd1507-f227-4f8b-932c-c0071f3b0732 req-16522d29-189b-47d5-9fb5-7f528e373a0d service nova] Lock "d73f431b-d002-4206-8b52-7d313a43dccb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:55:08 user nova-compute[75229]: DEBUG nova.compute.manager [req-81bd1507-f227-4f8b-932c-c0071f3b0732 req-16522d29-189b-47d5-9fb5-7f528e373a0d service nova] [instance: d73f431b-d002-4206-8b52-7d313a43dccb] No waiting events found dispatching network-vif-plugged-5a68432e-63fc-48e8-bc8c-62e0cd22033c {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 09:55:08 user nova-compute[75229]: WARNING nova.compute.manager [req-81bd1507-f227-4f8b-932c-c0071f3b0732 req-16522d29-189b-47d5-9fb5-7f528e373a0d service nova] [instance: d73f431b-d002-4206-8b52-7d313a43dccb] Received unexpected event network-vif-plugged-5a68432e-63fc-48e8-bc8c-62e0cd22033c for instance with vm_state shelved_offloaded and task_state spawning.
Nov 14 09:55:08 user nova-compute[75229]: DEBUG nova.compute.manager [None req-6e10b008-a154-4717-b4b7-c10555132ebe tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] [instance: d73f431b-d002-4206-8b52-7d313a43dccb] Checking state {{(pid=75229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 09:55:08 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-6e10b008-a154-4717-b4b7-c10555132ebe tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Lock "d73f431b-d002-4206-8b52-7d313a43dccb" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 10.353s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:55:09 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:55:13 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:55:14 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:55:18 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:55:19 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:55:22 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-a251012f-d2c4-4fd0-963b-c13cfae4b0cf tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Acquiring lock "589f4750-fac6-4e99-a430-0cda339808bc" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:55:22 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-a251012f-d2c4-4fd0-963b-c13cfae4b0cf tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Lock "589f4750-fac6-4e99-a430-0cda339808bc" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:55:22 user nova-compute[75229]: DEBUG nova.compute.manager [None req-a251012f-d2c4-4fd0-963b-c13cfae4b0cf tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] [instance: 589f4750-fac6-4e99-a430-0cda339808bc] Starting instance... {{(pid=75229) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 09:55:22 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-a251012f-d2c4-4fd0-963b-c13cfae4b0cf tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:55:22 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-a251012f-d2c4-4fd0-963b-c13cfae4b0cf tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:55:22 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-a251012f-d2c4-4fd0-963b-c13cfae4b0cf tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75229) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 09:55:22 user nova-compute[75229]: INFO nova.compute.claims [None req-a251012f-d2c4-4fd0-963b-c13cfae4b0cf tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] [instance: 589f4750-fac6-4e99-a430-0cda339808bc] Claim successful on node user
Nov 14 09:55:22 user nova-compute[75229]: DEBUG nova.compute.provider_tree [None req-a251012f-d2c4-4fd0-963b-c13cfae4b0cf tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Inventory has not changed in ProviderTree for provider: d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 {{(pid=75229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 09:55:22 user nova-compute[75229]: DEBUG nova.scheduler.client.report [None req-a251012f-d2c4-4fd0-963b-c13cfae4b0cf tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Inventory has not changed for provider d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 09:55:22 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-a251012f-d2c4-4fd0-963b-c13cfae4b0cf tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.446s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:55:22 user nova-compute[75229]: DEBUG nova.compute.manager [None req-a251012f-d2c4-4fd0-963b-c13cfae4b0cf tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] [instance: 589f4750-fac6-4e99-a430-0cda339808bc] Start building networks asynchronously for instance. {{(pid=75229) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 09:55:22 user nova-compute[75229]: DEBUG nova.compute.manager [None req-a251012f-d2c4-4fd0-963b-c13cfae4b0cf tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] [instance: 589f4750-fac6-4e99-a430-0cda339808bc] Allocating IP information in the background. {{(pid=75229) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 09:55:22 user nova-compute[75229]: DEBUG nova.network.neutron [None req-a251012f-d2c4-4fd0-963b-c13cfae4b0cf tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] [instance: 589f4750-fac6-4e99-a430-0cda339808bc] allocate_for_instance() {{(pid=75229) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 09:55:22 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-a251012f-d2c4-4fd0-963b-c13cfae4b0cf tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] [instance: 589f4750-fac6-4e99-a430-0cda339808bc] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 09:55:22 user nova-compute[75229]: DEBUG nova.compute.manager [None req-a251012f-d2c4-4fd0-963b-c13cfae4b0cf tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] [instance: 589f4750-fac6-4e99-a430-0cda339808bc] Start building block device mappings for instance. {{(pid=75229) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 09:55:22 user nova-compute[75229]: DEBUG nova.policy [None req-a251012f-d2c4-4fd0-963b-c13cfae4b0cf tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c0c381a0f6124f1ca6ce85c057b9143a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46e65cdd021f4a3db7c9254bb6d98b46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75229) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 09:55:22 user nova-compute[75229]: INFO nova.virt.block_device [None req-a251012f-d2c4-4fd0-963b-c13cfae4b0cf tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] [instance: 589f4750-fac6-4e99-a430-0cda339808bc] Booting with volume a5efb0e0-a85c-46ec-8a9d-2763bf548023 at /dev/vda
Nov 14 09:55:22 user nova-compute[75229]: DEBUG os_brick.utils [None req-a251012f-d2c4-4fd0-963b-c13cfae4b0cf tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 09:55:22 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:55:23 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:55:23 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[3652387c-360d-4778-8c49-2782366fb3a8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f1154031c835\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:55:23 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:55:23 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:55:23 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8464908-be39-4fbc-a908-b7a9025dc7c5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:55:23 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:55:23 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:55:23 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4335b38-56ac-468f-a411-804648dd16b2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:55:23 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd97ee1d-6ea3-4bd6-b6a0-63177f2c1c9b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:55:23 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-a251012f-d2c4-4fd0-963b-c13cfae4b0cf tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Running cmd (subprocess): nvme version {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:55:23 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-a251012f-d2c4-4fd0-963b-c13cfae4b0cf tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] 'nvme version' failed. Not Retrying. {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 09:55:23 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a251012f-d2c4-4fd0-963b-c13cfae4b0cf tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] nvme not present on system {{(pid=75229) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 09:55:23 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:55:23 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 09:55:23 user nova-compute[75229]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 09:55:23 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b7dc5b5-8ab5-481d-99cf-6be3cbc03f95]: (4, '') {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:55:23 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.lightos [None req-a251012f-d2c4-4fd0-963b-c13cfae4b0cf tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75229) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 09:55:23 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.lightos [None req-a251012f-d2c4-4fd0-963b-c13cfae4b0cf tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75229) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 09:55:23 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.lightos [None req-a251012f-d2c4-4fd0-963b-c13cfae4b0cf tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] LIGHTOS: no hostnqn found. {{(pid=75229) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 09:55:23 user nova-compute[75229]: DEBUG os_brick.utils [None req-a251012f-d2c4-4fd0-963b-c13cfae4b0cf tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] <== get_connector_properties: return (145ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f1154031c835', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 09:55:23 user nova-compute[75229]: DEBUG nova.virt.block_device [None req-a251012f-d2c4-4fd0-963b-c13cfae4b0cf tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] [instance: 589f4750-fac6-4e99-a430-0cda339808bc] Updating existing volume attachment record: fd501fbb-4b72-462e-927a-9cf9a2933220 {{(pid=75229) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 09:55:23 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:55:23 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:55:23 user nova-compute[75229]: DEBUG nova.network.neutron [None req-a251012f-d2c4-4fd0-963b-c13cfae4b0cf tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] [instance: 589f4750-fac6-4e99-a430-0cda339808bc] Successfully created port: e10815ba-0472-4ed0-af80-b4d0904580af {{(pid=75229) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 09:55:24 user nova-compute[75229]: DEBUG nova.compute.manager [req-5e81a67e-c591-4d07-8bb5-41c3ee0db066 req-07d0549c-a17c-4775-a234-ae9fc09fb384 service nova] [instance: 564d95eb-81c0-47a5-9979-2318fced06f5] Received event network-changed-81c08c89-9d11-4321-b1c6-d61800dac599 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:55:24 user nova-compute[75229]: DEBUG nova.compute.manager [req-5e81a67e-c591-4d07-8bb5-41c3ee0db066 req-07d0549c-a17c-4775-a234-ae9fc09fb384 service nova] [instance: 564d95eb-81c0-47a5-9979-2318fced06f5] Refreshing instance network info cache due to event network-changed-81c08c89-9d11-4321-b1c6-d61800dac599. {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 09:55:24 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-5e81a67e-c591-4d07-8bb5-41c3ee0db066 req-07d0549c-a17c-4775-a234-ae9fc09fb384 service nova] Acquiring lock "refresh_cache-564d95eb-81c0-47a5-9979-2318fced06f5" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 09:55:24 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-5e81a67e-c591-4d07-8bb5-41c3ee0db066 req-07d0549c-a17c-4775-a234-ae9fc09fb384 service nova] Acquired lock "refresh_cache-564d95eb-81c0-47a5-9979-2318fced06f5" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 09:55:24 user nova-compute[75229]: DEBUG nova.network.neutron [req-5e81a67e-c591-4d07-8bb5-41c3ee0db066 req-07d0549c-a17c-4775-a234-ae9fc09fb384 service nova] [instance: 564d95eb-81c0-47a5-9979-2318fced06f5] Refreshing network info cache for port 81c08c89-9d11-4321-b1c6-d61800dac599 {{(pid=75229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 09:55:24 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-b665b7fe-4ce9-46d5-b5d1-c1f67baca9b9 tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] Acquiring lock "564d95eb-81c0-47a5-9979-2318fced06f5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:55:24 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-b665b7fe-4ce9-46d5-b5d1-c1f67baca9b9 tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] Lock "564d95eb-81c0-47a5-9979-2318fced06f5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:55:24 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-b665b7fe-4ce9-46d5-b5d1-c1f67baca9b9 tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] Acquiring lock "564d95eb-81c0-47a5-9979-2318fced06f5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:55:24 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-b665b7fe-4ce9-46d5-b5d1-c1f67baca9b9 tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] Lock "564d95eb-81c0-47a5-9979-2318fced06f5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:55:24 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-b665b7fe-4ce9-46d5-b5d1-c1f67baca9b9 tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] Lock "564d95eb-81c0-47a5-9979-2318fced06f5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:55:24 user nova-compute[75229]: INFO nova.compute.manager [None req-b665b7fe-4ce9-46d5-b5d1-c1f67baca9b9 tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] [instance: 564d95eb-81c0-47a5-9979-2318fced06f5] Terminating instance
Nov 14 09:55:24 user nova-compute[75229]: DEBUG nova.compute.manager [None req-b665b7fe-4ce9-46d5-b5d1-c1f67baca9b9 tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] [instance: 564d95eb-81c0-47a5-9979-2318fced06f5] Start destroying the instance on the hypervisor. {{(pid=75229) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 09:55:24 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:55:24 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:55:24 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:55:24 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:55:24 user nova-compute[75229]: DEBUG nova.network.neutron [req-5e81a67e-c591-4d07-8bb5-41c3ee0db066 req-07d0549c-a17c-4775-a234-ae9fc09fb384 service nova] [instance: 564d95eb-81c0-47a5-9979-2318fced06f5] Updated VIF entry in instance network info cache for port 81c08c89-9d11-4321-b1c6-d61800dac599. {{(pid=75229) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 09:55:24 user nova-compute[75229]: DEBUG nova.network.neutron [req-5e81a67e-c591-4d07-8bb5-41c3ee0db066 req-07d0549c-a17c-4775-a234-ae9fc09fb384 service nova] [instance: 564d95eb-81c0-47a5-9979-2318fced06f5] Updating instance_info_cache with network_info: [{"id": "81c08c89-9d11-4321-b1c6-d61800dac599", "address": "fa:16:3e:36:da:ae", "network": {"id": "8d89f286-0349-4334-b27a-873f684d3652", "bridge": "br-int", "label": "tempest-TestStampPattern-841799214-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a196548d9de4e18b8bab9fefdab0861", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81c08c89-9d", "ovs_interfaceid": "81c08c89-9d11-4321-b1c6-d61800dac599", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 09:55:24 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-5e81a67e-c591-4d07-8bb5-41c3ee0db066 req-07d0549c-a17c-4775-a234-ae9fc09fb384 service nova] Releasing lock "refresh_cache-564d95eb-81c0-47a5-9979-2318fced06f5" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 09:55:24 user nova-compute[75229]: DEBUG nova.network.neutron [None req-a251012f-d2c4-4fd0-963b-c13cfae4b0cf tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] [instance: 589f4750-fac6-4e99-a430-0cda339808bc] Successfully updated port: e10815ba-0472-4ed0-af80-b4d0904580af {{(pid=75229) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 09:55:24 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-a251012f-d2c4-4fd0-963b-c13cfae4b0cf tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Acquiring lock "refresh_cache-589f4750-fac6-4e99-a430-0cda339808bc" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 09:55:24 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-a251012f-d2c4-4fd0-963b-c13cfae4b0cf tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Acquired lock "refresh_cache-589f4750-fac6-4e99-a430-0cda339808bc" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 09:55:24 user nova-compute[75229]: DEBUG nova.network.neutron [None req-a251012f-d2c4-4fd0-963b-c13cfae4b0cf tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] [instance: 589f4750-fac6-4e99-a430-0cda339808bc] Building network info cache for instance {{(pid=75229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 09:55:24 user nova-compute[75229]: DEBUG nova.compute.manager [req-ab74450c-dfa6-4774-9c05-6118f5b388fc req-180e332b-09cf-4d0a-9b92-b824905153ae service nova] [instance: 589f4750-fac6-4e99-a430-0cda339808bc] Received event network-changed-e10815ba-0472-4ed0-af80-b4d0904580af {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:55:24 user nova-compute[75229]: DEBUG nova.compute.manager [req-ab74450c-dfa6-4774-9c05-6118f5b388fc req-180e332b-09cf-4d0a-9b92-b824905153ae service nova] [instance: 589f4750-fac6-4e99-a430-0cda339808bc] Refreshing instance network info cache due to event network-changed-e10815ba-0472-4ed0-af80-b4d0904580af. {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 09:55:24 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-ab74450c-dfa6-4774-9c05-6118f5b388fc req-180e332b-09cf-4d0a-9b92-b824905153ae service nova] Acquiring lock "refresh_cache-589f4750-fac6-4e99-a430-0cda339808bc" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 09:55:24 user nova-compute[75229]: DEBUG nova.network.neutron [None req-a251012f-d2c4-4fd0-963b-c13cfae4b0cf tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] [instance: 589f4750-fac6-4e99-a430-0cda339808bc] Instance cache missing network info. {{(pid=75229) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 09:55:24 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:55:25 user nova-compute[75229]: INFO nova.virt.libvirt.driver [-] [instance: 564d95eb-81c0-47a5-9979-2318fced06f5] Instance destroyed successfully.
Nov 14 09:55:25 user nova-compute[75229]: DEBUG nova.objects.instance [None req-b665b7fe-4ce9-46d5-b5d1-c1f67baca9b9 tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] Lazy-loading 'resources' on Instance uuid 564d95eb-81c0-47a5-9979-2318fced06f5 {{(pid=75229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 09:55:25 user nova-compute[75229]: DEBUG nova.virt.libvirt.vif [None req-b665b7fe-4ce9-46d5-b5d1-c1f67baca9b9 tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T09:52:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-1367355019',display_name='tempest-TestStampPattern-server-1367355019',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1367355019',id=27,image_ref='219fc96b-99d8-4658-ba51-02adfcfd4a2a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC4/xEtZHm9Yk+8VKGmlmnaP2DqqxnCgXK/PuxMNYGLOnEJxt/VGvxZAFawEytkJILlGgczmBioMsbqPdSyGvSqffIJvSQLFesfq/9wXT8F6tu1JAnyvbNVNg8/xsFVJ6w==',key_name='tempest-TestStampPattern-1732599618',keypairs=<?>,launch_index=0,launched_at=2023-11-14T09:52:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6a196548d9de4e18b8bab9fefdab0861',ramdisk_id='',reservation_id='r-p8tnzoym',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='a4ce290f-6dd2-44b6-91be-8e775045837e',image_min_disk='1',image_min_ram='0',image_owner_id='6a196548d9de4e18b8bab9fefdab0861',image_owner_project_name='tempest-TestStampPattern-1637982262',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1637982262-project-member',image_user_id='9b525334713e47ceb8f71035116d5c36',owner_project_name='tempest-TestStampPattern-1637982262',owner_user_name='tempest-TestStampPattern-1637982262-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T09:52:40Z,user_data=None,user_id='9b525334713e47ceb8f71035116d5c36',uuid=564d95eb-81c0-47a5-9979-2318fced06f5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "81c08c89-9d11-4321-b1c6-d61800dac599", "address": "fa:16:3e:36:da:ae", "network": {"id": "8d89f286-0349-4334-b27a-873f684d3652", "bridge": "br-int", "label": "tempest-TestStampPattern-841799214-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.235", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a196548d9de4e18b8bab9fefdab0861", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81c08c89-9d", "ovs_interfaceid": "81c08c89-9d11-4321-b1c6-d61800dac599", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 09:55:25 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-b665b7fe-4ce9-46d5-b5d1-c1f67baca9b9 tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] Converting VIF {"id": "81c08c89-9d11-4321-b1c6-d61800dac599", "address": "fa:16:3e:36:da:ae", "network": {"id": "8d89f286-0349-4334-b27a-873f684d3652", "bridge": "br-int", "label": "tempest-TestStampPattern-841799214-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.235", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a196548d9de4e18b8bab9fefdab0861", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81c08c89-9d", "ovs_interfaceid": "81c08c89-9d11-4321-b1c6-d61800dac599", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 09:55:25 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-b665b7fe-4ce9-46d5-b5d1-c1f67baca9b9 tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:36:da:ae,bridge_name='br-int',has_traffic_filtering=True,id=81c08c89-9d11-4321-b1c6-d61800dac599,network=Network(8d89f286-0349-4334-b27a-873f684d3652),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap81c08c89-9d') {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 09:55:25 user nova-compute[75229]: DEBUG os_vif [None req-b665b7fe-4ce9-46d5-b5d1-c1f67baca9b9 tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:36:da:ae,bridge_name='br-int',has_traffic_filtering=True,id=81c08c89-9d11-4321-b1c6-d61800dac599,network=Network(8d89f286-0349-4334-b27a-873f684d3652),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap81c08c89-9d') {{(pid=75229) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 09:55:25 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:55:25 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap81c08c89-9d, bridge=br-int, if_exists=True) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:55:25 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:55:25 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 09:55:25 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:55:25 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5819ebf5-def9-44ca-aa3e-eca8a6b785d3) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:55:25 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:55:25 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:55:25 user nova-compute[75229]: INFO os_vif [None req-b665b7fe-4ce9-46d5-b5d1-c1f67baca9b9 tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:36:da:ae,bridge_name='br-int',has_traffic_filtering=True,id=81c08c89-9d11-4321-b1c6-d61800dac599,network=Network(8d89f286-0349-4334-b27a-873f684d3652),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap81c08c89-9d')
Nov 14 09:55:25 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-b665b7fe-4ce9-46d5-b5d1-c1f67baca9b9 tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] [instance: 564d95eb-81c0-47a5-9979-2318fced06f5] Deleting instance files /opt/stack/data/nova/instances/564d95eb-81c0-47a5-9979-2318fced06f5_del
Nov 14 09:55:25 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-b665b7fe-4ce9-46d5-b5d1-c1f67baca9b9 tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] [instance: 564d95eb-81c0-47a5-9979-2318fced06f5] Deletion of /opt/stack/data/nova/instances/564d95eb-81c0-47a5-9979-2318fced06f5_del complete
Nov 14 09:55:25 user nova-compute[75229]: DEBUG nova.network.neutron [None req-a251012f-d2c4-4fd0-963b-c13cfae4b0cf tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] [instance: 589f4750-fac6-4e99-a430-0cda339808bc] Updating instance_info_cache with network_info: [{"id": "e10815ba-0472-4ed0-af80-b4d0904580af", "address": "fa:16:3e:aa:81:3e", "network": {"id": "5dfc532f-3d5d-4342-b7f1-12c9c3992a54", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1457278473-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46e65cdd021f4a3db7c9254bb6d98b46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape10815ba-04", "ovs_interfaceid": "e10815ba-0472-4ed0-af80-b4d0904580af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 09:55:25 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-a251012f-d2c4-4fd0-963b-c13cfae4b0cf tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Releasing lock "refresh_cache-589f4750-fac6-4e99-a430-0cda339808bc" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 09:55:25 user nova-compute[75229]: DEBUG nova.compute.manager [None req-a251012f-d2c4-4fd0-963b-c13cfae4b0cf tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] [instance: 589f4750-fac6-4e99-a430-0cda339808bc] Instance network_info: |[{"id": "e10815ba-0472-4ed0-af80-b4d0904580af", "address": "fa:16:3e:aa:81:3e", "network": {"id": "5dfc532f-3d5d-4342-b7f1-12c9c3992a54", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1457278473-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46e65cdd021f4a3db7c9254bb6d98b46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape10815ba-04", "ovs_interfaceid": "e10815ba-0472-4ed0-af80-b4d0904580af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75229) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 09:55:25 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-ab74450c-dfa6-4774-9c05-6118f5b388fc req-180e332b-09cf-4d0a-9b92-b824905153ae service nova] Acquired lock "refresh_cache-589f4750-fac6-4e99-a430-0cda339808bc" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 09:55:25 user nova-compute[75229]: DEBUG nova.network.neutron [req-ab74450c-dfa6-4774-9c05-6118f5b388fc req-180e332b-09cf-4d0a-9b92-b824905153ae service nova] [instance: 589f4750-fac6-4e99-a430-0cda339808bc] Refreshing network info cache for port e10815ba-0472-4ed0-af80-b4d0904580af {{(pid=75229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 09:55:25 user nova-compute[75229]: INFO nova.compute.manager [None req-b665b7fe-4ce9-46d5-b5d1-c1f67baca9b9 tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] [instance: 564d95eb-81c0-47a5-9979-2318fced06f5] Took 0.97 seconds to destroy the instance on the hypervisor.
Nov 14 09:55:25 user nova-compute[75229]: DEBUG oslo.service.loopingcall [None req-b665b7fe-4ce9-46d5-b5d1-c1f67baca9b9 tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75229) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 09:55:25 user nova-compute[75229]: DEBUG nova.compute.manager [-] [instance: 564d95eb-81c0-47a5-9979-2318fced06f5] Deallocating network for instance {{(pid=75229) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 09:55:25 user nova-compute[75229]: DEBUG nova.network.neutron [-] [instance: 564d95eb-81c0-47a5-9979-2318fced06f5] deallocate_for_instance() {{(pid=75229) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 09:55:25 user nova-compute[75229]: DEBUG nova.network.neutron [req-ab74450c-dfa6-4774-9c05-6118f5b388fc req-180e332b-09cf-4d0a-9b92-b824905153ae service nova] [instance: 589f4750-fac6-4e99-a430-0cda339808bc] Updated VIF entry in instance network info cache for port e10815ba-0472-4ed0-af80-b4d0904580af. {{(pid=75229) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 09:55:25 user nova-compute[75229]: DEBUG nova.network.neutron [req-ab74450c-dfa6-4774-9c05-6118f5b388fc req-180e332b-09cf-4d0a-9b92-b824905153ae service nova] [instance: 589f4750-fac6-4e99-a430-0cda339808bc] Updating instance_info_cache with network_info: [{"id": "e10815ba-0472-4ed0-af80-b4d0904580af", "address": "fa:16:3e:aa:81:3e", "network": {"id": "5dfc532f-3d5d-4342-b7f1-12c9c3992a54", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1457278473-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46e65cdd021f4a3db7c9254bb6d98b46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape10815ba-04", "ovs_interfaceid": "e10815ba-0472-4ed0-af80-b4d0904580af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 09:55:25 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-ab74450c-dfa6-4774-9c05-6118f5b388fc req-180e332b-09cf-4d0a-9b92-b824905153ae service nova] Releasing lock "refresh_cache-589f4750-fac6-4e99-a430-0cda339808bc" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 09:55:25 user nova-compute[75229]: DEBUG nova.network.neutron [-] [instance: 564d95eb-81c0-47a5-9979-2318fced06f5] Updating instance_info_cache with network_info: [] {{(pid=75229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 09:55:25 user nova-compute[75229]: INFO nova.compute.manager [-] [instance: 564d95eb-81c0-47a5-9979-2318fced06f5] Took 0.59 seconds to deallocate network for instance.
Nov 14 09:55:25 user nova-compute[75229]: DEBUG nova.compute.manager [req-658b0e83-c69e-44a8-9c64-59f9fa5b8f66 req-91868f4d-1c3a-4cdc-80ff-b68fd3ba542e service nova] [instance: 564d95eb-81c0-47a5-9979-2318fced06f5] Received event network-vif-deleted-81c08c89-9d11-4321-b1c6-d61800dac599 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:55:25 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-b665b7fe-4ce9-46d5-b5d1-c1f67baca9b9 tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:55:25 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-b665b7fe-4ce9-46d5-b5d1-c1f67baca9b9 tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:55:26 user nova-compute[75229]: DEBUG nova.compute.provider_tree [None req-b665b7fe-4ce9-46d5-b5d1-c1f67baca9b9 tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] Inventory has not changed in ProviderTree for provider: d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 {{(pid=75229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 09:55:26 user nova-compute[75229]: DEBUG nova.scheduler.client.report [None req-b665b7fe-4ce9-46d5-b5d1-c1f67baca9b9 tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] Inventory has not changed for provider d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 09:55:26 user nova-compute[75229]: DEBUG nova.compute.manager [req-8107f2c6-e8ea-40b9-a131-99325f436898 req-e63c5f3c-bb3b-454e-ab95-b51febb6e348 service nova] [instance: 564d95eb-81c0-47a5-9979-2318fced06f5] Received event network-vif-unplugged-81c08c89-9d11-4321-b1c6-d61800dac599 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:55:26 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-8107f2c6-e8ea-40b9-a131-99325f436898 req-e63c5f3c-bb3b-454e-ab95-b51febb6e348 service nova] Acquiring lock "564d95eb-81c0-47a5-9979-2318fced06f5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:55:26 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-8107f2c6-e8ea-40b9-a131-99325f436898 req-e63c5f3c-bb3b-454e-ab95-b51febb6e348 service nova] Lock "564d95eb-81c0-47a5-9979-2318fced06f5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:55:26 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-8107f2c6-e8ea-40b9-a131-99325f436898 req-e63c5f3c-bb3b-454e-ab95-b51febb6e348 service nova] Lock "564d95eb-81c0-47a5-9979-2318fced06f5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:55:26 user nova-compute[75229]: DEBUG nova.compute.manager [req-8107f2c6-e8ea-40b9-a131-99325f436898 req-e63c5f3c-bb3b-454e-ab95-b51febb6e348 service nova] [instance: 564d95eb-81c0-47a5-9979-2318fced06f5] No waiting events found dispatching network-vif-unplugged-81c08c89-9d11-4321-b1c6-d61800dac599 {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 09:55:26 user nova-compute[75229]: WARNING nova.compute.manager [req-8107f2c6-e8ea-40b9-a131-99325f436898 req-e63c5f3c-bb3b-454e-ab95-b51febb6e348 service nova] [instance: 564d95eb-81c0-47a5-9979-2318fced06f5] Received unexpected event network-vif-unplugged-81c08c89-9d11-4321-b1c6-d61800dac599 for instance with vm_state deleted and task_state None.
Nov 14 09:55:26 user nova-compute[75229]: DEBUG nova.compute.manager [req-8107f2c6-e8ea-40b9-a131-99325f436898 req-e63c5f3c-bb3b-454e-ab95-b51febb6e348 service nova] [instance: 564d95eb-81c0-47a5-9979-2318fced06f5] Received event network-vif-plugged-81c08c89-9d11-4321-b1c6-d61800dac599 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:55:26 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-8107f2c6-e8ea-40b9-a131-99325f436898 req-e63c5f3c-bb3b-454e-ab95-b51febb6e348 service nova] Acquiring lock "564d95eb-81c0-47a5-9979-2318fced06f5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:55:26 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-8107f2c6-e8ea-40b9-a131-99325f436898 req-e63c5f3c-bb3b-454e-ab95-b51febb6e348 service nova] Lock "564d95eb-81c0-47a5-9979-2318fced06f5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:55:26 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-8107f2c6-e8ea-40b9-a131-99325f436898 req-e63c5f3c-bb3b-454e-ab95-b51febb6e348 service nova] Lock "564d95eb-81c0-47a5-9979-2318fced06f5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:55:26 user nova-compute[75229]: DEBUG nova.compute.manager [req-8107f2c6-e8ea-40b9-a131-99325f436898 req-e63c5f3c-bb3b-454e-ab95-b51febb6e348 service nova] [instance: 564d95eb-81c0-47a5-9979-2318fced06f5] No waiting events found dispatching network-vif-plugged-81c08c89-9d11-4321-b1c6-d61800dac599 {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 09:55:26 user nova-compute[75229]: WARNING nova.compute.manager [req-8107f2c6-e8ea-40b9-a131-99325f436898 req-e63c5f3c-bb3b-454e-ab95-b51febb6e348 service nova] [instance: 564d95eb-81c0-47a5-9979-2318fced06f5] Received unexpected event network-vif-plugged-81c08c89-9d11-4321-b1c6-d61800dac599 for instance with vm_state deleted and task_state None.
Nov 14 09:55:26 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-b665b7fe-4ce9-46d5-b5d1-c1f67baca9b9 tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.347s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:55:26 user nova-compute[75229]: INFO nova.scheduler.client.report [None req-b665b7fe-4ce9-46d5-b5d1-c1f67baca9b9 tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] Deleted allocations for instance 564d95eb-81c0-47a5-9979-2318fced06f5
Nov 14 09:55:26 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-b665b7fe-4ce9-46d5-b5d1-c1f67baca9b9 tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] Lock "564d95eb-81c0-47a5-9979-2318fced06f5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.105s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:55:27 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-9d8e201a-193b-485d-a106-711cbcd08262 tempest-VolumesActionsTest-480767440 tempest-VolumesActionsTest-480767440-project-member] Acquiring lock "200e8be8-516b-4344-a584-e88ee79b21a6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:55:27 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-9d8e201a-193b-485d-a106-711cbcd08262 tempest-VolumesActionsTest-480767440 tempest-VolumesActionsTest-480767440-project-member] Lock "200e8be8-516b-4344-a584-e88ee79b21a6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:55:27 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-9d8e201a-193b-485d-a106-711cbcd08262 tempest-VolumesActionsTest-480767440 tempest-VolumesActionsTest-480767440-project-member] Acquiring lock "200e8be8-516b-4344-a584-e88ee79b21a6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:55:27 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-9d8e201a-193b-485d-a106-711cbcd08262 tempest-VolumesActionsTest-480767440 tempest-VolumesActionsTest-480767440-project-member] Lock "200e8be8-516b-4344-a584-e88ee79b21a6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:55:27 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-9d8e201a-193b-485d-a106-711cbcd08262 tempest-VolumesActionsTest-480767440 tempest-VolumesActionsTest-480767440-project-member] Lock "200e8be8-516b-4344-a584-e88ee79b21a6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:55:27 user nova-compute[75229]: INFO nova.compute.manager [None req-9d8e201a-193b-485d-a106-711cbcd08262 tempest-VolumesActionsTest-480767440 tempest-VolumesActionsTest-480767440-project-member] [instance: 200e8be8-516b-4344-a584-e88ee79b21a6] Terminating instance
Nov 14 09:55:27 user nova-compute[75229]: DEBUG nova.compute.manager [None req-9d8e201a-193b-485d-a106-711cbcd08262 tempest-VolumesActionsTest-480767440 tempest-VolumesActionsTest-480767440-project-member] [instance: 200e8be8-516b-4344-a584-e88ee79b21a6] Start destroying the instance on the hypervisor. {{(pid=75229) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 09:55:27 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:55:27 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:55:27 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:55:27 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:55:27 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:55:27 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:55:27 user nova-compute[75229]: DEBUG nova.compute.manager [None req-a251012f-d2c4-4fd0-963b-c13cfae4b0cf tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] [instance: 589f4750-fac6-4e99-a430-0cda339808bc] Start spawning the instance on the hypervisor. {{(pid=75229) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 09:55:27 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-a251012f-d2c4-4fd0-963b-c13cfae4b0cf tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] [instance: 589f4750-fac6-4e99-a430-0cda339808bc] Creating instance directory {{(pid=75229) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 09:55:27 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-a251012f-d2c4-4fd0-963b-c13cfae4b0cf tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] [instance: 589f4750-fac6-4e99-a430-0cda339808bc] Creating image(s)
Nov 14 09:55:27 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-a251012f-d2c4-4fd0-963b-c13cfae4b0cf tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] [instance: 589f4750-fac6-4e99-a430-0cda339808bc] Did not create local disks {{(pid=75229) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 14 09:55:27 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-a251012f-d2c4-4fd0-963b-c13cfae4b0cf tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] [instance: 589f4750-fac6-4e99-a430-0cda339808bc] Ensure instance console log exists: /opt/stack/data/nova/instances/589f4750-fac6-4e99-a430-0cda339808bc/console.log {{(pid=75229) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 09:55:27 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-a251012f-d2c4-4fd0-963b-c13cfae4b0cf tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:55:27 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-a251012f-d2c4-4fd0-963b-c13cfae4b0cf tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:55:27 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-a251012f-d2c4-4fd0-963b-c13cfae4b0cf tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:55:27 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-a251012f-d2c4-4fd0-963b-c13cfae4b0cf tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] [instance: 589f4750-fac6-4e99-a430-0cda339808bc] Start _get_guest_xml network_info=[{"id": "e10815ba-0472-4ed0-af80-b4d0904580af", "address": "fa:16:3e:aa:81:3e", "network": {"id": "5dfc532f-3d5d-4342-b7f1-12c9c3992a54", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1457278473-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46e65cdd021f4a3db7c9254bb6d98b46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape10815ba-04", "ovs_interfaceid": "e10815ba-0472-4ed0-af80-b4d0904580af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:a5efb0e0-a85c-46ec-8a9d-2763bf548023', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MNpaKqUc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '589f4750-fac6-4e99-a430-0cda339808bc', 'attached_at': '', 'detached_at': '', 'volume_id': 'a5efb0e0-a85c-46ec-8a9d-2763bf548023', 'serial': 'a5efb0e0-a85c-46ec-8a9d-2763bf548023'}, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'attachment_id': 'fd501fbb-4b72-462e-927a-9cf9a2933220', 'guest_format': None, 'device_type': 'disk', 'volume_type': None} {{(pid=75229) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 09:55:27 user nova-compute[75229]: WARNING nova.virt.libvirt.driver [None req-a251012f-d2c4-4fd0-963b-c13cfae4b0cf tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 09:55:27 user nova-compute[75229]: WARNING nova.virt.libvirt.driver [None req-a251012f-d2c4-4fd0-963b-c13cfae4b0cf tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 09:55:27 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-a251012f-d2c4-4fd0-963b-c13cfae4b0cf tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75229) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 09:55:27 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-a251012f-d2c4-4fd0-963b-c13cfae4b0cf tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] CPU controller missing on host. {{(pid=75229) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 09:55:27 user nova-compute[75229]: INFO nova.virt.libvirt.driver [-] [instance: 200e8be8-516b-4344-a584-e88ee79b21a6] Instance destroyed successfully.
Nov 14 09:55:27 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:55:27 user nova-compute[75229]: DEBUG nova.objects.instance [None req-9d8e201a-193b-485d-a106-711cbcd08262 tempest-VolumesActionsTest-480767440 tempest-VolumesActionsTest-480767440-project-member] Lazy-loading 'resources' on Instance uuid 200e8be8-516b-4344-a584-e88ee79b21a6 {{(pid=75229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 09:55:27 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-a251012f-d2c4-4fd0-963b-c13cfae4b0cf tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75229) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 09:55:27 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-a251012f-d2c4-4fd0-963b-c13cfae4b0cf tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] CPU controller found on host. {{(pid=75229) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 09:55:27 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-a251012f-d2c4-4fd0-963b-c13cfae4b0cf tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75229) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 09:55:27 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-a251012f-d2c4-4fd0-963b-c13cfae4b0cf tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T09:39:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 09:55:27 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-a251012f-d2c4-4fd0-963b-c13cfae4b0cf tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Flavor limits 0:0:0 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 09:55:27 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-a251012f-d2c4-4fd0-963b-c13cfae4b0cf tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Image limits 0:0:0 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 09:55:27 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-a251012f-d2c4-4fd0-963b-c13cfae4b0cf tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Flavor pref 0:0:0 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 09:55:27 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-a251012f-d2c4-4fd0-963b-c13cfae4b0cf tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Image pref 0:0:0 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 09:55:27 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-a251012f-d2c4-4fd0-963b-c13cfae4b0cf tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 09:55:27 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-a251012f-d2c4-4fd0-963b-c13cfae4b0cf tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 09:55:27 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-a251012f-d2c4-4fd0-963b-c13cfae4b0cf tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75229) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 09:55:27 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-a251012f-d2c4-4fd0-963b-c13cfae4b0cf tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Got 1 possible topologies {{(pid=75229) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 09:55:27 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-a251012f-d2c4-4fd0-963b-c13cfae4b0cf tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 09:55:27 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-a251012f-d2c4-4fd0-963b-c13cfae4b0cf tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 09:55:27 user nova-compute[75229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a251012f-d2c4-4fd0-963b-c13cfae4b0cf tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] [instance: 589f4750-fac6-4e99-a430-0cda339808bc] Calling os-brick to attach iSCSI Volume {{(pid=75229) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 09:55:27 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-a251012f-d2c4-4fd0-963b-c13cfae4b0cf tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f73f85151b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a5efb0e0-a85c-46ec-8a9d-2763bf548023', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MNpaKqUc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 09:55:27 user nova-compute[75229]: WARNING os_brick.initiator.connectors.base [None req-a251012f-d2c4-4fd0-963b-c13cfae4b0cf tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 09:55:27 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-a251012f-d2c4-4fd0-963b-c13cfae4b0cf tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 09:55:27 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-a251012f-d2c4-4fd0-963b-c13cfae4b0cf tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 09:55:27 user nova-compute[75229]: WARNING os_brick.initiator.connectors.base [None req-a251012f-d2c4-4fd0-963b-c13cfae4b0cf tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 09:55:27 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-a251012f-d2c4-4fd0-963b-c13cfae4b0cf tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a5efb0e0-a85c-46ec-8a9d-2763bf548023" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 09:55:27 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-a251012f-d2c4-4fd0-963b-c13cfae4b0cf tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a5efb0e0-a85c-46ec-8a9d-2763bf548023" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 09:55:27 user nova-compute[75229]: INFO os_brick.initiator.connectors.iscsi [None req-a251012f-d2c4-4fd0-963b-c13cfae4b0cf tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 09:55:27 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:55:27 user nova-compute[75229]: DEBUG nova.virt.libvirt.vif [None req-9d8e201a-193b-485d-a106-711cbcd08262 tempest-VolumesActionsTest-480767440 tempest-VolumesActionsTest-480767440-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T09:53:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-2065351145',display_name='tempest-VolumesActionsTest-instance-2065351145',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-2065351145',id=29,image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-14T09:53:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='76963cea909f48398eea96eefec38b0f',ramdisk_id='',reservation_id='r-6g3ots57',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-480767440',owner_user_name='tempest-VolumesActionsTest-480767440-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T09:53:45Z,user_data=None,user_id='c560169166e745ad9bb47e0c570c3ed8',uuid=200e8be8-516b-4344-a584-e88ee79b21a6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "45b7b43f-1c69-4e7d-bbf9-3cad74f674ef", "address": "fa:16:3e:b2:1d:1c", "network": {"id": "fedfe4bb-5b8c-4782-9df9-19cba1844f7c", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2139303642-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76963cea909f48398eea96eefec38b0f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45b7b43f-1c", "ovs_interfaceid": "45b7b43f-1c69-4e7d-bbf9-3cad74f674ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 09:55:27 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-9d8e201a-193b-485d-a106-711cbcd08262 tempest-VolumesActionsTest-480767440 tempest-VolumesActionsTest-480767440-project-member] Converting VIF {"id": "45b7b43f-1c69-4e7d-bbf9-3cad74f674ef", "address": "fa:16:3e:b2:1d:1c", "network": {"id": "fedfe4bb-5b8c-4782-9df9-19cba1844f7c", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2139303642-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76963cea909f48398eea96eefec38b0f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45b7b43f-1c", "ovs_interfaceid": "45b7b43f-1c69-4e7d-bbf9-3cad74f674ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 09:55:27 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-9d8e201a-193b-485d-a106-711cbcd08262 tempest-VolumesActionsTest-480767440 tempest-VolumesActionsTest-480767440-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b2:1d:1c,bridge_name='br-int',has_traffic_filtering=True,id=45b7b43f-1c69-4e7d-bbf9-3cad74f674ef,network=Network(fedfe4bb-5b8c-4782-9df9-19cba1844f7c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap45b7b43f-1c') {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 09:55:27 user nova-compute[75229]: DEBUG os_vif [None req-9d8e201a-193b-485d-a106-711cbcd08262 tempest-VolumesActionsTest-480767440 tempest-VolumesActionsTest-480767440-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b2:1d:1c,bridge_name='br-int',has_traffic_filtering=True,id=45b7b43f-1c69-4e7d-bbf9-3cad74f674ef,network=Network(fedfe4bb-5b8c-4782-9df9-19cba1844f7c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap45b7b43f-1c') {{(pid=75229) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 09:55:27 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5efb0e0-a85c-46ec-8a9d-2763bf548023 -p 172.16.0.220:3260 {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:55:27 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:55:27 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap45b7b43f-1c, bridge=br-int, if_exists=True) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:55:27 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:55:27 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5efb0e0-a85c-46ec-8a9d-2763bf548023 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:55:27 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[80fd2af2-7a2a-4a4b-acea-9d80d94178c3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:55:27 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-a251012f-d2c4-4fd0-963b-c13cfae4b0cf tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 09:55:27 user nova-compute[75229]:  {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:55:27 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 09:55:27 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5efb0e0-a85c-46ec-8a9d-2763bf548023 -p 172.16.0.220:3260 --interface default --op new {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:55:27 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:55:27 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=79431ed6-dfbf-40d3-b5c7-fc72106b82f5) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:55:27 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:55:27 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:55:27 user nova-compute[75229]: INFO os_vif [None req-9d8e201a-193b-485d-a106-711cbcd08262 tempest-VolumesActionsTest-480767440 tempest-VolumesActionsTest-480767440-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b2:1d:1c,bridge_name='br-int',has_traffic_filtering=True,id=45b7b43f-1c69-4e7d-bbf9-3cad74f674ef,network=Network(fedfe4bb-5b8c-4782-9df9-19cba1844f7c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap45b7b43f-1c')
Nov 14 09:55:27 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-9d8e201a-193b-485d-a106-711cbcd08262 tempest-VolumesActionsTest-480767440 tempest-VolumesActionsTest-480767440-project-member] [instance: 200e8be8-516b-4344-a584-e88ee79b21a6] Deleting instance files /opt/stack/data/nova/instances/200e8be8-516b-4344-a584-e88ee79b21a6_del
Nov 14 09:55:27 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-9d8e201a-193b-485d-a106-711cbcd08262 tempest-VolumesActionsTest-480767440 tempest-VolumesActionsTest-480767440-project-member] [instance: 200e8be8-516b-4344-a584-e88ee79b21a6] Deletion of /opt/stack/data/nova/instances/200e8be8-516b-4344-a584-e88ee79b21a6_del complete
Nov 14 09:55:27 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5efb0e0-a85c-46ec-8a9d-2763bf548023 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.029s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:55:27 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac6ba293-529e-4024-86f6-ab7bc089f4fc]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a5efb0e0-a85c-46ec-8a9d-2763bf548023] added\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:55:27 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-a251012f-d2c4-4fd0-963b-c13cfae4b0cf tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a5efb0e0-a85c-46ec-8a9d-2763bf548023] added
Nov 14 09:55:27 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:55:27 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:55:27 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5efb0e0-a85c-46ec-8a9d-2763bf548023 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:55:27 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5efb0e0-a85c-46ec-8a9d-2763bf548023 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.033s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:55:27 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[dad6a9d2-f25f-4d54-b6f7-2d34b805c771]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:55:27 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-a251012f-d2c4-4fd0-963b-c13cfae4b0cf tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:55:27 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5efb0e0-a85c-46ec-8a9d-2763bf548023 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:55:28 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5efb0e0-a85c-46ec-8a9d-2763bf548023 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:55:28 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa0fb351-10e3-4413-b382-45ef3a0fc9ac]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:55:28 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-a251012f-d2c4-4fd0-963b-c13cfae4b0cf tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:55:28 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5efb0e0-a85c-46ec-8a9d-2763bf548023 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MNpaKqUc {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:55:28 user nova-compute[75229]: INFO nova.compute.manager [None req-9d8e201a-193b-485d-a106-711cbcd08262 tempest-VolumesActionsTest-480767440 tempest-VolumesActionsTest-480767440-project-member] [instance: 200e8be8-516b-4344-a584-e88ee79b21a6] Took 0.73 seconds to destroy the instance on the hypervisor.
Nov 14 09:55:28 user nova-compute[75229]: DEBUG oslo.service.loopingcall [None req-9d8e201a-193b-485d-a106-711cbcd08262 tempest-VolumesActionsTest-480767440 tempest-VolumesActionsTest-480767440-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75229) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 09:55:28 user nova-compute[75229]: DEBUG nova.compute.manager [-] [instance: 200e8be8-516b-4344-a584-e88ee79b21a6] Deallocating network for instance {{(pid=75229) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 09:55:28 user nova-compute[75229]: DEBUG nova.network.neutron [-] [instance: 200e8be8-516b-4344-a584-e88ee79b21a6] deallocate_for_instance() {{(pid=75229) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 09:55:28 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5efb0e0-a85c-46ec-8a9d-2763bf548023 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MNpaKqUc" returned: 0 in 0.023s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:55:28 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c55169e-8d5f-438a-90fa-41c335436e06]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:55:28 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-a251012f-d2c4-4fd0-963b-c13cfae4b0cf tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'MNpaKqUc'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:55:28 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5efb0e0-a85c-46ec-8a9d-2763bf548023 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:55:28 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5efb0e0-a85c-46ec-8a9d-2763bf548023 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:55:28 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9697911-752a-47ba-b790-dccd390a376d]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:55:28 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-a251012f-d2c4-4fd0-963b-c13cfae4b0cf tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:55:28 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:55:28 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:55:28 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[86edb01e-0512-46b4-b7a1-687a6bf9752c]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:55:28 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-a251012f-d2c4-4fd0-963b-c13cfae4b0cf tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 14 09:55:28 user nova-compute[75229]:  {{(pid=75229) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 09:55:28 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-a251012f-d2c4-4fd0-963b-c13cfae4b0cf tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 14 09:55:28 user nova-compute[75229]:  {{(pid=75229) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 09:55:28 user nova-compute[75229]: WARNING os_brick.initiator.connectors.iscsi [None req-a251012f-d2c4-4fd0-963b-c13cfae4b0cf tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 14 09:55:28 user nova-compute[75229]: 
Nov 14 09:55:28 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5efb0e0-a85c-46ec-8a9d-2763bf548023 -p 172.16.0.220:3260 --login {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:55:28 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5efb0e0-a85c-46ec-8a9d-2763bf548023 -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:55:28 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8fd6568-8b14-4d13-8788-5bab94e260ae]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a5efb0e0-a85c-46ec-8a9d-2763bf548023, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a5efb0e0-a85c-46ec-8a9d-2763bf548023, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:55:28 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-a251012f-d2c4-4fd0-963b-c13cfae4b0cf tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a5efb0e0-a85c-46ec-8a9d-2763bf548023, portal: 172.16.0.220,3260]
Nov 14 09:55:28 user nova-compute[75229]: Login to [iface: default, target: iqn.2010-10.org.openstack:a5efb0e0-a85c-46ec-8a9d-2763bf548023, portal: 172.16.0.220,3260] successful.
Nov 14 09:55:28 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:55:28 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5efb0e0-a85c-46ec-8a9d-2763bf548023 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:55:28 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5efb0e0-a85c-46ec-8a9d-2763bf548023 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:55:28 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d0ab913-df9c-4468-a0c0-36881ebd5fda]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:55:28 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-a251012f-d2c4-4fd0-963b-c13cfae4b0cf tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:55:28 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:55:28 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:55:28 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[b23b59a4-bc34-4afe-9604-7e44a39d6d02]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5efb0e0-a85c-46ec-8a9d-2763bf548023 (non-flash)\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:55:28 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-a251012f-d2c4-4fd0-963b-c13cfae4b0cf tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5efb0e0-a85c-46ec-8a9d-2763bf548023 (non-flash)
Nov 14 09:55:28 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 09:55:28 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-a251012f-d2c4-4fd0-963b-c13cfae4b0cf tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5efb0e0-a85c-46ec-8a9d-2763bf548023 (non-flash)
Nov 14 09:55:28 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 09:55:28 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-a251012f-d2c4-4fd0-963b-c13cfae4b0cf tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a5efb0e0-a85c-46ec-8a9d-2763bf548023" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.299s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 09:55:28 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-a251012f-d2c4-4fd0-963b-c13cfae4b0cf tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Connected to 172.16.0.220:3260 {{(pid=75229) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 09:55:28 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-a251012f-d2c4-4fd0-963b-c13cfae4b0cf tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] HCTL ('33', '-', '-', 0) found on session 31 with lun 0 {{(pid=75229) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 09:55:28 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-a251012f-d2c4-4fd0-963b-c13cfae4b0cf tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75229) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 09:55:28 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:55:28 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:55:28 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[500a76c0-8d44-42e8-be00-a66e1f704994]: (4, ('- - 0', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:55:28 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-a251012f-d2c4-4fd0-963b-c13cfae4b0cf tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Searching for a device in session 31 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75229) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 09:55:28 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-a251012f-d2c4-4fd0-963b-c13cfae4b0cf tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:a5efb0e0-a85c-46ec-8a9d-2763bf548023', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MNpaKqUc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75229) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 09:55:28 user nova-compute[75229]: DEBUG nova.compute.manager [req-ffd272f2-0aa3-4d0c-85cc-804cf67d6aa8 req-72f4c82d-ba93-42fa-aa22-7c90b2e0b480 service nova] [instance: 200e8be8-516b-4344-a584-e88ee79b21a6] Received event network-vif-unplugged-45b7b43f-1c69-4e7d-bbf9-3cad74f674ef {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:55:28 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-ffd272f2-0aa3-4d0c-85cc-804cf67d6aa8 req-72f4c82d-ba93-42fa-aa22-7c90b2e0b480 service nova] Acquiring lock "200e8be8-516b-4344-a584-e88ee79b21a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:55:28 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-ffd272f2-0aa3-4d0c-85cc-804cf67d6aa8 req-72f4c82d-ba93-42fa-aa22-7c90b2e0b480 service nova] Lock "200e8be8-516b-4344-a584-e88ee79b21a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:55:28 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-ffd272f2-0aa3-4d0c-85cc-804cf67d6aa8 req-72f4c82d-ba93-42fa-aa22-7c90b2e0b480 service nova] Lock "200e8be8-516b-4344-a584-e88ee79b21a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:55:28 user nova-compute[75229]: DEBUG nova.compute.manager [req-ffd272f2-0aa3-4d0c-85cc-804cf67d6aa8 req-72f4c82d-ba93-42fa-aa22-7c90b2e0b480 service nova] [instance: 200e8be8-516b-4344-a584-e88ee79b21a6] No waiting events found dispatching network-vif-unplugged-45b7b43f-1c69-4e7d-bbf9-3cad74f674ef {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 09:55:28 user nova-compute[75229]: DEBUG nova.compute.manager [req-ffd272f2-0aa3-4d0c-85cc-804cf67d6aa8 req-72f4c82d-ba93-42fa-aa22-7c90b2e0b480 service nova] [instance: 200e8be8-516b-4344-a584-e88ee79b21a6] Received event network-vif-unplugged-45b7b43f-1c69-4e7d-bbf9-3cad74f674ef for instance with task_state deleting. {{(pid=75229) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 09:55:28 user nova-compute[75229]: DEBUG nova.compute.manager [req-ffd272f2-0aa3-4d0c-85cc-804cf67d6aa8 req-72f4c82d-ba93-42fa-aa22-7c90b2e0b480 service nova] [instance: 200e8be8-516b-4344-a584-e88ee79b21a6] Received event network-vif-plugged-45b7b43f-1c69-4e7d-bbf9-3cad74f674ef {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:55:28 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-ffd272f2-0aa3-4d0c-85cc-804cf67d6aa8 req-72f4c82d-ba93-42fa-aa22-7c90b2e0b480 service nova] Acquiring lock "200e8be8-516b-4344-a584-e88ee79b21a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:55:28 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-ffd272f2-0aa3-4d0c-85cc-804cf67d6aa8 req-72f4c82d-ba93-42fa-aa22-7c90b2e0b480 service nova] Lock "200e8be8-516b-4344-a584-e88ee79b21a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:55:28 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-ffd272f2-0aa3-4d0c-85cc-804cf67d6aa8 req-72f4c82d-ba93-42fa-aa22-7c90b2e0b480 service nova] Lock "200e8be8-516b-4344-a584-e88ee79b21a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:55:28 user nova-compute[75229]: DEBUG nova.compute.manager [req-ffd272f2-0aa3-4d0c-85cc-804cf67d6aa8 req-72f4c82d-ba93-42fa-aa22-7c90b2e0b480 service nova] [instance: 200e8be8-516b-4344-a584-e88ee79b21a6] No waiting events found dispatching network-vif-plugged-45b7b43f-1c69-4e7d-bbf9-3cad74f674ef {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 09:55:28 user nova-compute[75229]: WARNING nova.compute.manager [req-ffd272f2-0aa3-4d0c-85cc-804cf67d6aa8 req-72f4c82d-ba93-42fa-aa22-7c90b2e0b480 service nova] [instance: 200e8be8-516b-4344-a584-e88ee79b21a6] Received unexpected event network-vif-plugged-45b7b43f-1c69-4e7d-bbf9-3cad74f674ef for instance with vm_state active and task_state deleting.
Nov 14 09:55:28 user nova-compute[75229]: DEBUG nova.compute.manager [req-ffd272f2-0aa3-4d0c-85cc-804cf67d6aa8 req-72f4c82d-ba93-42fa-aa22-7c90b2e0b480 service nova] [instance: 200e8be8-516b-4344-a584-e88ee79b21a6] Received event network-vif-plugged-45b7b43f-1c69-4e7d-bbf9-3cad74f674ef {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:55:28 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-ffd272f2-0aa3-4d0c-85cc-804cf67d6aa8 req-72f4c82d-ba93-42fa-aa22-7c90b2e0b480 service nova] Acquiring lock "200e8be8-516b-4344-a584-e88ee79b21a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:55:28 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-ffd272f2-0aa3-4d0c-85cc-804cf67d6aa8 req-72f4c82d-ba93-42fa-aa22-7c90b2e0b480 service nova] Lock "200e8be8-516b-4344-a584-e88ee79b21a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:55:28 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-ffd272f2-0aa3-4d0c-85cc-804cf67d6aa8 req-72f4c82d-ba93-42fa-aa22-7c90b2e0b480 service nova] Lock "200e8be8-516b-4344-a584-e88ee79b21a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:55:28 user nova-compute[75229]: DEBUG nova.compute.manager [req-ffd272f2-0aa3-4d0c-85cc-804cf67d6aa8 req-72f4c82d-ba93-42fa-aa22-7c90b2e0b480 service nova] [instance: 200e8be8-516b-4344-a584-e88ee79b21a6] No waiting events found dispatching network-vif-plugged-45b7b43f-1c69-4e7d-bbf9-3cad74f674ef {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 09:55:28 user nova-compute[75229]: WARNING nova.compute.manager [req-ffd272f2-0aa3-4d0c-85cc-804cf67d6aa8 req-72f4c82d-ba93-42fa-aa22-7c90b2e0b480 service nova] [instance: 200e8be8-516b-4344-a584-e88ee79b21a6] Received unexpected event network-vif-plugged-45b7b43f-1c69-4e7d-bbf9-3cad74f674ef for instance with vm_state active and task_state deleting.
Nov 14 09:55:28 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:55:28 user nova-compute[75229]: INFO nova.compute.manager [None req-1f87f549-18a8-46e7-98ff-0e3435cda372 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] [instance: 4c9fe69e-3f9d-4b30-a9e4-efc3e83efa17] Unrescuing
Nov 14 09:55:28 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-1f87f549-18a8-46e7-98ff-0e3435cda372 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Acquiring lock "refresh_cache-4c9fe69e-3f9d-4b30-a9e4-efc3e83efa17" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 09:55:28 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-1f87f549-18a8-46e7-98ff-0e3435cda372 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Acquired lock "refresh_cache-4c9fe69e-3f9d-4b30-a9e4-efc3e83efa17" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 09:55:28 user nova-compute[75229]: DEBUG nova.network.neutron [None req-1f87f549-18a8-46e7-98ff-0e3435cda372 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] [instance: 4c9fe69e-3f9d-4b30-a9e4-efc3e83efa17] Building network info cache for instance {{(pid=75229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 09:55:28 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:55:28 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:55:28 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:55:28 user nova-compute[75229]: DEBUG nova.network.neutron [-] [instance: 200e8be8-516b-4344-a584-e88ee79b21a6] Updating instance_info_cache with network_info: [] {{(pid=75229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 09:55:28 user nova-compute[75229]: INFO nova.compute.manager [-] [instance: 200e8be8-516b-4344-a584-e88ee79b21a6] Took 0.58 seconds to deallocate network for instance.
Nov 14 09:55:28 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:55:28 user nova-compute[75229]: DEBUG nova.compute.manager [req-8fde6b2a-0806-4314-9ead-5a0b24bd973a req-6c71200a-d09c-4ab7-961e-aa20b9d6643a service nova] [instance: 200e8be8-516b-4344-a584-e88ee79b21a6] Received event network-vif-deleted-45b7b43f-1c69-4e7d-bbf9-3cad74f674ef {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:55:28 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:55:28 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-9d8e201a-193b-485d-a106-711cbcd08262 tempest-VolumesActionsTest-480767440 tempest-VolumesActionsTest-480767440-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:55:28 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-9d8e201a-193b-485d-a106-711cbcd08262 tempest-VolumesActionsTest-480767440 tempest-VolumesActionsTest-480767440-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:55:28 user nova-compute[75229]: DEBUG nova.network.neutron [None req-1f87f549-18a8-46e7-98ff-0e3435cda372 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] [instance: 4c9fe69e-3f9d-4b30-a9e4-efc3e83efa17] Updating instance_info_cache with network_info: [{"id": "235153d6-63c1-44d2-97cc-c083544e6790", "address": "fa:16:3e:a0:db:35", "network": {"id": "22eed29e-7148-42f9-b4c7-b97811cba8eb", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2000485731-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46457b27e3ed416e827c3c22449fb512", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap235153d6-63", "ovs_interfaceid": "235153d6-63c1-44d2-97cc-c083544e6790", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 09:55:28 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-1f87f549-18a8-46e7-98ff-0e3435cda372 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Releasing lock "refresh_cache-4c9fe69e-3f9d-4b30-a9e4-efc3e83efa17" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 09:55:28 user nova-compute[75229]: DEBUG nova.objects.instance [None req-1f87f549-18a8-46e7-98ff-0e3435cda372 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Lazy-loading 'flavor' on Instance uuid 4c9fe69e-3f9d-4b30-a9e4-efc3e83efa17 {{(pid=75229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 09:55:28 user nova-compute[75229]: DEBUG nova.compute.provider_tree [None req-9d8e201a-193b-485d-a106-711cbcd08262 tempest-VolumesActionsTest-480767440 tempest-VolumesActionsTest-480767440-project-member] Inventory has not changed in ProviderTree for provider: d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 {{(pid=75229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 09:55:29 user nova-compute[75229]: DEBUG nova.scheduler.client.report [None req-9d8e201a-193b-485d-a106-711cbcd08262 tempest-VolumesActionsTest-480767440 tempest-VolumesActionsTest-480767440-project-member] Inventory has not changed for provider d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 09:55:29 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-9d8e201a-193b-485d-a106-711cbcd08262 tempest-VolumesActionsTest-480767440 tempest-VolumesActionsTest-480767440-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.352s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:55:29 user nova-compute[75229]: INFO nova.scheduler.client.report [None req-9d8e201a-193b-485d-a106-711cbcd08262 tempest-VolumesActionsTest-480767440 tempest-VolumesActionsTest-480767440-project-member] Deleted allocations for instance 200e8be8-516b-4344-a584-e88ee79b21a6
Nov 14 09:55:29 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:55:29 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:55:29 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-9d8e201a-193b-485d-a106-711cbcd08262 tempest-VolumesActionsTest-480767440 tempest-VolumesActionsTest-480767440-project-member] Lock "200e8be8-516b-4344-a584-e88ee79b21a6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.902s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:55:29 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-a251012f-d2c4-4fd0-963b-c13cfae4b0cf tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.329s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 09:55:29 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-a251012f-d2c4-4fd0-963b-c13cfae4b0cf tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] <== connect_volume: return (1330ms) {'type': 'block', 'scsi_wwn': '26265396161366132', 'path': '/dev/sdb'} {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 09:55:29 user nova-compute[75229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a251012f-d2c4-4fd0-963b-c13cfae4b0cf tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] [instance: 589f4750-fac6-4e99-a430-0cda339808bc] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26265396161366132', 'path': '/dev/sdb'} {{(pid=75229) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 09:55:29 user nova-compute[75229]: DEBUG nova.virt.libvirt.vif [None req-a251012f-d2c4-4fd0-963b-c13cfae4b0cf tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T09:55:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-724442357',display_name='tempest-ServerActionsTestOtherA-server-724442357',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-724442357',id=32,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGYpQZFb1U6nMdMA0U7Y/y+mR6NDiU0zUt1gWS7fx0RnGUEMiKL0fCtTR70lVN1zodlPi6pkSulrGMUx3iNoziRzj8cN92z29zHcNE44hvJVgwbBcM00kPn071ndMRlk4g==',key_name='tempest-keypair-397181797',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='46e65cdd021f4a3db7c9254bb6d98b46',ramdisk_id='',reservation_id='r-lre1lh5y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-280196295',owner_user_name='tempest-ServerActionsTestOtherA-280196295-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T09:55:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c0c381a0f6124f1ca6ce85c057b9143a',uuid=589f4750-fac6-4e99-a430-0cda339808bc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e10815ba-0472-4ed0-af80-b4d0904580af", "address": "fa:16:3e:aa:81:3e", "network": {"id": "5dfc532f-3d5d-4342-b7f1-12c9c3992a54", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1457278473-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46e65cdd021f4a3db7c9254bb6d98b46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape10815ba-04", "ovs_interfaceid": "e10815ba-0472-4ed0-af80-b4d0904580af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75229) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 09:55:29 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-a251012f-d2c4-4fd0-963b-c13cfae4b0cf tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Converting VIF {"id": "e10815ba-0472-4ed0-af80-b4d0904580af", "address": "fa:16:3e:aa:81:3e", "network": {"id": "5dfc532f-3d5d-4342-b7f1-12c9c3992a54", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1457278473-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46e65cdd021f4a3db7c9254bb6d98b46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape10815ba-04", "ovs_interfaceid": "e10815ba-0472-4ed0-af80-b4d0904580af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 09:55:29 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-a251012f-d2c4-4fd0-963b-c13cfae4b0cf tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:aa:81:3e,bridge_name='br-int',has_traffic_filtering=True,id=e10815ba-0472-4ed0-af80-b4d0904580af,network=Network(5dfc532f-3d5d-4342-b7f1-12c9c3992a54),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape10815ba-04') {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 09:55:29 user nova-compute[75229]: DEBUG nova.objects.instance [None req-a251012f-d2c4-4fd0-963b-c13cfae4b0cf tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Lazy-loading 'pci_devices' on Instance uuid 589f4750-fac6-4e99-a430-0cda339808bc {{(pid=75229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 09:55:29 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-a251012f-d2c4-4fd0-963b-c13cfae4b0cf tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] [instance: 589f4750-fac6-4e99-a430-0cda339808bc] End _get_guest_xml xml=<domain type="kvm">
Nov 14 09:55:29 user nova-compute[75229]:   <uuid>589f4750-fac6-4e99-a430-0cda339808bc</uuid>
Nov 14 09:55:29 user nova-compute[75229]:   <name>instance-00000020</name>
Nov 14 09:55:29 user nova-compute[75229]:   <memory>524288</memory>
Nov 14 09:55:29 user nova-compute[75229]:   <vcpu>1</vcpu>
Nov 14 09:55:29 user nova-compute[75229]:   <metadata>
Nov 14 09:55:29 user nova-compute[75229]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 09:55:29 user nova-compute[75229]:       <nova:package version="0.0.0"/>
Nov 14 09:55:29 user nova-compute[75229]:       <nova:name>tempest-ServerActionsTestOtherA-server-724442357</nova:name>
Nov 14 09:55:29 user nova-compute[75229]:       <nova:creationTime>2023-11-14 09:55:27</nova:creationTime>
Nov 14 09:55:29 user nova-compute[75229]:       <nova:flavor name="m1.tiny">
Nov 14 09:55:29 user nova-compute[75229]:         <nova:memory>512</nova:memory>
Nov 14 09:55:29 user nova-compute[75229]:         <nova:disk>1</nova:disk>
Nov 14 09:55:29 user nova-compute[75229]:         <nova:swap>0</nova:swap>
Nov 14 09:55:29 user nova-compute[75229]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 09:55:29 user nova-compute[75229]:         <nova:vcpus>1</nova:vcpus>
Nov 14 09:55:29 user nova-compute[75229]:       </nova:flavor>
Nov 14 09:55:29 user nova-compute[75229]:       <nova:owner>
Nov 14 09:55:29 user nova-compute[75229]:         <nova:user uuid="c0c381a0f6124f1ca6ce85c057b9143a">tempest-ServerActionsTestOtherA-280196295-project-member</nova:user>
Nov 14 09:55:29 user nova-compute[75229]:         <nova:project uuid="46e65cdd021f4a3db7c9254bb6d98b46">tempest-ServerActionsTestOtherA-280196295</nova:project>
Nov 14 09:55:29 user nova-compute[75229]:       </nova:owner>
Nov 14 09:55:29 user nova-compute[75229]:       <nova:ports>
Nov 14 09:55:29 user nova-compute[75229]:         <nova:port uuid="e10815ba-0472-4ed0-af80-b4d0904580af">
Nov 14 09:55:29 user nova-compute[75229]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 14 09:55:29 user nova-compute[75229]:         </nova:port>
Nov 14 09:55:29 user nova-compute[75229]:       </nova:ports>
Nov 14 09:55:29 user nova-compute[75229]:     </nova:instance>
Nov 14 09:55:29 user nova-compute[75229]:   </metadata>
Nov 14 09:55:29 user nova-compute[75229]:   <sysinfo type="smbios">
Nov 14 09:55:29 user nova-compute[75229]:     <system>
Nov 14 09:55:29 user nova-compute[75229]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 09:55:29 user nova-compute[75229]:       <entry name="product">OpenStack Nova</entry>
Nov 14 09:55:29 user nova-compute[75229]:       <entry name="version">0.0.0</entry>
Nov 14 09:55:29 user nova-compute[75229]:       <entry name="serial">589f4750-fac6-4e99-a430-0cda339808bc</entry>
Nov 14 09:55:29 user nova-compute[75229]:       <entry name="uuid">589f4750-fac6-4e99-a430-0cda339808bc</entry>
Nov 14 09:55:29 user nova-compute[75229]:       <entry name="family">Virtual Machine</entry>
Nov 14 09:55:29 user nova-compute[75229]:     </system>
Nov 14 09:55:29 user nova-compute[75229]:   </sysinfo>
Nov 14 09:55:29 user nova-compute[75229]:   <os>
Nov 14 09:55:29 user nova-compute[75229]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 09:55:29 user nova-compute[75229]:     <boot dev="hd"/>
Nov 14 09:55:29 user nova-compute[75229]:     <smbios mode="sysinfo"/>
Nov 14 09:55:29 user nova-compute[75229]:   </os>
Nov 14 09:55:29 user nova-compute[75229]:   <features>
Nov 14 09:55:29 user nova-compute[75229]:     <acpi/>
Nov 14 09:55:29 user nova-compute[75229]:     <apic/>
Nov 14 09:55:29 user nova-compute[75229]:     <vmcoreinfo/>
Nov 14 09:55:29 user nova-compute[75229]:   </features>
Nov 14 09:55:29 user nova-compute[75229]:   <clock offset="utc">
Nov 14 09:55:29 user nova-compute[75229]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 09:55:29 user nova-compute[75229]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 09:55:29 user nova-compute[75229]:     <timer name="hpet" present="no"/>
Nov 14 09:55:29 user nova-compute[75229]:   </clock>
Nov 14 09:55:29 user nova-compute[75229]:   <cpu mode="custom" match="exact">
Nov 14 09:55:29 user nova-compute[75229]:     <model>Nehalem</model>
Nov 14 09:55:29 user nova-compute[75229]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 09:55:29 user nova-compute[75229]:   </cpu>
Nov 14 09:55:29 user nova-compute[75229]:   <devices>
Nov 14 09:55:29 user nova-compute[75229]:     <disk type="block" device="disk">
Nov 14 09:55:29 user nova-compute[75229]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 09:55:29 user nova-compute[75229]:       <source dev="/dev/sdb"/>
Nov 14 09:55:29 user nova-compute[75229]:       <target dev="vda" bus="virtio"/>
Nov 14 09:55:29 user nova-compute[75229]:       <serial>a5efb0e0-a85c-46ec-8a9d-2763bf548023</serial>
Nov 14 09:55:29 user nova-compute[75229]:     </disk>
Nov 14 09:55:29 user nova-compute[75229]:     <interface type="ethernet">
Nov 14 09:55:29 user nova-compute[75229]:       <mac address="fa:16:3e:aa:81:3e"/>
Nov 14 09:55:29 user nova-compute[75229]:       <model type="virtio"/>
Nov 14 09:55:29 user nova-compute[75229]:       <mtu size="1442"/>
Nov 14 09:55:29 user nova-compute[75229]:       <target dev="tape10815ba-04"/>
Nov 14 09:55:29 user nova-compute[75229]:     </interface>
Nov 14 09:55:29 user nova-compute[75229]:     <serial type="pty">
Nov 14 09:55:29 user nova-compute[75229]:       <log file="/opt/stack/data/nova/instances/589f4750-fac6-4e99-a430-0cda339808bc/console.log" append="off"/>
Nov 14 09:55:29 user nova-compute[75229]:     </serial>
Nov 14 09:55:29 user nova-compute[75229]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 09:55:29 user nova-compute[75229]:     <video>
Nov 14 09:55:29 user nova-compute[75229]:       <model type="virtio"/>
Nov 14 09:55:29 user nova-compute[75229]:     </video>
Nov 14 09:55:29 user nova-compute[75229]:     <rng model="virtio">
Nov 14 09:55:29 user nova-compute[75229]:       <backend model="random">/dev/urandom</backend>
Nov 14 09:55:29 user nova-compute[75229]:     </rng>
Nov 14 09:55:29 user nova-compute[75229]:     <controller type="usb" index="0" model="none"/>
Nov 14 09:55:29 user nova-compute[75229]:     <memballoon model="virtio">
Nov 14 09:55:29 user nova-compute[75229]:       <stats period="10"/>
Nov 14 09:55:29 user nova-compute[75229]:     </memballoon>
Nov 14 09:55:29 user nova-compute[75229]:   </devices>
Nov 14 09:55:29 user nova-compute[75229]: </domain>
Nov 14 09:55:29 user nova-compute[75229]:  {{(pid=75229) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 09:55:29 user nova-compute[75229]: DEBUG nova.virt.libvirt.vif [None req-a251012f-d2c4-4fd0-963b-c13cfae4b0cf tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T09:55:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-724442357',display_name='tempest-ServerActionsTestOtherA-server-724442357',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-724442357',id=32,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGYpQZFb1U6nMdMA0U7Y/y+mR6NDiU0zUt1gWS7fx0RnGUEMiKL0fCtTR70lVN1zodlPi6pkSulrGMUx3iNoziRzj8cN92z29zHcNE44hvJVgwbBcM00kPn071ndMRlk4g==',key_name='tempest-keypair-397181797',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='46e65cdd021f4a3db7c9254bb6d98b46',ramdisk_id='',reservation_id='r-lre1lh5y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-280196295',owner_user_name='tempest-ServerActionsTestOtherA-280196295-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T09:55:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c0c381a0f6124f1ca6ce85c057b9143a',uuid=589f4750-fac6-4e99-a430-0cda339808bc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e10815ba-0472-4ed0-af80-b4d0904580af", "address": "fa:16:3e:aa:81:3e", "network": {"id": "5dfc532f-3d5d-4342-b7f1-12c9c3992a54", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1457278473-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46e65cdd021f4a3db7c9254bb6d98b46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape10815ba-04", "ovs_interfaceid": "e10815ba-0472-4ed0-af80-b4d0904580af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 09:55:29 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-a251012f-d2c4-4fd0-963b-c13cfae4b0cf tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Converting VIF {"id": "e10815ba-0472-4ed0-af80-b4d0904580af", "address": "fa:16:3e:aa:81:3e", "network": {"id": "5dfc532f-3d5d-4342-b7f1-12c9c3992a54", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1457278473-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46e65cdd021f4a3db7c9254bb6d98b46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape10815ba-04", "ovs_interfaceid": "e10815ba-0472-4ed0-af80-b4d0904580af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 09:55:29 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-a251012f-d2c4-4fd0-963b-c13cfae4b0cf tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:aa:81:3e,bridge_name='br-int',has_traffic_filtering=True,id=e10815ba-0472-4ed0-af80-b4d0904580af,network=Network(5dfc532f-3d5d-4342-b7f1-12c9c3992a54),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape10815ba-04') {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 09:55:29 user nova-compute[75229]: DEBUG os_vif [None req-a251012f-d2c4-4fd0-963b-c13cfae4b0cf tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:aa:81:3e,bridge_name='br-int',has_traffic_filtering=True,id=e10815ba-0472-4ed0-af80-b4d0904580af,network=Network(5dfc532f-3d5d-4342-b7f1-12c9c3992a54),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape10815ba-04') {{(pid=75229) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 09:55:29 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:55:29 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:55:29 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 09:55:29 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:55:29 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '45a38fa1-e2a1-57a5-951c-5caa67cb189d', '_type': 'linux-noop'}}, row=False) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:55:29 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:55:29 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 09:55:29 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:55:29 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:55:29 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape10815ba-04, may_exist=True, interface_attrs={}) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:55:29 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape10815ba-04, col_values=(('qos', UUID('a55db273-f14e-4ce7-af16-13c53178b7e0')),), if_exists=True) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:55:29 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape10815ba-04, col_values=(('external_ids', {'iface-id': 'e10815ba-0472-4ed0-af80-b4d0904580af', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:aa:81:3e', 'vm-uuid': '589f4750-fac6-4e99-a430-0cda339808bc'}),), if_exists=True) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:55:29 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:55:29 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 09:55:29 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:55:29 user nova-compute[75229]: INFO os_vif [None req-a251012f-d2c4-4fd0-963b-c13cfae4b0cf tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:aa:81:3e,bridge_name='br-int',has_traffic_filtering=True,id=e10815ba-0472-4ed0-af80-b4d0904580af,network=Network(5dfc532f-3d5d-4342-b7f1-12c9c3992a54),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape10815ba-04')
Nov 14 09:55:29 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-a251012f-d2c4-4fd0-963b-c13cfae4b0cf tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] No BDM found with device name vda, not building metadata. {{(pid=75229) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 09:55:29 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-a251012f-d2c4-4fd0-963b-c13cfae4b0cf tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] No VIF found with MAC fa:16:3e:aa:81:3e, not building metadata {{(pid=75229) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 09:55:29 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:55:29 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:55:30 user nova-compute[75229]: INFO nova.virt.libvirt.driver [-] [instance: 4c9fe69e-3f9d-4b30-a9e4-efc3e83efa17] Instance destroyed successfully.
Nov 14 09:55:30 user nova-compute[75229]: DEBUG nova.compute.manager [req-f89d462d-e52a-4d97-9318-c2aecc46ea1f req-51587f89-cb4f-4ea0-a3c4-37fd79f9d5fe service nova] [instance: 200e8be8-516b-4344-a584-e88ee79b21a6] Received event network-vif-plugged-45b7b43f-1c69-4e7d-bbf9-3cad74f674ef {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:55:30 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-f89d462d-e52a-4d97-9318-c2aecc46ea1f req-51587f89-cb4f-4ea0-a3c4-37fd79f9d5fe service nova] Acquiring lock "200e8be8-516b-4344-a584-e88ee79b21a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:55:30 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-f89d462d-e52a-4d97-9318-c2aecc46ea1f req-51587f89-cb4f-4ea0-a3c4-37fd79f9d5fe service nova] Lock "200e8be8-516b-4344-a584-e88ee79b21a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:55:30 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-f89d462d-e52a-4d97-9318-c2aecc46ea1f req-51587f89-cb4f-4ea0-a3c4-37fd79f9d5fe service nova] Lock "200e8be8-516b-4344-a584-e88ee79b21a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:55:30 user nova-compute[75229]: DEBUG nova.compute.manager [req-f89d462d-e52a-4d97-9318-c2aecc46ea1f req-51587f89-cb4f-4ea0-a3c4-37fd79f9d5fe service nova] [instance: 200e8be8-516b-4344-a584-e88ee79b21a6] No waiting events found dispatching network-vif-plugged-45b7b43f-1c69-4e7d-bbf9-3cad74f674ef {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 09:55:30 user nova-compute[75229]: WARNING nova.compute.manager [req-f89d462d-e52a-4d97-9318-c2aecc46ea1f req-51587f89-cb4f-4ea0-a3c4-37fd79f9d5fe service nova] [instance: 200e8be8-516b-4344-a584-e88ee79b21a6] Received unexpected event network-vif-plugged-45b7b43f-1c69-4e7d-bbf9-3cad74f674ef for instance with vm_state deleted and task_state None.
Nov 14 09:55:30 user nova-compute[75229]: DEBUG nova.compute.manager [req-f89d462d-e52a-4d97-9318-c2aecc46ea1f req-51587f89-cb4f-4ea0-a3c4-37fd79f9d5fe service nova] [instance: 200e8be8-516b-4344-a584-e88ee79b21a6] Received event network-vif-plugged-45b7b43f-1c69-4e7d-bbf9-3cad74f674ef {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:55:30 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-f89d462d-e52a-4d97-9318-c2aecc46ea1f req-51587f89-cb4f-4ea0-a3c4-37fd79f9d5fe service nova] Acquiring lock "200e8be8-516b-4344-a584-e88ee79b21a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:55:30 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-f89d462d-e52a-4d97-9318-c2aecc46ea1f req-51587f89-cb4f-4ea0-a3c4-37fd79f9d5fe service nova] Lock "200e8be8-516b-4344-a584-e88ee79b21a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:55:30 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-f89d462d-e52a-4d97-9318-c2aecc46ea1f req-51587f89-cb4f-4ea0-a3c4-37fd79f9d5fe service nova] Lock "200e8be8-516b-4344-a584-e88ee79b21a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:55:30 user nova-compute[75229]: DEBUG nova.compute.manager [req-f89d462d-e52a-4d97-9318-c2aecc46ea1f req-51587f89-cb4f-4ea0-a3c4-37fd79f9d5fe service nova] [instance: 200e8be8-516b-4344-a584-e88ee79b21a6] No waiting events found dispatching network-vif-plugged-45b7b43f-1c69-4e7d-bbf9-3cad74f674ef {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 09:55:30 user nova-compute[75229]: WARNING nova.compute.manager [req-f89d462d-e52a-4d97-9318-c2aecc46ea1f req-51587f89-cb4f-4ea0-a3c4-37fd79f9d5fe service nova] [instance: 200e8be8-516b-4344-a584-e88ee79b21a6] Received unexpected event network-vif-plugged-45b7b43f-1c69-4e7d-bbf9-3cad74f674ef for instance with vm_state deleted and task_state None.
Nov 14 09:55:30 user nova-compute[75229]: DEBUG nova.compute.manager [req-f89d462d-e52a-4d97-9318-c2aecc46ea1f req-51587f89-cb4f-4ea0-a3c4-37fd79f9d5fe service nova] [instance: 4c9fe69e-3f9d-4b30-a9e4-efc3e83efa17] Received event network-vif-unplugged-235153d6-63c1-44d2-97cc-c083544e6790 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:55:30 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-f89d462d-e52a-4d97-9318-c2aecc46ea1f req-51587f89-cb4f-4ea0-a3c4-37fd79f9d5fe service nova] Acquiring lock "4c9fe69e-3f9d-4b30-a9e4-efc3e83efa17-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:55:30 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-f89d462d-e52a-4d97-9318-c2aecc46ea1f req-51587f89-cb4f-4ea0-a3c4-37fd79f9d5fe service nova] Lock "4c9fe69e-3f9d-4b30-a9e4-efc3e83efa17-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:55:30 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-f89d462d-e52a-4d97-9318-c2aecc46ea1f req-51587f89-cb4f-4ea0-a3c4-37fd79f9d5fe service nova] Lock "4c9fe69e-3f9d-4b30-a9e4-efc3e83efa17-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:55:30 user nova-compute[75229]: DEBUG nova.compute.manager [req-f89d462d-e52a-4d97-9318-c2aecc46ea1f req-51587f89-cb4f-4ea0-a3c4-37fd79f9d5fe service nova] [instance: 4c9fe69e-3f9d-4b30-a9e4-efc3e83efa17] No waiting events found dispatching network-vif-unplugged-235153d6-63c1-44d2-97cc-c083544e6790 {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 09:55:30 user nova-compute[75229]: WARNING nova.compute.manager [req-f89d462d-e52a-4d97-9318-c2aecc46ea1f req-51587f89-cb4f-4ea0-a3c4-37fd79f9d5fe service nova] [instance: 4c9fe69e-3f9d-4b30-a9e4-efc3e83efa17] Received unexpected event network-vif-unplugged-235153d6-63c1-44d2-97cc-c083544e6790 for instance with vm_state rescued and task_state unrescuing.
Nov 14 09:55:30 user nova-compute[75229]: DEBUG nova.compute.manager [req-f89d462d-e52a-4d97-9318-c2aecc46ea1f req-51587f89-cb4f-4ea0-a3c4-37fd79f9d5fe service nova] [instance: 4c9fe69e-3f9d-4b30-a9e4-efc3e83efa17] Received event network-vif-plugged-235153d6-63c1-44d2-97cc-c083544e6790 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:55:30 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-f89d462d-e52a-4d97-9318-c2aecc46ea1f req-51587f89-cb4f-4ea0-a3c4-37fd79f9d5fe service nova] Acquiring lock "4c9fe69e-3f9d-4b30-a9e4-efc3e83efa17-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:55:30 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-f89d462d-e52a-4d97-9318-c2aecc46ea1f req-51587f89-cb4f-4ea0-a3c4-37fd79f9d5fe service nova] Lock "4c9fe69e-3f9d-4b30-a9e4-efc3e83efa17-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:55:30 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-f89d462d-e52a-4d97-9318-c2aecc46ea1f req-51587f89-cb4f-4ea0-a3c4-37fd79f9d5fe service nova] Lock "4c9fe69e-3f9d-4b30-a9e4-efc3e83efa17-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:55:30 user nova-compute[75229]: DEBUG nova.compute.manager [req-f89d462d-e52a-4d97-9318-c2aecc46ea1f req-51587f89-cb4f-4ea0-a3c4-37fd79f9d5fe service nova] [instance: 4c9fe69e-3f9d-4b30-a9e4-efc3e83efa17] No waiting events found dispatching network-vif-plugged-235153d6-63c1-44d2-97cc-c083544e6790 {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 09:55:30 user nova-compute[75229]: WARNING nova.compute.manager [req-f89d462d-e52a-4d97-9318-c2aecc46ea1f req-51587f89-cb4f-4ea0-a3c4-37fd79f9d5fe service nova] [instance: 4c9fe69e-3f9d-4b30-a9e4-efc3e83efa17] Received unexpected event network-vif-plugged-235153d6-63c1-44d2-97cc-c083544e6790 for instance with vm_state rescued and task_state unrescuing.
Nov 14 09:55:31 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:55:31 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:55:31 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:55:31 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:55:31 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:55:32 user nova-compute[75229]: DEBUG nova.compute.manager [req-68f50db8-7eee-4766-9af8-9895dabd84a4 req-6b3c9cbf-2090-485c-87f0-049a1721a8ee service nova] [instance: 589f4750-fac6-4e99-a430-0cda339808bc] Received event network-vif-plugged-e10815ba-0472-4ed0-af80-b4d0904580af {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:55:32 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-68f50db8-7eee-4766-9af8-9895dabd84a4 req-6b3c9cbf-2090-485c-87f0-049a1721a8ee service nova] Acquiring lock "589f4750-fac6-4e99-a430-0cda339808bc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:55:32 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-68f50db8-7eee-4766-9af8-9895dabd84a4 req-6b3c9cbf-2090-485c-87f0-049a1721a8ee service nova] Lock "589f4750-fac6-4e99-a430-0cda339808bc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:55:32 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-68f50db8-7eee-4766-9af8-9895dabd84a4 req-6b3c9cbf-2090-485c-87f0-049a1721a8ee service nova] Lock "589f4750-fac6-4e99-a430-0cda339808bc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:55:32 user nova-compute[75229]: DEBUG nova.compute.manager [req-68f50db8-7eee-4766-9af8-9895dabd84a4 req-6b3c9cbf-2090-485c-87f0-049a1721a8ee service nova] [instance: 589f4750-fac6-4e99-a430-0cda339808bc] No waiting events found dispatching network-vif-plugged-e10815ba-0472-4ed0-af80-b4d0904580af {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 09:55:32 user nova-compute[75229]: WARNING nova.compute.manager [req-68f50db8-7eee-4766-9af8-9895dabd84a4 req-6b3c9cbf-2090-485c-87f0-049a1721a8ee service nova] [instance: 589f4750-fac6-4e99-a430-0cda339808bc] Received unexpected event network-vif-plugged-e10815ba-0472-4ed0-af80-b4d0904580af for instance with vm_state building and task_state spawning.
Nov 14 09:55:32 user nova-compute[75229]: DEBUG nova.compute.manager [req-68f50db8-7eee-4766-9af8-9895dabd84a4 req-6b3c9cbf-2090-485c-87f0-049a1721a8ee service nova] [instance: 589f4750-fac6-4e99-a430-0cda339808bc] Received event network-vif-plugged-e10815ba-0472-4ed0-af80-b4d0904580af {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:55:32 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-68f50db8-7eee-4766-9af8-9895dabd84a4 req-6b3c9cbf-2090-485c-87f0-049a1721a8ee service nova] Acquiring lock "589f4750-fac6-4e99-a430-0cda339808bc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:55:32 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-68f50db8-7eee-4766-9af8-9895dabd84a4 req-6b3c9cbf-2090-485c-87f0-049a1721a8ee service nova] Lock "589f4750-fac6-4e99-a430-0cda339808bc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:55:32 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-68f50db8-7eee-4766-9af8-9895dabd84a4 req-6b3c9cbf-2090-485c-87f0-049a1721a8ee service nova] Lock "589f4750-fac6-4e99-a430-0cda339808bc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:55:32 user nova-compute[75229]: DEBUG nova.compute.manager [req-68f50db8-7eee-4766-9af8-9895dabd84a4 req-6b3c9cbf-2090-485c-87f0-049a1721a8ee service nova] [instance: 589f4750-fac6-4e99-a430-0cda339808bc] No waiting events found dispatching network-vif-plugged-e10815ba-0472-4ed0-af80-b4d0904580af {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 09:55:32 user nova-compute[75229]: WARNING nova.compute.manager [req-68f50db8-7eee-4766-9af8-9895dabd84a4 req-6b3c9cbf-2090-485c-87f0-049a1721a8ee service nova] [instance: 589f4750-fac6-4e99-a430-0cda339808bc] Received unexpected event network-vif-plugged-e10815ba-0472-4ed0-af80-b4d0904580af for instance with vm_state building and task_state spawning.
Nov 14 09:55:32 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:55:32 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:55:32 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:55:32 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:55:32 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-051c344f-f51c-40da-bdcb-8449be421fe0 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] Acquiring lock "9cdd6b32-d4bd-4135-a58e-fbc3b6d2a093" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:55:32 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-051c344f-f51c-40da-bdcb-8449be421fe0 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] Lock "9cdd6b32-d4bd-4135-a58e-fbc3b6d2a093" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:55:32 user nova-compute[75229]: DEBUG nova.compute.manager [None req-051c344f-f51c-40da-bdcb-8449be421fe0 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] [instance: 9cdd6b32-d4bd-4135-a58e-fbc3b6d2a093] Starting instance... {{(pid=75229) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 09:55:32 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-051c344f-f51c-40da-bdcb-8449be421fe0 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:55:32 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-051c344f-f51c-40da-bdcb-8449be421fe0 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:55:32 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-051c344f-f51c-40da-bdcb-8449be421fe0 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75229) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 09:55:32 user nova-compute[75229]: INFO nova.compute.claims [None req-051c344f-f51c-40da-bdcb-8449be421fe0 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] [instance: 9cdd6b32-d4bd-4135-a58e-fbc3b6d2a093] Claim successful on node user
Nov 14 09:55:33 user nova-compute[75229]: DEBUG nova.compute.provider_tree [None req-051c344f-f51c-40da-bdcb-8449be421fe0 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] Inventory has not changed in ProviderTree for provider: d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 {{(pid=75229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 09:55:33 user nova-compute[75229]: DEBUG nova.scheduler.client.report [None req-051c344f-f51c-40da-bdcb-8449be421fe0 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] Inventory has not changed for provider d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 09:55:33 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-051c344f-f51c-40da-bdcb-8449be421fe0 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.375s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:55:33 user nova-compute[75229]: DEBUG nova.compute.manager [None req-051c344f-f51c-40da-bdcb-8449be421fe0 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] [instance: 9cdd6b32-d4bd-4135-a58e-fbc3b6d2a093] Start building networks asynchronously for instance. {{(pid=75229) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 09:55:33 user nova-compute[75229]: DEBUG nova.compute.manager [None req-051c344f-f51c-40da-bdcb-8449be421fe0 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] [instance: 9cdd6b32-d4bd-4135-a58e-fbc3b6d2a093] Allocating IP information in the background. {{(pid=75229) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 09:55:33 user nova-compute[75229]: DEBUG nova.network.neutron [None req-051c344f-f51c-40da-bdcb-8449be421fe0 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] [instance: 9cdd6b32-d4bd-4135-a58e-fbc3b6d2a093] allocate_for_instance() {{(pid=75229) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 09:55:33 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-051c344f-f51c-40da-bdcb-8449be421fe0 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] [instance: 9cdd6b32-d4bd-4135-a58e-fbc3b6d2a093] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 09:55:33 user nova-compute[75229]: DEBUG nova.compute.manager [None req-051c344f-f51c-40da-bdcb-8449be421fe0 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] [instance: 9cdd6b32-d4bd-4135-a58e-fbc3b6d2a093] Start building block device mappings for instance. {{(pid=75229) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 09:55:33 user nova-compute[75229]: DEBUG nova.policy [None req-051c344f-f51c-40da-bdcb-8449be421fe0 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3603da40a87149478458797ea9aedfe2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a6157b9827b44d2bab197220b635fd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75229) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 09:55:33 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:55:33 user nova-compute[75229]: DEBUG nova.compute.manager [None req-051c344f-f51c-40da-bdcb-8449be421fe0 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] [instance: 9cdd6b32-d4bd-4135-a58e-fbc3b6d2a093] Start spawning the instance on the hypervisor. {{(pid=75229) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 09:55:33 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-051c344f-f51c-40da-bdcb-8449be421fe0 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] [instance: 9cdd6b32-d4bd-4135-a58e-fbc3b6d2a093] Creating instance directory {{(pid=75229) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 09:55:33 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-051c344f-f51c-40da-bdcb-8449be421fe0 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] [instance: 9cdd6b32-d4bd-4135-a58e-fbc3b6d2a093] Creating image(s)
Nov 14 09:55:33 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-051c344f-f51c-40da-bdcb-8449be421fe0 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] Acquiring lock "/opt/stack/data/nova/instances/9cdd6b32-d4bd-4135-a58e-fbc3b6d2a093/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:55:33 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-051c344f-f51c-40da-bdcb-8449be421fe0 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] Lock "/opt/stack/data/nova/instances/9cdd6b32-d4bd-4135-a58e-fbc3b6d2a093/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:55:33 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-051c344f-f51c-40da-bdcb-8449be421fe0 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] Lock "/opt/stack/data/nova/instances/9cdd6b32-d4bd-4135-a58e-fbc3b6d2a093/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:55:33 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-051c344f-f51c-40da-bdcb-8449be421fe0 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] Acquiring lock "416b91d903087fa895f2161be55eed80e05b44b6" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:55:33 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-051c344f-f51c-40da-bdcb-8449be421fe0 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] Lock "416b91d903087fa895f2161be55eed80e05b44b6" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:55:33 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-051c344f-f51c-40da-bdcb-8449be421fe0 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/416b91d903087fa895f2161be55eed80e05b44b6.part --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:55:34 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-051c344f-f51c-40da-bdcb-8449be421fe0 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/416b91d903087fa895f2161be55eed80e05b44b6.part --force-share --output=json" returned: 0 in 0.167s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:55:34 user nova-compute[75229]: DEBUG nova.virt.images [None req-051c344f-f51c-40da-bdcb-8449be421fe0 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] 0823bd45-8889-44a2-af7b-c62e62168aa0 was qcow2, converting to raw {{(pid=75229) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 14 09:55:34 user nova-compute[75229]: DEBUG nova.privsep.utils [None req-051c344f-f51c-40da-bdcb-8449be421fe0 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75229) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 14 09:55:34 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-051c344f-f51c-40da-bdcb-8449be421fe0 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/416b91d903087fa895f2161be55eed80e05b44b6.part /opt/stack/data/nova/instances/_base/416b91d903087fa895f2161be55eed80e05b44b6.converted {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:55:34 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:55:34 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-051c344f-f51c-40da-bdcb-8449be421fe0 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/416b91d903087fa895f2161be55eed80e05b44b6.part /opt/stack/data/nova/instances/_base/416b91d903087fa895f2161be55eed80e05b44b6.converted" returned: 0 in 0.278s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:55:34 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-051c344f-f51c-40da-bdcb-8449be421fe0 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/416b91d903087fa895f2161be55eed80e05b44b6.converted --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:55:34 user nova-compute[75229]: DEBUG nova.network.neutron [None req-051c344f-f51c-40da-bdcb-8449be421fe0 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] [instance: 9cdd6b32-d4bd-4135-a58e-fbc3b6d2a093] Successfully created port: 5b06ed49-fa0b-4b58-ad6e-a092a9c1d14c {{(pid=75229) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 09:55:34 user nova-compute[75229]: DEBUG nova.compute.manager [req-17aa1d4f-4932-4e93-ba10-57190371e0c4 req-22ca4135-5747-4c13-a05a-36c4bdc2b28f service nova] [instance: 4c9fe69e-3f9d-4b30-a9e4-efc3e83efa17] Received event network-vif-plugged-235153d6-63c1-44d2-97cc-c083544e6790 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:55:34 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-17aa1d4f-4932-4e93-ba10-57190371e0c4 req-22ca4135-5747-4c13-a05a-36c4bdc2b28f service nova] Acquiring lock "4c9fe69e-3f9d-4b30-a9e4-efc3e83efa17-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:55:34 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-17aa1d4f-4932-4e93-ba10-57190371e0c4 req-22ca4135-5747-4c13-a05a-36c4bdc2b28f service nova] Lock "4c9fe69e-3f9d-4b30-a9e4-efc3e83efa17-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:55:34 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-17aa1d4f-4932-4e93-ba10-57190371e0c4 req-22ca4135-5747-4c13-a05a-36c4bdc2b28f service nova] Lock "4c9fe69e-3f9d-4b30-a9e4-efc3e83efa17-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:55:34 user nova-compute[75229]: DEBUG nova.compute.manager [req-17aa1d4f-4932-4e93-ba10-57190371e0c4 req-22ca4135-5747-4c13-a05a-36c4bdc2b28f service nova] [instance: 4c9fe69e-3f9d-4b30-a9e4-efc3e83efa17] No waiting events found dispatching network-vif-plugged-235153d6-63c1-44d2-97cc-c083544e6790 {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 09:55:34 user nova-compute[75229]: WARNING nova.compute.manager [req-17aa1d4f-4932-4e93-ba10-57190371e0c4 req-22ca4135-5747-4c13-a05a-36c4bdc2b28f service nova] [instance: 4c9fe69e-3f9d-4b30-a9e4-efc3e83efa17] Received unexpected event network-vif-plugged-235153d6-63c1-44d2-97cc-c083544e6790 for instance with vm_state rescued and task_state unrescuing.
Nov 14 09:55:34 user nova-compute[75229]: DEBUG nova.compute.manager [req-17aa1d4f-4932-4e93-ba10-57190371e0c4 req-22ca4135-5747-4c13-a05a-36c4bdc2b28f service nova] [instance: 4c9fe69e-3f9d-4b30-a9e4-efc3e83efa17] Received event network-vif-plugged-235153d6-63c1-44d2-97cc-c083544e6790 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:55:34 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-17aa1d4f-4932-4e93-ba10-57190371e0c4 req-22ca4135-5747-4c13-a05a-36c4bdc2b28f service nova] Acquiring lock "4c9fe69e-3f9d-4b30-a9e4-efc3e83efa17-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:55:34 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-17aa1d4f-4932-4e93-ba10-57190371e0c4 req-22ca4135-5747-4c13-a05a-36c4bdc2b28f service nova] Lock "4c9fe69e-3f9d-4b30-a9e4-efc3e83efa17-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:55:34 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-17aa1d4f-4932-4e93-ba10-57190371e0c4 req-22ca4135-5747-4c13-a05a-36c4bdc2b28f service nova] Lock "4c9fe69e-3f9d-4b30-a9e4-efc3e83efa17-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:55:34 user nova-compute[75229]: DEBUG nova.compute.manager [req-17aa1d4f-4932-4e93-ba10-57190371e0c4 req-22ca4135-5747-4c13-a05a-36c4bdc2b28f service nova] [instance: 4c9fe69e-3f9d-4b30-a9e4-efc3e83efa17] No waiting events found dispatching network-vif-plugged-235153d6-63c1-44d2-97cc-c083544e6790 {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 09:55:34 user nova-compute[75229]: WARNING nova.compute.manager [req-17aa1d4f-4932-4e93-ba10-57190371e0c4 req-22ca4135-5747-4c13-a05a-36c4bdc2b28f service nova] [instance: 4c9fe69e-3f9d-4b30-a9e4-efc3e83efa17] Received unexpected event network-vif-plugged-235153d6-63c1-44d2-97cc-c083544e6790 for instance with vm_state rescued and task_state unrescuing.
Nov 14 09:55:34 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-051c344f-f51c-40da-bdcb-8449be421fe0 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/416b91d903087fa895f2161be55eed80e05b44b6.converted --force-share --output=json" returned: 0 in 0.181s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:55:34 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-051c344f-f51c-40da-bdcb-8449be421fe0 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] Lock "416b91d903087fa895f2161be55eed80e05b44b6" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.036s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:55:34 user nova-compute[75229]: DEBUG nova.compute.manager [None req-a251012f-d2c4-4fd0-963b-c13cfae4b0cf tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] [instance: 589f4750-fac6-4e99-a430-0cda339808bc] Instance event wait completed in 0 seconds for  {{(pid=75229) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 09:55:34 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-a251012f-d2c4-4fd0-963b-c13cfae4b0cf tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] [instance: 589f4750-fac6-4e99-a430-0cda339808bc] Guest created on hypervisor {{(pid=75229) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 09:55:34 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-051c344f-f51c-40da-bdcb-8449be421fe0 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/416b91d903087fa895f2161be55eed80e05b44b6 --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:55:34 user nova-compute[75229]: INFO nova.virt.libvirt.driver [-] [instance: 589f4750-fac6-4e99-a430-0cda339808bc] Instance spawned successfully.
Nov 14 09:55:34 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-a251012f-d2c4-4fd0-963b-c13cfae4b0cf tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] [instance: 589f4750-fac6-4e99-a430-0cda339808bc] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 09:55:34 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-a251012f-d2c4-4fd0-963b-c13cfae4b0cf tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] [instance: 589f4750-fac6-4e99-a430-0cda339808bc] Found default for hw_cdrom_bus of ide {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 09:55:34 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-a251012f-d2c4-4fd0-963b-c13cfae4b0cf tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] [instance: 589f4750-fac6-4e99-a430-0cda339808bc] Found default for hw_disk_bus of virtio {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 09:55:34 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-a251012f-d2c4-4fd0-963b-c13cfae4b0cf tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] [instance: 589f4750-fac6-4e99-a430-0cda339808bc] Found default for hw_input_bus of None {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 09:55:34 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-a251012f-d2c4-4fd0-963b-c13cfae4b0cf tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] [instance: 589f4750-fac6-4e99-a430-0cda339808bc] Found default for hw_pointer_model of None {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 09:55:34 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-a251012f-d2c4-4fd0-963b-c13cfae4b0cf tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] [instance: 589f4750-fac6-4e99-a430-0cda339808bc] Found default for hw_video_model of virtio {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 09:55:34 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-a251012f-d2c4-4fd0-963b-c13cfae4b0cf tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] [instance: 589f4750-fac6-4e99-a430-0cda339808bc] Found default for hw_vif_model of virtio {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 09:55:34 user nova-compute[75229]: DEBUG nova.compute.manager [None req-1f87f549-18a8-46e7-98ff-0e3435cda372 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] [instance: 4c9fe69e-3f9d-4b30-a9e4-efc3e83efa17] Checking state {{(pid=75229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 09:55:34 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-051c344f-f51c-40da-bdcb-8449be421fe0 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/416b91d903087fa895f2161be55eed80e05b44b6 --force-share --output=json" returned: 0 in 0.177s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:55:34 user nova-compute[75229]: INFO nova.compute.manager [None req-a251012f-d2c4-4fd0-963b-c13cfae4b0cf tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] [instance: 589f4750-fac6-4e99-a430-0cda339808bc] Took 6.90 seconds to spawn the instance on the hypervisor.
Nov 14 09:55:34 user nova-compute[75229]: DEBUG nova.compute.manager [None req-a251012f-d2c4-4fd0-963b-c13cfae4b0cf tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] [instance: 589f4750-fac6-4e99-a430-0cda339808bc] Checking state {{(pid=75229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 09:55:34 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-051c344f-f51c-40da-bdcb-8449be421fe0 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] Acquiring lock "416b91d903087fa895f2161be55eed80e05b44b6" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:55:34 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-051c344f-f51c-40da-bdcb-8449be421fe0 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] Lock "416b91d903087fa895f2161be55eed80e05b44b6" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:55:34 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-051c344f-f51c-40da-bdcb-8449be421fe0 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/416b91d903087fa895f2161be55eed80e05b44b6 --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:55:34 user nova-compute[75229]: INFO nova.compute.manager [None req-a251012f-d2c4-4fd0-963b-c13cfae4b0cf tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] [instance: 589f4750-fac6-4e99-a430-0cda339808bc] Took 12.64 seconds to build instance.
Nov 14 09:55:34 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-a251012f-d2c4-4fd0-963b-c13cfae4b0cf tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Lock "589f4750-fac6-4e99-a430-0cda339808bc" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.747s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:55:34 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-051c344f-f51c-40da-bdcb-8449be421fe0 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/416b91d903087fa895f2161be55eed80e05b44b6 --force-share --output=json" returned: 0 in 0.169s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:55:34 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-051c344f-f51c-40da-bdcb-8449be421fe0 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/416b91d903087fa895f2161be55eed80e05b44b6,backing_fmt=raw /opt/stack/data/nova/instances/9cdd6b32-d4bd-4135-a58e-fbc3b6d2a093/disk 1073741824 {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:55:34 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-051c344f-f51c-40da-bdcb-8449be421fe0 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/416b91d903087fa895f2161be55eed80e05b44b6,backing_fmt=raw /opt/stack/data/nova/instances/9cdd6b32-d4bd-4135-a58e-fbc3b6d2a093/disk 1073741824" returned: 0 in 0.048s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:55:34 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-051c344f-f51c-40da-bdcb-8449be421fe0 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] Lock "416b91d903087fa895f2161be55eed80e05b44b6" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.222s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:55:34 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-051c344f-f51c-40da-bdcb-8449be421fe0 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/416b91d903087fa895f2161be55eed80e05b44b6 --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:55:34 user nova-compute[75229]: DEBUG nova.network.neutron [None req-051c344f-f51c-40da-bdcb-8449be421fe0 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] [instance: 9cdd6b32-d4bd-4135-a58e-fbc3b6d2a093] Successfully updated port: 5b06ed49-fa0b-4b58-ad6e-a092a9c1d14c {{(pid=75229) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 09:55:35 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-051c344f-f51c-40da-bdcb-8449be421fe0 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] Acquiring lock "refresh_cache-9cdd6b32-d4bd-4135-a58e-fbc3b6d2a093" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 09:55:35 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-051c344f-f51c-40da-bdcb-8449be421fe0 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] Acquired lock "refresh_cache-9cdd6b32-d4bd-4135-a58e-fbc3b6d2a093" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 09:55:35 user nova-compute[75229]: DEBUG nova.network.neutron [None req-051c344f-f51c-40da-bdcb-8449be421fe0 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] [instance: 9cdd6b32-d4bd-4135-a58e-fbc3b6d2a093] Building network info cache for instance {{(pid=75229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 09:55:35 user nova-compute[75229]: DEBUG nova.compute.manager [req-34baaa78-cd1b-4b55-b7f6-bf53b3e3d877 req-06816b46-05b6-4227-a81c-2d7a5dfe0252 service nova] [instance: 9cdd6b32-d4bd-4135-a58e-fbc3b6d2a093] Received event network-changed-5b06ed49-fa0b-4b58-ad6e-a092a9c1d14c {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:55:35 user nova-compute[75229]: DEBUG nova.compute.manager [req-34baaa78-cd1b-4b55-b7f6-bf53b3e3d877 req-06816b46-05b6-4227-a81c-2d7a5dfe0252 service nova] [instance: 9cdd6b32-d4bd-4135-a58e-fbc3b6d2a093] Refreshing instance network info cache due to event network-changed-5b06ed49-fa0b-4b58-ad6e-a092a9c1d14c. {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 09:55:35 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-34baaa78-cd1b-4b55-b7f6-bf53b3e3d877 req-06816b46-05b6-4227-a81c-2d7a5dfe0252 service nova] Acquiring lock "refresh_cache-9cdd6b32-d4bd-4135-a58e-fbc3b6d2a093" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 09:55:35 user nova-compute[75229]: DEBUG nova.network.neutron [None req-051c344f-f51c-40da-bdcb-8449be421fe0 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] [instance: 9cdd6b32-d4bd-4135-a58e-fbc3b6d2a093] Instance cache missing network info. {{(pid=75229) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 09:55:35 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-051c344f-f51c-40da-bdcb-8449be421fe0 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/416b91d903087fa895f2161be55eed80e05b44b6 --force-share --output=json" returned: 0 in 0.179s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:55:35 user nova-compute[75229]: DEBUG nova.virt.disk.api [None req-051c344f-f51c-40da-bdcb-8449be421fe0 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9cdd6b32-d4bd-4135-a58e-fbc3b6d2a093/disk. size=1073741824 {{(pid=75229) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 09:55:35 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-051c344f-f51c-40da-bdcb-8449be421fe0 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cdd6b32-d4bd-4135-a58e-fbc3b6d2a093/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:55:35 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-051c344f-f51c-40da-bdcb-8449be421fe0 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cdd6b32-d4bd-4135-a58e-fbc3b6d2a093/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:55:35 user nova-compute[75229]: DEBUG nova.virt.disk.api [None req-051c344f-f51c-40da-bdcb-8449be421fe0 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] Cannot resize image /opt/stack/data/nova/instances/9cdd6b32-d4bd-4135-a58e-fbc3b6d2a093/disk to a smaller size. {{(pid=75229) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 09:55:35 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-051c344f-f51c-40da-bdcb-8449be421fe0 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] [instance: 9cdd6b32-d4bd-4135-a58e-fbc3b6d2a093] Created local disks {{(pid=75229) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 09:55:35 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-051c344f-f51c-40da-bdcb-8449be421fe0 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] [instance: 9cdd6b32-d4bd-4135-a58e-fbc3b6d2a093] Ensure instance console log exists: /opt/stack/data/nova/instances/9cdd6b32-d4bd-4135-a58e-fbc3b6d2a093/console.log {{(pid=75229) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 09:55:35 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-051c344f-f51c-40da-bdcb-8449be421fe0 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:55:35 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-051c344f-f51c-40da-bdcb-8449be421fe0 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:55:35 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-051c344f-f51c-40da-bdcb-8449be421fe0 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:55:35 user nova-compute[75229]: DEBUG nova.network.neutron [None req-051c344f-f51c-40da-bdcb-8449be421fe0 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] [instance: 9cdd6b32-d4bd-4135-a58e-fbc3b6d2a093] Updating instance_info_cache with network_info: [{"id": "5b06ed49-fa0b-4b58-ad6e-a092a9c1d14c", "address": "fa:16:3e:f8:75:16", "network": {"id": "1687d918-9f70-4099-b44c-97f92f90e6ff", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2074208460-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a6157b9827b44d2bab197220b635fd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b06ed49-fa", "ovs_interfaceid": "5b06ed49-fa0b-4b58-ad6e-a092a9c1d14c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 09:55:35 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-051c344f-f51c-40da-bdcb-8449be421fe0 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] Releasing lock "refresh_cache-9cdd6b32-d4bd-4135-a58e-fbc3b6d2a093" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 09:55:35 user nova-compute[75229]: DEBUG nova.compute.manager [None req-051c344f-f51c-40da-bdcb-8449be421fe0 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] [instance: 9cdd6b32-d4bd-4135-a58e-fbc3b6d2a093] Instance network_info: |[{"id": "5b06ed49-fa0b-4b58-ad6e-a092a9c1d14c", "address": "fa:16:3e:f8:75:16", "network": {"id": "1687d918-9f70-4099-b44c-97f92f90e6ff", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2074208460-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a6157b9827b44d2bab197220b635fd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b06ed49-fa", "ovs_interfaceid": "5b06ed49-fa0b-4b58-ad6e-a092a9c1d14c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75229) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 09:55:35 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-34baaa78-cd1b-4b55-b7f6-bf53b3e3d877 req-06816b46-05b6-4227-a81c-2d7a5dfe0252 service nova] Acquired lock "refresh_cache-9cdd6b32-d4bd-4135-a58e-fbc3b6d2a093" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 09:55:35 user nova-compute[75229]: DEBUG nova.network.neutron [req-34baaa78-cd1b-4b55-b7f6-bf53b3e3d877 req-06816b46-05b6-4227-a81c-2d7a5dfe0252 service nova] [instance: 9cdd6b32-d4bd-4135-a58e-fbc3b6d2a093] Refreshing network info cache for port 5b06ed49-fa0b-4b58-ad6e-a092a9c1d14c {{(pid=75229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 09:55:35 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-051c344f-f51c-40da-bdcb-8449be421fe0 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] [instance: 9cdd6b32-d4bd-4135-a58e-fbc3b6d2a093] Start _get_guest_xml network_info=[{"id": "5b06ed49-fa0b-4b58-ad6e-a092a9c1d14c", "address": "fa:16:3e:f8:75:16", "network": {"id": "1687d918-9f70-4099-b44c-97f92f90e6ff", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2074208460-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a6157b9827b44d2bab197220b635fd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b06ed49-fa", "ovs_interfaceid": "5b06ed49-fa0b-4b58-ad6e-a092a9c1d14c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T09:55:30Z,direct_url=<?>,disk_format='qcow2',id=0823bd45-8889-44a2-af7b-c62e62168aa0,min_disk=0,min_ram=0,name='tempest-scenario-img--1422221435',owner='4a6157b9827b44d2bab197220b635fd3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T09:55:31Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'disk_bus': 'virtio', 'guest_format': None, 'encryption_secret_uuid': None, 'size': 0, 'device_type': 'disk', 'image_id': '0823bd45-8889-44a2-af7b-c62e62168aa0'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75229) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 09:55:35 user nova-compute[75229]: WARNING nova.virt.libvirt.driver [None req-051c344f-f51c-40da-bdcb-8449be421fe0 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 09:55:35 user nova-compute[75229]: WARNING nova.virt.libvirt.driver [None req-051c344f-f51c-40da-bdcb-8449be421fe0 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 09:55:35 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-051c344f-f51c-40da-bdcb-8449be421fe0 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75229) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 09:55:35 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-051c344f-f51c-40da-bdcb-8449be421fe0 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] CPU controller missing on host. {{(pid=75229) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 09:55:35 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-051c344f-f51c-40da-bdcb-8449be421fe0 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75229) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 09:55:35 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-051c344f-f51c-40da-bdcb-8449be421fe0 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] CPU controller found on host. {{(pid=75229) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 09:55:35 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-051c344f-f51c-40da-bdcb-8449be421fe0 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75229) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 09:55:35 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-051c344f-f51c-40da-bdcb-8449be421fe0 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T09:39:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T09:55:30Z,direct_url=<?>,disk_format='qcow2',id=0823bd45-8889-44a2-af7b-c62e62168aa0,min_disk=0,min_ram=0,name='tempest-scenario-img--1422221435',owner='4a6157b9827b44d2bab197220b635fd3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T09:55:31Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 09:55:35 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-051c344f-f51c-40da-bdcb-8449be421fe0 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] Flavor limits 0:0:0 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 09:55:35 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-051c344f-f51c-40da-bdcb-8449be421fe0 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] Image limits 0:0:0 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 09:55:35 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-051c344f-f51c-40da-bdcb-8449be421fe0 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] Flavor pref 0:0:0 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 09:55:35 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-051c344f-f51c-40da-bdcb-8449be421fe0 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] Image pref 0:0:0 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 09:55:35 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-051c344f-f51c-40da-bdcb-8449be421fe0 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 09:55:35 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-051c344f-f51c-40da-bdcb-8449be421fe0 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 09:55:35 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-051c344f-f51c-40da-bdcb-8449be421fe0 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75229) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 09:55:35 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-051c344f-f51c-40da-bdcb-8449be421fe0 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] Got 1 possible topologies {{(pid=75229) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 09:55:35 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-051c344f-f51c-40da-bdcb-8449be421fe0 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 09:55:35 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-051c344f-f51c-40da-bdcb-8449be421fe0 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 09:55:35 user nova-compute[75229]: DEBUG nova.virt.libvirt.vif [None req-051c344f-f51c-40da-bdcb-8449be421fe0 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T09:55:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-508307917',display_name='tempest-TestMinimumBasicScenario-server-508307917',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-508307917',id=33,image_ref='0823bd45-8889-44a2-af7b-c62e62168aa0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNQaiZrYxhtQ9Z1odWv1XxjAtK8tIVJIrMXqwnGE0zhhoD5Zg7LGVLpp3XoFHJhcj9HkgHw1PM90l9fXjhW3gfdtl+BsuTiL7uocPMAUPc5CoP4m/p+J4JQ8M4ffCWUssg==',key_name='tempest-TestMinimumBasicScenario-1462263209',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4a6157b9827b44d2bab197220b635fd3',ramdisk_id='',reservation_id='r-dtnj4adv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0823bd45-8889-44a2-af7b-c62e62168aa0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-284611138',owner_user_name='tempest-TestMinimumBasicScenario-284611138-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T09:55:33Z,user_data=None,user_id='3603da40a87149478458797ea9aedfe2',uuid=9cdd6b32-d4bd-4135-a58e-fbc3b6d2a093,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5b06ed49-fa0b-4b58-ad6e-a092a9c1d14c", "address": "fa:16:3e:f8:75:16", "network": {"id": "1687d918-9f70-4099-b44c-97f92f90e6ff", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2074208460-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a6157b9827b44d2bab197220b635fd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b06ed49-fa", "ovs_interfaceid": "5b06ed49-fa0b-4b58-ad6e-a092a9c1d14c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75229) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 09:55:35 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-051c344f-f51c-40da-bdcb-8449be421fe0 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] Converting VIF {"id": "5b06ed49-fa0b-4b58-ad6e-a092a9c1d14c", "address": "fa:16:3e:f8:75:16", "network": {"id": "1687d918-9f70-4099-b44c-97f92f90e6ff", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2074208460-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a6157b9827b44d2bab197220b635fd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b06ed49-fa", "ovs_interfaceid": "5b06ed49-fa0b-4b58-ad6e-a092a9c1d14c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 09:55:35 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-051c344f-f51c-40da-bdcb-8449be421fe0 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f8:75:16,bridge_name='br-int',has_traffic_filtering=True,id=5b06ed49-fa0b-4b58-ad6e-a092a9c1d14c,network=Network(1687d918-9f70-4099-b44c-97f92f90e6ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b06ed49-fa') {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 09:55:35 user nova-compute[75229]: DEBUG nova.objects.instance [None req-051c344f-f51c-40da-bdcb-8449be421fe0 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] Lazy-loading 'pci_devices' on Instance uuid 9cdd6b32-d4bd-4135-a58e-fbc3b6d2a093 {{(pid=75229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 09:55:35 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-051c344f-f51c-40da-bdcb-8449be421fe0 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] [instance: 9cdd6b32-d4bd-4135-a58e-fbc3b6d2a093] End _get_guest_xml xml=<domain type="kvm">
Nov 14 09:55:35 user nova-compute[75229]:   <uuid>9cdd6b32-d4bd-4135-a58e-fbc3b6d2a093</uuid>
Nov 14 09:55:35 user nova-compute[75229]:   <name>instance-00000021</name>
Nov 14 09:55:35 user nova-compute[75229]:   <memory>524288</memory>
Nov 14 09:55:35 user nova-compute[75229]:   <vcpu>1</vcpu>
Nov 14 09:55:35 user nova-compute[75229]:   <metadata>
Nov 14 09:55:35 user nova-compute[75229]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 09:55:35 user nova-compute[75229]:       <nova:package version="0.0.0"/>
Nov 14 09:55:35 user nova-compute[75229]:       <nova:name>tempest-TestMinimumBasicScenario-server-508307917</nova:name>
Nov 14 09:55:35 user nova-compute[75229]:       <nova:creationTime>2023-11-14 09:55:35</nova:creationTime>
Nov 14 09:55:35 user nova-compute[75229]:       <nova:flavor name="m1.tiny">
Nov 14 09:55:35 user nova-compute[75229]:         <nova:memory>512</nova:memory>
Nov 14 09:55:35 user nova-compute[75229]:         <nova:disk>1</nova:disk>
Nov 14 09:55:35 user nova-compute[75229]:         <nova:swap>0</nova:swap>
Nov 14 09:55:35 user nova-compute[75229]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 09:55:35 user nova-compute[75229]:         <nova:vcpus>1</nova:vcpus>
Nov 14 09:55:35 user nova-compute[75229]:       </nova:flavor>
Nov 14 09:55:35 user nova-compute[75229]:       <nova:owner>
Nov 14 09:55:35 user nova-compute[75229]:         <nova:user uuid="3603da40a87149478458797ea9aedfe2">tempest-TestMinimumBasicScenario-284611138-project-member</nova:user>
Nov 14 09:55:35 user nova-compute[75229]:         <nova:project uuid="4a6157b9827b44d2bab197220b635fd3">tempest-TestMinimumBasicScenario-284611138</nova:project>
Nov 14 09:55:35 user nova-compute[75229]:       </nova:owner>
Nov 14 09:55:35 user nova-compute[75229]:       <nova:root type="image" uuid="0823bd45-8889-44a2-af7b-c62e62168aa0"/>
Nov 14 09:55:35 user nova-compute[75229]:       <nova:ports>
Nov 14 09:55:35 user nova-compute[75229]:         <nova:port uuid="5b06ed49-fa0b-4b58-ad6e-a092a9c1d14c">
Nov 14 09:55:35 user nova-compute[75229]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 14 09:55:35 user nova-compute[75229]:         </nova:port>
Nov 14 09:55:35 user nova-compute[75229]:       </nova:ports>
Nov 14 09:55:35 user nova-compute[75229]:     </nova:instance>
Nov 14 09:55:35 user nova-compute[75229]:   </metadata>
Nov 14 09:55:35 user nova-compute[75229]:   <sysinfo type="smbios">
Nov 14 09:55:35 user nova-compute[75229]:     <system>
Nov 14 09:55:35 user nova-compute[75229]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 09:55:35 user nova-compute[75229]:       <entry name="product">OpenStack Nova</entry>
Nov 14 09:55:35 user nova-compute[75229]:       <entry name="version">0.0.0</entry>
Nov 14 09:55:35 user nova-compute[75229]:       <entry name="serial">9cdd6b32-d4bd-4135-a58e-fbc3b6d2a093</entry>
Nov 14 09:55:35 user nova-compute[75229]:       <entry name="uuid">9cdd6b32-d4bd-4135-a58e-fbc3b6d2a093</entry>
Nov 14 09:55:35 user nova-compute[75229]:       <entry name="family">Virtual Machine</entry>
Nov 14 09:55:35 user nova-compute[75229]:     </system>
Nov 14 09:55:35 user nova-compute[75229]:   </sysinfo>
Nov 14 09:55:35 user nova-compute[75229]:   <os>
Nov 14 09:55:35 user nova-compute[75229]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 09:55:35 user nova-compute[75229]:     <boot dev="hd"/>
Nov 14 09:55:35 user nova-compute[75229]:     <smbios mode="sysinfo"/>
Nov 14 09:55:35 user nova-compute[75229]:   </os>
Nov 14 09:55:35 user nova-compute[75229]:   <features>
Nov 14 09:55:35 user nova-compute[75229]:     <acpi/>
Nov 14 09:55:35 user nova-compute[75229]:     <apic/>
Nov 14 09:55:35 user nova-compute[75229]:     <vmcoreinfo/>
Nov 14 09:55:35 user nova-compute[75229]:   </features>
Nov 14 09:55:35 user nova-compute[75229]:   <clock offset="utc">
Nov 14 09:55:35 user nova-compute[75229]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 09:55:35 user nova-compute[75229]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 09:55:35 user nova-compute[75229]:     <timer name="hpet" present="no"/>
Nov 14 09:55:35 user nova-compute[75229]:   </clock>
Nov 14 09:55:35 user nova-compute[75229]:   <cpu mode="custom" match="exact">
Nov 14 09:55:35 user nova-compute[75229]:     <model>Nehalem</model>
Nov 14 09:55:35 user nova-compute[75229]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 09:55:35 user nova-compute[75229]:   </cpu>
Nov 14 09:55:35 user nova-compute[75229]:   <devices>
Nov 14 09:55:35 user nova-compute[75229]:     <disk type="file" device="disk">
Nov 14 09:55:35 user nova-compute[75229]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 09:55:35 user nova-compute[75229]:       <source file="/opt/stack/data/nova/instances/9cdd6b32-d4bd-4135-a58e-fbc3b6d2a093/disk"/>
Nov 14 09:55:35 user nova-compute[75229]:       <target dev="vda" bus="virtio"/>
Nov 14 09:55:35 user nova-compute[75229]:     </disk>
Nov 14 09:55:35 user nova-compute[75229]:     <interface type="ethernet">
Nov 14 09:55:35 user nova-compute[75229]:       <mac address="fa:16:3e:f8:75:16"/>
Nov 14 09:55:35 user nova-compute[75229]:       <model type="virtio"/>
Nov 14 09:55:35 user nova-compute[75229]:       <mtu size="1442"/>
Nov 14 09:55:35 user nova-compute[75229]:       <target dev="tap5b06ed49-fa"/>
Nov 14 09:55:35 user nova-compute[75229]:     </interface>
Nov 14 09:55:35 user nova-compute[75229]:     <serial type="pty">
Nov 14 09:55:35 user nova-compute[75229]:       <log file="/opt/stack/data/nova/instances/9cdd6b32-d4bd-4135-a58e-fbc3b6d2a093/console.log" append="off"/>
Nov 14 09:55:35 user nova-compute[75229]:     </serial>
Nov 14 09:55:35 user nova-compute[75229]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 09:55:35 user nova-compute[75229]:     <video>
Nov 14 09:55:35 user nova-compute[75229]:       <model type="virtio"/>
Nov 14 09:55:35 user nova-compute[75229]:     </video>
Nov 14 09:55:35 user nova-compute[75229]:     <rng model="virtio">
Nov 14 09:55:35 user nova-compute[75229]:       <backend model="random">/dev/urandom</backend>
Nov 14 09:55:35 user nova-compute[75229]:     </rng>
Nov 14 09:55:35 user nova-compute[75229]:     <controller type="usb" index="0" model="none"/>
Nov 14 09:55:35 user nova-compute[75229]:     <memballoon model="virtio">
Nov 14 09:55:35 user nova-compute[75229]:       <stats period="10"/>
Nov 14 09:55:35 user nova-compute[75229]:     </memballoon>
Nov 14 09:55:35 user nova-compute[75229]:   </devices>
Nov 14 09:55:35 user nova-compute[75229]: </domain>
Nov 14 09:55:35 user nova-compute[75229]:  {{(pid=75229) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 09:55:35 user nova-compute[75229]: DEBUG nova.virt.libvirt.vif [None req-051c344f-f51c-40da-bdcb-8449be421fe0 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T09:55:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-508307917',display_name='tempest-TestMinimumBasicScenario-server-508307917',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-508307917',id=33,image_ref='0823bd45-8889-44a2-af7b-c62e62168aa0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNQaiZrYxhtQ9Z1odWv1XxjAtK8tIVJIrMXqwnGE0zhhoD5Zg7LGVLpp3XoFHJhcj9HkgHw1PM90l9fXjhW3gfdtl+BsuTiL7uocPMAUPc5CoP4m/p+J4JQ8M4ffCWUssg==',key_name='tempest-TestMinimumBasicScenario-1462263209',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4a6157b9827b44d2bab197220b635fd3',ramdisk_id='',reservation_id='r-dtnj4adv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0823bd45-8889-44a2-af7b-c62e62168aa0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-284611138',owner_user_name='tempest-TestMinimumBasicScenario-284611138-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T09:55:33Z,user_data=None,user_id='3603da40a87149478458797ea9aedfe2',uuid=9cdd6b32-d4bd-4135-a58e-fbc3b6d2a093,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5b06ed49-fa0b-4b58-ad6e-a092a9c1d14c", "address": "fa:16:3e:f8:75:16", "network": {"id": "1687d918-9f70-4099-b44c-97f92f90e6ff", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2074208460-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a6157b9827b44d2bab197220b635fd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b06ed49-fa", "ovs_interfaceid": "5b06ed49-fa0b-4b58-ad6e-a092a9c1d14c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 09:55:35 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-051c344f-f51c-40da-bdcb-8449be421fe0 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] Converting VIF {"id": "5b06ed49-fa0b-4b58-ad6e-a092a9c1d14c", "address": "fa:16:3e:f8:75:16", "network": {"id": "1687d918-9f70-4099-b44c-97f92f90e6ff", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2074208460-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a6157b9827b44d2bab197220b635fd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b06ed49-fa", "ovs_interfaceid": "5b06ed49-fa0b-4b58-ad6e-a092a9c1d14c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 09:55:35 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-051c344f-f51c-40da-bdcb-8449be421fe0 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f8:75:16,bridge_name='br-int',has_traffic_filtering=True,id=5b06ed49-fa0b-4b58-ad6e-a092a9c1d14c,network=Network(1687d918-9f70-4099-b44c-97f92f90e6ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b06ed49-fa') {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 09:55:35 user nova-compute[75229]: DEBUG os_vif [None req-051c344f-f51c-40da-bdcb-8449be421fe0 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f8:75:16,bridge_name='br-int',has_traffic_filtering=True,id=5b06ed49-fa0b-4b58-ad6e-a092a9c1d14c,network=Network(1687d918-9f70-4099-b44c-97f92f90e6ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b06ed49-fa') {{(pid=75229) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 09:55:35 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:55:35 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:55:35 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 09:55:35 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:55:35 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '40057138-d410-5562-9e26-54876b8a982c', '_type': 'linux-noop'}}, row=False) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:55:35 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:55:35 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:55:35 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:55:35 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5b06ed49-fa, may_exist=True, interface_attrs={}) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:55:35 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5b06ed49-fa, col_values=(('qos', UUID('bec2dd27-4292-4ce0-8002-71c3810f0fe4')),), if_exists=True) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:55:35 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5b06ed49-fa, col_values=(('external_ids', {'iface-id': '5b06ed49-fa0b-4b58-ad6e-a092a9c1d14c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f8:75:16', 'vm-uuid': '9cdd6b32-d4bd-4135-a58e-fbc3b6d2a093'}),), if_exists=True) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:55:35 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:55:35 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 09:55:35 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:55:35 user nova-compute[75229]: INFO os_vif [None req-051c344f-f51c-40da-bdcb-8449be421fe0 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f8:75:16,bridge_name='br-int',has_traffic_filtering=True,id=5b06ed49-fa0b-4b58-ad6e-a092a9c1d14c,network=Network(1687d918-9f70-4099-b44c-97f92f90e6ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b06ed49-fa')
Nov 14 09:55:35 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-051c344f-f51c-40da-bdcb-8449be421fe0 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] No BDM found with device name vda, not building metadata. {{(pid=75229) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 09:55:35 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-051c344f-f51c-40da-bdcb-8449be421fe0 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] No VIF found with MAC fa:16:3e:f8:75:16, not building metadata {{(pid=75229) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 09:55:35 user nova-compute[75229]: DEBUG nova.network.neutron [req-34baaa78-cd1b-4b55-b7f6-bf53b3e3d877 req-06816b46-05b6-4227-a81c-2d7a5dfe0252 service nova] [instance: 9cdd6b32-d4bd-4135-a58e-fbc3b6d2a093] Updated VIF entry in instance network info cache for port 5b06ed49-fa0b-4b58-ad6e-a092a9c1d14c. {{(pid=75229) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 09:55:35 user nova-compute[75229]: DEBUG nova.network.neutron [req-34baaa78-cd1b-4b55-b7f6-bf53b3e3d877 req-06816b46-05b6-4227-a81c-2d7a5dfe0252 service nova] [instance: 9cdd6b32-d4bd-4135-a58e-fbc3b6d2a093] Updating instance_info_cache with network_info: [{"id": "5b06ed49-fa0b-4b58-ad6e-a092a9c1d14c", "address": "fa:16:3e:f8:75:16", "network": {"id": "1687d918-9f70-4099-b44c-97f92f90e6ff", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2074208460-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a6157b9827b44d2bab197220b635fd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b06ed49-fa", "ovs_interfaceid": "5b06ed49-fa0b-4b58-ad6e-a092a9c1d14c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 09:55:35 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-34baaa78-cd1b-4b55-b7f6-bf53b3e3d877 req-06816b46-05b6-4227-a81c-2d7a5dfe0252 service nova] Releasing lock "refresh_cache-9cdd6b32-d4bd-4135-a58e-fbc3b6d2a093" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 09:55:36 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:55:37 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:55:37 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:55:37 user nova-compute[75229]: DEBUG nova.compute.manager [req-7fd21518-dca7-4896-847d-62f0b37dcad7 req-419911c9-62d7-470d-b1b8-83e0a2929880 service nova] [instance: 9cdd6b32-d4bd-4135-a58e-fbc3b6d2a093] Received event network-vif-plugged-5b06ed49-fa0b-4b58-ad6e-a092a9c1d14c {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:55:37 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-7fd21518-dca7-4896-847d-62f0b37dcad7 req-419911c9-62d7-470d-b1b8-83e0a2929880 service nova] Acquiring lock "9cdd6b32-d4bd-4135-a58e-fbc3b6d2a093-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:55:37 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-7fd21518-dca7-4896-847d-62f0b37dcad7 req-419911c9-62d7-470d-b1b8-83e0a2929880 service nova] Lock "9cdd6b32-d4bd-4135-a58e-fbc3b6d2a093-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:55:37 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-7fd21518-dca7-4896-847d-62f0b37dcad7 req-419911c9-62d7-470d-b1b8-83e0a2929880 service nova] Lock "9cdd6b32-d4bd-4135-a58e-fbc3b6d2a093-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:55:37 user nova-compute[75229]: DEBUG nova.compute.manager [req-7fd21518-dca7-4896-847d-62f0b37dcad7 req-419911c9-62d7-470d-b1b8-83e0a2929880 service nova] [instance: 9cdd6b32-d4bd-4135-a58e-fbc3b6d2a093] No waiting events found dispatching network-vif-plugged-5b06ed49-fa0b-4b58-ad6e-a092a9c1d14c {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 09:55:37 user nova-compute[75229]: WARNING nova.compute.manager [req-7fd21518-dca7-4896-847d-62f0b37dcad7 req-419911c9-62d7-470d-b1b8-83e0a2929880 service nova] [instance: 9cdd6b32-d4bd-4135-a58e-fbc3b6d2a093] Received unexpected event network-vif-plugged-5b06ed49-fa0b-4b58-ad6e-a092a9c1d14c for instance with vm_state building and task_state spawning.
Nov 14 09:55:37 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:55:37 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:55:37 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:55:37 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:55:38 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:55:39 user nova-compute[75229]: DEBUG nova.compute.manager [req-34b214e8-e9f2-4c11-974e-0af1ba99cafe req-d6756091-8187-4421-8c02-5d74917bac94 service nova] [instance: 9cdd6b32-d4bd-4135-a58e-fbc3b6d2a093] Received event network-vif-plugged-5b06ed49-fa0b-4b58-ad6e-a092a9c1d14c {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:55:39 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-34b214e8-e9f2-4c11-974e-0af1ba99cafe req-d6756091-8187-4421-8c02-5d74917bac94 service nova] Acquiring lock "9cdd6b32-d4bd-4135-a58e-fbc3b6d2a093-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:55:39 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-34b214e8-e9f2-4c11-974e-0af1ba99cafe req-d6756091-8187-4421-8c02-5d74917bac94 service nova] Lock "9cdd6b32-d4bd-4135-a58e-fbc3b6d2a093-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:55:39 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-34b214e8-e9f2-4c11-974e-0af1ba99cafe req-d6756091-8187-4421-8c02-5d74917bac94 service nova] Lock "9cdd6b32-d4bd-4135-a58e-fbc3b6d2a093-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:55:39 user nova-compute[75229]: DEBUG nova.compute.manager [req-34b214e8-e9f2-4c11-974e-0af1ba99cafe req-d6756091-8187-4421-8c02-5d74917bac94 service nova] [instance: 9cdd6b32-d4bd-4135-a58e-fbc3b6d2a093] No waiting events found dispatching network-vif-plugged-5b06ed49-fa0b-4b58-ad6e-a092a9c1d14c {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 09:55:39 user nova-compute[75229]: WARNING nova.compute.manager [req-34b214e8-e9f2-4c11-974e-0af1ba99cafe req-d6756091-8187-4421-8c02-5d74917bac94 service nova] [instance: 9cdd6b32-d4bd-4135-a58e-fbc3b6d2a093] Received unexpected event network-vif-plugged-5b06ed49-fa0b-4b58-ad6e-a092a9c1d14c for instance with vm_state building and task_state spawning.
Nov 14 09:55:39 user nova-compute[75229]: DEBUG nova.compute.manager [None req-051c344f-f51c-40da-bdcb-8449be421fe0 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] [instance: 9cdd6b32-d4bd-4135-a58e-fbc3b6d2a093] Instance event wait completed in 0 seconds for  {{(pid=75229) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 09:55:39 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-051c344f-f51c-40da-bdcb-8449be421fe0 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] [instance: 9cdd6b32-d4bd-4135-a58e-fbc3b6d2a093] Guest created on hypervisor {{(pid=75229) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 09:55:39 user nova-compute[75229]: INFO nova.virt.libvirt.driver [-] [instance: 9cdd6b32-d4bd-4135-a58e-fbc3b6d2a093] Instance spawned successfully.
Nov 14 09:55:39 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-051c344f-f51c-40da-bdcb-8449be421fe0 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] [instance: 9cdd6b32-d4bd-4135-a58e-fbc3b6d2a093] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 09:55:39 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-051c344f-f51c-40da-bdcb-8449be421fe0 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] [instance: 9cdd6b32-d4bd-4135-a58e-fbc3b6d2a093] Found default for hw_cdrom_bus of ide {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 09:55:39 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-051c344f-f51c-40da-bdcb-8449be421fe0 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] [instance: 9cdd6b32-d4bd-4135-a58e-fbc3b6d2a093] Found default for hw_disk_bus of virtio {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 09:55:39 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-051c344f-f51c-40da-bdcb-8449be421fe0 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] [instance: 9cdd6b32-d4bd-4135-a58e-fbc3b6d2a093] Found default for hw_input_bus of None {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 09:55:39 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-051c344f-f51c-40da-bdcb-8449be421fe0 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] [instance: 9cdd6b32-d4bd-4135-a58e-fbc3b6d2a093] Found default for hw_pointer_model of None {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 09:55:39 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-051c344f-f51c-40da-bdcb-8449be421fe0 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] [instance: 9cdd6b32-d4bd-4135-a58e-fbc3b6d2a093] Found default for hw_video_model of virtio {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 09:55:39 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-051c344f-f51c-40da-bdcb-8449be421fe0 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] [instance: 9cdd6b32-d4bd-4135-a58e-fbc3b6d2a093] Found default for hw_vif_model of virtio {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 09:55:39 user nova-compute[75229]: DEBUG nova.compute.manager [None req-c8f8bb5c-ae06-4dd6-830d-1d07be61c0fc tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] [instance: cda8c5ad-e70c-4021-bace-d55831c4bc78] Checking state {{(pid=75229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 09:55:39 user nova-compute[75229]: INFO nova.compute.manager [None req-051c344f-f51c-40da-bdcb-8449be421fe0 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] [instance: 9cdd6b32-d4bd-4135-a58e-fbc3b6d2a093] Took 6.06 seconds to spawn the instance on the hypervisor.
Nov 14 09:55:39 user nova-compute[75229]: DEBUG nova.compute.manager [None req-051c344f-f51c-40da-bdcb-8449be421fe0 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] [instance: 9cdd6b32-d4bd-4135-a58e-fbc3b6d2a093] Checking state {{(pid=75229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 09:55:39 user nova-compute[75229]: INFO nova.compute.manager [None req-c8f8bb5c-ae06-4dd6-830d-1d07be61c0fc tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] [instance: cda8c5ad-e70c-4021-bace-d55831c4bc78] instance snapshotting
Nov 14 09:55:39 user nova-compute[75229]: INFO nova.compute.manager [None req-051c344f-f51c-40da-bdcb-8449be421fe0 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] [instance: 9cdd6b32-d4bd-4135-a58e-fbc3b6d2a093] Took 6.77 seconds to build instance.
Nov 14 09:55:39 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-051c344f-f51c-40da-bdcb-8449be421fe0 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] Lock "9cdd6b32-d4bd-4135-a58e-fbc3b6d2a093" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.888s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:55:39 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-c8f8bb5c-ae06-4dd6-830d-1d07be61c0fc tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] [instance: cda8c5ad-e70c-4021-bace-d55831c4bc78] Beginning live snapshot process
Nov 14 09:55:39 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-c8f8bb5c-ae06-4dd6-830d-1d07be61c0fc tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cda8c5ad-e70c-4021-bace-d55831c4bc78/disk --force-share --output=json -f qcow2 {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:55:40 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-c8f8bb5c-ae06-4dd6-830d-1d07be61c0fc tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cda8c5ad-e70c-4021-bace-d55831c4bc78/disk --force-share --output=json -f qcow2" returned: 0 in 0.193s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:55:40 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-c8f8bb5c-ae06-4dd6-830d-1d07be61c0fc tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cda8c5ad-e70c-4021-bace-d55831c4bc78/disk --force-share --output=json -f qcow2 {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:55:40 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-c8f8bb5c-ae06-4dd6-830d-1d07be61c0fc tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cda8c5ad-e70c-4021-bace-d55831c4bc78/disk --force-share --output=json -f qcow2" returned: 0 in 0.229s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:55:40 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-c8f8bb5c-ae06-4dd6-830d-1d07be61c0fc tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6 --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:55:40 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-c8f8bb5c-ae06-4dd6-830d-1d07be61c0fc tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6 --force-share --output=json" returned: 0 in 0.195s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:55:40 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-c8f8bb5c-ae06-4dd6-830d-1d07be61c0fc tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmppgecwv0u/9557869943c74e5d89ddc928494a924f.delta 1073741824 {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:55:40 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-c8f8bb5c-ae06-4dd6-830d-1d07be61c0fc tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmppgecwv0u/9557869943c74e5d89ddc928494a924f.delta 1073741824" returned: 0 in 0.051s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:55:40 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-c8f8bb5c-ae06-4dd6-830d-1d07be61c0fc tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] [instance: cda8c5ad-e70c-4021-bace-d55831c4bc78] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 14 09:55:40 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:55:41 user nova-compute[75229]: DEBUG nova.virt.libvirt.guest [None req-c8f8bb5c-ae06-4dd6-830d-1d07be61c0fc tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=75229) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 09:55:41 user nova-compute[75229]: DEBUG nova.virt.libvirt.guest [None req-c8f8bb5c-ae06-4dd6-830d-1d07be61c0fc tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=75229) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 09:55:41 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-c8f8bb5c-ae06-4dd6-830d-1d07be61c0fc tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] [instance: cda8c5ad-e70c-4021-bace-d55831c4bc78] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 14 09:55:41 user nova-compute[75229]: DEBUG nova.privsep.utils [None req-c8f8bb5c-ae06-4dd6-830d-1d07be61c0fc tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75229) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 14 09:55:41 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-c8f8bb5c-ae06-4dd6-830d-1d07be61c0fc tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmppgecwv0u/9557869943c74e5d89ddc928494a924f.delta /opt/stack/data/nova/instances/snapshots/tmppgecwv0u/9557869943c74e5d89ddc928494a924f {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:55:42 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-c8f8bb5c-ae06-4dd6-830d-1d07be61c0fc tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmppgecwv0u/9557869943c74e5d89ddc928494a924f.delta /opt/stack/data/nova/instances/snapshots/tmppgecwv0u/9557869943c74e5d89ddc928494a924f" returned: 0 in 0.256s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:55:42 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-c8f8bb5c-ae06-4dd6-830d-1d07be61c0fc tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] [instance: cda8c5ad-e70c-4021-bace-d55831c4bc78] Snapshot extracted, beginning image upload
Nov 14 09:55:43 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:55:45 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-c8f8bb5c-ae06-4dd6-830d-1d07be61c0fc tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] [instance: cda8c5ad-e70c-4021-bace-d55831c4bc78] Snapshot image upload complete
Nov 14 09:55:45 user nova-compute[75229]: INFO nova.compute.manager [None req-c8f8bb5c-ae06-4dd6-830d-1d07be61c0fc tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] [instance: cda8c5ad-e70c-4021-bace-d55831c4bc78] Took 5.39 seconds to snapshot the instance on the hypervisor.
Nov 14 09:55:45 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:55:48 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 09:55:50 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 09:55:50 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:55:50 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75229) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 09:55:50 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75229) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 09:55:50 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75229) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 09:55:50 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:55:51 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 09:55:51 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:55:51 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:55:51 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:55:51 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Auditing locally available compute resources for user (node: user) {{(pid=75229) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 09:55:51 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d73f431b-d002-4206-8b52-7d313a43dccb/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:55:52 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d73f431b-d002-4206-8b52-7d313a43dccb/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:55:52 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d73f431b-d002-4206-8b52-7d313a43dccb/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:55:52 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d73f431b-d002-4206-8b52-7d313a43dccb/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:55:52 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cda8c5ad-e70c-4021-bace-d55831c4bc78/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:55:52 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cda8c5ad-e70c-4021-bace-d55831c4bc78/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:55:52 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cda8c5ad-e70c-4021-bace-d55831c4bc78/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:55:52 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cda8c5ad-e70c-4021-bace-d55831c4bc78/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:55:52 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7750cbc-b3d0-44aa-8b88-c291ba007a8a/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:55:52 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7750cbc-b3d0-44aa-8b88-c291ba007a8a/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:55:52 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7750cbc-b3d0-44aa-8b88-c291ba007a8a/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:55:53 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7750cbc-b3d0-44aa-8b88-c291ba007a8a/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:55:53 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75229) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 09:55:53 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e58500df-059a-4fce-afb7-ba36feca0697/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:55:53 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e58500df-059a-4fce-afb7-ba36feca0697/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:55:53 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e58500df-059a-4fce-afb7-ba36feca0697/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:55:53 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e58500df-059a-4fce-afb7-ba36feca0697/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:55:53 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:55:53 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c9fe69e-3f9d-4b30-a9e4-efc3e83efa17/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:55:53 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c9fe69e-3f9d-4b30-a9e4-efc3e83efa17/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:55:53 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c9fe69e-3f9d-4b30-a9e4-efc3e83efa17/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:55:53 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c9fe69e-3f9d-4b30-a9e4-efc3e83efa17/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:55:53 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4ce290f-6dd2-44b6-91be-8e775045837e/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:55:53 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4ce290f-6dd2-44b6-91be-8e775045837e/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:55:53 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4ce290f-6dd2-44b6-91be-8e775045837e/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:55:54 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4ce290f-6dd2-44b6-91be-8e775045837e/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:55:54 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57da589c-863c-42a8-8802-314a499ebc29/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:55:54 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57da589c-863c-42a8-8802-314a499ebc29/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:55:54 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57da589c-863c-42a8-8802-314a499ebc29/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:55:54 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57da589c-863c-42a8-8802-314a499ebc29/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:55:54 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cdd6b32-d4bd-4135-a58e-fbc3b6d2a093/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:55:54 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cdd6b32-d4bd-4135-a58e-fbc3b6d2a093/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:55:54 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cdd6b32-d4bd-4135-a58e-fbc3b6d2a093/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:55:54 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cdd6b32-d4bd-4135-a58e-fbc3b6d2a093/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:55:54 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5170e9e-66e3-4df1-9807-4958cac6480e/disk.rescue --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:55:55 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5170e9e-66e3-4df1-9807-4958cac6480e/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:55:55 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5170e9e-66e3-4df1-9807-4958cac6480e/disk.rescue --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:55:55 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5170e9e-66e3-4df1-9807-4958cac6480e/disk.rescue --force-share --output=json" returned: 0 in 0.176s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:55:55 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5170e9e-66e3-4df1-9807-4958cac6480e/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:55:55 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5170e9e-66e3-4df1-9807-4958cac6480e/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:55:55 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5170e9e-66e3-4df1-9807-4958cac6480e/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:55:55 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:55:55 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5170e9e-66e3-4df1-9807-4958cac6480e/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:55:56 user nova-compute[75229]: WARNING nova.virt.libvirt.driver [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 09:55:56 user nova-compute[75229]: WARNING nova.virt.libvirt.driver [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 09:55:56 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Hypervisor/Node resource view: name=user free_ram=7478MB free_disk=25.058883666992188GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75229) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 09:55:56 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:55:56 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:55:56 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Instance a7750cbc-b3d0-44aa-8b88-c291ba007a8a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 09:55:56 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Instance 4c9fe69e-3f9d-4b30-a9e4-efc3e83efa17 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 09:55:56 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Instance b5170e9e-66e3-4df1-9807-4958cac6480e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 09:55:56 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Instance a4ce290f-6dd2-44b6-91be-8e775045837e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 09:55:56 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Instance e58500df-059a-4fce-afb7-ba36feca0697 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 09:55:56 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Instance cda8c5ad-e70c-4021-bace-d55831c4bc78 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 09:55:56 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Instance 57da589c-863c-42a8-8802-314a499ebc29 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 09:55:56 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Instance d73f431b-d002-4206-8b52-7d313a43dccb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 09:55:56 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Instance 589f4750-fac6-4e99-a430-0cda339808bc actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 09:55:56 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Instance 9cdd6b32-d4bd-4135-a58e-fbc3b6d2a093 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 09:55:56 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75229) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 09:55:56 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75229) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 09:55:56 user nova-compute[75229]: DEBUG nova.compute.provider_tree [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Inventory has not changed in ProviderTree for provider: d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 {{(pid=75229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 09:55:56 user nova-compute[75229]: DEBUG nova.scheduler.client.report [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Inventory has not changed for provider d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 09:55:56 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Compute_service record updated for user:user {{(pid=75229) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 09:55:56 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.484s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:55:58 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:55:58 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 09:55:58 user nova-compute[75229]: DEBUG nova.compute.manager [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Starting heal instance info cache {{(pid=75229) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 09:55:58 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Acquiring lock "refresh_cache-a4ce290f-6dd2-44b6-91be-8e775045837e" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 09:55:58 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Acquired lock "refresh_cache-a4ce290f-6dd2-44b6-91be-8e775045837e" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 09:55:58 user nova-compute[75229]: DEBUG nova.network.neutron [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] [instance: a4ce290f-6dd2-44b6-91be-8e775045837e] Forcefully refreshing network info cache for instance {{(pid=75229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 09:55:59 user nova-compute[75229]: DEBUG nova.network.neutron [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] [instance: a4ce290f-6dd2-44b6-91be-8e775045837e] Updating instance_info_cache with network_info: [{"id": "0621f697-c41d-49da-9b80-6a2879fef41e", "address": "fa:16:3e:34:59:a9", "network": {"id": "8d89f286-0349-4334-b27a-873f684d3652", "bridge": "br-int", "label": "tempest-TestStampPattern-841799214-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.44", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a196548d9de4e18b8bab9fefdab0861", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0621f697-c4", "ovs_interfaceid": "0621f697-c41d-49da-9b80-6a2879fef41e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 09:55:59 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Releasing lock "refresh_cache-a4ce290f-6dd2-44b6-91be-8e775045837e" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 09:55:59 user nova-compute[75229]: DEBUG nova.compute.manager [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] [instance: a4ce290f-6dd2-44b6-91be-8e775045837e] Updated the network info_cache for instance {{(pid=75229) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 09:55:59 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 09:55:59 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 09:55:59 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 09:55:59 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 09:55:59 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 09:55:59 user nova-compute[75229]: DEBUG nova.compute.manager [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75229) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 09:55:59 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 09:56:00 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:56:03 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:56:05 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:56:08 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:56:08 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 09:56:10 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:56:13 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:56:15 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:56:19 user nova-compute[75229]: DEBUG nova.compute.manager [req-5a2ff15c-1159-4dd1-949b-3e85b518da5b req-caeeffd5-5e71-43f0-b772-337484ccfab3 service nova] [instance: a4ce290f-6dd2-44b6-91be-8e775045837e] Received event network-changed-0621f697-c41d-49da-9b80-6a2879fef41e {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:56:19 user nova-compute[75229]: DEBUG nova.compute.manager [req-5a2ff15c-1159-4dd1-949b-3e85b518da5b req-caeeffd5-5e71-43f0-b772-337484ccfab3 service nova] [instance: a4ce290f-6dd2-44b6-91be-8e775045837e] Refreshing instance network info cache due to event network-changed-0621f697-c41d-49da-9b80-6a2879fef41e. {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 09:56:19 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-5a2ff15c-1159-4dd1-949b-3e85b518da5b req-caeeffd5-5e71-43f0-b772-337484ccfab3 service nova] Acquiring lock "refresh_cache-a4ce290f-6dd2-44b6-91be-8e775045837e" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 09:56:19 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-5a2ff15c-1159-4dd1-949b-3e85b518da5b req-caeeffd5-5e71-43f0-b772-337484ccfab3 service nova] Acquired lock "refresh_cache-a4ce290f-6dd2-44b6-91be-8e775045837e" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 09:56:19 user nova-compute[75229]: DEBUG nova.network.neutron [req-5a2ff15c-1159-4dd1-949b-3e85b518da5b req-caeeffd5-5e71-43f0-b772-337484ccfab3 service nova] [instance: a4ce290f-6dd2-44b6-91be-8e775045837e] Refreshing network info cache for port 0621f697-c41d-49da-9b80-6a2879fef41e {{(pid=75229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 09:56:19 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-c2da3d59-e51c-4f3c-b208-2d4385f5bbcf tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] Acquiring lock "a4ce290f-6dd2-44b6-91be-8e775045837e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:56:19 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-c2da3d59-e51c-4f3c-b208-2d4385f5bbcf tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] Lock "a4ce290f-6dd2-44b6-91be-8e775045837e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:56:19 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-c2da3d59-e51c-4f3c-b208-2d4385f5bbcf tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] Acquiring lock "a4ce290f-6dd2-44b6-91be-8e775045837e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:56:19 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-c2da3d59-e51c-4f3c-b208-2d4385f5bbcf tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] Lock "a4ce290f-6dd2-44b6-91be-8e775045837e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:56:19 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-c2da3d59-e51c-4f3c-b208-2d4385f5bbcf tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] Lock "a4ce290f-6dd2-44b6-91be-8e775045837e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:56:19 user nova-compute[75229]: INFO nova.compute.manager [None req-c2da3d59-e51c-4f3c-b208-2d4385f5bbcf tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] [instance: a4ce290f-6dd2-44b6-91be-8e775045837e] Terminating instance
Nov 14 09:56:19 user nova-compute[75229]: DEBUG nova.compute.manager [None req-c2da3d59-e51c-4f3c-b208-2d4385f5bbcf tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] [instance: a4ce290f-6dd2-44b6-91be-8e775045837e] Start destroying the instance on the hypervisor. {{(pid=75229) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 09:56:19 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:56:19 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:56:19 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:56:19 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:56:19 user nova-compute[75229]: DEBUG nova.network.neutron [req-5a2ff15c-1159-4dd1-949b-3e85b518da5b req-caeeffd5-5e71-43f0-b772-337484ccfab3 service nova] [instance: a4ce290f-6dd2-44b6-91be-8e775045837e] Updated VIF entry in instance network info cache for port 0621f697-c41d-49da-9b80-6a2879fef41e. {{(pid=75229) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 09:56:19 user nova-compute[75229]: DEBUG nova.network.neutron [req-5a2ff15c-1159-4dd1-949b-3e85b518da5b req-caeeffd5-5e71-43f0-b772-337484ccfab3 service nova] [instance: a4ce290f-6dd2-44b6-91be-8e775045837e] Updating instance_info_cache with network_info: [{"id": "0621f697-c41d-49da-9b80-6a2879fef41e", "address": "fa:16:3e:34:59:a9", "network": {"id": "8d89f286-0349-4334-b27a-873f684d3652", "bridge": "br-int", "label": "tempest-TestStampPattern-841799214-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a196548d9de4e18b8bab9fefdab0861", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0621f697-c4", "ovs_interfaceid": "0621f697-c41d-49da-9b80-6a2879fef41e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 09:56:19 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-5a2ff15c-1159-4dd1-949b-3e85b518da5b req-caeeffd5-5e71-43f0-b772-337484ccfab3 service nova] Releasing lock "refresh_cache-a4ce290f-6dd2-44b6-91be-8e775045837e" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 09:56:19 user nova-compute[75229]: INFO nova.virt.libvirt.driver [-] [instance: a4ce290f-6dd2-44b6-91be-8e775045837e] Instance destroyed successfully.
Nov 14 09:56:19 user nova-compute[75229]: DEBUG nova.objects.instance [None req-c2da3d59-e51c-4f3c-b208-2d4385f5bbcf tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] Lazy-loading 'resources' on Instance uuid a4ce290f-6dd2-44b6-91be-8e775045837e {{(pid=75229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 09:56:19 user nova-compute[75229]: DEBUG nova.virt.libvirt.vif [None req-c2da3d59-e51c-4f3c-b208-2d4385f5bbcf tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T09:49:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-627374227',display_name='tempest-TestStampPattern-server-627374227',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-627374227',id=20,image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC4/xEtZHm9Yk+8VKGmlmnaP2DqqxnCgXK/PuxMNYGLOnEJxt/VGvxZAFawEytkJILlGgczmBioMsbqPdSyGvSqffIJvSQLFesfq/9wXT8F6tu1JAnyvbNVNg8/xsFVJ6w==',key_name='tempest-TestStampPattern-1732599618',keypairs=<?>,launch_index=0,launched_at=2023-11-14T09:49:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6a196548d9de4e18b8bab9fefdab0861',ramdisk_id='',reservation_id='r-0eflrpcq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestStampPattern-1637982262',owner_user_name='tempest-TestStampPattern-1637982262-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T09:52:31Z,user_data=None,user_id='9b525334713e47ceb8f71035116d5c36',uuid=a4ce290f-6dd2-44b6-91be-8e775045837e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0621f697-c41d-49da-9b80-6a2879fef41e", "address": "fa:16:3e:34:59:a9", "network": {"id": "8d89f286-0349-4334-b27a-873f684d3652", "bridge": "br-int", "label": "tempest-TestStampPattern-841799214-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.44", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a196548d9de4e18b8bab9fefdab0861", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0621f697-c4", "ovs_interfaceid": "0621f697-c41d-49da-9b80-6a2879fef41e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 09:56:19 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-c2da3d59-e51c-4f3c-b208-2d4385f5bbcf tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] Converting VIF {"id": "0621f697-c41d-49da-9b80-6a2879fef41e", "address": "fa:16:3e:34:59:a9", "network": {"id": "8d89f286-0349-4334-b27a-873f684d3652", "bridge": "br-int", "label": "tempest-TestStampPattern-841799214-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.44", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a196548d9de4e18b8bab9fefdab0861", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0621f697-c4", "ovs_interfaceid": "0621f697-c41d-49da-9b80-6a2879fef41e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 09:56:19 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-c2da3d59-e51c-4f3c-b208-2d4385f5bbcf tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:34:59:a9,bridge_name='br-int',has_traffic_filtering=True,id=0621f697-c41d-49da-9b80-6a2879fef41e,network=Network(8d89f286-0349-4334-b27a-873f684d3652),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0621f697-c4') {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 09:56:19 user nova-compute[75229]: DEBUG os_vif [None req-c2da3d59-e51c-4f3c-b208-2d4385f5bbcf tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:34:59:a9,bridge_name='br-int',has_traffic_filtering=True,id=0621f697-c41d-49da-9b80-6a2879fef41e,network=Network(8d89f286-0349-4334-b27a-873f684d3652),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0621f697-c4') {{(pid=75229) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 09:56:19 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:56:19 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0621f697-c4, bridge=br-int, if_exists=True) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:56:19 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 09:56:19 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:56:19 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=bab860ba-408b-4d09-aca9-47f0d60e8330) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:56:19 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:56:19 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 09:56:19 user nova-compute[75229]: INFO os_vif [None req-c2da3d59-e51c-4f3c-b208-2d4385f5bbcf tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:34:59:a9,bridge_name='br-int',has_traffic_filtering=True,id=0621f697-c41d-49da-9b80-6a2879fef41e,network=Network(8d89f286-0349-4334-b27a-873f684d3652),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0621f697-c4')
Nov 14 09:56:19 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-c2da3d59-e51c-4f3c-b208-2d4385f5bbcf tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] [instance: a4ce290f-6dd2-44b6-91be-8e775045837e] Deleting instance files /opt/stack/data/nova/instances/a4ce290f-6dd2-44b6-91be-8e775045837e_del
Nov 14 09:56:19 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-c2da3d59-e51c-4f3c-b208-2d4385f5bbcf tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] [instance: a4ce290f-6dd2-44b6-91be-8e775045837e] Deletion of /opt/stack/data/nova/instances/a4ce290f-6dd2-44b6-91be-8e775045837e_del complete
Nov 14 09:56:20 user nova-compute[75229]: INFO nova.compute.manager [None req-c2da3d59-e51c-4f3c-b208-2d4385f5bbcf tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] [instance: a4ce290f-6dd2-44b6-91be-8e775045837e] Took 0.89 seconds to destroy the instance on the hypervisor.
Nov 14 09:56:20 user nova-compute[75229]: DEBUG oslo.service.loopingcall [None req-c2da3d59-e51c-4f3c-b208-2d4385f5bbcf tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75229) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 09:56:20 user nova-compute[75229]: DEBUG nova.compute.manager [-] [instance: a4ce290f-6dd2-44b6-91be-8e775045837e] Deallocating network for instance {{(pid=75229) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 09:56:20 user nova-compute[75229]: DEBUG nova.network.neutron [-] [instance: a4ce290f-6dd2-44b6-91be-8e775045837e] deallocate_for_instance() {{(pid=75229) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 09:56:20 user nova-compute[75229]: DEBUG nova.network.neutron [-] [instance: a4ce290f-6dd2-44b6-91be-8e775045837e] Updating instance_info_cache with network_info: [] {{(pid=75229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 09:56:20 user nova-compute[75229]: INFO nova.compute.manager [-] [instance: a4ce290f-6dd2-44b6-91be-8e775045837e] Took 0.42 seconds to deallocate network for instance.
Nov 14 09:56:20 user nova-compute[75229]: DEBUG nova.compute.manager [req-84962f69-80ca-4159-806e-f47058b3b040 req-f07ee121-2cf9-43a2-923f-a8c7bc3e2927 service nova] [instance: a4ce290f-6dd2-44b6-91be-8e775045837e] Received event network-vif-deleted-0621f697-c41d-49da-9b80-6a2879fef41e {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:56:20 user nova-compute[75229]: INFO nova.compute.manager [req-84962f69-80ca-4159-806e-f47058b3b040 req-f07ee121-2cf9-43a2-923f-a8c7bc3e2927 service nova] [instance: a4ce290f-6dd2-44b6-91be-8e775045837e] Neutron deleted interface 0621f697-c41d-49da-9b80-6a2879fef41e; detaching it from the instance and deleting it from the info cache
Nov 14 09:56:20 user nova-compute[75229]: DEBUG nova.network.neutron [req-84962f69-80ca-4159-806e-f47058b3b040 req-f07ee121-2cf9-43a2-923f-a8c7bc3e2927 service nova] [instance: a4ce290f-6dd2-44b6-91be-8e775045837e] Updating instance_info_cache with network_info: [] {{(pid=75229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 09:56:20 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-c2da3d59-e51c-4f3c-b208-2d4385f5bbcf tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:56:20 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-c2da3d59-e51c-4f3c-b208-2d4385f5bbcf tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:56:20 user nova-compute[75229]: DEBUG nova.compute.manager [req-84962f69-80ca-4159-806e-f47058b3b040 req-f07ee121-2cf9-43a2-923f-a8c7bc3e2927 service nova] [instance: a4ce290f-6dd2-44b6-91be-8e775045837e] Detach interface failed, port_id=0621f697-c41d-49da-9b80-6a2879fef41e, reason: Instance a4ce290f-6dd2-44b6-91be-8e775045837e could not be found. {{(pid=75229) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 14 09:56:20 user nova-compute[75229]: DEBUG nova.compute.provider_tree [None req-c2da3d59-e51c-4f3c-b208-2d4385f5bbcf tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] Inventory has not changed in ProviderTree for provider: d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 {{(pid=75229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 09:56:20 user nova-compute[75229]: DEBUG nova.scheduler.client.report [None req-c2da3d59-e51c-4f3c-b208-2d4385f5bbcf tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] Inventory has not changed for provider d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 09:56:20 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-c2da3d59-e51c-4f3c-b208-2d4385f5bbcf tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.321s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:56:20 user nova-compute[75229]: INFO nova.scheduler.client.report [None req-c2da3d59-e51c-4f3c-b208-2d4385f5bbcf tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] Deleted allocations for instance a4ce290f-6dd2-44b6-91be-8e775045837e
Nov 14 09:56:20 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-c2da3d59-e51c-4f3c-b208-2d4385f5bbcf tempest-TestStampPattern-1637982262 tempest-TestStampPattern-1637982262-project-member] Lock "a4ce290f-6dd2-44b6-91be-8e775045837e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.821s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:56:21 user nova-compute[75229]: DEBUG nova.compute.manager [req-6c5da460-ec53-48e3-87de-b6555a07a179 req-dfc7a456-f634-42ff-9004-cc9638e2096e service nova] [instance: a4ce290f-6dd2-44b6-91be-8e775045837e] Received event network-vif-unplugged-0621f697-c41d-49da-9b80-6a2879fef41e {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:56:21 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-6c5da460-ec53-48e3-87de-b6555a07a179 req-dfc7a456-f634-42ff-9004-cc9638e2096e service nova] Acquiring lock "a4ce290f-6dd2-44b6-91be-8e775045837e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:56:21 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-6c5da460-ec53-48e3-87de-b6555a07a179 req-dfc7a456-f634-42ff-9004-cc9638e2096e service nova] Lock "a4ce290f-6dd2-44b6-91be-8e775045837e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:56:21 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-6c5da460-ec53-48e3-87de-b6555a07a179 req-dfc7a456-f634-42ff-9004-cc9638e2096e service nova] Lock "a4ce290f-6dd2-44b6-91be-8e775045837e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:56:21 user nova-compute[75229]: DEBUG nova.compute.manager [req-6c5da460-ec53-48e3-87de-b6555a07a179 req-dfc7a456-f634-42ff-9004-cc9638e2096e service nova] [instance: a4ce290f-6dd2-44b6-91be-8e775045837e] No waiting events found dispatching network-vif-unplugged-0621f697-c41d-49da-9b80-6a2879fef41e {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 09:56:21 user nova-compute[75229]: WARNING nova.compute.manager [req-6c5da460-ec53-48e3-87de-b6555a07a179 req-dfc7a456-f634-42ff-9004-cc9638e2096e service nova] [instance: a4ce290f-6dd2-44b6-91be-8e775045837e] Received unexpected event network-vif-unplugged-0621f697-c41d-49da-9b80-6a2879fef41e for instance with vm_state deleted and task_state None.
Nov 14 09:56:21 user nova-compute[75229]: DEBUG nova.compute.manager [req-6c5da460-ec53-48e3-87de-b6555a07a179 req-dfc7a456-f634-42ff-9004-cc9638e2096e service nova] [instance: a4ce290f-6dd2-44b6-91be-8e775045837e] Received event network-vif-plugged-0621f697-c41d-49da-9b80-6a2879fef41e {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:56:21 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-6c5da460-ec53-48e3-87de-b6555a07a179 req-dfc7a456-f634-42ff-9004-cc9638e2096e service nova] Acquiring lock "a4ce290f-6dd2-44b6-91be-8e775045837e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:56:21 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-6c5da460-ec53-48e3-87de-b6555a07a179 req-dfc7a456-f634-42ff-9004-cc9638e2096e service nova] Lock "a4ce290f-6dd2-44b6-91be-8e775045837e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:56:21 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-6c5da460-ec53-48e3-87de-b6555a07a179 req-dfc7a456-f634-42ff-9004-cc9638e2096e service nova] Lock "a4ce290f-6dd2-44b6-91be-8e775045837e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:56:21 user nova-compute[75229]: DEBUG nova.compute.manager [req-6c5da460-ec53-48e3-87de-b6555a07a179 req-dfc7a456-f634-42ff-9004-cc9638e2096e service nova] [instance: a4ce290f-6dd2-44b6-91be-8e775045837e] No waiting events found dispatching network-vif-plugged-0621f697-c41d-49da-9b80-6a2879fef41e {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 09:56:21 user nova-compute[75229]: WARNING nova.compute.manager [req-6c5da460-ec53-48e3-87de-b6555a07a179 req-dfc7a456-f634-42ff-9004-cc9638e2096e service nova] [instance: a4ce290f-6dd2-44b6-91be-8e775045837e] Received unexpected event network-vif-plugged-0621f697-c41d-49da-9b80-6a2879fef41e for instance with vm_state deleted and task_state None.
Nov 14 09:56:24 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:56:29 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:56:32 user nova-compute[75229]: DEBUG nova.compute.manager [req-55355646-d24d-4beb-bd6e-7ce12c4f5f32 req-3fc4712f-a7fd-40bb-99ec-459ba7e099a5 service nova] [instance: 57da589c-863c-42a8-8802-314a499ebc29] Received event network-changed-b570f667-506d-47ce-b69b-d4416514ef63 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:56:32 user nova-compute[75229]: DEBUG nova.compute.manager [req-55355646-d24d-4beb-bd6e-7ce12c4f5f32 req-3fc4712f-a7fd-40bb-99ec-459ba7e099a5 service nova] [instance: 57da589c-863c-42a8-8802-314a499ebc29] Refreshing instance network info cache due to event network-changed-b570f667-506d-47ce-b69b-d4416514ef63. {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 09:56:32 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-55355646-d24d-4beb-bd6e-7ce12c4f5f32 req-3fc4712f-a7fd-40bb-99ec-459ba7e099a5 service nova] Acquiring lock "refresh_cache-57da589c-863c-42a8-8802-314a499ebc29" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 09:56:32 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-55355646-d24d-4beb-bd6e-7ce12c4f5f32 req-3fc4712f-a7fd-40bb-99ec-459ba7e099a5 service nova] Acquired lock "refresh_cache-57da589c-863c-42a8-8802-314a499ebc29" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 09:56:32 user nova-compute[75229]: DEBUG nova.network.neutron [req-55355646-d24d-4beb-bd6e-7ce12c4f5f32 req-3fc4712f-a7fd-40bb-99ec-459ba7e099a5 service nova] [instance: 57da589c-863c-42a8-8802-314a499ebc29] Refreshing network info cache for port b570f667-506d-47ce-b69b-d4416514ef63 {{(pid=75229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 09:56:33 user nova-compute[75229]: DEBUG nova.network.neutron [req-55355646-d24d-4beb-bd6e-7ce12c4f5f32 req-3fc4712f-a7fd-40bb-99ec-459ba7e099a5 service nova] [instance: 57da589c-863c-42a8-8802-314a499ebc29] Updated VIF entry in instance network info cache for port b570f667-506d-47ce-b69b-d4416514ef63. {{(pid=75229) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 09:56:33 user nova-compute[75229]: DEBUG nova.network.neutron [req-55355646-d24d-4beb-bd6e-7ce12c4f5f32 req-3fc4712f-a7fd-40bb-99ec-459ba7e099a5 service nova] [instance: 57da589c-863c-42a8-8802-314a499ebc29] Updating instance_info_cache with network_info: [{"id": "b570f667-506d-47ce-b69b-d4416514ef63", "address": "fa:16:3e:c8:8e:cd", "network": {"id": "bd407caa-6ef6-400d-9327-3179dc1d8da4", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-29933774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b8d48c38c7344f5b12d0ed5b9392554", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb570f667-50", "ovs_interfaceid": "b570f667-506d-47ce-b69b-d4416514ef63", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 09:56:33 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-55355646-d24d-4beb-bd6e-7ce12c4f5f32 req-3fc4712f-a7fd-40bb-99ec-459ba7e099a5 service nova] Releasing lock "refresh_cache-57da589c-863c-42a8-8802-314a499ebc29" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 09:56:33 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:56:34 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-5a7b7e03-d667-48f6-a75a-46db886b543a tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Acquiring lock "57da589c-863c-42a8-8802-314a499ebc29" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:56:34 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-5a7b7e03-d667-48f6-a75a-46db886b543a tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Lock "57da589c-863c-42a8-8802-314a499ebc29" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:56:34 user nova-compute[75229]: DEBUG nova.objects.instance [None req-5a7b7e03-d667-48f6-a75a-46db886b543a tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Lazy-loading 'flavor' on Instance uuid 57da589c-863c-42a8-8802-314a499ebc29 {{(pid=75229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 09:56:34 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-5a7b7e03-d667-48f6-a75a-46db886b543a tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Lock "57da589c-863c-42a8-8802-314a499ebc29" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.064s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:56:34 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-5a7b7e03-d667-48f6-a75a-46db886b543a tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Acquiring lock "57da589c-863c-42a8-8802-314a499ebc29" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:56:34 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-5a7b7e03-d667-48f6-a75a-46db886b543a tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Lock "57da589c-863c-42a8-8802-314a499ebc29" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:56:34 user nova-compute[75229]: INFO nova.compute.manager [None req-5a7b7e03-d667-48f6-a75a-46db886b543a tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] [instance: 57da589c-863c-42a8-8802-314a499ebc29] Attaching volume 3d22e1af-30f1-4688-bfda-e6dd2c5bee99 to /dev/vdb
Nov 14 09:56:34 user nova-compute[75229]: DEBUG os_brick.utils [None req-5a7b7e03-d667-48f6-a75a-46db886b543a tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 09:56:34 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:56:34 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:56:34 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e104abb-94b8-4d52-8fc8-6a211732a5ea]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f1154031c835\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:56:34 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:56:34 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:56:34 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f0fc38a-a031-4828-96e7-acec2873dc6d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:56:34 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:56:34 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:56:34 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[e32864c5-dae0-4b48-9c37-3a3c8f9ac452]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:56:34 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0d302e0-8fae-4ed3-8b51-17e509818507]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:56:34 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-5a7b7e03-d667-48f6-a75a-46db886b543a tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Running cmd (subprocess): nvme version {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:56:34 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-5a7b7e03-d667-48f6-a75a-46db886b543a tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] 'nvme version' failed. Not Retrying. {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 09:56:34 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5a7b7e03-d667-48f6-a75a-46db886b543a tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] nvme not present on system {{(pid=75229) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 09:56:34 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:56:34 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 09:56:34 user nova-compute[75229]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 09:56:34 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[c80d6fc9-26fd-4954-992e-74a1fa764b78]: (4, '') {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:56:34 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.lightos [None req-5a7b7e03-d667-48f6-a75a-46db886b543a tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75229) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 09:56:34 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.lightos [None req-5a7b7e03-d667-48f6-a75a-46db886b543a tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75229) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 09:56:34 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.lightos [None req-5a7b7e03-d667-48f6-a75a-46db886b543a tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] LIGHTOS: no hostnqn found. {{(pid=75229) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 09:56:34 user nova-compute[75229]: DEBUG os_brick.utils [None req-5a7b7e03-d667-48f6-a75a-46db886b543a tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f1154031c835', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 09:56:34 user nova-compute[75229]: DEBUG nova.virt.block_device [None req-5a7b7e03-d667-48f6-a75a-46db886b543a tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] [instance: 57da589c-863c-42a8-8802-314a499ebc29] Updating existing volume attachment record: 0a6eb3c9-c901-44f3-b7f2-cea54f035548 {{(pid=75229) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 09:56:34 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:56:38 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:56:39 user nova-compute[75229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5a7b7e03-d667-48f6-a75a-46db886b543a tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] [instance: 57da589c-863c-42a8-8802-314a499ebc29] Calling os-brick to attach iSCSI Volume {{(pid=75229) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 09:56:39 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a7b7e03-d667-48f6-a75a-46db886b543a tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f73f85151b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3d22e1af-30f1-4688-bfda-e6dd2c5bee99', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZMNDHpgr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 09:56:39 user nova-compute[75229]: WARNING os_brick.initiator.connectors.base [None req-5a7b7e03-d667-48f6-a75a-46db886b543a tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 09:56:39 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-5a7b7e03-d667-48f6-a75a-46db886b543a tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 09:56:39 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-5a7b7e03-d667-48f6-a75a-46db886b543a tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 09:56:39 user nova-compute[75229]: WARNING os_brick.initiator.connectors.base [None req-5a7b7e03-d667-48f6-a75a-46db886b543a tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 09:56:39 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-5a7b7e03-d667-48f6-a75a-46db886b543a tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3d22e1af-30f1-4688-bfda-e6dd2c5bee99" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 09:56:39 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-5a7b7e03-d667-48f6-a75a-46db886b543a tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3d22e1af-30f1-4688-bfda-e6dd2c5bee99" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 09:56:39 user nova-compute[75229]: INFO os_brick.initiator.connectors.iscsi [None req-5a7b7e03-d667-48f6-a75a-46db886b543a tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 09:56:39 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d22e1af-30f1-4688-bfda-e6dd2c5bee99 -p 172.16.0.220:3260 {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:56:39 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:56:39 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d22e1af-30f1-4688-bfda-e6dd2c5bee99 -p 172.16.0.220:3260" returned: 21 in 0.133s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:56:39 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[c549a670-2a76-42dc-afcb-aa446ae531c0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:56:39 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a7b7e03-d667-48f6-a75a-46db886b543a tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 09:56:39 user nova-compute[75229]:  {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:56:39 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d22e1af-30f1-4688-bfda-e6dd2c5bee99 -p 172.16.0.220:3260 --interface default --op new {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:56:39 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d22e1af-30f1-4688-bfda-e6dd2c5bee99 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:56:39 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfab4f29-3ec9-4f18-88b1-1ccfaceb0a06]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3d22e1af-30f1-4688-bfda-e6dd2c5bee99] added\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:56:39 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a7b7e03-d667-48f6-a75a-46db886b543a tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3d22e1af-30f1-4688-bfda-e6dd2c5bee99] added
Nov 14 09:56:39 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:56:39 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d22e1af-30f1-4688-bfda-e6dd2c5bee99 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:56:40 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d22e1af-30f1-4688-bfda-e6dd2c5bee99 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.276s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:56:40 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[982a1a37-8ce0-4d5a-bf2f-c7a609fce278]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:56:40 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a7b7e03-d667-48f6-a75a-46db886b543a tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:56:40 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d22e1af-30f1-4688-bfda-e6dd2c5bee99 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:56:40 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d22e1af-30f1-4688-bfda-e6dd2c5bee99 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.044s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:56:40 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[12dc111b-4a58-48c0-bb04-741f32a211de]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:56:40 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a7b7e03-d667-48f6-a75a-46db886b543a tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:56:40 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d22e1af-30f1-4688-bfda-e6dd2c5bee99 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZMNDHpgr {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:56:40 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d22e1af-30f1-4688-bfda-e6dd2c5bee99 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZMNDHpgr" returned: 0 in 0.234s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:56:40 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d030a67-9787-4f67-97e0-e5240e0057f1]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:56:40 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a7b7e03-d667-48f6-a75a-46db886b543a tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ZMNDHpgr'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:56:40 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d22e1af-30f1-4688-bfda-e6dd2c5bee99 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:56:40 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d22e1af-30f1-4688-bfda-e6dd2c5bee99 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:56:40 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b000d75-2cba-441e-85e3-9cd72aa76def]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:56:40 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a7b7e03-d667-48f6-a75a-46db886b543a tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:56:40 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:56:40 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:56:40 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e931533-50e3-438e-8957-f1464e09135a]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5efb0e0-a85c-46ec-8a9d-2763bf548023 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f14db14-692f-4f9f-b2d1-13dcab6ed9c5 (non-flash)\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:56:40 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a7b7e03-d667-48f6-a75a-46db886b543a tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5efb0e0-a85c-46ec-8a9d-2763bf548023 (non-flash)
Nov 14 09:56:40 user nova-compute[75229]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f14db14-692f-4f9f-b2d1-13dcab6ed9c5 (non-flash)
Nov 14 09:56:40 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 09:56:40 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a7b7e03-d667-48f6-a75a-46db886b543a tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5efb0e0-a85c-46ec-8a9d-2763bf548023 (non-flash)
Nov 14 09:56:40 user nova-compute[75229]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f14db14-692f-4f9f-b2d1-13dcab6ed9c5 (non-flash)
Nov 14 09:56:40 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 09:56:40 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d22e1af-30f1-4688-bfda-e6dd2c5bee99 -p 172.16.0.220:3260 --login {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:56:40 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d22e1af-30f1-4688-bfda-e6dd2c5bee99 -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:56:40 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d3c652a-e082-456c-a23d-cd887bb1a6fa]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3d22e1af-30f1-4688-bfda-e6dd2c5bee99, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3d22e1af-30f1-4688-bfda-e6dd2c5bee99, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:56:40 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a7b7e03-d667-48f6-a75a-46db886b543a tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3d22e1af-30f1-4688-bfda-e6dd2c5bee99, portal: 172.16.0.220,3260]
Nov 14 09:56:40 user nova-compute[75229]: Login to [iface: default, target: iqn.2010-10.org.openstack:3d22e1af-30f1-4688-bfda-e6dd2c5bee99, portal: 172.16.0.220,3260] successful.
Nov 14 09:56:40 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:56:40 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d22e1af-30f1-4688-bfda-e6dd2c5bee99 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:56:40 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d22e1af-30f1-4688-bfda-e6dd2c5bee99 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.062s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:56:40 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb82b259-c807-48fd-83af-f944ca140b62]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:56:40 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a7b7e03-d667-48f6-a75a-46db886b543a tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:56:40 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:56:40 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:56:40 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[19593311-1b21-429e-917d-c3fa7fa56213]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5efb0e0-a85c-46ec-8a9d-2763bf548023 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f14db14-692f-4f9f-b2d1-13dcab6ed9c5 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d22e1af-30f1-4688-bfda-e6dd2c5bee99 (non-flash)\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:56:40 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a7b7e03-d667-48f6-a75a-46db886b543a tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5efb0e0-a85c-46ec-8a9d-2763bf548023 (non-flash)
Nov 14 09:56:40 user nova-compute[75229]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f14db14-692f-4f9f-b2d1-13dcab6ed9c5 (non-flash)
Nov 14 09:56:40 user nova-compute[75229]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d22e1af-30f1-4688-bfda-e6dd2c5bee99 (non-flash)
Nov 14 09:56:40 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 09:56:40 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a7b7e03-d667-48f6-a75a-46db886b543a tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5efb0e0-a85c-46ec-8a9d-2763bf548023 (non-flash)
Nov 14 09:56:40 user nova-compute[75229]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f14db14-692f-4f9f-b2d1-13dcab6ed9c5 (non-flash)
Nov 14 09:56:40 user nova-compute[75229]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d22e1af-30f1-4688-bfda-e6dd2c5bee99 (non-flash)
Nov 14 09:56:40 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 09:56:40 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-5a7b7e03-d667-48f6-a75a-46db886b543a tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3d22e1af-30f1-4688-bfda-e6dd2c5bee99" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.953s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 09:56:40 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a7b7e03-d667-48f6-a75a-46db886b543a tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Connected to 172.16.0.220:3260 {{(pid=75229) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 09:56:40 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-5a7b7e03-d667-48f6-a75a-46db886b543a tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] HCTL ('35', '-', '-', 0) found on session 33 with lun 0 {{(pid=75229) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 09:56:40 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-5a7b7e03-d667-48f6-a75a-46db886b543a tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75229) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 09:56:40 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:56:40 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.019s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:56:40 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[12420145-415d-455e-b144-f0e4ee01cc73]: (4, ('- - 0', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:56:40 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-5a7b7e03-d667-48f6-a75a-46db886b543a tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Searching for a device in session 33 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75229) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 09:56:40 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a7b7e03-d667-48f6-a75a-46db886b543a tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:3d22e1af-30f1-4688-bfda-e6dd2c5bee99', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZMNDHpgr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75229) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 09:56:41 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-5a7b7e03-d667-48f6-a75a-46db886b543a tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.011s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 09:56:41 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a7b7e03-d667-48f6-a75a-46db886b543a tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] <== connect_volume: return (2013ms) {'type': 'block', 'scsi_wwn': '23036653430333334', 'path': '/dev/sdd'} {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 09:56:41 user nova-compute[75229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5a7b7e03-d667-48f6-a75a-46db886b543a tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] [instance: 57da589c-863c-42a8-8802-314a499ebc29] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23036653430333334', 'path': '/dev/sdd'} {{(pid=75229) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 09:56:41 user nova-compute[75229]: DEBUG nova.objects.instance [None req-5a7b7e03-d667-48f6-a75a-46db886b543a tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Lazy-loading 'flavor' on Instance uuid 57da589c-863c-42a8-8802-314a499ebc29 {{(pid=75229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 09:56:41 user nova-compute[75229]: DEBUG nova.virt.libvirt.guest [None req-5a7b7e03-d667-48f6-a75a-46db886b543a tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 09:56:41 user nova-compute[75229]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 09:56:41 user nova-compute[75229]:   <source dev="/dev/sdd"/>
Nov 14 09:56:41 user nova-compute[75229]:   <target dev="vdb" bus="virtio"/>
Nov 14 09:56:41 user nova-compute[75229]:   <serial>3d22e1af-30f1-4688-bfda-e6dd2c5bee99</serial>
Nov 14 09:56:41 user nova-compute[75229]: </disk>
Nov 14 09:56:41 user nova-compute[75229]:  {{(pid=75229) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 09:56:43 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-5a7b7e03-d667-48f6-a75a-46db886b543a tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] No BDM found with device name vda, not building metadata. {{(pid=75229) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 09:56:43 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-5a7b7e03-d667-48f6-a75a-46db886b543a tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75229) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 09:56:43 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-5a7b7e03-d667-48f6-a75a-46db886b543a tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] No VIF found with MAC fa:16:3e:c8:8e:cd, not building metadata {{(pid=75229) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 09:56:43 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-5a7b7e03-d667-48f6-a75a-46db886b543a tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Lock "57da589c-863c-42a8-8802-314a499ebc29" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.934s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:56:43 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:56:43 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-ba99d65e-be25-4094-ae60-3f4a8c9b8af9 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Acquiring lock "57da589c-863c-42a8-8802-314a499ebc29" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:56:43 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-ba99d65e-be25-4094-ae60-3f4a8c9b8af9 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Lock "57da589c-863c-42a8-8802-314a499ebc29" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:56:43 user nova-compute[75229]: INFO nova.compute.manager [None req-ba99d65e-be25-4094-ae60-3f4a8c9b8af9 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] [instance: 57da589c-863c-42a8-8802-314a499ebc29] Detaching volume 3d22e1af-30f1-4688-bfda-e6dd2c5bee99
Nov 14 09:56:43 user nova-compute[75229]: INFO nova.virt.block_device [None req-ba99d65e-be25-4094-ae60-3f4a8c9b8af9 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] [instance: 57da589c-863c-42a8-8802-314a499ebc29] Attempting to driver detach volume 3d22e1af-30f1-4688-bfda-e6dd2c5bee99 from mountpoint /dev/vdb
Nov 14 09:56:43 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-ba99d65e-be25-4094-ae60-3f4a8c9b8af9 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Attempting to detach device vdb from instance 57da589c-863c-42a8-8802-314a499ebc29 from the persistent domain config. {{(pid=75229) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 09:56:43 user nova-compute[75229]: DEBUG nova.virt.libvirt.guest [None req-ba99d65e-be25-4094-ae60-3f4a8c9b8af9 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 09:56:43 user nova-compute[75229]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 09:56:43 user nova-compute[75229]:   <source dev="/dev/sdd"/>
Nov 14 09:56:43 user nova-compute[75229]:   <target dev="vdb" bus="virtio"/>
Nov 14 09:56:43 user nova-compute[75229]:   <serial>3d22e1af-30f1-4688-bfda-e6dd2c5bee99</serial>
Nov 14 09:56:43 user nova-compute[75229]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 09:56:43 user nova-compute[75229]: </disk>
Nov 14 09:56:43 user nova-compute[75229]:  {{(pid=75229) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 09:56:43 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-ba99d65e-be25-4094-ae60-3f4a8c9b8af9 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Successfully detached device vdb from instance 57da589c-863c-42a8-8802-314a499ebc29 from the persistent domain config.
Nov 14 09:56:43 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-ba99d65e-be25-4094-ae60-3f4a8c9b8af9 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 57da589c-863c-42a8-8802-314a499ebc29 from the live domain config. {{(pid=75229) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 09:56:43 user nova-compute[75229]: DEBUG nova.virt.libvirt.guest [None req-ba99d65e-be25-4094-ae60-3f4a8c9b8af9 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 09:56:43 user nova-compute[75229]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 09:56:43 user nova-compute[75229]:   <source dev="/dev/sdd"/>
Nov 14 09:56:43 user nova-compute[75229]:   <target dev="vdb" bus="virtio"/>
Nov 14 09:56:43 user nova-compute[75229]:   <serial>3d22e1af-30f1-4688-bfda-e6dd2c5bee99</serial>
Nov 14 09:56:43 user nova-compute[75229]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 09:56:43 user nova-compute[75229]: </disk>
Nov 14 09:56:43 user nova-compute[75229]:  {{(pid=75229) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 09:56:44 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-ba99d65e-be25-4094-ae60-3f4a8c9b8af9 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 57da589c-863c-42a8-8802-314a499ebc29 {{(pid=75229) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 09:56:44 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:56:47 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:56:47 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-e9531933-c1fc-4c34-84a8-22f450e70c0a tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Acquiring lock "30ae1f73-e0f3-4e26-987e-a684471a160d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:56:47 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-e9531933-c1fc-4c34-84a8-22f450e70c0a tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Lock "30ae1f73-e0f3-4e26-987e-a684471a160d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:56:47 user nova-compute[75229]: DEBUG nova.compute.manager [None req-e9531933-c1fc-4c34-84a8-22f450e70c0a tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] [instance: 30ae1f73-e0f3-4e26-987e-a684471a160d] Starting instance... {{(pid=75229) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 09:56:47 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-e9531933-c1fc-4c34-84a8-22f450e70c0a tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:56:47 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-e9531933-c1fc-4c34-84a8-22f450e70c0a tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:56:47 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-e9531933-c1fc-4c34-84a8-22f450e70c0a tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75229) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 09:56:47 user nova-compute[75229]: INFO nova.compute.claims [None req-e9531933-c1fc-4c34-84a8-22f450e70c0a tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] [instance: 30ae1f73-e0f3-4e26-987e-a684471a160d] Claim successful on node user
Nov 14 09:56:47 user nova-compute[75229]: DEBUG nova.compute.provider_tree [None req-e9531933-c1fc-4c34-84a8-22f450e70c0a tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Inventory has not changed in ProviderTree for provider: d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 {{(pid=75229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 09:56:47 user nova-compute[75229]: DEBUG nova.scheduler.client.report [None req-e9531933-c1fc-4c34-84a8-22f450e70c0a tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Inventory has not changed for provider d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 09:56:47 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-e9531933-c1fc-4c34-84a8-22f450e70c0a tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.366s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:56:47 user nova-compute[75229]: DEBUG nova.compute.manager [None req-e9531933-c1fc-4c34-84a8-22f450e70c0a tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] [instance: 30ae1f73-e0f3-4e26-987e-a684471a160d] Start building networks asynchronously for instance. {{(pid=75229) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 09:56:48 user nova-compute[75229]: DEBUG nova.compute.manager [None req-e9531933-c1fc-4c34-84a8-22f450e70c0a tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] [instance: 30ae1f73-e0f3-4e26-987e-a684471a160d] Allocating IP information in the background. {{(pid=75229) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 09:56:48 user nova-compute[75229]: DEBUG nova.network.neutron [None req-e9531933-c1fc-4c34-84a8-22f450e70c0a tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] [instance: 30ae1f73-e0f3-4e26-987e-a684471a160d] allocate_for_instance() {{(pid=75229) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 09:56:48 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-e9531933-c1fc-4c34-84a8-22f450e70c0a tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] [instance: 30ae1f73-e0f3-4e26-987e-a684471a160d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 09:56:48 user nova-compute[75229]: DEBUG nova.compute.manager [None req-e9531933-c1fc-4c34-84a8-22f450e70c0a tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] [instance: 30ae1f73-e0f3-4e26-987e-a684471a160d] Start building block device mappings for instance. {{(pid=75229) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 09:56:48 user nova-compute[75229]: INFO nova.virt.block_device [None req-e9531933-c1fc-4c34-84a8-22f450e70c0a tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] [instance: 30ae1f73-e0f3-4e26-987e-a684471a160d] Booting with blank volume at /dev/vda
Nov 14 09:56:48 user nova-compute[75229]: DEBUG nova.policy [None req-e9531933-c1fc-4c34-84a8-22f450e70c0a tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a8825cd49e9349f28576b704c4c4d717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8babb73006da4977a1fe2bdb35e08d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75229) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 09:56:48 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:56:48 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 09:56:49 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-11624001-65f3-443c-88a4-0fd10a2fb99b tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Acquiring lock "d73f431b-d002-4206-8b52-7d313a43dccb" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:56:49 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-11624001-65f3-443c-88a4-0fd10a2fb99b tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Lock "d73f431b-d002-4206-8b52-7d313a43dccb" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:56:49 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-11624001-65f3-443c-88a4-0fd10a2fb99b tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Acquiring lock "d73f431b-d002-4206-8b52-7d313a43dccb-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:56:49 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-11624001-65f3-443c-88a4-0fd10a2fb99b tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Lock "d73f431b-d002-4206-8b52-7d313a43dccb-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:56:49 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-11624001-65f3-443c-88a4-0fd10a2fb99b tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Lock "d73f431b-d002-4206-8b52-7d313a43dccb-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:56:49 user nova-compute[75229]: INFO nova.compute.manager [None req-11624001-65f3-443c-88a4-0fd10a2fb99b tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] [instance: d73f431b-d002-4206-8b52-7d313a43dccb] Terminating instance
Nov 14 09:56:49 user nova-compute[75229]: DEBUG nova.compute.manager [None req-11624001-65f3-443c-88a4-0fd10a2fb99b tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] [instance: d73f431b-d002-4206-8b52-7d313a43dccb] Start destroying the instance on the hypervisor. {{(pid=75229) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 09:56:49 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:56:49 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:56:49 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:56:49 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:56:49 user nova-compute[75229]: DEBUG nova.compute.manager [req-519c00ac-52fd-4f6b-b9c8-d93e794d3b2d req-edebf806-26cf-4411-a58d-d94342182e0c service nova] [instance: d73f431b-d002-4206-8b52-7d313a43dccb] Received event network-vif-unplugged-5a68432e-63fc-48e8-bc8c-62e0cd22033c {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:56:49 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-519c00ac-52fd-4f6b-b9c8-d93e794d3b2d req-edebf806-26cf-4411-a58d-d94342182e0c service nova] Acquiring lock "d73f431b-d002-4206-8b52-7d313a43dccb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:56:49 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-519c00ac-52fd-4f6b-b9c8-d93e794d3b2d req-edebf806-26cf-4411-a58d-d94342182e0c service nova] Lock "d73f431b-d002-4206-8b52-7d313a43dccb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:56:49 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-519c00ac-52fd-4f6b-b9c8-d93e794d3b2d req-edebf806-26cf-4411-a58d-d94342182e0c service nova] Lock "d73f431b-d002-4206-8b52-7d313a43dccb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:56:49 user nova-compute[75229]: DEBUG nova.compute.manager [req-519c00ac-52fd-4f6b-b9c8-d93e794d3b2d req-edebf806-26cf-4411-a58d-d94342182e0c service nova] [instance: d73f431b-d002-4206-8b52-7d313a43dccb] No waiting events found dispatching network-vif-unplugged-5a68432e-63fc-48e8-bc8c-62e0cd22033c {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 09:56:49 user nova-compute[75229]: DEBUG nova.compute.manager [req-519c00ac-52fd-4f6b-b9c8-d93e794d3b2d req-edebf806-26cf-4411-a58d-d94342182e0c service nova] [instance: d73f431b-d002-4206-8b52-7d313a43dccb] Received event network-vif-unplugged-5a68432e-63fc-48e8-bc8c-62e0cd22033c for instance with task_state deleting. {{(pid=75229) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 09:56:49 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:56:49 user nova-compute[75229]: INFO nova.virt.libvirt.driver [-] [instance: d73f431b-d002-4206-8b52-7d313a43dccb] Instance destroyed successfully.
Nov 14 09:56:49 user nova-compute[75229]: DEBUG nova.objects.instance [None req-11624001-65f3-443c-88a4-0fd10a2fb99b tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Lazy-loading 'resources' on Instance uuid d73f431b-d002-4206-8b52-7d313a43dccb {{(pid=75229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 09:56:49 user nova-compute[75229]: DEBUG nova.virt.libvirt.vif [None req-11624001-65f3-443c-88a4-0fd10a2fb99b tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-14T09:51:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-96778093',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-96778093',id=25,image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGfyjtPtz5lNuu2b03L54iFuPjmej6LdqUyojatEh20moB6hOdLggbtYqXaWcz4OMc83XdzLg3C2/ZUNoKdUPjhidKL/ruNKttCIqPpB3mHVa3kiDodTu2gKDUCEwJvIxQ==',key_name='tempest-keypair-1883588312',keypairs=<?>,launch_index=0,launched_at=2023-11-14T09:55:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ee9447f169de43829fe3ed51592752e9',ramdisk_id='',reservation_id='r-9md5usva',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-730167895',owner_user_name='tempest-AttachVolumeShelveTestJSON-730167895-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T09:55:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='319a0a5ee47a426799d40e0ebb62a3b0',uuid=d73f431b-d002-4206-8b52-7d313a43dccb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5a68432e-63fc-48e8-bc8c-62e0cd22033c", "address": "fa:16:3e:0c:97:35", "network": {"id": "589aea41-545f-4875-ab56-b7aa273dad6f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-785276916-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.92", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee9447f169de43829fe3ed51592752e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a68432e-63", "ovs_interfaceid": "5a68432e-63fc-48e8-bc8c-62e0cd22033c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 09:56:49 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-11624001-65f3-443c-88a4-0fd10a2fb99b tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Converting VIF {"id": "5a68432e-63fc-48e8-bc8c-62e0cd22033c", "address": "fa:16:3e:0c:97:35", "network": {"id": "589aea41-545f-4875-ab56-b7aa273dad6f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-785276916-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.92", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee9447f169de43829fe3ed51592752e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a68432e-63", "ovs_interfaceid": "5a68432e-63fc-48e8-bc8c-62e0cd22033c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 09:56:49 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-11624001-65f3-443c-88a4-0fd10a2fb99b tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0c:97:35,bridge_name='br-int',has_traffic_filtering=True,id=5a68432e-63fc-48e8-bc8c-62e0cd22033c,network=Network(589aea41-545f-4875-ab56-b7aa273dad6f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a68432e-63') {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 09:56:49 user nova-compute[75229]: DEBUG os_vif [None req-11624001-65f3-443c-88a4-0fd10a2fb99b tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0c:97:35,bridge_name='br-int',has_traffic_filtering=True,id=5a68432e-63fc-48e8-bc8c-62e0cd22033c,network=Network(589aea41-545f-4875-ab56-b7aa273dad6f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a68432e-63') {{(pid=75229) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 09:56:49 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:56:49 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5a68432e-63, bridge=br-int, if_exists=True) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:56:49 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:56:49 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 09:56:49 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:56:49 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=aab73209-5fe4-4d3f-bdd1-4f11a093aa90) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:56:49 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:56:49 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:56:49 user nova-compute[75229]: INFO os_vif [None req-11624001-65f3-443c-88a4-0fd10a2fb99b tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0c:97:35,bridge_name='br-int',has_traffic_filtering=True,id=5a68432e-63fc-48e8-bc8c-62e0cd22033c,network=Network(589aea41-545f-4875-ab56-b7aa273dad6f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a68432e-63')
Nov 14 09:56:49 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-11624001-65f3-443c-88a4-0fd10a2fb99b tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] [instance: d73f431b-d002-4206-8b52-7d313a43dccb] Deleting instance files /opt/stack/data/nova/instances/d73f431b-d002-4206-8b52-7d313a43dccb_del
Nov 14 09:56:49 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-11624001-65f3-443c-88a4-0fd10a2fb99b tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] [instance: d73f431b-d002-4206-8b52-7d313a43dccb] Deletion of /opt/stack/data/nova/instances/d73f431b-d002-4206-8b52-7d313a43dccb_del complete
Nov 14 09:56:49 user nova-compute[75229]: INFO nova.compute.manager [None req-11624001-65f3-443c-88a4-0fd10a2fb99b tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] [instance: d73f431b-d002-4206-8b52-7d313a43dccb] Took 0.75 seconds to destroy the instance on the hypervisor.
Nov 14 09:56:49 user nova-compute[75229]: DEBUG oslo.service.loopingcall [None req-11624001-65f3-443c-88a4-0fd10a2fb99b tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75229) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 09:56:49 user nova-compute[75229]: DEBUG nova.compute.manager [-] [instance: d73f431b-d002-4206-8b52-7d313a43dccb] Deallocating network for instance {{(pid=75229) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 09:56:49 user nova-compute[75229]: DEBUG nova.network.neutron [-] [instance: d73f431b-d002-4206-8b52-7d313a43dccb] deallocate_for_instance() {{(pid=75229) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 09:56:49 user nova-compute[75229]: DEBUG nova.network.neutron [None req-e9531933-c1fc-4c34-84a8-22f450e70c0a tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] [instance: 30ae1f73-e0f3-4e26-987e-a684471a160d] Successfully created port: c087c657-8eee-4e8e-bef1-4281129597ae {{(pid=75229) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 09:56:50 user nova-compute[75229]: DEBUG nova.network.neutron [None req-e9531933-c1fc-4c34-84a8-22f450e70c0a tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] [instance: 30ae1f73-e0f3-4e26-987e-a684471a160d] Successfully updated port: c087c657-8eee-4e8e-bef1-4281129597ae {{(pid=75229) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 09:56:50 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-e9531933-c1fc-4c34-84a8-22f450e70c0a tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Acquiring lock "refresh_cache-30ae1f73-e0f3-4e26-987e-a684471a160d" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 09:56:50 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-e9531933-c1fc-4c34-84a8-22f450e70c0a tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Acquired lock "refresh_cache-30ae1f73-e0f3-4e26-987e-a684471a160d" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 09:56:50 user nova-compute[75229]: DEBUG nova.network.neutron [None req-e9531933-c1fc-4c34-84a8-22f450e70c0a tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] [instance: 30ae1f73-e0f3-4e26-987e-a684471a160d] Building network info cache for instance {{(pid=75229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 09:56:50 user nova-compute[75229]: DEBUG nova.network.neutron [None req-e9531933-c1fc-4c34-84a8-22f450e70c0a tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] [instance: 30ae1f73-e0f3-4e26-987e-a684471a160d] Instance cache missing network info. {{(pid=75229) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 09:56:50 user nova-compute[75229]: DEBUG nova.network.neutron [-] [instance: d73f431b-d002-4206-8b52-7d313a43dccb] Updating instance_info_cache with network_info: [] {{(pid=75229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 09:56:50 user nova-compute[75229]: INFO nova.compute.manager [-] [instance: d73f431b-d002-4206-8b52-7d313a43dccb] Took 0.85 seconds to deallocate network for instance.
Nov 14 09:56:50 user nova-compute[75229]: DEBUG nova.compute.manager [req-dfa6b125-21eb-480d-8d7b-222637692db9 req-903c7e21-477c-4dfd-bee3-3b87dd0b0ded service nova] [instance: d73f431b-d002-4206-8b52-7d313a43dccb] Received event network-vif-deleted-5a68432e-63fc-48e8-bc8c-62e0cd22033c {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:56:50 user nova-compute[75229]: INFO nova.compute.manager [req-dfa6b125-21eb-480d-8d7b-222637692db9 req-903c7e21-477c-4dfd-bee3-3b87dd0b0ded service nova] [instance: d73f431b-d002-4206-8b52-7d313a43dccb] Neutron deleted interface 5a68432e-63fc-48e8-bc8c-62e0cd22033c; detaching it from the instance and deleting it from the info cache
Nov 14 09:56:50 user nova-compute[75229]: DEBUG nova.network.neutron [req-dfa6b125-21eb-480d-8d7b-222637692db9 req-903c7e21-477c-4dfd-bee3-3b87dd0b0ded service nova] [instance: d73f431b-d002-4206-8b52-7d313a43dccb] Updating instance_info_cache with network_info: [] {{(pid=75229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 09:56:50 user nova-compute[75229]: DEBUG nova.compute.manager [req-dfa6b125-21eb-480d-8d7b-222637692db9 req-903c7e21-477c-4dfd-bee3-3b87dd0b0ded service nova] [instance: d73f431b-d002-4206-8b52-7d313a43dccb] Detach interface failed, port_id=5a68432e-63fc-48e8-bc8c-62e0cd22033c, reason: Instance d73f431b-d002-4206-8b52-7d313a43dccb could not be found. {{(pid=75229) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 14 09:56:50 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-11624001-65f3-443c-88a4-0fd10a2fb99b tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:56:50 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-11624001-65f3-443c-88a4-0fd10a2fb99b tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:56:50 user nova-compute[75229]: DEBUG nova.network.neutron [None req-e9531933-c1fc-4c34-84a8-22f450e70c0a tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] [instance: 30ae1f73-e0f3-4e26-987e-a684471a160d] Updating instance_info_cache with network_info: [{"id": "c087c657-8eee-4e8e-bef1-4281129597ae", "address": "fa:16:3e:aa:d3:e3", "network": {"id": "6a700b61-4aa6-440b-87e6-a3525a5cb918", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-448680331-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8babb73006da4977a1fe2bdb35e08d8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc087c657-8e", "ovs_interfaceid": "c087c657-8eee-4e8e-bef1-4281129597ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 09:56:50 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-e9531933-c1fc-4c34-84a8-22f450e70c0a tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Releasing lock "refresh_cache-30ae1f73-e0f3-4e26-987e-a684471a160d" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 09:56:50 user nova-compute[75229]: DEBUG nova.compute.manager [None req-e9531933-c1fc-4c34-84a8-22f450e70c0a tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] [instance: 30ae1f73-e0f3-4e26-987e-a684471a160d] Instance network_info: |[{"id": "c087c657-8eee-4e8e-bef1-4281129597ae", "address": "fa:16:3e:aa:d3:e3", "network": {"id": "6a700b61-4aa6-440b-87e6-a3525a5cb918", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-448680331-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8babb73006da4977a1fe2bdb35e08d8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc087c657-8e", "ovs_interfaceid": "c087c657-8eee-4e8e-bef1-4281129597ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75229) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 09:56:50 user nova-compute[75229]: DEBUG nova.compute.provider_tree [None req-11624001-65f3-443c-88a4-0fd10a2fb99b tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Inventory has not changed in ProviderTree for provider: d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 {{(pid=75229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 09:56:51 user nova-compute[75229]: DEBUG nova.scheduler.client.report [None req-11624001-65f3-443c-88a4-0fd10a2fb99b tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Inventory has not changed for provider d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 09:56:51 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-11624001-65f3-443c-88a4-0fd10a2fb99b tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.330s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:56:51 user nova-compute[75229]: INFO nova.scheduler.client.report [None req-11624001-65f3-443c-88a4-0fd10a2fb99b tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Deleted allocations for instance d73f431b-d002-4206-8b52-7d313a43dccb
Nov 14 09:56:51 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-11624001-65f3-443c-88a4-0fd10a2fb99b tempest-AttachVolumeShelveTestJSON-730167895 tempest-AttachVolumeShelveTestJSON-730167895-project-member] Lock "d73f431b-d002-4206-8b52-7d313a43dccb" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.348s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:56:51 user nova-compute[75229]: DEBUG nova.compute.manager [req-410a4c49-3568-42a0-bd34-5ebca9dbe8c3 req-a623bd1f-1aac-415d-8267-44bc88e834b9 service nova] [instance: d73f431b-d002-4206-8b52-7d313a43dccb] Received event network-vif-plugged-5a68432e-63fc-48e8-bc8c-62e0cd22033c {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:56:51 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-410a4c49-3568-42a0-bd34-5ebca9dbe8c3 req-a623bd1f-1aac-415d-8267-44bc88e834b9 service nova] Acquiring lock "d73f431b-d002-4206-8b52-7d313a43dccb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:56:51 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-410a4c49-3568-42a0-bd34-5ebca9dbe8c3 req-a623bd1f-1aac-415d-8267-44bc88e834b9 service nova] Lock "d73f431b-d002-4206-8b52-7d313a43dccb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:56:51 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-410a4c49-3568-42a0-bd34-5ebca9dbe8c3 req-a623bd1f-1aac-415d-8267-44bc88e834b9 service nova] Lock "d73f431b-d002-4206-8b52-7d313a43dccb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:56:51 user nova-compute[75229]: DEBUG nova.compute.manager [req-410a4c49-3568-42a0-bd34-5ebca9dbe8c3 req-a623bd1f-1aac-415d-8267-44bc88e834b9 service nova] [instance: d73f431b-d002-4206-8b52-7d313a43dccb] No waiting events found dispatching network-vif-plugged-5a68432e-63fc-48e8-bc8c-62e0cd22033c {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 09:56:51 user nova-compute[75229]: WARNING nova.compute.manager [req-410a4c49-3568-42a0-bd34-5ebca9dbe8c3 req-a623bd1f-1aac-415d-8267-44bc88e834b9 service nova] [instance: d73f431b-d002-4206-8b52-7d313a43dccb] Received unexpected event network-vif-plugged-5a68432e-63fc-48e8-bc8c-62e0cd22033c for instance with vm_state deleted and task_state None.
Nov 14 09:56:51 user nova-compute[75229]: DEBUG nova.compute.manager [req-410a4c49-3568-42a0-bd34-5ebca9dbe8c3 req-a623bd1f-1aac-415d-8267-44bc88e834b9 service nova] [instance: 30ae1f73-e0f3-4e26-987e-a684471a160d] Received event network-changed-c087c657-8eee-4e8e-bef1-4281129597ae {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:56:51 user nova-compute[75229]: DEBUG nova.compute.manager [req-410a4c49-3568-42a0-bd34-5ebca9dbe8c3 req-a623bd1f-1aac-415d-8267-44bc88e834b9 service nova] [instance: 30ae1f73-e0f3-4e26-987e-a684471a160d] Refreshing instance network info cache due to event network-changed-c087c657-8eee-4e8e-bef1-4281129597ae. {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 09:56:51 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-410a4c49-3568-42a0-bd34-5ebca9dbe8c3 req-a623bd1f-1aac-415d-8267-44bc88e834b9 service nova] Acquiring lock "refresh_cache-30ae1f73-e0f3-4e26-987e-a684471a160d" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 09:56:51 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-410a4c49-3568-42a0-bd34-5ebca9dbe8c3 req-a623bd1f-1aac-415d-8267-44bc88e834b9 service nova] Acquired lock "refresh_cache-30ae1f73-e0f3-4e26-987e-a684471a160d" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 09:56:51 user nova-compute[75229]: DEBUG nova.network.neutron [req-410a4c49-3568-42a0-bd34-5ebca9dbe8c3 req-a623bd1f-1aac-415d-8267-44bc88e834b9 service nova] [instance: 30ae1f73-e0f3-4e26-987e-a684471a160d] Refreshing network info cache for port c087c657-8eee-4e8e-bef1-4281129597ae {{(pid=75229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 09:56:51 user nova-compute[75229]: DEBUG nova.network.neutron [req-410a4c49-3568-42a0-bd34-5ebca9dbe8c3 req-a623bd1f-1aac-415d-8267-44bc88e834b9 service nova] [instance: 30ae1f73-e0f3-4e26-987e-a684471a160d] Updated VIF entry in instance network info cache for port c087c657-8eee-4e8e-bef1-4281129597ae. {{(pid=75229) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 09:56:51 user nova-compute[75229]: DEBUG nova.network.neutron [req-410a4c49-3568-42a0-bd34-5ebca9dbe8c3 req-a623bd1f-1aac-415d-8267-44bc88e834b9 service nova] [instance: 30ae1f73-e0f3-4e26-987e-a684471a160d] Updating instance_info_cache with network_info: [{"id": "c087c657-8eee-4e8e-bef1-4281129597ae", "address": "fa:16:3e:aa:d3:e3", "network": {"id": "6a700b61-4aa6-440b-87e6-a3525a5cb918", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-448680331-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8babb73006da4977a1fe2bdb35e08d8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc087c657-8e", "ovs_interfaceid": "c087c657-8eee-4e8e-bef1-4281129597ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 09:56:51 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-410a4c49-3568-42a0-bd34-5ebca9dbe8c3 req-a623bd1f-1aac-415d-8267-44bc88e834b9 service nova] Releasing lock "refresh_cache-30ae1f73-e0f3-4e26-987e-a684471a160d" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 09:56:53 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:56:53 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 09:56:53 user nova-compute[75229]: DEBUG nova.compute.manager [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Starting heal instance info cache {{(pid=75229) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 09:56:53 user nova-compute[75229]: DEBUG os_brick.utils [None req-e9531933-c1fc-4c34-84a8-22f450e70c0a tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 09:56:53 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:56:53 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:56:53 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8c18c2c-af46-4109-adfb-deabd12bd181]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f1154031c835\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:56:53 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:56:53 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:56:53 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2f0aeb1-a136-4a33-9d38-90897bcc469f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:56:53 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:56:53 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:56:53 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[d236cfdc-4e7f-45a5-89b9-65e88957c08e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:56:53 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[78e77412-d71b-44a6-8802-5348f752c03c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:56:53 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-e9531933-c1fc-4c34-84a8-22f450e70c0a tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Running cmd (subprocess): nvme version {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:56:53 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-e9531933-c1fc-4c34-84a8-22f450e70c0a tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] 'nvme version' failed. Not Retrying. {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 09:56:53 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e9531933-c1fc-4c34-84a8-22f450e70c0a tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] nvme not present on system {{(pid=75229) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 09:56:53 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:56:53 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 09:56:53 user nova-compute[75229]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 09:56:53 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[f91b2035-6774-4aa3-ab0a-6c9ecea974f6]: (4, '') {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:56:53 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.lightos [None req-e9531933-c1fc-4c34-84a8-22f450e70c0a tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75229) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 09:56:53 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.lightos [None req-e9531933-c1fc-4c34-84a8-22f450e70c0a tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75229) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 09:56:53 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.lightos [None req-e9531933-c1fc-4c34-84a8-22f450e70c0a tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] LIGHTOS: no hostnqn found. {{(pid=75229) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 09:56:53 user nova-compute[75229]: DEBUG os_brick.utils [None req-e9531933-c1fc-4c34-84a8-22f450e70c0a tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f1154031c835', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 09:56:53 user nova-compute[75229]: DEBUG nova.virt.block_device [None req-e9531933-c1fc-4c34-84a8-22f450e70c0a tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] [instance: 30ae1f73-e0f3-4e26-987e-a684471a160d] Updating existing volume attachment record: 9b10ab8a-4a64-4912-825a-056b2487f548 {{(pid=75229) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 09:56:53 user nova-compute[75229]: DEBUG nova.compute.manager [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Didn't find any instances for network info cache update. {{(pid=75229) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 14 09:56:53 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 09:56:53 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 09:56:53 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:56:53 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:56:53 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:56:53 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Auditing locally available compute resources for user (node: user) {{(pid=75229) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 09:56:54 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cda8c5ad-e70c-4021-bace-d55831c4bc78/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:56:54 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cda8c5ad-e70c-4021-bace-d55831c4bc78/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:56:54 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cda8c5ad-e70c-4021-bace-d55831c4bc78/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:56:54 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cda8c5ad-e70c-4021-bace-d55831c4bc78/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:56:54 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7750cbc-b3d0-44aa-8b88-c291ba007a8a/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:56:54 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:56:54 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7750cbc-b3d0-44aa-8b88-c291ba007a8a/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:56:54 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7750cbc-b3d0-44aa-8b88-c291ba007a8a/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:56:54 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7750cbc-b3d0-44aa-8b88-c291ba007a8a/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:56:54 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75229) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 09:56:54 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e58500df-059a-4fce-afb7-ba36feca0697/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:56:55 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e58500df-059a-4fce-afb7-ba36feca0697/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:56:55 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e58500df-059a-4fce-afb7-ba36feca0697/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:56:55 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e58500df-059a-4fce-afb7-ba36feca0697/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:56:55 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c9fe69e-3f9d-4b30-a9e4-efc3e83efa17/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:56:55 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c9fe69e-3f9d-4b30-a9e4-efc3e83efa17/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:56:55 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c9fe69e-3f9d-4b30-a9e4-efc3e83efa17/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:56:55 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c9fe69e-3f9d-4b30-a9e4-efc3e83efa17/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:56:55 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57da589c-863c-42a8-8802-314a499ebc29/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:56:55 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57da589c-863c-42a8-8802-314a499ebc29/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:56:55 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57da589c-863c-42a8-8802-314a499ebc29/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:56:55 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57da589c-863c-42a8-8802-314a499ebc29/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:56:55 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cdd6b32-d4bd-4135-a58e-fbc3b6d2a093/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:56:56 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cdd6b32-d4bd-4135-a58e-fbc3b6d2a093/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:56:56 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cdd6b32-d4bd-4135-a58e-fbc3b6d2a093/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:56:56 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cdd6b32-d4bd-4135-a58e-fbc3b6d2a093/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:56:56 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5170e9e-66e3-4df1-9807-4958cac6480e/disk.rescue --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:56:56 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5170e9e-66e3-4df1-9807-4958cac6480e/disk.rescue --force-share --output=json" returned: 0 in 0.185s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:56:56 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5170e9e-66e3-4df1-9807-4958cac6480e/disk.rescue --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:56:56 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5170e9e-66e3-4df1-9807-4958cac6480e/disk.rescue --force-share --output=json" returned: 0 in 0.185s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:56:56 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5170e9e-66e3-4df1-9807-4958cac6480e/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:56:56 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5170e9e-66e3-4df1-9807-4958cac6480e/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:56:56 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5170e9e-66e3-4df1-9807-4958cac6480e/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:56:57 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5170e9e-66e3-4df1-9807-4958cac6480e/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:56:57 user nova-compute[75229]: WARNING nova.virt.libvirt.driver [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 09:56:57 user nova-compute[75229]: WARNING nova.virt.libvirt.driver [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 09:56:57 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Hypervisor/Node resource view: name=user free_ram=7815MB free_disk=25.181453704833984GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75229) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 09:56:57 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:56:57 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:56:57 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Instance a7750cbc-b3d0-44aa-8b88-c291ba007a8a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 09:56:57 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Instance 4c9fe69e-3f9d-4b30-a9e4-efc3e83efa17 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 09:56:57 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Instance b5170e9e-66e3-4df1-9807-4958cac6480e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 09:56:57 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Instance e58500df-059a-4fce-afb7-ba36feca0697 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 09:56:57 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Instance cda8c5ad-e70c-4021-bace-d55831c4bc78 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 09:56:57 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Instance 57da589c-863c-42a8-8802-314a499ebc29 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 09:56:57 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Instance 589f4750-fac6-4e99-a430-0cda339808bc actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 09:56:57 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Instance 9cdd6b32-d4bd-4135-a58e-fbc3b6d2a093 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 09:56:57 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Instance 30ae1f73-e0f3-4e26-987e-a684471a160d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 09:56:57 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=75229) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 09:56:57 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=75229) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 09:56:57 user nova-compute[75229]: DEBUG nova.compute.provider_tree [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Inventory has not changed in ProviderTree for provider: d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 {{(pid=75229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 09:56:57 user nova-compute[75229]: DEBUG nova.scheduler.client.report [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Inventory has not changed for provider d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 09:56:57 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Compute_service record updated for user:user {{(pid=75229) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 09:56:57 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.416s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:56:58 user nova-compute[75229]: DEBUG nova.compute.manager [None req-e9531933-c1fc-4c34-84a8-22f450e70c0a tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] [instance: 30ae1f73-e0f3-4e26-987e-a684471a160d] Start spawning the instance on the hypervisor. {{(pid=75229) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 09:56:58 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-e9531933-c1fc-4c34-84a8-22f450e70c0a tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] [instance: 30ae1f73-e0f3-4e26-987e-a684471a160d] Creating instance directory {{(pid=75229) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 09:56:58 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-e9531933-c1fc-4c34-84a8-22f450e70c0a tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] [instance: 30ae1f73-e0f3-4e26-987e-a684471a160d] Creating image(s)
Nov 14 09:56:58 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-e9531933-c1fc-4c34-84a8-22f450e70c0a tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] [instance: 30ae1f73-e0f3-4e26-987e-a684471a160d] Did not create local disks {{(pid=75229) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 14 09:56:58 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-e9531933-c1fc-4c34-84a8-22f450e70c0a tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] [instance: 30ae1f73-e0f3-4e26-987e-a684471a160d] Ensure instance console log exists: /opt/stack/data/nova/instances/30ae1f73-e0f3-4e26-987e-a684471a160d/console.log {{(pid=75229) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 09:56:58 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-e9531933-c1fc-4c34-84a8-22f450e70c0a tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:56:58 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-e9531933-c1fc-4c34-84a8-22f450e70c0a tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:56:58 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-e9531933-c1fc-4c34-84a8-22f450e70c0a tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:56:58 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-e9531933-c1fc-4c34-84a8-22f450e70c0a tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] [instance: 30ae1f73-e0f3-4e26-987e-a684471a160d] Start _get_guest_xml network_info=[{"id": "c087c657-8eee-4e8e-bef1-4281129597ae", "address": "fa:16:3e:aa:d3:e3", "network": {"id": "6a700b61-4aa6-440b-87e6-a3525a5cb918", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-448680331-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8babb73006da4977a1fe2bdb35e08d8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc087c657-8e", "ovs_interfaceid": "c087c657-8eee-4e8e-bef1-4281129597ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T09:40:10Z,direct_url=<?>,disk_format='qcow2',id=3bef8470-ecc7-40e3-95d4-9254348ea72d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='de5a91106b6948ed937a7178ff9464c4',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T09:40:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:5aebc438-0289-44fe-ad84-4e696468f50e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TgiuaWRw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '30ae1f73-e0f3-4e26-987e-a684471a160d', 'attached_at': '', 'detached_at': '', 'volume_id': '5aebc438-0289-44fe-ad84-4e696468f50e', 'serial': '5aebc438-0289-44fe-ad84-4e696468f50e'}, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'attachment_id': '9b10ab8a-4a64-4912-825a-056b2487f548', 'guest_format': None, 'device_type': 'disk', 'volume_type': None} {{(pid=75229) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 09:56:58 user nova-compute[75229]: WARNING nova.virt.libvirt.driver [None req-e9531933-c1fc-4c34-84a8-22f450e70c0a tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 09:56:58 user nova-compute[75229]: WARNING nova.virt.libvirt.driver [None req-e9531933-c1fc-4c34-84a8-22f450e70c0a tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 09:56:58 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-e9531933-c1fc-4c34-84a8-22f450e70c0a tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75229) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 09:56:58 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-e9531933-c1fc-4c34-84a8-22f450e70c0a tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] CPU controller missing on host. {{(pid=75229) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 09:56:58 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-e9531933-c1fc-4c34-84a8-22f450e70c0a tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75229) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 09:56:58 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-e9531933-c1fc-4c34-84a8-22f450e70c0a tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] CPU controller found on host. {{(pid=75229) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 09:56:58 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-e9531933-c1fc-4c34-84a8-22f450e70c0a tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75229) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 09:56:58 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-e9531933-c1fc-4c34-84a8-22f450e70c0a tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T09:39:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T09:40:10Z,direct_url=<?>,disk_format='qcow2',id=3bef8470-ecc7-40e3-95d4-9254348ea72d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='de5a91106b6948ed937a7178ff9464c4',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T09:40:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 09:56:58 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-e9531933-c1fc-4c34-84a8-22f450e70c0a tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Flavor limits 0:0:0 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 09:56:58 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-e9531933-c1fc-4c34-84a8-22f450e70c0a tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Image limits 0:0:0 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 09:56:58 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-e9531933-c1fc-4c34-84a8-22f450e70c0a tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Flavor pref 0:0:0 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 09:56:58 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-e9531933-c1fc-4c34-84a8-22f450e70c0a tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Image pref 0:0:0 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 09:56:58 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-e9531933-c1fc-4c34-84a8-22f450e70c0a tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 09:56:58 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-e9531933-c1fc-4c34-84a8-22f450e70c0a tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 09:56:58 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-e9531933-c1fc-4c34-84a8-22f450e70c0a tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75229) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 09:56:58 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-e9531933-c1fc-4c34-84a8-22f450e70c0a tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Got 1 possible topologies {{(pid=75229) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 09:56:58 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-e9531933-c1fc-4c34-84a8-22f450e70c0a tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 09:56:58 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-e9531933-c1fc-4c34-84a8-22f450e70c0a tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 09:56:58 user nova-compute[75229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e9531933-c1fc-4c34-84a8-22f450e70c0a tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] [instance: 30ae1f73-e0f3-4e26-987e-a684471a160d] Calling os-brick to attach iSCSI Volume {{(pid=75229) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 09:56:58 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9531933-c1fc-4c34-84a8-22f450e70c0a tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f73f85151b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5aebc438-0289-44fe-ad84-4e696468f50e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TgiuaWRw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 09:56:58 user nova-compute[75229]: WARNING os_brick.initiator.connectors.base [None req-e9531933-c1fc-4c34-84a8-22f450e70c0a tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 09:56:58 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-e9531933-c1fc-4c34-84a8-22f450e70c0a tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 09:56:58 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-e9531933-c1fc-4c34-84a8-22f450e70c0a tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 09:56:58 user nova-compute[75229]: WARNING os_brick.initiator.connectors.base [None req-e9531933-c1fc-4c34-84a8-22f450e70c0a tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 09:56:58 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-e9531933-c1fc-4c34-84a8-22f450e70c0a tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5aebc438-0289-44fe-ad84-4e696468f50e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 09:56:58 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-e9531933-c1fc-4c34-84a8-22f450e70c0a tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5aebc438-0289-44fe-ad84-4e696468f50e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 09:56:58 user nova-compute[75229]: INFO os_brick.initiator.connectors.iscsi [None req-e9531933-c1fc-4c34-84a8-22f450e70c0a tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 09:56:58 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5aebc438-0289-44fe-ad84-4e696468f50e -p 172.16.0.220:3260 {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:56:58 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5aebc438-0289-44fe-ad84-4e696468f50e -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:56:58 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[496b1d1a-74d5-49fb-a86e-bc6b7db90eaf]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:56:58 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9531933-c1fc-4c34-84a8-22f450e70c0a tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 09:56:58 user nova-compute[75229]:  {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:56:58 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5aebc438-0289-44fe-ad84-4e696468f50e -p 172.16.0.220:3260 --interface default --op new {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:56:58 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5aebc438-0289-44fe-ad84-4e696468f50e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:56:58 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[f09761c0-b995-40bc-92ca-7172f4b338b0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5aebc438-0289-44fe-ad84-4e696468f50e] added\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:56:58 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9531933-c1fc-4c34-84a8-22f450e70c0a tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5aebc438-0289-44fe-ad84-4e696468f50e] added
Nov 14 09:56:58 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:56:58 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5aebc438-0289-44fe-ad84-4e696468f50e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:56:58 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5aebc438-0289-44fe-ad84-4e696468f50e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:56:58 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[388ef519-59b3-480b-a36f-819cfcc00ef0]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:56:58 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9531933-c1fc-4c34-84a8-22f450e70c0a tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:56:58 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5aebc438-0289-44fe-ad84-4e696468f50e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:56:58 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5aebc438-0289-44fe-ad84-4e696468f50e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:56:58 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f5e5ff1-61d7-42bd-9019-42b710cd3872]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:56:58 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9531933-c1fc-4c34-84a8-22f450e70c0a tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:56:58 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5aebc438-0289-44fe-ad84-4e696468f50e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TgiuaWRw {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:56:58 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5aebc438-0289-44fe-ad84-4e696468f50e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TgiuaWRw" returned: 0 in 0.020s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:56:58 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[27dfffc1-9cc5-4687-8d45-de857da3c40d]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:56:58 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9531933-c1fc-4c34-84a8-22f450e70c0a tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'TgiuaWRw'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:56:58 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5aebc438-0289-44fe-ad84-4e696468f50e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:56:58 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5aebc438-0289-44fe-ad84-4e696468f50e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:56:58 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[18963ff8-2ed7-4b23-b68a-78c654e8ffe3]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:56:58 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9531933-c1fc-4c34-84a8-22f450e70c0a tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:56:58 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:56:58 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:56:58 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1d00a82-bc93-4f20-8d6f-3a805d725f10]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5efb0e0-a85c-46ec-8a9d-2763bf548023 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d22e1af-30f1-4688-bfda-e6dd2c5bee99 (non-flash)\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:56:58 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9531933-c1fc-4c34-84a8-22f450e70c0a tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5efb0e0-a85c-46ec-8a9d-2763bf548023 (non-flash)
Nov 14 09:56:58 user nova-compute[75229]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d22e1af-30f1-4688-bfda-e6dd2c5bee99 (non-flash)
Nov 14 09:56:58 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 09:56:58 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9531933-c1fc-4c34-84a8-22f450e70c0a tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5efb0e0-a85c-46ec-8a9d-2763bf548023 (non-flash)
Nov 14 09:56:58 user nova-compute[75229]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d22e1af-30f1-4688-bfda-e6dd2c5bee99 (non-flash)
Nov 14 09:56:58 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 09:56:58 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5aebc438-0289-44fe-ad84-4e696468f50e -p 172.16.0.220:3260 --login {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:56:58 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5aebc438-0289-44fe-ad84-4e696468f50e -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:56:58 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc644c38-731b-4c56-822a-f008ae43849b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5aebc438-0289-44fe-ad84-4e696468f50e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5aebc438-0289-44fe-ad84-4e696468f50e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:56:58 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9531933-c1fc-4c34-84a8-22f450e70c0a tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5aebc438-0289-44fe-ad84-4e696468f50e, portal: 172.16.0.220,3260]
Nov 14 09:56:58 user nova-compute[75229]: Login to [iface: default, target: iqn.2010-10.org.openstack:5aebc438-0289-44fe-ad84-4e696468f50e, portal: 172.16.0.220,3260] successful.
Nov 14 09:56:58 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:56:58 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5aebc438-0289-44fe-ad84-4e696468f50e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:56:58 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5aebc438-0289-44fe-ad84-4e696468f50e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:56:58 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd5505d5-393b-40d8-a303-262611e0d0a7]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:56:58 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9531933-c1fc-4c34-84a8-22f450e70c0a tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:56:58 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:56:58 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:56:58 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[1661f6aa-8dc3-411c-b59d-6dde242fa757]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5efb0e0-a85c-46ec-8a9d-2763bf548023 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d22e1af-30f1-4688-bfda-e6dd2c5bee99 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aebc438-0289-44fe-ad84-4e696468f50e (non-flash)\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:56:58 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9531933-c1fc-4c34-84a8-22f450e70c0a tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5efb0e0-a85c-46ec-8a9d-2763bf548023 (non-flash)
Nov 14 09:56:58 user nova-compute[75229]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d22e1af-30f1-4688-bfda-e6dd2c5bee99 (non-flash)
Nov 14 09:56:58 user nova-compute[75229]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aebc438-0289-44fe-ad84-4e696468f50e (non-flash)
Nov 14 09:56:58 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 09:56:58 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9531933-c1fc-4c34-84a8-22f450e70c0a tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5efb0e0-a85c-46ec-8a9d-2763bf548023 (non-flash)
Nov 14 09:56:58 user nova-compute[75229]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d22e1af-30f1-4688-bfda-e6dd2c5bee99 (non-flash)
Nov 14 09:56:58 user nova-compute[75229]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aebc438-0289-44fe-ad84-4e696468f50e (non-flash)
Nov 14 09:56:58 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 09:56:58 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-e9531933-c1fc-4c34-84a8-22f450e70c0a tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5aebc438-0289-44fe-ad84-4e696468f50e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.264s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 09:56:58 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9531933-c1fc-4c34-84a8-22f450e70c0a tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Connected to 172.16.0.220:3260 {{(pid=75229) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 09:56:58 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-e9531933-c1fc-4c34-84a8-22f450e70c0a tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] HCTL ('34', '-', '-', 0) found on session 34 with lun 0 {{(pid=75229) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 09:56:58 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-e9531933-c1fc-4c34-84a8-22f450e70c0a tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75229) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 09:56:58 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:56:58 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:56:58 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a43388c-0d89-4e8e-b045-8cf8f26482d8]: (4, ('- - 0', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:56:58 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-e9531933-c1fc-4c34-84a8-22f450e70c0a tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Searching for a device in session 34 and hctl ['34', '*', '*', 0] yield: None {{(pid=75229) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 09:56:59 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-e9531933-c1fc-4c34-84a8-22f450e70c0a tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Searching for a device in session 34 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75229) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 09:56:59 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9531933-c1fc-4c34-84a8-22f450e70c0a tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:5aebc438-0289-44fe-ad84-4e696468f50e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TgiuaWRw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75229) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 09:56:59 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-e9531933-c1fc-4c34-84a8-22f450e70c0a tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.296s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 09:56:59 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9531933-c1fc-4c34-84a8-22f450e70c0a tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] <== connect_volume: return (1297ms) {'type': 'block', 'scsi_wwn': '23638376139346638', 'path': '/dev/sdc'} {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 09:56:59 user nova-compute[75229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e9531933-c1fc-4c34-84a8-22f450e70c0a tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] [instance: 30ae1f73-e0f3-4e26-987e-a684471a160d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23638376139346638', 'path': '/dev/sdc'} {{(pid=75229) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 09:56:59 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 09:56:59 user nova-compute[75229]: DEBUG nova.virt.libvirt.vif [None req-e9531933-c1fc-4c34-84a8-22f450e70c0a tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T09:56:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1790249022',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1790249022',id=34,image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8babb73006da4977a1fe2bdb35e08d8f',ramdisk_id='',reservation_id='r-hu64t322',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-189750210',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T09:56:48Z,user_data=None,user_id='a8825cd49e9349f28576b704c4c4d717',uuid=30ae1f73-e0f3-4e26-987e-a684471a160d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c087c657-8eee-4e8e-bef1-4281129597ae", "address": "fa:16:3e:aa:d3:e3", "network": {"id": "6a700b61-4aa6-440b-87e6-a3525a5cb918", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-448680331-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8babb73006da4977a1fe2bdb35e08d8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc087c657-8e", "ovs_interfaceid": "c087c657-8eee-4e8e-bef1-4281129597ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75229) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 09:56:59 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-e9531933-c1fc-4c34-84a8-22f450e70c0a tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Converting VIF {"id": "c087c657-8eee-4e8e-bef1-4281129597ae", "address": "fa:16:3e:aa:d3:e3", "network": {"id": "6a700b61-4aa6-440b-87e6-a3525a5cb918", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-448680331-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8babb73006da4977a1fe2bdb35e08d8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc087c657-8e", "ovs_interfaceid": "c087c657-8eee-4e8e-bef1-4281129597ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 09:56:59 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-e9531933-c1fc-4c34-84a8-22f450e70c0a tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:aa:d3:e3,bridge_name='br-int',has_traffic_filtering=True,id=c087c657-8eee-4e8e-bef1-4281129597ae,network=Network(6a700b61-4aa6-440b-87e6-a3525a5cb918),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc087c657-8e') {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 09:56:59 user nova-compute[75229]: DEBUG nova.objects.instance [None req-e9531933-c1fc-4c34-84a8-22f450e70c0a tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Lazy-loading 'pci_devices' on Instance uuid 30ae1f73-e0f3-4e26-987e-a684471a160d {{(pid=75229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 09:56:59 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-e9531933-c1fc-4c34-84a8-22f450e70c0a tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] [instance: 30ae1f73-e0f3-4e26-987e-a684471a160d] End _get_guest_xml xml=<domain type="kvm">
Nov 14 09:56:59 user nova-compute[75229]:   <uuid>30ae1f73-e0f3-4e26-987e-a684471a160d</uuid>
Nov 14 09:56:59 user nova-compute[75229]:   <name>instance-00000022</name>
Nov 14 09:56:59 user nova-compute[75229]:   <memory>524288</memory>
Nov 14 09:56:59 user nova-compute[75229]:   <vcpu>1</vcpu>
Nov 14 09:56:59 user nova-compute[75229]:   <metadata>
Nov 14 09:56:59 user nova-compute[75229]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 09:56:59 user nova-compute[75229]:       <nova:package version="0.0.0"/>
Nov 14 09:56:59 user nova-compute[75229]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1790249022</nova:name>
Nov 14 09:56:59 user nova-compute[75229]:       <nova:creationTime>2023-11-14 09:56:58</nova:creationTime>
Nov 14 09:56:59 user nova-compute[75229]:       <nova:flavor name="m1.tiny">
Nov 14 09:56:59 user nova-compute[75229]:         <nova:memory>512</nova:memory>
Nov 14 09:56:59 user nova-compute[75229]:         <nova:disk>1</nova:disk>
Nov 14 09:56:59 user nova-compute[75229]:         <nova:swap>0</nova:swap>
Nov 14 09:56:59 user nova-compute[75229]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 09:56:59 user nova-compute[75229]:         <nova:vcpus>1</nova:vcpus>
Nov 14 09:56:59 user nova-compute[75229]:       </nova:flavor>
Nov 14 09:56:59 user nova-compute[75229]:       <nova:owner>
Nov 14 09:56:59 user nova-compute[75229]:         <nova:user uuid="a8825cd49e9349f28576b704c4c4d717">tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member</nova:user>
Nov 14 09:56:59 user nova-compute[75229]:         <nova:project uuid="8babb73006da4977a1fe2bdb35e08d8f">tempest-ServerBootFromVolumeStableRescueTest-189750210</nova:project>
Nov 14 09:56:59 user nova-compute[75229]:       </nova:owner>
Nov 14 09:56:59 user nova-compute[75229]:       <nova:root type="image" uuid="3bef8470-ecc7-40e3-95d4-9254348ea72d"/>
Nov 14 09:56:59 user nova-compute[75229]:       <nova:ports>
Nov 14 09:56:59 user nova-compute[75229]:         <nova:port uuid="c087c657-8eee-4e8e-bef1-4281129597ae">
Nov 14 09:56:59 user nova-compute[75229]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 14 09:56:59 user nova-compute[75229]:         </nova:port>
Nov 14 09:56:59 user nova-compute[75229]:       </nova:ports>
Nov 14 09:56:59 user nova-compute[75229]:     </nova:instance>
Nov 14 09:56:59 user nova-compute[75229]:   </metadata>
Nov 14 09:56:59 user nova-compute[75229]:   <sysinfo type="smbios">
Nov 14 09:56:59 user nova-compute[75229]:     <system>
Nov 14 09:56:59 user nova-compute[75229]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 09:56:59 user nova-compute[75229]:       <entry name="product">OpenStack Nova</entry>
Nov 14 09:56:59 user nova-compute[75229]:       <entry name="version">0.0.0</entry>
Nov 14 09:56:59 user nova-compute[75229]:       <entry name="serial">30ae1f73-e0f3-4e26-987e-a684471a160d</entry>
Nov 14 09:56:59 user nova-compute[75229]:       <entry name="uuid">30ae1f73-e0f3-4e26-987e-a684471a160d</entry>
Nov 14 09:56:59 user nova-compute[75229]:       <entry name="family">Virtual Machine</entry>
Nov 14 09:56:59 user nova-compute[75229]:     </system>
Nov 14 09:56:59 user nova-compute[75229]:   </sysinfo>
Nov 14 09:56:59 user nova-compute[75229]:   <os>
Nov 14 09:56:59 user nova-compute[75229]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 09:56:59 user nova-compute[75229]:     <boot dev="hd"/>
Nov 14 09:56:59 user nova-compute[75229]:     <smbios mode="sysinfo"/>
Nov 14 09:56:59 user nova-compute[75229]:   </os>
Nov 14 09:56:59 user nova-compute[75229]:   <features>
Nov 14 09:56:59 user nova-compute[75229]:     <acpi/>
Nov 14 09:56:59 user nova-compute[75229]:     <apic/>
Nov 14 09:56:59 user nova-compute[75229]:     <vmcoreinfo/>
Nov 14 09:56:59 user nova-compute[75229]:   </features>
Nov 14 09:56:59 user nova-compute[75229]:   <clock offset="utc">
Nov 14 09:56:59 user nova-compute[75229]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 09:56:59 user nova-compute[75229]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 09:56:59 user nova-compute[75229]:     <timer name="hpet" present="no"/>
Nov 14 09:56:59 user nova-compute[75229]:   </clock>
Nov 14 09:56:59 user nova-compute[75229]:   <cpu mode="custom" match="exact">
Nov 14 09:56:59 user nova-compute[75229]:     <model>Nehalem</model>
Nov 14 09:56:59 user nova-compute[75229]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 09:56:59 user nova-compute[75229]:   </cpu>
Nov 14 09:56:59 user nova-compute[75229]:   <devices>
Nov 14 09:56:59 user nova-compute[75229]:     <disk type="block" device="disk">
Nov 14 09:56:59 user nova-compute[75229]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 09:56:59 user nova-compute[75229]:       <source dev="/dev/sdc"/>
Nov 14 09:56:59 user nova-compute[75229]:       <target dev="vda" bus="virtio"/>
Nov 14 09:56:59 user nova-compute[75229]:       <serial>5aebc438-0289-44fe-ad84-4e696468f50e</serial>
Nov 14 09:56:59 user nova-compute[75229]:     </disk>
Nov 14 09:56:59 user nova-compute[75229]:     <interface type="ethernet">
Nov 14 09:56:59 user nova-compute[75229]:       <mac address="fa:16:3e:aa:d3:e3"/>
Nov 14 09:56:59 user nova-compute[75229]:       <model type="virtio"/>
Nov 14 09:56:59 user nova-compute[75229]:       <mtu size="1442"/>
Nov 14 09:56:59 user nova-compute[75229]:       <target dev="tapc087c657-8e"/>
Nov 14 09:56:59 user nova-compute[75229]:     </interface>
Nov 14 09:56:59 user nova-compute[75229]:     <serial type="pty">
Nov 14 09:56:59 user nova-compute[75229]:       <log file="/opt/stack/data/nova/instances/30ae1f73-e0f3-4e26-987e-a684471a160d/console.log" append="off"/>
Nov 14 09:56:59 user nova-compute[75229]:     </serial>
Nov 14 09:56:59 user nova-compute[75229]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 09:56:59 user nova-compute[75229]:     <video>
Nov 14 09:56:59 user nova-compute[75229]:       <model type="virtio"/>
Nov 14 09:56:59 user nova-compute[75229]:     </video>
Nov 14 09:56:59 user nova-compute[75229]:     <rng model="virtio">
Nov 14 09:56:59 user nova-compute[75229]:       <backend model="random">/dev/urandom</backend>
Nov 14 09:56:59 user nova-compute[75229]:     </rng>
Nov 14 09:56:59 user nova-compute[75229]:     <controller type="usb" index="0" model="none"/>
Nov 14 09:56:59 user nova-compute[75229]:     <memballoon model="virtio">
Nov 14 09:56:59 user nova-compute[75229]:       <stats period="10"/>
Nov 14 09:56:59 user nova-compute[75229]:     </memballoon>
Nov 14 09:56:59 user nova-compute[75229]:   </devices>
Nov 14 09:56:59 user nova-compute[75229]: </domain>
Nov 14 09:56:59 user nova-compute[75229]:  {{(pid=75229) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 09:56:59 user nova-compute[75229]: DEBUG nova.virt.libvirt.vif [None req-e9531933-c1fc-4c34-84a8-22f450e70c0a tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T09:56:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1790249022',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1790249022',id=34,image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8babb73006da4977a1fe2bdb35e08d8f',ramdisk_id='',reservation_id='r-hu64t322',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-189750210',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T09:56:48Z,user_data=None,user_id='a8825cd49e9349f28576b704c4c4d717',uuid=30ae1f73-e0f3-4e26-987e-a684471a160d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c087c657-8eee-4e8e-bef1-4281129597ae", "address": "fa:16:3e:aa:d3:e3", "network": {"id": "6a700b61-4aa6-440b-87e6-a3525a5cb918", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-448680331-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8babb73006da4977a1fe2bdb35e08d8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc087c657-8e", "ovs_interfaceid": "c087c657-8eee-4e8e-bef1-4281129597ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 09:56:59 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-e9531933-c1fc-4c34-84a8-22f450e70c0a tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Converting VIF {"id": "c087c657-8eee-4e8e-bef1-4281129597ae", "address": "fa:16:3e:aa:d3:e3", "network": {"id": "6a700b61-4aa6-440b-87e6-a3525a5cb918", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-448680331-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8babb73006da4977a1fe2bdb35e08d8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc087c657-8e", "ovs_interfaceid": "c087c657-8eee-4e8e-bef1-4281129597ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 09:56:59 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-e9531933-c1fc-4c34-84a8-22f450e70c0a tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:aa:d3:e3,bridge_name='br-int',has_traffic_filtering=True,id=c087c657-8eee-4e8e-bef1-4281129597ae,network=Network(6a700b61-4aa6-440b-87e6-a3525a5cb918),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc087c657-8e') {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 09:56:59 user nova-compute[75229]: DEBUG os_vif [None req-e9531933-c1fc-4c34-84a8-22f450e70c0a tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:aa:d3:e3,bridge_name='br-int',has_traffic_filtering=True,id=c087c657-8eee-4e8e-bef1-4281129597ae,network=Network(6a700b61-4aa6-440b-87e6-a3525a5cb918),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc087c657-8e') {{(pid=75229) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 09:56:59 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:56:59 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:56:59 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 09:56:59 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:56:59 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'bc03739a-0ef2-5e06-97ec-7545c9e87696', '_type': 'linux-noop'}}, row=False) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:56:59 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 09:56:59 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:56:59 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc087c657-8e, may_exist=True, interface_attrs={}) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:56:59 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc087c657-8e, col_values=(('qos', UUID('c9438e81-d498-44d5-84dc-8131e8bdc019')),), if_exists=True) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:56:59 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc087c657-8e, col_values=(('external_ids', {'iface-id': 'c087c657-8eee-4e8e-bef1-4281129597ae', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:aa:d3:e3', 'vm-uuid': '30ae1f73-e0f3-4e26-987e-a684471a160d'}),), if_exists=True) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:56:59 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:56:59 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 09:56:59 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:56:59 user nova-compute[75229]: INFO os_vif [None req-e9531933-c1fc-4c34-84a8-22f450e70c0a tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:aa:d3:e3,bridge_name='br-int',has_traffic_filtering=True,id=c087c657-8eee-4e8e-bef1-4281129597ae,network=Network(6a700b61-4aa6-440b-87e6-a3525a5cb918),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc087c657-8e')
Nov 14 09:56:59 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 09:56:59 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 09:56:59 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 09:56:59 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 09:56:59 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 09:56:59 user nova-compute[75229]: DEBUG nova.compute.manager [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75229) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 09:56:59 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-e9531933-c1fc-4c34-84a8-22f450e70c0a tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] No BDM found with device name vda, not building metadata. {{(pid=75229) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 09:56:59 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-e9531933-c1fc-4c34-84a8-22f450e70c0a tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] No VIF found with MAC fa:16:3e:aa:d3:e3, not building metadata {{(pid=75229) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 09:57:01 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:57:01 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:57:01 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:57:01 user nova-compute[75229]: DEBUG nova.compute.manager [req-414a3209-9be9-4c24-9664-b60967621a1f req-4c83eaf2-1b13-4570-b710-59ea7f2fdc73 service nova] [instance: 30ae1f73-e0f3-4e26-987e-a684471a160d] Received event network-vif-plugged-c087c657-8eee-4e8e-bef1-4281129597ae {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:57:01 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-414a3209-9be9-4c24-9664-b60967621a1f req-4c83eaf2-1b13-4570-b710-59ea7f2fdc73 service nova] Acquiring lock "30ae1f73-e0f3-4e26-987e-a684471a160d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:57:01 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-414a3209-9be9-4c24-9664-b60967621a1f req-4c83eaf2-1b13-4570-b710-59ea7f2fdc73 service nova] Lock "30ae1f73-e0f3-4e26-987e-a684471a160d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:57:01 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-414a3209-9be9-4c24-9664-b60967621a1f req-4c83eaf2-1b13-4570-b710-59ea7f2fdc73 service nova] Lock "30ae1f73-e0f3-4e26-987e-a684471a160d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:57:01 user nova-compute[75229]: DEBUG nova.compute.manager [req-414a3209-9be9-4c24-9664-b60967621a1f req-4c83eaf2-1b13-4570-b710-59ea7f2fdc73 service nova] [instance: 30ae1f73-e0f3-4e26-987e-a684471a160d] No waiting events found dispatching network-vif-plugged-c087c657-8eee-4e8e-bef1-4281129597ae {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 09:57:01 user nova-compute[75229]: WARNING nova.compute.manager [req-414a3209-9be9-4c24-9664-b60967621a1f req-4c83eaf2-1b13-4570-b710-59ea7f2fdc73 service nova] [instance: 30ae1f73-e0f3-4e26-987e-a684471a160d] Received unexpected event network-vif-plugged-c087c657-8eee-4e8e-bef1-4281129597ae for instance with vm_state building and task_state spawning.
Nov 14 09:57:01 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:57:01 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:57:03 user nova-compute[75229]: DEBUG nova.compute.manager [None req-e9531933-c1fc-4c34-84a8-22f450e70c0a tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] [instance: 30ae1f73-e0f3-4e26-987e-a684471a160d] Instance event wait completed in 0 seconds for  {{(pid=75229) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 09:57:03 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-e9531933-c1fc-4c34-84a8-22f450e70c0a tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] [instance: 30ae1f73-e0f3-4e26-987e-a684471a160d] Guest created on hypervisor {{(pid=75229) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 09:57:03 user nova-compute[75229]: INFO nova.virt.libvirt.driver [-] [instance: 30ae1f73-e0f3-4e26-987e-a684471a160d] Instance spawned successfully.
Nov 14 09:57:03 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-e9531933-c1fc-4c34-84a8-22f450e70c0a tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] [instance: 30ae1f73-e0f3-4e26-987e-a684471a160d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 09:57:03 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-e9531933-c1fc-4c34-84a8-22f450e70c0a tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] [instance: 30ae1f73-e0f3-4e26-987e-a684471a160d] Found default for hw_cdrom_bus of ide {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 09:57:03 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-e9531933-c1fc-4c34-84a8-22f450e70c0a tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] [instance: 30ae1f73-e0f3-4e26-987e-a684471a160d] Found default for hw_disk_bus of virtio {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 09:57:03 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-e9531933-c1fc-4c34-84a8-22f450e70c0a tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] [instance: 30ae1f73-e0f3-4e26-987e-a684471a160d] Found default for hw_input_bus of None {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 09:57:03 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-e9531933-c1fc-4c34-84a8-22f450e70c0a tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] [instance: 30ae1f73-e0f3-4e26-987e-a684471a160d] Found default for hw_pointer_model of None {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 09:57:03 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-e9531933-c1fc-4c34-84a8-22f450e70c0a tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] [instance: 30ae1f73-e0f3-4e26-987e-a684471a160d] Found default for hw_video_model of virtio {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 09:57:03 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-e9531933-c1fc-4c34-84a8-22f450e70c0a tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] [instance: 30ae1f73-e0f3-4e26-987e-a684471a160d] Found default for hw_vif_model of virtio {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 09:57:03 user nova-compute[75229]: DEBUG nova.compute.manager [req-1b695150-cd69-4495-93c0-cded5729c305 req-c9f83a93-40f9-42e9-a660-928f874619e3 service nova] [instance: 30ae1f73-e0f3-4e26-987e-a684471a160d] Received event network-vif-plugged-c087c657-8eee-4e8e-bef1-4281129597ae {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:57:03 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-1b695150-cd69-4495-93c0-cded5729c305 req-c9f83a93-40f9-42e9-a660-928f874619e3 service nova] Acquiring lock "30ae1f73-e0f3-4e26-987e-a684471a160d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:57:03 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-1b695150-cd69-4495-93c0-cded5729c305 req-c9f83a93-40f9-42e9-a660-928f874619e3 service nova] Lock "30ae1f73-e0f3-4e26-987e-a684471a160d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:57:03 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-1b695150-cd69-4495-93c0-cded5729c305 req-c9f83a93-40f9-42e9-a660-928f874619e3 service nova] Lock "30ae1f73-e0f3-4e26-987e-a684471a160d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:57:03 user nova-compute[75229]: DEBUG nova.compute.manager [req-1b695150-cd69-4495-93c0-cded5729c305 req-c9f83a93-40f9-42e9-a660-928f874619e3 service nova] [instance: 30ae1f73-e0f3-4e26-987e-a684471a160d] No waiting events found dispatching network-vif-plugged-c087c657-8eee-4e8e-bef1-4281129597ae {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 09:57:03 user nova-compute[75229]: WARNING nova.compute.manager [req-1b695150-cd69-4495-93c0-cded5729c305 req-c9f83a93-40f9-42e9-a660-928f874619e3 service nova] [instance: 30ae1f73-e0f3-4e26-987e-a684471a160d] Received unexpected event network-vif-plugged-c087c657-8eee-4e8e-bef1-4281129597ae for instance with vm_state building and task_state spawning.
Nov 14 09:57:03 user nova-compute[75229]: INFO nova.compute.manager [None req-e9531933-c1fc-4c34-84a8-22f450e70c0a tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] [instance: 30ae1f73-e0f3-4e26-987e-a684471a160d] Took 5.06 seconds to spawn the instance on the hypervisor.
Nov 14 09:57:03 user nova-compute[75229]: DEBUG nova.compute.manager [None req-e9531933-c1fc-4c34-84a8-22f450e70c0a tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] [instance: 30ae1f73-e0f3-4e26-987e-a684471a160d] Checking state {{(pid=75229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 09:57:03 user nova-compute[75229]: INFO nova.compute.manager [None req-e9531933-c1fc-4c34-84a8-22f450e70c0a tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] [instance: 30ae1f73-e0f3-4e26-987e-a684471a160d] Took 15.84 seconds to build instance.
Nov 14 09:57:03 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-e9531933-c1fc-4c34-84a8-22f450e70c0a tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Lock "30ae1f73-e0f3-4e26-987e-a684471a160d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.934s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:57:03 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:57:04 user nova-compute[75229]: WARNING nova.virt.libvirt.driver [None req-ba99d65e-be25-4094-ae60-3f4a8c9b8af9 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 57da589c-863c-42a8-8802-314a499ebc29 is timed out.
Nov 14 09:57:04 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-ba99d65e-be25-4094-ae60-3f4a8c9b8af9 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Successfully detached device vdb from instance 57da589c-863c-42a8-8802-314a499ebc29 from the live domain config.
Nov 14 09:57:04 user nova-compute[75229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ba99d65e-be25-4094-ae60-3f4a8c9b8af9 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] [instance: 57da589c-863c-42a8-8802-314a499ebc29] calling os-brick to detach iSCSI Volume {{(pid=75229) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 09:57:04 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba99d65e-be25-4094-ae60-3f4a8c9b8af9 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f73f85151b0>, {'target_iqn': 'iqn.2010-10.org.openstack:3d22e1af-30f1-4688-bfda-e6dd2c5bee99', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZMNDHpgr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 09:57:04 user nova-compute[75229]: WARNING os_brick.initiator.connectors.base [None req-ba99d65e-be25-4094-ae60-3f4a8c9b8af9 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 09:57:04 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-ba99d65e-be25-4094-ae60-3f4a8c9b8af9 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 09:57:04 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-ba99d65e-be25-4094-ae60-3f4a8c9b8af9 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 09:57:04 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:57:04 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:57:04 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1d13c32-0cf3-4775-964e-91741be4fed1]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a5efb0e0-a85c-46ec-8a9d-2763bf548023\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3d22e1af-30f1-4688-bfda-e6dd2c5bee99\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5aebc438-0289-44fe-ad84-4e696468f50e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:57:04 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba99d65e-be25-4094-ae60-3f4a8c9b8af9 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 09:57:04 user nova-compute[75229]: No targets found.
Nov 14 09:57:04 user nova-compute[75229]: iSNS:
Nov 14 09:57:04 user nova-compute[75229]: No targets found.
Nov 14 09:57:04 user nova-compute[75229]: STATIC:
Nov 14 09:57:04 user nova-compute[75229]: Target: iqn.2010-10.org.openstack:a5efb0e0-a85c-46ec-8a9d-2763bf548023
Nov 14 09:57:04 user nova-compute[75229]:         Portal: 172.16.0.220:3260,-1
Nov 14 09:57:04 user nova-compute[75229]:                 Iface Name: default
Nov 14 09:57:04 user nova-compute[75229]: Target: iqn.2010-10.org.openstack:3d22e1af-30f1-4688-bfda-e6dd2c5bee99
Nov 14 09:57:04 user nova-compute[75229]:         Portal: 172.16.0.220:3260,-1
Nov 14 09:57:04 user nova-compute[75229]:                 Iface Name: default
Nov 14 09:57:04 user nova-compute[75229]: Target: iqn.2010-10.org.openstack:5aebc438-0289-44fe-ad84-4e696468f50e
Nov 14 09:57:04 user nova-compute[75229]:         Portal: 172.16.0.220:3260,-1
Nov 14 09:57:04 user nova-compute[75229]:                 Iface Name: default
Nov 14 09:57:04 user nova-compute[75229]: FIRMWARE:
Nov 14 09:57:04 user nova-compute[75229]: No targets found.
Nov 14 09:57:04 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 09:57:04 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba99d65e-be25-4094-ae60-3f4a8c9b8af9 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 09:57:04 user nova-compute[75229]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 09:57:04 user nova-compute[75229]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75229) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 09:57:04 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba99d65e-be25-4094-ae60-3f4a8c9b8af9 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3d22e1af-30f1-4688-bfda-e6dd2c5bee99', 0)] {{(pid=75229) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 09:57:04 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:57:04 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:57:04 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e6a34c4-fc1a-4fc2-897a-6702d17c13ac]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3d22e1af-30f1-4688-bfda-e6dd2c5bee99\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5aebc438-0289-44fe-ad84-4e696468f50e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a5efb0e0-a85c-46ec-8a9d-2763bf548023\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:57:04 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:57:04 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:57:04 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[e33bf023-9fb9-45b8-a686-af8c84a64844]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5efb0e0-a85c-46ec-8a9d-2763bf548023 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d22e1af-30f1-4688-bfda-e6dd2c5bee99 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aebc438-0289-44fe-ad84-4e696468f50e (non-flash)\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:57:04 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba99d65e-be25-4094-ae60-3f4a8c9b8af9 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5efb0e0-a85c-46ec-8a9d-2763bf548023 (non-flash)
Nov 14 09:57:04 user nova-compute[75229]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d22e1af-30f1-4688-bfda-e6dd2c5bee99 (non-flash)
Nov 14 09:57:04 user nova-compute[75229]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aebc438-0289-44fe-ad84-4e696468f50e (non-flash)
Nov 14 09:57:04 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 09:57:04 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba99d65e-be25-4094-ae60-3f4a8c9b8af9 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5efb0e0-a85c-46ec-8a9d-2763bf548023 (non-flash)
Nov 14 09:57:04 user nova-compute[75229]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d22e1af-30f1-4688-bfda-e6dd2c5bee99 (non-flash)
Nov 14 09:57:04 user nova-compute[75229]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aebc438-0289-44fe-ad84-4e696468f50e (non-flash)
Nov 14 09:57:04 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 09:57:04 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba99d65e-be25-4094-ae60-3f4a8c9b8af9 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f73d4f5c4c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3d22e1af-30f1-4688-bfda-e6dd2c5bee99'): ({'sdd'}, set())}) {{(pid=75229) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 09:57:04 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-ba99d65e-be25-4094-ae60-3f4a8c9b8af9 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Removing single pathed devices sdd {{(pid=75229) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 09:57:04 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:57:04 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:57:04 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[75790217-df64-4560-962f-fc09a404477b]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:57:04 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:57:04 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.025s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:57:04 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[a34775f7-977c-49e8-8272-dc86b7025247]: (4, ('ok\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:57:04 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-ba99d65e-be25-4094-ae60-3f4a8c9b8af9 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Flushing IO for device /dev/sdd {{(pid=75229) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 09:57:04 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:57:04 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:57:04 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[320b81b5-85cb-414a-9920-39987ab238ac]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:57:04 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-ba99d65e-be25-4094-ae60-3f4a8c9b8af9 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75229) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 09:57:04 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:57:04 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.045s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:57:04 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[61b6af95-6cd8-4178-864a-fbabffbdc218]: (4, ('1', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:57:04 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-ba99d65e-be25-4094-ae60-3f4a8c9b8af9 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75229) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 09:57:04 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-ba99d65e-be25-4094-ae60-3f4a8c9b8af9 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] SCSI volumes sdd have been removed. {{(pid=75229) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 09:57:04 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba99d65e-be25-4094-ae60-3f4a8c9b8af9 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3d22e1af-30f1-4688-bfda-e6dd2c5bee99')] {{(pid=75229) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 09:57:04 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d22e1af-30f1-4688-bfda-e6dd2c5bee99 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:57:04 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d22e1af-30f1-4688-bfda-e6dd2c5bee99 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:57:04 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[220f2cc9-0043-46dc-a8ad-abf7b928aae4]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:57:04 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba99d65e-be25-4094-ae60-3f4a8c9b8af9 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:57:04 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d22e1af-30f1-4688-bfda-e6dd2c5bee99 -p 172.16.0.220:3260 --logout {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:57:04 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d22e1af-30f1-4688-bfda-e6dd2c5bee99 -p 172.16.0.220:3260 --logout" returned: 0 in 0.047s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:57:04 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[28ad680b-bb19-44c2-985b-3277bc64c386]: (4, ('Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:3d22e1af-30f1-4688-bfda-e6dd2c5bee99, portal: 172.16.0.220,3260]\nLogout of [sid: 33, target: iqn.2010-10.org.openstack:3d22e1af-30f1-4688-bfda-e6dd2c5bee99, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:57:04 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba99d65e-be25-4094-ae60-3f4a8c9b8af9 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:3d22e1af-30f1-4688-bfda-e6dd2c5bee99, portal: 172.16.0.220,3260]
Nov 14 09:57:04 user nova-compute[75229]: Logout of [sid: 33, target: iqn.2010-10.org.openstack:3d22e1af-30f1-4688-bfda-e6dd2c5bee99, portal: 172.16.0.220,3260] successful.
Nov 14 09:57:04 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:57:04 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d22e1af-30f1-4688-bfda-e6dd2c5bee99 -p 172.16.0.220:3260 --op delete {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:57:04 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d22e1af-30f1-4688-bfda-e6dd2c5bee99 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:57:04 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[558f1dca-adc8-4020-8616-31a8065dc73e]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:57:04 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba99d65e-be25-4094-ae60-3f4a8c9b8af9 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:57:04 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-ba99d65e-be25-4094-ae60-3f4a8c9b8af9 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.299s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 09:57:04 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba99d65e-be25-4094-ae60-3f4a8c9b8af9 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] <== disconnect_volume: return (300ms) None {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 09:57:04 user nova-compute[75229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ba99d65e-be25-4094-ae60-3f4a8c9b8af9 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] [instance: 57da589c-863c-42a8-8802-314a499ebc29] Disconnected iSCSI Volume {{(pid=75229) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 09:57:04 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:57:05 user nova-compute[75229]: DEBUG nova.objects.instance [None req-ba99d65e-be25-4094-ae60-3f4a8c9b8af9 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Lazy-loading 'flavor' on Instance uuid 57da589c-863c-42a8-8802-314a499ebc29 {{(pid=75229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 09:57:05 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-ba99d65e-be25-4094-ae60-3f4a8c9b8af9 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Lock "57da589c-863c-42a8-8802-314a499ebc29" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.641s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:57:09 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 09:57:13 user nova-compute[75229]: DEBUG nova.compute.manager [req-c140aa26-b7e4-490b-8a23-c4b2b4c60ef8 req-9c1ca002-77a7-46f2-92c3-af6f84e00fdb service nova] [instance: a7750cbc-b3d0-44aa-8b88-c291ba007a8a] Received event network-changed-e5b20e94-618c-4c51-b20f-1d3f1fb921b6 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:57:13 user nova-compute[75229]: DEBUG nova.compute.manager [req-c140aa26-b7e4-490b-8a23-c4b2b4c60ef8 req-9c1ca002-77a7-46f2-92c3-af6f84e00fdb service nova] [instance: a7750cbc-b3d0-44aa-8b88-c291ba007a8a] Refreshing instance network info cache due to event network-changed-e5b20e94-618c-4c51-b20f-1d3f1fb921b6. {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 09:57:13 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-c140aa26-b7e4-490b-8a23-c4b2b4c60ef8 req-9c1ca002-77a7-46f2-92c3-af6f84e00fdb service nova] Acquiring lock "refresh_cache-a7750cbc-b3d0-44aa-8b88-c291ba007a8a" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 09:57:13 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-c140aa26-b7e4-490b-8a23-c4b2b4c60ef8 req-9c1ca002-77a7-46f2-92c3-af6f84e00fdb service nova] Acquired lock "refresh_cache-a7750cbc-b3d0-44aa-8b88-c291ba007a8a" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 09:57:13 user nova-compute[75229]: DEBUG nova.network.neutron [req-c140aa26-b7e4-490b-8a23-c4b2b4c60ef8 req-9c1ca002-77a7-46f2-92c3-af6f84e00fdb service nova] [instance: a7750cbc-b3d0-44aa-8b88-c291ba007a8a] Refreshing network info cache for port e5b20e94-618c-4c51-b20f-1d3f1fb921b6 {{(pid=75229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 09:57:13 user nova-compute[75229]: DEBUG nova.network.neutron [req-c140aa26-b7e4-490b-8a23-c4b2b4c60ef8 req-9c1ca002-77a7-46f2-92c3-af6f84e00fdb service nova] [instance: a7750cbc-b3d0-44aa-8b88-c291ba007a8a] Updated VIF entry in instance network info cache for port e5b20e94-618c-4c51-b20f-1d3f1fb921b6. {{(pid=75229) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 09:57:13 user nova-compute[75229]: DEBUG nova.network.neutron [req-c140aa26-b7e4-490b-8a23-c4b2b4c60ef8 req-9c1ca002-77a7-46f2-92c3-af6f84e00fdb service nova] [instance: a7750cbc-b3d0-44aa-8b88-c291ba007a8a] Updating instance_info_cache with network_info: [{"id": "e5b20e94-618c-4c51-b20f-1d3f1fb921b6", "address": "fa:16:3e:e5:e8:ed", "network": {"id": "5dfc532f-3d5d-4342-b7f1-12c9c3992a54", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1457278473-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46e65cdd021f4a3db7c9254bb6d98b46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5b20e94-61", "ovs_interfaceid": "e5b20e94-618c-4c51-b20f-1d3f1fb921b6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 09:57:13 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-c140aa26-b7e4-490b-8a23-c4b2b4c60ef8 req-9c1ca002-77a7-46f2-92c3-af6f84e00fdb service nova] Releasing lock "refresh_cache-a7750cbc-b3d0-44aa-8b88-c291ba007a8a" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 09:57:14 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 09:57:14 user nova-compute[75229]: DEBUG nova.compute.manager [None req-c0ce5a41-ee4e-4f8b-b50b-3e72f0e879b8 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] [instance: 589f4750-fac6-4e99-a430-0cda339808bc] Stashing vm_state: active {{(pid=75229) _prep_resize /opt/stack/nova/nova/compute/manager.py:5615}}
Nov 14 09:57:15 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-c0ce5a41-ee4e-4f8b-b50b-3e72f0e879b8 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:57:15 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-c0ce5a41-ee4e-4f8b-b50b-3e72f0e879b8 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:57:15 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-c0ce5a41-ee4e-4f8b-b50b-3e72f0e879b8 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75229) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 09:57:15 user nova-compute[75229]: INFO nova.compute.claims [None req-c0ce5a41-ee4e-4f8b-b50b-3e72f0e879b8 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] [instance: 589f4750-fac6-4e99-a430-0cda339808bc] Claim successful on node user
Nov 14 09:57:15 user nova-compute[75229]: INFO nova.compute.resource_tracker [None req-c0ce5a41-ee4e-4f8b-b50b-3e72f0e879b8 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] [instance: 589f4750-fac6-4e99-a430-0cda339808bc] Updating resource usage from migration efd6ebd1-d0fd-452d-8e9c-ca6c337c47a8
Nov 14 09:57:15 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:57:15 user nova-compute[75229]: DEBUG nova.compute.manager [req-dc5c380d-a643-4f79-8ed7-a256ab0d5985 req-cbdf18c4-b6c2-4f4d-af6d-f793b8cd8dd9 service nova] [instance: 589f4750-fac6-4e99-a430-0cda339808bc] Received event network-changed-e10815ba-0472-4ed0-af80-b4d0904580af {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:57:15 user nova-compute[75229]: DEBUG nova.compute.manager [req-dc5c380d-a643-4f79-8ed7-a256ab0d5985 req-cbdf18c4-b6c2-4f4d-af6d-f793b8cd8dd9 service nova] [instance: 589f4750-fac6-4e99-a430-0cda339808bc] Refreshing instance network info cache due to event network-changed-e10815ba-0472-4ed0-af80-b4d0904580af. {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 09:57:15 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-dc5c380d-a643-4f79-8ed7-a256ab0d5985 req-cbdf18c4-b6c2-4f4d-af6d-f793b8cd8dd9 service nova] Acquiring lock "refresh_cache-589f4750-fac6-4e99-a430-0cda339808bc" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 09:57:15 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-dc5c380d-a643-4f79-8ed7-a256ab0d5985 req-cbdf18c4-b6c2-4f4d-af6d-f793b8cd8dd9 service nova] Acquired lock "refresh_cache-589f4750-fac6-4e99-a430-0cda339808bc" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 09:57:15 user nova-compute[75229]: DEBUG nova.network.neutron [req-dc5c380d-a643-4f79-8ed7-a256ab0d5985 req-cbdf18c4-b6c2-4f4d-af6d-f793b8cd8dd9 service nova] [instance: 589f4750-fac6-4e99-a430-0cda339808bc] Refreshing network info cache for port e10815ba-0472-4ed0-af80-b4d0904580af {{(pid=75229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 09:57:15 user nova-compute[75229]: DEBUG nova.compute.provider_tree [None req-c0ce5a41-ee4e-4f8b-b50b-3e72f0e879b8 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Inventory has not changed in ProviderTree for provider: d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 {{(pid=75229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 09:57:15 user nova-compute[75229]: DEBUG nova.scheduler.client.report [None req-c0ce5a41-ee4e-4f8b-b50b-3e72f0e879b8 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Inventory has not changed for provider d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 09:57:15 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-c0ce5a41-ee4e-4f8b-b50b-3e72f0e879b8 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.473s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:57:15 user nova-compute[75229]: INFO nova.compute.manager [None req-c0ce5a41-ee4e-4f8b-b50b-3e72f0e879b8 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] [instance: 589f4750-fac6-4e99-a430-0cda339808bc] Migrating
Nov 14 09:57:15 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-c0ce5a41-ee4e-4f8b-b50b-3e72f0e879b8 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Acquiring lock "refresh_cache-589f4750-fac6-4e99-a430-0cda339808bc" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 09:57:15 user nova-compute[75229]: DEBUG nova.network.neutron [req-dc5c380d-a643-4f79-8ed7-a256ab0d5985 req-cbdf18c4-b6c2-4f4d-af6d-f793b8cd8dd9 service nova] [instance: 589f4750-fac6-4e99-a430-0cda339808bc] Updated VIF entry in instance network info cache for port e10815ba-0472-4ed0-af80-b4d0904580af. {{(pid=75229) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 09:57:15 user nova-compute[75229]: DEBUG nova.network.neutron [req-dc5c380d-a643-4f79-8ed7-a256ab0d5985 req-cbdf18c4-b6c2-4f4d-af6d-f793b8cd8dd9 service nova] [instance: 589f4750-fac6-4e99-a430-0cda339808bc] Updating instance_info_cache with network_info: [{"id": "e10815ba-0472-4ed0-af80-b4d0904580af", "address": "fa:16:3e:aa:81:3e", "network": {"id": "5dfc532f-3d5d-4342-b7f1-12c9c3992a54", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1457278473-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.147", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46e65cdd021f4a3db7c9254bb6d98b46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape10815ba-04", "ovs_interfaceid": "e10815ba-0472-4ed0-af80-b4d0904580af", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 09:57:15 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-dc5c380d-a643-4f79-8ed7-a256ab0d5985 req-cbdf18c4-b6c2-4f4d-af6d-f793b8cd8dd9 service nova] Releasing lock "refresh_cache-589f4750-fac6-4e99-a430-0cda339808bc" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 09:57:15 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-c0ce5a41-ee4e-4f8b-b50b-3e72f0e879b8 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Acquired lock "refresh_cache-589f4750-fac6-4e99-a430-0cda339808bc" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 09:57:15 user nova-compute[75229]: DEBUG nova.network.neutron [None req-c0ce5a41-ee4e-4f8b-b50b-3e72f0e879b8 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] [instance: 589f4750-fac6-4e99-a430-0cda339808bc] Building network info cache for instance {{(pid=75229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 09:57:16 user nova-compute[75229]: DEBUG nova.network.neutron [None req-c0ce5a41-ee4e-4f8b-b50b-3e72f0e879b8 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] [instance: 589f4750-fac6-4e99-a430-0cda339808bc] Updating instance_info_cache with network_info: [{"id": "e10815ba-0472-4ed0-af80-b4d0904580af", "address": "fa:16:3e:aa:81:3e", "network": {"id": "5dfc532f-3d5d-4342-b7f1-12c9c3992a54", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1457278473-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.147", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46e65cdd021f4a3db7c9254bb6d98b46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape10815ba-04", "ovs_interfaceid": "e10815ba-0472-4ed0-af80-b4d0904580af", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 09:57:16 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-c0ce5a41-ee4e-4f8b-b50b-3e72f0e879b8 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Releasing lock "refresh_cache-589f4750-fac6-4e99-a430-0cda339808bc" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 09:57:16 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-c0ce5a41-ee4e-4f8b-b50b-3e72f0e879b8 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] [instance: 589f4750-fac6-4e99-a430-0cda339808bc] Starting migrate_disk_and_power_off {{(pid=75229) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Nov 14 09:57:16 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:57:16 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:57:16 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:57:16 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:57:17 user nova-compute[75229]: INFO nova.virt.libvirt.driver [-] [instance: 589f4750-fac6-4e99-a430-0cda339808bc] Instance destroyed successfully.
Nov 14 09:57:17 user nova-compute[75229]: DEBUG nova.virt.libvirt.vif [None req-c0ce5a41-ee4e-4f8b-b50b-3e72f0e879b8 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T09:55:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-724442357',display_name='tempest-ServerActionsTestOtherA-server-724442357',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-724442357',id=32,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGYpQZFb1U6nMdMA0U7Y/y+mR6NDiU0zUt1gWS7fx0RnGUEMiKL0fCtTR70lVN1zodlPi6pkSulrGMUx3iNoziRzj8cN92z29zHcNE44hvJVgwbBcM00kPn071ndMRlk4g==',key_name='tempest-keypair-397181797',keypairs=<?>,launch_index=0,launched_at=2023-11-14T09:55:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='46e65cdd021f4a3db7c9254bb6d98b46',ramdisk_id='',reservation_id='r-lre1lh5y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-280196295',owner_user_name='tempest-ServerActionsTestOtherA-280196295-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T09:57:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c0c381a0f6124f1ca6ce85c057b9143a',uuid=589f4750-fac6-4e99-a430-0cda339808bc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e10815ba-0472-4ed0-af80-b4d0904580af", "address": "fa:16:3e:aa:81:3e", "network": {"id": "5dfc532f-3d5d-4342-b7f1-12c9c3992a54", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1457278473-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.147", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1457278473-network", "vif_mac": "fa:16:3e:aa:81:3e"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46e65cdd021f4a3db7c9254bb6d98b46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape10815ba-04", "ovs_interfaceid": "e10815ba-0472-4ed0-af80-b4d0904580af", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 09:57:17 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-c0ce5a41-ee4e-4f8b-b50b-3e72f0e879b8 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Converting VIF {"id": "e10815ba-0472-4ed0-af80-b4d0904580af", "address": "fa:16:3e:aa:81:3e", "network": {"id": "5dfc532f-3d5d-4342-b7f1-12c9c3992a54", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1457278473-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.147", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1457278473-network", "vif_mac": "fa:16:3e:aa:81:3e"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46e65cdd021f4a3db7c9254bb6d98b46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape10815ba-04", "ovs_interfaceid": "e10815ba-0472-4ed0-af80-b4d0904580af", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 09:57:17 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-c0ce5a41-ee4e-4f8b-b50b-3e72f0e879b8 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:aa:81:3e,bridge_name='br-int',has_traffic_filtering=True,id=e10815ba-0472-4ed0-af80-b4d0904580af,network=Network(5dfc532f-3d5d-4342-b7f1-12c9c3992a54),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape10815ba-04') {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 09:57:17 user nova-compute[75229]: DEBUG os_vif [None req-c0ce5a41-ee4e-4f8b-b50b-3e72f0e879b8 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:aa:81:3e,bridge_name='br-int',has_traffic_filtering=True,id=e10815ba-0472-4ed0-af80-b4d0904580af,network=Network(5dfc532f-3d5d-4342-b7f1-12c9c3992a54),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape10815ba-04') {{(pid=75229) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 09:57:17 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:57:17 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape10815ba-04, bridge=br-int, if_exists=True) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:57:17 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:57:17 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:57:17 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:57:17 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a55db273-f14e-4ce7-af16-13c53178b7e0) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:57:17 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:57:17 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 09:57:17 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:57:17 user nova-compute[75229]: INFO os_vif [None req-c0ce5a41-ee4e-4f8b-b50b-3e72f0e879b8 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:aa:81:3e,bridge_name='br-int',has_traffic_filtering=True,id=e10815ba-0472-4ed0-af80-b4d0904580af,network=Network(5dfc532f-3d5d-4342-b7f1-12c9c3992a54),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape10815ba-04')
Nov 14 09:57:17 user nova-compute[75229]: DEBUG nova.compute.manager [req-6e2acf42-ec46-407d-97ed-99b31bfc474d req-2cd7e6a2-a1ff-49ae-96f0-c9c2a479bfa7 service nova] [instance: 589f4750-fac6-4e99-a430-0cda339808bc] Received event network-vif-unplugged-e10815ba-0472-4ed0-af80-b4d0904580af {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:57:17 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-6e2acf42-ec46-407d-97ed-99b31bfc474d req-2cd7e6a2-a1ff-49ae-96f0-c9c2a479bfa7 service nova] Acquiring lock "589f4750-fac6-4e99-a430-0cda339808bc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:57:17 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-6e2acf42-ec46-407d-97ed-99b31bfc474d req-2cd7e6a2-a1ff-49ae-96f0-c9c2a479bfa7 service nova] Lock "589f4750-fac6-4e99-a430-0cda339808bc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:57:17 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-6e2acf42-ec46-407d-97ed-99b31bfc474d req-2cd7e6a2-a1ff-49ae-96f0-c9c2a479bfa7 service nova] Lock "589f4750-fac6-4e99-a430-0cda339808bc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:57:17 user nova-compute[75229]: DEBUG nova.compute.manager [req-6e2acf42-ec46-407d-97ed-99b31bfc474d req-2cd7e6a2-a1ff-49ae-96f0-c9c2a479bfa7 service nova] [instance: 589f4750-fac6-4e99-a430-0cda339808bc] No waiting events found dispatching network-vif-unplugged-e10815ba-0472-4ed0-af80-b4d0904580af {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 09:57:17 user nova-compute[75229]: WARNING nova.compute.manager [req-6e2acf42-ec46-407d-97ed-99b31bfc474d req-2cd7e6a2-a1ff-49ae-96f0-c9c2a479bfa7 service nova] [instance: 589f4750-fac6-4e99-a430-0cda339808bc] Received unexpected event network-vif-unplugged-e10815ba-0472-4ed0-af80-b4d0904580af for instance with vm_state active and task_state resize_migrating.
Nov 14 09:57:17 user nova-compute[75229]: DEBUG nova.compute.manager [req-6e2acf42-ec46-407d-97ed-99b31bfc474d req-2cd7e6a2-a1ff-49ae-96f0-c9c2a479bfa7 service nova] [instance: 589f4750-fac6-4e99-a430-0cda339808bc] Received event network-vif-plugged-e10815ba-0472-4ed0-af80-b4d0904580af {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:57:17 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-6e2acf42-ec46-407d-97ed-99b31bfc474d req-2cd7e6a2-a1ff-49ae-96f0-c9c2a479bfa7 service nova] Acquiring lock "589f4750-fac6-4e99-a430-0cda339808bc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:57:17 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-6e2acf42-ec46-407d-97ed-99b31bfc474d req-2cd7e6a2-a1ff-49ae-96f0-c9c2a479bfa7 service nova] Lock "589f4750-fac6-4e99-a430-0cda339808bc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:57:17 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-6e2acf42-ec46-407d-97ed-99b31bfc474d req-2cd7e6a2-a1ff-49ae-96f0-c9c2a479bfa7 service nova] Lock "589f4750-fac6-4e99-a430-0cda339808bc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:57:17 user nova-compute[75229]: DEBUG nova.compute.manager [req-6e2acf42-ec46-407d-97ed-99b31bfc474d req-2cd7e6a2-a1ff-49ae-96f0-c9c2a479bfa7 service nova] [instance: 589f4750-fac6-4e99-a430-0cda339808bc] No waiting events found dispatching network-vif-plugged-e10815ba-0472-4ed0-af80-b4d0904580af {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 09:57:17 user nova-compute[75229]: WARNING nova.compute.manager [req-6e2acf42-ec46-407d-97ed-99b31bfc474d req-2cd7e6a2-a1ff-49ae-96f0-c9c2a479bfa7 service nova] [instance: 589f4750-fac6-4e99-a430-0cda339808bc] Received unexpected event network-vif-plugged-e10815ba-0472-4ed0-af80-b4d0904580af for instance with vm_state active and task_state resize_migrating.
Nov 14 09:57:17 user nova-compute[75229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c0ce5a41-ee4e-4f8b-b50b-3e72f0e879b8 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] [instance: 589f4750-fac6-4e99-a430-0cda339808bc] calling os-brick to detach iSCSI Volume {{(pid=75229) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 09:57:17 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0ce5a41-ee4e-4f8b-b50b-3e72f0e879b8 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f73f85151b0>, {'target_iqn': 'iqn.2010-10.org.openstack:a5efb0e0-a85c-46ec-8a9d-2763bf548023', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MNpaKqUc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 09:57:17 user nova-compute[75229]: WARNING os_brick.initiator.connectors.base [None req-c0ce5a41-ee4e-4f8b-b50b-3e72f0e879b8 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 09:57:17 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-c0ce5a41-ee4e-4f8b-b50b-3e72f0e879b8 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 09:57:17 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-c0ce5a41-ee4e-4f8b-b50b-3e72f0e879b8 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 09:57:17 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:57:17 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:57:17 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c163dc4-3f31-456e-aa4a-fd0cf9cd6b9e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a5efb0e0-a85c-46ec-8a9d-2763bf548023\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5aebc438-0289-44fe-ad84-4e696468f50e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:57:17 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0ce5a41-ee4e-4f8b-b50b-3e72f0e879b8 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 09:57:17 user nova-compute[75229]: No targets found.
Nov 14 09:57:17 user nova-compute[75229]: iSNS:
Nov 14 09:57:17 user nova-compute[75229]: No targets found.
Nov 14 09:57:17 user nova-compute[75229]: STATIC:
Nov 14 09:57:17 user nova-compute[75229]: Target: iqn.2010-10.org.openstack:a5efb0e0-a85c-46ec-8a9d-2763bf548023
Nov 14 09:57:17 user nova-compute[75229]:         Portal: 172.16.0.220:3260,-1
Nov 14 09:57:17 user nova-compute[75229]:                 Iface Name: default
Nov 14 09:57:17 user nova-compute[75229]: Target: iqn.2010-10.org.openstack:5aebc438-0289-44fe-ad84-4e696468f50e
Nov 14 09:57:17 user nova-compute[75229]:         Portal: 172.16.0.220:3260,-1
Nov 14 09:57:17 user nova-compute[75229]:                 Iface Name: default
Nov 14 09:57:17 user nova-compute[75229]: FIRMWARE:
Nov 14 09:57:17 user nova-compute[75229]: No targets found.
Nov 14 09:57:17 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 09:57:17 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0ce5a41-ee4e-4f8b-b50b-3e72f0e879b8 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 09:57:17 user nova-compute[75229]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 09:57:17 user nova-compute[75229]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75229) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 09:57:17 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0ce5a41-ee4e-4f8b-b50b-3e72f0e879b8 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a5efb0e0-a85c-46ec-8a9d-2763bf548023', 0)] {{(pid=75229) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 09:57:17 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:57:17 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:57:17 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[87ec88b6-1a65-4244-9bed-e51bf5ca9e8f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5aebc438-0289-44fe-ad84-4e696468f50e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a5efb0e0-a85c-46ec-8a9d-2763bf548023\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:57:17 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:57:17 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:57:17 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[019df201-1b4a-4a7e-b769-3f1d4d360552]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5efb0e0-a85c-46ec-8a9d-2763bf548023 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aebc438-0289-44fe-ad84-4e696468f50e (non-flash)\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:57:17 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0ce5a41-ee4e-4f8b-b50b-3e72f0e879b8 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5efb0e0-a85c-46ec-8a9d-2763bf548023 (non-flash)
Nov 14 09:57:17 user nova-compute[75229]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aebc438-0289-44fe-ad84-4e696468f50e (non-flash)
Nov 14 09:57:17 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 09:57:17 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0ce5a41-ee4e-4f8b-b50b-3e72f0e879b8 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5efb0e0-a85c-46ec-8a9d-2763bf548023 (non-flash)
Nov 14 09:57:17 user nova-compute[75229]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aebc438-0289-44fe-ad84-4e696468f50e (non-flash)
Nov 14 09:57:17 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 09:57:17 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0ce5a41-ee4e-4f8b-b50b-3e72f0e879b8 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f73d4ee2dd0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a5efb0e0-a85c-46ec-8a9d-2763bf548023'): ({'sdb'}, set())}) {{(pid=75229) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 09:57:17 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-c0ce5a41-ee4e-4f8b-b50b-3e72f0e879b8 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Removing single pathed devices sdb {{(pid=75229) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 09:57:17 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:57:17 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:57:17 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[598c405c-7589-4196-a180-9fe2558d645d]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:57:17 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:57:17 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:57:17 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[010e8818-6f06-4566-bb25-59cd5c3b8498]: (4, ('ok\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:57:17 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-c0ce5a41-ee4e-4f8b-b50b-3e72f0e879b8 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Flushing IO for device /dev/sdb {{(pid=75229) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 09:57:17 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:57:17 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.017s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:57:17 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7cce829-ebda-4df6-83f1-0f7db08067ea]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:57:17 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-c0ce5a41-ee4e-4f8b-b50b-3e72f0e879b8 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75229) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 09:57:17 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:57:17 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.047s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:57:17 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea5342ba-af91-4b8c-a752-978177e6fa23]: (4, ('1', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:57:17 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-c0ce5a41-ee4e-4f8b-b50b-3e72f0e879b8 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75229) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 09:57:17 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-c0ce5a41-ee4e-4f8b-b50b-3e72f0e879b8 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] SCSI volumes sdb have been removed. {{(pid=75229) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 09:57:17 user nova-compute[75229]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-26265396161366132', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_58e469e', '/dev/disk/by-id/scsi-1SCST_BIO58e469e-be9aa6a22a116ef1') {{(pid=86458) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 14 09:57:17 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b44ad43-6bf8-4294-a860-5035771e2b91]: (4, None) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:57:17 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0ce5a41-ee4e-4f8b-b50b-3e72f0e879b8 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a5efb0e0-a85c-46ec-8a9d-2763bf548023')] {{(pid=75229) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 09:57:17 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5efb0e0-a85c-46ec-8a9d-2763bf548023 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:57:17 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5efb0e0-a85c-46ec-8a9d-2763bf548023 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:57:17 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e70a38a-a2d5-4850-b39d-13301435ab0f]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:57:17 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0ce5a41-ee4e-4f8b-b50b-3e72f0e879b8 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:57:17 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5efb0e0-a85c-46ec-8a9d-2763bf548023 -p 172.16.0.220:3260 --logout {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:57:17 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5efb0e0-a85c-46ec-8a9d-2763bf548023 -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:57:17 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2aa6ee1-0758-4d08-8a33-f762704dd474]: (4, ('Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:a5efb0e0-a85c-46ec-8a9d-2763bf548023, portal: 172.16.0.220,3260]\nLogout of [sid: 31, target: iqn.2010-10.org.openstack:a5efb0e0-a85c-46ec-8a9d-2763bf548023, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:57:17 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0ce5a41-ee4e-4f8b-b50b-3e72f0e879b8 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:a5efb0e0-a85c-46ec-8a9d-2763bf548023, portal: 172.16.0.220,3260]
Nov 14 09:57:17 user nova-compute[75229]: Logout of [sid: 31, target: iqn.2010-10.org.openstack:a5efb0e0-a85c-46ec-8a9d-2763bf548023, portal: 172.16.0.220,3260] successful.
Nov 14 09:57:17 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:57:17 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5efb0e0-a85c-46ec-8a9d-2763bf548023 -p 172.16.0.220:3260 --op delete {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:57:17 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5efb0e0-a85c-46ec-8a9d-2763bf548023 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:57:17 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[695fa3d7-b00f-4fc4-959d-3f25b6ec638f]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:57:17 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0ce5a41-ee4e-4f8b-b50b-3e72f0e879b8 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:57:17 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-c0ce5a41-ee4e-4f8b-b50b-3e72f0e879b8 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.313s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 09:57:17 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0ce5a41-ee4e-4f8b-b50b-3e72f0e879b8 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] <== disconnect_volume: return (314ms) None {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 09:57:17 user nova-compute[75229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c0ce5a41-ee4e-4f8b-b50b-3e72f0e879b8 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] [instance: 589f4750-fac6-4e99-a430-0cda339808bc] Disconnected iSCSI Volume {{(pid=75229) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 09:57:17 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-c0ce5a41-ee4e-4f8b-b50b-3e72f0e879b8 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75229) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 09:57:18 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:57:18 user nova-compute[75229]: DEBUG nova.network.neutron [None req-c0ce5a41-ee4e-4f8b-b50b-3e72f0e879b8 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] [instance: 589f4750-fac6-4e99-a430-0cda339808bc] Port e10815ba-0472-4ed0-af80-b4d0904580af binding to destination host user is already ACTIVE {{(pid=75229) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 14 09:57:18 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-c0ce5a41-ee4e-4f8b-b50b-3e72f0e879b8 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Acquiring lock "589f4750-fac6-4e99-a430-0cda339808bc-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:57:18 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-c0ce5a41-ee4e-4f8b-b50b-3e72f0e879b8 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Lock "589f4750-fac6-4e99-a430-0cda339808bc-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:57:18 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-c0ce5a41-ee4e-4f8b-b50b-3e72f0e879b8 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Lock "589f4750-fac6-4e99-a430-0cda339808bc-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:57:18 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-c0ce5a41-ee4e-4f8b-b50b-3e72f0e879b8 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Acquiring lock "refresh_cache-589f4750-fac6-4e99-a430-0cda339808bc" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 09:57:18 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-c0ce5a41-ee4e-4f8b-b50b-3e72f0e879b8 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Acquired lock "refresh_cache-589f4750-fac6-4e99-a430-0cda339808bc" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 09:57:18 user nova-compute[75229]: DEBUG nova.network.neutron [None req-c0ce5a41-ee4e-4f8b-b50b-3e72f0e879b8 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] [instance: 589f4750-fac6-4e99-a430-0cda339808bc] Building network info cache for instance {{(pid=75229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 09:57:19 user nova-compute[75229]: DEBUG nova.network.neutron [None req-c0ce5a41-ee4e-4f8b-b50b-3e72f0e879b8 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] [instance: 589f4750-fac6-4e99-a430-0cda339808bc] Updating instance_info_cache with network_info: [{"id": "e10815ba-0472-4ed0-af80-b4d0904580af", "address": "fa:16:3e:aa:81:3e", "network": {"id": "5dfc532f-3d5d-4342-b7f1-12c9c3992a54", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1457278473-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.147", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46e65cdd021f4a3db7c9254bb6d98b46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape10815ba-04", "ovs_interfaceid": "e10815ba-0472-4ed0-af80-b4d0904580af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 09:57:19 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-c0ce5a41-ee4e-4f8b-b50b-3e72f0e879b8 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Releasing lock "refresh_cache-589f4750-fac6-4e99-a430-0cda339808bc" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 09:57:19 user nova-compute[75229]: DEBUG os_brick.utils [None req-c0ce5a41-ee4e-4f8b-b50b-3e72f0e879b8 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 09:57:19 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:57:19 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:57:19 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8bb2411-4440-4f56-b688-4411a0a16b2b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f1154031c835\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:57:19 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:57:19 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:57:19 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[05bc7743-a35d-4425-97c5-89f323e64733]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:57:19 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:57:19 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:57:19 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[288c671b-92da-4a0f-8c8f-520f23e1c384]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:57:19 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[83bf4935-f52a-424c-92ca-73f0d7f22a33]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:57:19 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-c0ce5a41-ee4e-4f8b-b50b-3e72f0e879b8 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Running cmd (subprocess): nvme version {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:57:19 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-c0ce5a41-ee4e-4f8b-b50b-3e72f0e879b8 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] 'nvme version' failed. Not Retrying. {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 09:57:19 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c0ce5a41-ee4e-4f8b-b50b-3e72f0e879b8 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] nvme not present on system {{(pid=75229) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 09:57:19 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:57:19 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 09:57:19 user nova-compute[75229]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 09:57:19 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8e72e65-f348-45d5-909d-289438e89ef4]: (4, '') {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:57:19 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.lightos [None req-c0ce5a41-ee4e-4f8b-b50b-3e72f0e879b8 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75229) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 09:57:19 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.lightos [None req-c0ce5a41-ee4e-4f8b-b50b-3e72f0e879b8 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75229) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 09:57:19 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.lightos [None req-c0ce5a41-ee4e-4f8b-b50b-3e72f0e879b8 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] LIGHTOS: no hostnqn found. {{(pid=75229) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 09:57:19 user nova-compute[75229]: DEBUG os_brick.utils [None req-c0ce5a41-ee4e-4f8b-b50b-3e72f0e879b8 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f1154031c835', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 09:57:22 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:57:23 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-3af934ac-9659-479a-8756-f214532c71f9 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Acquiring lock "abb8e340-164d-4bc2-a503-7e8ea3c9b35b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:57:23 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-3af934ac-9659-479a-8756-f214532c71f9 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Lock "abb8e340-164d-4bc2-a503-7e8ea3c9b35b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:57:23 user nova-compute[75229]: DEBUG nova.compute.manager [None req-3af934ac-9659-479a-8756-f214532c71f9 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] [instance: abb8e340-164d-4bc2-a503-7e8ea3c9b35b] Starting instance... {{(pid=75229) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 09:57:23 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-3af934ac-9659-479a-8756-f214532c71f9 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:57:23 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-3af934ac-9659-479a-8756-f214532c71f9 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:57:23 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-3af934ac-9659-479a-8756-f214532c71f9 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75229) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 09:57:23 user nova-compute[75229]: INFO nova.compute.claims [None req-3af934ac-9659-479a-8756-f214532c71f9 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] [instance: abb8e340-164d-4bc2-a503-7e8ea3c9b35b] Claim successful on node user
Nov 14 09:57:24 user nova-compute[75229]: DEBUG nova.compute.provider_tree [None req-3af934ac-9659-479a-8756-f214532c71f9 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Inventory has not changed in ProviderTree for provider: d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 {{(pid=75229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 09:57:24 user nova-compute[75229]: DEBUG nova.scheduler.client.report [None req-3af934ac-9659-479a-8756-f214532c71f9 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Inventory has not changed for provider d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 09:57:24 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-3af934ac-9659-479a-8756-f214532c71f9 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.497s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:57:24 user nova-compute[75229]: DEBUG nova.compute.manager [None req-3af934ac-9659-479a-8756-f214532c71f9 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] [instance: abb8e340-164d-4bc2-a503-7e8ea3c9b35b] Start building networks asynchronously for instance. {{(pid=75229) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 09:57:24 user nova-compute[75229]: DEBUG nova.compute.manager [None req-3af934ac-9659-479a-8756-f214532c71f9 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] [instance: abb8e340-164d-4bc2-a503-7e8ea3c9b35b] Allocating IP information in the background. {{(pid=75229) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 09:57:24 user nova-compute[75229]: DEBUG nova.network.neutron [None req-3af934ac-9659-479a-8756-f214532c71f9 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] [instance: abb8e340-164d-4bc2-a503-7e8ea3c9b35b] allocate_for_instance() {{(pid=75229) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 09:57:24 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-c0ce5a41-ee4e-4f8b-b50b-3e72f0e879b8 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] [instance: 589f4750-fac6-4e99-a430-0cda339808bc] Starting finish_migration {{(pid=75229) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Nov 14 09:57:24 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-c0ce5a41-ee4e-4f8b-b50b-3e72f0e879b8 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] [instance: 589f4750-fac6-4e99-a430-0cda339808bc] Instance directory exists: not creating {{(pid=75229) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 14 09:57:24 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-c0ce5a41-ee4e-4f8b-b50b-3e72f0e879b8 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] [instance: 589f4750-fac6-4e99-a430-0cda339808bc] Creating image(s)
Nov 14 09:57:24 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-c0ce5a41-ee4e-4f8b-b50b-3e72f0e879b8 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] [instance: 589f4750-fac6-4e99-a430-0cda339808bc] Did not create local disks {{(pid=75229) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 14 09:57:24 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-c0ce5a41-ee4e-4f8b-b50b-3e72f0e879b8 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] [instance: 589f4750-fac6-4e99-a430-0cda339808bc] Ensure instance console log exists: /opt/stack/data/nova/instances/589f4750-fac6-4e99-a430-0cda339808bc/console.log {{(pid=75229) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 09:57:24 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-c0ce5a41-ee4e-4f8b-b50b-3e72f0e879b8 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:57:24 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-c0ce5a41-ee4e-4f8b-b50b-3e72f0e879b8 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:57:24 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-c0ce5a41-ee4e-4f8b-b50b-3e72f0e879b8 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:57:24 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-c0ce5a41-ee4e-4f8b-b50b-3e72f0e879b8 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] [instance: 589f4750-fac6-4e99-a430-0cda339808bc] Start _get_guest_xml network_info=[{"id": "e10815ba-0472-4ed0-af80-b4d0904580af", "address": "fa:16:3e:aa:81:3e", "network": {"id": "5dfc532f-3d5d-4342-b7f1-12c9c3992a54", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1457278473-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.147", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1457278473-network", "vif_mac": "fa:16:3e:aa:81:3e"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46e65cdd021f4a3db7c9254bb6d98b46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape10815ba-04", "ovs_interfaceid": "e10815ba-0472-4ed0-af80-b4d0904580af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:a5efb0e0-a85c-46ec-8a9d-2763bf548023', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MNpaKqUc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '589f4750-fac6-4e99-a430-0cda339808bc', 'attached_at': '2023-11-14T09:57:24.000000', 'detached_at': '', 'volume_id': 'a5efb0e0-a85c-46ec-8a9d-2763bf548023', 'serial': 'a5efb0e0-a85c-46ec-8a9d-2763bf548023'}, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'attachment_id': '585280ed-6c02-43e4-9147-171803081483', 'guest_format': None, 'device_type': 'disk', 'volume_type': None} {{(pid=75229) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 09:57:24 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-3af934ac-9659-479a-8756-f214532c71f9 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] [instance: abb8e340-164d-4bc2-a503-7e8ea3c9b35b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 09:57:24 user nova-compute[75229]: WARNING nova.virt.libvirt.driver [None req-c0ce5a41-ee4e-4f8b-b50b-3e72f0e879b8 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 09:57:24 user nova-compute[75229]: WARNING nova.virt.libvirt.driver [None req-c0ce5a41-ee4e-4f8b-b50b-3e72f0e879b8 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 09:57:24 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-c0ce5a41-ee4e-4f8b-b50b-3e72f0e879b8 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75229) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 09:57:24 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-c0ce5a41-ee4e-4f8b-b50b-3e72f0e879b8 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] CPU controller missing on host. {{(pid=75229) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 09:57:24 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-c0ce5a41-ee4e-4f8b-b50b-3e72f0e879b8 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75229) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 09:57:24 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-c0ce5a41-ee4e-4f8b-b50b-3e72f0e879b8 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] CPU controller found on host. {{(pid=75229) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 09:57:24 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-c0ce5a41-ee4e-4f8b-b50b-3e72f0e879b8 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75229) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 09:57:24 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-c0ce5a41-ee4e-4f8b-b50b-3e72f0e879b8 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T09:40:00Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 09:57:24 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-c0ce5a41-ee4e-4f8b-b50b-3e72f0e879b8 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Flavor limits 0:0:0 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 09:57:24 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-c0ce5a41-ee4e-4f8b-b50b-3e72f0e879b8 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Image limits 0:0:0 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 09:57:24 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-c0ce5a41-ee4e-4f8b-b50b-3e72f0e879b8 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Flavor pref 0:0:0 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 09:57:24 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-c0ce5a41-ee4e-4f8b-b50b-3e72f0e879b8 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Image pref 0:0:0 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 09:57:24 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-c0ce5a41-ee4e-4f8b-b50b-3e72f0e879b8 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 09:57:24 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-c0ce5a41-ee4e-4f8b-b50b-3e72f0e879b8 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 09:57:24 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-c0ce5a41-ee4e-4f8b-b50b-3e72f0e879b8 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75229) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 09:57:24 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-c0ce5a41-ee4e-4f8b-b50b-3e72f0e879b8 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Got 1 possible topologies {{(pid=75229) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 09:57:24 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-c0ce5a41-ee4e-4f8b-b50b-3e72f0e879b8 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 09:57:24 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-c0ce5a41-ee4e-4f8b-b50b-3e72f0e879b8 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 09:57:24 user nova-compute[75229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c0ce5a41-ee4e-4f8b-b50b-3e72f0e879b8 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] [instance: 589f4750-fac6-4e99-a430-0cda339808bc] Calling os-brick to attach iSCSI Volume {{(pid=75229) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 09:57:24 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0ce5a41-ee4e-4f8b-b50b-3e72f0e879b8 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f73f85151b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a5efb0e0-a85c-46ec-8a9d-2763bf548023', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MNpaKqUc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 09:57:24 user nova-compute[75229]: WARNING os_brick.initiator.connectors.base [None req-c0ce5a41-ee4e-4f8b-b50b-3e72f0e879b8 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 09:57:24 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-c0ce5a41-ee4e-4f8b-b50b-3e72f0e879b8 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 09:57:24 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-c0ce5a41-ee4e-4f8b-b50b-3e72f0e879b8 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 09:57:24 user nova-compute[75229]: WARNING os_brick.initiator.connectors.base [None req-c0ce5a41-ee4e-4f8b-b50b-3e72f0e879b8 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 09:57:24 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-c0ce5a41-ee4e-4f8b-b50b-3e72f0e879b8 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a5efb0e0-a85c-46ec-8a9d-2763bf548023" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 09:57:24 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-c0ce5a41-ee4e-4f8b-b50b-3e72f0e879b8 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a5efb0e0-a85c-46ec-8a9d-2763bf548023" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 09:57:24 user nova-compute[75229]: INFO os_brick.initiator.connectors.iscsi [None req-c0ce5a41-ee4e-4f8b-b50b-3e72f0e879b8 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 09:57:24 user nova-compute[75229]: DEBUG nova.compute.manager [None req-3af934ac-9659-479a-8756-f214532c71f9 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] [instance: abb8e340-164d-4bc2-a503-7e8ea3c9b35b] Start building block device mappings for instance. {{(pid=75229) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 09:57:24 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5efb0e0-a85c-46ec-8a9d-2763bf548023 -p 172.16.0.220:3260 {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:57:24 user nova-compute[75229]: DEBUG nova.policy [None req-3af934ac-9659-479a-8756-f214532c71f9 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a3cb33a5c522499e8cd254edd5e15879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46457b27e3ed416e827c3c22449fb512', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75229) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 09:57:24 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5efb0e0-a85c-46ec-8a9d-2763bf548023 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:57:24 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba1064a3-eac9-4057-b9eb-5869e0f19ec6]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:57:24 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0ce5a41-ee4e-4f8b-b50b-3e72f0e879b8 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 09:57:24 user nova-compute[75229]:  {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:57:24 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5efb0e0-a85c-46ec-8a9d-2763bf548023 -p 172.16.0.220:3260 --interface default --op new {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:57:24 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5efb0e0-a85c-46ec-8a9d-2763bf548023 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:57:24 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[90247e84-02bf-40d3-80e9-5a20726a52d9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a5efb0e0-a85c-46ec-8a9d-2763bf548023] added\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:57:24 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0ce5a41-ee4e-4f8b-b50b-3e72f0e879b8 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a5efb0e0-a85c-46ec-8a9d-2763bf548023] added
Nov 14 09:57:24 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:57:24 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5efb0e0-a85c-46ec-8a9d-2763bf548023 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:57:24 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5efb0e0-a85c-46ec-8a9d-2763bf548023 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:57:24 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbaf7b17-93af-45f0-8756-9f7ecb5d53eb]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:57:24 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0ce5a41-ee4e-4f8b-b50b-3e72f0e879b8 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:57:24 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5efb0e0-a85c-46ec-8a9d-2763bf548023 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:57:24 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5efb0e0-a85c-46ec-8a9d-2763bf548023 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:57:24 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[62927979-7b46-4993-908e-399e51692a37]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:57:24 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0ce5a41-ee4e-4f8b-b50b-3e72f0e879b8 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:57:24 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5efb0e0-a85c-46ec-8a9d-2763bf548023 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MNpaKqUc {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:57:24 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5efb0e0-a85c-46ec-8a9d-2763bf548023 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MNpaKqUc" returned: 0 in 0.023s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:57:24 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e5f1747-d71b-4eb5-9ccb-1b84d40bbb37]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:57:24 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0ce5a41-ee4e-4f8b-b50b-3e72f0e879b8 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'MNpaKqUc'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:57:24 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5efb0e0-a85c-46ec-8a9d-2763bf548023 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:57:24 user nova-compute[75229]: DEBUG nova.compute.manager [None req-3af934ac-9659-479a-8756-f214532c71f9 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] [instance: abb8e340-164d-4bc2-a503-7e8ea3c9b35b] Start spawning the instance on the hypervisor. {{(pid=75229) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 09:57:24 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-3af934ac-9659-479a-8756-f214532c71f9 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] [instance: abb8e340-164d-4bc2-a503-7e8ea3c9b35b] Creating instance directory {{(pid=75229) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 09:57:24 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-3af934ac-9659-479a-8756-f214532c71f9 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] [instance: abb8e340-164d-4bc2-a503-7e8ea3c9b35b] Creating image(s)
Nov 14 09:57:24 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-3af934ac-9659-479a-8756-f214532c71f9 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Acquiring lock "/opt/stack/data/nova/instances/abb8e340-164d-4bc2-a503-7e8ea3c9b35b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:57:24 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-3af934ac-9659-479a-8756-f214532c71f9 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Lock "/opt/stack/data/nova/instances/abb8e340-164d-4bc2-a503-7e8ea3c9b35b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:57:24 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-3af934ac-9659-479a-8756-f214532c71f9 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Lock "/opt/stack/data/nova/instances/abb8e340-164d-4bc2-a503-7e8ea3c9b35b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:57:24 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-3af934ac-9659-479a-8756-f214532c71f9 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6 --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:57:24 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5efb0e0-a85c-46ec-8a9d-2763bf548023 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:57:24 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[de38e044-d7bf-47aa-84ac-df513604fc30]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:57:24 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0ce5a41-ee4e-4f8b-b50b-3e72f0e879b8 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:57:24 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:57:24 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:57:24 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[421de4dc-8f73-4fdf-bb1a-9b652e95e2a9]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aebc438-0289-44fe-ad84-4e696468f50e (non-flash)\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:57:24 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0ce5a41-ee4e-4f8b-b50b-3e72f0e879b8 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aebc438-0289-44fe-ad84-4e696468f50e (non-flash)
Nov 14 09:57:24 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 09:57:24 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0ce5a41-ee4e-4f8b-b50b-3e72f0e879b8 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aebc438-0289-44fe-ad84-4e696468f50e (non-flash)
Nov 14 09:57:24 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 09:57:24 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5efb0e0-a85c-46ec-8a9d-2763bf548023 -p 172.16.0.220:3260 --login {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:57:24 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5efb0e0-a85c-46ec-8a9d-2763bf548023 -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:57:24 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd832df1-e97c-47be-a457-6828f15c50b3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a5efb0e0-a85c-46ec-8a9d-2763bf548023, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a5efb0e0-a85c-46ec-8a9d-2763bf548023, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:57:24 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0ce5a41-ee4e-4f8b-b50b-3e72f0e879b8 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a5efb0e0-a85c-46ec-8a9d-2763bf548023, portal: 172.16.0.220,3260]
Nov 14 09:57:24 user nova-compute[75229]: Login to [iface: default, target: iqn.2010-10.org.openstack:a5efb0e0-a85c-46ec-8a9d-2763bf548023, portal: 172.16.0.220,3260] successful.
Nov 14 09:57:24 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:57:24 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5efb0e0-a85c-46ec-8a9d-2763bf548023 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:57:24 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5efb0e0-a85c-46ec-8a9d-2763bf548023 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:57:24 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[55b92537-db30-4ba6-b264-5ab0df17b305]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:57:24 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0ce5a41-ee4e-4f8b-b50b-3e72f0e879b8 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:57:24 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:57:24 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:57:24 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[78065589-0eda-4a48-b7da-f50f8d4aadec]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aebc438-0289-44fe-ad84-4e696468f50e (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5efb0e0-a85c-46ec-8a9d-2763bf548023 (non-flash)\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:57:24 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0ce5a41-ee4e-4f8b-b50b-3e72f0e879b8 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aebc438-0289-44fe-ad84-4e696468f50e (non-flash)
Nov 14 09:57:24 user nova-compute[75229]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5efb0e0-a85c-46ec-8a9d-2763bf548023 (non-flash)
Nov 14 09:57:24 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 09:57:24 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0ce5a41-ee4e-4f8b-b50b-3e72f0e879b8 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aebc438-0289-44fe-ad84-4e696468f50e (non-flash)
Nov 14 09:57:24 user nova-compute[75229]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5efb0e0-a85c-46ec-8a9d-2763bf548023 (non-flash)
Nov 14 09:57:24 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 09:57:24 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-c0ce5a41-ee4e-4f8b-b50b-3e72f0e879b8 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a5efb0e0-a85c-46ec-8a9d-2763bf548023" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.333s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 09:57:24 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0ce5a41-ee4e-4f8b-b50b-3e72f0e879b8 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Connected to 172.16.0.220:3260 {{(pid=75229) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 09:57:24 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-c0ce5a41-ee4e-4f8b-b50b-3e72f0e879b8 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] HCTL ('33', '-', '-', 0) found on session 35 with lun 0 {{(pid=75229) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 09:57:24 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-c0ce5a41-ee4e-4f8b-b50b-3e72f0e879b8 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75229) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 09:57:24 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:57:24 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-3af934ac-9659-479a-8756-f214532c71f9 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6 --force-share --output=json" returned: 0 in 0.191s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:57:24 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-3af934ac-9659-479a-8756-f214532c71f9 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Acquiring lock "4f30e3fe703d2381679612a57b1fb80a467f60b6" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:57:24 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-3af934ac-9659-479a-8756-f214532c71f9 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Lock "4f30e3fe703d2381679612a57b1fb80a467f60b6" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:57:24 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-3af934ac-9659-479a-8756-f214532c71f9 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6 --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:57:24 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:57:24 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[8880429b-10ce-491c-a287-0bfa289781e4]: (4, ('- - 0', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:57:24 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-c0ce5a41-ee4e-4f8b-b50b-3e72f0e879b8 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Searching for a device in session 35 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75229) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 09:57:24 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0ce5a41-ee4e-4f8b-b50b-3e72f0e879b8 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:a5efb0e0-a85c-46ec-8a9d-2763bf548023', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MNpaKqUc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75229) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 09:57:25 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-3af934ac-9659-479a-8756-f214532c71f9 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6 --force-share --output=json" returned: 0 in 0.208s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:57:25 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-3af934ac-9659-479a-8756-f214532c71f9 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6,backing_fmt=raw /opt/stack/data/nova/instances/abb8e340-164d-4bc2-a503-7e8ea3c9b35b/disk 1073741824 {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:57:25 user nova-compute[75229]: DEBUG nova.network.neutron [None req-3af934ac-9659-479a-8756-f214532c71f9 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] [instance: abb8e340-164d-4bc2-a503-7e8ea3c9b35b] Successfully created port: 37ce4717-9a82-41c6-9d89-f1e55b9ae398 {{(pid=75229) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 09:57:25 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-3af934ac-9659-479a-8756-f214532c71f9 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6,backing_fmt=raw /opt/stack/data/nova/instances/abb8e340-164d-4bc2-a503-7e8ea3c9b35b/disk 1073741824" returned: 0 in 0.073s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:57:25 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-3af934ac-9659-479a-8756-f214532c71f9 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Lock "4f30e3fe703d2381679612a57b1fb80a467f60b6" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.286s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:57:25 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-3af934ac-9659-479a-8756-f214532c71f9 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6 --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:57:25 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-3af934ac-9659-479a-8756-f214532c71f9 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6 --force-share --output=json" returned: 0 in 0.183s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:57:25 user nova-compute[75229]: DEBUG nova.virt.disk.api [None req-3af934ac-9659-479a-8756-f214532c71f9 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Checking if we can resize image /opt/stack/data/nova/instances/abb8e340-164d-4bc2-a503-7e8ea3c9b35b/disk. size=1073741824 {{(pid=75229) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 09:57:25 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-3af934ac-9659-479a-8756-f214532c71f9 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abb8e340-164d-4bc2-a503-7e8ea3c9b35b/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:57:25 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-7d4bf66e-30a7-4a4c-9919-d00645ad1868 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] Acquiring lock "9cdd6b32-d4bd-4135-a58e-fbc3b6d2a093" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:57:25 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-7d4bf66e-30a7-4a4c-9919-d00645ad1868 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] Lock "9cdd6b32-d4bd-4135-a58e-fbc3b6d2a093" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.008s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:57:25 user nova-compute[75229]: DEBUG nova.objects.instance [None req-7d4bf66e-30a7-4a4c-9919-d00645ad1868 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] Lazy-loading 'flavor' on Instance uuid 9cdd6b32-d4bd-4135-a58e-fbc3b6d2a093 {{(pid=75229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 09:57:25 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-7d4bf66e-30a7-4a4c-9919-d00645ad1868 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] Lock "9cdd6b32-d4bd-4135-a58e-fbc3b6d2a093" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.060s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:57:25 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-3af934ac-9659-479a-8756-f214532c71f9 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abb8e340-164d-4bc2-a503-7e8ea3c9b35b/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:57:25 user nova-compute[75229]: DEBUG nova.virt.disk.api [None req-3af934ac-9659-479a-8756-f214532c71f9 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Cannot resize image /opt/stack/data/nova/instances/abb8e340-164d-4bc2-a503-7e8ea3c9b35b/disk to a smaller size. {{(pid=75229) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 09:57:25 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-3af934ac-9659-479a-8756-f214532c71f9 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] [instance: abb8e340-164d-4bc2-a503-7e8ea3c9b35b] Created local disks {{(pid=75229) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 09:57:25 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-3af934ac-9659-479a-8756-f214532c71f9 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] [instance: abb8e340-164d-4bc2-a503-7e8ea3c9b35b] Ensure instance console log exists: /opt/stack/data/nova/instances/abb8e340-164d-4bc2-a503-7e8ea3c9b35b/console.log {{(pid=75229) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 09:57:25 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-3af934ac-9659-479a-8756-f214532c71f9 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:57:25 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-3af934ac-9659-479a-8756-f214532c71f9 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:57:25 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-3af934ac-9659-479a-8756-f214532c71f9 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:57:25 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-7d4bf66e-30a7-4a4c-9919-d00645ad1868 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] Acquiring lock "9cdd6b32-d4bd-4135-a58e-fbc3b6d2a093" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:57:25 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-7d4bf66e-30a7-4a4c-9919-d00645ad1868 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] Lock "9cdd6b32-d4bd-4135-a58e-fbc3b6d2a093" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:57:25 user nova-compute[75229]: INFO nova.compute.manager [None req-7d4bf66e-30a7-4a4c-9919-d00645ad1868 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] [instance: 9cdd6b32-d4bd-4135-a58e-fbc3b6d2a093] Attaching volume 94a0a817-0b71-4589-90eb-8c8d159f7fd2 to /dev/vdb
Nov 14 09:57:25 user nova-compute[75229]: DEBUG os_brick.utils [None req-7d4bf66e-30a7-4a4c-9919-d00645ad1868 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 09:57:25 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:57:25 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:57:25 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0882bdc-1151-4452-81b0-c51ce65bac8f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f1154031c835\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:57:25 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:57:25 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:57:25 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[10c70ae7-8088-4bc4-be23-41a7ad6c1e6f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:57:25 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:57:25 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:57:25 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[96b8a7ba-bb82-4320-962e-c195b2b1b639]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:57:25 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fd45b97-5748-41fb-a9a5-6c0318ad8a75]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:57:25 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-7d4bf66e-30a7-4a4c-9919-d00645ad1868 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] Running cmd (subprocess): nvme version {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:57:25 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-7d4bf66e-30a7-4a4c-9919-d00645ad1868 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] 'nvme version' failed. Not Retrying. {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 09:57:25 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7d4bf66e-30a7-4a4c-9919-d00645ad1868 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] nvme not present on system {{(pid=75229) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 09:57:25 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:57:25 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 09:57:25 user nova-compute[75229]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 09:57:25 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[1722a8f2-3b5d-4cf3-94f2-16b5c6df95cd]: (4, '') {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:57:25 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:57:25 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.lightos [None req-7d4bf66e-30a7-4a4c-9919-d00645ad1868 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75229) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 09:57:25 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.lightos [None req-7d4bf66e-30a7-4a4c-9919-d00645ad1868 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75229) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 09:57:25 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.lightos [None req-7d4bf66e-30a7-4a4c-9919-d00645ad1868 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] LIGHTOS: no hostnqn found. {{(pid=75229) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 09:57:25 user nova-compute[75229]: DEBUG os_brick.utils [None req-7d4bf66e-30a7-4a4c-9919-d00645ad1868 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] <== get_connector_properties: return (138ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f1154031c835', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 09:57:25 user nova-compute[75229]: DEBUG nova.virt.block_device [None req-7d4bf66e-30a7-4a4c-9919-d00645ad1868 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] [instance: 9cdd6b32-d4bd-4135-a58e-fbc3b6d2a093] Updating existing volume attachment record: 45cef383-ce56-4119-9e54-9d6af2f5653a {{(pid=75229) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 09:57:25 user nova-compute[75229]: DEBUG nova.network.neutron [None req-3af934ac-9659-479a-8756-f214532c71f9 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] [instance: abb8e340-164d-4bc2-a503-7e8ea3c9b35b] Successfully updated port: 37ce4717-9a82-41c6-9d89-f1e55b9ae398 {{(pid=75229) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 09:57:25 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-c0ce5a41-ee4e-4f8b-b50b-3e72f0e879b8 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.403s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 09:57:25 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0ce5a41-ee4e-4f8b-b50b-3e72f0e879b8 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] <== connect_volume: return (1404ms) {'type': 'block', 'scsi_wwn': '26265396161366132', 'path': '/dev/sdb'} {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 09:57:25 user nova-compute[75229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c0ce5a41-ee4e-4f8b-b50b-3e72f0e879b8 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] [instance: 589f4750-fac6-4e99-a430-0cda339808bc] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26265396161366132', 'path': '/dev/sdb'} {{(pid=75229) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 09:57:25 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-3af934ac-9659-479a-8756-f214532c71f9 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Acquiring lock "refresh_cache-abb8e340-164d-4bc2-a503-7e8ea3c9b35b" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 09:57:25 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-3af934ac-9659-479a-8756-f214532c71f9 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Acquired lock "refresh_cache-abb8e340-164d-4bc2-a503-7e8ea3c9b35b" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 09:57:25 user nova-compute[75229]: DEBUG nova.network.neutron [None req-3af934ac-9659-479a-8756-f214532c71f9 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] [instance: abb8e340-164d-4bc2-a503-7e8ea3c9b35b] Building network info cache for instance {{(pid=75229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 09:57:25 user nova-compute[75229]: DEBUG nova.compute.manager [req-b2df78f3-5434-4ab7-a70b-50e756e4a150 req-292b3cf5-f8ab-4797-b001-0b29b2e262a3 service nova] [instance: abb8e340-164d-4bc2-a503-7e8ea3c9b35b] Received event network-changed-37ce4717-9a82-41c6-9d89-f1e55b9ae398 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:57:25 user nova-compute[75229]: DEBUG nova.compute.manager [req-b2df78f3-5434-4ab7-a70b-50e756e4a150 req-292b3cf5-f8ab-4797-b001-0b29b2e262a3 service nova] [instance: abb8e340-164d-4bc2-a503-7e8ea3c9b35b] Refreshing instance network info cache due to event network-changed-37ce4717-9a82-41c6-9d89-f1e55b9ae398. {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 09:57:25 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-b2df78f3-5434-4ab7-a70b-50e756e4a150 req-292b3cf5-f8ab-4797-b001-0b29b2e262a3 service nova] Acquiring lock "refresh_cache-abb8e340-164d-4bc2-a503-7e8ea3c9b35b" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 09:57:25 user nova-compute[75229]: DEBUG nova.virt.libvirt.vif [None req-c0ce5a41-ee4e-4f8b-b50b-3e72f0e879b8 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T09:55:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-724442357',display_name='tempest-ServerActionsTestOtherA-server-724442357',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-724442357',id=32,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGYpQZFb1U6nMdMA0U7Y/y+mR6NDiU0zUt1gWS7fx0RnGUEMiKL0fCtTR70lVN1zodlPi6pkSulrGMUx3iNoziRzj8cN92z29zHcNE44hvJVgwbBcM00kPn071ndMRlk4g==',key_name='tempest-keypair-397181797',keypairs=<?>,launch_index=0,launched_at=2023-11-14T09:55:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='46e65cdd021f4a3db7c9254bb6d98b46',ramdisk_id='',reservation_id='r-lre1lh5y',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-280196295',owner_user_name='tempest-ServerActionsTestOtherA-280196295-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T09:57:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c0c381a0f6124f1ca6ce85c057b9143a',uuid=589f4750-fac6-4e99-a430-0cda339808bc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e10815ba-0472-4ed0-af80-b4d0904580af", "address": "fa:16:3e:aa:81:3e", "network": {"id": "5dfc532f-3d5d-4342-b7f1-12c9c3992a54", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1457278473-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.147", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1457278473-network", "vif_mac": "fa:16:3e:aa:81:3e"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46e65cdd021f4a3db7c9254bb6d98b46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape10815ba-04", "ovs_interfaceid": "e10815ba-0472-4ed0-af80-b4d0904580af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75229) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 09:57:25 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-c0ce5a41-ee4e-4f8b-b50b-3e72f0e879b8 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Converting VIF {"id": "e10815ba-0472-4ed0-af80-b4d0904580af", "address": "fa:16:3e:aa:81:3e", "network": {"id": "5dfc532f-3d5d-4342-b7f1-12c9c3992a54", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1457278473-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.147", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1457278473-network", "vif_mac": "fa:16:3e:aa:81:3e"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46e65cdd021f4a3db7c9254bb6d98b46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape10815ba-04", "ovs_interfaceid": "e10815ba-0472-4ed0-af80-b4d0904580af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 09:57:25 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-c0ce5a41-ee4e-4f8b-b50b-3e72f0e879b8 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:aa:81:3e,bridge_name='br-int',has_traffic_filtering=True,id=e10815ba-0472-4ed0-af80-b4d0904580af,network=Network(5dfc532f-3d5d-4342-b7f1-12c9c3992a54),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape10815ba-04') {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 09:57:25 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-c0ce5a41-ee4e-4f8b-b50b-3e72f0e879b8 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] [instance: 589f4750-fac6-4e99-a430-0cda339808bc] End _get_guest_xml xml=<domain type="kvm">
Nov 14 09:57:25 user nova-compute[75229]:   <uuid>589f4750-fac6-4e99-a430-0cda339808bc</uuid>
Nov 14 09:57:25 user nova-compute[75229]:   <name>instance-00000020</name>
Nov 14 09:57:25 user nova-compute[75229]:   <memory>2097152</memory>
Nov 14 09:57:25 user nova-compute[75229]:   <vcpu>1</vcpu>
Nov 14 09:57:25 user nova-compute[75229]:   <metadata>
Nov 14 09:57:25 user nova-compute[75229]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 09:57:25 user nova-compute[75229]:       <nova:package version="0.0.0"/>
Nov 14 09:57:25 user nova-compute[75229]:       <nova:name>tempest-ServerActionsTestOtherA-server-724442357</nova:name>
Nov 14 09:57:25 user nova-compute[75229]:       <nova:creationTime>2023-11-14 09:57:24</nova:creationTime>
Nov 14 09:57:25 user nova-compute[75229]:       <nova:flavor name="m1.small">
Nov 14 09:57:25 user nova-compute[75229]:         <nova:memory>2048</nova:memory>
Nov 14 09:57:25 user nova-compute[75229]:         <nova:disk>20</nova:disk>
Nov 14 09:57:25 user nova-compute[75229]:         <nova:swap>0</nova:swap>
Nov 14 09:57:25 user nova-compute[75229]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 09:57:25 user nova-compute[75229]:         <nova:vcpus>1</nova:vcpus>
Nov 14 09:57:25 user nova-compute[75229]:       </nova:flavor>
Nov 14 09:57:25 user nova-compute[75229]:       <nova:owner>
Nov 14 09:57:25 user nova-compute[75229]:         <nova:user uuid="c0c381a0f6124f1ca6ce85c057b9143a">tempest-ServerActionsTestOtherA-280196295-project-member</nova:user>
Nov 14 09:57:25 user nova-compute[75229]:         <nova:project uuid="46e65cdd021f4a3db7c9254bb6d98b46">tempest-ServerActionsTestOtherA-280196295</nova:project>
Nov 14 09:57:25 user nova-compute[75229]:       </nova:owner>
Nov 14 09:57:25 user nova-compute[75229]:       <nova:ports>
Nov 14 09:57:25 user nova-compute[75229]:         <nova:port uuid="e10815ba-0472-4ed0-af80-b4d0904580af">
Nov 14 09:57:25 user nova-compute[75229]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 14 09:57:25 user nova-compute[75229]:         </nova:port>
Nov 14 09:57:25 user nova-compute[75229]:       </nova:ports>
Nov 14 09:57:25 user nova-compute[75229]:     </nova:instance>
Nov 14 09:57:25 user nova-compute[75229]:   </metadata>
Nov 14 09:57:25 user nova-compute[75229]:   <sysinfo type="smbios">
Nov 14 09:57:25 user nova-compute[75229]:     <system>
Nov 14 09:57:25 user nova-compute[75229]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 09:57:25 user nova-compute[75229]:       <entry name="product">OpenStack Nova</entry>
Nov 14 09:57:25 user nova-compute[75229]:       <entry name="version">0.0.0</entry>
Nov 14 09:57:25 user nova-compute[75229]:       <entry name="serial">589f4750-fac6-4e99-a430-0cda339808bc</entry>
Nov 14 09:57:25 user nova-compute[75229]:       <entry name="uuid">589f4750-fac6-4e99-a430-0cda339808bc</entry>
Nov 14 09:57:25 user nova-compute[75229]:       <entry name="family">Virtual Machine</entry>
Nov 14 09:57:25 user nova-compute[75229]:     </system>
Nov 14 09:57:25 user nova-compute[75229]:   </sysinfo>
Nov 14 09:57:25 user nova-compute[75229]:   <os>
Nov 14 09:57:25 user nova-compute[75229]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 09:57:25 user nova-compute[75229]:     <boot dev="hd"/>
Nov 14 09:57:25 user nova-compute[75229]:     <smbios mode="sysinfo"/>
Nov 14 09:57:25 user nova-compute[75229]:   </os>
Nov 14 09:57:25 user nova-compute[75229]:   <features>
Nov 14 09:57:25 user nova-compute[75229]:     <acpi/>
Nov 14 09:57:25 user nova-compute[75229]:     <apic/>
Nov 14 09:57:25 user nova-compute[75229]:     <vmcoreinfo/>
Nov 14 09:57:25 user nova-compute[75229]:   </features>
Nov 14 09:57:25 user nova-compute[75229]:   <clock offset="utc">
Nov 14 09:57:25 user nova-compute[75229]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 09:57:25 user nova-compute[75229]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 09:57:25 user nova-compute[75229]:     <timer name="hpet" present="no"/>
Nov 14 09:57:25 user nova-compute[75229]:   </clock>
Nov 14 09:57:25 user nova-compute[75229]:   <cpu mode="custom" match="exact">
Nov 14 09:57:25 user nova-compute[75229]:     <model>Nehalem</model>
Nov 14 09:57:25 user nova-compute[75229]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 09:57:25 user nova-compute[75229]:   </cpu>
Nov 14 09:57:25 user nova-compute[75229]:   <devices>
Nov 14 09:57:25 user nova-compute[75229]:     <disk type="block" device="disk">
Nov 14 09:57:25 user nova-compute[75229]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 09:57:25 user nova-compute[75229]:       <source dev="/dev/sdb"/>
Nov 14 09:57:25 user nova-compute[75229]:       <target dev="vda" bus="virtio"/>
Nov 14 09:57:25 user nova-compute[75229]:       <serial>a5efb0e0-a85c-46ec-8a9d-2763bf548023</serial>
Nov 14 09:57:25 user nova-compute[75229]:     </disk>
Nov 14 09:57:25 user nova-compute[75229]:     <interface type="ethernet">
Nov 14 09:57:25 user nova-compute[75229]:       <mac address="fa:16:3e:aa:81:3e"/>
Nov 14 09:57:25 user nova-compute[75229]:       <model type="virtio"/>
Nov 14 09:57:25 user nova-compute[75229]:       <mtu size="1442"/>
Nov 14 09:57:25 user nova-compute[75229]:       <target dev="tape10815ba-04"/>
Nov 14 09:57:25 user nova-compute[75229]:     </interface>
Nov 14 09:57:25 user nova-compute[75229]:     <serial type="pty">
Nov 14 09:57:25 user nova-compute[75229]:       <log file="/opt/stack/data/nova/instances/589f4750-fac6-4e99-a430-0cda339808bc/console.log" append="off"/>
Nov 14 09:57:25 user nova-compute[75229]:     </serial>
Nov 14 09:57:25 user nova-compute[75229]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 09:57:25 user nova-compute[75229]:     <video>
Nov 14 09:57:25 user nova-compute[75229]:       <model type="virtio"/>
Nov 14 09:57:25 user nova-compute[75229]:     </video>
Nov 14 09:57:25 user nova-compute[75229]:     <rng model="virtio">
Nov 14 09:57:25 user nova-compute[75229]:       <backend model="random">/dev/urandom</backend>
Nov 14 09:57:25 user nova-compute[75229]:     </rng>
Nov 14 09:57:25 user nova-compute[75229]:     <controller type="usb" index="0" model="none"/>
Nov 14 09:57:25 user nova-compute[75229]:     <memballoon model="virtio">
Nov 14 09:57:25 user nova-compute[75229]:       <stats period="10"/>
Nov 14 09:57:25 user nova-compute[75229]:     </memballoon>
Nov 14 09:57:25 user nova-compute[75229]:   </devices>
Nov 14 09:57:25 user nova-compute[75229]: </domain>
Nov 14 09:57:25 user nova-compute[75229]:  {{(pid=75229) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 09:57:25 user nova-compute[75229]: DEBUG nova.virt.libvirt.vif [None req-c0ce5a41-ee4e-4f8b-b50b-3e72f0e879b8 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T09:55:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-724442357',display_name='tempest-ServerActionsTestOtherA-server-724442357',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-724442357',id=32,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGYpQZFb1U6nMdMA0U7Y/y+mR6NDiU0zUt1gWS7fx0RnGUEMiKL0fCtTR70lVN1zodlPi6pkSulrGMUx3iNoziRzj8cN92z29zHcNE44hvJVgwbBcM00kPn071ndMRlk4g==',key_name='tempest-keypair-397181797',keypairs=<?>,launch_index=0,launched_at=2023-11-14T09:55:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='46e65cdd021f4a3db7c9254bb6d98b46',ramdisk_id='',reservation_id='r-lre1lh5y',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-280196295',owner_user_name='tempest-ServerActionsTestOtherA-280196295-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T09:57:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c0c381a0f6124f1ca6ce85c057b9143a',uuid=589f4750-fac6-4e99-a430-0cda339808bc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e10815ba-0472-4ed0-af80-b4d0904580af", "address": "fa:16:3e:aa:81:3e", "network": {"id": "5dfc532f-3d5d-4342-b7f1-12c9c3992a54", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1457278473-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.147", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1457278473-network", "vif_mac": "fa:16:3e:aa:81:3e"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46e65cdd021f4a3db7c9254bb6d98b46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape10815ba-04", "ovs_interfaceid": "e10815ba-0472-4ed0-af80-b4d0904580af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 09:57:25 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-c0ce5a41-ee4e-4f8b-b50b-3e72f0e879b8 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Converting VIF {"id": "e10815ba-0472-4ed0-af80-b4d0904580af", "address": "fa:16:3e:aa:81:3e", "network": {"id": "5dfc532f-3d5d-4342-b7f1-12c9c3992a54", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1457278473-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.147", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1457278473-network", "vif_mac": "fa:16:3e:aa:81:3e"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46e65cdd021f4a3db7c9254bb6d98b46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape10815ba-04", "ovs_interfaceid": "e10815ba-0472-4ed0-af80-b4d0904580af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 09:57:25 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-c0ce5a41-ee4e-4f8b-b50b-3e72f0e879b8 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:aa:81:3e,bridge_name='br-int',has_traffic_filtering=True,id=e10815ba-0472-4ed0-af80-b4d0904580af,network=Network(5dfc532f-3d5d-4342-b7f1-12c9c3992a54),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape10815ba-04') {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 09:57:25 user nova-compute[75229]: DEBUG os_vif [None req-c0ce5a41-ee4e-4f8b-b50b-3e72f0e879b8 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:aa:81:3e,bridge_name='br-int',has_traffic_filtering=True,id=e10815ba-0472-4ed0-af80-b4d0904580af,network=Network(5dfc532f-3d5d-4342-b7f1-12c9c3992a54),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape10815ba-04') {{(pid=75229) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 09:57:25 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:57:25 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:57:25 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 09:57:25 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:57:25 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '45a38fa1-e2a1-57a5-951c-5caa67cb189d', '_type': 'linux-noop'}}, row=False) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:57:25 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:57:25 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 09:57:26 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:57:26 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape10815ba-04, may_exist=True, interface_attrs={}) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:57:26 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape10815ba-04, col_values=(('qos', UUID('6bf23fc0-d087-4473-8d7a-2058d5ef3034')),), if_exists=True) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:57:26 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape10815ba-04, col_values=(('external_ids', {'iface-id': 'e10815ba-0472-4ed0-af80-b4d0904580af', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:aa:81:3e', 'vm-uuid': '589f4750-fac6-4e99-a430-0cda339808bc'}),), if_exists=True) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:57:26 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:57:26 user nova-compute[75229]: DEBUG nova.network.neutron [None req-3af934ac-9659-479a-8756-f214532c71f9 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] [instance: abb8e340-164d-4bc2-a503-7e8ea3c9b35b] Instance cache missing network info. {{(pid=75229) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 09:57:26 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:57:26 user nova-compute[75229]: INFO os_vif [None req-c0ce5a41-ee4e-4f8b-b50b-3e72f0e879b8 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:aa:81:3e,bridge_name='br-int',has_traffic_filtering=True,id=e10815ba-0472-4ed0-af80-b4d0904580af,network=Network(5dfc532f-3d5d-4342-b7f1-12c9c3992a54),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape10815ba-04')
Nov 14 09:57:26 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-c0ce5a41-ee4e-4f8b-b50b-3e72f0e879b8 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] No BDM found with device name vda, not building metadata. {{(pid=75229) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 09:57:26 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-c0ce5a41-ee4e-4f8b-b50b-3e72f0e879b8 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] No VIF found with MAC fa:16:3e:aa:81:3e, not building metadata {{(pid=75229) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 09:57:26 user nova-compute[75229]: DEBUG nova.network.neutron [None req-3af934ac-9659-479a-8756-f214532c71f9 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] [instance: abb8e340-164d-4bc2-a503-7e8ea3c9b35b] Updating instance_info_cache with network_info: [{"id": "37ce4717-9a82-41c6-9d89-f1e55b9ae398", "address": "fa:16:3e:92:c4:4b", "network": {"id": "22eed29e-7148-42f9-b4c7-b97811cba8eb", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2000485731-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46457b27e3ed416e827c3c22449fb512", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37ce4717-9a", "ovs_interfaceid": "37ce4717-9a82-41c6-9d89-f1e55b9ae398", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 09:57:26 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-3af934ac-9659-479a-8756-f214532c71f9 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Releasing lock "refresh_cache-abb8e340-164d-4bc2-a503-7e8ea3c9b35b" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 09:57:26 user nova-compute[75229]: DEBUG nova.compute.manager [None req-3af934ac-9659-479a-8756-f214532c71f9 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] [instance: abb8e340-164d-4bc2-a503-7e8ea3c9b35b] Instance network_info: |[{"id": "37ce4717-9a82-41c6-9d89-f1e55b9ae398", "address": "fa:16:3e:92:c4:4b", "network": {"id": "22eed29e-7148-42f9-b4c7-b97811cba8eb", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2000485731-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46457b27e3ed416e827c3c22449fb512", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37ce4717-9a", "ovs_interfaceid": "37ce4717-9a82-41c6-9d89-f1e55b9ae398", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75229) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 09:57:26 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-b2df78f3-5434-4ab7-a70b-50e756e4a150 req-292b3cf5-f8ab-4797-b001-0b29b2e262a3 service nova] Acquired lock "refresh_cache-abb8e340-164d-4bc2-a503-7e8ea3c9b35b" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 09:57:26 user nova-compute[75229]: DEBUG nova.network.neutron [req-b2df78f3-5434-4ab7-a70b-50e756e4a150 req-292b3cf5-f8ab-4797-b001-0b29b2e262a3 service nova] [instance: abb8e340-164d-4bc2-a503-7e8ea3c9b35b] Refreshing network info cache for port 37ce4717-9a82-41c6-9d89-f1e55b9ae398 {{(pid=75229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 09:57:26 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-3af934ac-9659-479a-8756-f214532c71f9 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] [instance: abb8e340-164d-4bc2-a503-7e8ea3c9b35b] Start _get_guest_xml network_info=[{"id": "37ce4717-9a82-41c6-9d89-f1e55b9ae398", "address": "fa:16:3e:92:c4:4b", "network": {"id": "22eed29e-7148-42f9-b4c7-b97811cba8eb", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2000485731-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46457b27e3ed416e827c3c22449fb512", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37ce4717-9a", "ovs_interfaceid": "37ce4717-9a82-41c6-9d89-f1e55b9ae398", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T09:40:10Z,direct_url=<?>,disk_format='qcow2',id=3bef8470-ecc7-40e3-95d4-9254348ea72d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='de5a91106b6948ed937a7178ff9464c4',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T09:40:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'disk_bus': 'virtio', 'guest_format': None, 'encryption_secret_uuid': None, 'size': 0, 'device_type': 'disk', 'image_id': '3bef8470-ecc7-40e3-95d4-9254348ea72d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75229) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 09:57:26 user nova-compute[75229]: WARNING nova.virt.libvirt.driver [None req-3af934ac-9659-479a-8756-f214532c71f9 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 09:57:26 user nova-compute[75229]: WARNING nova.virt.libvirt.driver [None req-3af934ac-9659-479a-8756-f214532c71f9 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 09:57:26 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-3af934ac-9659-479a-8756-f214532c71f9 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75229) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 09:57:26 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-3af934ac-9659-479a-8756-f214532c71f9 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] CPU controller missing on host. {{(pid=75229) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 09:57:26 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-3af934ac-9659-479a-8756-f214532c71f9 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75229) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 09:57:26 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-3af934ac-9659-479a-8756-f214532c71f9 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] CPU controller found on host. {{(pid=75229) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 09:57:26 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-3af934ac-9659-479a-8756-f214532c71f9 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75229) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 09:57:26 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-3af934ac-9659-479a-8756-f214532c71f9 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T09:39:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T09:40:10Z,direct_url=<?>,disk_format='qcow2',id=3bef8470-ecc7-40e3-95d4-9254348ea72d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='de5a91106b6948ed937a7178ff9464c4',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T09:40:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 09:57:26 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-3af934ac-9659-479a-8756-f214532c71f9 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Flavor limits 0:0:0 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 09:57:26 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-3af934ac-9659-479a-8756-f214532c71f9 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Image limits 0:0:0 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 09:57:26 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-3af934ac-9659-479a-8756-f214532c71f9 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Flavor pref 0:0:0 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 09:57:26 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-3af934ac-9659-479a-8756-f214532c71f9 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Image pref 0:0:0 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 09:57:26 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-3af934ac-9659-479a-8756-f214532c71f9 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 09:57:26 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-3af934ac-9659-479a-8756-f214532c71f9 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 09:57:26 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-3af934ac-9659-479a-8756-f214532c71f9 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75229) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 09:57:26 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-3af934ac-9659-479a-8756-f214532c71f9 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Got 1 possible topologies {{(pid=75229) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 09:57:26 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-3af934ac-9659-479a-8756-f214532c71f9 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 09:57:26 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-3af934ac-9659-479a-8756-f214532c71f9 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 09:57:26 user nova-compute[75229]: DEBUG nova.virt.libvirt.vif [None req-3af934ac-9659-479a-8756-f214532c71f9 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T09:57:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-852653284',display_name='tempest-ServerRescueNegativeTestJSON-server-852653284',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-852653284',id=35,image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIdhYa6J6ux6sEyjhtSOnIdcpfqYBU0T4i4xdWqDC4Ach0c+1fPVMeRgGZTsfJf+pkb1r79lSZ/ejqownl7uMFcdcqgEpgtqZeQb5GYf0i6txS0oNHoP6L0HNRQYfOpjeg==',key_name='tempest-keypair-411272448',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='46457b27e3ed416e827c3c22449fb512',ramdisk_id='',reservation_id='r-ajfymruw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-557279920',owner_user_name='tempest-ServerRescueNegativeTestJSON-557279920-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T09:57:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a3cb33a5c522499e8cd254edd5e15879',uuid=abb8e340-164d-4bc2-a503-7e8ea3c9b35b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "37ce4717-9a82-41c6-9d89-f1e55b9ae398", "address": "fa:16:3e:92:c4:4b", "network": {"id": "22eed29e-7148-42f9-b4c7-b97811cba8eb", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2000485731-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46457b27e3ed416e827c3c22449fb512", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37ce4717-9a", "ovs_interfaceid": "37ce4717-9a82-41c6-9d89-f1e55b9ae398", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75229) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 09:57:26 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-3af934ac-9659-479a-8756-f214532c71f9 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Converting VIF {"id": "37ce4717-9a82-41c6-9d89-f1e55b9ae398", "address": "fa:16:3e:92:c4:4b", "network": {"id": "22eed29e-7148-42f9-b4c7-b97811cba8eb", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2000485731-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46457b27e3ed416e827c3c22449fb512", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37ce4717-9a", "ovs_interfaceid": "37ce4717-9a82-41c6-9d89-f1e55b9ae398", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 09:57:26 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-3af934ac-9659-479a-8756-f214532c71f9 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:92:c4:4b,bridge_name='br-int',has_traffic_filtering=True,id=37ce4717-9a82-41c6-9d89-f1e55b9ae398,network=Network(22eed29e-7148-42f9-b4c7-b97811cba8eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37ce4717-9a') {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 09:57:26 user nova-compute[75229]: DEBUG nova.objects.instance [None req-3af934ac-9659-479a-8756-f214532c71f9 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Lazy-loading 'pci_devices' on Instance uuid abb8e340-164d-4bc2-a503-7e8ea3c9b35b {{(pid=75229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 09:57:26 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-3af934ac-9659-479a-8756-f214532c71f9 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] [instance: abb8e340-164d-4bc2-a503-7e8ea3c9b35b] End _get_guest_xml xml=<domain type="kvm">
Nov 14 09:57:26 user nova-compute[75229]:   <uuid>abb8e340-164d-4bc2-a503-7e8ea3c9b35b</uuid>
Nov 14 09:57:26 user nova-compute[75229]:   <name>instance-00000023</name>
Nov 14 09:57:26 user nova-compute[75229]:   <memory>524288</memory>
Nov 14 09:57:26 user nova-compute[75229]:   <vcpu>1</vcpu>
Nov 14 09:57:26 user nova-compute[75229]:   <metadata>
Nov 14 09:57:26 user nova-compute[75229]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 09:57:26 user nova-compute[75229]:       <nova:package version="0.0.0"/>
Nov 14 09:57:26 user nova-compute[75229]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-852653284</nova:name>
Nov 14 09:57:26 user nova-compute[75229]:       <nova:creationTime>2023-11-14 09:57:26</nova:creationTime>
Nov 14 09:57:26 user nova-compute[75229]:       <nova:flavor name="m1.tiny">
Nov 14 09:57:26 user nova-compute[75229]:         <nova:memory>512</nova:memory>
Nov 14 09:57:26 user nova-compute[75229]:         <nova:disk>1</nova:disk>
Nov 14 09:57:26 user nova-compute[75229]:         <nova:swap>0</nova:swap>
Nov 14 09:57:26 user nova-compute[75229]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 09:57:26 user nova-compute[75229]:         <nova:vcpus>1</nova:vcpus>
Nov 14 09:57:26 user nova-compute[75229]:       </nova:flavor>
Nov 14 09:57:26 user nova-compute[75229]:       <nova:owner>
Nov 14 09:57:26 user nova-compute[75229]:         <nova:user uuid="a3cb33a5c522499e8cd254edd5e15879">tempest-ServerRescueNegativeTestJSON-557279920-project-member</nova:user>
Nov 14 09:57:26 user nova-compute[75229]:         <nova:project uuid="46457b27e3ed416e827c3c22449fb512">tempest-ServerRescueNegativeTestJSON-557279920</nova:project>
Nov 14 09:57:26 user nova-compute[75229]:       </nova:owner>
Nov 14 09:57:26 user nova-compute[75229]:       <nova:root type="image" uuid="3bef8470-ecc7-40e3-95d4-9254348ea72d"/>
Nov 14 09:57:26 user nova-compute[75229]:       <nova:ports>
Nov 14 09:57:26 user nova-compute[75229]:         <nova:port uuid="37ce4717-9a82-41c6-9d89-f1e55b9ae398">
Nov 14 09:57:26 user nova-compute[75229]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 14 09:57:26 user nova-compute[75229]:         </nova:port>
Nov 14 09:57:26 user nova-compute[75229]:       </nova:ports>
Nov 14 09:57:26 user nova-compute[75229]:     </nova:instance>
Nov 14 09:57:26 user nova-compute[75229]:   </metadata>
Nov 14 09:57:26 user nova-compute[75229]:   <sysinfo type="smbios">
Nov 14 09:57:26 user nova-compute[75229]:     <system>
Nov 14 09:57:26 user nova-compute[75229]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 09:57:26 user nova-compute[75229]:       <entry name="product">OpenStack Nova</entry>
Nov 14 09:57:26 user nova-compute[75229]:       <entry name="version">0.0.0</entry>
Nov 14 09:57:26 user nova-compute[75229]:       <entry name="serial">abb8e340-164d-4bc2-a503-7e8ea3c9b35b</entry>
Nov 14 09:57:26 user nova-compute[75229]:       <entry name="uuid">abb8e340-164d-4bc2-a503-7e8ea3c9b35b</entry>
Nov 14 09:57:26 user nova-compute[75229]:       <entry name="family">Virtual Machine</entry>
Nov 14 09:57:26 user nova-compute[75229]:     </system>
Nov 14 09:57:26 user nova-compute[75229]:   </sysinfo>
Nov 14 09:57:26 user nova-compute[75229]:   <os>
Nov 14 09:57:26 user nova-compute[75229]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 09:57:26 user nova-compute[75229]:     <boot dev="hd"/>
Nov 14 09:57:26 user nova-compute[75229]:     <smbios mode="sysinfo"/>
Nov 14 09:57:26 user nova-compute[75229]:   </os>
Nov 14 09:57:26 user nova-compute[75229]:   <features>
Nov 14 09:57:26 user nova-compute[75229]:     <acpi/>
Nov 14 09:57:26 user nova-compute[75229]:     <apic/>
Nov 14 09:57:26 user nova-compute[75229]:     <vmcoreinfo/>
Nov 14 09:57:26 user nova-compute[75229]:   </features>
Nov 14 09:57:26 user nova-compute[75229]:   <clock offset="utc">
Nov 14 09:57:26 user nova-compute[75229]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 09:57:26 user nova-compute[75229]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 09:57:26 user nova-compute[75229]:     <timer name="hpet" present="no"/>
Nov 14 09:57:26 user nova-compute[75229]:   </clock>
Nov 14 09:57:26 user nova-compute[75229]:   <cpu mode="custom" match="exact">
Nov 14 09:57:26 user nova-compute[75229]:     <model>Nehalem</model>
Nov 14 09:57:26 user nova-compute[75229]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 09:57:26 user nova-compute[75229]:   </cpu>
Nov 14 09:57:26 user nova-compute[75229]:   <devices>
Nov 14 09:57:26 user nova-compute[75229]:     <disk type="file" device="disk">
Nov 14 09:57:26 user nova-compute[75229]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 09:57:26 user nova-compute[75229]:       <source file="/opt/stack/data/nova/instances/abb8e340-164d-4bc2-a503-7e8ea3c9b35b/disk"/>
Nov 14 09:57:26 user nova-compute[75229]:       <target dev="vda" bus="virtio"/>
Nov 14 09:57:26 user nova-compute[75229]:     </disk>
Nov 14 09:57:26 user nova-compute[75229]:     <interface type="ethernet">
Nov 14 09:57:26 user nova-compute[75229]:       <mac address="fa:16:3e:92:c4:4b"/>
Nov 14 09:57:26 user nova-compute[75229]:       <model type="virtio"/>
Nov 14 09:57:26 user nova-compute[75229]:       <mtu size="1442"/>
Nov 14 09:57:26 user nova-compute[75229]:       <target dev="tap37ce4717-9a"/>
Nov 14 09:57:26 user nova-compute[75229]:     </interface>
Nov 14 09:57:26 user nova-compute[75229]:     <serial type="pty">
Nov 14 09:57:26 user nova-compute[75229]:       <log file="/opt/stack/data/nova/instances/abb8e340-164d-4bc2-a503-7e8ea3c9b35b/console.log" append="off"/>
Nov 14 09:57:26 user nova-compute[75229]:     </serial>
Nov 14 09:57:26 user nova-compute[75229]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 09:57:26 user nova-compute[75229]:     <video>
Nov 14 09:57:26 user nova-compute[75229]:       <model type="virtio"/>
Nov 14 09:57:26 user nova-compute[75229]:     </video>
Nov 14 09:57:26 user nova-compute[75229]:     <rng model="virtio">
Nov 14 09:57:26 user nova-compute[75229]:       <backend model="random">/dev/urandom</backend>
Nov 14 09:57:26 user nova-compute[75229]:     </rng>
Nov 14 09:57:26 user nova-compute[75229]:     <controller type="usb" index="0" model="none"/>
Nov 14 09:57:26 user nova-compute[75229]:     <memballoon model="virtio">
Nov 14 09:57:26 user nova-compute[75229]:       <stats period="10"/>
Nov 14 09:57:26 user nova-compute[75229]:     </memballoon>
Nov 14 09:57:26 user nova-compute[75229]:   </devices>
Nov 14 09:57:26 user nova-compute[75229]: </domain>
Nov 14 09:57:26 user nova-compute[75229]:  {{(pid=75229) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 09:57:26 user nova-compute[75229]: DEBUG nova.virt.libvirt.vif [None req-3af934ac-9659-479a-8756-f214532c71f9 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T09:57:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-852653284',display_name='tempest-ServerRescueNegativeTestJSON-server-852653284',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-852653284',id=35,image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIdhYa6J6ux6sEyjhtSOnIdcpfqYBU0T4i4xdWqDC4Ach0c+1fPVMeRgGZTsfJf+pkb1r79lSZ/ejqownl7uMFcdcqgEpgtqZeQb5GYf0i6txS0oNHoP6L0HNRQYfOpjeg==',key_name='tempest-keypair-411272448',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='46457b27e3ed416e827c3c22449fb512',ramdisk_id='',reservation_id='r-ajfymruw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-557279920',owner_user_name='tempest-ServerRescueNegativeTestJSON-557279920-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T09:57:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a3cb33a5c522499e8cd254edd5e15879',uuid=abb8e340-164d-4bc2-a503-7e8ea3c9b35b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "37ce4717-9a82-41c6-9d89-f1e55b9ae398", "address": "fa:16:3e:92:c4:4b", "network": {"id": "22eed29e-7148-42f9-b4c7-b97811cba8eb", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2000485731-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46457b27e3ed416e827c3c22449fb512", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37ce4717-9a", "ovs_interfaceid": "37ce4717-9a82-41c6-9d89-f1e55b9ae398", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 09:57:26 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-3af934ac-9659-479a-8756-f214532c71f9 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Converting VIF {"id": "37ce4717-9a82-41c6-9d89-f1e55b9ae398", "address": "fa:16:3e:92:c4:4b", "network": {"id": "22eed29e-7148-42f9-b4c7-b97811cba8eb", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2000485731-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46457b27e3ed416e827c3c22449fb512", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37ce4717-9a", "ovs_interfaceid": "37ce4717-9a82-41c6-9d89-f1e55b9ae398", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 09:57:26 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-3af934ac-9659-479a-8756-f214532c71f9 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:92:c4:4b,bridge_name='br-int',has_traffic_filtering=True,id=37ce4717-9a82-41c6-9d89-f1e55b9ae398,network=Network(22eed29e-7148-42f9-b4c7-b97811cba8eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37ce4717-9a') {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 09:57:26 user nova-compute[75229]: DEBUG os_vif [None req-3af934ac-9659-479a-8756-f214532c71f9 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:92:c4:4b,bridge_name='br-int',has_traffic_filtering=True,id=37ce4717-9a82-41c6-9d89-f1e55b9ae398,network=Network(22eed29e-7148-42f9-b4c7-b97811cba8eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37ce4717-9a') {{(pid=75229) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 09:57:26 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:57:26 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:57:26 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 09:57:26 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:57:26 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e1d8c5af-32d9-54d1-b94d-5f449cecf552', '_type': 'linux-noop'}}, row=False) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:57:26 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:57:26 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 09:57:26 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:57:26 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:57:26 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap37ce4717-9a, may_exist=True, interface_attrs={}) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:57:26 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap37ce4717-9a, col_values=(('qos', UUID('cb0c383a-53c2-42d9-8b11-aa3d781afe84')),), if_exists=True) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:57:26 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap37ce4717-9a, col_values=(('external_ids', {'iface-id': '37ce4717-9a82-41c6-9d89-f1e55b9ae398', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:92:c4:4b', 'vm-uuid': 'abb8e340-164d-4bc2-a503-7e8ea3c9b35b'}),), if_exists=True) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:57:26 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:57:26 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 09:57:26 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:57:26 user nova-compute[75229]: INFO os_vif [None req-3af934ac-9659-479a-8756-f214532c71f9 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:92:c4:4b,bridge_name='br-int',has_traffic_filtering=True,id=37ce4717-9a82-41c6-9d89-f1e55b9ae398,network=Network(22eed29e-7148-42f9-b4c7-b97811cba8eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37ce4717-9a')
Nov 14 09:57:26 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-3af934ac-9659-479a-8756-f214532c71f9 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] No BDM found with device name vda, not building metadata. {{(pid=75229) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 09:57:26 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-3af934ac-9659-479a-8756-f214532c71f9 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] No VIF found with MAC fa:16:3e:92:c4:4b, not building metadata {{(pid=75229) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 09:57:26 user nova-compute[75229]: DEBUG nova.network.neutron [req-b2df78f3-5434-4ab7-a70b-50e756e4a150 req-292b3cf5-f8ab-4797-b001-0b29b2e262a3 service nova] [instance: abb8e340-164d-4bc2-a503-7e8ea3c9b35b] Updated VIF entry in instance network info cache for port 37ce4717-9a82-41c6-9d89-f1e55b9ae398. {{(pid=75229) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 09:57:26 user nova-compute[75229]: DEBUG nova.network.neutron [req-b2df78f3-5434-4ab7-a70b-50e756e4a150 req-292b3cf5-f8ab-4797-b001-0b29b2e262a3 service nova] [instance: abb8e340-164d-4bc2-a503-7e8ea3c9b35b] Updating instance_info_cache with network_info: [{"id": "37ce4717-9a82-41c6-9d89-f1e55b9ae398", "address": "fa:16:3e:92:c4:4b", "network": {"id": "22eed29e-7148-42f9-b4c7-b97811cba8eb", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2000485731-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46457b27e3ed416e827c3c22449fb512", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37ce4717-9a", "ovs_interfaceid": "37ce4717-9a82-41c6-9d89-f1e55b9ae398", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 09:57:26 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-b2df78f3-5434-4ab7-a70b-50e756e4a150 req-292b3cf5-f8ab-4797-b001-0b29b2e262a3 service nova] Releasing lock "refresh_cache-abb8e340-164d-4bc2-a503-7e8ea3c9b35b" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 09:57:27 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:57:28 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:57:28 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:57:28 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:57:28 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:57:28 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:57:28 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:57:28 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:57:28 user nova-compute[75229]: DEBUG nova.compute.manager [req-900797ed-b2be-48f3-9e81-362a5f6c7634 req-70ffe0e7-fddb-435b-9d66-12e07280636b service nova] [instance: 589f4750-fac6-4e99-a430-0cda339808bc] Received event network-vif-plugged-e10815ba-0472-4ed0-af80-b4d0904580af {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:57:28 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-900797ed-b2be-48f3-9e81-362a5f6c7634 req-70ffe0e7-fddb-435b-9d66-12e07280636b service nova] Acquiring lock "589f4750-fac6-4e99-a430-0cda339808bc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:57:28 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-900797ed-b2be-48f3-9e81-362a5f6c7634 req-70ffe0e7-fddb-435b-9d66-12e07280636b service nova] Lock "589f4750-fac6-4e99-a430-0cda339808bc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:57:28 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-900797ed-b2be-48f3-9e81-362a5f6c7634 req-70ffe0e7-fddb-435b-9d66-12e07280636b service nova] Lock "589f4750-fac6-4e99-a430-0cda339808bc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:57:28 user nova-compute[75229]: DEBUG nova.compute.manager [req-900797ed-b2be-48f3-9e81-362a5f6c7634 req-70ffe0e7-fddb-435b-9d66-12e07280636b service nova] [instance: 589f4750-fac6-4e99-a430-0cda339808bc] No waiting events found dispatching network-vif-plugged-e10815ba-0472-4ed0-af80-b4d0904580af {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 09:57:28 user nova-compute[75229]: WARNING nova.compute.manager [req-900797ed-b2be-48f3-9e81-362a5f6c7634 req-70ffe0e7-fddb-435b-9d66-12e07280636b service nova] [instance: 589f4750-fac6-4e99-a430-0cda339808bc] Received unexpected event network-vif-plugged-e10815ba-0472-4ed0-af80-b4d0904580af for instance with vm_state active and task_state resize_finish.
Nov 14 09:57:28 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:57:28 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:57:28 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:57:28 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:57:28 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:57:30 user nova-compute[75229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7d4bf66e-30a7-4a4c-9919-d00645ad1868 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] [instance: 9cdd6b32-d4bd-4135-a58e-fbc3b6d2a093] Calling os-brick to attach iSCSI Volume {{(pid=75229) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 09:57:30 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d4bf66e-30a7-4a4c-9919-d00645ad1868 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f73f85151b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:94a0a817-0b71-4589-90eb-8c8d159f7fd2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ivMLsape', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 09:57:30 user nova-compute[75229]: WARNING os_brick.initiator.connectors.base [None req-7d4bf66e-30a7-4a4c-9919-d00645ad1868 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 09:57:30 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-7d4bf66e-30a7-4a4c-9919-d00645ad1868 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 09:57:30 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-7d4bf66e-30a7-4a4c-9919-d00645ad1868 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 09:57:30 user nova-compute[75229]: WARNING os_brick.initiator.connectors.base [None req-7d4bf66e-30a7-4a4c-9919-d00645ad1868 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 09:57:30 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-7d4bf66e-30a7-4a4c-9919-d00645ad1868 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:94a0a817-0b71-4589-90eb-8c8d159f7fd2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 09:57:30 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-7d4bf66e-30a7-4a4c-9919-d00645ad1868 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:94a0a817-0b71-4589-90eb-8c8d159f7fd2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 09:57:30 user nova-compute[75229]: INFO os_brick.initiator.connectors.iscsi [None req-7d4bf66e-30a7-4a4c-9919-d00645ad1868 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 09:57:30 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94a0a817-0b71-4589-90eb-8c8d159f7fd2 -p 172.16.0.220:3260 {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:57:30 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94a0a817-0b71-4589-90eb-8c8d159f7fd2 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:57:30 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[a35512e6-9143-4536-977e-27aff42dbde5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:57:30 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d4bf66e-30a7-4a4c-9919-d00645ad1868 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 09:57:30 user nova-compute[75229]:  {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:57:30 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94a0a817-0b71-4589-90eb-8c8d159f7fd2 -p 172.16.0.220:3260 --interface default --op new {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:57:30 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94a0a817-0b71-4589-90eb-8c8d159f7fd2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:57:30 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[c47b042d-e9b7-4ff4-930e-277973f43259]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:94a0a817-0b71-4589-90eb-8c8d159f7fd2] added\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:57:30 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d4bf66e-30a7-4a4c-9919-d00645ad1868 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:94a0a817-0b71-4589-90eb-8c8d159f7fd2] added
Nov 14 09:57:30 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:57:30 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94a0a817-0b71-4589-90eb-8c8d159f7fd2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:57:30 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94a0a817-0b71-4589-90eb-8c8d159f7fd2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:57:30 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc587798-f1fe-4cd8-b72d-e2b71f6dbd49]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:57:30 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d4bf66e-30a7-4a4c-9919-d00645ad1868 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:57:30 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94a0a817-0b71-4589-90eb-8c8d159f7fd2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:57:30 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94a0a817-0b71-4589-90eb-8c8d159f7fd2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:57:30 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[e446f1f0-4d22-4a4d-b3bd-af9f02ab6a9d]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:57:30 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d4bf66e-30a7-4a4c-9919-d00645ad1868 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:57:30 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94a0a817-0b71-4589-90eb-8c8d159f7fd2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ivMLsape {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:57:30 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94a0a817-0b71-4589-90eb-8c8d159f7fd2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ivMLsape" returned: 0 in 0.019s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:57:30 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a498b7c-356c-40f6-9a14-907bf1e27ddd]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:57:30 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d4bf66e-30a7-4a4c-9919-d00645ad1868 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ivMLsape'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:57:30 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94a0a817-0b71-4589-90eb-8c8d159f7fd2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:57:30 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94a0a817-0b71-4589-90eb-8c8d159f7fd2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:57:30 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc2c3ddb-78f9-4b3f-8813-cee6d9bf7586]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:57:30 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d4bf66e-30a7-4a4c-9919-d00645ad1868 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:57:30 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:57:30 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:57:30 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bc0fde9-d870-4030-b6b9-efbda035031e]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aebc438-0289-44fe-ad84-4e696468f50e (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5efb0e0-a85c-46ec-8a9d-2763bf548023 (non-flash)\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:57:30 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d4bf66e-30a7-4a4c-9919-d00645ad1868 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aebc438-0289-44fe-ad84-4e696468f50e (non-flash)
Nov 14 09:57:30 user nova-compute[75229]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5efb0e0-a85c-46ec-8a9d-2763bf548023 (non-flash)
Nov 14 09:57:30 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 09:57:30 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d4bf66e-30a7-4a4c-9919-d00645ad1868 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aebc438-0289-44fe-ad84-4e696468f50e (non-flash)
Nov 14 09:57:30 user nova-compute[75229]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5efb0e0-a85c-46ec-8a9d-2763bf548023 (non-flash)
Nov 14 09:57:30 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 09:57:30 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94a0a817-0b71-4589-90eb-8c8d159f7fd2 -p 172.16.0.220:3260 --login {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:57:30 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94a0a817-0b71-4589-90eb-8c8d159f7fd2 -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:57:30 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b4bc610-83ab-476f-9738-48333f87d052]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:94a0a817-0b71-4589-90eb-8c8d159f7fd2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:94a0a817-0b71-4589-90eb-8c8d159f7fd2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:57:30 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d4bf66e-30a7-4a4c-9919-d00645ad1868 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:94a0a817-0b71-4589-90eb-8c8d159f7fd2, portal: 172.16.0.220,3260]
Nov 14 09:57:30 user nova-compute[75229]: Login to [iface: default, target: iqn.2010-10.org.openstack:94a0a817-0b71-4589-90eb-8c8d159f7fd2, portal: 172.16.0.220,3260] successful.
Nov 14 09:57:30 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:57:30 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94a0a817-0b71-4589-90eb-8c8d159f7fd2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:57:30 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94a0a817-0b71-4589-90eb-8c8d159f7fd2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:57:30 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[4443bc57-e7a4-474f-8eb4-22f7f9426f46]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:57:30 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d4bf66e-30a7-4a4c-9919-d00645ad1868 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:57:30 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:57:30 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:57:30 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd5eb797-c0d6-49a6-8496-31fe820547dd]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aebc438-0289-44fe-ad84-4e696468f50e (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5efb0e0-a85c-46ec-8a9d-2763bf548023 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94a0a817-0b71-4589-90eb-8c8d159f7fd2 (non-flash)\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:57:30 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d4bf66e-30a7-4a4c-9919-d00645ad1868 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aebc438-0289-44fe-ad84-4e696468f50e (non-flash)
Nov 14 09:57:30 user nova-compute[75229]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5efb0e0-a85c-46ec-8a9d-2763bf548023 (non-flash)
Nov 14 09:57:30 user nova-compute[75229]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94a0a817-0b71-4589-90eb-8c8d159f7fd2 (non-flash)
Nov 14 09:57:30 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 09:57:30 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d4bf66e-30a7-4a4c-9919-d00645ad1868 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aebc438-0289-44fe-ad84-4e696468f50e (non-flash)
Nov 14 09:57:30 user nova-compute[75229]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5efb0e0-a85c-46ec-8a9d-2763bf548023 (non-flash)
Nov 14 09:57:30 user nova-compute[75229]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94a0a817-0b71-4589-90eb-8c8d159f7fd2 (non-flash)
Nov 14 09:57:30 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 09:57:30 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-7d4bf66e-30a7-4a4c-9919-d00645ad1868 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:94a0a817-0b71-4589-90eb-8c8d159f7fd2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.295s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 09:57:30 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d4bf66e-30a7-4a4c-9919-d00645ad1868 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] Connected to 172.16.0.220:3260 {{(pid=75229) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 09:57:30 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-7d4bf66e-30a7-4a4c-9919-d00645ad1868 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] HCTL ('35', '-', '-', 0) found on session 36 with lun 0 {{(pid=75229) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 09:57:30 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-7d4bf66e-30a7-4a4c-9919-d00645ad1868 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75229) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 09:57:30 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:57:30 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.030s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:57:30 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f7d8576-a443-4541-8967-7f6fb06529c5]: (4, ('- - 0', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:57:30 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-7d4bf66e-30a7-4a4c-9919-d00645ad1868 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] Searching for a device in session 36 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75229) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 09:57:30 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d4bf66e-30a7-4a4c-9919-d00645ad1868 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:94a0a817-0b71-4589-90eb-8c8d159f7fd2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ivMLsape', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75229) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 09:57:30 user nova-compute[75229]: DEBUG nova.compute.manager [req-b5afb17d-502d-4452-ad86-d827eed5b8e0 req-cf0b2cf7-f475-424f-8895-24ec5737db16 service nova] [instance: 589f4750-fac6-4e99-a430-0cda339808bc] Received event network-vif-plugged-e10815ba-0472-4ed0-af80-b4d0904580af {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:57:30 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-b5afb17d-502d-4452-ad86-d827eed5b8e0 req-cf0b2cf7-f475-424f-8895-24ec5737db16 service nova] Acquiring lock "589f4750-fac6-4e99-a430-0cda339808bc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:57:30 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-b5afb17d-502d-4452-ad86-d827eed5b8e0 req-cf0b2cf7-f475-424f-8895-24ec5737db16 service nova] Lock "589f4750-fac6-4e99-a430-0cda339808bc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:57:30 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-b5afb17d-502d-4452-ad86-d827eed5b8e0 req-cf0b2cf7-f475-424f-8895-24ec5737db16 service nova] Lock "589f4750-fac6-4e99-a430-0cda339808bc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:57:30 user nova-compute[75229]: DEBUG nova.compute.manager [req-b5afb17d-502d-4452-ad86-d827eed5b8e0 req-cf0b2cf7-f475-424f-8895-24ec5737db16 service nova] [instance: 589f4750-fac6-4e99-a430-0cda339808bc] No waiting events found dispatching network-vif-plugged-e10815ba-0472-4ed0-af80-b4d0904580af {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 09:57:30 user nova-compute[75229]: WARNING nova.compute.manager [req-b5afb17d-502d-4452-ad86-d827eed5b8e0 req-cf0b2cf7-f475-424f-8895-24ec5737db16 service nova] [instance: 589f4750-fac6-4e99-a430-0cda339808bc] Received unexpected event network-vif-plugged-e10815ba-0472-4ed0-af80-b4d0904580af for instance with vm_state active and task_state resize_finish.
Nov 14 09:57:30 user nova-compute[75229]: DEBUG nova.compute.manager [req-b5afb17d-502d-4452-ad86-d827eed5b8e0 req-cf0b2cf7-f475-424f-8895-24ec5737db16 service nova] [instance: abb8e340-164d-4bc2-a503-7e8ea3c9b35b] Received event network-vif-plugged-37ce4717-9a82-41c6-9d89-f1e55b9ae398 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:57:30 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-b5afb17d-502d-4452-ad86-d827eed5b8e0 req-cf0b2cf7-f475-424f-8895-24ec5737db16 service nova] Acquiring lock "abb8e340-164d-4bc2-a503-7e8ea3c9b35b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:57:30 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-b5afb17d-502d-4452-ad86-d827eed5b8e0 req-cf0b2cf7-f475-424f-8895-24ec5737db16 service nova] Lock "abb8e340-164d-4bc2-a503-7e8ea3c9b35b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:57:30 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-b5afb17d-502d-4452-ad86-d827eed5b8e0 req-cf0b2cf7-f475-424f-8895-24ec5737db16 service nova] Lock "abb8e340-164d-4bc2-a503-7e8ea3c9b35b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:57:30 user nova-compute[75229]: DEBUG nova.compute.manager [req-b5afb17d-502d-4452-ad86-d827eed5b8e0 req-cf0b2cf7-f475-424f-8895-24ec5737db16 service nova] [instance: abb8e340-164d-4bc2-a503-7e8ea3c9b35b] No waiting events found dispatching network-vif-plugged-37ce4717-9a82-41c6-9d89-f1e55b9ae398 {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 09:57:30 user nova-compute[75229]: WARNING nova.compute.manager [req-b5afb17d-502d-4452-ad86-d827eed5b8e0 req-cf0b2cf7-f475-424f-8895-24ec5737db16 service nova] [instance: abb8e340-164d-4bc2-a503-7e8ea3c9b35b] Received unexpected event network-vif-plugged-37ce4717-9a82-41c6-9d89-f1e55b9ae398 for instance with vm_state building and task_state spawning.
Nov 14 09:57:30 user nova-compute[75229]: DEBUG nova.compute.manager [req-b5afb17d-502d-4452-ad86-d827eed5b8e0 req-cf0b2cf7-f475-424f-8895-24ec5737db16 service nova] [instance: abb8e340-164d-4bc2-a503-7e8ea3c9b35b] Received event network-vif-plugged-37ce4717-9a82-41c6-9d89-f1e55b9ae398 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:57:30 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-b5afb17d-502d-4452-ad86-d827eed5b8e0 req-cf0b2cf7-f475-424f-8895-24ec5737db16 service nova] Acquiring lock "abb8e340-164d-4bc2-a503-7e8ea3c9b35b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:57:30 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-b5afb17d-502d-4452-ad86-d827eed5b8e0 req-cf0b2cf7-f475-424f-8895-24ec5737db16 service nova] Lock "abb8e340-164d-4bc2-a503-7e8ea3c9b35b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:57:30 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-b5afb17d-502d-4452-ad86-d827eed5b8e0 req-cf0b2cf7-f475-424f-8895-24ec5737db16 service nova] Lock "abb8e340-164d-4bc2-a503-7e8ea3c9b35b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:57:30 user nova-compute[75229]: DEBUG nova.compute.manager [req-b5afb17d-502d-4452-ad86-d827eed5b8e0 req-cf0b2cf7-f475-424f-8895-24ec5737db16 service nova] [instance: abb8e340-164d-4bc2-a503-7e8ea3c9b35b] No waiting events found dispatching network-vif-plugged-37ce4717-9a82-41c6-9d89-f1e55b9ae398 {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 09:57:30 user nova-compute[75229]: WARNING nova.compute.manager [req-b5afb17d-502d-4452-ad86-d827eed5b8e0 req-cf0b2cf7-f475-424f-8895-24ec5737db16 service nova] [instance: abb8e340-164d-4bc2-a503-7e8ea3c9b35b] Received unexpected event network-vif-plugged-37ce4717-9a82-41c6-9d89-f1e55b9ae398 for instance with vm_state building and task_state spawning.
Nov 14 09:57:31 user nova-compute[75229]: DEBUG nova.compute.manager [None req-c0ce5a41-ee4e-4f8b-b50b-3e72f0e879b8 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] [instance: 589f4750-fac6-4e99-a430-0cda339808bc] Instance event wait completed in 0 seconds for  {{(pid=75229) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 09:57:31 user nova-compute[75229]: INFO nova.virt.libvirt.driver [-] [instance: 589f4750-fac6-4e99-a430-0cda339808bc] Instance running successfully.
Nov 14 09:57:31 user nova-compute[75229]: DEBUG nova.virt.libvirt.guest [None req-c0ce5a41-ee4e-4f8b-b50b-3e72f0e879b8 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] [instance: 589f4750-fac6-4e99-a430-0cda339808bc] Failed to set time: agent not configured {{(pid=75229) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Nov 14 09:57:31 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-c0ce5a41-ee4e-4f8b-b50b-3e72f0e879b8 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] [instance: 589f4750-fac6-4e99-a430-0cda339808bc] finish_migration finished successfully. {{(pid=75229) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Nov 14 09:57:31 user nova-compute[75229]: DEBUG nova.compute.manager [None req-3af934ac-9659-479a-8756-f214532c71f9 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] [instance: abb8e340-164d-4bc2-a503-7e8ea3c9b35b] Instance event wait completed in 0 seconds for  {{(pid=75229) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 09:57:31 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-3af934ac-9659-479a-8756-f214532c71f9 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] [instance: abb8e340-164d-4bc2-a503-7e8ea3c9b35b] Guest created on hypervisor {{(pid=75229) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 09:57:31 user nova-compute[75229]: INFO nova.virt.libvirt.driver [-] [instance: abb8e340-164d-4bc2-a503-7e8ea3c9b35b] Instance spawned successfully.
Nov 14 09:57:31 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-3af934ac-9659-479a-8756-f214532c71f9 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] [instance: abb8e340-164d-4bc2-a503-7e8ea3c9b35b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 09:57:31 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-3af934ac-9659-479a-8756-f214532c71f9 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] [instance: abb8e340-164d-4bc2-a503-7e8ea3c9b35b] Found default for hw_cdrom_bus of ide {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 09:57:31 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-3af934ac-9659-479a-8756-f214532c71f9 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] [instance: abb8e340-164d-4bc2-a503-7e8ea3c9b35b] Found default for hw_disk_bus of virtio {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 09:57:31 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-3af934ac-9659-479a-8756-f214532c71f9 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] [instance: abb8e340-164d-4bc2-a503-7e8ea3c9b35b] Found default for hw_input_bus of None {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 09:57:31 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-3af934ac-9659-479a-8756-f214532c71f9 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] [instance: abb8e340-164d-4bc2-a503-7e8ea3c9b35b] Found default for hw_pointer_model of None {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 09:57:31 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-3af934ac-9659-479a-8756-f214532c71f9 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] [instance: abb8e340-164d-4bc2-a503-7e8ea3c9b35b] Found default for hw_video_model of virtio {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 09:57:31 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-3af934ac-9659-479a-8756-f214532c71f9 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] [instance: abb8e340-164d-4bc2-a503-7e8ea3c9b35b] Found default for hw_vif_model of virtio {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 09:57:31 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:57:31 user nova-compute[75229]: INFO nova.compute.manager [None req-3af934ac-9659-479a-8756-f214532c71f9 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] [instance: abb8e340-164d-4bc2-a503-7e8ea3c9b35b] Took 6.81 seconds to spawn the instance on the hypervisor.
Nov 14 09:57:31 user nova-compute[75229]: DEBUG nova.compute.manager [None req-3af934ac-9659-479a-8756-f214532c71f9 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] [instance: abb8e340-164d-4bc2-a503-7e8ea3c9b35b] Checking state {{(pid=75229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 09:57:31 user nova-compute[75229]: INFO nova.compute.manager [None req-3af934ac-9659-479a-8756-f214532c71f9 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] [instance: abb8e340-164d-4bc2-a503-7e8ea3c9b35b] Took 7.71 seconds to build instance.
Nov 14 09:57:31 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-3af934ac-9659-479a-8756-f214532c71f9 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Lock "abb8e340-164d-4bc2-a503-7e8ea3c9b35b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.834s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:57:31 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-7d4bf66e-30a7-4a4c-9919-d00645ad1868 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.339s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 09:57:31 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d4bf66e-30a7-4a4c-9919-d00645ad1868 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] <== connect_volume: return (1342ms) {'type': 'block', 'scsi_wwn': '26430363165633430', 'path': '/dev/sdd'} {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 09:57:31 user nova-compute[75229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7d4bf66e-30a7-4a4c-9919-d00645ad1868 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] [instance: 9cdd6b32-d4bd-4135-a58e-fbc3b6d2a093] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26430363165633430', 'path': '/dev/sdd'} {{(pid=75229) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 09:57:31 user nova-compute[75229]: DEBUG nova.objects.instance [None req-7d4bf66e-30a7-4a4c-9919-d00645ad1868 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] Lazy-loading 'flavor' on Instance uuid 9cdd6b32-d4bd-4135-a58e-fbc3b6d2a093 {{(pid=75229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 09:57:31 user nova-compute[75229]: DEBUG nova.virt.libvirt.guest [None req-7d4bf66e-30a7-4a4c-9919-d00645ad1868 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 09:57:31 user nova-compute[75229]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 09:57:31 user nova-compute[75229]:   <source dev="/dev/sdd"/>
Nov 14 09:57:31 user nova-compute[75229]:   <target dev="vdb" bus="virtio"/>
Nov 14 09:57:31 user nova-compute[75229]:   <serial>94a0a817-0b71-4589-90eb-8c8d159f7fd2</serial>
Nov 14 09:57:31 user nova-compute[75229]: </disk>
Nov 14 09:57:31 user nova-compute[75229]:  {{(pid=75229) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 09:57:32 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:57:32 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-7d4bf66e-30a7-4a4c-9919-d00645ad1868 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] No BDM found with device name vda, not building metadata. {{(pid=75229) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 09:57:32 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-7d4bf66e-30a7-4a4c-9919-d00645ad1868 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75229) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 09:57:32 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-7d4bf66e-30a7-4a4c-9919-d00645ad1868 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] No VIF found with MAC fa:16:3e:f8:75:16, not building metadata {{(pid=75229) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 09:57:32 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-7d4bf66e-30a7-4a4c-9919-d00645ad1868 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] Lock "9cdd6b32-d4bd-4135-a58e-fbc3b6d2a093" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.762s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:57:33 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:57:34 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:57:34 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-51acf880-c73e-45de-82f1-842597711bdc tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Acquiring lock "57da589c-863c-42a8-8802-314a499ebc29" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:57:34 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-51acf880-c73e-45de-82f1-842597711bdc tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Lock "57da589c-863c-42a8-8802-314a499ebc29" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:57:34 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-51acf880-c73e-45de-82f1-842597711bdc tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Acquiring lock "57da589c-863c-42a8-8802-314a499ebc29-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:57:34 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-51acf880-c73e-45de-82f1-842597711bdc tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Lock "57da589c-863c-42a8-8802-314a499ebc29-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:57:34 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-51acf880-c73e-45de-82f1-842597711bdc tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Lock "57da589c-863c-42a8-8802-314a499ebc29-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:57:34 user nova-compute[75229]: INFO nova.compute.manager [None req-51acf880-c73e-45de-82f1-842597711bdc tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] [instance: 57da589c-863c-42a8-8802-314a499ebc29] Terminating instance
Nov 14 09:57:34 user nova-compute[75229]: DEBUG nova.compute.manager [None req-51acf880-c73e-45de-82f1-842597711bdc tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] [instance: 57da589c-863c-42a8-8802-314a499ebc29] Start destroying the instance on the hypervisor. {{(pid=75229) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 09:57:34 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:57:34 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:57:34 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:57:34 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:57:34 user nova-compute[75229]: DEBUG nova.compute.manager [req-91a22c9b-a157-41bc-9ea8-57ad64a2ac0f req-1e6390cd-3fc0-40cc-8313-189001fa6e78 service nova] [instance: 57da589c-863c-42a8-8802-314a499ebc29] Received event network-vif-unplugged-b570f667-506d-47ce-b69b-d4416514ef63 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:57:34 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-91a22c9b-a157-41bc-9ea8-57ad64a2ac0f req-1e6390cd-3fc0-40cc-8313-189001fa6e78 service nova] Acquiring lock "57da589c-863c-42a8-8802-314a499ebc29-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:57:34 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-91a22c9b-a157-41bc-9ea8-57ad64a2ac0f req-1e6390cd-3fc0-40cc-8313-189001fa6e78 service nova] Lock "57da589c-863c-42a8-8802-314a499ebc29-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:57:34 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-91a22c9b-a157-41bc-9ea8-57ad64a2ac0f req-1e6390cd-3fc0-40cc-8313-189001fa6e78 service nova] Lock "57da589c-863c-42a8-8802-314a499ebc29-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:57:34 user nova-compute[75229]: DEBUG nova.compute.manager [req-91a22c9b-a157-41bc-9ea8-57ad64a2ac0f req-1e6390cd-3fc0-40cc-8313-189001fa6e78 service nova] [instance: 57da589c-863c-42a8-8802-314a499ebc29] No waiting events found dispatching network-vif-unplugged-b570f667-506d-47ce-b69b-d4416514ef63 {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 09:57:34 user nova-compute[75229]: DEBUG nova.compute.manager [req-91a22c9b-a157-41bc-9ea8-57ad64a2ac0f req-1e6390cd-3fc0-40cc-8313-189001fa6e78 service nova] [instance: 57da589c-863c-42a8-8802-314a499ebc29] Received event network-vif-unplugged-b570f667-506d-47ce-b69b-d4416514ef63 for instance with task_state deleting. {{(pid=75229) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 09:57:34 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:57:35 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:57:35 user nova-compute[75229]: INFO nova.virt.libvirt.driver [-] [instance: 57da589c-863c-42a8-8802-314a499ebc29] Instance destroyed successfully.
Nov 14 09:57:35 user nova-compute[75229]: DEBUG nova.objects.instance [None req-51acf880-c73e-45de-82f1-842597711bdc tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Lazy-loading 'resources' on Instance uuid 57da589c-863c-42a8-8802-314a499ebc29 {{(pid=75229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 09:57:35 user nova-compute[75229]: DEBUG nova.virt.libvirt.vif [None req-51acf880-c73e-45de-82f1-842597711bdc tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T09:54:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-623194614',display_name='tempest-AttachVolumeNegativeTest-server-623194614',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-623194614',id=31,image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIsfr8HU0VHYjIy5w1P2+mPftKRogBYBm9pEZK2RTD9jC+sVXq3vMmHy7GFbw68+sHuKrWbc4J/gU4gRIaVLJfSuuxaraEgdrz/NT1hTKfvcxI3hsx3LBJvKefJId6kOrg==',key_name='tempest-keypair-820004043',keypairs=<?>,launch_index=0,launched_at=2023-11-14T09:54:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8b8d48c38c7344f5b12d0ed5b9392554',ramdisk_id='',reservation_id='r-tr8jk5m0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-140392099',owner_user_name='tempest-AttachVolumeNegativeTest-140392099-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T09:54:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3b8313e365eb4970a58c412768e959bf',uuid=57da589c-863c-42a8-8802-314a499ebc29,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b570f667-506d-47ce-b69b-d4416514ef63", "address": "fa:16:3e:c8:8e:cd", "network": {"id": "bd407caa-6ef6-400d-9327-3179dc1d8da4", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-29933774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b8d48c38c7344f5b12d0ed5b9392554", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb570f667-50", "ovs_interfaceid": "b570f667-506d-47ce-b69b-d4416514ef63", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 09:57:35 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-51acf880-c73e-45de-82f1-842597711bdc tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Converting VIF {"id": "b570f667-506d-47ce-b69b-d4416514ef63", "address": "fa:16:3e:c8:8e:cd", "network": {"id": "bd407caa-6ef6-400d-9327-3179dc1d8da4", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-29933774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b8d48c38c7344f5b12d0ed5b9392554", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb570f667-50", "ovs_interfaceid": "b570f667-506d-47ce-b69b-d4416514ef63", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 09:57:35 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-51acf880-c73e-45de-82f1-842597711bdc tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c8:8e:cd,bridge_name='br-int',has_traffic_filtering=True,id=b570f667-506d-47ce-b69b-d4416514ef63,network=Network(bd407caa-6ef6-400d-9327-3179dc1d8da4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb570f667-50') {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 09:57:35 user nova-compute[75229]: DEBUG os_vif [None req-51acf880-c73e-45de-82f1-842597711bdc tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c8:8e:cd,bridge_name='br-int',has_traffic_filtering=True,id=b570f667-506d-47ce-b69b-d4416514ef63,network=Network(bd407caa-6ef6-400d-9327-3179dc1d8da4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb570f667-50') {{(pid=75229) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 09:57:35 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:57:35 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb570f667-50, bridge=br-int, if_exists=True) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:57:35 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:57:35 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 09:57:35 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:57:35 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c3eaddb9-6b07-438a-a9a0-b2f2f901d898) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:57:35 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:57:35 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 09:57:35 user nova-compute[75229]: INFO os_vif [None req-51acf880-c73e-45de-82f1-842597711bdc tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c8:8e:cd,bridge_name='br-int',has_traffic_filtering=True,id=b570f667-506d-47ce-b69b-d4416514ef63,network=Network(bd407caa-6ef6-400d-9327-3179dc1d8da4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb570f667-50')
Nov 14 09:57:35 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-51acf880-c73e-45de-82f1-842597711bdc tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] [instance: 57da589c-863c-42a8-8802-314a499ebc29] Deleting instance files /opt/stack/data/nova/instances/57da589c-863c-42a8-8802-314a499ebc29_del
Nov 14 09:57:35 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-51acf880-c73e-45de-82f1-842597711bdc tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] [instance: 57da589c-863c-42a8-8802-314a499ebc29] Deletion of /opt/stack/data/nova/instances/57da589c-863c-42a8-8802-314a499ebc29_del complete
Nov 14 09:57:35 user nova-compute[75229]: INFO nova.compute.manager [None req-51acf880-c73e-45de-82f1-842597711bdc tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] [instance: 57da589c-863c-42a8-8802-314a499ebc29] Took 0.95 seconds to destroy the instance on the hypervisor.
Nov 14 09:57:35 user nova-compute[75229]: DEBUG oslo.service.loopingcall [None req-51acf880-c73e-45de-82f1-842597711bdc tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75229) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 09:57:35 user nova-compute[75229]: DEBUG nova.compute.manager [-] [instance: 57da589c-863c-42a8-8802-314a499ebc29] Deallocating network for instance {{(pid=75229) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 09:57:35 user nova-compute[75229]: DEBUG nova.network.neutron [-] [instance: 57da589c-863c-42a8-8802-314a499ebc29] deallocate_for_instance() {{(pid=75229) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 09:57:35 user nova-compute[75229]: DEBUG nova.compute.manager [req-236bc1bb-7f40-4ab5-93cb-1dd0e69ec406 req-30158f10-b8c5-4483-a9de-2c9f0e2c79a0 service nova] [instance: 9cdd6b32-d4bd-4135-a58e-fbc3b6d2a093] Received event network-changed-5b06ed49-fa0b-4b58-ad6e-a092a9c1d14c {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:57:35 user nova-compute[75229]: DEBUG nova.compute.manager [req-236bc1bb-7f40-4ab5-93cb-1dd0e69ec406 req-30158f10-b8c5-4483-a9de-2c9f0e2c79a0 service nova] [instance: 9cdd6b32-d4bd-4135-a58e-fbc3b6d2a093] Refreshing instance network info cache due to event network-changed-5b06ed49-fa0b-4b58-ad6e-a092a9c1d14c. {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 09:57:35 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-236bc1bb-7f40-4ab5-93cb-1dd0e69ec406 req-30158f10-b8c5-4483-a9de-2c9f0e2c79a0 service nova] Acquiring lock "refresh_cache-9cdd6b32-d4bd-4135-a58e-fbc3b6d2a093" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 09:57:35 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-236bc1bb-7f40-4ab5-93cb-1dd0e69ec406 req-30158f10-b8c5-4483-a9de-2c9f0e2c79a0 service nova] Acquired lock "refresh_cache-9cdd6b32-d4bd-4135-a58e-fbc3b6d2a093" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 09:57:35 user nova-compute[75229]: DEBUG nova.network.neutron [req-236bc1bb-7f40-4ab5-93cb-1dd0e69ec406 req-30158f10-b8c5-4483-a9de-2c9f0e2c79a0 service nova] [instance: 9cdd6b32-d4bd-4135-a58e-fbc3b6d2a093] Refreshing network info cache for port 5b06ed49-fa0b-4b58-ad6e-a092a9c1d14c {{(pid=75229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 09:57:36 user nova-compute[75229]: DEBUG nova.network.neutron [-] [instance: 57da589c-863c-42a8-8802-314a499ebc29] Updating instance_info_cache with network_info: [] {{(pid=75229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 09:57:36 user nova-compute[75229]: INFO nova.compute.manager [-] [instance: 57da589c-863c-42a8-8802-314a499ebc29] Took 0.88 seconds to deallocate network for instance.
Nov 14 09:57:36 user nova-compute[75229]: DEBUG nova.compute.manager [req-dabd7a3b-cd9c-4b87-a29a-babe3c3bcbb1 req-26498086-aac4-4fc1-b124-21979470f37c service nova] [instance: 57da589c-863c-42a8-8802-314a499ebc29] Received event network-vif-deleted-b570f667-506d-47ce-b69b-d4416514ef63 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:57:36 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-51acf880-c73e-45de-82f1-842597711bdc tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:57:36 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-51acf880-c73e-45de-82f1-842597711bdc tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:57:36 user nova-compute[75229]: DEBUG nova.compute.provider_tree [None req-51acf880-c73e-45de-82f1-842597711bdc tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Inventory has not changed in ProviderTree for provider: d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 {{(pid=75229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 09:57:36 user nova-compute[75229]: DEBUG nova.scheduler.client.report [None req-51acf880-c73e-45de-82f1-842597711bdc tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Inventory has not changed for provider d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 09:57:36 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-51acf880-c73e-45de-82f1-842597711bdc tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.507s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:57:36 user nova-compute[75229]: DEBUG nova.compute.manager [req-939af0a1-7c0e-4476-b875-0422a518bb45 req-32b4a572-18b2-4d76-aafc-526da99ceda0 service nova] [instance: 57da589c-863c-42a8-8802-314a499ebc29] Received event network-vif-plugged-b570f667-506d-47ce-b69b-d4416514ef63 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:57:36 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-939af0a1-7c0e-4476-b875-0422a518bb45 req-32b4a572-18b2-4d76-aafc-526da99ceda0 service nova] Acquiring lock "57da589c-863c-42a8-8802-314a499ebc29-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:57:36 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-939af0a1-7c0e-4476-b875-0422a518bb45 req-32b4a572-18b2-4d76-aafc-526da99ceda0 service nova] Lock "57da589c-863c-42a8-8802-314a499ebc29-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:57:36 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-939af0a1-7c0e-4476-b875-0422a518bb45 req-32b4a572-18b2-4d76-aafc-526da99ceda0 service nova] Lock "57da589c-863c-42a8-8802-314a499ebc29-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:57:36 user nova-compute[75229]: DEBUG nova.compute.manager [req-939af0a1-7c0e-4476-b875-0422a518bb45 req-32b4a572-18b2-4d76-aafc-526da99ceda0 service nova] [instance: 57da589c-863c-42a8-8802-314a499ebc29] No waiting events found dispatching network-vif-plugged-b570f667-506d-47ce-b69b-d4416514ef63 {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 09:57:36 user nova-compute[75229]: WARNING nova.compute.manager [req-939af0a1-7c0e-4476-b875-0422a518bb45 req-32b4a572-18b2-4d76-aafc-526da99ceda0 service nova] [instance: 57da589c-863c-42a8-8802-314a499ebc29] Received unexpected event network-vif-plugged-b570f667-506d-47ce-b69b-d4416514ef63 for instance with vm_state deleted and task_state None.
Nov 14 09:57:36 user nova-compute[75229]: DEBUG nova.network.neutron [req-236bc1bb-7f40-4ab5-93cb-1dd0e69ec406 req-30158f10-b8c5-4483-a9de-2c9f0e2c79a0 service nova] [instance: 9cdd6b32-d4bd-4135-a58e-fbc3b6d2a093] Updated VIF entry in instance network info cache for port 5b06ed49-fa0b-4b58-ad6e-a092a9c1d14c. {{(pid=75229) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 09:57:36 user nova-compute[75229]: DEBUG nova.network.neutron [req-236bc1bb-7f40-4ab5-93cb-1dd0e69ec406 req-30158f10-b8c5-4483-a9de-2c9f0e2c79a0 service nova] [instance: 9cdd6b32-d4bd-4135-a58e-fbc3b6d2a093] Updating instance_info_cache with network_info: [{"id": "5b06ed49-fa0b-4b58-ad6e-a092a9c1d14c", "address": "fa:16:3e:f8:75:16", "network": {"id": "1687d918-9f70-4099-b44c-97f92f90e6ff", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2074208460-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.100", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a6157b9827b44d2bab197220b635fd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b06ed49-fa", "ovs_interfaceid": "5b06ed49-fa0b-4b58-ad6e-a092a9c1d14c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 09:57:36 user nova-compute[75229]: INFO nova.scheduler.client.report [None req-51acf880-c73e-45de-82f1-842597711bdc tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Deleted allocations for instance 57da589c-863c-42a8-8802-314a499ebc29
Nov 14 09:57:36 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-236bc1bb-7f40-4ab5-93cb-1dd0e69ec406 req-30158f10-b8c5-4483-a9de-2c9f0e2c79a0 service nova] Releasing lock "refresh_cache-9cdd6b32-d4bd-4135-a58e-fbc3b6d2a093" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 09:57:36 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-51acf880-c73e-45de-82f1-842597711bdc tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Lock "57da589c-863c-42a8-8802-314a499ebc29" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.611s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:57:38 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:57:38 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-1ced2b8c-79f0-44ec-9d6f-be6c20804819 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] Acquiring lock "9cdd6b32-d4bd-4135-a58e-fbc3b6d2a093" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:57:38 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-1ced2b8c-79f0-44ec-9d6f-be6c20804819 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] Lock "9cdd6b32-d4bd-4135-a58e-fbc3b6d2a093" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:57:38 user nova-compute[75229]: INFO nova.compute.manager [None req-1ced2b8c-79f0-44ec-9d6f-be6c20804819 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] [instance: 9cdd6b32-d4bd-4135-a58e-fbc3b6d2a093] Rebooting instance
Nov 14 09:57:38 user nova-compute[75229]: DEBUG nova.compute.manager [req-f313205d-98e5-441e-8d3b-e13142aea089 req-563b0899-0a94-4932-be71-6ab4577de797 service nova] [instance: 9cdd6b32-d4bd-4135-a58e-fbc3b6d2a093] Received event network-changed-5b06ed49-fa0b-4b58-ad6e-a092a9c1d14c {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:57:38 user nova-compute[75229]: DEBUG nova.compute.manager [req-f313205d-98e5-441e-8d3b-e13142aea089 req-563b0899-0a94-4932-be71-6ab4577de797 service nova] [instance: 9cdd6b32-d4bd-4135-a58e-fbc3b6d2a093] Refreshing instance network info cache due to event network-changed-5b06ed49-fa0b-4b58-ad6e-a092a9c1d14c. {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 09:57:38 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-f313205d-98e5-441e-8d3b-e13142aea089 req-563b0899-0a94-4932-be71-6ab4577de797 service nova] Acquiring lock "refresh_cache-9cdd6b32-d4bd-4135-a58e-fbc3b6d2a093" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 09:57:38 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-f313205d-98e5-441e-8d3b-e13142aea089 req-563b0899-0a94-4932-be71-6ab4577de797 service nova] Acquired lock "refresh_cache-9cdd6b32-d4bd-4135-a58e-fbc3b6d2a093" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 09:57:38 user nova-compute[75229]: DEBUG nova.network.neutron [req-f313205d-98e5-441e-8d3b-e13142aea089 req-563b0899-0a94-4932-be71-6ab4577de797 service nova] [instance: 9cdd6b32-d4bd-4135-a58e-fbc3b6d2a093] Refreshing network info cache for port 5b06ed49-fa0b-4b58-ad6e-a092a9c1d14c {{(pid=75229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 09:57:38 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-1ced2b8c-79f0-44ec-9d6f-be6c20804819 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] Acquiring lock "refresh_cache-9cdd6b32-d4bd-4135-a58e-fbc3b6d2a093" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 09:57:39 user nova-compute[75229]: DEBUG nova.network.neutron [req-f313205d-98e5-441e-8d3b-e13142aea089 req-563b0899-0a94-4932-be71-6ab4577de797 service nova] [instance: 9cdd6b32-d4bd-4135-a58e-fbc3b6d2a093] Updated VIF entry in instance network info cache for port 5b06ed49-fa0b-4b58-ad6e-a092a9c1d14c. {{(pid=75229) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 09:57:39 user nova-compute[75229]: DEBUG nova.network.neutron [req-f313205d-98e5-441e-8d3b-e13142aea089 req-563b0899-0a94-4932-be71-6ab4577de797 service nova] [instance: 9cdd6b32-d4bd-4135-a58e-fbc3b6d2a093] Updating instance_info_cache with network_info: [{"id": "5b06ed49-fa0b-4b58-ad6e-a092a9c1d14c", "address": "fa:16:3e:f8:75:16", "network": {"id": "1687d918-9f70-4099-b44c-97f92f90e6ff", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2074208460-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.100", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a6157b9827b44d2bab197220b635fd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b06ed49-fa", "ovs_interfaceid": "5b06ed49-fa0b-4b58-ad6e-a092a9c1d14c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 09:57:39 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-f313205d-98e5-441e-8d3b-e13142aea089 req-563b0899-0a94-4932-be71-6ab4577de797 service nova] Releasing lock "refresh_cache-9cdd6b32-d4bd-4135-a58e-fbc3b6d2a093" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 09:57:39 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-1ced2b8c-79f0-44ec-9d6f-be6c20804819 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] Acquired lock "refresh_cache-9cdd6b32-d4bd-4135-a58e-fbc3b6d2a093" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 09:57:39 user nova-compute[75229]: DEBUG nova.network.neutron [None req-1ced2b8c-79f0-44ec-9d6f-be6c20804819 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] [instance: 9cdd6b32-d4bd-4135-a58e-fbc3b6d2a093] Building network info cache for instance {{(pid=75229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 09:57:39 user nova-compute[75229]: DEBUG nova.network.neutron [None req-1ced2b8c-79f0-44ec-9d6f-be6c20804819 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] [instance: 9cdd6b32-d4bd-4135-a58e-fbc3b6d2a093] Updating instance_info_cache with network_info: [{"id": "5b06ed49-fa0b-4b58-ad6e-a092a9c1d14c", "address": "fa:16:3e:f8:75:16", "network": {"id": "1687d918-9f70-4099-b44c-97f92f90e6ff", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2074208460-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.100", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a6157b9827b44d2bab197220b635fd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b06ed49-fa", "ovs_interfaceid": "5b06ed49-fa0b-4b58-ad6e-a092a9c1d14c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 09:57:39 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-1ced2b8c-79f0-44ec-9d6f-be6c20804819 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] Releasing lock "refresh_cache-9cdd6b32-d4bd-4135-a58e-fbc3b6d2a093" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 09:57:39 user nova-compute[75229]: DEBUG nova.compute.manager [None req-1ced2b8c-79f0-44ec-9d6f-be6c20804819 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] [instance: 9cdd6b32-d4bd-4135-a58e-fbc3b6d2a093] Checking state {{(pid=75229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 09:57:39 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-23705a1a-b740-468b-9af7-a59fb08f7f42 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Acquiring lock "bc39b8e1-c8f9-4aa9-8d1b-72524b73f88c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:57:39 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-23705a1a-b740-468b-9af7-a59fb08f7f42 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Lock "bc39b8e1-c8f9-4aa9-8d1b-72524b73f88c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:57:39 user nova-compute[75229]: DEBUG nova.compute.manager [None req-23705a1a-b740-468b-9af7-a59fb08f7f42 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] [instance: bc39b8e1-c8f9-4aa9-8d1b-72524b73f88c] Starting instance... {{(pid=75229) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 09:57:40 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-23705a1a-b740-468b-9af7-a59fb08f7f42 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:57:40 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-23705a1a-b740-468b-9af7-a59fb08f7f42 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:57:40 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:57:40 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-23705a1a-b740-468b-9af7-a59fb08f7f42 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75229) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 09:57:40 user nova-compute[75229]: INFO nova.compute.claims [None req-23705a1a-b740-468b-9af7-a59fb08f7f42 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] [instance: bc39b8e1-c8f9-4aa9-8d1b-72524b73f88c] Claim successful on node user
Nov 14 09:57:40 user nova-compute[75229]: DEBUG nova.compute.provider_tree [None req-23705a1a-b740-468b-9af7-a59fb08f7f42 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Inventory has not changed in ProviderTree for provider: d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 {{(pid=75229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 09:57:40 user nova-compute[75229]: DEBUG nova.scheduler.client.report [None req-23705a1a-b740-468b-9af7-a59fb08f7f42 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Inventory has not changed for provider d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 09:57:40 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-23705a1a-b740-468b-9af7-a59fb08f7f42 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.461s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:57:40 user nova-compute[75229]: DEBUG nova.compute.manager [None req-23705a1a-b740-468b-9af7-a59fb08f7f42 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] [instance: bc39b8e1-c8f9-4aa9-8d1b-72524b73f88c] Start building networks asynchronously for instance. {{(pid=75229) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 09:57:40 user nova-compute[75229]: DEBUG nova.compute.manager [None req-23705a1a-b740-468b-9af7-a59fb08f7f42 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] [instance: bc39b8e1-c8f9-4aa9-8d1b-72524b73f88c] Allocating IP information in the background. {{(pid=75229) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 09:57:40 user nova-compute[75229]: DEBUG nova.network.neutron [None req-23705a1a-b740-468b-9af7-a59fb08f7f42 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] [instance: bc39b8e1-c8f9-4aa9-8d1b-72524b73f88c] allocate_for_instance() {{(pid=75229) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 09:57:40 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-23705a1a-b740-468b-9af7-a59fb08f7f42 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] [instance: bc39b8e1-c8f9-4aa9-8d1b-72524b73f88c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 09:57:40 user nova-compute[75229]: DEBUG nova.compute.manager [None req-23705a1a-b740-468b-9af7-a59fb08f7f42 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] [instance: bc39b8e1-c8f9-4aa9-8d1b-72524b73f88c] Start building block device mappings for instance. {{(pid=75229) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 09:57:40 user nova-compute[75229]: DEBUG nova.policy [None req-23705a1a-b740-468b-9af7-a59fb08f7f42 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c26f33e4cdf14ba796445959953f8685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46620ac128944703899f22fe5439ba26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75229) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 09:57:40 user nova-compute[75229]: INFO nova.virt.block_device [None req-23705a1a-b740-468b-9af7-a59fb08f7f42 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] [instance: bc39b8e1-c8f9-4aa9-8d1b-72524b73f88c] Booting with volume snapshot daceab86-c021-4d22-a92d-b3e1d1394ca0 at /dev/vda
Nov 14 09:57:41 user nova-compute[75229]: DEBUG nova.network.neutron [None req-23705a1a-b740-468b-9af7-a59fb08f7f42 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] [instance: bc39b8e1-c8f9-4aa9-8d1b-72524b73f88c] Successfully created port: 8e3a02db-6163-43cd-b8ea-e52e85e68b24 {{(pid=75229) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 09:57:42 user nova-compute[75229]: DEBUG nova.network.neutron [None req-23705a1a-b740-468b-9af7-a59fb08f7f42 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] [instance: bc39b8e1-c8f9-4aa9-8d1b-72524b73f88c] Successfully updated port: 8e3a02db-6163-43cd-b8ea-e52e85e68b24 {{(pid=75229) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 09:57:42 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-23705a1a-b740-468b-9af7-a59fb08f7f42 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Acquiring lock "refresh_cache-bc39b8e1-c8f9-4aa9-8d1b-72524b73f88c" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 09:57:42 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-23705a1a-b740-468b-9af7-a59fb08f7f42 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Acquired lock "refresh_cache-bc39b8e1-c8f9-4aa9-8d1b-72524b73f88c" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 09:57:42 user nova-compute[75229]: DEBUG nova.network.neutron [None req-23705a1a-b740-468b-9af7-a59fb08f7f42 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] [instance: bc39b8e1-c8f9-4aa9-8d1b-72524b73f88c] Building network info cache for instance {{(pid=75229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 09:57:42 user nova-compute[75229]: DEBUG nova.compute.manager [req-57fa06ef-8eab-41d3-9ee9-7eec7ce4b467 req-4163d21b-1648-4365-8333-f68b9404606a service nova] [instance: bc39b8e1-c8f9-4aa9-8d1b-72524b73f88c] Received event network-changed-8e3a02db-6163-43cd-b8ea-e52e85e68b24 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:57:42 user nova-compute[75229]: DEBUG nova.compute.manager [req-57fa06ef-8eab-41d3-9ee9-7eec7ce4b467 req-4163d21b-1648-4365-8333-f68b9404606a service nova] [instance: bc39b8e1-c8f9-4aa9-8d1b-72524b73f88c] Refreshing instance network info cache due to event network-changed-8e3a02db-6163-43cd-b8ea-e52e85e68b24. {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 09:57:42 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-57fa06ef-8eab-41d3-9ee9-7eec7ce4b467 req-4163d21b-1648-4365-8333-f68b9404606a service nova] Acquiring lock "refresh_cache-bc39b8e1-c8f9-4aa9-8d1b-72524b73f88c" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 09:57:42 user nova-compute[75229]: DEBUG nova.network.neutron [None req-23705a1a-b740-468b-9af7-a59fb08f7f42 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] [instance: bc39b8e1-c8f9-4aa9-8d1b-72524b73f88c] Instance cache missing network info. {{(pid=75229) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 09:57:42 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:57:42 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:57:42 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:57:42 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:57:42 user nova-compute[75229]: DEBUG nova.network.neutron [None req-23705a1a-b740-468b-9af7-a59fb08f7f42 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] [instance: bc39b8e1-c8f9-4aa9-8d1b-72524b73f88c] Updating instance_info_cache with network_info: [{"id": "8e3a02db-6163-43cd-b8ea-e52e85e68b24", "address": "fa:16:3e:51:a5:b7", "network": {"id": "118ea7c1-77c0-4660-b7b7-f311f6b0ec8a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1907578504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46620ac128944703899f22fe5439ba26", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e3a02db-61", "ovs_interfaceid": "8e3a02db-6163-43cd-b8ea-e52e85e68b24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 09:57:42 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-23705a1a-b740-468b-9af7-a59fb08f7f42 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Releasing lock "refresh_cache-bc39b8e1-c8f9-4aa9-8d1b-72524b73f88c" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 09:57:42 user nova-compute[75229]: DEBUG nova.compute.manager [None req-23705a1a-b740-468b-9af7-a59fb08f7f42 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] [instance: bc39b8e1-c8f9-4aa9-8d1b-72524b73f88c] Instance network_info: |[{"id": "8e3a02db-6163-43cd-b8ea-e52e85e68b24", "address": "fa:16:3e:51:a5:b7", "network": {"id": "118ea7c1-77c0-4660-b7b7-f311f6b0ec8a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1907578504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46620ac128944703899f22fe5439ba26", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e3a02db-61", "ovs_interfaceid": "8e3a02db-6163-43cd-b8ea-e52e85e68b24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75229) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 09:57:42 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-57fa06ef-8eab-41d3-9ee9-7eec7ce4b467 req-4163d21b-1648-4365-8333-f68b9404606a service nova] Acquired lock "refresh_cache-bc39b8e1-c8f9-4aa9-8d1b-72524b73f88c" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 09:57:42 user nova-compute[75229]: DEBUG nova.network.neutron [req-57fa06ef-8eab-41d3-9ee9-7eec7ce4b467 req-4163d21b-1648-4365-8333-f68b9404606a service nova] [instance: bc39b8e1-c8f9-4aa9-8d1b-72524b73f88c] Refreshing network info cache for port 8e3a02db-6163-43cd-b8ea-e52e85e68b24 {{(pid=75229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 09:57:43 user nova-compute[75229]: DEBUG nova.network.neutron [req-57fa06ef-8eab-41d3-9ee9-7eec7ce4b467 req-4163d21b-1648-4365-8333-f68b9404606a service nova] [instance: bc39b8e1-c8f9-4aa9-8d1b-72524b73f88c] Updated VIF entry in instance network info cache for port 8e3a02db-6163-43cd-b8ea-e52e85e68b24. {{(pid=75229) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 09:57:43 user nova-compute[75229]: DEBUG nova.network.neutron [req-57fa06ef-8eab-41d3-9ee9-7eec7ce4b467 req-4163d21b-1648-4365-8333-f68b9404606a service nova] [instance: bc39b8e1-c8f9-4aa9-8d1b-72524b73f88c] Updating instance_info_cache with network_info: [{"id": "8e3a02db-6163-43cd-b8ea-e52e85e68b24", "address": "fa:16:3e:51:a5:b7", "network": {"id": "118ea7c1-77c0-4660-b7b7-f311f6b0ec8a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1907578504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46620ac128944703899f22fe5439ba26", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e3a02db-61", "ovs_interfaceid": "8e3a02db-6163-43cd-b8ea-e52e85e68b24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 09:57:43 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-57fa06ef-8eab-41d3-9ee9-7eec7ce4b467 req-4163d21b-1648-4365-8333-f68b9404606a service nova] Releasing lock "refresh_cache-bc39b8e1-c8f9-4aa9-8d1b-72524b73f88c" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 09:57:43 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-1ced2b8c-79f0-44ec-9d6f-be6c20804819 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] [instance: 9cdd6b32-d4bd-4135-a58e-fbc3b6d2a093] Instance shutdown successfully.
Nov 14 09:57:43 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:57:44 user nova-compute[75229]: DEBUG nova.compute.manager [req-7a30e5c6-64cf-4b50-b03a-37bb3c0fc3d9 req-0d81aa8a-77e7-40b0-9058-be6eaea2bb2a service nova] [instance: 9cdd6b32-d4bd-4135-a58e-fbc3b6d2a093] Received event network-vif-unplugged-5b06ed49-fa0b-4b58-ad6e-a092a9c1d14c {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:57:44 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-7a30e5c6-64cf-4b50-b03a-37bb3c0fc3d9 req-0d81aa8a-77e7-40b0-9058-be6eaea2bb2a service nova] Acquiring lock "9cdd6b32-d4bd-4135-a58e-fbc3b6d2a093-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:57:44 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-7a30e5c6-64cf-4b50-b03a-37bb3c0fc3d9 req-0d81aa8a-77e7-40b0-9058-be6eaea2bb2a service nova] Lock "9cdd6b32-d4bd-4135-a58e-fbc3b6d2a093-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:57:44 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-7a30e5c6-64cf-4b50-b03a-37bb3c0fc3d9 req-0d81aa8a-77e7-40b0-9058-be6eaea2bb2a service nova] Lock "9cdd6b32-d4bd-4135-a58e-fbc3b6d2a093-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:57:44 user nova-compute[75229]: DEBUG nova.compute.manager [req-7a30e5c6-64cf-4b50-b03a-37bb3c0fc3d9 req-0d81aa8a-77e7-40b0-9058-be6eaea2bb2a service nova] [instance: 9cdd6b32-d4bd-4135-a58e-fbc3b6d2a093] No waiting events found dispatching network-vif-unplugged-5b06ed49-fa0b-4b58-ad6e-a092a9c1d14c {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 09:57:44 user nova-compute[75229]: WARNING nova.compute.manager [req-7a30e5c6-64cf-4b50-b03a-37bb3c0fc3d9 req-0d81aa8a-77e7-40b0-9058-be6eaea2bb2a service nova] [instance: 9cdd6b32-d4bd-4135-a58e-fbc3b6d2a093] Received unexpected event network-vif-unplugged-5b06ed49-fa0b-4b58-ad6e-a092a9c1d14c for instance with vm_state active and task_state reboot_started.
Nov 14 09:57:44 user nova-compute[75229]: DEBUG nova.compute.manager [req-7a30e5c6-64cf-4b50-b03a-37bb3c0fc3d9 req-0d81aa8a-77e7-40b0-9058-be6eaea2bb2a service nova] [instance: 9cdd6b32-d4bd-4135-a58e-fbc3b6d2a093] Received event network-vif-plugged-5b06ed49-fa0b-4b58-ad6e-a092a9c1d14c {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:57:44 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-7a30e5c6-64cf-4b50-b03a-37bb3c0fc3d9 req-0d81aa8a-77e7-40b0-9058-be6eaea2bb2a service nova] Acquiring lock "9cdd6b32-d4bd-4135-a58e-fbc3b6d2a093-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:57:44 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-7a30e5c6-64cf-4b50-b03a-37bb3c0fc3d9 req-0d81aa8a-77e7-40b0-9058-be6eaea2bb2a service nova] Lock "9cdd6b32-d4bd-4135-a58e-fbc3b6d2a093-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:57:44 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-7a30e5c6-64cf-4b50-b03a-37bb3c0fc3d9 req-0d81aa8a-77e7-40b0-9058-be6eaea2bb2a service nova] Lock "9cdd6b32-d4bd-4135-a58e-fbc3b6d2a093-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:57:44 user nova-compute[75229]: DEBUG nova.compute.manager [req-7a30e5c6-64cf-4b50-b03a-37bb3c0fc3d9 req-0d81aa8a-77e7-40b0-9058-be6eaea2bb2a service nova] [instance: 9cdd6b32-d4bd-4135-a58e-fbc3b6d2a093] No waiting events found dispatching network-vif-plugged-5b06ed49-fa0b-4b58-ad6e-a092a9c1d14c {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 09:57:44 user nova-compute[75229]: WARNING nova.compute.manager [req-7a30e5c6-64cf-4b50-b03a-37bb3c0fc3d9 req-0d81aa8a-77e7-40b0-9058-be6eaea2bb2a service nova] [instance: 9cdd6b32-d4bd-4135-a58e-fbc3b6d2a093] Received unexpected event network-vif-plugged-5b06ed49-fa0b-4b58-ad6e-a092a9c1d14c for instance with vm_state active and task_state reboot_started.
Nov 14 09:57:44 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:57:44 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:57:44 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:57:44 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:57:44 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:57:44 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:57:45 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:57:46 user nova-compute[75229]: DEBUG nova.compute.manager [req-e423b266-e3a4-456f-8665-301161fb41f1 req-550b8b82-82dc-4b74-98ca-bf1e15c62198 service nova] [instance: 9cdd6b32-d4bd-4135-a58e-fbc3b6d2a093] Received event network-vif-plugged-5b06ed49-fa0b-4b58-ad6e-a092a9c1d14c {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:57:46 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-e423b266-e3a4-456f-8665-301161fb41f1 req-550b8b82-82dc-4b74-98ca-bf1e15c62198 service nova] Acquiring lock "9cdd6b32-d4bd-4135-a58e-fbc3b6d2a093-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:57:46 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-e423b266-e3a4-456f-8665-301161fb41f1 req-550b8b82-82dc-4b74-98ca-bf1e15c62198 service nova] Lock "9cdd6b32-d4bd-4135-a58e-fbc3b6d2a093-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:57:46 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-e423b266-e3a4-456f-8665-301161fb41f1 req-550b8b82-82dc-4b74-98ca-bf1e15c62198 service nova] Lock "9cdd6b32-d4bd-4135-a58e-fbc3b6d2a093-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:57:46 user nova-compute[75229]: DEBUG nova.compute.manager [req-e423b266-e3a4-456f-8665-301161fb41f1 req-550b8b82-82dc-4b74-98ca-bf1e15c62198 service nova] [instance: 9cdd6b32-d4bd-4135-a58e-fbc3b6d2a093] No waiting events found dispatching network-vif-plugged-5b06ed49-fa0b-4b58-ad6e-a092a9c1d14c {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 09:57:46 user nova-compute[75229]: WARNING nova.compute.manager [req-e423b266-e3a4-456f-8665-301161fb41f1 req-550b8b82-82dc-4b74-98ca-bf1e15c62198 service nova] [instance: 9cdd6b32-d4bd-4135-a58e-fbc3b6d2a093] Received unexpected event network-vif-plugged-5b06ed49-fa0b-4b58-ad6e-a092a9c1d14c for instance with vm_state active and task_state reboot_started.
Nov 14 09:57:46 user nova-compute[75229]: DEBUG nova.compute.manager [req-e423b266-e3a4-456f-8665-301161fb41f1 req-550b8b82-82dc-4b74-98ca-bf1e15c62198 service nova] [instance: 9cdd6b32-d4bd-4135-a58e-fbc3b6d2a093] Received event network-vif-plugged-5b06ed49-fa0b-4b58-ad6e-a092a9c1d14c {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:57:46 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-e423b266-e3a4-456f-8665-301161fb41f1 req-550b8b82-82dc-4b74-98ca-bf1e15c62198 service nova] Acquiring lock "9cdd6b32-d4bd-4135-a58e-fbc3b6d2a093-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:57:46 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-e423b266-e3a4-456f-8665-301161fb41f1 req-550b8b82-82dc-4b74-98ca-bf1e15c62198 service nova] Lock "9cdd6b32-d4bd-4135-a58e-fbc3b6d2a093-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:57:46 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-e423b266-e3a4-456f-8665-301161fb41f1 req-550b8b82-82dc-4b74-98ca-bf1e15c62198 service nova] Lock "9cdd6b32-d4bd-4135-a58e-fbc3b6d2a093-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:57:46 user nova-compute[75229]: DEBUG nova.compute.manager [req-e423b266-e3a4-456f-8665-301161fb41f1 req-550b8b82-82dc-4b74-98ca-bf1e15c62198 service nova] [instance: 9cdd6b32-d4bd-4135-a58e-fbc3b6d2a093] No waiting events found dispatching network-vif-plugged-5b06ed49-fa0b-4b58-ad6e-a092a9c1d14c {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 09:57:46 user nova-compute[75229]: WARNING nova.compute.manager [req-e423b266-e3a4-456f-8665-301161fb41f1 req-550b8b82-82dc-4b74-98ca-bf1e15c62198 service nova] [instance: 9cdd6b32-d4bd-4135-a58e-fbc3b6d2a093] Received unexpected event network-vif-plugged-5b06ed49-fa0b-4b58-ad6e-a092a9c1d14c for instance with vm_state active and task_state reboot_started.
Nov 14 09:57:46 user nova-compute[75229]: DEBUG os_brick.utils [None req-23705a1a-b740-468b-9af7-a59fb08f7f42 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 09:57:46 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:57:46 user nova-compute[75229]: INFO nova.virt.libvirt.driver [-] [instance: 9cdd6b32-d4bd-4135-a58e-fbc3b6d2a093] Instance running successfully.
Nov 14 09:57:46 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-1ced2b8c-79f0-44ec-9d6f-be6c20804819 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] [instance: 9cdd6b32-d4bd-4135-a58e-fbc3b6d2a093] Instance soft rebooted successfully.
Nov 14 09:57:46 user nova-compute[75229]: DEBUG nova.compute.manager [None req-1ced2b8c-79f0-44ec-9d6f-be6c20804819 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] [instance: 9cdd6b32-d4bd-4135-a58e-fbc3b6d2a093] Checking state {{(pid=75229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 09:57:46 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:57:46 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[1710ffb8-0c97-4126-8198-98a556ac344f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f1154031c835\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:57:46 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:57:46 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:57:46 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[68185410-6136-462b-9c43-33aa08613357]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:57:46 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:57:46 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:57:46 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[88a078da-00a2-43ec-80b6-1dec42a96a56]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:57:46 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[62a7b535-fd25-4b78-ae17-45338d7b5cfb]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:57:46 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-23705a1a-b740-468b-9af7-a59fb08f7f42 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Running cmd (subprocess): nvme version {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:57:46 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-23705a1a-b740-468b-9af7-a59fb08f7f42 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] 'nvme version' failed. Not Retrying. {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 09:57:46 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.nvmeof [None req-23705a1a-b740-468b-9af7-a59fb08f7f42 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] nvme not present on system {{(pid=75229) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 09:57:46 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:57:46 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-1ced2b8c-79f0-44ec-9d6f-be6c20804819 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] Lock "9cdd6b32-d4bd-4135-a58e-fbc3b6d2a093" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.849s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:57:46 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 09:57:46 user nova-compute[75229]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 09:57:46 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7fe5afd-51bf-4f3c-b6aa-fe753d525f35]: (4, '') {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:57:46 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.lightos [None req-23705a1a-b740-468b-9af7-a59fb08f7f42 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75229) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 09:57:46 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.lightos [None req-23705a1a-b740-468b-9af7-a59fb08f7f42 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75229) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 09:57:46 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.lightos [None req-23705a1a-b740-468b-9af7-a59fb08f7f42 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] LIGHTOS: no hostnqn found. {{(pid=75229) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 09:57:46 user nova-compute[75229]: DEBUG os_brick.utils [None req-23705a1a-b740-468b-9af7-a59fb08f7f42 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f1154031c835', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 09:57:46 user nova-compute[75229]: DEBUG nova.virt.block_device [None req-23705a1a-b740-468b-9af7-a59fb08f7f42 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] [instance: bc39b8e1-c8f9-4aa9-8d1b-72524b73f88c] Updating existing volume attachment record: c1671da7-651e-4474-8ed4-5ca959bc0fbe {{(pid=75229) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 09:57:47 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:57:48 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:57:48 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:57:49 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 09:57:50 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:57:51 user nova-compute[75229]: DEBUG nova.compute.manager [None req-23705a1a-b740-468b-9af7-a59fb08f7f42 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] [instance: bc39b8e1-c8f9-4aa9-8d1b-72524b73f88c] Start spawning the instance on the hypervisor. {{(pid=75229) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 09:57:51 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-23705a1a-b740-468b-9af7-a59fb08f7f42 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] [instance: bc39b8e1-c8f9-4aa9-8d1b-72524b73f88c] Creating instance directory {{(pid=75229) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 09:57:51 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-23705a1a-b740-468b-9af7-a59fb08f7f42 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] [instance: bc39b8e1-c8f9-4aa9-8d1b-72524b73f88c] Creating image(s)
Nov 14 09:57:51 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-23705a1a-b740-468b-9af7-a59fb08f7f42 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] [instance: bc39b8e1-c8f9-4aa9-8d1b-72524b73f88c] Did not create local disks {{(pid=75229) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 14 09:57:51 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-23705a1a-b740-468b-9af7-a59fb08f7f42 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] [instance: bc39b8e1-c8f9-4aa9-8d1b-72524b73f88c] Ensure instance console log exists: /opt/stack/data/nova/instances/bc39b8e1-c8f9-4aa9-8d1b-72524b73f88c/console.log {{(pid=75229) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 09:57:51 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-23705a1a-b740-468b-9af7-a59fb08f7f42 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:57:51 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-23705a1a-b740-468b-9af7-a59fb08f7f42 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:57:51 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-23705a1a-b740-468b-9af7-a59fb08f7f42 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:57:51 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-23705a1a-b740-468b-9af7-a59fb08f7f42 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] [instance: bc39b8e1-c8f9-4aa9-8d1b-72524b73f88c] Start _get_guest_xml network_info=[{"id": "8e3a02db-6163-43cd-b8ea-e52e85e68b24", "address": "fa:16:3e:51:a5:b7", "network": {"id": "118ea7c1-77c0-4660-b7b7-f311f6b0ec8a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1907578504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46620ac128944703899f22fe5439ba26", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e3a02db-61", "ovs_interfaceid": "8e3a02db-6163-43cd-b8ea-e52e85e68b24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:4562974d-4587-4774-adb3-21a623f466c2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lBfSsupY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'bc39b8e1-c8f9-4aa9-8d1b-72524b73f88c', 'attached_at': '', 'detached_at': '', 'volume_id': '4562974d-4587-4774-adb3-21a623f466c2', 'serial': '4562974d-4587-4774-adb3-21a623f466c2'}, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'attachment_id': 'c1671da7-651e-4474-8ed4-5ca959bc0fbe', 'guest_format': None, 'device_type': 'disk', 'volume_type': None} {{(pid=75229) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 09:57:51 user nova-compute[75229]: WARNING nova.virt.libvirt.driver [None req-23705a1a-b740-468b-9af7-a59fb08f7f42 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 09:57:51 user nova-compute[75229]: WARNING nova.virt.libvirt.driver [None req-23705a1a-b740-468b-9af7-a59fb08f7f42 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 09:57:51 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-23705a1a-b740-468b-9af7-a59fb08f7f42 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75229) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 09:57:51 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-23705a1a-b740-468b-9af7-a59fb08f7f42 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] CPU controller missing on host. {{(pid=75229) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 09:57:51 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-23705a1a-b740-468b-9af7-a59fb08f7f42 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75229) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 09:57:51 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-23705a1a-b740-468b-9af7-a59fb08f7f42 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] CPU controller found on host. {{(pid=75229) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 09:57:51 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-23705a1a-b740-468b-9af7-a59fb08f7f42 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75229) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 09:57:51 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-23705a1a-b740-468b-9af7-a59fb08f7f42 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T09:39:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 09:57:51 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-23705a1a-b740-468b-9af7-a59fb08f7f42 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Flavor limits 0:0:0 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 09:57:51 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-23705a1a-b740-468b-9af7-a59fb08f7f42 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Image limits 0:0:0 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 09:57:51 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-23705a1a-b740-468b-9af7-a59fb08f7f42 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Flavor pref 0:0:0 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 09:57:51 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-23705a1a-b740-468b-9af7-a59fb08f7f42 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Image pref 0:0:0 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 09:57:51 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-23705a1a-b740-468b-9af7-a59fb08f7f42 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 09:57:51 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-23705a1a-b740-468b-9af7-a59fb08f7f42 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 09:57:51 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-23705a1a-b740-468b-9af7-a59fb08f7f42 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75229) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 09:57:51 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-23705a1a-b740-468b-9af7-a59fb08f7f42 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Got 1 possible topologies {{(pid=75229) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 09:57:51 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-23705a1a-b740-468b-9af7-a59fb08f7f42 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 09:57:51 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-23705a1a-b740-468b-9af7-a59fb08f7f42 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 09:57:51 user nova-compute[75229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-23705a1a-b740-468b-9af7-a59fb08f7f42 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] [instance: bc39b8e1-c8f9-4aa9-8d1b-72524b73f88c] Calling os-brick to attach iSCSI Volume {{(pid=75229) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 09:57:51 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-23705a1a-b740-468b-9af7-a59fb08f7f42 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f73f85151b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4562974d-4587-4774-adb3-21a623f466c2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lBfSsupY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 09:57:51 user nova-compute[75229]: WARNING os_brick.initiator.connectors.base [None req-23705a1a-b740-468b-9af7-a59fb08f7f42 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 09:57:51 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-23705a1a-b740-468b-9af7-a59fb08f7f42 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 09:57:51 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-23705a1a-b740-468b-9af7-a59fb08f7f42 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 09:57:51 user nova-compute[75229]: WARNING os_brick.initiator.connectors.base [None req-23705a1a-b740-468b-9af7-a59fb08f7f42 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 09:57:51 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-23705a1a-b740-468b-9af7-a59fb08f7f42 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4562974d-4587-4774-adb3-21a623f466c2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 09:57:51 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-23705a1a-b740-468b-9af7-a59fb08f7f42 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4562974d-4587-4774-adb3-21a623f466c2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 09:57:51 user nova-compute[75229]: INFO os_brick.initiator.connectors.iscsi [None req-23705a1a-b740-468b-9af7-a59fb08f7f42 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 09:57:51 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4562974d-4587-4774-adb3-21a623f466c2 -p 172.16.0.220:3260 {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:57:51 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4562974d-4587-4774-adb3-21a623f466c2 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:57:51 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee9063d0-539f-46fa-871b-fff643bf33c9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:57:51 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-23705a1a-b740-468b-9af7-a59fb08f7f42 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 09:57:51 user nova-compute[75229]:  {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:57:51 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4562974d-4587-4774-adb3-21a623f466c2 -p 172.16.0.220:3260 --interface default --op new {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:57:51 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4562974d-4587-4774-adb3-21a623f466c2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:57:51 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[90cf26f1-b168-4d3b-a3c9-5532cdc96bdb]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4562974d-4587-4774-adb3-21a623f466c2] added\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:57:51 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-23705a1a-b740-468b-9af7-a59fb08f7f42 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4562974d-4587-4774-adb3-21a623f466c2] added
Nov 14 09:57:51 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:57:51 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4562974d-4587-4774-adb3-21a623f466c2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:57:51 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4562974d-4587-4774-adb3-21a623f466c2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:57:51 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[8411cf1e-6a34-4746-a5b1-24e86c85e91d]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:57:51 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-23705a1a-b740-468b-9af7-a59fb08f7f42 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:57:51 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4562974d-4587-4774-adb3-21a623f466c2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:57:51 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4562974d-4587-4774-adb3-21a623f466c2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:57:51 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[497ea2f4-7ccc-4b82-952e-527a86d754c6]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:57:51 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-23705a1a-b740-468b-9af7-a59fb08f7f42 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:57:51 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4562974d-4587-4774-adb3-21a623f466c2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lBfSsupY {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:57:51 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4562974d-4587-4774-adb3-21a623f466c2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lBfSsupY" returned: 0 in 0.018s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:57:51 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[f233d15c-b8fa-49af-b740-c1ed908df8f7]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:57:51 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-23705a1a-b740-468b-9af7-a59fb08f7f42 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'lBfSsupY'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:57:51 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4562974d-4587-4774-adb3-21a623f466c2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:57:51 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4562974d-4587-4774-adb3-21a623f466c2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:57:51 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e7d0f16-d043-4971-b19c-908a45673a5b]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:57:51 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-23705a1a-b740-468b-9af7-a59fb08f7f42 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:57:51 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:57:51 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:57:51 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd19395e-2575-4bfd-83fc-3e0657a2d72e]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aebc438-0289-44fe-ad84-4e696468f50e (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5efb0e0-a85c-46ec-8a9d-2763bf548023 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94a0a817-0b71-4589-90eb-8c8d159f7fd2 (non-flash)\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:57:51 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-23705a1a-b740-468b-9af7-a59fb08f7f42 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aebc438-0289-44fe-ad84-4e696468f50e (non-flash)
Nov 14 09:57:51 user nova-compute[75229]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5efb0e0-a85c-46ec-8a9d-2763bf548023 (non-flash)
Nov 14 09:57:51 user nova-compute[75229]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94a0a817-0b71-4589-90eb-8c8d159f7fd2 (non-flash)
Nov 14 09:57:51 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 09:57:51 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-23705a1a-b740-468b-9af7-a59fb08f7f42 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aebc438-0289-44fe-ad84-4e696468f50e (non-flash)
Nov 14 09:57:51 user nova-compute[75229]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5efb0e0-a85c-46ec-8a9d-2763bf548023 (non-flash)
Nov 14 09:57:51 user nova-compute[75229]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94a0a817-0b71-4589-90eb-8c8d159f7fd2 (non-flash)
Nov 14 09:57:51 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 09:57:51 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4562974d-4587-4774-adb3-21a623f466c2 -p 172.16.0.220:3260 --login {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:57:51 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4562974d-4587-4774-adb3-21a623f466c2 -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:57:51 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfb0ea66-7cf8-4226-aeaf-abbe320864fe]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4562974d-4587-4774-adb3-21a623f466c2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4562974d-4587-4774-adb3-21a623f466c2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:57:51 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-23705a1a-b740-468b-9af7-a59fb08f7f42 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4562974d-4587-4774-adb3-21a623f466c2, portal: 172.16.0.220,3260]
Nov 14 09:57:51 user nova-compute[75229]: Login to [iface: default, target: iqn.2010-10.org.openstack:4562974d-4587-4774-adb3-21a623f466c2, portal: 172.16.0.220,3260] successful.
Nov 14 09:57:51 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:57:51 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4562974d-4587-4774-adb3-21a623f466c2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:57:51 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4562974d-4587-4774-adb3-21a623f466c2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:57:51 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca17e0f5-39ec-4136-92d1-7c7ea1e61f20]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:57:51 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-23705a1a-b740-468b-9af7-a59fb08f7f42 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:57:51 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:57:51 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:57:51 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9a59b24-c284-41bc-8042-7dca6e8aa299]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aebc438-0289-44fe-ad84-4e696468f50e (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5efb0e0-a85c-46ec-8a9d-2763bf548023 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94a0a817-0b71-4589-90eb-8c8d159f7fd2 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4562974d-4587-4774-adb3-21a623f466c2 (non-flash)\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:57:51 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-23705a1a-b740-468b-9af7-a59fb08f7f42 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aebc438-0289-44fe-ad84-4e696468f50e (non-flash)
Nov 14 09:57:51 user nova-compute[75229]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5efb0e0-a85c-46ec-8a9d-2763bf548023 (non-flash)
Nov 14 09:57:51 user nova-compute[75229]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94a0a817-0b71-4589-90eb-8c8d159f7fd2 (non-flash)
Nov 14 09:57:51 user nova-compute[75229]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4562974d-4587-4774-adb3-21a623f466c2 (non-flash)
Nov 14 09:57:51 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 09:57:51 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-23705a1a-b740-468b-9af7-a59fb08f7f42 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aebc438-0289-44fe-ad84-4e696468f50e (non-flash)
Nov 14 09:57:51 user nova-compute[75229]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5efb0e0-a85c-46ec-8a9d-2763bf548023 (non-flash)
Nov 14 09:57:51 user nova-compute[75229]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94a0a817-0b71-4589-90eb-8c8d159f7fd2 (non-flash)
Nov 14 09:57:51 user nova-compute[75229]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4562974d-4587-4774-adb3-21a623f466c2 (non-flash)
Nov 14 09:57:51 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 09:57:51 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-23705a1a-b740-468b-9af7-a59fb08f7f42 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4562974d-4587-4774-adb3-21a623f466c2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.311s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 09:57:51 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-23705a1a-b740-468b-9af7-a59fb08f7f42 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Connected to 172.16.0.220:3260 {{(pid=75229) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 09:57:51 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-23705a1a-b740-468b-9af7-a59fb08f7f42 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] HCTL ('36', '-', '-', 0) found on session 37 with lun 0 {{(pid=75229) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 09:57:51 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-23705a1a-b740-468b-9af7-a59fb08f7f42 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75229) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 09:57:51 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:57:51 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.016s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:57:51 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4e0cc89-faaa-4b08-88f4-11fba658f3d1]: (4, ('- - 0', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:57:51 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-23705a1a-b740-468b-9af7-a59fb08f7f42 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Searching for a device in session 37 and hctl ['36', '*', '*', 0] yield: None {{(pid=75229) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 09:57:52 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-23705a1a-b740-468b-9af7-a59fb08f7f42 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Searching for a device in session 37 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75229) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 09:57:52 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-23705a1a-b740-468b-9af7-a59fb08f7f42 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:4562974d-4587-4774-adb3-21a623f466c2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lBfSsupY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75229) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 09:57:52 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-23705a1a-b740-468b-9af7-a59fb08f7f42 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.340s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 09:57:52 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-23705a1a-b740-468b-9af7-a59fb08f7f42 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] <== connect_volume: return (1341ms) {'type': 'block', 'scsi_wwn': '23362386562626262', 'path': '/dev/sde'} {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 09:57:52 user nova-compute[75229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-23705a1a-b740-468b-9af7-a59fb08f7f42 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] [instance: bc39b8e1-c8f9-4aa9-8d1b-72524b73f88c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23362386562626262', 'path': '/dev/sde'} {{(pid=75229) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 09:57:52 user nova-compute[75229]: DEBUG nova.virt.libvirt.vif [None req-23705a1a-b740-468b-9af7-a59fb08f7f42 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T09:57:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-2091069473',display_name='tempest-TestVolumeBootPattern-server-2091069473',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-2091069473',id=36,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='46620ac128944703899f22fe5439ba26',ramdisk_id='',reservation_id='r-jb3ofr5o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2064993142',owner_user_name='tempest-TestVolumeBootPattern-2064993142-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T09:57:41Z,user_data=None,user_id='c26f33e4cdf14ba796445959953f8685',uuid=bc39b8e1-c8f9-4aa9-8d1b-72524b73f88c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8e3a02db-6163-43cd-b8ea-e52e85e68b24", "address": "fa:16:3e:51:a5:b7", "network": {"id": "118ea7c1-77c0-4660-b7b7-f311f6b0ec8a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1907578504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46620ac128944703899f22fe5439ba26", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e3a02db-61", "ovs_interfaceid": "8e3a02db-6163-43cd-b8ea-e52e85e68b24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75229) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 09:57:52 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-23705a1a-b740-468b-9af7-a59fb08f7f42 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Converting VIF {"id": "8e3a02db-6163-43cd-b8ea-e52e85e68b24", "address": "fa:16:3e:51:a5:b7", "network": {"id": "118ea7c1-77c0-4660-b7b7-f311f6b0ec8a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1907578504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46620ac128944703899f22fe5439ba26", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e3a02db-61", "ovs_interfaceid": "8e3a02db-6163-43cd-b8ea-e52e85e68b24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 09:57:52 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-23705a1a-b740-468b-9af7-a59fb08f7f42 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:51:a5:b7,bridge_name='br-int',has_traffic_filtering=True,id=8e3a02db-6163-43cd-b8ea-e52e85e68b24,network=Network(118ea7c1-77c0-4660-b7b7-f311f6b0ec8a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e3a02db-61') {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 09:57:52 user nova-compute[75229]: DEBUG nova.objects.instance [None req-23705a1a-b740-468b-9af7-a59fb08f7f42 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Lazy-loading 'pci_devices' on Instance uuid bc39b8e1-c8f9-4aa9-8d1b-72524b73f88c {{(pid=75229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 09:57:52 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-23705a1a-b740-468b-9af7-a59fb08f7f42 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] [instance: bc39b8e1-c8f9-4aa9-8d1b-72524b73f88c] End _get_guest_xml xml=<domain type="kvm">
Nov 14 09:57:52 user nova-compute[75229]:   <uuid>bc39b8e1-c8f9-4aa9-8d1b-72524b73f88c</uuid>
Nov 14 09:57:52 user nova-compute[75229]:   <name>instance-00000024</name>
Nov 14 09:57:52 user nova-compute[75229]:   <memory>524288</memory>
Nov 14 09:57:52 user nova-compute[75229]:   <vcpu>1</vcpu>
Nov 14 09:57:52 user nova-compute[75229]:   <metadata>
Nov 14 09:57:52 user nova-compute[75229]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 09:57:52 user nova-compute[75229]:       <nova:package version="0.0.0"/>
Nov 14 09:57:52 user nova-compute[75229]:       <nova:name>tempest-TestVolumeBootPattern-server-2091069473</nova:name>
Nov 14 09:57:52 user nova-compute[75229]:       <nova:creationTime>2023-11-14 09:57:51</nova:creationTime>
Nov 14 09:57:52 user nova-compute[75229]:       <nova:flavor name="m1.tiny">
Nov 14 09:57:52 user nova-compute[75229]:         <nova:memory>512</nova:memory>
Nov 14 09:57:52 user nova-compute[75229]:         <nova:disk>1</nova:disk>
Nov 14 09:57:52 user nova-compute[75229]:         <nova:swap>0</nova:swap>
Nov 14 09:57:52 user nova-compute[75229]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 09:57:52 user nova-compute[75229]:         <nova:vcpus>1</nova:vcpus>
Nov 14 09:57:52 user nova-compute[75229]:       </nova:flavor>
Nov 14 09:57:52 user nova-compute[75229]:       <nova:owner>
Nov 14 09:57:52 user nova-compute[75229]:         <nova:user uuid="c26f33e4cdf14ba796445959953f8685">tempest-TestVolumeBootPattern-2064993142-project-member</nova:user>
Nov 14 09:57:52 user nova-compute[75229]:         <nova:project uuid="46620ac128944703899f22fe5439ba26">tempest-TestVolumeBootPattern-2064993142</nova:project>
Nov 14 09:57:52 user nova-compute[75229]:       </nova:owner>
Nov 14 09:57:52 user nova-compute[75229]:       <nova:ports>
Nov 14 09:57:52 user nova-compute[75229]:         <nova:port uuid="8e3a02db-6163-43cd-b8ea-e52e85e68b24">
Nov 14 09:57:52 user nova-compute[75229]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 14 09:57:52 user nova-compute[75229]:         </nova:port>
Nov 14 09:57:52 user nova-compute[75229]:       </nova:ports>
Nov 14 09:57:52 user nova-compute[75229]:     </nova:instance>
Nov 14 09:57:52 user nova-compute[75229]:   </metadata>
Nov 14 09:57:52 user nova-compute[75229]:   <sysinfo type="smbios">
Nov 14 09:57:52 user nova-compute[75229]:     <system>
Nov 14 09:57:52 user nova-compute[75229]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 09:57:52 user nova-compute[75229]:       <entry name="product">OpenStack Nova</entry>
Nov 14 09:57:52 user nova-compute[75229]:       <entry name="version">0.0.0</entry>
Nov 14 09:57:52 user nova-compute[75229]:       <entry name="serial">bc39b8e1-c8f9-4aa9-8d1b-72524b73f88c</entry>
Nov 14 09:57:52 user nova-compute[75229]:       <entry name="uuid">bc39b8e1-c8f9-4aa9-8d1b-72524b73f88c</entry>
Nov 14 09:57:52 user nova-compute[75229]:       <entry name="family">Virtual Machine</entry>
Nov 14 09:57:52 user nova-compute[75229]:     </system>
Nov 14 09:57:52 user nova-compute[75229]:   </sysinfo>
Nov 14 09:57:52 user nova-compute[75229]:   <os>
Nov 14 09:57:52 user nova-compute[75229]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 09:57:52 user nova-compute[75229]:     <boot dev="hd"/>
Nov 14 09:57:52 user nova-compute[75229]:     <smbios mode="sysinfo"/>
Nov 14 09:57:52 user nova-compute[75229]:   </os>
Nov 14 09:57:52 user nova-compute[75229]:   <features>
Nov 14 09:57:52 user nova-compute[75229]:     <acpi/>
Nov 14 09:57:52 user nova-compute[75229]:     <apic/>
Nov 14 09:57:52 user nova-compute[75229]:     <vmcoreinfo/>
Nov 14 09:57:52 user nova-compute[75229]:   </features>
Nov 14 09:57:52 user nova-compute[75229]:   <clock offset="utc">
Nov 14 09:57:52 user nova-compute[75229]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 09:57:52 user nova-compute[75229]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 09:57:52 user nova-compute[75229]:     <timer name="hpet" present="no"/>
Nov 14 09:57:52 user nova-compute[75229]:   </clock>
Nov 14 09:57:52 user nova-compute[75229]:   <cpu mode="custom" match="exact">
Nov 14 09:57:52 user nova-compute[75229]:     <model>Nehalem</model>
Nov 14 09:57:52 user nova-compute[75229]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 09:57:52 user nova-compute[75229]:   </cpu>
Nov 14 09:57:52 user nova-compute[75229]:   <devices>
Nov 14 09:57:52 user nova-compute[75229]:     <disk type="block" device="disk">
Nov 14 09:57:52 user nova-compute[75229]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 09:57:52 user nova-compute[75229]:       <source dev="/dev/sde"/>
Nov 14 09:57:52 user nova-compute[75229]:       <target dev="vda" bus="virtio"/>
Nov 14 09:57:52 user nova-compute[75229]:       <serial>4562974d-4587-4774-adb3-21a623f466c2</serial>
Nov 14 09:57:52 user nova-compute[75229]:     </disk>
Nov 14 09:57:52 user nova-compute[75229]:     <interface type="ethernet">
Nov 14 09:57:52 user nova-compute[75229]:       <mac address="fa:16:3e:51:a5:b7"/>
Nov 14 09:57:52 user nova-compute[75229]:       <model type="virtio"/>
Nov 14 09:57:52 user nova-compute[75229]:       <mtu size="1442"/>
Nov 14 09:57:52 user nova-compute[75229]:       <target dev="tap8e3a02db-61"/>
Nov 14 09:57:52 user nova-compute[75229]:     </interface>
Nov 14 09:57:52 user nova-compute[75229]:     <serial type="pty">
Nov 14 09:57:52 user nova-compute[75229]:       <log file="/opt/stack/data/nova/instances/bc39b8e1-c8f9-4aa9-8d1b-72524b73f88c/console.log" append="off"/>
Nov 14 09:57:52 user nova-compute[75229]:     </serial>
Nov 14 09:57:52 user nova-compute[75229]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 09:57:52 user nova-compute[75229]:     <video>
Nov 14 09:57:52 user nova-compute[75229]:       <model type="virtio"/>
Nov 14 09:57:52 user nova-compute[75229]:     </video>
Nov 14 09:57:52 user nova-compute[75229]:     <rng model="virtio">
Nov 14 09:57:52 user nova-compute[75229]:       <backend model="random">/dev/urandom</backend>
Nov 14 09:57:52 user nova-compute[75229]:     </rng>
Nov 14 09:57:52 user nova-compute[75229]:     <controller type="usb" index="0" model="none"/>
Nov 14 09:57:52 user nova-compute[75229]:     <memballoon model="virtio">
Nov 14 09:57:52 user nova-compute[75229]:       <stats period="10"/>
Nov 14 09:57:52 user nova-compute[75229]:     </memballoon>
Nov 14 09:57:52 user nova-compute[75229]:   </devices>
Nov 14 09:57:52 user nova-compute[75229]: </domain>
Nov 14 09:57:52 user nova-compute[75229]:  {{(pid=75229) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 09:57:52 user nova-compute[75229]: DEBUG nova.virt.libvirt.vif [None req-23705a1a-b740-468b-9af7-a59fb08f7f42 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T09:57:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-2091069473',display_name='tempest-TestVolumeBootPattern-server-2091069473',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-2091069473',id=36,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='46620ac128944703899f22fe5439ba26',ramdisk_id='',reservation_id='r-jb3ofr5o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2064993142',owner_user_name='tempest-TestVolumeBootPattern-2064993142-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T09:57:41Z,user_data=None,user_id='c26f33e4cdf14ba796445959953f8685',uuid=bc39b8e1-c8f9-4aa9-8d1b-72524b73f88c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8e3a02db-6163-43cd-b8ea-e52e85e68b24", "address": "fa:16:3e:51:a5:b7", "network": {"id": "118ea7c1-77c0-4660-b7b7-f311f6b0ec8a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1907578504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46620ac128944703899f22fe5439ba26", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e3a02db-61", "ovs_interfaceid": "8e3a02db-6163-43cd-b8ea-e52e85e68b24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 09:57:52 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-23705a1a-b740-468b-9af7-a59fb08f7f42 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Converting VIF {"id": "8e3a02db-6163-43cd-b8ea-e52e85e68b24", "address": "fa:16:3e:51:a5:b7", "network": {"id": "118ea7c1-77c0-4660-b7b7-f311f6b0ec8a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1907578504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46620ac128944703899f22fe5439ba26", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e3a02db-61", "ovs_interfaceid": "8e3a02db-6163-43cd-b8ea-e52e85e68b24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 09:57:52 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-23705a1a-b740-468b-9af7-a59fb08f7f42 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:51:a5:b7,bridge_name='br-int',has_traffic_filtering=True,id=8e3a02db-6163-43cd-b8ea-e52e85e68b24,network=Network(118ea7c1-77c0-4660-b7b7-f311f6b0ec8a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e3a02db-61') {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 09:57:52 user nova-compute[75229]: DEBUG os_vif [None req-23705a1a-b740-468b-9af7-a59fb08f7f42 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:51:a5:b7,bridge_name='br-int',has_traffic_filtering=True,id=8e3a02db-6163-43cd-b8ea-e52e85e68b24,network=Network(118ea7c1-77c0-4660-b7b7-f311f6b0ec8a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e3a02db-61') {{(pid=75229) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 09:57:52 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:57:52 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:57:52 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 09:57:52 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:57:52 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4d5dc10d-458e-5514-86dc-987ab8a34c98', '_type': 'linux-noop'}}, row=False) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:57:52 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:57:52 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 09:57:52 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:57:52 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8e3a02db-61, may_exist=True, interface_attrs={}) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:57:52 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8e3a02db-61, col_values=(('qos', UUID('9499efb3-b25e-412b-a261-77a204923a8f')),), if_exists=True) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:57:52 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8e3a02db-61, col_values=(('external_ids', {'iface-id': '8e3a02db-6163-43cd-b8ea-e52e85e68b24', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:51:a5:b7', 'vm-uuid': 'bc39b8e1-c8f9-4aa9-8d1b-72524b73f88c'}),), if_exists=True) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:57:52 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:57:52 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 09:57:52 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:57:52 user nova-compute[75229]: INFO os_vif [None req-23705a1a-b740-468b-9af7-a59fb08f7f42 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:51:a5:b7,bridge_name='br-int',has_traffic_filtering=True,id=8e3a02db-6163-43cd-b8ea-e52e85e68b24,network=Network(118ea7c1-77c0-4660-b7b7-f311f6b0ec8a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e3a02db-61')
Nov 14 09:57:52 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-23705a1a-b740-468b-9af7-a59fb08f7f42 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] No BDM found with device name vda, not building metadata. {{(pid=75229) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 09:57:52 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-23705a1a-b740-468b-9af7-a59fb08f7f42 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] No VIF found with MAC fa:16:3e:51:a5:b7, not building metadata {{(pid=75229) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 09:57:53 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:57:53 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 09:57:53 user nova-compute[75229]: DEBUG nova.compute.manager [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Starting heal instance info cache {{(pid=75229) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 09:57:53 user nova-compute[75229]: DEBUG nova.compute.manager [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Rebuilding the list of instances to heal {{(pid=75229) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 09:57:53 user nova-compute[75229]: DEBUG nova.compute.manager [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] [instance: bc39b8e1-c8f9-4aa9-8d1b-72524b73f88c] Skipping network cache update for instance because it is Building. {{(pid=75229) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Nov 14 09:57:53 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Acquiring lock "refresh_cache-a7750cbc-b3d0-44aa-8b88-c291ba007a8a" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 09:57:53 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Acquired lock "refresh_cache-a7750cbc-b3d0-44aa-8b88-c291ba007a8a" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 09:57:53 user nova-compute[75229]: DEBUG nova.network.neutron [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] [instance: a7750cbc-b3d0-44aa-8b88-c291ba007a8a] Forcefully refreshing network info cache for instance {{(pid=75229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 09:57:53 user nova-compute[75229]: DEBUG nova.objects.instance [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Lazy-loading 'info_cache' on Instance uuid a7750cbc-b3d0-44aa-8b88-c291ba007a8a {{(pid=75229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 09:57:54 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:57:54 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:57:54 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:57:54 user nova-compute[75229]: DEBUG nova.compute.manager [req-ff068b9c-bc61-4f72-99e3-99320dab7e81 req-39bb46a0-1f16-44ec-a573-328cb4a56357 service nova] [instance: bc39b8e1-c8f9-4aa9-8d1b-72524b73f88c] Received event network-vif-plugged-8e3a02db-6163-43cd-b8ea-e52e85e68b24 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:57:54 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-ff068b9c-bc61-4f72-99e3-99320dab7e81 req-39bb46a0-1f16-44ec-a573-328cb4a56357 service nova] Acquiring lock "bc39b8e1-c8f9-4aa9-8d1b-72524b73f88c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:57:54 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-ff068b9c-bc61-4f72-99e3-99320dab7e81 req-39bb46a0-1f16-44ec-a573-328cb4a56357 service nova] Lock "bc39b8e1-c8f9-4aa9-8d1b-72524b73f88c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:57:54 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-ff068b9c-bc61-4f72-99e3-99320dab7e81 req-39bb46a0-1f16-44ec-a573-328cb4a56357 service nova] Lock "bc39b8e1-c8f9-4aa9-8d1b-72524b73f88c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:57:54 user nova-compute[75229]: DEBUG nova.compute.manager [req-ff068b9c-bc61-4f72-99e3-99320dab7e81 req-39bb46a0-1f16-44ec-a573-328cb4a56357 service nova] [instance: bc39b8e1-c8f9-4aa9-8d1b-72524b73f88c] No waiting events found dispatching network-vif-plugged-8e3a02db-6163-43cd-b8ea-e52e85e68b24 {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 09:57:54 user nova-compute[75229]: WARNING nova.compute.manager [req-ff068b9c-bc61-4f72-99e3-99320dab7e81 req-39bb46a0-1f16-44ec-a573-328cb4a56357 service nova] [instance: bc39b8e1-c8f9-4aa9-8d1b-72524b73f88c] Received unexpected event network-vif-plugged-8e3a02db-6163-43cd-b8ea-e52e85e68b24 for instance with vm_state building and task_state spawning.
Nov 14 09:57:54 user nova-compute[75229]: DEBUG nova.network.neutron [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] [instance: a7750cbc-b3d0-44aa-8b88-c291ba007a8a] Updating instance_info_cache with network_info: [{"id": "e5b20e94-618c-4c51-b20f-1d3f1fb921b6", "address": "fa:16:3e:e5:e8:ed", "network": {"id": "5dfc532f-3d5d-4342-b7f1-12c9c3992a54", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1457278473-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46e65cdd021f4a3db7c9254bb6d98b46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5b20e94-61", "ovs_interfaceid": "e5b20e94-618c-4c51-b20f-1d3f1fb921b6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 09:57:54 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Releasing lock "refresh_cache-a7750cbc-b3d0-44aa-8b88-c291ba007a8a" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 09:57:54 user nova-compute[75229]: DEBUG nova.compute.manager [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] [instance: a7750cbc-b3d0-44aa-8b88-c291ba007a8a] Updated the network info_cache for instance {{(pid=75229) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 09:57:54 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:57:54 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:57:54 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:57:55 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 09:57:55 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 09:57:55 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 09:57:55 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:57:55 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:57:55 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:57:55 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Auditing locally available compute resources for user (node: user) {{(pid=75229) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 09:57:55 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cda8c5ad-e70c-4021-bace-d55831c4bc78/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:57:56 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cda8c5ad-e70c-4021-bace-d55831c4bc78/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:57:56 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cda8c5ad-e70c-4021-bace-d55831c4bc78/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:57:56 user nova-compute[75229]: DEBUG nova.compute.manager [None req-23705a1a-b740-468b-9af7-a59fb08f7f42 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] [instance: bc39b8e1-c8f9-4aa9-8d1b-72524b73f88c] Instance event wait completed in 0 seconds for  {{(pid=75229) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 09:57:56 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-23705a1a-b740-468b-9af7-a59fb08f7f42 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] [instance: bc39b8e1-c8f9-4aa9-8d1b-72524b73f88c] Guest created on hypervisor {{(pid=75229) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 09:57:56 user nova-compute[75229]: INFO nova.virt.libvirt.driver [-] [instance: bc39b8e1-c8f9-4aa9-8d1b-72524b73f88c] Instance spawned successfully.
Nov 14 09:57:56 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-23705a1a-b740-468b-9af7-a59fb08f7f42 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] [instance: bc39b8e1-c8f9-4aa9-8d1b-72524b73f88c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 09:57:56 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cda8c5ad-e70c-4021-bace-d55831c4bc78/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:57:56 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-23705a1a-b740-468b-9af7-a59fb08f7f42 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] [instance: bc39b8e1-c8f9-4aa9-8d1b-72524b73f88c] Found default for hw_cdrom_bus of ide {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 09:57:56 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-23705a1a-b740-468b-9af7-a59fb08f7f42 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] [instance: bc39b8e1-c8f9-4aa9-8d1b-72524b73f88c] Found default for hw_disk_bus of virtio {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 09:57:56 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-23705a1a-b740-468b-9af7-a59fb08f7f42 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] [instance: bc39b8e1-c8f9-4aa9-8d1b-72524b73f88c] Found default for hw_input_bus of None {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 09:57:56 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-23705a1a-b740-468b-9af7-a59fb08f7f42 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] [instance: bc39b8e1-c8f9-4aa9-8d1b-72524b73f88c] Found default for hw_pointer_model of None {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 09:57:56 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-23705a1a-b740-468b-9af7-a59fb08f7f42 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] [instance: bc39b8e1-c8f9-4aa9-8d1b-72524b73f88c] Found default for hw_video_model of virtio {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 09:57:56 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-23705a1a-b740-468b-9af7-a59fb08f7f42 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] [instance: bc39b8e1-c8f9-4aa9-8d1b-72524b73f88c] Found default for hw_vif_model of virtio {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 09:57:56 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7750cbc-b3d0-44aa-8b88-c291ba007a8a/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:57:56 user nova-compute[75229]: INFO nova.compute.manager [None req-23705a1a-b740-468b-9af7-a59fb08f7f42 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] [instance: bc39b8e1-c8f9-4aa9-8d1b-72524b73f88c] Took 5.20 seconds to spawn the instance on the hypervisor.
Nov 14 09:57:56 user nova-compute[75229]: DEBUG nova.compute.manager [None req-23705a1a-b740-468b-9af7-a59fb08f7f42 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] [instance: bc39b8e1-c8f9-4aa9-8d1b-72524b73f88c] Checking state {{(pid=75229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 09:57:56 user nova-compute[75229]: INFO nova.compute.manager [None req-23705a1a-b740-468b-9af7-a59fb08f7f42 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] [instance: bc39b8e1-c8f9-4aa9-8d1b-72524b73f88c] Took 16.47 seconds to build instance.
Nov 14 09:57:56 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7750cbc-b3d0-44aa-8b88-c291ba007a8a/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:57:56 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7750cbc-b3d0-44aa-8b88-c291ba007a8a/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:57:56 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-23705a1a-b740-468b-9af7-a59fb08f7f42 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Lock "bc39b8e1-c8f9-4aa9-8d1b-72524b73f88c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.600s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:57:56 user nova-compute[75229]: DEBUG nova.compute.manager [req-bd143369-934e-4506-b9c9-8e77ecfcf591 req-ff42cb0f-e3cb-43f4-b8b3-b4737c39e958 service nova] [instance: bc39b8e1-c8f9-4aa9-8d1b-72524b73f88c] Received event network-vif-plugged-8e3a02db-6163-43cd-b8ea-e52e85e68b24 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:57:56 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-bd143369-934e-4506-b9c9-8e77ecfcf591 req-ff42cb0f-e3cb-43f4-b8b3-b4737c39e958 service nova] Acquiring lock "bc39b8e1-c8f9-4aa9-8d1b-72524b73f88c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:57:56 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-bd143369-934e-4506-b9c9-8e77ecfcf591 req-ff42cb0f-e3cb-43f4-b8b3-b4737c39e958 service nova] Lock "bc39b8e1-c8f9-4aa9-8d1b-72524b73f88c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:57:56 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-bd143369-934e-4506-b9c9-8e77ecfcf591 req-ff42cb0f-e3cb-43f4-b8b3-b4737c39e958 service nova] Lock "bc39b8e1-c8f9-4aa9-8d1b-72524b73f88c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:57:56 user nova-compute[75229]: DEBUG nova.compute.manager [req-bd143369-934e-4506-b9c9-8e77ecfcf591 req-ff42cb0f-e3cb-43f4-b8b3-b4737c39e958 service nova] [instance: bc39b8e1-c8f9-4aa9-8d1b-72524b73f88c] No waiting events found dispatching network-vif-plugged-8e3a02db-6163-43cd-b8ea-e52e85e68b24 {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 09:57:56 user nova-compute[75229]: WARNING nova.compute.manager [req-bd143369-934e-4506-b9c9-8e77ecfcf591 req-ff42cb0f-e3cb-43f4-b8b3-b4737c39e958 service nova] [instance: bc39b8e1-c8f9-4aa9-8d1b-72524b73f88c] Received unexpected event network-vif-plugged-8e3a02db-6163-43cd-b8ea-e52e85e68b24 for instance with vm_state active and task_state None.
Nov 14 09:57:56 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7750cbc-b3d0-44aa-8b88-c291ba007a8a/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:57:56 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75229) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 09:57:56 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e58500df-059a-4fce-afb7-ba36feca0697/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:57:56 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e58500df-059a-4fce-afb7-ba36feca0697/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:57:56 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e58500df-059a-4fce-afb7-ba36feca0697/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:57:57 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e58500df-059a-4fce-afb7-ba36feca0697/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:57:57 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c9fe69e-3f9d-4b30-a9e4-efc3e83efa17/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:57:57 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c9fe69e-3f9d-4b30-a9e4-efc3e83efa17/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:57:57 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c9fe69e-3f9d-4b30-a9e4-efc3e83efa17/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:57:57 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c9fe69e-3f9d-4b30-a9e4-efc3e83efa17/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:57:57 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75229) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 09:57:57 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75229) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 09:57:57 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cdd6b32-d4bd-4135-a58e-fbc3b6d2a093/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:57:57 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:57:57 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cdd6b32-d4bd-4135-a58e-fbc3b6d2a093/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:57:57 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cdd6b32-d4bd-4135-a58e-fbc3b6d2a093/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:57:57 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cdd6b32-d4bd-4135-a58e-fbc3b6d2a093/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:57:57 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75229) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 09:57:57 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abb8e340-164d-4bc2-a503-7e8ea3c9b35b/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:57:58 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abb8e340-164d-4bc2-a503-7e8ea3c9b35b/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:57:58 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abb8e340-164d-4bc2-a503-7e8ea3c9b35b/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:57:58 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abb8e340-164d-4bc2-a503-7e8ea3c9b35b/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:57:58 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5170e9e-66e3-4df1-9807-4958cac6480e/disk.rescue --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:57:58 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5170e9e-66e3-4df1-9807-4958cac6480e/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:57:58 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5170e9e-66e3-4df1-9807-4958cac6480e/disk.rescue --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:57:58 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:57:58 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5170e9e-66e3-4df1-9807-4958cac6480e/disk.rescue --force-share --output=json" returned: 0 in 0.192s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:57:58 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5170e9e-66e3-4df1-9807-4958cac6480e/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:57:58 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5170e9e-66e3-4df1-9807-4958cac6480e/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:57:58 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5170e9e-66e3-4df1-9807-4958cac6480e/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:57:59 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5170e9e-66e3-4df1-9807-4958cac6480e/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:57:59 user nova-compute[75229]: WARNING nova.virt.libvirt.driver [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 09:57:59 user nova-compute[75229]: WARNING nova.virt.libvirt.driver [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 09:57:59 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Hypervisor/Node resource view: name=user free_ram=7723MB free_disk=25.156219482421875GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75229) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 09:57:59 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:57:59 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:57:59 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Applying migration context for instance 589f4750-fac6-4e99-a430-0cda339808bc as it has an incoming, in-progress migration efd6ebd1-d0fd-452d-8e9c-ca6c337c47a8. Migration status is finished {{(pid=75229) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 14 09:57:59 user nova-compute[75229]: INFO nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] [instance: 589f4750-fac6-4e99-a430-0cda339808bc] Updating resource usage from migration efd6ebd1-d0fd-452d-8e9c-ca6c337c47a8
Nov 14 09:57:59 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Instance a7750cbc-b3d0-44aa-8b88-c291ba007a8a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 09:57:59 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Instance 4c9fe69e-3f9d-4b30-a9e4-efc3e83efa17 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 09:57:59 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Instance b5170e9e-66e3-4df1-9807-4958cac6480e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 09:57:59 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Instance e58500df-059a-4fce-afb7-ba36feca0697 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 09:57:59 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Instance cda8c5ad-e70c-4021-bace-d55831c4bc78 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 09:57:59 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Instance 9cdd6b32-d4bd-4135-a58e-fbc3b6d2a093 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 09:57:59 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Instance 30ae1f73-e0f3-4e26-987e-a684471a160d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 09:57:59 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Migration efd6ebd1-d0fd-452d-8e9c-ca6c337c47a8 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 14 09:57:59 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Instance 589f4750-fac6-4e99-a430-0cda339808bc actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 09:57:59 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Instance abb8e340-164d-4bc2-a503-7e8ea3c9b35b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 09:57:59 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Instance bc39b8e1-c8f9-4aa9-8d1b-72524b73f88c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 09:57:59 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=75229) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 09:57:59 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=75229) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 09:58:00 user nova-compute[75229]: DEBUG nova.compute.provider_tree [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Inventory has not changed in ProviderTree for provider: d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 {{(pid=75229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 09:58:00 user nova-compute[75229]: DEBUG nova.scheduler.client.report [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Inventory has not changed for provider d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 09:58:00 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Compute_service record updated for user:user {{(pid=75229) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 09:58:00 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.539s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:58:02 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:58:03 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:58:04 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 09:58:04 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 09:58:04 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 09:58:04 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 09:58:04 user nova-compute[75229]: DEBUG nova.compute.manager [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75229) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 09:58:07 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:58:08 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:58:09 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 09:58:12 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:58:13 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:58:17 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:58:18 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:58:22 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:58:23 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:58:27 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:58:28 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:58:28 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-125854a5-9ece-46ce-99e8-6538817996ce tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Acquiring lock "eba59006-83c1-4bda-b9f5-f3be4d1e5e58" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:58:28 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-125854a5-9ece-46ce-99e8-6538817996ce tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Lock "eba59006-83c1-4bda-b9f5-f3be4d1e5e58" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:58:28 user nova-compute[75229]: DEBUG nova.compute.manager [None req-125854a5-9ece-46ce-99e8-6538817996ce tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] [instance: eba59006-83c1-4bda-b9f5-f3be4d1e5e58] Starting instance... {{(pid=75229) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 09:58:28 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-125854a5-9ece-46ce-99e8-6538817996ce tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:58:28 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-125854a5-9ece-46ce-99e8-6538817996ce tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:58:28 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-125854a5-9ece-46ce-99e8-6538817996ce tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75229) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 09:58:28 user nova-compute[75229]: INFO nova.compute.claims [None req-125854a5-9ece-46ce-99e8-6538817996ce tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] [instance: eba59006-83c1-4bda-b9f5-f3be4d1e5e58] Claim successful on node user
Nov 14 09:58:29 user nova-compute[75229]: DEBUG nova.compute.provider_tree [None req-125854a5-9ece-46ce-99e8-6538817996ce tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Inventory has not changed in ProviderTree for provider: d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 {{(pid=75229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 09:58:29 user nova-compute[75229]: DEBUG nova.scheduler.client.report [None req-125854a5-9ece-46ce-99e8-6538817996ce tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Inventory has not changed for provider d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 09:58:29 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-125854a5-9ece-46ce-99e8-6538817996ce tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.638s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:58:29 user nova-compute[75229]: DEBUG nova.compute.manager [None req-125854a5-9ece-46ce-99e8-6538817996ce tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] [instance: eba59006-83c1-4bda-b9f5-f3be4d1e5e58] Start building networks asynchronously for instance. {{(pid=75229) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 09:58:29 user nova-compute[75229]: DEBUG nova.compute.manager [None req-125854a5-9ece-46ce-99e8-6538817996ce tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] [instance: eba59006-83c1-4bda-b9f5-f3be4d1e5e58] Allocating IP information in the background. {{(pid=75229) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 09:58:29 user nova-compute[75229]: DEBUG nova.network.neutron [None req-125854a5-9ece-46ce-99e8-6538817996ce tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] [instance: eba59006-83c1-4bda-b9f5-f3be4d1e5e58] allocate_for_instance() {{(pid=75229) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 09:58:29 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-125854a5-9ece-46ce-99e8-6538817996ce tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] [instance: eba59006-83c1-4bda-b9f5-f3be4d1e5e58] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 09:58:29 user nova-compute[75229]: DEBUG nova.compute.manager [None req-125854a5-9ece-46ce-99e8-6538817996ce tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] [instance: eba59006-83c1-4bda-b9f5-f3be4d1e5e58] Start building block device mappings for instance. {{(pid=75229) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 09:58:29 user nova-compute[75229]: DEBUG nova.policy [None req-125854a5-9ece-46ce-99e8-6538817996ce tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3b8313e365eb4970a58c412768e959bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b8d48c38c7344f5b12d0ed5b9392554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75229) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 09:58:29 user nova-compute[75229]: DEBUG nova.compute.manager [None req-125854a5-9ece-46ce-99e8-6538817996ce tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] [instance: eba59006-83c1-4bda-b9f5-f3be4d1e5e58] Start spawning the instance on the hypervisor. {{(pid=75229) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 09:58:29 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-125854a5-9ece-46ce-99e8-6538817996ce tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] [instance: eba59006-83c1-4bda-b9f5-f3be4d1e5e58] Creating instance directory {{(pid=75229) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 09:58:29 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-125854a5-9ece-46ce-99e8-6538817996ce tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] [instance: eba59006-83c1-4bda-b9f5-f3be4d1e5e58] Creating image(s)
Nov 14 09:58:29 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-125854a5-9ece-46ce-99e8-6538817996ce tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Acquiring lock "/opt/stack/data/nova/instances/eba59006-83c1-4bda-b9f5-f3be4d1e5e58/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:58:29 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-125854a5-9ece-46ce-99e8-6538817996ce tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Lock "/opt/stack/data/nova/instances/eba59006-83c1-4bda-b9f5-f3be4d1e5e58/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:58:29 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-125854a5-9ece-46ce-99e8-6538817996ce tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Lock "/opt/stack/data/nova/instances/eba59006-83c1-4bda-b9f5-f3be4d1e5e58/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:58:29 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-125854a5-9ece-46ce-99e8-6538817996ce tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6 --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:58:29 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-125854a5-9ece-46ce-99e8-6538817996ce tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6 --force-share --output=json" returned: 0 in 0.212s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:58:29 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-125854a5-9ece-46ce-99e8-6538817996ce tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Acquiring lock "4f30e3fe703d2381679612a57b1fb80a467f60b6" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:58:29 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-125854a5-9ece-46ce-99e8-6538817996ce tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Lock "4f30e3fe703d2381679612a57b1fb80a467f60b6" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:58:29 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-125854a5-9ece-46ce-99e8-6538817996ce tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6 --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:58:30 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-125854a5-9ece-46ce-99e8-6538817996ce tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6 --force-share --output=json" returned: 0 in 0.180s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:58:30 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-125854a5-9ece-46ce-99e8-6538817996ce tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6,backing_fmt=raw /opt/stack/data/nova/instances/eba59006-83c1-4bda-b9f5-f3be4d1e5e58/disk 1073741824 {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:58:30 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-125854a5-9ece-46ce-99e8-6538817996ce tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6,backing_fmt=raw /opt/stack/data/nova/instances/eba59006-83c1-4bda-b9f5-f3be4d1e5e58/disk 1073741824" returned: 0 in 0.058s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:58:30 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-125854a5-9ece-46ce-99e8-6538817996ce tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Lock "4f30e3fe703d2381679612a57b1fb80a467f60b6" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.244s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:58:30 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-125854a5-9ece-46ce-99e8-6538817996ce tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6 --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:58:30 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-125854a5-9ece-46ce-99e8-6538817996ce tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6 --force-share --output=json" returned: 0 in 0.204s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:58:30 user nova-compute[75229]: DEBUG nova.virt.disk.api [None req-125854a5-9ece-46ce-99e8-6538817996ce tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Checking if we can resize image /opt/stack/data/nova/instances/eba59006-83c1-4bda-b9f5-f3be4d1e5e58/disk. size=1073741824 {{(pid=75229) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 09:58:30 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-125854a5-9ece-46ce-99e8-6538817996ce tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eba59006-83c1-4bda-b9f5-f3be4d1e5e58/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:58:30 user nova-compute[75229]: DEBUG nova.network.neutron [None req-125854a5-9ece-46ce-99e8-6538817996ce tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] [instance: eba59006-83c1-4bda-b9f5-f3be4d1e5e58] Successfully created port: 3eec6b6f-28b1-4026-b81a-22c88d1f94a4 {{(pid=75229) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 09:58:30 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-125854a5-9ece-46ce-99e8-6538817996ce tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eba59006-83c1-4bda-b9f5-f3be4d1e5e58/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:58:30 user nova-compute[75229]: DEBUG nova.virt.disk.api [None req-125854a5-9ece-46ce-99e8-6538817996ce tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Cannot resize image /opt/stack/data/nova/instances/eba59006-83c1-4bda-b9f5-f3be4d1e5e58/disk to a smaller size. {{(pid=75229) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 09:58:30 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-125854a5-9ece-46ce-99e8-6538817996ce tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] [instance: eba59006-83c1-4bda-b9f5-f3be4d1e5e58] Created local disks {{(pid=75229) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 09:58:30 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-125854a5-9ece-46ce-99e8-6538817996ce tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] [instance: eba59006-83c1-4bda-b9f5-f3be4d1e5e58] Ensure instance console log exists: /opt/stack/data/nova/instances/eba59006-83c1-4bda-b9f5-f3be4d1e5e58/console.log {{(pid=75229) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 09:58:30 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-125854a5-9ece-46ce-99e8-6538817996ce tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:58:30 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-125854a5-9ece-46ce-99e8-6538817996ce tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:58:30 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-125854a5-9ece-46ce-99e8-6538817996ce tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:58:31 user nova-compute[75229]: DEBUG nova.network.neutron [None req-125854a5-9ece-46ce-99e8-6538817996ce tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] [instance: eba59006-83c1-4bda-b9f5-f3be4d1e5e58] Successfully updated port: 3eec6b6f-28b1-4026-b81a-22c88d1f94a4 {{(pid=75229) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 09:58:31 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-125854a5-9ece-46ce-99e8-6538817996ce tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Acquiring lock "refresh_cache-eba59006-83c1-4bda-b9f5-f3be4d1e5e58" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 09:58:31 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-125854a5-9ece-46ce-99e8-6538817996ce tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Acquired lock "refresh_cache-eba59006-83c1-4bda-b9f5-f3be4d1e5e58" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 09:58:31 user nova-compute[75229]: DEBUG nova.network.neutron [None req-125854a5-9ece-46ce-99e8-6538817996ce tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] [instance: eba59006-83c1-4bda-b9f5-f3be4d1e5e58] Building network info cache for instance {{(pid=75229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 09:58:31 user nova-compute[75229]: DEBUG nova.compute.manager [req-1d1331fe-25dc-46f1-8eb2-497a3439c6d1 req-3b830dfe-935d-48c7-9b58-a48674441d3b service nova] [instance: eba59006-83c1-4bda-b9f5-f3be4d1e5e58] Received event network-changed-3eec6b6f-28b1-4026-b81a-22c88d1f94a4 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:58:31 user nova-compute[75229]: DEBUG nova.compute.manager [req-1d1331fe-25dc-46f1-8eb2-497a3439c6d1 req-3b830dfe-935d-48c7-9b58-a48674441d3b service nova] [instance: eba59006-83c1-4bda-b9f5-f3be4d1e5e58] Refreshing instance network info cache due to event network-changed-3eec6b6f-28b1-4026-b81a-22c88d1f94a4. {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 09:58:31 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-1d1331fe-25dc-46f1-8eb2-497a3439c6d1 req-3b830dfe-935d-48c7-9b58-a48674441d3b service nova] Acquiring lock "refresh_cache-eba59006-83c1-4bda-b9f5-f3be4d1e5e58" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 09:58:31 user nova-compute[75229]: DEBUG nova.network.neutron [None req-125854a5-9ece-46ce-99e8-6538817996ce tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] [instance: eba59006-83c1-4bda-b9f5-f3be4d1e5e58] Instance cache missing network info. {{(pid=75229) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 09:58:31 user nova-compute[75229]: DEBUG nova.network.neutron [None req-125854a5-9ece-46ce-99e8-6538817996ce tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] [instance: eba59006-83c1-4bda-b9f5-f3be4d1e5e58] Updating instance_info_cache with network_info: [{"id": "3eec6b6f-28b1-4026-b81a-22c88d1f94a4", "address": "fa:16:3e:8c:7a:8a", "network": {"id": "bd407caa-6ef6-400d-9327-3179dc1d8da4", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-29933774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b8d48c38c7344f5b12d0ed5b9392554", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3eec6b6f-28", "ovs_interfaceid": "3eec6b6f-28b1-4026-b81a-22c88d1f94a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 09:58:31 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-125854a5-9ece-46ce-99e8-6538817996ce tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Releasing lock "refresh_cache-eba59006-83c1-4bda-b9f5-f3be4d1e5e58" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 09:58:31 user nova-compute[75229]: DEBUG nova.compute.manager [None req-125854a5-9ece-46ce-99e8-6538817996ce tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] [instance: eba59006-83c1-4bda-b9f5-f3be4d1e5e58] Instance network_info: |[{"id": "3eec6b6f-28b1-4026-b81a-22c88d1f94a4", "address": "fa:16:3e:8c:7a:8a", "network": {"id": "bd407caa-6ef6-400d-9327-3179dc1d8da4", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-29933774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b8d48c38c7344f5b12d0ed5b9392554", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3eec6b6f-28", "ovs_interfaceid": "3eec6b6f-28b1-4026-b81a-22c88d1f94a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75229) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 09:58:31 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-1d1331fe-25dc-46f1-8eb2-497a3439c6d1 req-3b830dfe-935d-48c7-9b58-a48674441d3b service nova] Acquired lock "refresh_cache-eba59006-83c1-4bda-b9f5-f3be4d1e5e58" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 09:58:31 user nova-compute[75229]: DEBUG nova.network.neutron [req-1d1331fe-25dc-46f1-8eb2-497a3439c6d1 req-3b830dfe-935d-48c7-9b58-a48674441d3b service nova] [instance: eba59006-83c1-4bda-b9f5-f3be4d1e5e58] Refreshing network info cache for port 3eec6b6f-28b1-4026-b81a-22c88d1f94a4 {{(pid=75229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 09:58:31 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-125854a5-9ece-46ce-99e8-6538817996ce tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] [instance: eba59006-83c1-4bda-b9f5-f3be4d1e5e58] Start _get_guest_xml network_info=[{"id": "3eec6b6f-28b1-4026-b81a-22c88d1f94a4", "address": "fa:16:3e:8c:7a:8a", "network": {"id": "bd407caa-6ef6-400d-9327-3179dc1d8da4", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-29933774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b8d48c38c7344f5b12d0ed5b9392554", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3eec6b6f-28", "ovs_interfaceid": "3eec6b6f-28b1-4026-b81a-22c88d1f94a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T09:40:10Z,direct_url=<?>,disk_format='qcow2',id=3bef8470-ecc7-40e3-95d4-9254348ea72d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='de5a91106b6948ed937a7178ff9464c4',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T09:40:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'disk_bus': 'virtio', 'guest_format': None, 'encryption_secret_uuid': None, 'size': 0, 'device_type': 'disk', 'image_id': '3bef8470-ecc7-40e3-95d4-9254348ea72d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75229) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 09:58:31 user nova-compute[75229]: WARNING nova.virt.libvirt.driver [None req-125854a5-9ece-46ce-99e8-6538817996ce tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 09:58:31 user nova-compute[75229]: WARNING nova.virt.libvirt.driver [None req-125854a5-9ece-46ce-99e8-6538817996ce tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 09:58:31 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-125854a5-9ece-46ce-99e8-6538817996ce tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75229) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 09:58:31 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-125854a5-9ece-46ce-99e8-6538817996ce tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] CPU controller missing on host. {{(pid=75229) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 09:58:31 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-125854a5-9ece-46ce-99e8-6538817996ce tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75229) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 09:58:31 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-125854a5-9ece-46ce-99e8-6538817996ce tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] CPU controller found on host. {{(pid=75229) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 09:58:31 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-125854a5-9ece-46ce-99e8-6538817996ce tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75229) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 09:58:31 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-125854a5-9ece-46ce-99e8-6538817996ce tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T09:39:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T09:40:10Z,direct_url=<?>,disk_format='qcow2',id=3bef8470-ecc7-40e3-95d4-9254348ea72d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='de5a91106b6948ed937a7178ff9464c4',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T09:40:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 09:58:31 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-125854a5-9ece-46ce-99e8-6538817996ce tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Flavor limits 0:0:0 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 09:58:31 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-125854a5-9ece-46ce-99e8-6538817996ce tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Image limits 0:0:0 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 09:58:31 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-125854a5-9ece-46ce-99e8-6538817996ce tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Flavor pref 0:0:0 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 09:58:31 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-125854a5-9ece-46ce-99e8-6538817996ce tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Image pref 0:0:0 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 09:58:31 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-125854a5-9ece-46ce-99e8-6538817996ce tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 09:58:31 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-125854a5-9ece-46ce-99e8-6538817996ce tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 09:58:31 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-125854a5-9ece-46ce-99e8-6538817996ce tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75229) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 09:58:31 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-125854a5-9ece-46ce-99e8-6538817996ce tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Got 1 possible topologies {{(pid=75229) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 09:58:31 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-125854a5-9ece-46ce-99e8-6538817996ce tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 09:58:31 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-125854a5-9ece-46ce-99e8-6538817996ce tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 09:58:31 user nova-compute[75229]: DEBUG nova.virt.libvirt.vif [None req-125854a5-9ece-46ce-99e8-6538817996ce tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T09:58:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1194693438',display_name='tempest-AttachVolumeNegativeTest-server-1194693438',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1194693438',id=37,image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEGArvZaufn98L/n8qe2G/tMbxpeJIFyBc3Sy+z02pn+jM1N9OPNiOdEk/tKM43bM6T65GvcsHCI7BkPQknWTS/YFjBkC5TVU0CgY0hjM5R93g1H95A5vsED7YJjsKnXtQ==',key_name='tempest-keypair-1144153704',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8b8d48c38c7344f5b12d0ed5b9392554',ramdisk_id='',reservation_id='r-nraikvdc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-140392099',owner_user_name='tempest-AttachVolumeNegativeTest-140392099-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T09:58:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3b8313e365eb4970a58c412768e959bf',uuid=eba59006-83c1-4bda-b9f5-f3be4d1e5e58,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3eec6b6f-28b1-4026-b81a-22c88d1f94a4", "address": "fa:16:3e:8c:7a:8a", "network": {"id": "bd407caa-6ef6-400d-9327-3179dc1d8da4", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-29933774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b8d48c38c7344f5b12d0ed5b9392554", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3eec6b6f-28", "ovs_interfaceid": "3eec6b6f-28b1-4026-b81a-22c88d1f94a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75229) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 09:58:31 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-125854a5-9ece-46ce-99e8-6538817996ce tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Converting VIF {"id": "3eec6b6f-28b1-4026-b81a-22c88d1f94a4", "address": "fa:16:3e:8c:7a:8a", "network": {"id": "bd407caa-6ef6-400d-9327-3179dc1d8da4", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-29933774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b8d48c38c7344f5b12d0ed5b9392554", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3eec6b6f-28", "ovs_interfaceid": "3eec6b6f-28b1-4026-b81a-22c88d1f94a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 09:58:31 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-125854a5-9ece-46ce-99e8-6538817996ce tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8c:7a:8a,bridge_name='br-int',has_traffic_filtering=True,id=3eec6b6f-28b1-4026-b81a-22c88d1f94a4,network=Network(bd407caa-6ef6-400d-9327-3179dc1d8da4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3eec6b6f-28') {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 09:58:31 user nova-compute[75229]: DEBUG nova.objects.instance [None req-125854a5-9ece-46ce-99e8-6538817996ce tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Lazy-loading 'pci_devices' on Instance uuid eba59006-83c1-4bda-b9f5-f3be4d1e5e58 {{(pid=75229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 09:58:31 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-125854a5-9ece-46ce-99e8-6538817996ce tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] [instance: eba59006-83c1-4bda-b9f5-f3be4d1e5e58] End _get_guest_xml xml=<domain type="kvm">
Nov 14 09:58:31 user nova-compute[75229]:   <uuid>eba59006-83c1-4bda-b9f5-f3be4d1e5e58</uuid>
Nov 14 09:58:31 user nova-compute[75229]:   <name>instance-00000025</name>
Nov 14 09:58:31 user nova-compute[75229]:   <memory>524288</memory>
Nov 14 09:58:31 user nova-compute[75229]:   <vcpu>1</vcpu>
Nov 14 09:58:31 user nova-compute[75229]:   <metadata>
Nov 14 09:58:31 user nova-compute[75229]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 09:58:31 user nova-compute[75229]:       <nova:package version="0.0.0"/>
Nov 14 09:58:31 user nova-compute[75229]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1194693438</nova:name>
Nov 14 09:58:31 user nova-compute[75229]:       <nova:creationTime>2023-11-14 09:58:31</nova:creationTime>
Nov 14 09:58:31 user nova-compute[75229]:       <nova:flavor name="m1.tiny">
Nov 14 09:58:31 user nova-compute[75229]:         <nova:memory>512</nova:memory>
Nov 14 09:58:31 user nova-compute[75229]:         <nova:disk>1</nova:disk>
Nov 14 09:58:31 user nova-compute[75229]:         <nova:swap>0</nova:swap>
Nov 14 09:58:31 user nova-compute[75229]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 09:58:31 user nova-compute[75229]:         <nova:vcpus>1</nova:vcpus>
Nov 14 09:58:31 user nova-compute[75229]:       </nova:flavor>
Nov 14 09:58:31 user nova-compute[75229]:       <nova:owner>
Nov 14 09:58:31 user nova-compute[75229]:         <nova:user uuid="3b8313e365eb4970a58c412768e959bf">tempest-AttachVolumeNegativeTest-140392099-project-member</nova:user>
Nov 14 09:58:31 user nova-compute[75229]:         <nova:project uuid="8b8d48c38c7344f5b12d0ed5b9392554">tempest-AttachVolumeNegativeTest-140392099</nova:project>
Nov 14 09:58:31 user nova-compute[75229]:       </nova:owner>
Nov 14 09:58:31 user nova-compute[75229]:       <nova:root type="image" uuid="3bef8470-ecc7-40e3-95d4-9254348ea72d"/>
Nov 14 09:58:31 user nova-compute[75229]:       <nova:ports>
Nov 14 09:58:31 user nova-compute[75229]:         <nova:port uuid="3eec6b6f-28b1-4026-b81a-22c88d1f94a4">
Nov 14 09:58:31 user nova-compute[75229]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 14 09:58:31 user nova-compute[75229]:         </nova:port>
Nov 14 09:58:31 user nova-compute[75229]:       </nova:ports>
Nov 14 09:58:31 user nova-compute[75229]:     </nova:instance>
Nov 14 09:58:31 user nova-compute[75229]:   </metadata>
Nov 14 09:58:31 user nova-compute[75229]:   <sysinfo type="smbios">
Nov 14 09:58:31 user nova-compute[75229]:     <system>
Nov 14 09:58:31 user nova-compute[75229]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 09:58:31 user nova-compute[75229]:       <entry name="product">OpenStack Nova</entry>
Nov 14 09:58:31 user nova-compute[75229]:       <entry name="version">0.0.0</entry>
Nov 14 09:58:31 user nova-compute[75229]:       <entry name="serial">eba59006-83c1-4bda-b9f5-f3be4d1e5e58</entry>
Nov 14 09:58:31 user nova-compute[75229]:       <entry name="uuid">eba59006-83c1-4bda-b9f5-f3be4d1e5e58</entry>
Nov 14 09:58:31 user nova-compute[75229]:       <entry name="family">Virtual Machine</entry>
Nov 14 09:58:31 user nova-compute[75229]:     </system>
Nov 14 09:58:31 user nova-compute[75229]:   </sysinfo>
Nov 14 09:58:31 user nova-compute[75229]:   <os>
Nov 14 09:58:31 user nova-compute[75229]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 09:58:31 user nova-compute[75229]:     <boot dev="hd"/>
Nov 14 09:58:31 user nova-compute[75229]:     <smbios mode="sysinfo"/>
Nov 14 09:58:31 user nova-compute[75229]:   </os>
Nov 14 09:58:31 user nova-compute[75229]:   <features>
Nov 14 09:58:31 user nova-compute[75229]:     <acpi/>
Nov 14 09:58:31 user nova-compute[75229]:     <apic/>
Nov 14 09:58:31 user nova-compute[75229]:     <vmcoreinfo/>
Nov 14 09:58:31 user nova-compute[75229]:   </features>
Nov 14 09:58:31 user nova-compute[75229]:   <clock offset="utc">
Nov 14 09:58:31 user nova-compute[75229]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 09:58:31 user nova-compute[75229]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 09:58:31 user nova-compute[75229]:     <timer name="hpet" present="no"/>
Nov 14 09:58:31 user nova-compute[75229]:   </clock>
Nov 14 09:58:31 user nova-compute[75229]:   <cpu mode="custom" match="exact">
Nov 14 09:58:31 user nova-compute[75229]:     <model>Nehalem</model>
Nov 14 09:58:31 user nova-compute[75229]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 09:58:31 user nova-compute[75229]:   </cpu>
Nov 14 09:58:31 user nova-compute[75229]:   <devices>
Nov 14 09:58:31 user nova-compute[75229]:     <disk type="file" device="disk">
Nov 14 09:58:31 user nova-compute[75229]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 09:58:31 user nova-compute[75229]:       <source file="/opt/stack/data/nova/instances/eba59006-83c1-4bda-b9f5-f3be4d1e5e58/disk"/>
Nov 14 09:58:31 user nova-compute[75229]:       <target dev="vda" bus="virtio"/>
Nov 14 09:58:31 user nova-compute[75229]:     </disk>
Nov 14 09:58:31 user nova-compute[75229]:     <interface type="ethernet">
Nov 14 09:58:31 user nova-compute[75229]:       <mac address="fa:16:3e:8c:7a:8a"/>
Nov 14 09:58:31 user nova-compute[75229]:       <model type="virtio"/>
Nov 14 09:58:31 user nova-compute[75229]:       <mtu size="1442"/>
Nov 14 09:58:31 user nova-compute[75229]:       <target dev="tap3eec6b6f-28"/>
Nov 14 09:58:31 user nova-compute[75229]:     </interface>
Nov 14 09:58:31 user nova-compute[75229]:     <serial type="pty">
Nov 14 09:58:31 user nova-compute[75229]:       <log file="/opt/stack/data/nova/instances/eba59006-83c1-4bda-b9f5-f3be4d1e5e58/console.log" append="off"/>
Nov 14 09:58:31 user nova-compute[75229]:     </serial>
Nov 14 09:58:31 user nova-compute[75229]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 09:58:31 user nova-compute[75229]:     <video>
Nov 14 09:58:31 user nova-compute[75229]:       <model type="virtio"/>
Nov 14 09:58:31 user nova-compute[75229]:     </video>
Nov 14 09:58:31 user nova-compute[75229]:     <rng model="virtio">
Nov 14 09:58:31 user nova-compute[75229]:       <backend model="random">/dev/urandom</backend>
Nov 14 09:58:31 user nova-compute[75229]:     </rng>
Nov 14 09:58:31 user nova-compute[75229]:     <controller type="usb" index="0" model="none"/>
Nov 14 09:58:31 user nova-compute[75229]:     <memballoon model="virtio">
Nov 14 09:58:31 user nova-compute[75229]:       <stats period="10"/>
Nov 14 09:58:31 user nova-compute[75229]:     </memballoon>
Nov 14 09:58:31 user nova-compute[75229]:   </devices>
Nov 14 09:58:31 user nova-compute[75229]: </domain>
Nov 14 09:58:31 user nova-compute[75229]:  {{(pid=75229) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 09:58:31 user nova-compute[75229]: DEBUG nova.virt.libvirt.vif [None req-125854a5-9ece-46ce-99e8-6538817996ce tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T09:58:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1194693438',display_name='tempest-AttachVolumeNegativeTest-server-1194693438',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1194693438',id=37,image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEGArvZaufn98L/n8qe2G/tMbxpeJIFyBc3Sy+z02pn+jM1N9OPNiOdEk/tKM43bM6T65GvcsHCI7BkPQknWTS/YFjBkC5TVU0CgY0hjM5R93g1H95A5vsED7YJjsKnXtQ==',key_name='tempest-keypair-1144153704',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8b8d48c38c7344f5b12d0ed5b9392554',ramdisk_id='',reservation_id='r-nraikvdc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-140392099',owner_user_name='tempest-AttachVolumeNegativeTest-140392099-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T09:58:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3b8313e365eb4970a58c412768e959bf',uuid=eba59006-83c1-4bda-b9f5-f3be4d1e5e58,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3eec6b6f-28b1-4026-b81a-22c88d1f94a4", "address": "fa:16:3e:8c:7a:8a", "network": {"id": "bd407caa-6ef6-400d-9327-3179dc1d8da4", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-29933774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b8d48c38c7344f5b12d0ed5b9392554", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3eec6b6f-28", "ovs_interfaceid": "3eec6b6f-28b1-4026-b81a-22c88d1f94a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 09:58:31 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-125854a5-9ece-46ce-99e8-6538817996ce tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Converting VIF {"id": "3eec6b6f-28b1-4026-b81a-22c88d1f94a4", "address": "fa:16:3e:8c:7a:8a", "network": {"id": "bd407caa-6ef6-400d-9327-3179dc1d8da4", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-29933774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b8d48c38c7344f5b12d0ed5b9392554", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3eec6b6f-28", "ovs_interfaceid": "3eec6b6f-28b1-4026-b81a-22c88d1f94a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 09:58:31 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-125854a5-9ece-46ce-99e8-6538817996ce tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8c:7a:8a,bridge_name='br-int',has_traffic_filtering=True,id=3eec6b6f-28b1-4026-b81a-22c88d1f94a4,network=Network(bd407caa-6ef6-400d-9327-3179dc1d8da4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3eec6b6f-28') {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 09:58:31 user nova-compute[75229]: DEBUG os_vif [None req-125854a5-9ece-46ce-99e8-6538817996ce tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8c:7a:8a,bridge_name='br-int',has_traffic_filtering=True,id=3eec6b6f-28b1-4026-b81a-22c88d1f94a4,network=Network(bd407caa-6ef6-400d-9327-3179dc1d8da4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3eec6b6f-28') {{(pid=75229) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 09:58:31 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:58:31 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:58:31 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 09:58:31 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:58:31 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '488df730-5d7f-5838-99a9-b909dda285d5', '_type': 'linux-noop'}}, row=False) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:58:31 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:58:31 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 09:58:31 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:58:31 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3eec6b6f-28, may_exist=True, interface_attrs={}) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:58:31 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3eec6b6f-28, col_values=(('qos', UUID('35036d1d-1acb-456f-aa54-8ec2bbf24e2b')),), if_exists=True) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:58:31 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3eec6b6f-28, col_values=(('external_ids', {'iface-id': '3eec6b6f-28b1-4026-b81a-22c88d1f94a4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8c:7a:8a', 'vm-uuid': 'eba59006-83c1-4bda-b9f5-f3be4d1e5e58'}),), if_exists=True) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:58:31 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:58:31 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 09:58:31 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:58:31 user nova-compute[75229]: INFO os_vif [None req-125854a5-9ece-46ce-99e8-6538817996ce tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8c:7a:8a,bridge_name='br-int',has_traffic_filtering=True,id=3eec6b6f-28b1-4026-b81a-22c88d1f94a4,network=Network(bd407caa-6ef6-400d-9327-3179dc1d8da4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3eec6b6f-28')
Nov 14 09:58:32 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-125854a5-9ece-46ce-99e8-6538817996ce tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] No BDM found with device name vda, not building metadata. {{(pid=75229) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 09:58:32 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-125854a5-9ece-46ce-99e8-6538817996ce tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] No VIF found with MAC fa:16:3e:8c:7a:8a, not building metadata {{(pid=75229) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 09:58:32 user nova-compute[75229]: DEBUG nova.network.neutron [req-1d1331fe-25dc-46f1-8eb2-497a3439c6d1 req-3b830dfe-935d-48c7-9b58-a48674441d3b service nova] [instance: eba59006-83c1-4bda-b9f5-f3be4d1e5e58] Updated VIF entry in instance network info cache for port 3eec6b6f-28b1-4026-b81a-22c88d1f94a4. {{(pid=75229) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 09:58:32 user nova-compute[75229]: DEBUG nova.network.neutron [req-1d1331fe-25dc-46f1-8eb2-497a3439c6d1 req-3b830dfe-935d-48c7-9b58-a48674441d3b service nova] [instance: eba59006-83c1-4bda-b9f5-f3be4d1e5e58] Updating instance_info_cache with network_info: [{"id": "3eec6b6f-28b1-4026-b81a-22c88d1f94a4", "address": "fa:16:3e:8c:7a:8a", "network": {"id": "bd407caa-6ef6-400d-9327-3179dc1d8da4", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-29933774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b8d48c38c7344f5b12d0ed5b9392554", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3eec6b6f-28", "ovs_interfaceid": "3eec6b6f-28b1-4026-b81a-22c88d1f94a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 09:58:32 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-1d1331fe-25dc-46f1-8eb2-497a3439c6d1 req-3b830dfe-935d-48c7-9b58-a48674441d3b service nova] Releasing lock "refresh_cache-eba59006-83c1-4bda-b9f5-f3be4d1e5e58" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 09:58:33 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:58:33 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:58:33 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:58:33 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:58:33 user nova-compute[75229]: DEBUG nova.compute.manager [req-85298d12-627f-4cdc-a324-bb352cef64e8 req-20821f83-5ad9-4748-9f65-54a8f41c4fdf service nova] [instance: eba59006-83c1-4bda-b9f5-f3be4d1e5e58] Received event network-vif-plugged-3eec6b6f-28b1-4026-b81a-22c88d1f94a4 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:58:33 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-85298d12-627f-4cdc-a324-bb352cef64e8 req-20821f83-5ad9-4748-9f65-54a8f41c4fdf service nova] Acquiring lock "eba59006-83c1-4bda-b9f5-f3be4d1e5e58-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:58:33 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-85298d12-627f-4cdc-a324-bb352cef64e8 req-20821f83-5ad9-4748-9f65-54a8f41c4fdf service nova] Lock "eba59006-83c1-4bda-b9f5-f3be4d1e5e58-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:58:33 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-85298d12-627f-4cdc-a324-bb352cef64e8 req-20821f83-5ad9-4748-9f65-54a8f41c4fdf service nova] Lock "eba59006-83c1-4bda-b9f5-f3be4d1e5e58-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:58:33 user nova-compute[75229]: DEBUG nova.compute.manager [req-85298d12-627f-4cdc-a324-bb352cef64e8 req-20821f83-5ad9-4748-9f65-54a8f41c4fdf service nova] [instance: eba59006-83c1-4bda-b9f5-f3be4d1e5e58] No waiting events found dispatching network-vif-plugged-3eec6b6f-28b1-4026-b81a-22c88d1f94a4 {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 09:58:33 user nova-compute[75229]: WARNING nova.compute.manager [req-85298d12-627f-4cdc-a324-bb352cef64e8 req-20821f83-5ad9-4748-9f65-54a8f41c4fdf service nova] [instance: eba59006-83c1-4bda-b9f5-f3be4d1e5e58] Received unexpected event network-vif-plugged-3eec6b6f-28b1-4026-b81a-22c88d1f94a4 for instance with vm_state building and task_state spawning.
Nov 14 09:58:33 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:58:33 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:58:33 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:58:34 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:58:35 user nova-compute[75229]: DEBUG nova.compute.manager [None req-125854a5-9ece-46ce-99e8-6538817996ce tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] [instance: eba59006-83c1-4bda-b9f5-f3be4d1e5e58] Instance event wait completed in 0 seconds for  {{(pid=75229) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 09:58:35 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-125854a5-9ece-46ce-99e8-6538817996ce tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] [instance: eba59006-83c1-4bda-b9f5-f3be4d1e5e58] Guest created on hypervisor {{(pid=75229) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 09:58:35 user nova-compute[75229]: INFO nova.virt.libvirt.driver [-] [instance: eba59006-83c1-4bda-b9f5-f3be4d1e5e58] Instance spawned successfully.
Nov 14 09:58:35 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-125854a5-9ece-46ce-99e8-6538817996ce tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] [instance: eba59006-83c1-4bda-b9f5-f3be4d1e5e58] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 09:58:35 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-125854a5-9ece-46ce-99e8-6538817996ce tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] [instance: eba59006-83c1-4bda-b9f5-f3be4d1e5e58] Found default for hw_cdrom_bus of ide {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 09:58:35 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-125854a5-9ece-46ce-99e8-6538817996ce tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] [instance: eba59006-83c1-4bda-b9f5-f3be4d1e5e58] Found default for hw_disk_bus of virtio {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 09:58:35 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-125854a5-9ece-46ce-99e8-6538817996ce tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] [instance: eba59006-83c1-4bda-b9f5-f3be4d1e5e58] Found default for hw_input_bus of None {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 09:58:35 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-125854a5-9ece-46ce-99e8-6538817996ce tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] [instance: eba59006-83c1-4bda-b9f5-f3be4d1e5e58] Found default for hw_pointer_model of None {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 09:58:35 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-125854a5-9ece-46ce-99e8-6538817996ce tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] [instance: eba59006-83c1-4bda-b9f5-f3be4d1e5e58] Found default for hw_video_model of virtio {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 09:58:35 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-125854a5-9ece-46ce-99e8-6538817996ce tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] [instance: eba59006-83c1-4bda-b9f5-f3be4d1e5e58] Found default for hw_vif_model of virtio {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 09:58:35 user nova-compute[75229]: DEBUG nova.compute.manager [req-4bf8df99-e520-4956-80ad-706e91564eab req-290479a4-1717-458f-a4f5-0d5d2a60f142 service nova] [instance: eba59006-83c1-4bda-b9f5-f3be4d1e5e58] Received event network-vif-plugged-3eec6b6f-28b1-4026-b81a-22c88d1f94a4 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:58:35 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-4bf8df99-e520-4956-80ad-706e91564eab req-290479a4-1717-458f-a4f5-0d5d2a60f142 service nova] Acquiring lock "eba59006-83c1-4bda-b9f5-f3be4d1e5e58-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:58:35 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-4bf8df99-e520-4956-80ad-706e91564eab req-290479a4-1717-458f-a4f5-0d5d2a60f142 service nova] Lock "eba59006-83c1-4bda-b9f5-f3be4d1e5e58-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:58:35 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-4bf8df99-e520-4956-80ad-706e91564eab req-290479a4-1717-458f-a4f5-0d5d2a60f142 service nova] Lock "eba59006-83c1-4bda-b9f5-f3be4d1e5e58-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:58:35 user nova-compute[75229]: DEBUG nova.compute.manager [req-4bf8df99-e520-4956-80ad-706e91564eab req-290479a4-1717-458f-a4f5-0d5d2a60f142 service nova] [instance: eba59006-83c1-4bda-b9f5-f3be4d1e5e58] No waiting events found dispatching network-vif-plugged-3eec6b6f-28b1-4026-b81a-22c88d1f94a4 {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 09:58:35 user nova-compute[75229]: WARNING nova.compute.manager [req-4bf8df99-e520-4956-80ad-706e91564eab req-290479a4-1717-458f-a4f5-0d5d2a60f142 service nova] [instance: eba59006-83c1-4bda-b9f5-f3be4d1e5e58] Received unexpected event network-vif-plugged-3eec6b6f-28b1-4026-b81a-22c88d1f94a4 for instance with vm_state building and task_state spawning.
Nov 14 09:58:35 user nova-compute[75229]: INFO nova.compute.manager [None req-125854a5-9ece-46ce-99e8-6538817996ce tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] [instance: eba59006-83c1-4bda-b9f5-f3be4d1e5e58] Took 5.95 seconds to spawn the instance on the hypervisor.
Nov 14 09:58:35 user nova-compute[75229]: DEBUG nova.compute.manager [None req-125854a5-9ece-46ce-99e8-6538817996ce tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] [instance: eba59006-83c1-4bda-b9f5-f3be4d1e5e58] Checking state {{(pid=75229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 09:58:35 user nova-compute[75229]: INFO nova.compute.manager [None req-125854a5-9ece-46ce-99e8-6538817996ce tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] [instance: eba59006-83c1-4bda-b9f5-f3be4d1e5e58] Took 6.97 seconds to build instance.
Nov 14 09:58:35 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-125854a5-9ece-46ce-99e8-6538817996ce tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Lock "eba59006-83c1-4bda-b9f5-f3be4d1e5e58" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.135s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:58:36 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:58:38 user nova-compute[75229]: INFO nova.compute.manager [None req-c0d19783-031f-471b-9222-f460ef81ea84 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] [instance: 30ae1f73-e0f3-4e26-987e-a684471a160d] Rescuing
Nov 14 09:58:38 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-c0d19783-031f-471b-9222-f460ef81ea84 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Acquiring lock "refresh_cache-30ae1f73-e0f3-4e26-987e-a684471a160d" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 09:58:38 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-c0d19783-031f-471b-9222-f460ef81ea84 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Acquired lock "refresh_cache-30ae1f73-e0f3-4e26-987e-a684471a160d" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 09:58:38 user nova-compute[75229]: DEBUG nova.network.neutron [None req-c0d19783-031f-471b-9222-f460ef81ea84 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] [instance: 30ae1f73-e0f3-4e26-987e-a684471a160d] Building network info cache for instance {{(pid=75229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 09:58:38 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:58:39 user nova-compute[75229]: DEBUG nova.network.neutron [None req-c0d19783-031f-471b-9222-f460ef81ea84 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] [instance: 30ae1f73-e0f3-4e26-987e-a684471a160d] Updating instance_info_cache with network_info: [{"id": "c087c657-8eee-4e8e-bef1-4281129597ae", "address": "fa:16:3e:aa:d3:e3", "network": {"id": "6a700b61-4aa6-440b-87e6-a3525a5cb918", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-448680331-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8babb73006da4977a1fe2bdb35e08d8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc087c657-8e", "ovs_interfaceid": "c087c657-8eee-4e8e-bef1-4281129597ae", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 09:58:39 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-c0d19783-031f-471b-9222-f460ef81ea84 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Releasing lock "refresh_cache-30ae1f73-e0f3-4e26-987e-a684471a160d" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 09:58:39 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:58:39 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:58:39 user nova-compute[75229]: DEBUG nova.compute.manager [req-da6aebe6-10b3-4b8c-b4e6-d80b4c395f0c req-492b6e41-f02f-4816-965d-2c40eff7deb4 service nova] [instance: 30ae1f73-e0f3-4e26-987e-a684471a160d] Received event network-vif-unplugged-c087c657-8eee-4e8e-bef1-4281129597ae {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:58:39 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-da6aebe6-10b3-4b8c-b4e6-d80b4c395f0c req-492b6e41-f02f-4816-965d-2c40eff7deb4 service nova] Acquiring lock "30ae1f73-e0f3-4e26-987e-a684471a160d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:58:39 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-da6aebe6-10b3-4b8c-b4e6-d80b4c395f0c req-492b6e41-f02f-4816-965d-2c40eff7deb4 service nova] Lock "30ae1f73-e0f3-4e26-987e-a684471a160d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:58:39 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-da6aebe6-10b3-4b8c-b4e6-d80b4c395f0c req-492b6e41-f02f-4816-965d-2c40eff7deb4 service nova] Lock "30ae1f73-e0f3-4e26-987e-a684471a160d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:58:39 user nova-compute[75229]: DEBUG nova.compute.manager [req-da6aebe6-10b3-4b8c-b4e6-d80b4c395f0c req-492b6e41-f02f-4816-965d-2c40eff7deb4 service nova] [instance: 30ae1f73-e0f3-4e26-987e-a684471a160d] No waiting events found dispatching network-vif-unplugged-c087c657-8eee-4e8e-bef1-4281129597ae {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 09:58:39 user nova-compute[75229]: WARNING nova.compute.manager [req-da6aebe6-10b3-4b8c-b4e6-d80b4c395f0c req-492b6e41-f02f-4816-965d-2c40eff7deb4 service nova] [instance: 30ae1f73-e0f3-4e26-987e-a684471a160d] Received unexpected event network-vif-unplugged-c087c657-8eee-4e8e-bef1-4281129597ae for instance with vm_state active and task_state rescuing.
Nov 14 09:58:39 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:58:39 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:58:39 user nova-compute[75229]: INFO nova.virt.libvirt.driver [-] [instance: 30ae1f73-e0f3-4e26-987e-a684471a160d] Instance destroyed successfully.
Nov 14 09:58:39 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-c0d19783-031f-471b-9222-f460ef81ea84 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] [instance: 30ae1f73-e0f3-4e26-987e-a684471a160d] Attempting a stable device rescue
Nov 14 09:58:39 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-c0d19783-031f-471b-9222-f460ef81ea84 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75229) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 14 09:58:39 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-c0d19783-031f-471b-9222-f460ef81ea84 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] [instance: 30ae1f73-e0f3-4e26-987e-a684471a160d] Instance directory exists: not creating {{(pid=75229) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 14 09:58:39 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-c0d19783-031f-471b-9222-f460ef81ea84 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] [instance: 30ae1f73-e0f3-4e26-987e-a684471a160d] Creating image(s)
Nov 14 09:58:39 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-c0d19783-031f-471b-9222-f460ef81ea84 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Acquiring lock "/opt/stack/data/nova/instances/30ae1f73-e0f3-4e26-987e-a684471a160d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:58:39 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-c0d19783-031f-471b-9222-f460ef81ea84 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Lock "/opt/stack/data/nova/instances/30ae1f73-e0f3-4e26-987e-a684471a160d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:58:39 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-c0d19783-031f-471b-9222-f460ef81ea84 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Lock "/opt/stack/data/nova/instances/30ae1f73-e0f3-4e26-987e-a684471a160d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:58:39 user nova-compute[75229]: DEBUG nova.objects.instance [None req-c0d19783-031f-471b-9222-f460ef81ea84 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Lazy-loading 'trusted_certs' on Instance uuid 30ae1f73-e0f3-4e26-987e-a684471a160d {{(pid=75229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 09:58:39 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-c0d19783-031f-471b-9222-f460ef81ea84 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Acquiring lock "d8468a836873c93f733c22455de284c8041fbfd2" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:58:39 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-c0d19783-031f-471b-9222-f460ef81ea84 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Lock "d8468a836873c93f733c22455de284c8041fbfd2" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:58:41 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-c0d19783-031f-471b-9222-f460ef81ea84 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8468a836873c93f733c22455de284c8041fbfd2.part --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:58:41 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-c0d19783-031f-471b-9222-f460ef81ea84 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8468a836873c93f733c22455de284c8041fbfd2.part --force-share --output=json" returned: 0 in 0.185s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:58:41 user nova-compute[75229]: DEBUG nova.virt.images [None req-c0d19783-031f-471b-9222-f460ef81ea84 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] d3c5d094-b612-4532-967e-6cd61397a429 was qcow2, converting to raw {{(pid=75229) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 14 09:58:41 user nova-compute[75229]: DEBUG nova.privsep.utils [None req-c0d19783-031f-471b-9222-f460ef81ea84 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75229) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 14 09:58:41 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-c0d19783-031f-471b-9222-f460ef81ea84 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/d8468a836873c93f733c22455de284c8041fbfd2.part /opt/stack/data/nova/instances/_base/d8468a836873c93f733c22455de284c8041fbfd2.converted {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:58:41 user nova-compute[75229]: DEBUG nova.compute.manager [req-1df551e1-d3f8-4c88-8057-e55ceec54dee req-69fff773-adcc-40ec-89d8-7a84a4492602 service nova] [instance: 30ae1f73-e0f3-4e26-987e-a684471a160d] Received event network-vif-plugged-c087c657-8eee-4e8e-bef1-4281129597ae {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:58:41 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-1df551e1-d3f8-4c88-8057-e55ceec54dee req-69fff773-adcc-40ec-89d8-7a84a4492602 service nova] Acquiring lock "30ae1f73-e0f3-4e26-987e-a684471a160d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:58:41 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-1df551e1-d3f8-4c88-8057-e55ceec54dee req-69fff773-adcc-40ec-89d8-7a84a4492602 service nova] Lock "30ae1f73-e0f3-4e26-987e-a684471a160d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:58:41 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-1df551e1-d3f8-4c88-8057-e55ceec54dee req-69fff773-adcc-40ec-89d8-7a84a4492602 service nova] Lock "30ae1f73-e0f3-4e26-987e-a684471a160d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:58:41 user nova-compute[75229]: DEBUG nova.compute.manager [req-1df551e1-d3f8-4c88-8057-e55ceec54dee req-69fff773-adcc-40ec-89d8-7a84a4492602 service nova] [instance: 30ae1f73-e0f3-4e26-987e-a684471a160d] No waiting events found dispatching network-vif-plugged-c087c657-8eee-4e8e-bef1-4281129597ae {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 09:58:41 user nova-compute[75229]: WARNING nova.compute.manager [req-1df551e1-d3f8-4c88-8057-e55ceec54dee req-69fff773-adcc-40ec-89d8-7a84a4492602 service nova] [instance: 30ae1f73-e0f3-4e26-987e-a684471a160d] Received unexpected event network-vif-plugged-c087c657-8eee-4e8e-bef1-4281129597ae for instance with vm_state active and task_state rescuing.
Nov 14 09:58:41 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-c0d19783-031f-471b-9222-f460ef81ea84 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/d8468a836873c93f733c22455de284c8041fbfd2.part /opt/stack/data/nova/instances/_base/d8468a836873c93f733c22455de284c8041fbfd2.converted" returned: 0 in 0.609s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:58:41 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-c0d19783-031f-471b-9222-f460ef81ea84 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8468a836873c93f733c22455de284c8041fbfd2.converted --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:58:41 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:58:42 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-c0d19783-031f-471b-9222-f460ef81ea84 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8468a836873c93f733c22455de284c8041fbfd2.converted --force-share --output=json" returned: 0 in 0.186s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:58:42 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-c0d19783-031f-471b-9222-f460ef81ea84 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Lock "d8468a836873c93f733c22455de284c8041fbfd2" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.123s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:58:42 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-c0d19783-031f-471b-9222-f460ef81ea84 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Acquiring lock "d8468a836873c93f733c22455de284c8041fbfd2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:58:42 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-c0d19783-031f-471b-9222-f460ef81ea84 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Lock "d8468a836873c93f733c22455de284c8041fbfd2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:58:42 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-c0d19783-031f-471b-9222-f460ef81ea84 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8468a836873c93f733c22455de284c8041fbfd2 --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:58:42 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-c0d19783-031f-471b-9222-f460ef81ea84 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8468a836873c93f733c22455de284c8041fbfd2 --force-share --output=json" returned: 0 in 0.201s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:58:42 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-c0d19783-031f-471b-9222-f460ef81ea84 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d8468a836873c93f733c22455de284c8041fbfd2,backing_fmt=raw /opt/stack/data/nova/instances/30ae1f73-e0f3-4e26-987e-a684471a160d/disk.rescue {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:58:42 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-c0d19783-031f-471b-9222-f460ef81ea84 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d8468a836873c93f733c22455de284c8041fbfd2,backing_fmt=raw /opt/stack/data/nova/instances/30ae1f73-e0f3-4e26-987e-a684471a160d/disk.rescue" returned: 0 in 0.047s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:58:42 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-c0d19783-031f-471b-9222-f460ef81ea84 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Lock "d8468a836873c93f733c22455de284c8041fbfd2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.255s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:58:42 user nova-compute[75229]: DEBUG nova.objects.instance [None req-c0d19783-031f-471b-9222-f460ef81ea84 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Lazy-loading 'migration_context' on Instance uuid 30ae1f73-e0f3-4e26-987e-a684471a160d {{(pid=75229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 09:58:42 user nova-compute[75229]: DEBUG nova.objects.base [None req-c0d19783-031f-471b-9222-f460ef81ea84 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Object Instance<30ae1f73-e0f3-4e26-987e-a684471a160d> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75229) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 09:58:42 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-c0d19783-031f-471b-9222-f460ef81ea84 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] [instance: 30ae1f73-e0f3-4e26-987e-a684471a160d] Created local disks {{(pid=75229) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 09:58:42 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-c0d19783-031f-471b-9222-f460ef81ea84 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] [instance: 30ae1f73-e0f3-4e26-987e-a684471a160d] Start _get_guest_xml network_info=[{"id": "c087c657-8eee-4e8e-bef1-4281129597ae", "address": "fa:16:3e:aa:d3:e3", "network": {"id": "6a700b61-4aa6-440b-87e6-a3525a5cb918", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-448680331-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-448680331-network", "vif_mac": "fa:16:3e:aa:d3:e3"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8babb73006da4977a1fe2bdb35e08d8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc087c657-8e", "ovs_interfaceid": "c087c657-8eee-4e8e-bef1-4281129597ae", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T09:40:10Z,direct_url=<?>,disk_format='qcow2',id=3bef8470-ecc7-40e3-95d4-9254348ea72d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='de5a91106b6948ed937a7178ff9464c4',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T09:40:12Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'd3c5d094-b612-4532-967e-6cd61397a429', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:5aebc438-0289-44fe-ad84-4e696468f50e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TgiuaWRw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': '30ae1f73-e0f3-4e26-987e-a684471a160d', 'attached_at': '', 'detached_at': '', 'volume_id': '5aebc438-0289-44fe-ad84-4e696468f50e', 'serial': '5aebc438-0289-44fe-ad84-4e696468f50e'}, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'attachment_id': '9b10ab8a-4a64-4912-825a-056b2487f548', 'guest_format': None, 'device_type': 'disk', 'volume_type': None} {{(pid=75229) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 09:58:42 user nova-compute[75229]: DEBUG nova.objects.instance [None req-c0d19783-031f-471b-9222-f460ef81ea84 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Lazy-loading 'resources' on Instance uuid 30ae1f73-e0f3-4e26-987e-a684471a160d {{(pid=75229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 09:58:42 user nova-compute[75229]: DEBUG nova.objects.base [None req-c0d19783-031f-471b-9222-f460ef81ea84 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Object Instance<30ae1f73-e0f3-4e26-987e-a684471a160d> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75229) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 09:58:42 user nova-compute[75229]: DEBUG nova.objects.instance [None req-c0d19783-031f-471b-9222-f460ef81ea84 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Lazy-loading 'numa_topology' on Instance uuid 30ae1f73-e0f3-4e26-987e-a684471a160d {{(pid=75229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 09:58:42 user nova-compute[75229]: DEBUG nova.objects.base [None req-c0d19783-031f-471b-9222-f460ef81ea84 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Object Instance<30ae1f73-e0f3-4e26-987e-a684471a160d> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75229) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 09:58:42 user nova-compute[75229]: WARNING nova.virt.libvirt.driver [None req-c0d19783-031f-471b-9222-f460ef81ea84 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 09:58:42 user nova-compute[75229]: WARNING nova.virt.libvirt.driver [None req-c0d19783-031f-471b-9222-f460ef81ea84 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 09:58:42 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-c0d19783-031f-471b-9222-f460ef81ea84 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75229) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 09:58:42 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-c0d19783-031f-471b-9222-f460ef81ea84 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] CPU controller missing on host. {{(pid=75229) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 09:58:42 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-c0d19783-031f-471b-9222-f460ef81ea84 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75229) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 09:58:42 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-c0d19783-031f-471b-9222-f460ef81ea84 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] CPU controller found on host. {{(pid=75229) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 09:58:42 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-c0d19783-031f-471b-9222-f460ef81ea84 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75229) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 09:58:42 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-c0d19783-031f-471b-9222-f460ef81ea84 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T09:39:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T09:40:10Z,direct_url=<?>,disk_format='qcow2',id=3bef8470-ecc7-40e3-95d4-9254348ea72d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='de5a91106b6948ed937a7178ff9464c4',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T09:40:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 09:58:42 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-c0d19783-031f-471b-9222-f460ef81ea84 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Flavor limits 0:0:0 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 09:58:42 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-c0d19783-031f-471b-9222-f460ef81ea84 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Image limits 0:0:0 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 09:58:42 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-c0d19783-031f-471b-9222-f460ef81ea84 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Flavor pref 0:0:0 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 09:58:42 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-c0d19783-031f-471b-9222-f460ef81ea84 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Image pref 0:0:0 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 09:58:42 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-c0d19783-031f-471b-9222-f460ef81ea84 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 09:58:42 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-c0d19783-031f-471b-9222-f460ef81ea84 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 09:58:42 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-c0d19783-031f-471b-9222-f460ef81ea84 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75229) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 09:58:42 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-c0d19783-031f-471b-9222-f460ef81ea84 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Got 1 possible topologies {{(pid=75229) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 09:58:42 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-c0d19783-031f-471b-9222-f460ef81ea84 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 09:58:42 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-c0d19783-031f-471b-9222-f460ef81ea84 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 09:58:42 user nova-compute[75229]: DEBUG nova.objects.instance [None req-c0d19783-031f-471b-9222-f460ef81ea84 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Lazy-loading 'vcpu_model' on Instance uuid 30ae1f73-e0f3-4e26-987e-a684471a160d {{(pid=75229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 09:58:42 user nova-compute[75229]: DEBUG nova.objects.base [None req-c0d19783-031f-471b-9222-f460ef81ea84 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Object Instance<30ae1f73-e0f3-4e26-987e-a684471a160d> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75229) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 09:58:42 user nova-compute[75229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c0d19783-031f-471b-9222-f460ef81ea84 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] [instance: 30ae1f73-e0f3-4e26-987e-a684471a160d] Calling os-brick to attach iSCSI Volume {{(pid=75229) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 09:58:42 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0d19783-031f-471b-9222-f460ef81ea84 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f73f85151b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5aebc438-0289-44fe-ad84-4e696468f50e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TgiuaWRw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 09:58:42 user nova-compute[75229]: WARNING os_brick.initiator.connectors.base [None req-c0d19783-031f-471b-9222-f460ef81ea84 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 09:58:42 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-c0d19783-031f-471b-9222-f460ef81ea84 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 09:58:42 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-c0d19783-031f-471b-9222-f460ef81ea84 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 09:58:42 user nova-compute[75229]: WARNING os_brick.initiator.connectors.base [None req-c0d19783-031f-471b-9222-f460ef81ea84 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 09:58:42 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-c0d19783-031f-471b-9222-f460ef81ea84 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5aebc438-0289-44fe-ad84-4e696468f50e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 09:58:42 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-c0d19783-031f-471b-9222-f460ef81ea84 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5aebc438-0289-44fe-ad84-4e696468f50e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 09:58:42 user nova-compute[75229]: INFO os_brick.initiator.connectors.iscsi [None req-c0d19783-031f-471b-9222-f460ef81ea84 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 09:58:42 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5aebc438-0289-44fe-ad84-4e696468f50e -p 172.16.0.220:3260 {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:58:42 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5aebc438-0289-44fe-ad84-4e696468f50e -p 172.16.0.220:3260" returned: 0 in 0.019s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:58:42 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[05a8b95e-be3d-4013-b9f9-c4e5ed514cf3]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:5aebc438-0289-44fe-ad84-4e696468f50e\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = TgiuaWRw\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:58:42 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0d19783-031f-471b-9222-f460ef81ea84 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 14 09:58:42 user nova-compute[75229]: node.name = iqn.2010-10.org.openstack:5aebc438-0289-44fe-ad84-4e696468f50e
Nov 14 09:58:42 user nova-compute[75229]: node.tpgt = -1
Nov 14 09:58:42 user nova-compute[75229]: node.startup = automatic
Nov 14 09:58:42 user nova-compute[75229]: node.leading_login = No
Nov 14 09:58:42 user nova-compute[75229]: iface.iscsi_ifacename = default
Nov 14 09:58:42 user nova-compute[75229]: iface.net_ifacename = <empty>
Nov 14 09:58:42 user nova-compute[75229]: iface.ipaddress = <empty>
Nov 14 09:58:42 user nova-compute[75229]: iface.prefix_len = 0
Nov 14 09:58:42 user nova-compute[75229]: iface.hwaddress = <empty>
Nov 14 09:58:42 user nova-compute[75229]: iface.transport_name = tcp
Nov 14 09:58:42 user nova-compute[75229]: iface.initiatorname = <empty>
Nov 14 09:58:42 user nova-compute[75229]: iface.state = <empty>
Nov 14 09:58:42 user nova-compute[75229]: iface.vlan_id = 0
Nov 14 09:58:42 user nova-compute[75229]: iface.vlan_priority = 0
Nov 14 09:58:42 user nova-compute[75229]: iface.vlan_state = <empty>
Nov 14 09:58:42 user nova-compute[75229]: iface.iface_num = 0
Nov 14 09:58:42 user nova-compute[75229]: iface.mtu = 0
Nov 14 09:58:42 user nova-compute[75229]: iface.port = 0
Nov 14 09:58:42 user nova-compute[75229]: iface.bootproto = <empty>
Nov 14 09:58:42 user nova-compute[75229]: iface.subnet_mask = <empty>
Nov 14 09:58:42 user nova-compute[75229]: iface.gateway = <empty>
Nov 14 09:58:42 user nova-compute[75229]: iface.dhcp_alt_client_id_state = <empty>
Nov 14 09:58:42 user nova-compute[75229]: iface.dhcp_alt_client_id = <empty>
Nov 14 09:58:42 user nova-compute[75229]: iface.dhcp_dns = <empty>
Nov 14 09:58:42 user nova-compute[75229]: iface.dhcp_learn_iqn = <empty>
Nov 14 09:58:42 user nova-compute[75229]: iface.dhcp_req_vendor_id_state = <empty>
Nov 14 09:58:42 user nova-compute[75229]: iface.dhcp_vendor_id_state = <empty>
Nov 14 09:58:42 user nova-compute[75229]: iface.dhcp_vendor_id = <empty>
Nov 14 09:58:42 user nova-compute[75229]: iface.dhcp_slp_da = <empty>
Nov 14 09:58:42 user nova-compute[75229]: iface.fragmentation = <empty>
Nov 14 09:58:42 user nova-compute[75229]: iface.gratuitous_arp = <empty>
Nov 14 09:58:42 user nova-compute[75229]: iface.incoming_forwarding = <empty>
Nov 14 09:58:42 user nova-compute[75229]: iface.tos_state = <empty>
Nov 14 09:58:42 user nova-compute[75229]: iface.tos = 0
Nov 14 09:58:42 user nova-compute[75229]: iface.ttl = 0
Nov 14 09:58:42 user nova-compute[75229]: iface.delayed_ack = <empty>
Nov 14 09:58:42 user nova-compute[75229]: iface.tcp_nagle = <empty>
Nov 14 09:58:42 user nova-compute[75229]: iface.tcp_wsf_state = <empty>
Nov 14 09:58:42 user nova-compute[75229]: iface.tcp_wsf = 0
Nov 14 09:58:42 user nova-compute[75229]: iface.tcp_timer_scale = 0
Nov 14 09:58:42 user nova-compute[75229]: iface.tcp_timestamp = <empty>
Nov 14 09:58:42 user nova-compute[75229]: iface.redirect = <empty>
Nov 14 09:58:42 user nova-compute[75229]: iface.def_task_mgmt_timeout = 0
Nov 14 09:58:42 user nova-compute[75229]: iface.header_digest = <empty>
Nov 14 09:58:42 user nova-compute[75229]: iface.data_digest = <empty>
Nov 14 09:58:42 user nova-compute[75229]: iface.immediate_data = <empty>
Nov 14 09:58:42 user nova-compute[75229]: iface.initial_r2t = <empty>
Nov 14 09:58:42 user nova-compute[75229]: iface.data_seq_inorder = <empty>
Nov 14 09:58:42 user nova-compute[75229]: iface.data_pdu_inorder = <empty>
Nov 14 09:58:42 user nova-compute[75229]: iface.erl = 0
Nov 14 09:58:42 user nova-compute[75229]: iface.max_receive_data_len = 0
Nov 14 09:58:42 user nova-compute[75229]: iface.first_burst_len = 0
Nov 14 09:58:42 user nova-compute[75229]: iface.max_outstanding_r2t = 0
Nov 14 09:58:42 user nova-compute[75229]: iface.max_burst_len = 0
Nov 14 09:58:42 user nova-compute[75229]: iface.chap_auth = <empty>
Nov 14 09:58:42 user nova-compute[75229]: iface.bidi_chap = <empty>
Nov 14 09:58:42 user nova-compute[75229]: iface.strict_login_compliance = <empty>
Nov 14 09:58:42 user nova-compute[75229]: iface.discovery_auth = <empty>
Nov 14 09:58:42 user nova-compute[75229]: iface.discovery_logout = <empty>
Nov 14 09:58:42 user nova-compute[75229]: node.discovery_address = <empty>
Nov 14 09:58:42 user nova-compute[75229]: node.discovery_port = 0
Nov 14 09:58:42 user nova-compute[75229]: node.discovery_type = static
Nov 14 09:58:42 user nova-compute[75229]: node.session.initial_cmdsn = 0
Nov 14 09:58:42 user nova-compute[75229]: node.session.initial_login_retry_max = 8
Nov 14 09:58:42 user nova-compute[75229]: node.session.xmit_thread_priority = -20
Nov 14 09:58:42 user nova-compute[75229]: node.session.cmds_max = 128
Nov 14 09:58:42 user nova-compute[75229]: node.session.queue_depth = 32
Nov 14 09:58:42 user nova-compute[75229]: node.session.nr_sessions = 1
Nov 14 09:58:42 user nova-compute[75229]: node.session.auth.authmethod = CHAP
Nov 14 09:58:42 user nova-compute[75229]: node.session.auth.username = TgiuaWRw
Nov 14 09:58:42 user nova-compute[75229]: node.session.auth.password = ***
Nov 14 09:58:42 user nova-compute[75229]: node.session.auth.username_in = <empty>
Nov 14 09:58:42 user nova-compute[75229]: node.session.auth.password_in = <empty>
Nov 14 09:58:42 user nova-compute[75229]: node.session.auth.chap_algs = MD5
Nov 14 09:58:42 user nova-compute[75229]: node.session.timeo.replacement_timeout = 120
Nov 14 09:58:42 user nova-compute[75229]: node.session.err_timeo.abort_timeout = 15
Nov 14 09:58:42 user nova-compute[75229]: node.session.err_timeo.lu_reset_timeout = 30
Nov 14 09:58:42 user nova-compute[75229]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 14 09:58:42 user nova-compute[75229]: node.session.err_timeo.host_reset_timeout = 60
Nov 14 09:58:42 user nova-compute[75229]: node.session.iscsi.FastAbort = Yes
Nov 14 09:58:42 user nova-compute[75229]: node.session.iscsi.InitialR2T = No
Nov 14 09:58:42 user nova-compute[75229]: node.session.iscsi.ImmediateData = Yes
Nov 14 09:58:42 user nova-compute[75229]: node.session.iscsi.FirstBurstLength = 262144
Nov 14 09:58:42 user nova-compute[75229]: node.session.iscsi.MaxBurstLength = 16776192
Nov 14 09:58:42 user nova-compute[75229]: node.session.iscsi.DefaultTime2Retain = 0
Nov 14 09:58:42 user nova-compute[75229]: node.session.iscsi.DefaultTime2Wait = 2
Nov 14 09:58:42 user nova-compute[75229]: node.session.iscsi.MaxConnections = 1
Nov 14 09:58:42 user nova-compute[75229]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 14 09:58:42 user nova-compute[75229]: node.session.iscsi.ERL = 0
Nov 14 09:58:42 user nova-compute[75229]: node.session.scan = manual
Nov 14 09:58:42 user nova-compute[75229]: node.session.reopen_max = 0
Nov 14 09:58:42 user nova-compute[75229]: node.conn[0].address = 172.16.0.220
Nov 14 09:58:42 user nova-compute[75229]: node.conn[0].port = 3260
Nov 14 09:58:42 user nova-compute[75229]: node.conn[0].startup = manual
Nov 14 09:58:42 user nova-compute[75229]: node.conn[0].tcp.window_size = 524288
Nov 14 09:58:42 user nova-compute[75229]: node.conn[0].tcp.type_of_service = 0
Nov 14 09:58:42 user nova-compute[75229]: node.conn[0].timeo.logout_timeout = 15
Nov 14 09:58:42 user nova-compute[75229]: node.conn[0].timeo.login_timeout = 15
Nov 14 09:58:42 user nova-compute[75229]: node.conn[0].timeo.auth_timeout = 45
Nov 14 09:58:42 user nova-compute[75229]: node.conn[0].timeo.noop_out_interval = 5
Nov 14 09:58:42 user nova-compute[75229]: node.conn[0].timeo.noop_out_timeout = 5
Nov 14 09:58:42 user nova-compute[75229]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 14 09:58:42 user nova-compute[75229]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 14 09:58:42 user nova-compute[75229]: node.conn[0].iscsi.HeaderDigest = None
Nov 14 09:58:42 user nova-compute[75229]: node.conn[0].iscsi.DataDigest = None
Nov 14 09:58:42 user nova-compute[75229]: node.conn[0].iscsi.IFMarker = No
Nov 14 09:58:42 user nova-compute[75229]: node.conn[0].iscsi.OFMarker = No
Nov 14 09:58:42 user nova-compute[75229]: # END RECORD
Nov 14 09:58:42 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:58:42 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5aebc438-0289-44fe-ad84-4e696468f50e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:58:42 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5aebc438-0289-44fe-ad84-4e696468f50e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:58:42 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[b10b3ea2-daa5-4ddb-a10b-f1d79c350496]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:58:42 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0d19783-031f-471b-9222-f460ef81ea84 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:58:42 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5aebc438-0289-44fe-ad84-4e696468f50e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:58:42 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5aebc438-0289-44fe-ad84-4e696468f50e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:58:42 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[0710ba39-ca0c-4bf8-a1b1-a6b435897f01]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:58:42 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0d19783-031f-471b-9222-f460ef81ea84 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:58:42 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5aebc438-0289-44fe-ad84-4e696468f50e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TgiuaWRw {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:58:42 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5aebc438-0289-44fe-ad84-4e696468f50e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TgiuaWRw" returned: 0 in 0.017s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:58:42 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fea33d7-b173-4a08-9cb7-60760cc599ec]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:58:42 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0d19783-031f-471b-9222-f460ef81ea84 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'TgiuaWRw'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:58:42 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5aebc438-0289-44fe-ad84-4e696468f50e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:58:42 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5aebc438-0289-44fe-ad84-4e696468f50e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:58:42 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ad7d71d-6393-4df1-90a5-739516b355f9]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:58:42 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0d19783-031f-471b-9222-f460ef81ea84 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:58:42 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:58:42 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:58:42 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4a2a1ec-10f8-4462-952b-8db7e9a1d129]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aebc438-0289-44fe-ad84-4e696468f50e (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5efb0e0-a85c-46ec-8a9d-2763bf548023 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94a0a817-0b71-4589-90eb-8c8d159f7fd2 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4562974d-4587-4774-adb3-21a623f466c2 (non-flash)\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:58:42 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0d19783-031f-471b-9222-f460ef81ea84 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aebc438-0289-44fe-ad84-4e696468f50e (non-flash)
Nov 14 09:58:42 user nova-compute[75229]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5efb0e0-a85c-46ec-8a9d-2763bf548023 (non-flash)
Nov 14 09:58:42 user nova-compute[75229]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94a0a817-0b71-4589-90eb-8c8d159f7fd2 (non-flash)
Nov 14 09:58:42 user nova-compute[75229]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4562974d-4587-4774-adb3-21a623f466c2 (non-flash)
Nov 14 09:58:42 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 09:58:42 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0d19783-031f-471b-9222-f460ef81ea84 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aebc438-0289-44fe-ad84-4e696468f50e (non-flash)
Nov 14 09:58:42 user nova-compute[75229]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5efb0e0-a85c-46ec-8a9d-2763bf548023 (non-flash)
Nov 14 09:58:42 user nova-compute[75229]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94a0a817-0b71-4589-90eb-8c8d159f7fd2 (non-flash)
Nov 14 09:58:42 user nova-compute[75229]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4562974d-4587-4774-adb3-21a623f466c2 (non-flash)
Nov 14 09:58:42 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 09:58:42 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-c0d19783-031f-471b-9222-f460ef81ea84 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5aebc438-0289-44fe-ad84-4e696468f50e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.150s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 09:58:42 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0d19783-031f-471b-9222-f460ef81ea84 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Connected to 172.16.0.220:3260 {{(pid=75229) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 09:58:42 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-c0d19783-031f-471b-9222-f460ef81ea84 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] HCTL ('34', '0', '0', 0) found on session 34 with lun 0 {{(pid=75229) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 09:58:42 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-c0d19783-031f-471b-9222-f460ef81ea84 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Scanning host 34 c: 0, t: 0, l: 0) {{(pid=75229) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 09:58:42 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:58:42 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:58:42 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[19a481b1-7115-4c9e-8526-6697f1cc22ce]: (4, ('0 0 0', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:58:42 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-c0d19783-031f-471b-9222-f460ef81ea84 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Searching for a device in session 34 and hctl ('34', '0', '0', 0) yield: sdc {{(pid=75229) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 09:58:42 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0d19783-031f-471b-9222-f460ef81ea84 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:5aebc438-0289-44fe-ad84-4e696468f50e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TgiuaWRw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75229) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 09:58:42 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-c0d19783-031f-471b-9222-f460ef81ea84 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.179s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 09:58:42 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0d19783-031f-471b-9222-f460ef81ea84 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] <== connect_volume: return (180ms) {'type': 'block', 'scsi_wwn': '23638376139346638', 'path': '/dev/sdc'} {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 09:58:42 user nova-compute[75229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c0d19783-031f-471b-9222-f460ef81ea84 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] [instance: 30ae1f73-e0f3-4e26-987e-a684471a160d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23638376139346638', 'path': '/dev/sdc'} {{(pid=75229) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 09:58:42 user nova-compute[75229]: DEBUG nova.virt.libvirt.vif [None req-c0d19783-031f-471b-9222-f460ef81ea84 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T09:56:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1790249022',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1790249022',id=34,image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-14T09:57:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8babb73006da4977a1fe2bdb35e08d8f',ramdisk_id='',reservation_id='r-hu64t322',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-189750210',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T09:57:03Z,user_data=None,user_id='a8825cd49e9349f28576b704c4c4d717',uuid=30ae1f73-e0f3-4e26-987e-a684471a160d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c087c657-8eee-4e8e-bef1-4281129597ae", "address": "fa:16:3e:aa:d3:e3", "network": {"id": "6a700b61-4aa6-440b-87e6-a3525a5cb918", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-448680331-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-448680331-network", "vif_mac": "fa:16:3e:aa:d3:e3"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8babb73006da4977a1fe2bdb35e08d8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc087c657-8e", "ovs_interfaceid": "c087c657-8eee-4e8e-bef1-4281129597ae", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75229) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 09:58:42 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-c0d19783-031f-471b-9222-f460ef81ea84 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Converting VIF {"id": "c087c657-8eee-4e8e-bef1-4281129597ae", "address": "fa:16:3e:aa:d3:e3", "network": {"id": "6a700b61-4aa6-440b-87e6-a3525a5cb918", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-448680331-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-448680331-network", "vif_mac": "fa:16:3e:aa:d3:e3"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8babb73006da4977a1fe2bdb35e08d8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc087c657-8e", "ovs_interfaceid": "c087c657-8eee-4e8e-bef1-4281129597ae", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 09:58:42 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-c0d19783-031f-471b-9222-f460ef81ea84 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:aa:d3:e3,bridge_name='br-int',has_traffic_filtering=True,id=c087c657-8eee-4e8e-bef1-4281129597ae,network=Network(6a700b61-4aa6-440b-87e6-a3525a5cb918),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc087c657-8e') {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 09:58:42 user nova-compute[75229]: DEBUG nova.objects.instance [None req-c0d19783-031f-471b-9222-f460ef81ea84 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Lazy-loading 'pci_devices' on Instance uuid 30ae1f73-e0f3-4e26-987e-a684471a160d {{(pid=75229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 09:58:42 user nova-compute[75229]: DEBUG nova.objects.base [None req-c0d19783-031f-471b-9222-f460ef81ea84 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Object Instance<30ae1f73-e0f3-4e26-987e-a684471a160d> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75229) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 09:58:42 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-c0d19783-031f-471b-9222-f460ef81ea84 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] [instance: 30ae1f73-e0f3-4e26-987e-a684471a160d] End _get_guest_xml xml=<domain type="kvm">
Nov 14 09:58:42 user nova-compute[75229]:   <uuid>30ae1f73-e0f3-4e26-987e-a684471a160d</uuid>
Nov 14 09:58:42 user nova-compute[75229]:   <name>instance-00000022</name>
Nov 14 09:58:42 user nova-compute[75229]:   <memory>524288</memory>
Nov 14 09:58:42 user nova-compute[75229]:   <vcpu>1</vcpu>
Nov 14 09:58:42 user nova-compute[75229]:   <metadata>
Nov 14 09:58:42 user nova-compute[75229]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 09:58:42 user nova-compute[75229]:       <nova:package version="0.0.0"/>
Nov 14 09:58:42 user nova-compute[75229]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1790249022</nova:name>
Nov 14 09:58:42 user nova-compute[75229]:       <nova:creationTime>2023-11-14 09:58:42</nova:creationTime>
Nov 14 09:58:42 user nova-compute[75229]:       <nova:flavor name="m1.tiny">
Nov 14 09:58:42 user nova-compute[75229]:         <nova:memory>512</nova:memory>
Nov 14 09:58:42 user nova-compute[75229]:         <nova:disk>1</nova:disk>
Nov 14 09:58:42 user nova-compute[75229]:         <nova:swap>0</nova:swap>
Nov 14 09:58:42 user nova-compute[75229]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 09:58:42 user nova-compute[75229]:         <nova:vcpus>1</nova:vcpus>
Nov 14 09:58:42 user nova-compute[75229]:       </nova:flavor>
Nov 14 09:58:42 user nova-compute[75229]:       <nova:owner>
Nov 14 09:58:42 user nova-compute[75229]:         <nova:user uuid="a8825cd49e9349f28576b704c4c4d717">tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member</nova:user>
Nov 14 09:58:42 user nova-compute[75229]:         <nova:project uuid="8babb73006da4977a1fe2bdb35e08d8f">tempest-ServerBootFromVolumeStableRescueTest-189750210</nova:project>
Nov 14 09:58:42 user nova-compute[75229]:       </nova:owner>
Nov 14 09:58:42 user nova-compute[75229]:       <nova:root type="image" uuid="3bef8470-ecc7-40e3-95d4-9254348ea72d"/>
Nov 14 09:58:42 user nova-compute[75229]:       <nova:ports>
Nov 14 09:58:42 user nova-compute[75229]:         <nova:port uuid="c087c657-8eee-4e8e-bef1-4281129597ae">
Nov 14 09:58:42 user nova-compute[75229]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 14 09:58:42 user nova-compute[75229]:         </nova:port>
Nov 14 09:58:42 user nova-compute[75229]:       </nova:ports>
Nov 14 09:58:42 user nova-compute[75229]:     </nova:instance>
Nov 14 09:58:42 user nova-compute[75229]:   </metadata>
Nov 14 09:58:42 user nova-compute[75229]:   <sysinfo type="smbios">
Nov 14 09:58:42 user nova-compute[75229]:     <system>
Nov 14 09:58:42 user nova-compute[75229]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 09:58:42 user nova-compute[75229]:       <entry name="product">OpenStack Nova</entry>
Nov 14 09:58:42 user nova-compute[75229]:       <entry name="version">0.0.0</entry>
Nov 14 09:58:42 user nova-compute[75229]:       <entry name="serial">30ae1f73-e0f3-4e26-987e-a684471a160d</entry>
Nov 14 09:58:42 user nova-compute[75229]:       <entry name="uuid">30ae1f73-e0f3-4e26-987e-a684471a160d</entry>
Nov 14 09:58:42 user nova-compute[75229]:       <entry name="family">Virtual Machine</entry>
Nov 14 09:58:42 user nova-compute[75229]:     </system>
Nov 14 09:58:42 user nova-compute[75229]:   </sysinfo>
Nov 14 09:58:42 user nova-compute[75229]:   <os>
Nov 14 09:58:42 user nova-compute[75229]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 09:58:42 user nova-compute[75229]:     <smbios mode="sysinfo"/>
Nov 14 09:58:42 user nova-compute[75229]:   </os>
Nov 14 09:58:42 user nova-compute[75229]:   <features>
Nov 14 09:58:42 user nova-compute[75229]:     <acpi/>
Nov 14 09:58:42 user nova-compute[75229]:     <apic/>
Nov 14 09:58:42 user nova-compute[75229]:     <vmcoreinfo/>
Nov 14 09:58:42 user nova-compute[75229]:   </features>
Nov 14 09:58:42 user nova-compute[75229]:   <clock offset="utc">
Nov 14 09:58:42 user nova-compute[75229]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 09:58:42 user nova-compute[75229]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 09:58:42 user nova-compute[75229]:     <timer name="hpet" present="no"/>
Nov 14 09:58:42 user nova-compute[75229]:   </clock>
Nov 14 09:58:42 user nova-compute[75229]:   <cpu mode="custom" match="exact">
Nov 14 09:58:42 user nova-compute[75229]:     <model>Nehalem</model>
Nov 14 09:58:42 user nova-compute[75229]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 09:58:42 user nova-compute[75229]:   </cpu>
Nov 14 09:58:42 user nova-compute[75229]:   <devices>
Nov 14 09:58:42 user nova-compute[75229]:     <disk type="block" device="disk">
Nov 14 09:58:42 user nova-compute[75229]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 09:58:42 user nova-compute[75229]:       <source dev="/dev/sdc"/>
Nov 14 09:58:42 user nova-compute[75229]:       <target dev="vda" bus="virtio"/>
Nov 14 09:58:42 user nova-compute[75229]:       <serial>5aebc438-0289-44fe-ad84-4e696468f50e</serial>
Nov 14 09:58:42 user nova-compute[75229]:     </disk>
Nov 14 09:58:42 user nova-compute[75229]:     <disk type="file" device="disk">
Nov 14 09:58:42 user nova-compute[75229]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 09:58:42 user nova-compute[75229]:       <source file="/opt/stack/data/nova/instances/30ae1f73-e0f3-4e26-987e-a684471a160d/disk.rescue"/>
Nov 14 09:58:42 user nova-compute[75229]:       <target dev="vdb" bus="virtio"/>
Nov 14 09:58:42 user nova-compute[75229]:       <boot order="1"/>
Nov 14 09:58:42 user nova-compute[75229]:     </disk>
Nov 14 09:58:42 user nova-compute[75229]:     <interface type="ethernet">
Nov 14 09:58:42 user nova-compute[75229]:       <mac address="fa:16:3e:aa:d3:e3"/>
Nov 14 09:58:42 user nova-compute[75229]:       <model type="virtio"/>
Nov 14 09:58:42 user nova-compute[75229]:       <mtu size="1442"/>
Nov 14 09:58:42 user nova-compute[75229]:       <target dev="tapc087c657-8e"/>
Nov 14 09:58:42 user nova-compute[75229]:     </interface>
Nov 14 09:58:42 user nova-compute[75229]:     <serial type="pty">
Nov 14 09:58:42 user nova-compute[75229]:       <log file="/opt/stack/data/nova/instances/30ae1f73-e0f3-4e26-987e-a684471a160d/console.log" append="off"/>
Nov 14 09:58:42 user nova-compute[75229]:     </serial>
Nov 14 09:58:42 user nova-compute[75229]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 09:58:42 user nova-compute[75229]:     <video>
Nov 14 09:58:42 user nova-compute[75229]:       <model type="virtio"/>
Nov 14 09:58:42 user nova-compute[75229]:     </video>
Nov 14 09:58:42 user nova-compute[75229]:     <rng model="virtio">
Nov 14 09:58:42 user nova-compute[75229]:       <backend model="random">/dev/urandom</backend>
Nov 14 09:58:42 user nova-compute[75229]:     </rng>
Nov 14 09:58:42 user nova-compute[75229]:     <controller type="usb" index="0" model="none"/>
Nov 14 09:58:42 user nova-compute[75229]:     <memballoon model="virtio">
Nov 14 09:58:42 user nova-compute[75229]:       <stats period="10"/>
Nov 14 09:58:42 user nova-compute[75229]:     </memballoon>
Nov 14 09:58:42 user nova-compute[75229]:   </devices>
Nov 14 09:58:42 user nova-compute[75229]: </domain>
Nov 14 09:58:42 user nova-compute[75229]:  {{(pid=75229) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 09:58:42 user nova-compute[75229]: INFO nova.virt.libvirt.driver [-] [instance: 30ae1f73-e0f3-4e26-987e-a684471a160d] Instance destroyed successfully.
Nov 14 09:58:42 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-c0d19783-031f-471b-9222-f460ef81ea84 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] No BDM found with device name vda, not building metadata. {{(pid=75229) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 09:58:42 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-c0d19783-031f-471b-9222-f460ef81ea84 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75229) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 09:58:42 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-c0d19783-031f-471b-9222-f460ef81ea84 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] No VIF found with MAC fa:16:3e:aa:d3:e3, not building metadata {{(pid=75229) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 09:58:44 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:58:44 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:58:44 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:58:44 user nova-compute[75229]: DEBUG nova.compute.manager [req-776c3b6c-372f-4359-982b-7abc2b43f6e9 req-bcf4c0f7-1379-4814-bade-375ca36f0da6 service nova] [instance: 30ae1f73-e0f3-4e26-987e-a684471a160d] Received event network-vif-plugged-c087c657-8eee-4e8e-bef1-4281129597ae {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:58:44 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-776c3b6c-372f-4359-982b-7abc2b43f6e9 req-bcf4c0f7-1379-4814-bade-375ca36f0da6 service nova] Acquiring lock "30ae1f73-e0f3-4e26-987e-a684471a160d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:58:44 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-776c3b6c-372f-4359-982b-7abc2b43f6e9 req-bcf4c0f7-1379-4814-bade-375ca36f0da6 service nova] Lock "30ae1f73-e0f3-4e26-987e-a684471a160d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:58:44 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-776c3b6c-372f-4359-982b-7abc2b43f6e9 req-bcf4c0f7-1379-4814-bade-375ca36f0da6 service nova] Lock "30ae1f73-e0f3-4e26-987e-a684471a160d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:58:44 user nova-compute[75229]: DEBUG nova.compute.manager [req-776c3b6c-372f-4359-982b-7abc2b43f6e9 req-bcf4c0f7-1379-4814-bade-375ca36f0da6 service nova] [instance: 30ae1f73-e0f3-4e26-987e-a684471a160d] No waiting events found dispatching network-vif-plugged-c087c657-8eee-4e8e-bef1-4281129597ae {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 09:58:44 user nova-compute[75229]: WARNING nova.compute.manager [req-776c3b6c-372f-4359-982b-7abc2b43f6e9 req-bcf4c0f7-1379-4814-bade-375ca36f0da6 service nova] [instance: 30ae1f73-e0f3-4e26-987e-a684471a160d] Received unexpected event network-vif-plugged-c087c657-8eee-4e8e-bef1-4281129597ae for instance with vm_state active and task_state rescuing.
Nov 14 09:58:44 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:58:44 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:58:46 user nova-compute[75229]: DEBUG nova.compute.manager [None req-c0d19783-031f-471b-9222-f460ef81ea84 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] [instance: 30ae1f73-e0f3-4e26-987e-a684471a160d] Checking state {{(pid=75229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 09:58:46 user nova-compute[75229]: DEBUG nova.compute.manager [req-6c9286b1-d8b8-45c7-82fe-ceb5fa0c62fa req-733b498b-1dc8-481c-af88-9cb542a3ccf2 service nova] [instance: 30ae1f73-e0f3-4e26-987e-a684471a160d] Received event network-vif-plugged-c087c657-8eee-4e8e-bef1-4281129597ae {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:58:46 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-6c9286b1-d8b8-45c7-82fe-ceb5fa0c62fa req-733b498b-1dc8-481c-af88-9cb542a3ccf2 service nova] Acquiring lock "30ae1f73-e0f3-4e26-987e-a684471a160d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:58:46 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-6c9286b1-d8b8-45c7-82fe-ceb5fa0c62fa req-733b498b-1dc8-481c-af88-9cb542a3ccf2 service nova] Lock "30ae1f73-e0f3-4e26-987e-a684471a160d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:58:46 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-6c9286b1-d8b8-45c7-82fe-ceb5fa0c62fa req-733b498b-1dc8-481c-af88-9cb542a3ccf2 service nova] Lock "30ae1f73-e0f3-4e26-987e-a684471a160d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:58:46 user nova-compute[75229]: DEBUG nova.compute.manager [req-6c9286b1-d8b8-45c7-82fe-ceb5fa0c62fa req-733b498b-1dc8-481c-af88-9cb542a3ccf2 service nova] [instance: 30ae1f73-e0f3-4e26-987e-a684471a160d] No waiting events found dispatching network-vif-plugged-c087c657-8eee-4e8e-bef1-4281129597ae {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 09:58:46 user nova-compute[75229]: WARNING nova.compute.manager [req-6c9286b1-d8b8-45c7-82fe-ceb5fa0c62fa req-733b498b-1dc8-481c-af88-9cb542a3ccf2 service nova] [instance: 30ae1f73-e0f3-4e26-987e-a684471a160d] Received unexpected event network-vif-plugged-c087c657-8eee-4e8e-bef1-4281129597ae for instance with vm_state active and task_state rescuing.
Nov 14 09:58:46 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:58:48 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:58:49 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 09:58:51 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:58:53 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:58:53 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:58:53 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 09:58:53 user nova-compute[75229]: DEBUG nova.compute.manager [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Starting heal instance info cache {{(pid=75229) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 09:58:53 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Acquiring lock "refresh_cache-4c9fe69e-3f9d-4b30-a9e4-efc3e83efa17" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 09:58:53 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Acquired lock "refresh_cache-4c9fe69e-3f9d-4b30-a9e4-efc3e83efa17" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 09:58:53 user nova-compute[75229]: DEBUG nova.network.neutron [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] [instance: 4c9fe69e-3f9d-4b30-a9e4-efc3e83efa17] Forcefully refreshing network info cache for instance {{(pid=75229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 09:58:54 user nova-compute[75229]: DEBUG nova.network.neutron [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] [instance: 4c9fe69e-3f9d-4b30-a9e4-efc3e83efa17] Updating instance_info_cache with network_info: [{"id": "235153d6-63c1-44d2-97cc-c083544e6790", "address": "fa:16:3e:a0:db:35", "network": {"id": "22eed29e-7148-42f9-b4c7-b97811cba8eb", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2000485731-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46457b27e3ed416e827c3c22449fb512", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap235153d6-63", "ovs_interfaceid": "235153d6-63c1-44d2-97cc-c083544e6790", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 09:58:54 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Releasing lock "refresh_cache-4c9fe69e-3f9d-4b30-a9e4-efc3e83efa17" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 09:58:54 user nova-compute[75229]: DEBUG nova.compute.manager [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] [instance: 4c9fe69e-3f9d-4b30-a9e4-efc3e83efa17] Updated the network info_cache for instance {{(pid=75229) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 09:58:55 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 09:58:55 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 09:58:56 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:58:57 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 09:58:57 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:58:57 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:58:57 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:58:57 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Auditing locally available compute resources for user (node: user) {{(pid=75229) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 09:58:57 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cda8c5ad-e70c-4021-bace-d55831c4bc78/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:58:58 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cda8c5ad-e70c-4021-bace-d55831c4bc78/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:58:58 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cda8c5ad-e70c-4021-bace-d55831c4bc78/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:58:58 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cda8c5ad-e70c-4021-bace-d55831c4bc78/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:58:58 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7750cbc-b3d0-44aa-8b88-c291ba007a8a/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:58:58 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7750cbc-b3d0-44aa-8b88-c291ba007a8a/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:58:58 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7750cbc-b3d0-44aa-8b88-c291ba007a8a/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:58:58 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:58:58 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7750cbc-b3d0-44aa-8b88-c291ba007a8a/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:58:58 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75229) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 09:58:58 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eba59006-83c1-4bda-b9f5-f3be4d1e5e58/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:58:58 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eba59006-83c1-4bda-b9f5-f3be4d1e5e58/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:58:58 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eba59006-83c1-4bda-b9f5-f3be4d1e5e58/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:58:59 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eba59006-83c1-4bda-b9f5-f3be4d1e5e58/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:58:59 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e58500df-059a-4fce-afb7-ba36feca0697/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:58:59 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e58500df-059a-4fce-afb7-ba36feca0697/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:58:59 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e58500df-059a-4fce-afb7-ba36feca0697/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:58:59 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e58500df-059a-4fce-afb7-ba36feca0697/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:58:59 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c9fe69e-3f9d-4b30-a9e4-efc3e83efa17/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:58:59 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c9fe69e-3f9d-4b30-a9e4-efc3e83efa17/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:58:59 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c9fe69e-3f9d-4b30-a9e4-efc3e83efa17/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:58:59 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c9fe69e-3f9d-4b30-a9e4-efc3e83efa17/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:58:59 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75229) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 09:58:59 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75229) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 09:58:59 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30ae1f73-e0f3-4e26-987e-a684471a160d/disk.rescue --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:58:59 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30ae1f73-e0f3-4e26-987e-a684471a160d/disk.rescue --force-share --output=json" returned: 0 in 0.187s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:58:59 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30ae1f73-e0f3-4e26-987e-a684471a160d/disk.rescue --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:59:00 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30ae1f73-e0f3-4e26-987e-a684471a160d/disk.rescue --force-share --output=json" returned: 0 in 0.169s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:59:00 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cdd6b32-d4bd-4135-a58e-fbc3b6d2a093/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:59:00 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cdd6b32-d4bd-4135-a58e-fbc3b6d2a093/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:59:00 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cdd6b32-d4bd-4135-a58e-fbc3b6d2a093/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:59:00 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cdd6b32-d4bd-4135-a58e-fbc3b6d2a093/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:59:00 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75229) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 09:59:00 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abb8e340-164d-4bc2-a503-7e8ea3c9b35b/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:59:00 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abb8e340-164d-4bc2-a503-7e8ea3c9b35b/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:59:00 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abb8e340-164d-4bc2-a503-7e8ea3c9b35b/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:59:00 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abb8e340-164d-4bc2-a503-7e8ea3c9b35b/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:59:00 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5170e9e-66e3-4df1-9807-4958cac6480e/disk.rescue --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:59:01 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5170e9e-66e3-4df1-9807-4958cac6480e/disk.rescue --force-share --output=json" returned: 0 in 0.167s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:59:01 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5170e9e-66e3-4df1-9807-4958cac6480e/disk.rescue --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:59:01 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5170e9e-66e3-4df1-9807-4958cac6480e/disk.rescue --force-share --output=json" returned: 0 in 0.170s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:59:01 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5170e9e-66e3-4df1-9807-4958cac6480e/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:59:01 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5170e9e-66e3-4df1-9807-4958cac6480e/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:59:01 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5170e9e-66e3-4df1-9807-4958cac6480e/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:59:01 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5170e9e-66e3-4df1-9807-4958cac6480e/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:59:02 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:59:02 user nova-compute[75229]: WARNING nova.virt.libvirt.driver [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 09:59:02 user nova-compute[75229]: WARNING nova.virt.libvirt.driver [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 09:59:02 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Hypervisor/Node resource view: name=user free_ram=7439MB free_disk=25.029296875GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75229) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 09:59:02 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:59:02 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:59:02 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Applying migration context for instance 589f4750-fac6-4e99-a430-0cda339808bc as it has an incoming, in-progress migration efd6ebd1-d0fd-452d-8e9c-ca6c337c47a8. Migration status is finished {{(pid=75229) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 14 09:59:02 user nova-compute[75229]: INFO nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] [instance: 589f4750-fac6-4e99-a430-0cda339808bc] Updating resource usage from migration efd6ebd1-d0fd-452d-8e9c-ca6c337c47a8
Nov 14 09:59:02 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Instance a7750cbc-b3d0-44aa-8b88-c291ba007a8a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 09:59:02 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Instance 4c9fe69e-3f9d-4b30-a9e4-efc3e83efa17 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 09:59:02 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Instance b5170e9e-66e3-4df1-9807-4958cac6480e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 09:59:02 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Instance e58500df-059a-4fce-afb7-ba36feca0697 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 09:59:02 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Instance cda8c5ad-e70c-4021-bace-d55831c4bc78 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 09:59:02 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Instance 9cdd6b32-d4bd-4135-a58e-fbc3b6d2a093 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 09:59:02 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Instance 30ae1f73-e0f3-4e26-987e-a684471a160d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 09:59:02 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Migration efd6ebd1-d0fd-452d-8e9c-ca6c337c47a8 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 14 09:59:02 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Instance 589f4750-fac6-4e99-a430-0cda339808bc actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 09:59:02 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Instance abb8e340-164d-4bc2-a503-7e8ea3c9b35b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 09:59:02 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Instance bc39b8e1-c8f9-4aa9-8d1b-72524b73f88c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 09:59:02 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Instance eba59006-83c1-4bda-b9f5-f3be4d1e5e58 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 09:59:02 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=75229) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 09:59:02 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Final resource view: name=user phys_ram=16011MB used_ram=8192MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=75229) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 09:59:02 user nova-compute[75229]: DEBUG nova.compute.provider_tree [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Inventory has not changed in ProviderTree for provider: d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 {{(pid=75229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 09:59:02 user nova-compute[75229]: DEBUG nova.scheduler.client.report [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Inventory has not changed for provider d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 09:59:02 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Compute_service record updated for user:user {{(pid=75229) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 09:59:02 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.475s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:59:03 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:59:04 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 09:59:04 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 09:59:04 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 09:59:04 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 09:59:04 user nova-compute[75229]: DEBUG nova.compute.manager [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75229) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 09:59:04 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-972638cd-19dc-4867-b7a6-b98f8901b35f tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Acquiring lock "589f4750-fac6-4e99-a430-0cda339808bc" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:59:04 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-972638cd-19dc-4867-b7a6-b98f8901b35f tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Lock "589f4750-fac6-4e99-a430-0cda339808bc" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:59:04 user nova-compute[75229]: DEBUG nova.compute.manager [None req-972638cd-19dc-4867-b7a6-b98f8901b35f tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] [instance: 589f4750-fac6-4e99-a430-0cda339808bc] Going to confirm migration 2 {{(pid=75229) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:4774}}
Nov 14 09:59:05 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-972638cd-19dc-4867-b7a6-b98f8901b35f tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Acquiring lock "refresh_cache-589f4750-fac6-4e99-a430-0cda339808bc" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 09:59:05 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-972638cd-19dc-4867-b7a6-b98f8901b35f tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Acquired lock "refresh_cache-589f4750-fac6-4e99-a430-0cda339808bc" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 09:59:05 user nova-compute[75229]: DEBUG nova.network.neutron [None req-972638cd-19dc-4867-b7a6-b98f8901b35f tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] [instance: 589f4750-fac6-4e99-a430-0cda339808bc] Building network info cache for instance {{(pid=75229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 09:59:05 user nova-compute[75229]: DEBUG nova.objects.instance [None req-972638cd-19dc-4867-b7a6-b98f8901b35f tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Lazy-loading 'info_cache' on Instance uuid 589f4750-fac6-4e99-a430-0cda339808bc {{(pid=75229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 09:59:05 user nova-compute[75229]: DEBUG nova.network.neutron [None req-972638cd-19dc-4867-b7a6-b98f8901b35f tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] [instance: 589f4750-fac6-4e99-a430-0cda339808bc] Updating instance_info_cache with network_info: [{"id": "e10815ba-0472-4ed0-af80-b4d0904580af", "address": "fa:16:3e:aa:81:3e", "network": {"id": "5dfc532f-3d5d-4342-b7f1-12c9c3992a54", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1457278473-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.147", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46e65cdd021f4a3db7c9254bb6d98b46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape10815ba-04", "ovs_interfaceid": "e10815ba-0472-4ed0-af80-b4d0904580af", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 09:59:05 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-972638cd-19dc-4867-b7a6-b98f8901b35f tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Releasing lock "refresh_cache-589f4750-fac6-4e99-a430-0cda339808bc" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 09:59:05 user nova-compute[75229]: DEBUG nova.objects.instance [None req-972638cd-19dc-4867-b7a6-b98f8901b35f tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Lazy-loading 'migration_context' on Instance uuid 589f4750-fac6-4e99-a430-0cda339808bc {{(pid=75229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 09:59:05 user nova-compute[75229]: DEBUG nova.objects.base [None req-972638cd-19dc-4867-b7a6-b98f8901b35f tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Object Instance<589f4750-fac6-4e99-a430-0cda339808bc> lazy-loaded attributes: info_cache,migration_context {{(pid=75229) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 09:59:05 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-972638cd-19dc-4867-b7a6-b98f8901b35f tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:59:05 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-972638cd-19dc-4867-b7a6-b98f8901b35f tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:59:06 user nova-compute[75229]: DEBUG nova.compute.provider_tree [None req-972638cd-19dc-4867-b7a6-b98f8901b35f tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Inventory has not changed in ProviderTree for provider: d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 {{(pid=75229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 09:59:06 user nova-compute[75229]: DEBUG nova.scheduler.client.report [None req-972638cd-19dc-4867-b7a6-b98f8901b35f tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Inventory has not changed for provider d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 09:59:06 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-972638cd-19dc-4867-b7a6-b98f8901b35f tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 0.359s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:59:06 user nova-compute[75229]: INFO nova.scheduler.client.report [None req-972638cd-19dc-4867-b7a6-b98f8901b35f tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Deleted allocation for migration efd6ebd1-d0fd-452d-8e9c-ca6c337c47a8
Nov 14 09:59:06 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-972638cd-19dc-4867-b7a6-b98f8901b35f tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Lock "589f4750-fac6-4e99-a430-0cda339808bc" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 1.422s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:59:07 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:59:08 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:59:12 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:59:13 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:59:14 user nova-compute[75229]: DEBUG nova.compute.manager [req-0e6f1073-37a6-440d-b6b5-ddd770ec6725 req-3c8679cf-6e12-4115-9131-651cb5fa7bc4 service nova] [instance: abb8e340-164d-4bc2-a503-7e8ea3c9b35b] Received event network-changed-37ce4717-9a82-41c6-9d89-f1e55b9ae398 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:59:14 user nova-compute[75229]: DEBUG nova.compute.manager [req-0e6f1073-37a6-440d-b6b5-ddd770ec6725 req-3c8679cf-6e12-4115-9131-651cb5fa7bc4 service nova] [instance: abb8e340-164d-4bc2-a503-7e8ea3c9b35b] Refreshing instance network info cache due to event network-changed-37ce4717-9a82-41c6-9d89-f1e55b9ae398. {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 09:59:14 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-0e6f1073-37a6-440d-b6b5-ddd770ec6725 req-3c8679cf-6e12-4115-9131-651cb5fa7bc4 service nova] Acquiring lock "refresh_cache-abb8e340-164d-4bc2-a503-7e8ea3c9b35b" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 09:59:14 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-0e6f1073-37a6-440d-b6b5-ddd770ec6725 req-3c8679cf-6e12-4115-9131-651cb5fa7bc4 service nova] Acquired lock "refresh_cache-abb8e340-164d-4bc2-a503-7e8ea3c9b35b" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 09:59:14 user nova-compute[75229]: DEBUG nova.network.neutron [req-0e6f1073-37a6-440d-b6b5-ddd770ec6725 req-3c8679cf-6e12-4115-9131-651cb5fa7bc4 service nova] [instance: abb8e340-164d-4bc2-a503-7e8ea3c9b35b] Refreshing network info cache for port 37ce4717-9a82-41c6-9d89-f1e55b9ae398 {{(pid=75229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 09:59:14 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-47c18b4a-1b98-4b82-9d2b-4d8b23d604a2 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Acquiring lock "abb8e340-164d-4bc2-a503-7e8ea3c9b35b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:59:14 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-47c18b4a-1b98-4b82-9d2b-4d8b23d604a2 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Lock "abb8e340-164d-4bc2-a503-7e8ea3c9b35b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:59:14 user nova-compute[75229]: DEBUG nova.objects.instance [None req-47c18b4a-1b98-4b82-9d2b-4d8b23d604a2 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Lazy-loading 'flavor' on Instance uuid abb8e340-164d-4bc2-a503-7e8ea3c9b35b {{(pid=75229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 09:59:14 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-47c18b4a-1b98-4b82-9d2b-4d8b23d604a2 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Lock "abb8e340-164d-4bc2-a503-7e8ea3c9b35b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.051s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:59:14 user nova-compute[75229]: DEBUG nova.network.neutron [req-0e6f1073-37a6-440d-b6b5-ddd770ec6725 req-3c8679cf-6e12-4115-9131-651cb5fa7bc4 service nova] [instance: abb8e340-164d-4bc2-a503-7e8ea3c9b35b] Updated VIF entry in instance network info cache for port 37ce4717-9a82-41c6-9d89-f1e55b9ae398. {{(pid=75229) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 09:59:14 user nova-compute[75229]: DEBUG nova.network.neutron [req-0e6f1073-37a6-440d-b6b5-ddd770ec6725 req-3c8679cf-6e12-4115-9131-651cb5fa7bc4 service nova] [instance: abb8e340-164d-4bc2-a503-7e8ea3c9b35b] Updating instance_info_cache with network_info: [{"id": "37ce4717-9a82-41c6-9d89-f1e55b9ae398", "address": "fa:16:3e:92:c4:4b", "network": {"id": "22eed29e-7148-42f9-b4c7-b97811cba8eb", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2000485731-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.13", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46457b27e3ed416e827c3c22449fb512", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37ce4717-9a", "ovs_interfaceid": "37ce4717-9a82-41c6-9d89-f1e55b9ae398", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 09:59:14 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-0e6f1073-37a6-440d-b6b5-ddd770ec6725 req-3c8679cf-6e12-4115-9131-651cb5fa7bc4 service nova] Releasing lock "refresh_cache-abb8e340-164d-4bc2-a503-7e8ea3c9b35b" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 09:59:14 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-47c18b4a-1b98-4b82-9d2b-4d8b23d604a2 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Acquiring lock "abb8e340-164d-4bc2-a503-7e8ea3c9b35b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:59:14 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-47c18b4a-1b98-4b82-9d2b-4d8b23d604a2 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Lock "abb8e340-164d-4bc2-a503-7e8ea3c9b35b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:59:14 user nova-compute[75229]: INFO nova.compute.manager [None req-47c18b4a-1b98-4b82-9d2b-4d8b23d604a2 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] [instance: abb8e340-164d-4bc2-a503-7e8ea3c9b35b] Attaching volume 143891e8-62eb-42d7-b076-db6f52b4f606 to /dev/vdb
Nov 14 09:59:14 user nova-compute[75229]: DEBUG os_brick.utils [None req-47c18b4a-1b98-4b82-9d2b-4d8b23d604a2 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 09:59:14 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:59:14 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:59:14 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1b290c1-2afc-485a-a62e-94e5b8b9e357]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f1154031c835\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:59:15 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:59:15 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:59:15 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[56007ba7-16b2-4c52-a3d4-546d1a5780a6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:59:15 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:59:15 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:59:15 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7caed0f-640a-4e7e-9aa1-b824e079117e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:59:15 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cf97a83-9c83-4ce8-8723-dd422ebebfe3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:59:15 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-47c18b4a-1b98-4b82-9d2b-4d8b23d604a2 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Running cmd (subprocess): nvme version {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:59:15 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-47c18b4a-1b98-4b82-9d2b-4d8b23d604a2 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] 'nvme version' failed. Not Retrying. {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 09:59:15 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.nvmeof [None req-47c18b4a-1b98-4b82-9d2b-4d8b23d604a2 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] nvme not present on system {{(pid=75229) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 09:59:15 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:59:15 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 09:59:15 user nova-compute[75229]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 09:59:15 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b144907-fc42-4095-98af-a1b00d091f62]: (4, '') {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:59:15 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.lightos [None req-47c18b4a-1b98-4b82-9d2b-4d8b23d604a2 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75229) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 09:59:15 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.lightos [None req-47c18b4a-1b98-4b82-9d2b-4d8b23d604a2 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75229) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 09:59:15 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.lightos [None req-47c18b4a-1b98-4b82-9d2b-4d8b23d604a2 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] LIGHTOS: no hostnqn found. {{(pid=75229) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 09:59:15 user nova-compute[75229]: DEBUG os_brick.utils [None req-47c18b4a-1b98-4b82-9d2b-4d8b23d604a2 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] <== get_connector_properties: return (115ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f1154031c835', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 09:59:15 user nova-compute[75229]: DEBUG nova.virt.block_device [None req-47c18b4a-1b98-4b82-9d2b-4d8b23d604a2 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] [instance: abb8e340-164d-4bc2-a503-7e8ea3c9b35b] Updating existing volume attachment record: 01aa4a4f-8061-48f1-94c6-cf22349b86b7 {{(pid=75229) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 09:59:17 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:59:18 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:59:19 user nova-compute[75229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-47c18b4a-1b98-4b82-9d2b-4d8b23d604a2 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] [instance: abb8e340-164d-4bc2-a503-7e8ea3c9b35b] Calling os-brick to attach iSCSI Volume {{(pid=75229) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 09:59:19 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-47c18b4a-1b98-4b82-9d2b-4d8b23d604a2 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f73f85151b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:143891e8-62eb-42d7-b076-db6f52b4f606', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ubwOngiF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 09:59:19 user nova-compute[75229]: WARNING os_brick.initiator.connectors.base [None req-47c18b4a-1b98-4b82-9d2b-4d8b23d604a2 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 09:59:19 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-47c18b4a-1b98-4b82-9d2b-4d8b23d604a2 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 09:59:19 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-47c18b4a-1b98-4b82-9d2b-4d8b23d604a2 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 09:59:19 user nova-compute[75229]: WARNING os_brick.initiator.connectors.base [None req-47c18b4a-1b98-4b82-9d2b-4d8b23d604a2 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 09:59:19 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-47c18b4a-1b98-4b82-9d2b-4d8b23d604a2 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:143891e8-62eb-42d7-b076-db6f52b4f606" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 09:59:19 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-47c18b4a-1b98-4b82-9d2b-4d8b23d604a2 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:143891e8-62eb-42d7-b076-db6f52b4f606" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 09:59:19 user nova-compute[75229]: INFO os_brick.initiator.connectors.iscsi [None req-47c18b4a-1b98-4b82-9d2b-4d8b23d604a2 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 09:59:19 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:143891e8-62eb-42d7-b076-db6f52b4f606 -p 172.16.0.220:3260 {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:59:19 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:143891e8-62eb-42d7-b076-db6f52b4f606 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:59:19 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[168d104b-120d-41ed-b347-270a7b9633ac]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:59:19 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-47c18b4a-1b98-4b82-9d2b-4d8b23d604a2 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 09:59:19 user nova-compute[75229]:  {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:59:19 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:143891e8-62eb-42d7-b076-db6f52b4f606 -p 172.16.0.220:3260 --interface default --op new {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:59:19 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:143891e8-62eb-42d7-b076-db6f52b4f606 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:59:19 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[e36a6c35-f3a2-436e-95ca-db0efac571cb]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:143891e8-62eb-42d7-b076-db6f52b4f606] added\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:59:19 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-47c18b4a-1b98-4b82-9d2b-4d8b23d604a2 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:143891e8-62eb-42d7-b076-db6f52b4f606] added
Nov 14 09:59:19 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:59:19 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:143891e8-62eb-42d7-b076-db6f52b4f606 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:59:19 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:143891e8-62eb-42d7-b076-db6f52b4f606 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:59:19 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[16123c73-0fc8-408b-a9d7-7563bf5affcb]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:59:19 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-47c18b4a-1b98-4b82-9d2b-4d8b23d604a2 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:59:19 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:143891e8-62eb-42d7-b076-db6f52b4f606 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:59:19 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:143891e8-62eb-42d7-b076-db6f52b4f606 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:59:19 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0888439-e505-407c-835a-98c2d4b13587]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:59:19 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-47c18b4a-1b98-4b82-9d2b-4d8b23d604a2 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:59:19 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:143891e8-62eb-42d7-b076-db6f52b4f606 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ubwOngiF {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:59:19 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:143891e8-62eb-42d7-b076-db6f52b4f606 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ubwOngiF" returned: 0 in 0.019s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:59:19 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[431f3ee4-7d4b-4efe-8b66-05e93b89c3ae]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:59:19 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-47c18b4a-1b98-4b82-9d2b-4d8b23d604a2 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ubwOngiF'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:59:19 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:143891e8-62eb-42d7-b076-db6f52b4f606 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:59:19 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:143891e8-62eb-42d7-b076-db6f52b4f606 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:59:19 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[e86833ea-ed25-4c44-937f-ab675d9878aa]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:59:19 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-47c18b4a-1b98-4b82-9d2b-4d8b23d604a2 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:59:19 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:59:19 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:59:19 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[7461e5cb-d757-4315-914f-fb32c0fc8098]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aebc438-0289-44fe-ad84-4e696468f50e (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5efb0e0-a85c-46ec-8a9d-2763bf548023 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94a0a817-0b71-4589-90eb-8c8d159f7fd2 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4562974d-4587-4774-adb3-21a623f466c2 (non-flash)\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:59:19 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-47c18b4a-1b98-4b82-9d2b-4d8b23d604a2 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aebc438-0289-44fe-ad84-4e696468f50e (non-flash)
Nov 14 09:59:19 user nova-compute[75229]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5efb0e0-a85c-46ec-8a9d-2763bf548023 (non-flash)
Nov 14 09:59:19 user nova-compute[75229]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94a0a817-0b71-4589-90eb-8c8d159f7fd2 (non-flash)
Nov 14 09:59:19 user nova-compute[75229]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4562974d-4587-4774-adb3-21a623f466c2 (non-flash)
Nov 14 09:59:19 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 09:59:19 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-47c18b4a-1b98-4b82-9d2b-4d8b23d604a2 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aebc438-0289-44fe-ad84-4e696468f50e (non-flash)
Nov 14 09:59:19 user nova-compute[75229]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5efb0e0-a85c-46ec-8a9d-2763bf548023 (non-flash)
Nov 14 09:59:19 user nova-compute[75229]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94a0a817-0b71-4589-90eb-8c8d159f7fd2 (non-flash)
Nov 14 09:59:19 user nova-compute[75229]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4562974d-4587-4774-adb3-21a623f466c2 (non-flash)
Nov 14 09:59:19 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 09:59:19 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:143891e8-62eb-42d7-b076-db6f52b4f606 -p 172.16.0.220:3260 --login {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:59:19 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:143891e8-62eb-42d7-b076-db6f52b4f606 -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:59:19 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[b41b3a49-6165-4969-b477-2d742365891d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:143891e8-62eb-42d7-b076-db6f52b4f606, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:143891e8-62eb-42d7-b076-db6f52b4f606, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:59:19 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-47c18b4a-1b98-4b82-9d2b-4d8b23d604a2 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:143891e8-62eb-42d7-b076-db6f52b4f606, portal: 172.16.0.220,3260]
Nov 14 09:59:19 user nova-compute[75229]: Login to [iface: default, target: iqn.2010-10.org.openstack:143891e8-62eb-42d7-b076-db6f52b4f606, portal: 172.16.0.220,3260] successful.
Nov 14 09:59:19 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:59:19 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:143891e8-62eb-42d7-b076-db6f52b4f606 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:59:19 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:143891e8-62eb-42d7-b076-db6f52b4f606 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:59:19 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[901f9d64-075f-4a56-b462-fc473203b98d]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:59:19 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-47c18b4a-1b98-4b82-9d2b-4d8b23d604a2 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:59:19 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:59:19 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:59:19 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b8eca81-8ac2-4b5f-85e7-6f4628a6405f]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aebc438-0289-44fe-ad84-4e696468f50e (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5efb0e0-a85c-46ec-8a9d-2763bf548023 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94a0a817-0b71-4589-90eb-8c8d159f7fd2 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4562974d-4587-4774-adb3-21a623f466c2 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:143891e8-62eb-42d7-b076-db6f52b4f606 (non-flash)\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:59:19 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-47c18b4a-1b98-4b82-9d2b-4d8b23d604a2 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aebc438-0289-44fe-ad84-4e696468f50e (non-flash)
Nov 14 09:59:19 user nova-compute[75229]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5efb0e0-a85c-46ec-8a9d-2763bf548023 (non-flash)
Nov 14 09:59:19 user nova-compute[75229]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94a0a817-0b71-4589-90eb-8c8d159f7fd2 (non-flash)
Nov 14 09:59:19 user nova-compute[75229]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4562974d-4587-4774-adb3-21a623f466c2 (non-flash)
Nov 14 09:59:19 user nova-compute[75229]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:143891e8-62eb-42d7-b076-db6f52b4f606 (non-flash)
Nov 14 09:59:19 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 09:59:19 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-47c18b4a-1b98-4b82-9d2b-4d8b23d604a2 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aebc438-0289-44fe-ad84-4e696468f50e (non-flash)
Nov 14 09:59:19 user nova-compute[75229]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5efb0e0-a85c-46ec-8a9d-2763bf548023 (non-flash)
Nov 14 09:59:19 user nova-compute[75229]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94a0a817-0b71-4589-90eb-8c8d159f7fd2 (non-flash)
Nov 14 09:59:19 user nova-compute[75229]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4562974d-4587-4774-adb3-21a623f466c2 (non-flash)
Nov 14 09:59:19 user nova-compute[75229]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:143891e8-62eb-42d7-b076-db6f52b4f606 (non-flash)
Nov 14 09:59:19 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 09:59:19 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-47c18b4a-1b98-4b82-9d2b-4d8b23d604a2 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:143891e8-62eb-42d7-b076-db6f52b4f606" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.285s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 09:59:19 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-47c18b4a-1b98-4b82-9d2b-4d8b23d604a2 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Connected to 172.16.0.220:3260 {{(pid=75229) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 09:59:19 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-47c18b4a-1b98-4b82-9d2b-4d8b23d604a2 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] HCTL ('37', '-', '-', 0) found on session 38 with lun 0 {{(pid=75229) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 09:59:19 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-47c18b4a-1b98-4b82-9d2b-4d8b23d604a2 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75229) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 09:59:19 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:59:19 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.017s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:59:19 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[132751ed-fd19-43ba-a8d4-7eeca0d8645f]: (4, ('- - 0', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:59:19 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-47c18b4a-1b98-4b82-9d2b-4d8b23d604a2 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Searching for a device in session 38 and hctl ['37', '*', '*', 0] yield: None {{(pid=75229) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 09:59:20 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-47c18b4a-1b98-4b82-9d2b-4d8b23d604a2 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Searching for a device in session 38 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75229) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 09:59:20 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-47c18b4a-1b98-4b82-9d2b-4d8b23d604a2 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:143891e8-62eb-42d7-b076-db6f52b4f606', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ubwOngiF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75229) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 09:59:20 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-47c18b4a-1b98-4b82-9d2b-4d8b23d604a2 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.314s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 09:59:20 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-47c18b4a-1b98-4b82-9d2b-4d8b23d604a2 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] <== connect_volume: return (1316ms) {'type': 'block', 'scsi_wwn': '26465663230346337', 'path': '/dev/sdf'} {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 09:59:20 user nova-compute[75229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-47c18b4a-1b98-4b82-9d2b-4d8b23d604a2 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] [instance: abb8e340-164d-4bc2-a503-7e8ea3c9b35b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26465663230346337', 'path': '/dev/sdf'} {{(pid=75229) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 09:59:20 user nova-compute[75229]: DEBUG nova.objects.instance [None req-47c18b4a-1b98-4b82-9d2b-4d8b23d604a2 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Lazy-loading 'flavor' on Instance uuid abb8e340-164d-4bc2-a503-7e8ea3c9b35b {{(pid=75229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 09:59:20 user nova-compute[75229]: DEBUG nova.virt.libvirt.guest [None req-47c18b4a-1b98-4b82-9d2b-4d8b23d604a2 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 09:59:20 user nova-compute[75229]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 09:59:20 user nova-compute[75229]:   <source dev="/dev/sdf"/>
Nov 14 09:59:20 user nova-compute[75229]:   <target dev="vdb" bus="virtio"/>
Nov 14 09:59:20 user nova-compute[75229]:   <serial>143891e8-62eb-42d7-b076-db6f52b4f606</serial>
Nov 14 09:59:20 user nova-compute[75229]: </disk>
Nov 14 09:59:20 user nova-compute[75229]:  {{(pid=75229) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 09:59:21 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-47c18b4a-1b98-4b82-9d2b-4d8b23d604a2 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] No BDM found with device name vda, not building metadata. {{(pid=75229) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 09:59:21 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-47c18b4a-1b98-4b82-9d2b-4d8b23d604a2 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75229) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 09:59:21 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-47c18b4a-1b98-4b82-9d2b-4d8b23d604a2 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] No VIF found with MAC fa:16:3e:92:c4:4b, not building metadata {{(pid=75229) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 09:59:21 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-47c18b4a-1b98-4b82-9d2b-4d8b23d604a2 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Lock "abb8e340-164d-4bc2-a503-7e8ea3c9b35b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.533s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:59:21 user nova-compute[75229]: INFO nova.compute.manager [None req-81bdb5cb-b77f-45a6-b850-60d9d80aea27 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] [instance: abb8e340-164d-4bc2-a503-7e8ea3c9b35b] Rescuing
Nov 14 09:59:21 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-81bdb5cb-b77f-45a6-b850-60d9d80aea27 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Acquiring lock "refresh_cache-abb8e340-164d-4bc2-a503-7e8ea3c9b35b" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 09:59:21 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-81bdb5cb-b77f-45a6-b850-60d9d80aea27 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Acquired lock "refresh_cache-abb8e340-164d-4bc2-a503-7e8ea3c9b35b" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 09:59:21 user nova-compute[75229]: DEBUG nova.network.neutron [None req-81bdb5cb-b77f-45a6-b850-60d9d80aea27 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] [instance: abb8e340-164d-4bc2-a503-7e8ea3c9b35b] Building network info cache for instance {{(pid=75229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 09:59:22 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:59:22 user nova-compute[75229]: DEBUG nova.network.neutron [None req-81bdb5cb-b77f-45a6-b850-60d9d80aea27 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] [instance: abb8e340-164d-4bc2-a503-7e8ea3c9b35b] Updating instance_info_cache with network_info: [{"id": "37ce4717-9a82-41c6-9d89-f1e55b9ae398", "address": "fa:16:3e:92:c4:4b", "network": {"id": "22eed29e-7148-42f9-b4c7-b97811cba8eb", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2000485731-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.13", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46457b27e3ed416e827c3c22449fb512", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37ce4717-9a", "ovs_interfaceid": "37ce4717-9a82-41c6-9d89-f1e55b9ae398", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 09:59:22 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-81bdb5cb-b77f-45a6-b850-60d9d80aea27 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Releasing lock "refresh_cache-abb8e340-164d-4bc2-a503-7e8ea3c9b35b" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 09:59:22 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:59:22 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:59:22 user nova-compute[75229]: DEBUG nova.compute.manager [req-787951ae-7bab-478d-8992-c59b2a3dfd29 req-20909b36-c535-4277-b687-e9efa9ed073a service nova] [instance: abb8e340-164d-4bc2-a503-7e8ea3c9b35b] Received event network-vif-unplugged-37ce4717-9a82-41c6-9d89-f1e55b9ae398 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:59:22 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-787951ae-7bab-478d-8992-c59b2a3dfd29 req-20909b36-c535-4277-b687-e9efa9ed073a service nova] Acquiring lock "abb8e340-164d-4bc2-a503-7e8ea3c9b35b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:59:22 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-787951ae-7bab-478d-8992-c59b2a3dfd29 req-20909b36-c535-4277-b687-e9efa9ed073a service nova] Lock "abb8e340-164d-4bc2-a503-7e8ea3c9b35b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:59:22 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-787951ae-7bab-478d-8992-c59b2a3dfd29 req-20909b36-c535-4277-b687-e9efa9ed073a service nova] Lock "abb8e340-164d-4bc2-a503-7e8ea3c9b35b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:59:22 user nova-compute[75229]: DEBUG nova.compute.manager [req-787951ae-7bab-478d-8992-c59b2a3dfd29 req-20909b36-c535-4277-b687-e9efa9ed073a service nova] [instance: abb8e340-164d-4bc2-a503-7e8ea3c9b35b] No waiting events found dispatching network-vif-unplugged-37ce4717-9a82-41c6-9d89-f1e55b9ae398 {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 09:59:22 user nova-compute[75229]: WARNING nova.compute.manager [req-787951ae-7bab-478d-8992-c59b2a3dfd29 req-20909b36-c535-4277-b687-e9efa9ed073a service nova] [instance: abb8e340-164d-4bc2-a503-7e8ea3c9b35b] Received unexpected event network-vif-unplugged-37ce4717-9a82-41c6-9d89-f1e55b9ae398 for instance with vm_state active and task_state rescuing.
Nov 14 09:59:22 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:59:22 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:59:22 user nova-compute[75229]: INFO nova.virt.libvirt.driver [-] [instance: abb8e340-164d-4bc2-a503-7e8ea3c9b35b] Instance destroyed successfully.
Nov 14 09:59:22 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-81bdb5cb-b77f-45a6-b850-60d9d80aea27 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] [instance: abb8e340-164d-4bc2-a503-7e8ea3c9b35b] Attempting rescue
Nov 14 09:59:22 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-81bdb5cb-b77f-45a6-b850-60d9d80aea27 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75229) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 14 09:59:22 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-81bdb5cb-b77f-45a6-b850-60d9d80aea27 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] [instance: abb8e340-164d-4bc2-a503-7e8ea3c9b35b] Instance directory exists: not creating {{(pid=75229) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 14 09:59:22 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-81bdb5cb-b77f-45a6-b850-60d9d80aea27 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] [instance: abb8e340-164d-4bc2-a503-7e8ea3c9b35b] Creating image(s)
Nov 14 09:59:22 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-81bdb5cb-b77f-45a6-b850-60d9d80aea27 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Acquiring lock "/opt/stack/data/nova/instances/abb8e340-164d-4bc2-a503-7e8ea3c9b35b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:59:22 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-81bdb5cb-b77f-45a6-b850-60d9d80aea27 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Lock "/opt/stack/data/nova/instances/abb8e340-164d-4bc2-a503-7e8ea3c9b35b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:59:22 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-81bdb5cb-b77f-45a6-b850-60d9d80aea27 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Lock "/opt/stack/data/nova/instances/abb8e340-164d-4bc2-a503-7e8ea3c9b35b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:59:22 user nova-compute[75229]: DEBUG nova.objects.instance [None req-81bdb5cb-b77f-45a6-b850-60d9d80aea27 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Lazy-loading 'trusted_certs' on Instance uuid abb8e340-164d-4bc2-a503-7e8ea3c9b35b {{(pid=75229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 09:59:22 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-81bdb5cb-b77f-45a6-b850-60d9d80aea27 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Acquiring lock "4f30e3fe703d2381679612a57b1fb80a467f60b6" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:59:22 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-81bdb5cb-b77f-45a6-b850-60d9d80aea27 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Lock "4f30e3fe703d2381679612a57b1fb80a467f60b6" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:59:22 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-81bdb5cb-b77f-45a6-b850-60d9d80aea27 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6 --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:59:23 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-81bdb5cb-b77f-45a6-b850-60d9d80aea27 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6 --force-share --output=json" returned: 0 in 0.189s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:59:23 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-81bdb5cb-b77f-45a6-b850-60d9d80aea27 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6,backing_fmt=raw /opt/stack/data/nova/instances/abb8e340-164d-4bc2-a503-7e8ea3c9b35b/disk.rescue {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:59:23 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-81bdb5cb-b77f-45a6-b850-60d9d80aea27 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6,backing_fmt=raw /opt/stack/data/nova/instances/abb8e340-164d-4bc2-a503-7e8ea3c9b35b/disk.rescue" returned: 0 in 0.067s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:59:23 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-81bdb5cb-b77f-45a6-b850-60d9d80aea27 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Lock "4f30e3fe703d2381679612a57b1fb80a467f60b6" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.264s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:59:23 user nova-compute[75229]: DEBUG nova.objects.instance [None req-81bdb5cb-b77f-45a6-b850-60d9d80aea27 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Lazy-loading 'migration_context' on Instance uuid abb8e340-164d-4bc2-a503-7e8ea3c9b35b {{(pid=75229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 09:59:23 user nova-compute[75229]: DEBUG nova.objects.base [None req-81bdb5cb-b77f-45a6-b850-60d9d80aea27 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Object Instance<abb8e340-164d-4bc2-a503-7e8ea3c9b35b> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75229) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 09:59:23 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-81bdb5cb-b77f-45a6-b850-60d9d80aea27 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] [instance: abb8e340-164d-4bc2-a503-7e8ea3c9b35b] Created local disks {{(pid=75229) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 09:59:23 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-81bdb5cb-b77f-45a6-b850-60d9d80aea27 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] [instance: abb8e340-164d-4bc2-a503-7e8ea3c9b35b] Start _get_guest_xml network_info=[{"id": "37ce4717-9a82-41c6-9d89-f1e55b9ae398", "address": "fa:16:3e:92:c4:4b", "network": {"id": "22eed29e-7148-42f9-b4c7-b97811cba8eb", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2000485731-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.13", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-2000485731-network", "vif_mac": "fa:16:3e:92:c4:4b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46457b27e3ed416e827c3c22449fb512", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37ce4717-9a", "ovs_interfaceid": "37ce4717-9a82-41c6-9d89-f1e55b9ae398", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T09:40:10Z,direct_url=<?>,disk_format='qcow2',id=3bef8470-ecc7-40e3-95d4-9254348ea72d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='de5a91106b6948ed937a7178ff9464c4',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T09:40:12Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '3bef8470-ecc7-40e3-95d4-9254348ea72d', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=75229) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 09:59:23 user nova-compute[75229]: DEBUG nova.objects.instance [None req-81bdb5cb-b77f-45a6-b850-60d9d80aea27 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Lazy-loading 'resources' on Instance uuid abb8e340-164d-4bc2-a503-7e8ea3c9b35b {{(pid=75229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 09:59:23 user nova-compute[75229]: DEBUG nova.objects.base [None req-81bdb5cb-b77f-45a6-b850-60d9d80aea27 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Object Instance<abb8e340-164d-4bc2-a503-7e8ea3c9b35b> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75229) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 09:59:23 user nova-compute[75229]: DEBUG nova.objects.instance [None req-81bdb5cb-b77f-45a6-b850-60d9d80aea27 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Lazy-loading 'numa_topology' on Instance uuid abb8e340-164d-4bc2-a503-7e8ea3c9b35b {{(pid=75229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 09:59:23 user nova-compute[75229]: DEBUG nova.objects.base [None req-81bdb5cb-b77f-45a6-b850-60d9d80aea27 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Object Instance<abb8e340-164d-4bc2-a503-7e8ea3c9b35b> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75229) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 09:59:23 user nova-compute[75229]: WARNING nova.virt.libvirt.driver [None req-81bdb5cb-b77f-45a6-b850-60d9d80aea27 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 09:59:23 user nova-compute[75229]: WARNING nova.virt.libvirt.driver [None req-81bdb5cb-b77f-45a6-b850-60d9d80aea27 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 09:59:23 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-81bdb5cb-b77f-45a6-b850-60d9d80aea27 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75229) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 09:59:23 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-81bdb5cb-b77f-45a6-b850-60d9d80aea27 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] CPU controller missing on host. {{(pid=75229) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 09:59:23 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-81bdb5cb-b77f-45a6-b850-60d9d80aea27 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75229) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 09:59:23 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-81bdb5cb-b77f-45a6-b850-60d9d80aea27 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] CPU controller found on host. {{(pid=75229) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 09:59:23 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-81bdb5cb-b77f-45a6-b850-60d9d80aea27 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75229) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 09:59:23 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-81bdb5cb-b77f-45a6-b850-60d9d80aea27 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T09:39:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T09:40:10Z,direct_url=<?>,disk_format='qcow2',id=3bef8470-ecc7-40e3-95d4-9254348ea72d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='de5a91106b6948ed937a7178ff9464c4',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T09:40:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 09:59:23 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-81bdb5cb-b77f-45a6-b850-60d9d80aea27 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Flavor limits 0:0:0 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 09:59:23 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-81bdb5cb-b77f-45a6-b850-60d9d80aea27 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Image limits 0:0:0 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 09:59:23 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-81bdb5cb-b77f-45a6-b850-60d9d80aea27 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Flavor pref 0:0:0 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 09:59:23 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-81bdb5cb-b77f-45a6-b850-60d9d80aea27 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Image pref 0:0:0 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 09:59:23 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-81bdb5cb-b77f-45a6-b850-60d9d80aea27 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 09:59:23 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-81bdb5cb-b77f-45a6-b850-60d9d80aea27 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 09:59:23 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-81bdb5cb-b77f-45a6-b850-60d9d80aea27 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75229) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 09:59:23 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-81bdb5cb-b77f-45a6-b850-60d9d80aea27 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Got 1 possible topologies {{(pid=75229) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 09:59:23 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-81bdb5cb-b77f-45a6-b850-60d9d80aea27 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 09:59:23 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-81bdb5cb-b77f-45a6-b850-60d9d80aea27 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 09:59:23 user nova-compute[75229]: DEBUG nova.objects.instance [None req-81bdb5cb-b77f-45a6-b850-60d9d80aea27 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Lazy-loading 'vcpu_model' on Instance uuid abb8e340-164d-4bc2-a503-7e8ea3c9b35b {{(pid=75229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 09:59:23 user nova-compute[75229]: DEBUG nova.objects.base [None req-81bdb5cb-b77f-45a6-b850-60d9d80aea27 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Object Instance<abb8e340-164d-4bc2-a503-7e8ea3c9b35b> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75229) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 09:59:23 user nova-compute[75229]: DEBUG nova.virt.libvirt.vif [None req-81bdb5cb-b77f-45a6-b850-60d9d80aea27 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T09:57:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-852653284',display_name='tempest-ServerRescueNegativeTestJSON-server-852653284',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-852653284',id=35,image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIdhYa6J6ux6sEyjhtSOnIdcpfqYBU0T4i4xdWqDC4Ach0c+1fPVMeRgGZTsfJf+pkb1r79lSZ/ejqownl7uMFcdcqgEpgtqZeQb5GYf0i6txS0oNHoP6L0HNRQYfOpjeg==',key_name='tempest-keypair-411272448',keypairs=<?>,launch_index=0,launched_at=2023-11-14T09:57:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='46457b27e3ed416e827c3c22449fb512',ramdisk_id='',reservation_id='r-ajfymruw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-557279920',owner_user_name='tempest-ServerRescueNegativeTestJSON-557279920-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T09:57:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a3cb33a5c522499e8cd254edd5e15879',uuid=abb8e340-164d-4bc2-a503-7e8ea3c9b35b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "37ce4717-9a82-41c6-9d89-f1e55b9ae398", "address": "fa:16:3e:92:c4:4b", "network": {"id": "22eed29e-7148-42f9-b4c7-b97811cba8eb", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2000485731-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.13", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-2000485731-network", "vif_mac": "fa:16:3e:92:c4:4b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46457b27e3ed416e827c3c22449fb512", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37ce4717-9a", "ovs_interfaceid": "37ce4717-9a82-41c6-9d89-f1e55b9ae398", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75229) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 09:59:23 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-81bdb5cb-b77f-45a6-b850-60d9d80aea27 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Converting VIF {"id": "37ce4717-9a82-41c6-9d89-f1e55b9ae398", "address": "fa:16:3e:92:c4:4b", "network": {"id": "22eed29e-7148-42f9-b4c7-b97811cba8eb", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2000485731-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.13", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-2000485731-network", "vif_mac": "fa:16:3e:92:c4:4b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46457b27e3ed416e827c3c22449fb512", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37ce4717-9a", "ovs_interfaceid": "37ce4717-9a82-41c6-9d89-f1e55b9ae398", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 09:59:23 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-81bdb5cb-b77f-45a6-b850-60d9d80aea27 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:92:c4:4b,bridge_name='br-int',has_traffic_filtering=True,id=37ce4717-9a82-41c6-9d89-f1e55b9ae398,network=Network(22eed29e-7148-42f9-b4c7-b97811cba8eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37ce4717-9a') {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 09:59:23 user nova-compute[75229]: DEBUG nova.objects.instance [None req-81bdb5cb-b77f-45a6-b850-60d9d80aea27 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Lazy-loading 'pci_devices' on Instance uuid abb8e340-164d-4bc2-a503-7e8ea3c9b35b {{(pid=75229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 09:59:23 user nova-compute[75229]: DEBUG nova.objects.base [None req-81bdb5cb-b77f-45a6-b850-60d9d80aea27 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Object Instance<abb8e340-164d-4bc2-a503-7e8ea3c9b35b> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75229) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 09:59:23 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-81bdb5cb-b77f-45a6-b850-60d9d80aea27 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] [instance: abb8e340-164d-4bc2-a503-7e8ea3c9b35b] End _get_guest_xml xml=<domain type="kvm">
Nov 14 09:59:23 user nova-compute[75229]:   <uuid>abb8e340-164d-4bc2-a503-7e8ea3c9b35b</uuid>
Nov 14 09:59:23 user nova-compute[75229]:   <name>instance-00000023</name>
Nov 14 09:59:23 user nova-compute[75229]:   <memory>524288</memory>
Nov 14 09:59:23 user nova-compute[75229]:   <vcpu>1</vcpu>
Nov 14 09:59:23 user nova-compute[75229]:   <metadata>
Nov 14 09:59:23 user nova-compute[75229]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 09:59:23 user nova-compute[75229]:       <nova:package version="0.0.0"/>
Nov 14 09:59:23 user nova-compute[75229]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-852653284</nova:name>
Nov 14 09:59:23 user nova-compute[75229]:       <nova:creationTime>2023-11-14 09:59:23</nova:creationTime>
Nov 14 09:59:23 user nova-compute[75229]:       <nova:flavor name="m1.tiny">
Nov 14 09:59:23 user nova-compute[75229]:         <nova:memory>512</nova:memory>
Nov 14 09:59:23 user nova-compute[75229]:         <nova:disk>1</nova:disk>
Nov 14 09:59:23 user nova-compute[75229]:         <nova:swap>0</nova:swap>
Nov 14 09:59:23 user nova-compute[75229]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 09:59:23 user nova-compute[75229]:         <nova:vcpus>1</nova:vcpus>
Nov 14 09:59:23 user nova-compute[75229]:       </nova:flavor>
Nov 14 09:59:23 user nova-compute[75229]:       <nova:owner>
Nov 14 09:59:23 user nova-compute[75229]:         <nova:user uuid="a3cb33a5c522499e8cd254edd5e15879">tempest-ServerRescueNegativeTestJSON-557279920-project-member</nova:user>
Nov 14 09:59:23 user nova-compute[75229]:         <nova:project uuid="46457b27e3ed416e827c3c22449fb512">tempest-ServerRescueNegativeTestJSON-557279920</nova:project>
Nov 14 09:59:23 user nova-compute[75229]:       </nova:owner>
Nov 14 09:59:23 user nova-compute[75229]:       <nova:root type="image" uuid="3bef8470-ecc7-40e3-95d4-9254348ea72d"/>
Nov 14 09:59:23 user nova-compute[75229]:       <nova:ports>
Nov 14 09:59:23 user nova-compute[75229]:         <nova:port uuid="37ce4717-9a82-41c6-9d89-f1e55b9ae398">
Nov 14 09:59:23 user nova-compute[75229]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 14 09:59:23 user nova-compute[75229]:         </nova:port>
Nov 14 09:59:23 user nova-compute[75229]:       </nova:ports>
Nov 14 09:59:23 user nova-compute[75229]:     </nova:instance>
Nov 14 09:59:23 user nova-compute[75229]:   </metadata>
Nov 14 09:59:23 user nova-compute[75229]:   <sysinfo type="smbios">
Nov 14 09:59:23 user nova-compute[75229]:     <system>
Nov 14 09:59:23 user nova-compute[75229]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 09:59:23 user nova-compute[75229]:       <entry name="product">OpenStack Nova</entry>
Nov 14 09:59:23 user nova-compute[75229]:       <entry name="version">0.0.0</entry>
Nov 14 09:59:23 user nova-compute[75229]:       <entry name="serial">abb8e340-164d-4bc2-a503-7e8ea3c9b35b</entry>
Nov 14 09:59:23 user nova-compute[75229]:       <entry name="uuid">abb8e340-164d-4bc2-a503-7e8ea3c9b35b</entry>
Nov 14 09:59:23 user nova-compute[75229]:       <entry name="family">Virtual Machine</entry>
Nov 14 09:59:23 user nova-compute[75229]:     </system>
Nov 14 09:59:23 user nova-compute[75229]:   </sysinfo>
Nov 14 09:59:23 user nova-compute[75229]:   <os>
Nov 14 09:59:23 user nova-compute[75229]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 09:59:23 user nova-compute[75229]:     <smbios mode="sysinfo"/>
Nov 14 09:59:23 user nova-compute[75229]:   </os>
Nov 14 09:59:23 user nova-compute[75229]:   <features>
Nov 14 09:59:23 user nova-compute[75229]:     <acpi/>
Nov 14 09:59:23 user nova-compute[75229]:     <apic/>
Nov 14 09:59:23 user nova-compute[75229]:     <vmcoreinfo/>
Nov 14 09:59:23 user nova-compute[75229]:   </features>
Nov 14 09:59:23 user nova-compute[75229]:   <clock offset="utc">
Nov 14 09:59:23 user nova-compute[75229]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 09:59:23 user nova-compute[75229]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 09:59:23 user nova-compute[75229]:     <timer name="hpet" present="no"/>
Nov 14 09:59:23 user nova-compute[75229]:   </clock>
Nov 14 09:59:23 user nova-compute[75229]:   <cpu mode="custom" match="exact">
Nov 14 09:59:23 user nova-compute[75229]:     <model>Nehalem</model>
Nov 14 09:59:23 user nova-compute[75229]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 09:59:23 user nova-compute[75229]:   </cpu>
Nov 14 09:59:23 user nova-compute[75229]:   <devices>
Nov 14 09:59:23 user nova-compute[75229]:     <disk type="file" device="disk">
Nov 14 09:59:23 user nova-compute[75229]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 09:59:23 user nova-compute[75229]:       <source file="/opt/stack/data/nova/instances/abb8e340-164d-4bc2-a503-7e8ea3c9b35b/disk.rescue"/>
Nov 14 09:59:23 user nova-compute[75229]:       <target dev="vda" bus="virtio"/>
Nov 14 09:59:23 user nova-compute[75229]:     </disk>
Nov 14 09:59:23 user nova-compute[75229]:     <disk type="file" device="disk">
Nov 14 09:59:23 user nova-compute[75229]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 09:59:23 user nova-compute[75229]:       <source file="/opt/stack/data/nova/instances/abb8e340-164d-4bc2-a503-7e8ea3c9b35b/disk"/>
Nov 14 09:59:23 user nova-compute[75229]:       <target dev="vdb" bus="virtio"/>
Nov 14 09:59:23 user nova-compute[75229]:     </disk>
Nov 14 09:59:23 user nova-compute[75229]:     <interface type="ethernet">
Nov 14 09:59:23 user nova-compute[75229]:       <mac address="fa:16:3e:92:c4:4b"/>
Nov 14 09:59:23 user nova-compute[75229]:       <model type="virtio"/>
Nov 14 09:59:23 user nova-compute[75229]:       <mtu size="1442"/>
Nov 14 09:59:23 user nova-compute[75229]:       <target dev="tap37ce4717-9a"/>
Nov 14 09:59:23 user nova-compute[75229]:     </interface>
Nov 14 09:59:23 user nova-compute[75229]:     <serial type="pty">
Nov 14 09:59:23 user nova-compute[75229]:       <log file="/opt/stack/data/nova/instances/abb8e340-164d-4bc2-a503-7e8ea3c9b35b/console.log" append="off"/>
Nov 14 09:59:23 user nova-compute[75229]:     </serial>
Nov 14 09:59:23 user nova-compute[75229]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 09:59:23 user nova-compute[75229]:     <video>
Nov 14 09:59:23 user nova-compute[75229]:       <model type="virtio"/>
Nov 14 09:59:23 user nova-compute[75229]:     </video>
Nov 14 09:59:23 user nova-compute[75229]:     <rng model="virtio">
Nov 14 09:59:23 user nova-compute[75229]:       <backend model="random">/dev/urandom</backend>
Nov 14 09:59:23 user nova-compute[75229]:     </rng>
Nov 14 09:59:23 user nova-compute[75229]:     <controller type="usb" index="0" model="none"/>
Nov 14 09:59:23 user nova-compute[75229]:     <memballoon model="virtio">
Nov 14 09:59:23 user nova-compute[75229]:       <stats period="10"/>
Nov 14 09:59:23 user nova-compute[75229]:     </memballoon>
Nov 14 09:59:23 user nova-compute[75229]:   </devices>
Nov 14 09:59:23 user nova-compute[75229]: </domain>
Nov 14 09:59:23 user nova-compute[75229]:  {{(pid=75229) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 09:59:23 user nova-compute[75229]: INFO nova.virt.libvirt.driver [-] [instance: abb8e340-164d-4bc2-a503-7e8ea3c9b35b] Instance destroyed successfully.
Nov 14 09:59:23 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-81bdb5cb-b77f-45a6-b850-60d9d80aea27 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] No BDM found with device name vda, not building metadata. {{(pid=75229) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 09:59:23 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-81bdb5cb-b77f-45a6-b850-60d9d80aea27 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75229) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 09:59:23 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-81bdb5cb-b77f-45a6-b850-60d9d80aea27 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] No VIF found with MAC fa:16:3e:92:c4:4b, not building metadata {{(pid=75229) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 09:59:23 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:59:24 user nova-compute[75229]: DEBUG nova.compute.manager [req-a173389e-6c19-413c-8e7f-ff04ca86a220 req-68efc1d1-3cda-44f2-a064-d231090a4b71 service nova] [instance: abb8e340-164d-4bc2-a503-7e8ea3c9b35b] Received event network-vif-plugged-37ce4717-9a82-41c6-9d89-f1e55b9ae398 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:59:24 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-a173389e-6c19-413c-8e7f-ff04ca86a220 req-68efc1d1-3cda-44f2-a064-d231090a4b71 service nova] Acquiring lock "abb8e340-164d-4bc2-a503-7e8ea3c9b35b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:59:24 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-a173389e-6c19-413c-8e7f-ff04ca86a220 req-68efc1d1-3cda-44f2-a064-d231090a4b71 service nova] Lock "abb8e340-164d-4bc2-a503-7e8ea3c9b35b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:59:24 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-a173389e-6c19-413c-8e7f-ff04ca86a220 req-68efc1d1-3cda-44f2-a064-d231090a4b71 service nova] Lock "abb8e340-164d-4bc2-a503-7e8ea3c9b35b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:59:24 user nova-compute[75229]: DEBUG nova.compute.manager [req-a173389e-6c19-413c-8e7f-ff04ca86a220 req-68efc1d1-3cda-44f2-a064-d231090a4b71 service nova] [instance: abb8e340-164d-4bc2-a503-7e8ea3c9b35b] No waiting events found dispatching network-vif-plugged-37ce4717-9a82-41c6-9d89-f1e55b9ae398 {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 09:59:24 user nova-compute[75229]: WARNING nova.compute.manager [req-a173389e-6c19-413c-8e7f-ff04ca86a220 req-68efc1d1-3cda-44f2-a064-d231090a4b71 service nova] [instance: abb8e340-164d-4bc2-a503-7e8ea3c9b35b] Received unexpected event network-vif-plugged-37ce4717-9a82-41c6-9d89-f1e55b9ae398 for instance with vm_state active and task_state rescuing.
Nov 14 09:59:24 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:59:24 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:59:24 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:59:24 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:59:25 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:59:26 user nova-compute[75229]: DEBUG nova.compute.manager [req-8ddb1ac0-2e0c-4b5c-bc86-912f757404a3 req-1484f778-f765-441a-9852-3c621acf63a2 service nova] [instance: abb8e340-164d-4bc2-a503-7e8ea3c9b35b] Received event network-vif-plugged-37ce4717-9a82-41c6-9d89-f1e55b9ae398 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:59:26 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-8ddb1ac0-2e0c-4b5c-bc86-912f757404a3 req-1484f778-f765-441a-9852-3c621acf63a2 service nova] Acquiring lock "abb8e340-164d-4bc2-a503-7e8ea3c9b35b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:59:26 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-8ddb1ac0-2e0c-4b5c-bc86-912f757404a3 req-1484f778-f765-441a-9852-3c621acf63a2 service nova] Lock "abb8e340-164d-4bc2-a503-7e8ea3c9b35b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:59:26 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-8ddb1ac0-2e0c-4b5c-bc86-912f757404a3 req-1484f778-f765-441a-9852-3c621acf63a2 service nova] Lock "abb8e340-164d-4bc2-a503-7e8ea3c9b35b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:59:26 user nova-compute[75229]: DEBUG nova.compute.manager [req-8ddb1ac0-2e0c-4b5c-bc86-912f757404a3 req-1484f778-f765-441a-9852-3c621acf63a2 service nova] [instance: abb8e340-164d-4bc2-a503-7e8ea3c9b35b] No waiting events found dispatching network-vif-plugged-37ce4717-9a82-41c6-9d89-f1e55b9ae398 {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 09:59:26 user nova-compute[75229]: WARNING nova.compute.manager [req-8ddb1ac0-2e0c-4b5c-bc86-912f757404a3 req-1484f778-f765-441a-9852-3c621acf63a2 service nova] [instance: abb8e340-164d-4bc2-a503-7e8ea3c9b35b] Received unexpected event network-vif-plugged-37ce4717-9a82-41c6-9d89-f1e55b9ae398 for instance with vm_state active and task_state rescuing.
Nov 14 09:59:26 user nova-compute[75229]: DEBUG nova.compute.manager [req-8ddb1ac0-2e0c-4b5c-bc86-912f757404a3 req-1484f778-f765-441a-9852-3c621acf63a2 service nova] [instance: abb8e340-164d-4bc2-a503-7e8ea3c9b35b] Received event network-vif-plugged-37ce4717-9a82-41c6-9d89-f1e55b9ae398 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:59:26 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-8ddb1ac0-2e0c-4b5c-bc86-912f757404a3 req-1484f778-f765-441a-9852-3c621acf63a2 service nova] Acquiring lock "abb8e340-164d-4bc2-a503-7e8ea3c9b35b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:59:26 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-8ddb1ac0-2e0c-4b5c-bc86-912f757404a3 req-1484f778-f765-441a-9852-3c621acf63a2 service nova] Lock "abb8e340-164d-4bc2-a503-7e8ea3c9b35b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:59:26 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-8ddb1ac0-2e0c-4b5c-bc86-912f757404a3 req-1484f778-f765-441a-9852-3c621acf63a2 service nova] Lock "abb8e340-164d-4bc2-a503-7e8ea3c9b35b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:59:26 user nova-compute[75229]: DEBUG nova.compute.manager [req-8ddb1ac0-2e0c-4b5c-bc86-912f757404a3 req-1484f778-f765-441a-9852-3c621acf63a2 service nova] [instance: abb8e340-164d-4bc2-a503-7e8ea3c9b35b] No waiting events found dispatching network-vif-plugged-37ce4717-9a82-41c6-9d89-f1e55b9ae398 {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 09:59:26 user nova-compute[75229]: WARNING nova.compute.manager [req-8ddb1ac0-2e0c-4b5c-bc86-912f757404a3 req-1484f778-f765-441a-9852-3c621acf63a2 service nova] [instance: abb8e340-164d-4bc2-a503-7e8ea3c9b35b] Received unexpected event network-vif-plugged-37ce4717-9a82-41c6-9d89-f1e55b9ae398 for instance with vm_state active and task_state rescuing.
Nov 14 09:59:27 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:59:27 user nova-compute[75229]: DEBUG nova.compute.manager [None req-81bdb5cb-b77f-45a6-b850-60d9d80aea27 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] [instance: abb8e340-164d-4bc2-a503-7e8ea3c9b35b] Checking state {{(pid=75229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 09:59:28 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:59:30 user nova-compute[75229]: DEBUG nova.compute.manager [req-4f037c29-f719-4720-aa82-76e198d03b0f req-4ac7bbbc-4184-4c1f-ac89-a8f87620e3f6 service nova] [instance: 9cdd6b32-d4bd-4135-a58e-fbc3b6d2a093] Received event network-changed-5b06ed49-fa0b-4b58-ad6e-a092a9c1d14c {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:59:30 user nova-compute[75229]: DEBUG nova.compute.manager [req-4f037c29-f719-4720-aa82-76e198d03b0f req-4ac7bbbc-4184-4c1f-ac89-a8f87620e3f6 service nova] [instance: 9cdd6b32-d4bd-4135-a58e-fbc3b6d2a093] Refreshing instance network info cache due to event network-changed-5b06ed49-fa0b-4b58-ad6e-a092a9c1d14c. {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 09:59:30 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-4f037c29-f719-4720-aa82-76e198d03b0f req-4ac7bbbc-4184-4c1f-ac89-a8f87620e3f6 service nova] Acquiring lock "refresh_cache-9cdd6b32-d4bd-4135-a58e-fbc3b6d2a093" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 09:59:30 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-4f037c29-f719-4720-aa82-76e198d03b0f req-4ac7bbbc-4184-4c1f-ac89-a8f87620e3f6 service nova] Acquired lock "refresh_cache-9cdd6b32-d4bd-4135-a58e-fbc3b6d2a093" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 09:59:30 user nova-compute[75229]: DEBUG nova.network.neutron [req-4f037c29-f719-4720-aa82-76e198d03b0f req-4ac7bbbc-4184-4c1f-ac89-a8f87620e3f6 service nova] [instance: 9cdd6b32-d4bd-4135-a58e-fbc3b6d2a093] Refreshing network info cache for port 5b06ed49-fa0b-4b58-ad6e-a092a9c1d14c {{(pid=75229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 09:59:30 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-c8c68107-d972-43d9-a13c-c27237ee7119 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Acquiring lock "bc39b8e1-c8f9-4aa9-8d1b-72524b73f88c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:59:30 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-c8c68107-d972-43d9-a13c-c27237ee7119 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Lock "bc39b8e1-c8f9-4aa9-8d1b-72524b73f88c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:59:30 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-c8c68107-d972-43d9-a13c-c27237ee7119 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Acquiring lock "bc39b8e1-c8f9-4aa9-8d1b-72524b73f88c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:59:30 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-c8c68107-d972-43d9-a13c-c27237ee7119 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Lock "bc39b8e1-c8f9-4aa9-8d1b-72524b73f88c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:59:30 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-c8c68107-d972-43d9-a13c-c27237ee7119 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Lock "bc39b8e1-c8f9-4aa9-8d1b-72524b73f88c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:59:30 user nova-compute[75229]: INFO nova.compute.manager [None req-c8c68107-d972-43d9-a13c-c27237ee7119 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] [instance: bc39b8e1-c8f9-4aa9-8d1b-72524b73f88c] Terminating instance
Nov 14 09:59:30 user nova-compute[75229]: DEBUG nova.compute.manager [None req-c8c68107-d972-43d9-a13c-c27237ee7119 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] [instance: bc39b8e1-c8f9-4aa9-8d1b-72524b73f88c] Start destroying the instance on the hypervisor. {{(pid=75229) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 09:59:30 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:59:30 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:59:30 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:59:30 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:59:31 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:59:31 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:59:31 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:59:31 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:59:31 user nova-compute[75229]: INFO nova.virt.libvirt.driver [-] [instance: bc39b8e1-c8f9-4aa9-8d1b-72524b73f88c] Instance destroyed successfully.
Nov 14 09:59:31 user nova-compute[75229]: DEBUG nova.objects.instance [None req-c8c68107-d972-43d9-a13c-c27237ee7119 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Lazy-loading 'resources' on Instance uuid bc39b8e1-c8f9-4aa9-8d1b-72524b73f88c {{(pid=75229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 09:59:31 user nova-compute[75229]: DEBUG nova.virt.libvirt.vif [None req-c8c68107-d972-43d9-a13c-c27237ee7119 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T09:57:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-2091069473',display_name='tempest-TestVolumeBootPattern-server-2091069473',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-2091069473',id=36,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-14T09:57:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='46620ac128944703899f22fe5439ba26',ramdisk_id='',reservation_id='r-jb3ofr5o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-2064993142',owner_user_name='tempest-TestVolumeBootPattern-2064993142-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T09:57:56Z,user_data=None,user_id='c26f33e4cdf14ba796445959953f8685',uuid=bc39b8e1-c8f9-4aa9-8d1b-72524b73f88c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8e3a02db-6163-43cd-b8ea-e52e85e68b24", "address": "fa:16:3e:51:a5:b7", "network": {"id": "118ea7c1-77c0-4660-b7b7-f311f6b0ec8a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1907578504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46620ac128944703899f22fe5439ba26", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e3a02db-61", "ovs_interfaceid": "8e3a02db-6163-43cd-b8ea-e52e85e68b24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 09:59:31 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-c8c68107-d972-43d9-a13c-c27237ee7119 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Converting VIF {"id": "8e3a02db-6163-43cd-b8ea-e52e85e68b24", "address": "fa:16:3e:51:a5:b7", "network": {"id": "118ea7c1-77c0-4660-b7b7-f311f6b0ec8a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1907578504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46620ac128944703899f22fe5439ba26", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e3a02db-61", "ovs_interfaceid": "8e3a02db-6163-43cd-b8ea-e52e85e68b24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 09:59:31 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-c8c68107-d972-43d9-a13c-c27237ee7119 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:51:a5:b7,bridge_name='br-int',has_traffic_filtering=True,id=8e3a02db-6163-43cd-b8ea-e52e85e68b24,network=Network(118ea7c1-77c0-4660-b7b7-f311f6b0ec8a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e3a02db-61') {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 09:59:31 user nova-compute[75229]: DEBUG os_vif [None req-c8c68107-d972-43d9-a13c-c27237ee7119 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:51:a5:b7,bridge_name='br-int',has_traffic_filtering=True,id=8e3a02db-6163-43cd-b8ea-e52e85e68b24,network=Network(118ea7c1-77c0-4660-b7b7-f311f6b0ec8a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e3a02db-61') {{(pid=75229) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 09:59:31 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:59:31 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8e3a02db-61, bridge=br-int, if_exists=True) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:59:31 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:59:31 user nova-compute[75229]: DEBUG nova.network.neutron [req-4f037c29-f719-4720-aa82-76e198d03b0f req-4ac7bbbc-4184-4c1f-ac89-a8f87620e3f6 service nova] [instance: 9cdd6b32-d4bd-4135-a58e-fbc3b6d2a093] Updated VIF entry in instance network info cache for port 5b06ed49-fa0b-4b58-ad6e-a092a9c1d14c. {{(pid=75229) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 09:59:31 user nova-compute[75229]: DEBUG nova.network.neutron [req-4f037c29-f719-4720-aa82-76e198d03b0f req-4ac7bbbc-4184-4c1f-ac89-a8f87620e3f6 service nova] [instance: 9cdd6b32-d4bd-4135-a58e-fbc3b6d2a093] Updating instance_info_cache with network_info: [{"id": "5b06ed49-fa0b-4b58-ad6e-a092a9c1d14c", "address": "fa:16:3e:f8:75:16", "network": {"id": "1687d918-9f70-4099-b44c-97f92f90e6ff", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2074208460-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.100", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a6157b9827b44d2bab197220b635fd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b06ed49-fa", "ovs_interfaceid": "5b06ed49-fa0b-4b58-ad6e-a092a9c1d14c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 09:59:31 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 09:59:31 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:59:31 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:59:31 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9499efb3-b25e-412b-a261-77a204923a8f) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:59:31 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:59:31 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:59:31 user nova-compute[75229]: INFO os_vif [None req-c8c68107-d972-43d9-a13c-c27237ee7119 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:51:a5:b7,bridge_name='br-int',has_traffic_filtering=True,id=8e3a02db-6163-43cd-b8ea-e52e85e68b24,network=Network(118ea7c1-77c0-4660-b7b7-f311f6b0ec8a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e3a02db-61')
Nov 14 09:59:31 user nova-compute[75229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c8c68107-d972-43d9-a13c-c27237ee7119 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] [instance: bc39b8e1-c8f9-4aa9-8d1b-72524b73f88c] calling os-brick to detach iSCSI Volume {{(pid=75229) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 09:59:31 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8c68107-d972-43d9-a13c-c27237ee7119 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f73f85151b0>, {'target_iqn': 'iqn.2010-10.org.openstack:4562974d-4587-4774-adb3-21a623f466c2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lBfSsupY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 09:59:31 user nova-compute[75229]: WARNING os_brick.initiator.connectors.base [None req-c8c68107-d972-43d9-a13c-c27237ee7119 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 09:59:31 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-c8c68107-d972-43d9-a13c-c27237ee7119 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 09:59:31 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-c8c68107-d972-43d9-a13c-c27237ee7119 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 09:59:31 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-4f037c29-f719-4720-aa82-76e198d03b0f req-4ac7bbbc-4184-4c1f-ac89-a8f87620e3f6 service nova] Releasing lock "refresh_cache-9cdd6b32-d4bd-4135-a58e-fbc3b6d2a093" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 09:59:31 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:59:31 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:59:31 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[992d31b0-ef3f-49ac-9eb5-b9be7db685b9]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:94a0a817-0b71-4589-90eb-8c8d159f7fd2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a5efb0e0-a85c-46ec-8a9d-2763bf548023\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:143891e8-62eb-42d7-b076-db6f52b4f606\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5aebc438-0289-44fe-ad84-4e696468f50e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4562974d-4587-4774-adb3-21a623f466c2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:59:31 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8c68107-d972-43d9-a13c-c27237ee7119 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 09:59:31 user nova-compute[75229]: No targets found.
Nov 14 09:59:31 user nova-compute[75229]: iSNS:
Nov 14 09:59:31 user nova-compute[75229]: No targets found.
Nov 14 09:59:31 user nova-compute[75229]: STATIC:
Nov 14 09:59:31 user nova-compute[75229]: Target: iqn.2010-10.org.openstack:94a0a817-0b71-4589-90eb-8c8d159f7fd2
Nov 14 09:59:31 user nova-compute[75229]:         Portal: 172.16.0.220:3260,-1
Nov 14 09:59:31 user nova-compute[75229]:                 Iface Name: default
Nov 14 09:59:31 user nova-compute[75229]: Target: iqn.2010-10.org.openstack:a5efb0e0-a85c-46ec-8a9d-2763bf548023
Nov 14 09:59:31 user nova-compute[75229]:         Portal: 172.16.0.220:3260,-1
Nov 14 09:59:31 user nova-compute[75229]:                 Iface Name: default
Nov 14 09:59:31 user nova-compute[75229]: Target: iqn.2010-10.org.openstack:143891e8-62eb-42d7-b076-db6f52b4f606
Nov 14 09:59:31 user nova-compute[75229]:         Portal: 172.16.0.220:3260,-1
Nov 14 09:59:31 user nova-compute[75229]:                 Iface Name: default
Nov 14 09:59:31 user nova-compute[75229]: Target: iqn.2010-10.org.openstack:5aebc438-0289-44fe-ad84-4e696468f50e
Nov 14 09:59:31 user nova-compute[75229]:         Portal: 172.16.0.220:3260,-1
Nov 14 09:59:31 user nova-compute[75229]:                 Iface Name: default
Nov 14 09:59:31 user nova-compute[75229]: Target: iqn.2010-10.org.openstack:4562974d-4587-4774-adb3-21a623f466c2
Nov 14 09:59:31 user nova-compute[75229]:         Portal: 172.16.0.220:3260,-1
Nov 14 09:59:31 user nova-compute[75229]:                 Iface Name: default
Nov 14 09:59:31 user nova-compute[75229]: FIRMWARE:
Nov 14 09:59:31 user nova-compute[75229]: No targets found.
Nov 14 09:59:31 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 09:59:31 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8c68107-d972-43d9-a13c-c27237ee7119 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 09:59:31 user nova-compute[75229]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 09:59:31 user nova-compute[75229]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75229) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 09:59:31 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8c68107-d972-43d9-a13c-c27237ee7119 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4562974d-4587-4774-adb3-21a623f466c2', 0)] {{(pid=75229) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 09:59:31 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:59:31 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:59:31 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f569354-fe50-435d-9fb1-666e1bc8b21b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:143891e8-62eb-42d7-b076-db6f52b4f606\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4562974d-4587-4774-adb3-21a623f466c2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5aebc438-0289-44fe-ad84-4e696468f50e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:94a0a817-0b71-4589-90eb-8c8d159f7fd2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a5efb0e0-a85c-46ec-8a9d-2763bf548023\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:59:31 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:59:31 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.039s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:59:31 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[1681ed99-e4ae-459b-8c5c-4df67f78898a]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aebc438-0289-44fe-ad84-4e696468f50e (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5efb0e0-a85c-46ec-8a9d-2763bf548023 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94a0a817-0b71-4589-90eb-8c8d159f7fd2 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4562974d-4587-4774-adb3-21a623f466c2 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:143891e8-62eb-42d7-b076-db6f52b4f606 (non-flash)\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:59:31 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8c68107-d972-43d9-a13c-c27237ee7119 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aebc438-0289-44fe-ad84-4e696468f50e (non-flash)
Nov 14 09:59:31 user nova-compute[75229]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5efb0e0-a85c-46ec-8a9d-2763bf548023 (non-flash)
Nov 14 09:59:31 user nova-compute[75229]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94a0a817-0b71-4589-90eb-8c8d159f7fd2 (non-flash)
Nov 14 09:59:31 user nova-compute[75229]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4562974d-4587-4774-adb3-21a623f466c2 (non-flash)
Nov 14 09:59:31 user nova-compute[75229]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:143891e8-62eb-42d7-b076-db6f52b4f606 (non-flash)
Nov 14 09:59:31 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 09:59:31 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8c68107-d972-43d9-a13c-c27237ee7119 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aebc438-0289-44fe-ad84-4e696468f50e (non-flash)
Nov 14 09:59:31 user nova-compute[75229]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5efb0e0-a85c-46ec-8a9d-2763bf548023 (non-flash)
Nov 14 09:59:31 user nova-compute[75229]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94a0a817-0b71-4589-90eb-8c8d159f7fd2 (non-flash)
Nov 14 09:59:31 user nova-compute[75229]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4562974d-4587-4774-adb3-21a623f466c2 (non-flash)
Nov 14 09:59:31 user nova-compute[75229]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:143891e8-62eb-42d7-b076-db6f52b4f606 (non-flash)
Nov 14 09:59:31 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 09:59:31 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8c68107-d972-43d9-a13c-c27237ee7119 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f73f83d9120>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4562974d-4587-4774-adb3-21a623f466c2'): ({'sde'}, set())}) {{(pid=75229) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 09:59:31 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-c8c68107-d972-43d9-a13c-c27237ee7119 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Removing single pathed devices sde {{(pid=75229) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 09:59:31 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:59:31 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.032s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:59:31 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce1618f9-8203-4e23-b9fb-498405cd99c5]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:59:31 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:59:31 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.021s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:59:31 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[30a4e35a-0383-4b7c-86c9-73aab14bd27e]: (4, ('ok\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:59:31 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-c8c68107-d972-43d9-a13c-c27237ee7119 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Flushing IO for device /dev/sde {{(pid=75229) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 09:59:31 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:59:31 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.015s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:59:31 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5fe593a-c964-4692-9703-fa9cd122c746]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:59:31 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-c8c68107-d972-43d9-a13c-c27237ee7119 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75229) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 09:59:31 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:59:32 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.066s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:59:32 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f7d4926-f365-4021-9da7-b8381a2a2a11]: (4, ('1', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:59:32 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-c8c68107-d972-43d9-a13c-c27237ee7119 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75229) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 09:59:32 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-c8c68107-d972-43d9-a13c-c27237ee7119 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] SCSI volumes sde have been removed. {{(pid=75229) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 09:59:32 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8c68107-d972-43d9-a13c-c27237ee7119 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4562974d-4587-4774-adb3-21a623f466c2')] {{(pid=75229) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 09:59:32 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4562974d-4587-4774-adb3-21a623f466c2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:59:32 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4562974d-4587-4774-adb3-21a623f466c2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:59:32 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[22dad4ca-0d55-4bbf-a280-56aee7010895]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:59:32 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8c68107-d972-43d9-a13c-c27237ee7119 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:59:32 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4562974d-4587-4774-adb3-21a623f466c2 -p 172.16.0.220:3260 --logout {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:59:32 user nova-compute[75229]: DEBUG nova.compute.manager [req-8b5a5ab5-45ae-4df4-bdb2-78f1bd6ec8d8 req-06d145ac-2373-42d3-90f4-44b715628393 service nova] [instance: 9cdd6b32-d4bd-4135-a58e-fbc3b6d2a093] Received event network-changed-5b06ed49-fa0b-4b58-ad6e-a092a9c1d14c {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:59:32 user nova-compute[75229]: DEBUG nova.compute.manager [req-8b5a5ab5-45ae-4df4-bdb2-78f1bd6ec8d8 req-06d145ac-2373-42d3-90f4-44b715628393 service nova] [instance: 9cdd6b32-d4bd-4135-a58e-fbc3b6d2a093] Refreshing instance network info cache due to event network-changed-5b06ed49-fa0b-4b58-ad6e-a092a9c1d14c. {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 09:59:32 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-8b5a5ab5-45ae-4df4-bdb2-78f1bd6ec8d8 req-06d145ac-2373-42d3-90f4-44b715628393 service nova] Acquiring lock "refresh_cache-9cdd6b32-d4bd-4135-a58e-fbc3b6d2a093" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 09:59:32 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-8b5a5ab5-45ae-4df4-bdb2-78f1bd6ec8d8 req-06d145ac-2373-42d3-90f4-44b715628393 service nova] Acquired lock "refresh_cache-9cdd6b32-d4bd-4135-a58e-fbc3b6d2a093" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 09:59:32 user nova-compute[75229]: DEBUG nova.network.neutron [req-8b5a5ab5-45ae-4df4-bdb2-78f1bd6ec8d8 req-06d145ac-2373-42d3-90f4-44b715628393 service nova] [instance: 9cdd6b32-d4bd-4135-a58e-fbc3b6d2a093] Refreshing network info cache for port 5b06ed49-fa0b-4b58-ad6e-a092a9c1d14c {{(pid=75229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 09:59:32 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4562974d-4587-4774-adb3-21a623f466c2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.078s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:59:32 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba7c7d65-d9fd-45d0-b55e-32d233fe59b7]: (4, ('Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:4562974d-4587-4774-adb3-21a623f466c2, portal: 172.16.0.220,3260]\nLogout of [sid: 37, target: iqn.2010-10.org.openstack:4562974d-4587-4774-adb3-21a623f466c2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:59:32 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8c68107-d972-43d9-a13c-c27237ee7119 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:4562974d-4587-4774-adb3-21a623f466c2, portal: 172.16.0.220,3260]
Nov 14 09:59:32 user nova-compute[75229]: Logout of [sid: 37, target: iqn.2010-10.org.openstack:4562974d-4587-4774-adb3-21a623f466c2, portal: 172.16.0.220,3260] successful.
Nov 14 09:59:32 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:59:32 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4562974d-4587-4774-adb3-21a623f466c2 -p 172.16.0.220:3260 --op delete {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:59:32 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4562974d-4587-4774-adb3-21a623f466c2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:59:32 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[fce1f856-0eac-4b73-860f-de9eb8ec60af]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:59:32 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8c68107-d972-43d9-a13c-c27237ee7119 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:59:32 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-c8c68107-d972-43d9-a13c-c27237ee7119 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.417s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 09:59:32 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8c68107-d972-43d9-a13c-c27237ee7119 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] <== disconnect_volume: return (420ms) None {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 09:59:32 user nova-compute[75229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c8c68107-d972-43d9-a13c-c27237ee7119 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] [instance: bc39b8e1-c8f9-4aa9-8d1b-72524b73f88c] Disconnected iSCSI Volume {{(pid=75229) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 09:59:32 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-c8c68107-d972-43d9-a13c-c27237ee7119 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] [instance: bc39b8e1-c8f9-4aa9-8d1b-72524b73f88c] Deleting instance files /opt/stack/data/nova/instances/bc39b8e1-c8f9-4aa9-8d1b-72524b73f88c_del
Nov 14 09:59:32 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-c8c68107-d972-43d9-a13c-c27237ee7119 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] [instance: bc39b8e1-c8f9-4aa9-8d1b-72524b73f88c] Deletion of /opt/stack/data/nova/instances/bc39b8e1-c8f9-4aa9-8d1b-72524b73f88c_del complete
Nov 14 09:59:32 user nova-compute[75229]: INFO nova.compute.manager [None req-c8c68107-d972-43d9-a13c-c27237ee7119 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] [instance: bc39b8e1-c8f9-4aa9-8d1b-72524b73f88c] Took 1.45 seconds to destroy the instance on the hypervisor.
Nov 14 09:59:32 user nova-compute[75229]: DEBUG oslo.service.loopingcall [None req-c8c68107-d972-43d9-a13c-c27237ee7119 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75229) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 09:59:32 user nova-compute[75229]: DEBUG nova.compute.manager [-] [instance: bc39b8e1-c8f9-4aa9-8d1b-72524b73f88c] Deallocating network for instance {{(pid=75229) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 09:59:32 user nova-compute[75229]: DEBUG nova.network.neutron [-] [instance: bc39b8e1-c8f9-4aa9-8d1b-72524b73f88c] deallocate_for_instance() {{(pid=75229) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 09:59:32 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-cdab3a16-dc2b-4688-9d9c-3ab2a08ab87c tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] Acquiring lock "9cdd6b32-d4bd-4135-a58e-fbc3b6d2a093" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:59:32 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-cdab3a16-dc2b-4688-9d9c-3ab2a08ab87c tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] Lock "9cdd6b32-d4bd-4135-a58e-fbc3b6d2a093" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:59:32 user nova-compute[75229]: INFO nova.compute.manager [None req-cdab3a16-dc2b-4688-9d9c-3ab2a08ab87c tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] [instance: 9cdd6b32-d4bd-4135-a58e-fbc3b6d2a093] Detaching volume 94a0a817-0b71-4589-90eb-8c8d159f7fd2
Nov 14 09:59:32 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:59:32 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:59:32 user nova-compute[75229]: INFO nova.virt.block_device [None req-cdab3a16-dc2b-4688-9d9c-3ab2a08ab87c tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] [instance: 9cdd6b32-d4bd-4135-a58e-fbc3b6d2a093] Attempting to driver detach volume 94a0a817-0b71-4589-90eb-8c8d159f7fd2 from mountpoint /dev/vdb
Nov 14 09:59:32 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:59:32 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-cdab3a16-dc2b-4688-9d9c-3ab2a08ab87c tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] Attempting to detach device vdb from instance 9cdd6b32-d4bd-4135-a58e-fbc3b6d2a093 from the persistent domain config. {{(pid=75229) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 09:59:32 user nova-compute[75229]: DEBUG nova.virt.libvirt.guest [None req-cdab3a16-dc2b-4688-9d9c-3ab2a08ab87c tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 09:59:32 user nova-compute[75229]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 09:59:32 user nova-compute[75229]:   <source dev="/dev/sdd"/>
Nov 14 09:59:32 user nova-compute[75229]:   <target dev="vdb" bus="virtio"/>
Nov 14 09:59:32 user nova-compute[75229]:   <serial>94a0a817-0b71-4589-90eb-8c8d159f7fd2</serial>
Nov 14 09:59:32 user nova-compute[75229]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 09:59:32 user nova-compute[75229]: </disk>
Nov 14 09:59:32 user nova-compute[75229]:  {{(pid=75229) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 09:59:32 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-cdab3a16-dc2b-4688-9d9c-3ab2a08ab87c tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] Successfully detached device vdb from instance 9cdd6b32-d4bd-4135-a58e-fbc3b6d2a093 from the persistent domain config.
Nov 14 09:59:32 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-cdab3a16-dc2b-4688-9d9c-3ab2a08ab87c tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 9cdd6b32-d4bd-4135-a58e-fbc3b6d2a093 from the live domain config. {{(pid=75229) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 09:59:32 user nova-compute[75229]: DEBUG nova.virt.libvirt.guest [None req-cdab3a16-dc2b-4688-9d9c-3ab2a08ab87c tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 09:59:32 user nova-compute[75229]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 09:59:32 user nova-compute[75229]:   <source dev="/dev/sdd"/>
Nov 14 09:59:32 user nova-compute[75229]:   <target dev="vdb" bus="virtio"/>
Nov 14 09:59:32 user nova-compute[75229]:   <serial>94a0a817-0b71-4589-90eb-8c8d159f7fd2</serial>
Nov 14 09:59:32 user nova-compute[75229]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 09:59:32 user nova-compute[75229]: </disk>
Nov 14 09:59:32 user nova-compute[75229]:  {{(pid=75229) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 09:59:32 user nova-compute[75229]: DEBUG nova.compute.manager [req-15c7b4f1-6a7f-4d0e-914e-82cec4dd1fcc req-4ff41fb9-0e87-4535-9b64-ed7b5b53e3e5 service nova] [instance: bc39b8e1-c8f9-4aa9-8d1b-72524b73f88c] Received event network-vif-unplugged-8e3a02db-6163-43cd-b8ea-e52e85e68b24 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:59:32 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-15c7b4f1-6a7f-4d0e-914e-82cec4dd1fcc req-4ff41fb9-0e87-4535-9b64-ed7b5b53e3e5 service nova] Acquiring lock "bc39b8e1-c8f9-4aa9-8d1b-72524b73f88c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:59:32 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-15c7b4f1-6a7f-4d0e-914e-82cec4dd1fcc req-4ff41fb9-0e87-4535-9b64-ed7b5b53e3e5 service nova] Lock "bc39b8e1-c8f9-4aa9-8d1b-72524b73f88c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.009s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:59:32 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-15c7b4f1-6a7f-4d0e-914e-82cec4dd1fcc req-4ff41fb9-0e87-4535-9b64-ed7b5b53e3e5 service nova] Lock "bc39b8e1-c8f9-4aa9-8d1b-72524b73f88c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:59:32 user nova-compute[75229]: DEBUG nova.compute.manager [req-15c7b4f1-6a7f-4d0e-914e-82cec4dd1fcc req-4ff41fb9-0e87-4535-9b64-ed7b5b53e3e5 service nova] [instance: bc39b8e1-c8f9-4aa9-8d1b-72524b73f88c] No waiting events found dispatching network-vif-unplugged-8e3a02db-6163-43cd-b8ea-e52e85e68b24 {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 09:59:32 user nova-compute[75229]: DEBUG nova.compute.manager [req-15c7b4f1-6a7f-4d0e-914e-82cec4dd1fcc req-4ff41fb9-0e87-4535-9b64-ed7b5b53e3e5 service nova] [instance: bc39b8e1-c8f9-4aa9-8d1b-72524b73f88c] Received event network-vif-unplugged-8e3a02db-6163-43cd-b8ea-e52e85e68b24 for instance with task_state deleting. {{(pid=75229) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 09:59:32 user nova-compute[75229]: DEBUG nova.compute.manager [req-15c7b4f1-6a7f-4d0e-914e-82cec4dd1fcc req-4ff41fb9-0e87-4535-9b64-ed7b5b53e3e5 service nova] [instance: bc39b8e1-c8f9-4aa9-8d1b-72524b73f88c] Received event network-vif-plugged-8e3a02db-6163-43cd-b8ea-e52e85e68b24 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:59:32 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-15c7b4f1-6a7f-4d0e-914e-82cec4dd1fcc req-4ff41fb9-0e87-4535-9b64-ed7b5b53e3e5 service nova] Acquiring lock "bc39b8e1-c8f9-4aa9-8d1b-72524b73f88c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:59:32 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-15c7b4f1-6a7f-4d0e-914e-82cec4dd1fcc req-4ff41fb9-0e87-4535-9b64-ed7b5b53e3e5 service nova] Lock "bc39b8e1-c8f9-4aa9-8d1b-72524b73f88c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:59:32 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-15c7b4f1-6a7f-4d0e-914e-82cec4dd1fcc req-4ff41fb9-0e87-4535-9b64-ed7b5b53e3e5 service nova] Lock "bc39b8e1-c8f9-4aa9-8d1b-72524b73f88c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:59:32 user nova-compute[75229]: DEBUG nova.compute.manager [req-15c7b4f1-6a7f-4d0e-914e-82cec4dd1fcc req-4ff41fb9-0e87-4535-9b64-ed7b5b53e3e5 service nova] [instance: bc39b8e1-c8f9-4aa9-8d1b-72524b73f88c] No waiting events found dispatching network-vif-plugged-8e3a02db-6163-43cd-b8ea-e52e85e68b24 {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 09:59:32 user nova-compute[75229]: WARNING nova.compute.manager [req-15c7b4f1-6a7f-4d0e-914e-82cec4dd1fcc req-4ff41fb9-0e87-4535-9b64-ed7b5b53e3e5 service nova] [instance: bc39b8e1-c8f9-4aa9-8d1b-72524b73f88c] Received unexpected event network-vif-plugged-8e3a02db-6163-43cd-b8ea-e52e85e68b24 for instance with vm_state active and task_state deleting.
Nov 14 09:59:32 user nova-compute[75229]: DEBUG nova.compute.manager [req-15c7b4f1-6a7f-4d0e-914e-82cec4dd1fcc req-4ff41fb9-0e87-4535-9b64-ed7b5b53e3e5 service nova] [instance: bc39b8e1-c8f9-4aa9-8d1b-72524b73f88c] Received event network-vif-plugged-8e3a02db-6163-43cd-b8ea-e52e85e68b24 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:59:32 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-15c7b4f1-6a7f-4d0e-914e-82cec4dd1fcc req-4ff41fb9-0e87-4535-9b64-ed7b5b53e3e5 service nova] Acquiring lock "bc39b8e1-c8f9-4aa9-8d1b-72524b73f88c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:59:32 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-15c7b4f1-6a7f-4d0e-914e-82cec4dd1fcc req-4ff41fb9-0e87-4535-9b64-ed7b5b53e3e5 service nova] Lock "bc39b8e1-c8f9-4aa9-8d1b-72524b73f88c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:59:32 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-15c7b4f1-6a7f-4d0e-914e-82cec4dd1fcc req-4ff41fb9-0e87-4535-9b64-ed7b5b53e3e5 service nova] Lock "bc39b8e1-c8f9-4aa9-8d1b-72524b73f88c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:59:32 user nova-compute[75229]: DEBUG nova.compute.manager [req-15c7b4f1-6a7f-4d0e-914e-82cec4dd1fcc req-4ff41fb9-0e87-4535-9b64-ed7b5b53e3e5 service nova] [instance: bc39b8e1-c8f9-4aa9-8d1b-72524b73f88c] No waiting events found dispatching network-vif-plugged-8e3a02db-6163-43cd-b8ea-e52e85e68b24 {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 09:59:32 user nova-compute[75229]: WARNING nova.compute.manager [req-15c7b4f1-6a7f-4d0e-914e-82cec4dd1fcc req-4ff41fb9-0e87-4535-9b64-ed7b5b53e3e5 service nova] [instance: bc39b8e1-c8f9-4aa9-8d1b-72524b73f88c] Received unexpected event network-vif-plugged-8e3a02db-6163-43cd-b8ea-e52e85e68b24 for instance with vm_state active and task_state deleting.
Nov 14 09:59:32 user nova-compute[75229]: DEBUG nova.compute.manager [req-15c7b4f1-6a7f-4d0e-914e-82cec4dd1fcc req-4ff41fb9-0e87-4535-9b64-ed7b5b53e3e5 service nova] [instance: bc39b8e1-c8f9-4aa9-8d1b-72524b73f88c] Received event network-vif-plugged-8e3a02db-6163-43cd-b8ea-e52e85e68b24 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:59:32 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-15c7b4f1-6a7f-4d0e-914e-82cec4dd1fcc req-4ff41fb9-0e87-4535-9b64-ed7b5b53e3e5 service nova] Acquiring lock "bc39b8e1-c8f9-4aa9-8d1b-72524b73f88c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:59:32 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-15c7b4f1-6a7f-4d0e-914e-82cec4dd1fcc req-4ff41fb9-0e87-4535-9b64-ed7b5b53e3e5 service nova] Lock "bc39b8e1-c8f9-4aa9-8d1b-72524b73f88c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:59:32 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-15c7b4f1-6a7f-4d0e-914e-82cec4dd1fcc req-4ff41fb9-0e87-4535-9b64-ed7b5b53e3e5 service nova] Lock "bc39b8e1-c8f9-4aa9-8d1b-72524b73f88c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:59:32 user nova-compute[75229]: DEBUG nova.compute.manager [req-15c7b4f1-6a7f-4d0e-914e-82cec4dd1fcc req-4ff41fb9-0e87-4535-9b64-ed7b5b53e3e5 service nova] [instance: bc39b8e1-c8f9-4aa9-8d1b-72524b73f88c] No waiting events found dispatching network-vif-plugged-8e3a02db-6163-43cd-b8ea-e52e85e68b24 {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 09:59:32 user nova-compute[75229]: WARNING nova.compute.manager [req-15c7b4f1-6a7f-4d0e-914e-82cec4dd1fcc req-4ff41fb9-0e87-4535-9b64-ed7b5b53e3e5 service nova] [instance: bc39b8e1-c8f9-4aa9-8d1b-72524b73f88c] Received unexpected event network-vif-plugged-8e3a02db-6163-43cd-b8ea-e52e85e68b24 for instance with vm_state active and task_state deleting.
Nov 14 09:59:32 user nova-compute[75229]: DEBUG nova.compute.manager [req-15c7b4f1-6a7f-4d0e-914e-82cec4dd1fcc req-4ff41fb9-0e87-4535-9b64-ed7b5b53e3e5 service nova] [instance: bc39b8e1-c8f9-4aa9-8d1b-72524b73f88c] Received event network-vif-unplugged-8e3a02db-6163-43cd-b8ea-e52e85e68b24 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:59:32 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-15c7b4f1-6a7f-4d0e-914e-82cec4dd1fcc req-4ff41fb9-0e87-4535-9b64-ed7b5b53e3e5 service nova] Acquiring lock "bc39b8e1-c8f9-4aa9-8d1b-72524b73f88c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:59:32 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-15c7b4f1-6a7f-4d0e-914e-82cec4dd1fcc req-4ff41fb9-0e87-4535-9b64-ed7b5b53e3e5 service nova] Lock "bc39b8e1-c8f9-4aa9-8d1b-72524b73f88c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:59:32 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-15c7b4f1-6a7f-4d0e-914e-82cec4dd1fcc req-4ff41fb9-0e87-4535-9b64-ed7b5b53e3e5 service nova] Lock "bc39b8e1-c8f9-4aa9-8d1b-72524b73f88c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:59:32 user nova-compute[75229]: DEBUG nova.compute.manager [req-15c7b4f1-6a7f-4d0e-914e-82cec4dd1fcc req-4ff41fb9-0e87-4535-9b64-ed7b5b53e3e5 service nova] [instance: bc39b8e1-c8f9-4aa9-8d1b-72524b73f88c] No waiting events found dispatching network-vif-unplugged-8e3a02db-6163-43cd-b8ea-e52e85e68b24 {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 09:59:32 user nova-compute[75229]: DEBUG nova.compute.manager [req-15c7b4f1-6a7f-4d0e-914e-82cec4dd1fcc req-4ff41fb9-0e87-4535-9b64-ed7b5b53e3e5 service nova] [instance: bc39b8e1-c8f9-4aa9-8d1b-72524b73f88c] Received event network-vif-unplugged-8e3a02db-6163-43cd-b8ea-e52e85e68b24 for instance with task_state deleting. {{(pid=75229) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 09:59:32 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:59:32 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:59:32 user nova-compute[75229]: DEBUG nova.network.neutron [req-8b5a5ab5-45ae-4df4-bdb2-78f1bd6ec8d8 req-06d145ac-2373-42d3-90f4-44b715628393 service nova] [instance: 9cdd6b32-d4bd-4135-a58e-fbc3b6d2a093] Updated VIF entry in instance network info cache for port 5b06ed49-fa0b-4b58-ad6e-a092a9c1d14c. {{(pid=75229) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 09:59:32 user nova-compute[75229]: DEBUG nova.network.neutron [req-8b5a5ab5-45ae-4df4-bdb2-78f1bd6ec8d8 req-06d145ac-2373-42d3-90f4-44b715628393 service nova] [instance: 9cdd6b32-d4bd-4135-a58e-fbc3b6d2a093] Updating instance_info_cache with network_info: [{"id": "5b06ed49-fa0b-4b58-ad6e-a092a9c1d14c", "address": "fa:16:3e:f8:75:16", "network": {"id": "1687d918-9f70-4099-b44c-97f92f90e6ff", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2074208460-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a6157b9827b44d2bab197220b635fd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b06ed49-fa", "ovs_interfaceid": "5b06ed49-fa0b-4b58-ad6e-a092a9c1d14c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 09:59:32 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-8b5a5ab5-45ae-4df4-bdb2-78f1bd6ec8d8 req-06d145ac-2373-42d3-90f4-44b715628393 service nova] Releasing lock "refresh_cache-9cdd6b32-d4bd-4135-a58e-fbc3b6d2a093" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 09:59:32 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-cdab3a16-dc2b-4688-9d9c-3ab2a08ab87c tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 9cdd6b32-d4bd-4135-a58e-fbc3b6d2a093 {{(pid=75229) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 09:59:33 user nova-compute[75229]: DEBUG nova.network.neutron [-] [instance: bc39b8e1-c8f9-4aa9-8d1b-72524b73f88c] Updating instance_info_cache with network_info: [] {{(pid=75229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 09:59:33 user nova-compute[75229]: INFO nova.compute.manager [-] [instance: bc39b8e1-c8f9-4aa9-8d1b-72524b73f88c] Took 0.82 seconds to deallocate network for instance.
Nov 14 09:59:33 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:59:33 user nova-compute[75229]: INFO nova.compute.manager [None req-c8c68107-d972-43d9-a13c-c27237ee7119 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] [instance: bc39b8e1-c8f9-4aa9-8d1b-72524b73f88c] Took 0.79 seconds to detach 1 volumes for instance.
Nov 14 09:59:33 user nova-compute[75229]: DEBUG nova.compute.manager [None req-c8c68107-d972-43d9-a13c-c27237ee7119 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] [instance: bc39b8e1-c8f9-4aa9-8d1b-72524b73f88c] Deleting volume: 4562974d-4587-4774-adb3-21a623f466c2 {{(pid=75229) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 14 09:59:34 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-c8c68107-d972-43d9-a13c-c27237ee7119 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:59:34 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-c8c68107-d972-43d9-a13c-c27237ee7119 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:59:34 user nova-compute[75229]: DEBUG nova.compute.provider_tree [None req-c8c68107-d972-43d9-a13c-c27237ee7119 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Inventory has not changed in ProviderTree for provider: d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 {{(pid=75229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 09:59:34 user nova-compute[75229]: DEBUG nova.scheduler.client.report [None req-c8c68107-d972-43d9-a13c-c27237ee7119 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Inventory has not changed for provider d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 09:59:34 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-c8c68107-d972-43d9-a13c-c27237ee7119 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.326s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:59:34 user nova-compute[75229]: INFO nova.scheduler.client.report [None req-c8c68107-d972-43d9-a13c-c27237ee7119 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Deleted allocations for instance bc39b8e1-c8f9-4aa9-8d1b-72524b73f88c
Nov 14 09:59:34 user nova-compute[75229]: DEBUG nova.compute.manager [req-8069a63c-a3ff-442f-aa4b-00bca177e5d7 req-09be37f2-a7de-4ca7-af42-f5b937bc2194 service nova] [instance: bc39b8e1-c8f9-4aa9-8d1b-72524b73f88c] Received event network-vif-plugged-8e3a02db-6163-43cd-b8ea-e52e85e68b24 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:59:34 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-8069a63c-a3ff-442f-aa4b-00bca177e5d7 req-09be37f2-a7de-4ca7-af42-f5b937bc2194 service nova] Acquiring lock "bc39b8e1-c8f9-4aa9-8d1b-72524b73f88c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:59:34 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-8069a63c-a3ff-442f-aa4b-00bca177e5d7 req-09be37f2-a7de-4ca7-af42-f5b937bc2194 service nova] Lock "bc39b8e1-c8f9-4aa9-8d1b-72524b73f88c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:59:34 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-8069a63c-a3ff-442f-aa4b-00bca177e5d7 req-09be37f2-a7de-4ca7-af42-f5b937bc2194 service nova] Lock "bc39b8e1-c8f9-4aa9-8d1b-72524b73f88c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:59:34 user nova-compute[75229]: DEBUG nova.compute.manager [req-8069a63c-a3ff-442f-aa4b-00bca177e5d7 req-09be37f2-a7de-4ca7-af42-f5b937bc2194 service nova] [instance: bc39b8e1-c8f9-4aa9-8d1b-72524b73f88c] No waiting events found dispatching network-vif-plugged-8e3a02db-6163-43cd-b8ea-e52e85e68b24 {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 09:59:34 user nova-compute[75229]: WARNING nova.compute.manager [req-8069a63c-a3ff-442f-aa4b-00bca177e5d7 req-09be37f2-a7de-4ca7-af42-f5b937bc2194 service nova] [instance: bc39b8e1-c8f9-4aa9-8d1b-72524b73f88c] Received unexpected event network-vif-plugged-8e3a02db-6163-43cd-b8ea-e52e85e68b24 for instance with vm_state deleted and task_state None.
Nov 14 09:59:34 user nova-compute[75229]: DEBUG nova.compute.manager [req-8069a63c-a3ff-442f-aa4b-00bca177e5d7 req-09be37f2-a7de-4ca7-af42-f5b937bc2194 service nova] [instance: bc39b8e1-c8f9-4aa9-8d1b-72524b73f88c] Received event network-vif-deleted-8e3a02db-6163-43cd-b8ea-e52e85e68b24 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:59:34 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-c8c68107-d972-43d9-a13c-c27237ee7119 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Lock "bc39b8e1-c8f9-4aa9-8d1b-72524b73f88c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.717s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:59:34 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-0989740a-4ef6-4746-8979-46f280bbdab1 tempest-ServersNegativeTestJSON-1483105767 tempest-ServersNegativeTestJSON-1483105767-project-member] Acquiring lock "e58500df-059a-4fce-afb7-ba36feca0697" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:59:34 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-0989740a-4ef6-4746-8979-46f280bbdab1 tempest-ServersNegativeTestJSON-1483105767 tempest-ServersNegativeTestJSON-1483105767-project-member] Lock "e58500df-059a-4fce-afb7-ba36feca0697" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:59:34 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-0989740a-4ef6-4746-8979-46f280bbdab1 tempest-ServersNegativeTestJSON-1483105767 tempest-ServersNegativeTestJSON-1483105767-project-member] Acquiring lock "e58500df-059a-4fce-afb7-ba36feca0697-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:59:34 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-0989740a-4ef6-4746-8979-46f280bbdab1 tempest-ServersNegativeTestJSON-1483105767 tempest-ServersNegativeTestJSON-1483105767-project-member] Lock "e58500df-059a-4fce-afb7-ba36feca0697-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:59:34 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-0989740a-4ef6-4746-8979-46f280bbdab1 tempest-ServersNegativeTestJSON-1483105767 tempest-ServersNegativeTestJSON-1483105767-project-member] Lock "e58500df-059a-4fce-afb7-ba36feca0697-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:59:34 user nova-compute[75229]: INFO nova.compute.manager [None req-0989740a-4ef6-4746-8979-46f280bbdab1 tempest-ServersNegativeTestJSON-1483105767 tempest-ServersNegativeTestJSON-1483105767-project-member] [instance: e58500df-059a-4fce-afb7-ba36feca0697] Terminating instance
Nov 14 09:59:34 user nova-compute[75229]: DEBUG nova.compute.manager [None req-0989740a-4ef6-4746-8979-46f280bbdab1 tempest-ServersNegativeTestJSON-1483105767 tempest-ServersNegativeTestJSON-1483105767-project-member] [instance: e58500df-059a-4fce-afb7-ba36feca0697] Start destroying the instance on the hypervisor. {{(pid=75229) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 09:59:34 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:59:34 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:59:34 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:59:34 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:59:35 user nova-compute[75229]: INFO nova.virt.libvirt.driver [-] [instance: e58500df-059a-4fce-afb7-ba36feca0697] Instance destroyed successfully.
Nov 14 09:59:35 user nova-compute[75229]: DEBUG nova.objects.instance [None req-0989740a-4ef6-4746-8979-46f280bbdab1 tempest-ServersNegativeTestJSON-1483105767 tempest-ServersNegativeTestJSON-1483105767-project-member] Lazy-loading 'resources' on Instance uuid e58500df-059a-4fce-afb7-ba36feca0697 {{(pid=75229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 09:59:35 user nova-compute[75229]: DEBUG nova.virt.libvirt.vif [None req-0989740a-4ef6-4746-8979-46f280bbdab1 tempest-ServersNegativeTestJSON-1483105767 tempest-ServersNegativeTestJSON-1483105767-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T09:50:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1811166071',display_name='tempest-ServersNegativeTestJSON-server-1811166071',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1811166071',id=23,image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-14T09:51:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='133a5fa644c24636bd2b334d7b95e4c3',ramdisk_id='',reservation_id='r-0c6lypls',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-1483105767',owner_user_name='tempest-ServersNegativeTestJSON-1483105767-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T09:51:03Z,user_data=None,user_id='a479b16af2894f6388c73aaaa744ec6b',uuid=e58500df-059a-4fce-afb7-ba36feca0697,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "50ef44e5-e0bb-4def-9be3-2d528985d37c", "address": "fa:16:3e:5d:6e:2c", "network": {"id": "b841fceb-4765-4e8e-b800-8651dcb1d867", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1867189200-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "133a5fa644c24636bd2b334d7b95e4c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50ef44e5-e0", "ovs_interfaceid": "50ef44e5-e0bb-4def-9be3-2d528985d37c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 09:59:35 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-0989740a-4ef6-4746-8979-46f280bbdab1 tempest-ServersNegativeTestJSON-1483105767 tempest-ServersNegativeTestJSON-1483105767-project-member] Converting VIF {"id": "50ef44e5-e0bb-4def-9be3-2d528985d37c", "address": "fa:16:3e:5d:6e:2c", "network": {"id": "b841fceb-4765-4e8e-b800-8651dcb1d867", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1867189200-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "133a5fa644c24636bd2b334d7b95e4c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50ef44e5-e0", "ovs_interfaceid": "50ef44e5-e0bb-4def-9be3-2d528985d37c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 09:59:35 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-0989740a-4ef6-4746-8979-46f280bbdab1 tempest-ServersNegativeTestJSON-1483105767 tempest-ServersNegativeTestJSON-1483105767-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5d:6e:2c,bridge_name='br-int',has_traffic_filtering=True,id=50ef44e5-e0bb-4def-9be3-2d528985d37c,network=Network(b841fceb-4765-4e8e-b800-8651dcb1d867),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50ef44e5-e0') {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 09:59:35 user nova-compute[75229]: DEBUG os_vif [None req-0989740a-4ef6-4746-8979-46f280bbdab1 tempest-ServersNegativeTestJSON-1483105767 tempest-ServersNegativeTestJSON-1483105767-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5d:6e:2c,bridge_name='br-int',has_traffic_filtering=True,id=50ef44e5-e0bb-4def-9be3-2d528985d37c,network=Network(b841fceb-4765-4e8e-b800-8651dcb1d867),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50ef44e5-e0') {{(pid=75229) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 09:59:35 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:59:35 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap50ef44e5-e0, bridge=br-int, if_exists=True) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:59:35 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:59:35 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 09:59:35 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:59:35 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=62bfc0f4-2232-4502-8b82-c89a94f876c1) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:59:35 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:59:35 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:59:35 user nova-compute[75229]: INFO os_vif [None req-0989740a-4ef6-4746-8979-46f280bbdab1 tempest-ServersNegativeTestJSON-1483105767 tempest-ServersNegativeTestJSON-1483105767-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5d:6e:2c,bridge_name='br-int',has_traffic_filtering=True,id=50ef44e5-e0bb-4def-9be3-2d528985d37c,network=Network(b841fceb-4765-4e8e-b800-8651dcb1d867),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50ef44e5-e0')
Nov 14 09:59:35 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-0989740a-4ef6-4746-8979-46f280bbdab1 tempest-ServersNegativeTestJSON-1483105767 tempest-ServersNegativeTestJSON-1483105767-project-member] [instance: e58500df-059a-4fce-afb7-ba36feca0697] Deleting instance files /opt/stack/data/nova/instances/e58500df-059a-4fce-afb7-ba36feca0697_del
Nov 14 09:59:35 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-0989740a-4ef6-4746-8979-46f280bbdab1 tempest-ServersNegativeTestJSON-1483105767 tempest-ServersNegativeTestJSON-1483105767-project-member] [instance: e58500df-059a-4fce-afb7-ba36feca0697] Deletion of /opt/stack/data/nova/instances/e58500df-059a-4fce-afb7-ba36feca0697_del complete
Nov 14 09:59:35 user nova-compute[75229]: INFO nova.compute.manager [None req-0989740a-4ef6-4746-8979-46f280bbdab1 tempest-ServersNegativeTestJSON-1483105767 tempest-ServersNegativeTestJSON-1483105767-project-member] [instance: e58500df-059a-4fce-afb7-ba36feca0697] Took 0.73 seconds to destroy the instance on the hypervisor.
Nov 14 09:59:35 user nova-compute[75229]: DEBUG oslo.service.loopingcall [None req-0989740a-4ef6-4746-8979-46f280bbdab1 tempest-ServersNegativeTestJSON-1483105767 tempest-ServersNegativeTestJSON-1483105767-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75229) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 09:59:35 user nova-compute[75229]: DEBUG nova.compute.manager [-] [instance: e58500df-059a-4fce-afb7-ba36feca0697] Deallocating network for instance {{(pid=75229) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 09:59:35 user nova-compute[75229]: DEBUG nova.network.neutron [-] [instance: e58500df-059a-4fce-afb7-ba36feca0697] deallocate_for_instance() {{(pid=75229) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 09:59:35 user nova-compute[75229]: DEBUG nova.network.neutron [-] [instance: e58500df-059a-4fce-afb7-ba36feca0697] Updating instance_info_cache with network_info: [] {{(pid=75229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 09:59:35 user nova-compute[75229]: INFO nova.compute.manager [-] [instance: e58500df-059a-4fce-afb7-ba36feca0697] Took 0.47 seconds to deallocate network for instance.
Nov 14 09:59:35 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-0989740a-4ef6-4746-8979-46f280bbdab1 tempest-ServersNegativeTestJSON-1483105767 tempest-ServersNegativeTestJSON-1483105767-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:59:35 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-0989740a-4ef6-4746-8979-46f280bbdab1 tempest-ServersNegativeTestJSON-1483105767 tempest-ServersNegativeTestJSON-1483105767-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:59:36 user nova-compute[75229]: DEBUG nova.compute.provider_tree [None req-0989740a-4ef6-4746-8979-46f280bbdab1 tempest-ServersNegativeTestJSON-1483105767 tempest-ServersNegativeTestJSON-1483105767-project-member] Inventory has not changed in ProviderTree for provider: d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 {{(pid=75229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 09:59:36 user nova-compute[75229]: DEBUG nova.scheduler.client.report [None req-0989740a-4ef6-4746-8979-46f280bbdab1 tempest-ServersNegativeTestJSON-1483105767 tempest-ServersNegativeTestJSON-1483105767-project-member] Inventory has not changed for provider d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 09:59:36 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-0989740a-4ef6-4746-8979-46f280bbdab1 tempest-ServersNegativeTestJSON-1483105767 tempest-ServersNegativeTestJSON-1483105767-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.298s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:59:36 user nova-compute[75229]: INFO nova.scheduler.client.report [None req-0989740a-4ef6-4746-8979-46f280bbdab1 tempest-ServersNegativeTestJSON-1483105767 tempest-ServersNegativeTestJSON-1483105767-project-member] Deleted allocations for instance e58500df-059a-4fce-afb7-ba36feca0697
Nov 14 09:59:36 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-0989740a-4ef6-4746-8979-46f280bbdab1 tempest-ServersNegativeTestJSON-1483105767 tempest-ServersNegativeTestJSON-1483105767-project-member] Lock "e58500df-059a-4fce-afb7-ba36feca0697" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.691s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:59:36 user nova-compute[75229]: DEBUG nova.compute.manager [req-2b13d590-d129-46b9-bdb8-c6ef914023e6 req-e0a02030-7779-433c-9a65-24d48437b607 service nova] [instance: e58500df-059a-4fce-afb7-ba36feca0697] Received event network-vif-unplugged-50ef44e5-e0bb-4def-9be3-2d528985d37c {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:59:36 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-2b13d590-d129-46b9-bdb8-c6ef914023e6 req-e0a02030-7779-433c-9a65-24d48437b607 service nova] Acquiring lock "e58500df-059a-4fce-afb7-ba36feca0697-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:59:36 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-2b13d590-d129-46b9-bdb8-c6ef914023e6 req-e0a02030-7779-433c-9a65-24d48437b607 service nova] Lock "e58500df-059a-4fce-afb7-ba36feca0697-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:59:36 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-2b13d590-d129-46b9-bdb8-c6ef914023e6 req-e0a02030-7779-433c-9a65-24d48437b607 service nova] Lock "e58500df-059a-4fce-afb7-ba36feca0697-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:59:36 user nova-compute[75229]: DEBUG nova.compute.manager [req-2b13d590-d129-46b9-bdb8-c6ef914023e6 req-e0a02030-7779-433c-9a65-24d48437b607 service nova] [instance: e58500df-059a-4fce-afb7-ba36feca0697] No waiting events found dispatching network-vif-unplugged-50ef44e5-e0bb-4def-9be3-2d528985d37c {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 09:59:36 user nova-compute[75229]: WARNING nova.compute.manager [req-2b13d590-d129-46b9-bdb8-c6ef914023e6 req-e0a02030-7779-433c-9a65-24d48437b607 service nova] [instance: e58500df-059a-4fce-afb7-ba36feca0697] Received unexpected event network-vif-unplugged-50ef44e5-e0bb-4def-9be3-2d528985d37c for instance with vm_state deleted and task_state None.
Nov 14 09:59:36 user nova-compute[75229]: DEBUG nova.compute.manager [req-2b13d590-d129-46b9-bdb8-c6ef914023e6 req-e0a02030-7779-433c-9a65-24d48437b607 service nova] [instance: e58500df-059a-4fce-afb7-ba36feca0697] Received event network-vif-plugged-50ef44e5-e0bb-4def-9be3-2d528985d37c {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:59:36 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-2b13d590-d129-46b9-bdb8-c6ef914023e6 req-e0a02030-7779-433c-9a65-24d48437b607 service nova] Acquiring lock "e58500df-059a-4fce-afb7-ba36feca0697-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:59:36 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-2b13d590-d129-46b9-bdb8-c6ef914023e6 req-e0a02030-7779-433c-9a65-24d48437b607 service nova] Lock "e58500df-059a-4fce-afb7-ba36feca0697-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:59:36 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-2b13d590-d129-46b9-bdb8-c6ef914023e6 req-e0a02030-7779-433c-9a65-24d48437b607 service nova] Lock "e58500df-059a-4fce-afb7-ba36feca0697-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:59:36 user nova-compute[75229]: DEBUG nova.compute.manager [req-2b13d590-d129-46b9-bdb8-c6ef914023e6 req-e0a02030-7779-433c-9a65-24d48437b607 service nova] [instance: e58500df-059a-4fce-afb7-ba36feca0697] No waiting events found dispatching network-vif-plugged-50ef44e5-e0bb-4def-9be3-2d528985d37c {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 09:59:36 user nova-compute[75229]: WARNING nova.compute.manager [req-2b13d590-d129-46b9-bdb8-c6ef914023e6 req-e0a02030-7779-433c-9a65-24d48437b607 service nova] [instance: e58500df-059a-4fce-afb7-ba36feca0697] Received unexpected event network-vif-plugged-50ef44e5-e0bb-4def-9be3-2d528985d37c for instance with vm_state deleted and task_state None.
Nov 14 09:59:36 user nova-compute[75229]: DEBUG nova.compute.manager [req-2b13d590-d129-46b9-bdb8-c6ef914023e6 req-e0a02030-7779-433c-9a65-24d48437b607 service nova] [instance: e58500df-059a-4fce-afb7-ba36feca0697] Received event network-vif-deleted-50ef44e5-e0bb-4def-9be3-2d528985d37c {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:59:40 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:59:43 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:59:45 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:59:48 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:59:50 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:59:50 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 09:59:52 user nova-compute[75229]: WARNING nova.virt.libvirt.driver [None req-cdab3a16-dc2b-4688-9d9c-3ab2a08ab87c tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 9cdd6b32-d4bd-4135-a58e-fbc3b6d2a093 is timed out.
Nov 14 09:59:52 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-cdab3a16-dc2b-4688-9d9c-3ab2a08ab87c tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] Successfully detached device vdb from instance 9cdd6b32-d4bd-4135-a58e-fbc3b6d2a093 from the live domain config.
Nov 14 09:59:52 user nova-compute[75229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cdab3a16-dc2b-4688-9d9c-3ab2a08ab87c tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] [instance: 9cdd6b32-d4bd-4135-a58e-fbc3b6d2a093] calling os-brick to detach iSCSI Volume {{(pid=75229) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 09:59:52 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdab3a16-dc2b-4688-9d9c-3ab2a08ab87c tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f73f85151b0>, {'target_iqn': 'iqn.2010-10.org.openstack:94a0a817-0b71-4589-90eb-8c8d159f7fd2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ivMLsape', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 09:59:52 user nova-compute[75229]: WARNING os_brick.initiator.connectors.base [None req-cdab3a16-dc2b-4688-9d9c-3ab2a08ab87c tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 09:59:52 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-cdab3a16-dc2b-4688-9d9c-3ab2a08ab87c tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 09:59:52 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-cdab3a16-dc2b-4688-9d9c-3ab2a08ab87c tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 09:59:52 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:59:52 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:59:52 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c4bb06e-4743-4baa-aa9a-3e1934f9a82b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:94a0a817-0b71-4589-90eb-8c8d159f7fd2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a5efb0e0-a85c-46ec-8a9d-2763bf548023\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:143891e8-62eb-42d7-b076-db6f52b4f606\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5aebc438-0289-44fe-ad84-4e696468f50e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:59:52 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdab3a16-dc2b-4688-9d9c-3ab2a08ab87c tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 09:59:52 user nova-compute[75229]: No targets found.
Nov 14 09:59:52 user nova-compute[75229]: iSNS:
Nov 14 09:59:52 user nova-compute[75229]: No targets found.
Nov 14 09:59:52 user nova-compute[75229]: STATIC:
Nov 14 09:59:52 user nova-compute[75229]: Target: iqn.2010-10.org.openstack:94a0a817-0b71-4589-90eb-8c8d159f7fd2
Nov 14 09:59:52 user nova-compute[75229]:         Portal: 172.16.0.220:3260,-1
Nov 14 09:59:52 user nova-compute[75229]:                 Iface Name: default
Nov 14 09:59:52 user nova-compute[75229]: Target: iqn.2010-10.org.openstack:a5efb0e0-a85c-46ec-8a9d-2763bf548023
Nov 14 09:59:52 user nova-compute[75229]:         Portal: 172.16.0.220:3260,-1
Nov 14 09:59:52 user nova-compute[75229]:                 Iface Name: default
Nov 14 09:59:52 user nova-compute[75229]: Target: iqn.2010-10.org.openstack:143891e8-62eb-42d7-b076-db6f52b4f606
Nov 14 09:59:52 user nova-compute[75229]:         Portal: 172.16.0.220:3260,-1
Nov 14 09:59:52 user nova-compute[75229]:                 Iface Name: default
Nov 14 09:59:52 user nova-compute[75229]: Target: iqn.2010-10.org.openstack:5aebc438-0289-44fe-ad84-4e696468f50e
Nov 14 09:59:52 user nova-compute[75229]:         Portal: 172.16.0.220:3260,-1
Nov 14 09:59:52 user nova-compute[75229]:                 Iface Name: default
Nov 14 09:59:52 user nova-compute[75229]: FIRMWARE:
Nov 14 09:59:52 user nova-compute[75229]: No targets found.
Nov 14 09:59:52 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 09:59:52 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdab3a16-dc2b-4688-9d9c-3ab2a08ab87c tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 09:59:52 user nova-compute[75229]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 09:59:52 user nova-compute[75229]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75229) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 09:59:52 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdab3a16-dc2b-4688-9d9c-3ab2a08ab87c tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:94a0a817-0b71-4589-90eb-8c8d159f7fd2', 0)] {{(pid=75229) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 09:59:52 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:59:52 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:59:52 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[502ae28b-12db-4121-ad9f-88492e81da70]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:143891e8-62eb-42d7-b076-db6f52b4f606\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5aebc438-0289-44fe-ad84-4e696468f50e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:94a0a817-0b71-4589-90eb-8c8d159f7fd2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a5efb0e0-a85c-46ec-8a9d-2763bf548023\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:59:52 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:59:52 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:59:52 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b90b9a3-fe41-4e0a-afcb-ededb6279618]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aebc438-0289-44fe-ad84-4e696468f50e (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5efb0e0-a85c-46ec-8a9d-2763bf548023 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94a0a817-0b71-4589-90eb-8c8d159f7fd2 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:143891e8-62eb-42d7-b076-db6f52b4f606 (non-flash)\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:59:52 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdab3a16-dc2b-4688-9d9c-3ab2a08ab87c tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aebc438-0289-44fe-ad84-4e696468f50e (non-flash)
Nov 14 09:59:52 user nova-compute[75229]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5efb0e0-a85c-46ec-8a9d-2763bf548023 (non-flash)
Nov 14 09:59:52 user nova-compute[75229]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94a0a817-0b71-4589-90eb-8c8d159f7fd2 (non-flash)
Nov 14 09:59:52 user nova-compute[75229]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:143891e8-62eb-42d7-b076-db6f52b4f606 (non-flash)
Nov 14 09:59:52 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 09:59:52 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdab3a16-dc2b-4688-9d9c-3ab2a08ab87c tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aebc438-0289-44fe-ad84-4e696468f50e (non-flash)
Nov 14 09:59:52 user nova-compute[75229]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5efb0e0-a85c-46ec-8a9d-2763bf548023 (non-flash)
Nov 14 09:59:52 user nova-compute[75229]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94a0a817-0b71-4589-90eb-8c8d159f7fd2 (non-flash)
Nov 14 09:59:52 user nova-compute[75229]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:143891e8-62eb-42d7-b076-db6f52b4f606 (non-flash)
Nov 14 09:59:52 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 09:59:52 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdab3a16-dc2b-4688-9d9c-3ab2a08ab87c tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f73d4f5d1b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:94a0a817-0b71-4589-90eb-8c8d159f7fd2'): ({'sdd'}, set())}) {{(pid=75229) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 09:59:52 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-cdab3a16-dc2b-4688-9d9c-3ab2a08ab87c tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] Removing single pathed devices sdd {{(pid=75229) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 09:59:52 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:59:53 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:59:53 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[660961ec-64e3-446f-b59b-999b5b06138c]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:59:53 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:59:53 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.024s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:59:53 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[8924d765-3001-4cd1-88d7-a2628bc10356]: (4, ('ok\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:59:53 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-cdab3a16-dc2b-4688-9d9c-3ab2a08ab87c tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] Flushing IO for device /dev/sdd {{(pid=75229) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 09:59:53 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:59:53 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:59:53 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[4eafad81-e1bf-4479-bc73-634fa3c52299]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:59:53 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-cdab3a16-dc2b-4688-9d9c-3ab2a08ab87c tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75229) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 09:59:53 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:59:53 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.046s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:59:53 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e350751-b7aa-447d-b363-9cfabf2589ec]: (4, ('1', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:59:53 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-cdab3a16-dc2b-4688-9d9c-3ab2a08ab87c tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75229) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 09:59:53 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-cdab3a16-dc2b-4688-9d9c-3ab2a08ab87c tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] SCSI volumes sdd have been removed. {{(pid=75229) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 09:59:53 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdab3a16-dc2b-4688-9d9c-3ab2a08ab87c tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:94a0a817-0b71-4589-90eb-8c8d159f7fd2')] {{(pid=75229) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 09:59:53 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94a0a817-0b71-4589-90eb-8c8d159f7fd2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:59:53 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94a0a817-0b71-4589-90eb-8c8d159f7fd2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:59:53 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f62117d-87bf-4158-ae5d-c20b47a611e1]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:59:53 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdab3a16-dc2b-4688-9d9c-3ab2a08ab87c tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:59:53 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94a0a817-0b71-4589-90eb-8c8d159f7fd2 -p 172.16.0.220:3260 --logout {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:59:53 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94a0a817-0b71-4589-90eb-8c8d159f7fd2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:59:53 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[43d23dda-7d52-45f2-9e94-42e764af6499]: (4, ('Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:94a0a817-0b71-4589-90eb-8c8d159f7fd2, portal: 172.16.0.220,3260]\nLogout of [sid: 36, target: iqn.2010-10.org.openstack:94a0a817-0b71-4589-90eb-8c8d159f7fd2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:59:53 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdab3a16-dc2b-4688-9d9c-3ab2a08ab87c tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:94a0a817-0b71-4589-90eb-8c8d159f7fd2, portal: 172.16.0.220,3260]
Nov 14 09:59:53 user nova-compute[75229]: Logout of [sid: 36, target: iqn.2010-10.org.openstack:94a0a817-0b71-4589-90eb-8c8d159f7fd2, portal: 172.16.0.220,3260] successful.
Nov 14 09:59:53 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:59:53 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94a0a817-0b71-4589-90eb-8c8d159f7fd2 -p 172.16.0.220:3260 --op delete {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:59:53 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94a0a817-0b71-4589-90eb-8c8d159f7fd2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:59:53 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[820481bf-cf32-4214-82c3-43154219f0d6]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:59:53 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdab3a16-dc2b-4688-9d9c-3ab2a08ab87c tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:59:53 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-cdab3a16-dc2b-4688-9d9c-3ab2a08ab87c tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.328s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 09:59:53 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdab3a16-dc2b-4688-9d9c-3ab2a08ab87c tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] <== disconnect_volume: return (329ms) None {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 09:59:53 user nova-compute[75229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cdab3a16-dc2b-4688-9d9c-3ab2a08ab87c tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] [instance: 9cdd6b32-d4bd-4135-a58e-fbc3b6d2a093] Disconnected iSCSI Volume {{(pid=75229) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 09:59:53 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:59:53 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 09:59:53 user nova-compute[75229]: DEBUG nova.compute.manager [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Cleaning up deleted instances {{(pid=75229) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 14 09:59:53 user nova-compute[75229]: DEBUG nova.compute.manager [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] There are 0 instances to clean {{(pid=75229) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 14 09:59:54 user nova-compute[75229]: DEBUG nova.objects.instance [None req-cdab3a16-dc2b-4688-9d9c-3ab2a08ab87c tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] Lazy-loading 'flavor' on Instance uuid 9cdd6b32-d4bd-4135-a58e-fbc3b6d2a093 {{(pid=75229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 09:59:54 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-cdab3a16-dc2b-4688-9d9c-3ab2a08ab87c tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] Lock "9cdd6b32-d4bd-4135-a58e-fbc3b6d2a093" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.929s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:59:54 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 09:59:54 user nova-compute[75229]: DEBUG nova.compute.manager [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Starting heal instance info cache {{(pid=75229) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 09:59:54 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Acquiring lock "refresh_cache-b5170e9e-66e3-4df1-9807-4958cac6480e" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 09:59:54 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Acquired lock "refresh_cache-b5170e9e-66e3-4df1-9807-4958cac6480e" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 09:59:54 user nova-compute[75229]: DEBUG nova.network.neutron [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] [instance: b5170e9e-66e3-4df1-9807-4958cac6480e] Forcefully refreshing network info cache for instance {{(pid=75229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 09:59:55 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:59:55 user nova-compute[75229]: DEBUG nova.network.neutron [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] [instance: b5170e9e-66e3-4df1-9807-4958cac6480e] Updating instance_info_cache with network_info: [{"id": "bed3fc1c-227e-44d2-85e1-589501a2e9dc", "address": "fa:16:3e:26:85:42", "network": {"id": "22eed29e-7148-42f9-b4c7-b97811cba8eb", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2000485731-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46457b27e3ed416e827c3c22449fb512", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbed3fc1c-22", "ovs_interfaceid": "bed3fc1c-227e-44d2-85e1-589501a2e9dc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 09:59:55 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Releasing lock "refresh_cache-b5170e9e-66e3-4df1-9807-4958cac6480e" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 09:59:55 user nova-compute[75229]: DEBUG nova.compute.manager [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] [instance: b5170e9e-66e3-4df1-9807-4958cac6480e] Updated the network info_cache for instance {{(pid=75229) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 09:59:56 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 09:59:57 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 09:59:58 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:59:58 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 09:59:58 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:59:58 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:59:58 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:59:58 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Auditing locally available compute resources for user (node: user) {{(pid=75229) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 09:59:58 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cda8c5ad-e70c-4021-bace-d55831c4bc78/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:59:59 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cda8c5ad-e70c-4021-bace-d55831c4bc78/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:59:59 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cda8c5ad-e70c-4021-bace-d55831c4bc78/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:59:59 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cda8c5ad-e70c-4021-bace-d55831c4bc78/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:59:59 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7750cbc-b3d0-44aa-8b88-c291ba007a8a/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:59:59 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7750cbc-b3d0-44aa-8b88-c291ba007a8a/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:59:59 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7750cbc-b3d0-44aa-8b88-c291ba007a8a/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:59:59 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7750cbc-b3d0-44aa-8b88-c291ba007a8a/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:59:59 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75229) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 09:59:59 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eba59006-83c1-4bda-b9f5-f3be4d1e5e58/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:59:59 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eba59006-83c1-4bda-b9f5-f3be4d1e5e58/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:59:59 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eba59006-83c1-4bda-b9f5-f3be4d1e5e58/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:00:00 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eba59006-83c1-4bda-b9f5-f3be4d1e5e58/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:00:00 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c9fe69e-3f9d-4b30-a9e4-efc3e83efa17/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:00:00 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:00:00 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c9fe69e-3f9d-4b30-a9e4-efc3e83efa17/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:00:00 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c9fe69e-3f9d-4b30-a9e4-efc3e83efa17/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:00:00 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c9fe69e-3f9d-4b30-a9e4-efc3e83efa17/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:00:00 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75229) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 10:00:00 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30ae1f73-e0f3-4e26-987e-a684471a160d/disk.rescue --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:00:00 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30ae1f73-e0f3-4e26-987e-a684471a160d/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:00:00 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30ae1f73-e0f3-4e26-987e-a684471a160d/disk.rescue --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:00:00 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30ae1f73-e0f3-4e26-987e-a684471a160d/disk.rescue --force-share --output=json" returned: 0 in 0.171s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:00:00 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cdd6b32-d4bd-4135-a58e-fbc3b6d2a093/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:00:00 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cdd6b32-d4bd-4135-a58e-fbc3b6d2a093/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:00:00 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cdd6b32-d4bd-4135-a58e-fbc3b6d2a093/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:00:01 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cdd6b32-d4bd-4135-a58e-fbc3b6d2a093/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:00:01 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abb8e340-164d-4bc2-a503-7e8ea3c9b35b/disk.rescue --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:00:01 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abb8e340-164d-4bc2-a503-7e8ea3c9b35b/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:00:01 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abb8e340-164d-4bc2-a503-7e8ea3c9b35b/disk.rescue --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:00:01 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abb8e340-164d-4bc2-a503-7e8ea3c9b35b/disk.rescue --force-share --output=json" returned: 0 in 0.195s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:00:01 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] skipping disk /opt/stack/data/nova/instances/abb8e340-164d-4bc2-a503-7e8ea3c9b35b/disk (vdb) as it is a volume {{(pid=75229) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 10:00:01 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5170e9e-66e3-4df1-9807-4958cac6480e/disk.rescue --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:00:01 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5170e9e-66e3-4df1-9807-4958cac6480e/disk.rescue --force-share --output=json" returned: 0 in 0.185s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:00:01 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5170e9e-66e3-4df1-9807-4958cac6480e/disk.rescue --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:00:01 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5170e9e-66e3-4df1-9807-4958cac6480e/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:00:01 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5170e9e-66e3-4df1-9807-4958cac6480e/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:00:02 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5170e9e-66e3-4df1-9807-4958cac6480e/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:00:02 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5170e9e-66e3-4df1-9807-4958cac6480e/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:00:02 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5170e9e-66e3-4df1-9807-4958cac6480e/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:00:02 user nova-compute[75229]: WARNING nova.virt.libvirt.driver [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 10:00:02 user nova-compute[75229]: WARNING nova.virt.libvirt.driver [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 10:00:02 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Hypervisor/Node resource view: name=user free_ram=7681MB free_disk=25.05156707763672GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75229) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 10:00:02 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:00:02 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:00:02 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Instance a7750cbc-b3d0-44aa-8b88-c291ba007a8a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 10:00:02 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Instance 4c9fe69e-3f9d-4b30-a9e4-efc3e83efa17 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 10:00:02 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Instance b5170e9e-66e3-4df1-9807-4958cac6480e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 10:00:02 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Instance cda8c5ad-e70c-4021-bace-d55831c4bc78 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 10:00:02 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Instance 9cdd6b32-d4bd-4135-a58e-fbc3b6d2a093 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 10:00:02 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Instance 30ae1f73-e0f3-4e26-987e-a684471a160d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 10:00:02 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Instance 589f4750-fac6-4e99-a430-0cda339808bc actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 10:00:02 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Instance abb8e340-164d-4bc2-a503-7e8ea3c9b35b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 10:00:02 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Instance eba59006-83c1-4bda-b9f5-f3be4d1e5e58 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 10:00:02 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=75229) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 10:00:02 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=75229) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 10:00:02 user nova-compute[75229]: DEBUG nova.scheduler.client.report [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Refreshing inventories for resource provider d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 {{(pid=75229) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 14 10:00:03 user nova-compute[75229]: DEBUG nova.scheduler.client.report [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Updating ProviderTree inventory for provider d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75229) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 14 10:00:03 user nova-compute[75229]: DEBUG nova.compute.provider_tree [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Updating inventory in ProviderTree for provider d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 14 10:00:03 user nova-compute[75229]: DEBUG nova.scheduler.client.report [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Refreshing aggregate associations for resource provider d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3, aggregates: None {{(pid=75229) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 14 10:00:03 user nova-compute[75229]: DEBUG nova.scheduler.client.report [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Refreshing trait associations for resource provider d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3, traits: COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_MMX,HW_CPU_X86_SSE42,HW_CPU_X86_SSSE3,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_TRUSTED_CERTS,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSE,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_USB,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_RESCUE_BFV {{(pid=75229) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 14 10:00:03 user nova-compute[75229]: DEBUG nova.compute.provider_tree [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Inventory has not changed in ProviderTree for provider: d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 {{(pid=75229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 10:00:03 user nova-compute[75229]: DEBUG nova.scheduler.client.report [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Inventory has not changed for provider d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 10:00:03 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Compute_service record updated for user:user {{(pid=75229) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 10:00:03 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.687s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:00:04 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:00:04 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:00:04 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:00:04 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:00:04 user nova-compute[75229]: DEBUG nova.compute.manager [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75229) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 10:00:04 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:00:04 user nova-compute[75229]: DEBUG nova.compute.manager [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75229) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 14 10:00:05 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 10:00:09 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:00:10 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 10:00:14 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:00:15 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 10:00:15 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:00:15 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75229) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 10:00:15 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75229) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 10:00:15 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75229) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 10:00:15 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:00:19 user nova-compute[75229]: DEBUG nova.compute.manager [req-e8344ccf-906b-4ce9-ab36-89b1f06e4ae4 req-54dc09a5-6502-4284-9100-9d14f9bd96fd service nova] [instance: eba59006-83c1-4bda-b9f5-f3be4d1e5e58] Received event network-changed-3eec6b6f-28b1-4026-b81a-22c88d1f94a4 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 10:00:19 user nova-compute[75229]: DEBUG nova.compute.manager [req-e8344ccf-906b-4ce9-ab36-89b1f06e4ae4 req-54dc09a5-6502-4284-9100-9d14f9bd96fd service nova] [instance: eba59006-83c1-4bda-b9f5-f3be4d1e5e58] Refreshing instance network info cache due to event network-changed-3eec6b6f-28b1-4026-b81a-22c88d1f94a4. {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 10:00:19 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-e8344ccf-906b-4ce9-ab36-89b1f06e4ae4 req-54dc09a5-6502-4284-9100-9d14f9bd96fd service nova] Acquiring lock "refresh_cache-eba59006-83c1-4bda-b9f5-f3be4d1e5e58" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 10:00:19 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-e8344ccf-906b-4ce9-ab36-89b1f06e4ae4 req-54dc09a5-6502-4284-9100-9d14f9bd96fd service nova] Acquired lock "refresh_cache-eba59006-83c1-4bda-b9f5-f3be4d1e5e58" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 10:00:19 user nova-compute[75229]: DEBUG nova.network.neutron [req-e8344ccf-906b-4ce9-ab36-89b1f06e4ae4 req-54dc09a5-6502-4284-9100-9d14f9bd96fd service nova] [instance: eba59006-83c1-4bda-b9f5-f3be4d1e5e58] Refreshing network info cache for port 3eec6b6f-28b1-4026-b81a-22c88d1f94a4 {{(pid=75229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 10:00:19 user nova-compute[75229]: DEBUG nova.network.neutron [req-e8344ccf-906b-4ce9-ab36-89b1f06e4ae4 req-54dc09a5-6502-4284-9100-9d14f9bd96fd service nova] [instance: eba59006-83c1-4bda-b9f5-f3be4d1e5e58] Updated VIF entry in instance network info cache for port 3eec6b6f-28b1-4026-b81a-22c88d1f94a4. {{(pid=75229) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 10:00:19 user nova-compute[75229]: DEBUG nova.network.neutron [req-e8344ccf-906b-4ce9-ab36-89b1f06e4ae4 req-54dc09a5-6502-4284-9100-9d14f9bd96fd service nova] [instance: eba59006-83c1-4bda-b9f5-f3be4d1e5e58] Updating instance_info_cache with network_info: [{"id": "3eec6b6f-28b1-4026-b81a-22c88d1f94a4", "address": "fa:16:3e:8c:7a:8a", "network": {"id": "bd407caa-6ef6-400d-9327-3179dc1d8da4", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-29933774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.61", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b8d48c38c7344f5b12d0ed5b9392554", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3eec6b6f-28", "ovs_interfaceid": "3eec6b6f-28b1-4026-b81a-22c88d1f94a4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 10:00:19 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-e8344ccf-906b-4ce9-ab36-89b1f06e4ae4 req-54dc09a5-6502-4284-9100-9d14f9bd96fd service nova] Releasing lock "refresh_cache-eba59006-83c1-4bda-b9f5-f3be4d1e5e58" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 10:00:20 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:00:21 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-ee46b062-c726-47a9-9367-6621ddf6beb0 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Acquiring lock "eba59006-83c1-4bda-b9f5-f3be4d1e5e58" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:00:21 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-ee46b062-c726-47a9-9367-6621ddf6beb0 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Lock "eba59006-83c1-4bda-b9f5-f3be4d1e5e58" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:00:21 user nova-compute[75229]: DEBUG nova.objects.instance [None req-ee46b062-c726-47a9-9367-6621ddf6beb0 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Lazy-loading 'flavor' on Instance uuid eba59006-83c1-4bda-b9f5-f3be4d1e5e58 {{(pid=75229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 10:00:21 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-ee46b062-c726-47a9-9367-6621ddf6beb0 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Lock "eba59006-83c1-4bda-b9f5-f3be4d1e5e58" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:00:21 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-ee46b062-c726-47a9-9367-6621ddf6beb0 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Acquiring lock "eba59006-83c1-4bda-b9f5-f3be4d1e5e58" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:00:21 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-ee46b062-c726-47a9-9367-6621ddf6beb0 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Lock "eba59006-83c1-4bda-b9f5-f3be4d1e5e58" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:00:21 user nova-compute[75229]: INFO nova.compute.manager [None req-ee46b062-c726-47a9-9367-6621ddf6beb0 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] [instance: eba59006-83c1-4bda-b9f5-f3be4d1e5e58] Attaching volume 2df516f3-0635-44ed-8a28-e74c0ebaeeaf to /dev/vdb
Nov 14 10:00:21 user nova-compute[75229]: DEBUG os_brick.utils [None req-ee46b062-c726-47a9-9367-6621ddf6beb0 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 10:00:21 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:00:21 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:00:21 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[77237d6d-21bf-46ab-b2fd-fe890d66174b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f1154031c835\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:00:21 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:00:21 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:00:21 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[f83831aa-81e1-49e2-b7f2-f523d8093f59]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:00:21 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:00:21 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:00:21 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[92f2d491-55d7-4e1c-8c1e-a8c1476113e7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:00:21 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0abddb0-cbf0-46e8-a2b4-5a511c23683e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:00:21 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-ee46b062-c726-47a9-9367-6621ddf6beb0 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Running cmd (subprocess): nvme version {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:00:21 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-ee46b062-c726-47a9-9367-6621ddf6beb0 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] 'nvme version' failed. Not Retrying. {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 10:00:21 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ee46b062-c726-47a9-9367-6621ddf6beb0 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] nvme not present on system {{(pid=75229) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 10:00:21 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:00:21 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 10:00:21 user nova-compute[75229]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 10:00:21 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8a04489-9cef-4e73-a017-52e3dcc02aa5]: (4, '') {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:00:21 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.lightos [None req-ee46b062-c726-47a9-9367-6621ddf6beb0 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75229) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 10:00:21 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.lightos [None req-ee46b062-c726-47a9-9367-6621ddf6beb0 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75229) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 10:00:21 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.lightos [None req-ee46b062-c726-47a9-9367-6621ddf6beb0 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] LIGHTOS: no hostnqn found. {{(pid=75229) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 10:00:21 user nova-compute[75229]: DEBUG os_brick.utils [None req-ee46b062-c726-47a9-9367-6621ddf6beb0 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f1154031c835', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 10:00:21 user nova-compute[75229]: DEBUG nova.virt.block_device [None req-ee46b062-c726-47a9-9367-6621ddf6beb0 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] [instance: eba59006-83c1-4bda-b9f5-f3be4d1e5e58] Updating existing volume attachment record: 7f13f9ab-9aaf-47e5-bbb7-4d30d19f7a72 {{(pid=75229) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 10:00:23 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:00:24 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-dd00811c-27f0-4645-b52f-7db45eba91b5 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] Acquiring lock "9cdd6b32-d4bd-4135-a58e-fbc3b6d2a093" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:00:24 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-dd00811c-27f0-4645-b52f-7db45eba91b5 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] Lock "9cdd6b32-d4bd-4135-a58e-fbc3b6d2a093" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:00:24 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-dd00811c-27f0-4645-b52f-7db45eba91b5 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] Acquiring lock "9cdd6b32-d4bd-4135-a58e-fbc3b6d2a093-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:00:24 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-dd00811c-27f0-4645-b52f-7db45eba91b5 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] Lock "9cdd6b32-d4bd-4135-a58e-fbc3b6d2a093-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:00:24 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-dd00811c-27f0-4645-b52f-7db45eba91b5 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] Lock "9cdd6b32-d4bd-4135-a58e-fbc3b6d2a093-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:00:24 user nova-compute[75229]: INFO nova.compute.manager [None req-dd00811c-27f0-4645-b52f-7db45eba91b5 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] [instance: 9cdd6b32-d4bd-4135-a58e-fbc3b6d2a093] Terminating instance
Nov 14 10:00:24 user nova-compute[75229]: DEBUG nova.compute.manager [None req-dd00811c-27f0-4645-b52f-7db45eba91b5 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] [instance: 9cdd6b32-d4bd-4135-a58e-fbc3b6d2a093] Start destroying the instance on the hypervisor. {{(pid=75229) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 10:00:24 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:00:24 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:00:25 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:00:25 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:00:25 user nova-compute[75229]: DEBUG nova.compute.manager [req-8aa419e2-a88f-49bf-a728-b6ea9a81001d req-3487c682-832a-478f-b100-31fbc5168c7b service nova] [instance: 9cdd6b32-d4bd-4135-a58e-fbc3b6d2a093] Received event network-vif-unplugged-5b06ed49-fa0b-4b58-ad6e-a092a9c1d14c {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 10:00:25 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-8aa419e2-a88f-49bf-a728-b6ea9a81001d req-3487c682-832a-478f-b100-31fbc5168c7b service nova] Acquiring lock "9cdd6b32-d4bd-4135-a58e-fbc3b6d2a093-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:00:25 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-8aa419e2-a88f-49bf-a728-b6ea9a81001d req-3487c682-832a-478f-b100-31fbc5168c7b service nova] Lock "9cdd6b32-d4bd-4135-a58e-fbc3b6d2a093-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:00:25 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-8aa419e2-a88f-49bf-a728-b6ea9a81001d req-3487c682-832a-478f-b100-31fbc5168c7b service nova] Lock "9cdd6b32-d4bd-4135-a58e-fbc3b6d2a093-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:00:25 user nova-compute[75229]: DEBUG nova.compute.manager [req-8aa419e2-a88f-49bf-a728-b6ea9a81001d req-3487c682-832a-478f-b100-31fbc5168c7b service nova] [instance: 9cdd6b32-d4bd-4135-a58e-fbc3b6d2a093] No waiting events found dispatching network-vif-unplugged-5b06ed49-fa0b-4b58-ad6e-a092a9c1d14c {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 10:00:25 user nova-compute[75229]: DEBUG nova.compute.manager [req-8aa419e2-a88f-49bf-a728-b6ea9a81001d req-3487c682-832a-478f-b100-31fbc5168c7b service nova] [instance: 9cdd6b32-d4bd-4135-a58e-fbc3b6d2a093] Received event network-vif-unplugged-5b06ed49-fa0b-4b58-ad6e-a092a9c1d14c for instance with task_state deleting. {{(pid=75229) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 10:00:25 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:00:25 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:00:25 user nova-compute[75229]: INFO nova.virt.libvirt.driver [-] [instance: 9cdd6b32-d4bd-4135-a58e-fbc3b6d2a093] Instance destroyed successfully.
Nov 14 10:00:25 user nova-compute[75229]: DEBUG nova.objects.instance [None req-dd00811c-27f0-4645-b52f-7db45eba91b5 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] Lazy-loading 'resources' on Instance uuid 9cdd6b32-d4bd-4135-a58e-fbc3b6d2a093 {{(pid=75229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 10:00:25 user nova-compute[75229]: DEBUG nova.virt.libvirt.vif [None req-dd00811c-27f0-4645-b52f-7db45eba91b5 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T09:55:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-508307917',display_name='tempest-TestMinimumBasicScenario-server-508307917',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-508307917',id=33,image_ref='0823bd45-8889-44a2-af7b-c62e62168aa0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNQaiZrYxhtQ9Z1odWv1XxjAtK8tIVJIrMXqwnGE0zhhoD5Zg7LGVLpp3XoFHJhcj9HkgHw1PM90l9fXjhW3gfdtl+BsuTiL7uocPMAUPc5CoP4m/p+J4JQ8M4ffCWUssg==',key_name='tempest-TestMinimumBasicScenario-1462263209',keypairs=<?>,launch_index=0,launched_at=2023-11-14T09:55:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4a6157b9827b44d2bab197220b635fd3',ramdisk_id='',reservation_id='r-dtnj4adv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0823bd45-8889-44a2-af7b-c62e62168aa0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-284611138',owner_user_name='tempest-TestMinimumBasicScenario-284611138-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T09:57:47Z,user_data=None,user_id='3603da40a87149478458797ea9aedfe2',uuid=9cdd6b32-d4bd-4135-a58e-fbc3b6d2a093,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5b06ed49-fa0b-4b58-ad6e-a092a9c1d14c", "address": "fa:16:3e:f8:75:16", "network": {"id": "1687d918-9f70-4099-b44c-97f92f90e6ff", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2074208460-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a6157b9827b44d2bab197220b635fd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b06ed49-fa", "ovs_interfaceid": "5b06ed49-fa0b-4b58-ad6e-a092a9c1d14c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 10:00:25 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-dd00811c-27f0-4645-b52f-7db45eba91b5 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] Converting VIF {"id": "5b06ed49-fa0b-4b58-ad6e-a092a9c1d14c", "address": "fa:16:3e:f8:75:16", "network": {"id": "1687d918-9f70-4099-b44c-97f92f90e6ff", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2074208460-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a6157b9827b44d2bab197220b635fd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b06ed49-fa", "ovs_interfaceid": "5b06ed49-fa0b-4b58-ad6e-a092a9c1d14c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 10:00:25 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-dd00811c-27f0-4645-b52f-7db45eba91b5 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f8:75:16,bridge_name='br-int',has_traffic_filtering=True,id=5b06ed49-fa0b-4b58-ad6e-a092a9c1d14c,network=Network(1687d918-9f70-4099-b44c-97f92f90e6ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b06ed49-fa') {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 10:00:25 user nova-compute[75229]: DEBUG os_vif [None req-dd00811c-27f0-4645-b52f-7db45eba91b5 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f8:75:16,bridge_name='br-int',has_traffic_filtering=True,id=5b06ed49-fa0b-4b58-ad6e-a092a9c1d14c,network=Network(1687d918-9f70-4099-b44c-97f92f90e6ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b06ed49-fa') {{(pid=75229) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 10:00:25 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:00:25 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5b06ed49-fa, bridge=br-int, if_exists=True) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 10:00:25 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:00:25 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 10:00:25 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:00:25 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=bec2dd27-4292-4ce0-8002-71c3810f0fe4) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 10:00:25 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:00:25 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:00:25 user nova-compute[75229]: INFO os_vif [None req-dd00811c-27f0-4645-b52f-7db45eba91b5 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f8:75:16,bridge_name='br-int',has_traffic_filtering=True,id=5b06ed49-fa0b-4b58-ad6e-a092a9c1d14c,network=Network(1687d918-9f70-4099-b44c-97f92f90e6ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b06ed49-fa')
Nov 14 10:00:25 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-dd00811c-27f0-4645-b52f-7db45eba91b5 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] [instance: 9cdd6b32-d4bd-4135-a58e-fbc3b6d2a093] Deleting instance files /opt/stack/data/nova/instances/9cdd6b32-d4bd-4135-a58e-fbc3b6d2a093_del
Nov 14 10:00:25 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-dd00811c-27f0-4645-b52f-7db45eba91b5 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] [instance: 9cdd6b32-d4bd-4135-a58e-fbc3b6d2a093] Deletion of /opt/stack/data/nova/instances/9cdd6b32-d4bd-4135-a58e-fbc3b6d2a093_del complete
Nov 14 10:00:25 user nova-compute[75229]: INFO nova.compute.manager [None req-dd00811c-27f0-4645-b52f-7db45eba91b5 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] [instance: 9cdd6b32-d4bd-4135-a58e-fbc3b6d2a093] Took 0.91 seconds to destroy the instance on the hypervisor.
Nov 14 10:00:25 user nova-compute[75229]: DEBUG oslo.service.loopingcall [None req-dd00811c-27f0-4645-b52f-7db45eba91b5 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75229) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 10:00:25 user nova-compute[75229]: DEBUG nova.compute.manager [-] [instance: 9cdd6b32-d4bd-4135-a58e-fbc3b6d2a093] Deallocating network for instance {{(pid=75229) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 10:00:25 user nova-compute[75229]: DEBUG nova.network.neutron [-] [instance: 9cdd6b32-d4bd-4135-a58e-fbc3b6d2a093] deallocate_for_instance() {{(pid=75229) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 10:00:26 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:00:26 user nova-compute[75229]: DEBUG nova.network.neutron [-] [instance: 9cdd6b32-d4bd-4135-a58e-fbc3b6d2a093] Updating instance_info_cache with network_info: [] {{(pid=75229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 10:00:26 user nova-compute[75229]: WARNING nova.compute.manager [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] While synchronizing instance power states, found 9 instances in the database and 8 instances on the hypervisor.
Nov 14 10:00:26 user nova-compute[75229]: DEBUG nova.compute.manager [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Triggering sync for uuid a7750cbc-b3d0-44aa-8b88-c291ba007a8a {{(pid=75229) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 10:00:26 user nova-compute[75229]: DEBUG nova.compute.manager [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Triggering sync for uuid 4c9fe69e-3f9d-4b30-a9e4-efc3e83efa17 {{(pid=75229) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 10:00:26 user nova-compute[75229]: DEBUG nova.compute.manager [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Triggering sync for uuid b5170e9e-66e3-4df1-9807-4958cac6480e {{(pid=75229) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 10:00:26 user nova-compute[75229]: DEBUG nova.compute.manager [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Triggering sync for uuid cda8c5ad-e70c-4021-bace-d55831c4bc78 {{(pid=75229) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 10:00:26 user nova-compute[75229]: DEBUG nova.compute.manager [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Triggering sync for uuid 589f4750-fac6-4e99-a430-0cda339808bc {{(pid=75229) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 10:00:26 user nova-compute[75229]: DEBUG nova.compute.manager [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Triggering sync for uuid 30ae1f73-e0f3-4e26-987e-a684471a160d {{(pid=75229) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 10:00:26 user nova-compute[75229]: DEBUG nova.compute.manager [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Triggering sync for uuid abb8e340-164d-4bc2-a503-7e8ea3c9b35b {{(pid=75229) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 10:00:26 user nova-compute[75229]: DEBUG nova.compute.manager [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Triggering sync for uuid eba59006-83c1-4bda-b9f5-f3be4d1e5e58 {{(pid=75229) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 10:00:26 user nova-compute[75229]: DEBUG nova.compute.manager [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Triggering sync for uuid 9cdd6b32-d4bd-4135-a58e-fbc3b6d2a093 {{(pid=75229) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 10:00:26 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Acquiring lock "a7750cbc-b3d0-44aa-8b88-c291ba007a8a" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:00:26 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Lock "a7750cbc-b3d0-44aa-8b88-c291ba007a8a" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:00:26 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Acquiring lock "4c9fe69e-3f9d-4b30-a9e4-efc3e83efa17" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:00:26 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Lock "4c9fe69e-3f9d-4b30-a9e4-efc3e83efa17" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:00:26 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Acquiring lock "b5170e9e-66e3-4df1-9807-4958cac6480e" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:00:26 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Lock "b5170e9e-66e3-4df1-9807-4958cac6480e" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:00:26 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Acquiring lock "cda8c5ad-e70c-4021-bace-d55831c4bc78" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:00:26 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Lock "cda8c5ad-e70c-4021-bace-d55831c4bc78" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:00:26 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Acquiring lock "589f4750-fac6-4e99-a430-0cda339808bc" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:00:26 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Lock "589f4750-fac6-4e99-a430-0cda339808bc" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:00:26 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Acquiring lock "30ae1f73-e0f3-4e26-987e-a684471a160d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:00:26 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Lock "30ae1f73-e0f3-4e26-987e-a684471a160d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:00:26 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Acquiring lock "abb8e340-164d-4bc2-a503-7e8ea3c9b35b" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:00:26 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Lock "abb8e340-164d-4bc2-a503-7e8ea3c9b35b" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:00:26 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Acquiring lock "eba59006-83c1-4bda-b9f5-f3be4d1e5e58" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:00:26 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Acquiring lock "9cdd6b32-d4bd-4135-a58e-fbc3b6d2a093" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:00:26 user nova-compute[75229]: INFO nova.compute.manager [-] [instance: 9cdd6b32-d4bd-4135-a58e-fbc3b6d2a093] Took 0.48 seconds to deallocate network for instance.
Nov 14 10:00:26 user nova-compute[75229]: DEBUG nova.compute.manager [req-72919ce9-4a36-4547-a04f-2b383e80fe2a req-176596b7-1071-4edd-b46e-fb5fdaf47a50 service nova] [instance: 9cdd6b32-d4bd-4135-a58e-fbc3b6d2a093] Received event network-vif-deleted-5b06ed49-fa0b-4b58-ad6e-a092a9c1d14c {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 10:00:26 user nova-compute[75229]: INFO nova.compute.manager [req-72919ce9-4a36-4547-a04f-2b383e80fe2a req-176596b7-1071-4edd-b46e-fb5fdaf47a50 service nova] [instance: 9cdd6b32-d4bd-4135-a58e-fbc3b6d2a093] Neutron deleted interface 5b06ed49-fa0b-4b58-ad6e-a092a9c1d14c; detaching it from the instance and deleting it from the info cache
Nov 14 10:00:26 user nova-compute[75229]: DEBUG nova.network.neutron [req-72919ce9-4a36-4547-a04f-2b383e80fe2a req-176596b7-1071-4edd-b46e-fb5fdaf47a50 service nova] [instance: 9cdd6b32-d4bd-4135-a58e-fbc3b6d2a093] Updating instance_info_cache with network_info: [] {{(pid=75229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 10:00:26 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Lock "a7750cbc-b3d0-44aa-8b88-c291ba007a8a" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.049s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:00:26 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Lock "b5170e9e-66e3-4df1-9807-4958cac6480e" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.058s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:00:26 user nova-compute[75229]: DEBUG nova.compute.manager [req-72919ce9-4a36-4547-a04f-2b383e80fe2a req-176596b7-1071-4edd-b46e-fb5fdaf47a50 service nova] [instance: 9cdd6b32-d4bd-4135-a58e-fbc3b6d2a093] Detach interface failed, port_id=5b06ed49-fa0b-4b58-ad6e-a092a9c1d14c, reason: Instance 9cdd6b32-d4bd-4135-a58e-fbc3b6d2a093 could not be found. {{(pid=75229) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 14 10:00:26 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Lock "4c9fe69e-3f9d-4b30-a9e4-efc3e83efa17" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.064s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:00:26 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Lock "cda8c5ad-e70c-4021-bace-d55831c4bc78" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.063s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:00:26 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Lock "30ae1f73-e0f3-4e26-987e-a684471a160d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.073s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:00:26 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Lock "abb8e340-164d-4bc2-a503-7e8ea3c9b35b" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.079s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:00:26 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Lock "589f4750-fac6-4e99-a430-0cda339808bc" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.089s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:00:26 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-dd00811c-27f0-4645-b52f-7db45eba91b5 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:00:26 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-dd00811c-27f0-4645-b52f-7db45eba91b5 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:00:26 user nova-compute[75229]: DEBUG nova.compute.provider_tree [None req-dd00811c-27f0-4645-b52f-7db45eba91b5 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] Inventory has not changed in ProviderTree for provider: d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 {{(pid=75229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 10:00:26 user nova-compute[75229]: DEBUG nova.scheduler.client.report [None req-dd00811c-27f0-4645-b52f-7db45eba91b5 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] Inventory has not changed for provider d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 10:00:26 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-dd00811c-27f0-4645-b52f-7db45eba91b5 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.334s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:00:26 user nova-compute[75229]: INFO nova.scheduler.client.report [None req-dd00811c-27f0-4645-b52f-7db45eba91b5 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] Deleted allocations for instance 9cdd6b32-d4bd-4135-a58e-fbc3b6d2a093
Nov 14 10:00:26 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-dd00811c-27f0-4645-b52f-7db45eba91b5 tempest-TestMinimumBasicScenario-284611138 tempest-TestMinimumBasicScenario-284611138-project-member] Lock "9cdd6b32-d4bd-4135-a58e-fbc3b6d2a093" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.947s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:00:26 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Lock "9cdd6b32-d4bd-4135-a58e-fbc3b6d2a093" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.544s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:00:26 user nova-compute[75229]: INFO nova.compute.manager [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] [instance: 9cdd6b32-d4bd-4135-a58e-fbc3b6d2a093] During sync_power_state the instance has a pending task (deleting). Skip.
Nov 14 10:00:26 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Lock "9cdd6b32-d4bd-4135-a58e-fbc3b6d2a093" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:00:27 user nova-compute[75229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ee46b062-c726-47a9-9367-6621ddf6beb0 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] [instance: eba59006-83c1-4bda-b9f5-f3be4d1e5e58] Calling os-brick to attach iSCSI Volume {{(pid=75229) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 10:00:27 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee46b062-c726-47a9-9367-6621ddf6beb0 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f73f85151b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2df516f3-0635-44ed-8a28-e74c0ebaeeaf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eIxMbNfz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 10:00:27 user nova-compute[75229]: WARNING os_brick.initiator.connectors.base [None req-ee46b062-c726-47a9-9367-6621ddf6beb0 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 10:00:27 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-ee46b062-c726-47a9-9367-6621ddf6beb0 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 10:00:27 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-ee46b062-c726-47a9-9367-6621ddf6beb0 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 10:00:27 user nova-compute[75229]: WARNING os_brick.initiator.connectors.base [None req-ee46b062-c726-47a9-9367-6621ddf6beb0 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 10:00:27 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-ee46b062-c726-47a9-9367-6621ddf6beb0 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2df516f3-0635-44ed-8a28-e74c0ebaeeaf" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 10:00:27 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-ee46b062-c726-47a9-9367-6621ddf6beb0 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2df516f3-0635-44ed-8a28-e74c0ebaeeaf" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 10:00:27 user nova-compute[75229]: INFO os_brick.initiator.connectors.iscsi [None req-ee46b062-c726-47a9-9367-6621ddf6beb0 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 10:00:27 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2df516f3-0635-44ed-8a28-e74c0ebaeeaf -p 172.16.0.220:3260 {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:00:27 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2df516f3-0635-44ed-8a28-e74c0ebaeeaf -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:00:27 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b7fff19-c868-462b-b07c-2e44a92394f9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:00:27 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee46b062-c726-47a9-9367-6621ddf6beb0 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 10:00:27 user nova-compute[75229]:  {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 10:00:27 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2df516f3-0635-44ed-8a28-e74c0ebaeeaf -p 172.16.0.220:3260 --interface default --op new {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:00:27 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2df516f3-0635-44ed-8a28-e74c0ebaeeaf -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:00:27 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0db0f66-596f-4b23-b4f1-76230e2a7810]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2df516f3-0635-44ed-8a28-e74c0ebaeeaf] added\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:00:27 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee46b062-c726-47a9-9367-6621ddf6beb0 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2df516f3-0635-44ed-8a28-e74c0ebaeeaf] added
Nov 14 10:00:27 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 10:00:27 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2df516f3-0635-44ed-8a28-e74c0ebaeeaf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:00:27 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2df516f3-0635-44ed-8a28-e74c0ebaeeaf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:00:27 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cd4ff76-9773-41da-85d2-51ed6dca3f5c]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:00:27 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee46b062-c726-47a9-9367-6621ddf6beb0 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 10:00:27 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2df516f3-0635-44ed-8a28-e74c0ebaeeaf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:00:27 user nova-compute[75229]: DEBUG nova.compute.manager [req-8014e703-5244-4b8d-83b7-1f18440c2f1c req-097ec2a5-a500-4985-bb8b-c6c0c8994ce8 service nova] [instance: 9cdd6b32-d4bd-4135-a58e-fbc3b6d2a093] Received event network-vif-plugged-5b06ed49-fa0b-4b58-ad6e-a092a9c1d14c {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 10:00:27 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-8014e703-5244-4b8d-83b7-1f18440c2f1c req-097ec2a5-a500-4985-bb8b-c6c0c8994ce8 service nova] Acquiring lock "9cdd6b32-d4bd-4135-a58e-fbc3b6d2a093-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:00:27 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-8014e703-5244-4b8d-83b7-1f18440c2f1c req-097ec2a5-a500-4985-bb8b-c6c0c8994ce8 service nova] Lock "9cdd6b32-d4bd-4135-a58e-fbc3b6d2a093-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:00:27 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-8014e703-5244-4b8d-83b7-1f18440c2f1c req-097ec2a5-a500-4985-bb8b-c6c0c8994ce8 service nova] Lock "9cdd6b32-d4bd-4135-a58e-fbc3b6d2a093-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:00:27 user nova-compute[75229]: DEBUG nova.compute.manager [req-8014e703-5244-4b8d-83b7-1f18440c2f1c req-097ec2a5-a500-4985-bb8b-c6c0c8994ce8 service nova] [instance: 9cdd6b32-d4bd-4135-a58e-fbc3b6d2a093] No waiting events found dispatching network-vif-plugged-5b06ed49-fa0b-4b58-ad6e-a092a9c1d14c {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 10:00:27 user nova-compute[75229]: WARNING nova.compute.manager [req-8014e703-5244-4b8d-83b7-1f18440c2f1c req-097ec2a5-a500-4985-bb8b-c6c0c8994ce8 service nova] [instance: 9cdd6b32-d4bd-4135-a58e-fbc3b6d2a093] Received unexpected event network-vif-plugged-5b06ed49-fa0b-4b58-ad6e-a092a9c1d14c for instance with vm_state deleted and task_state None.
Nov 14 10:00:27 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2df516f3-0635-44ed-8a28-e74c0ebaeeaf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:00:27 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1652195-b222-43ab-91b9-636f05d09fcb]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:00:27 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee46b062-c726-47a9-9367-6621ddf6beb0 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 10:00:27 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2df516f3-0635-44ed-8a28-e74c0ebaeeaf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eIxMbNfz {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:00:27 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2df516f3-0635-44ed-8a28-e74c0ebaeeaf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eIxMbNfz" returned: 0 in 0.021s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:00:27 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[8903c828-8d35-4748-9674-db260258f8fa]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:00:27 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee46b062-c726-47a9-9367-6621ddf6beb0 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'eIxMbNfz'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 10:00:27 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2df516f3-0635-44ed-8a28-e74c0ebaeeaf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:00:27 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2df516f3-0635-44ed-8a28-e74c0ebaeeaf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:00:27 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d3f1558-51ff-424c-a1c0-55b1625da2f1]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:00:27 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee46b062-c726-47a9-9367-6621ddf6beb0 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 10:00:27 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:00:27 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:00:27 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fe33150-3ac2-4d23-afa6-7c2bad718834]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aebc438-0289-44fe-ad84-4e696468f50e (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5efb0e0-a85c-46ec-8a9d-2763bf548023 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:143891e8-62eb-42d7-b076-db6f52b4f606 (non-flash)\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:00:27 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee46b062-c726-47a9-9367-6621ddf6beb0 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aebc438-0289-44fe-ad84-4e696468f50e (non-flash)
Nov 14 10:00:27 user nova-compute[75229]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5efb0e0-a85c-46ec-8a9d-2763bf548023 (non-flash)
Nov 14 10:00:27 user nova-compute[75229]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:143891e8-62eb-42d7-b076-db6f52b4f606 (non-flash)
Nov 14 10:00:27 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 10:00:27 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee46b062-c726-47a9-9367-6621ddf6beb0 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aebc438-0289-44fe-ad84-4e696468f50e (non-flash)
Nov 14 10:00:27 user nova-compute[75229]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5efb0e0-a85c-46ec-8a9d-2763bf548023 (non-flash)
Nov 14 10:00:27 user nova-compute[75229]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:143891e8-62eb-42d7-b076-db6f52b4f606 (non-flash)
Nov 14 10:00:27 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 10:00:27 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2df516f3-0635-44ed-8a28-e74c0ebaeeaf -p 172.16.0.220:3260 --login {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:00:27 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2df516f3-0635-44ed-8a28-e74c0ebaeeaf -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:00:27 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[d100d2ea-c3eb-496d-b6ae-156bc6b4c00f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2df516f3-0635-44ed-8a28-e74c0ebaeeaf, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2df516f3-0635-44ed-8a28-e74c0ebaeeaf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:00:27 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee46b062-c726-47a9-9367-6621ddf6beb0 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2df516f3-0635-44ed-8a28-e74c0ebaeeaf, portal: 172.16.0.220,3260]
Nov 14 10:00:27 user nova-compute[75229]: Login to [iface: default, target: iqn.2010-10.org.openstack:2df516f3-0635-44ed-8a28-e74c0ebaeeaf, portal: 172.16.0.220,3260] successful.
Nov 14 10:00:27 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 10:00:27 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2df516f3-0635-44ed-8a28-e74c0ebaeeaf -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:00:27 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2df516f3-0635-44ed-8a28-e74c0ebaeeaf -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:00:27 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d8de62a-b132-48bb-b7ba-80de832a164d]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:00:27 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee46b062-c726-47a9-9367-6621ddf6beb0 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 10:00:27 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:00:27 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:00:27 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cfd99d3-9117-4a78-b556-ee6abd8279c0]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aebc438-0289-44fe-ad84-4e696468f50e (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5efb0e0-a85c-46ec-8a9d-2763bf548023 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:143891e8-62eb-42d7-b076-db6f52b4f606 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2df516f3-0635-44ed-8a28-e74c0ebaeeaf (non-flash)\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:00:27 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee46b062-c726-47a9-9367-6621ddf6beb0 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aebc438-0289-44fe-ad84-4e696468f50e (non-flash)
Nov 14 10:00:27 user nova-compute[75229]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5efb0e0-a85c-46ec-8a9d-2763bf548023 (non-flash)
Nov 14 10:00:27 user nova-compute[75229]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:143891e8-62eb-42d7-b076-db6f52b4f606 (non-flash)
Nov 14 10:00:27 user nova-compute[75229]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2df516f3-0635-44ed-8a28-e74c0ebaeeaf (non-flash)
Nov 14 10:00:27 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 10:00:27 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee46b062-c726-47a9-9367-6621ddf6beb0 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aebc438-0289-44fe-ad84-4e696468f50e (non-flash)
Nov 14 10:00:27 user nova-compute[75229]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5efb0e0-a85c-46ec-8a9d-2763bf548023 (non-flash)
Nov 14 10:00:27 user nova-compute[75229]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:143891e8-62eb-42d7-b076-db6f52b4f606 (non-flash)
Nov 14 10:00:27 user nova-compute[75229]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2df516f3-0635-44ed-8a28-e74c0ebaeeaf (non-flash)
Nov 14 10:00:27 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 10:00:27 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-ee46b062-c726-47a9-9367-6621ddf6beb0 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2df516f3-0635-44ed-8a28-e74c0ebaeeaf" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.311s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 10:00:27 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee46b062-c726-47a9-9367-6621ddf6beb0 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Connected to 172.16.0.220:3260 {{(pid=75229) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 10:00:27 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-ee46b062-c726-47a9-9367-6621ddf6beb0 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] HCTL ('35', '-', '-', 0) found on session 39 with lun 0 {{(pid=75229) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 10:00:27 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-ee46b062-c726-47a9-9367-6621ddf6beb0 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75229) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 10:00:27 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:00:27 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:00:27 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a215dc6-278b-489f-99d6-0032d6de7111]: (4, ('- - 0', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:00:27 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-ee46b062-c726-47a9-9367-6621ddf6beb0 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Searching for a device in session 39 and hctl ['35', '*', '*', 0] yield: None {{(pid=75229) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 10:00:27 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:00:28 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-ee46b062-c726-47a9-9367-6621ddf6beb0 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Searching for a device in session 39 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75229) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 10:00:28 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee46b062-c726-47a9-9367-6621ddf6beb0 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:2df516f3-0635-44ed-8a28-e74c0ebaeeaf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eIxMbNfz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75229) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 10:00:28 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-ee46b062-c726-47a9-9367-6621ddf6beb0 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.344s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 10:00:28 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee46b062-c726-47a9-9367-6621ddf6beb0 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] <== connect_volume: return (1346ms) {'type': 'block', 'scsi_wwn': '23433376135636636', 'path': '/dev/sdd'} {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 10:00:28 user nova-compute[75229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ee46b062-c726-47a9-9367-6621ddf6beb0 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] [instance: eba59006-83c1-4bda-b9f5-f3be4d1e5e58] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23433376135636636', 'path': '/dev/sdd'} {{(pid=75229) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 10:00:28 user nova-compute[75229]: DEBUG nova.objects.instance [None req-ee46b062-c726-47a9-9367-6621ddf6beb0 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Lazy-loading 'flavor' on Instance uuid eba59006-83c1-4bda-b9f5-f3be4d1e5e58 {{(pid=75229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 10:00:28 user nova-compute[75229]: DEBUG nova.virt.libvirt.guest [None req-ee46b062-c726-47a9-9367-6621ddf6beb0 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 10:00:28 user nova-compute[75229]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 10:00:28 user nova-compute[75229]:   <source dev="/dev/sdd"/>
Nov 14 10:00:28 user nova-compute[75229]:   <target dev="vdb" bus="virtio"/>
Nov 14 10:00:28 user nova-compute[75229]:   <serial>2df516f3-0635-44ed-8a28-e74c0ebaeeaf</serial>
Nov 14 10:00:28 user nova-compute[75229]: </disk>
Nov 14 10:00:28 user nova-compute[75229]:  {{(pid=75229) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 10:00:28 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:00:28 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-ee46b062-c726-47a9-9367-6621ddf6beb0 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] No BDM found with device name vda, not building metadata. {{(pid=75229) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 10:00:28 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-ee46b062-c726-47a9-9367-6621ddf6beb0 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75229) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 10:00:28 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-ee46b062-c726-47a9-9367-6621ddf6beb0 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] No VIF found with MAC fa:16:3e:8c:7a:8a, not building metadata {{(pid=75229) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 10:00:29 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-ee46b062-c726-47a9-9367-6621ddf6beb0 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Lock "eba59006-83c1-4bda-b9f5-f3be4d1e5e58" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.831s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:00:29 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Lock "eba59006-83c1-4bda-b9f5-f3be4d1e5e58" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 2.804s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:00:29 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Lock "eba59006-83c1-4bda-b9f5-f3be4d1e5e58" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.025s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:00:29 user nova-compute[75229]: INFO nova.compute.manager [None req-c74d1195-99ae-42df-b7c1-aba85ed05301 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] [instance: 30ae1f73-e0f3-4e26-987e-a684471a160d] Unrescuing
Nov 14 10:00:29 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-c74d1195-99ae-42df-b7c1-aba85ed05301 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Acquiring lock "refresh_cache-30ae1f73-e0f3-4e26-987e-a684471a160d" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 10:00:29 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-c74d1195-99ae-42df-b7c1-aba85ed05301 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Acquired lock "refresh_cache-30ae1f73-e0f3-4e26-987e-a684471a160d" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 10:00:29 user nova-compute[75229]: DEBUG nova.network.neutron [None req-c74d1195-99ae-42df-b7c1-aba85ed05301 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] [instance: 30ae1f73-e0f3-4e26-987e-a684471a160d] Building network info cache for instance {{(pid=75229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 10:00:30 user nova-compute[75229]: DEBUG nova.network.neutron [None req-c74d1195-99ae-42df-b7c1-aba85ed05301 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] [instance: 30ae1f73-e0f3-4e26-987e-a684471a160d] Updating instance_info_cache with network_info: [{"id": "c087c657-8eee-4e8e-bef1-4281129597ae", "address": "fa:16:3e:aa:d3:e3", "network": {"id": "6a700b61-4aa6-440b-87e6-a3525a5cb918", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-448680331-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8babb73006da4977a1fe2bdb35e08d8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc087c657-8e", "ovs_interfaceid": "c087c657-8eee-4e8e-bef1-4281129597ae", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 10:00:30 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-c74d1195-99ae-42df-b7c1-aba85ed05301 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Releasing lock "refresh_cache-30ae1f73-e0f3-4e26-987e-a684471a160d" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 10:00:30 user nova-compute[75229]: DEBUG nova.objects.instance [None req-c74d1195-99ae-42df-b7c1-aba85ed05301 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Lazy-loading 'flavor' on Instance uuid 30ae1f73-e0f3-4e26-987e-a684471a160d {{(pid=75229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 10:00:30 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-dc9718f8-13ae-442c-b823-b2447bf2a748 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Acquiring lock "eba59006-83c1-4bda-b9f5-f3be4d1e5e58" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:00:30 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-dc9718f8-13ae-442c-b823-b2447bf2a748 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Lock "eba59006-83c1-4bda-b9f5-f3be4d1e5e58" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:00:30 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:00:30 user nova-compute[75229]: INFO nova.compute.manager [None req-dc9718f8-13ae-442c-b823-b2447bf2a748 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] [instance: eba59006-83c1-4bda-b9f5-f3be4d1e5e58] Detaching volume 2df516f3-0635-44ed-8a28-e74c0ebaeeaf
Nov 14 10:00:30 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:00:30 user nova-compute[75229]: INFO nova.virt.block_device [None req-dc9718f8-13ae-442c-b823-b2447bf2a748 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] [instance: eba59006-83c1-4bda-b9f5-f3be4d1e5e58] Attempting to driver detach volume 2df516f3-0635-44ed-8a28-e74c0ebaeeaf from mountpoint /dev/vdb
Nov 14 10:00:30 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-dc9718f8-13ae-442c-b823-b2447bf2a748 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Attempting to detach device vdb from instance eba59006-83c1-4bda-b9f5-f3be4d1e5e58 from the persistent domain config. {{(pid=75229) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 10:00:30 user nova-compute[75229]: DEBUG nova.virt.libvirt.guest [None req-dc9718f8-13ae-442c-b823-b2447bf2a748 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 10:00:30 user nova-compute[75229]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 10:00:30 user nova-compute[75229]:   <source dev="/dev/sdd"/>
Nov 14 10:00:30 user nova-compute[75229]:   <target dev="vdb" bus="virtio"/>
Nov 14 10:00:30 user nova-compute[75229]:   <serial>2df516f3-0635-44ed-8a28-e74c0ebaeeaf</serial>
Nov 14 10:00:30 user nova-compute[75229]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 10:00:30 user nova-compute[75229]: </disk>
Nov 14 10:00:30 user nova-compute[75229]:  {{(pid=75229) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 10:00:30 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-dc9718f8-13ae-442c-b823-b2447bf2a748 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Successfully detached device vdb from instance eba59006-83c1-4bda-b9f5-f3be4d1e5e58 from the persistent domain config.
Nov 14 10:00:30 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-dc9718f8-13ae-442c-b823-b2447bf2a748 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance eba59006-83c1-4bda-b9f5-f3be4d1e5e58 from the live domain config. {{(pid=75229) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 10:00:30 user nova-compute[75229]: DEBUG nova.virt.libvirt.guest [None req-dc9718f8-13ae-442c-b823-b2447bf2a748 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 10:00:30 user nova-compute[75229]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 10:00:30 user nova-compute[75229]:   <source dev="/dev/sdd"/>
Nov 14 10:00:30 user nova-compute[75229]:   <target dev="vdb" bus="virtio"/>
Nov 14 10:00:30 user nova-compute[75229]:   <serial>2df516f3-0635-44ed-8a28-e74c0ebaeeaf</serial>
Nov 14 10:00:30 user nova-compute[75229]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 10:00:30 user nova-compute[75229]: </disk>
Nov 14 10:00:30 user nova-compute[75229]:  {{(pid=75229) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 10:00:30 user nova-compute[75229]: DEBUG nova.compute.manager [req-41cce21c-0a6d-40e1-92d6-e8eadf0aca53 req-b6f2a1a2-4008-4255-833a-3a9fdfa07508 service nova] [instance: 30ae1f73-e0f3-4e26-987e-a684471a160d] Received event network-vif-unplugged-c087c657-8eee-4e8e-bef1-4281129597ae {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 10:00:30 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-41cce21c-0a6d-40e1-92d6-e8eadf0aca53 req-b6f2a1a2-4008-4255-833a-3a9fdfa07508 service nova] Acquiring lock "30ae1f73-e0f3-4e26-987e-a684471a160d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:00:30 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-41cce21c-0a6d-40e1-92d6-e8eadf0aca53 req-b6f2a1a2-4008-4255-833a-3a9fdfa07508 service nova] Lock "30ae1f73-e0f3-4e26-987e-a684471a160d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:00:30 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-41cce21c-0a6d-40e1-92d6-e8eadf0aca53 req-b6f2a1a2-4008-4255-833a-3a9fdfa07508 service nova] Lock "30ae1f73-e0f3-4e26-987e-a684471a160d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:00:30 user nova-compute[75229]: DEBUG nova.compute.manager [req-41cce21c-0a6d-40e1-92d6-e8eadf0aca53 req-b6f2a1a2-4008-4255-833a-3a9fdfa07508 service nova] [instance: 30ae1f73-e0f3-4e26-987e-a684471a160d] No waiting events found dispatching network-vif-unplugged-c087c657-8eee-4e8e-bef1-4281129597ae {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 10:00:30 user nova-compute[75229]: WARNING nova.compute.manager [req-41cce21c-0a6d-40e1-92d6-e8eadf0aca53 req-b6f2a1a2-4008-4255-833a-3a9fdfa07508 service nova] [instance: 30ae1f73-e0f3-4e26-987e-a684471a160d] Received unexpected event network-vif-unplugged-c087c657-8eee-4e8e-bef1-4281129597ae for instance with vm_state rescued and task_state unrescuing.
Nov 14 10:00:30 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:00:30 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:00:30 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:00:30 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-dc9718f8-13ae-442c-b823-b2447bf2a748 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance eba59006-83c1-4bda-b9f5-f3be4d1e5e58 {{(pid=75229) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 10:00:31 user nova-compute[75229]: INFO nova.virt.libvirt.driver [-] [instance: 30ae1f73-e0f3-4e26-987e-a684471a160d] Instance destroyed successfully.
Nov 14 10:00:32 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:00:32 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:00:32 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:00:32 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:00:32 user nova-compute[75229]: DEBUG nova.compute.manager [req-0908f26e-2f8b-4def-bc27-c76dd5d893a1 req-d5b37313-aec2-4a38-a367-a81ea56d5058 service nova] [instance: 30ae1f73-e0f3-4e26-987e-a684471a160d] Received event network-vif-plugged-c087c657-8eee-4e8e-bef1-4281129597ae {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 10:00:32 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-0908f26e-2f8b-4def-bc27-c76dd5d893a1 req-d5b37313-aec2-4a38-a367-a81ea56d5058 service nova] Acquiring lock "30ae1f73-e0f3-4e26-987e-a684471a160d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:00:32 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-0908f26e-2f8b-4def-bc27-c76dd5d893a1 req-d5b37313-aec2-4a38-a367-a81ea56d5058 service nova] Lock "30ae1f73-e0f3-4e26-987e-a684471a160d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:00:32 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-0908f26e-2f8b-4def-bc27-c76dd5d893a1 req-d5b37313-aec2-4a38-a367-a81ea56d5058 service nova] Lock "30ae1f73-e0f3-4e26-987e-a684471a160d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:00:32 user nova-compute[75229]: DEBUG nova.compute.manager [req-0908f26e-2f8b-4def-bc27-c76dd5d893a1 req-d5b37313-aec2-4a38-a367-a81ea56d5058 service nova] [instance: 30ae1f73-e0f3-4e26-987e-a684471a160d] No waiting events found dispatching network-vif-plugged-c087c657-8eee-4e8e-bef1-4281129597ae {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 10:00:32 user nova-compute[75229]: WARNING nova.compute.manager [req-0908f26e-2f8b-4def-bc27-c76dd5d893a1 req-d5b37313-aec2-4a38-a367-a81ea56d5058 service nova] [instance: 30ae1f73-e0f3-4e26-987e-a684471a160d] Received unexpected event network-vif-plugged-c087c657-8eee-4e8e-bef1-4281129597ae for instance with vm_state rescued and task_state unrescuing.
Nov 14 10:00:32 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:00:32 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:00:32 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-7a98b42c-0836-4f96-95de-8178f6352fb0 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Acquiring lock "d822d5e4-38d8-4ca7-a682-f2f2144b6005" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:00:32 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-7a98b42c-0836-4f96-95de-8178f6352fb0 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Lock "d822d5e4-38d8-4ca7-a682-f2f2144b6005" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:00:32 user nova-compute[75229]: DEBUG nova.compute.manager [None req-7a98b42c-0836-4f96-95de-8178f6352fb0 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] [instance: d822d5e4-38d8-4ca7-a682-f2f2144b6005] Starting instance... {{(pid=75229) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 10:00:32 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-7a98b42c-0836-4f96-95de-8178f6352fb0 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:00:32 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-7a98b42c-0836-4f96-95de-8178f6352fb0 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:00:32 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-7a98b42c-0836-4f96-95de-8178f6352fb0 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75229) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 10:00:32 user nova-compute[75229]: INFO nova.compute.claims [None req-7a98b42c-0836-4f96-95de-8178f6352fb0 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] [instance: d822d5e4-38d8-4ca7-a682-f2f2144b6005] Claim successful on node user
Nov 14 10:00:33 user nova-compute[75229]: DEBUG nova.compute.provider_tree [None req-7a98b42c-0836-4f96-95de-8178f6352fb0 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Inventory has not changed in ProviderTree for provider: d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 {{(pid=75229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 10:00:33 user nova-compute[75229]: DEBUG nova.scheduler.client.report [None req-7a98b42c-0836-4f96-95de-8178f6352fb0 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Inventory has not changed for provider d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 10:00:33 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-7a98b42c-0836-4f96-95de-8178f6352fb0 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.364s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:00:33 user nova-compute[75229]: DEBUG nova.compute.manager [None req-7a98b42c-0836-4f96-95de-8178f6352fb0 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] [instance: d822d5e4-38d8-4ca7-a682-f2f2144b6005] Start building networks asynchronously for instance. {{(pid=75229) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 10:00:33 user nova-compute[75229]: DEBUG nova.compute.manager [None req-7a98b42c-0836-4f96-95de-8178f6352fb0 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] [instance: d822d5e4-38d8-4ca7-a682-f2f2144b6005] Allocating IP information in the background. {{(pid=75229) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 10:00:33 user nova-compute[75229]: DEBUG nova.network.neutron [None req-7a98b42c-0836-4f96-95de-8178f6352fb0 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] [instance: d822d5e4-38d8-4ca7-a682-f2f2144b6005] allocate_for_instance() {{(pid=75229) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 10:00:33 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-7a98b42c-0836-4f96-95de-8178f6352fb0 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] [instance: d822d5e4-38d8-4ca7-a682-f2f2144b6005] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 10:00:33 user nova-compute[75229]: DEBUG nova.compute.manager [None req-7a98b42c-0836-4f96-95de-8178f6352fb0 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] [instance: d822d5e4-38d8-4ca7-a682-f2f2144b6005] Start building block device mappings for instance. {{(pid=75229) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 10:00:33 user nova-compute[75229]: DEBUG nova.policy [None req-7a98b42c-0836-4f96-95de-8178f6352fb0 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c26f33e4cdf14ba796445959953f8685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46620ac128944703899f22fe5439ba26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75229) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 10:00:33 user nova-compute[75229]: INFO nova.virt.block_device [None req-7a98b42c-0836-4f96-95de-8178f6352fb0 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] [instance: d822d5e4-38d8-4ca7-a682-f2f2144b6005] Booting with volume 2977635e-b11f-4ab2-875c-e9f396b932dc at /dev/vda
Nov 14 10:00:33 user nova-compute[75229]: DEBUG os_brick.utils [None req-7a98b42c-0836-4f96-95de-8178f6352fb0 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 10:00:33 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:00:33 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:00:33 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[29d7a4a2-9f15-4ad8-98d3-7ae8e9183e81]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f1154031c835\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:00:33 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:00:33 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:00:33 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[30efafb7-602d-40d4-b656-a0a4bfd8eeb8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:00:33 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:00:33 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:00:33 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[589c16b0-8be7-4379-89ec-9ffa147cdbb6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:00:33 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e7e9d94-a4b2-4006-b603-651ba979cc33]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:00:33 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-7a98b42c-0836-4f96-95de-8178f6352fb0 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Running cmd (subprocess): nvme version {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:00:33 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-7a98b42c-0836-4f96-95de-8178f6352fb0 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] 'nvme version' failed. Not Retrying. {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 10:00:33 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7a98b42c-0836-4f96-95de-8178f6352fb0 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] nvme not present on system {{(pid=75229) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 10:00:33 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:00:33 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 10:00:33 user nova-compute[75229]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 10:00:33 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[169103fe-93b4-4504-8a22-cf35e575b41e]: (4, '') {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:00:33 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.lightos [None req-7a98b42c-0836-4f96-95de-8178f6352fb0 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75229) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 10:00:33 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.lightos [None req-7a98b42c-0836-4f96-95de-8178f6352fb0 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75229) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 10:00:33 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.lightos [None req-7a98b42c-0836-4f96-95de-8178f6352fb0 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] LIGHTOS: no hostnqn found. {{(pid=75229) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 10:00:33 user nova-compute[75229]: DEBUG os_brick.utils [None req-7a98b42c-0836-4f96-95de-8178f6352fb0 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f1154031c835', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 10:00:33 user nova-compute[75229]: DEBUG nova.virt.block_device [None req-7a98b42c-0836-4f96-95de-8178f6352fb0 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] [instance: d822d5e4-38d8-4ca7-a682-f2f2144b6005] Updating existing volume attachment record: 4e7bed85-19ef-4265-9757-c10af167d0d2 {{(pid=75229) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 10:00:33 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:00:34 user nova-compute[75229]: DEBUG nova.network.neutron [None req-7a98b42c-0836-4f96-95de-8178f6352fb0 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] [instance: d822d5e4-38d8-4ca7-a682-f2f2144b6005] Successfully created port: 3f756f52-9183-4c6e-b60f-3d97c69fb495 {{(pid=75229) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 10:00:34 user nova-compute[75229]: DEBUG nova.compute.manager [req-e83874d2-af1f-4bbb-8778-c2b8b9f3b5a5 req-491b179e-8a8f-447b-825e-ca958621c71a service nova] [instance: 30ae1f73-e0f3-4e26-987e-a684471a160d] Received event network-vif-plugged-c087c657-8eee-4e8e-bef1-4281129597ae {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 10:00:34 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-e83874d2-af1f-4bbb-8778-c2b8b9f3b5a5 req-491b179e-8a8f-447b-825e-ca958621c71a service nova] Acquiring lock "30ae1f73-e0f3-4e26-987e-a684471a160d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:00:34 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-e83874d2-af1f-4bbb-8778-c2b8b9f3b5a5 req-491b179e-8a8f-447b-825e-ca958621c71a service nova] Lock "30ae1f73-e0f3-4e26-987e-a684471a160d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:00:34 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-e83874d2-af1f-4bbb-8778-c2b8b9f3b5a5 req-491b179e-8a8f-447b-825e-ca958621c71a service nova] Lock "30ae1f73-e0f3-4e26-987e-a684471a160d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:00:34 user nova-compute[75229]: DEBUG nova.compute.manager [req-e83874d2-af1f-4bbb-8778-c2b8b9f3b5a5 req-491b179e-8a8f-447b-825e-ca958621c71a service nova] [instance: 30ae1f73-e0f3-4e26-987e-a684471a160d] No waiting events found dispatching network-vif-plugged-c087c657-8eee-4e8e-bef1-4281129597ae {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 10:00:34 user nova-compute[75229]: WARNING nova.compute.manager [req-e83874d2-af1f-4bbb-8778-c2b8b9f3b5a5 req-491b179e-8a8f-447b-825e-ca958621c71a service nova] [instance: 30ae1f73-e0f3-4e26-987e-a684471a160d] Received unexpected event network-vif-plugged-c087c657-8eee-4e8e-bef1-4281129597ae for instance with vm_state rescued and task_state unrescuing.
Nov 14 10:00:34 user nova-compute[75229]: DEBUG nova.compute.manager [req-e83874d2-af1f-4bbb-8778-c2b8b9f3b5a5 req-491b179e-8a8f-447b-825e-ca958621c71a service nova] [instance: 30ae1f73-e0f3-4e26-987e-a684471a160d] Received event network-vif-plugged-c087c657-8eee-4e8e-bef1-4281129597ae {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 10:00:34 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-e83874d2-af1f-4bbb-8778-c2b8b9f3b5a5 req-491b179e-8a8f-447b-825e-ca958621c71a service nova] Acquiring lock "30ae1f73-e0f3-4e26-987e-a684471a160d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:00:34 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-e83874d2-af1f-4bbb-8778-c2b8b9f3b5a5 req-491b179e-8a8f-447b-825e-ca958621c71a service nova] Lock "30ae1f73-e0f3-4e26-987e-a684471a160d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:00:34 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-e83874d2-af1f-4bbb-8778-c2b8b9f3b5a5 req-491b179e-8a8f-447b-825e-ca958621c71a service nova] Lock "30ae1f73-e0f3-4e26-987e-a684471a160d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:00:34 user nova-compute[75229]: DEBUG nova.compute.manager [req-e83874d2-af1f-4bbb-8778-c2b8b9f3b5a5 req-491b179e-8a8f-447b-825e-ca958621c71a service nova] [instance: 30ae1f73-e0f3-4e26-987e-a684471a160d] No waiting events found dispatching network-vif-plugged-c087c657-8eee-4e8e-bef1-4281129597ae {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 10:00:34 user nova-compute[75229]: WARNING nova.compute.manager [req-e83874d2-af1f-4bbb-8778-c2b8b9f3b5a5 req-491b179e-8a8f-447b-825e-ca958621c71a service nova] [instance: 30ae1f73-e0f3-4e26-987e-a684471a160d] Received unexpected event network-vif-plugged-c087c657-8eee-4e8e-bef1-4281129597ae for instance with vm_state rescued and task_state unrescuing.
Nov 14 10:00:34 user nova-compute[75229]: DEBUG nova.compute.manager [None req-c74d1195-99ae-42df-b7c1-aba85ed05301 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] [instance: 30ae1f73-e0f3-4e26-987e-a684471a160d] Checking state {{(pid=75229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 10:00:34 user nova-compute[75229]: DEBUG nova.network.neutron [None req-7a98b42c-0836-4f96-95de-8178f6352fb0 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] [instance: d822d5e4-38d8-4ca7-a682-f2f2144b6005] Successfully updated port: 3f756f52-9183-4c6e-b60f-3d97c69fb495 {{(pid=75229) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 10:00:34 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-7a98b42c-0836-4f96-95de-8178f6352fb0 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Acquiring lock "refresh_cache-d822d5e4-38d8-4ca7-a682-f2f2144b6005" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 10:00:34 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-7a98b42c-0836-4f96-95de-8178f6352fb0 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Acquired lock "refresh_cache-d822d5e4-38d8-4ca7-a682-f2f2144b6005" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 10:00:34 user nova-compute[75229]: DEBUG nova.network.neutron [None req-7a98b42c-0836-4f96-95de-8178f6352fb0 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] [instance: d822d5e4-38d8-4ca7-a682-f2f2144b6005] Building network info cache for instance {{(pid=75229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 10:00:34 user nova-compute[75229]: DEBUG nova.network.neutron [None req-7a98b42c-0836-4f96-95de-8178f6352fb0 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] [instance: d822d5e4-38d8-4ca7-a682-f2f2144b6005] Instance cache missing network info. {{(pid=75229) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 10:00:35 user nova-compute[75229]: DEBUG nova.network.neutron [None req-7a98b42c-0836-4f96-95de-8178f6352fb0 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] [instance: d822d5e4-38d8-4ca7-a682-f2f2144b6005] Updating instance_info_cache with network_info: [{"id": "3f756f52-9183-4c6e-b60f-3d97c69fb495", "address": "fa:16:3e:94:54:20", "network": {"id": "118ea7c1-77c0-4660-b7b7-f311f6b0ec8a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1907578504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46620ac128944703899f22fe5439ba26", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f756f52-91", "ovs_interfaceid": "3f756f52-9183-4c6e-b60f-3d97c69fb495", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 10:00:35 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-7a98b42c-0836-4f96-95de-8178f6352fb0 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Releasing lock "refresh_cache-d822d5e4-38d8-4ca7-a682-f2f2144b6005" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 10:00:35 user nova-compute[75229]: DEBUG nova.compute.manager [None req-7a98b42c-0836-4f96-95de-8178f6352fb0 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] [instance: d822d5e4-38d8-4ca7-a682-f2f2144b6005] Instance network_info: |[{"id": "3f756f52-9183-4c6e-b60f-3d97c69fb495", "address": "fa:16:3e:94:54:20", "network": {"id": "118ea7c1-77c0-4660-b7b7-f311f6b0ec8a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1907578504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46620ac128944703899f22fe5439ba26", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f756f52-91", "ovs_interfaceid": "3f756f52-9183-4c6e-b60f-3d97c69fb495", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75229) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 10:00:35 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:00:36 user nova-compute[75229]: DEBUG nova.compute.manager [req-64d8f769-9dd5-4408-abca-3db6ffa7cd1d req-727ba824-0f0f-40da-8881-188bad1a5f0e service nova] [instance: d822d5e4-38d8-4ca7-a682-f2f2144b6005] Received event network-changed-3f756f52-9183-4c6e-b60f-3d97c69fb495 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 10:00:36 user nova-compute[75229]: DEBUG nova.compute.manager [req-64d8f769-9dd5-4408-abca-3db6ffa7cd1d req-727ba824-0f0f-40da-8881-188bad1a5f0e service nova] [instance: d822d5e4-38d8-4ca7-a682-f2f2144b6005] Refreshing instance network info cache due to event network-changed-3f756f52-9183-4c6e-b60f-3d97c69fb495. {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 10:00:36 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-64d8f769-9dd5-4408-abca-3db6ffa7cd1d req-727ba824-0f0f-40da-8881-188bad1a5f0e service nova] Acquiring lock "refresh_cache-d822d5e4-38d8-4ca7-a682-f2f2144b6005" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 10:00:36 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-64d8f769-9dd5-4408-abca-3db6ffa7cd1d req-727ba824-0f0f-40da-8881-188bad1a5f0e service nova] Acquired lock "refresh_cache-d822d5e4-38d8-4ca7-a682-f2f2144b6005" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 10:00:36 user nova-compute[75229]: DEBUG nova.network.neutron [req-64d8f769-9dd5-4408-abca-3db6ffa7cd1d req-727ba824-0f0f-40da-8881-188bad1a5f0e service nova] [instance: d822d5e4-38d8-4ca7-a682-f2f2144b6005] Refreshing network info cache for port 3f756f52-9183-4c6e-b60f-3d97c69fb495 {{(pid=75229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 10:00:37 user nova-compute[75229]: DEBUG nova.network.neutron [req-64d8f769-9dd5-4408-abca-3db6ffa7cd1d req-727ba824-0f0f-40da-8881-188bad1a5f0e service nova] [instance: d822d5e4-38d8-4ca7-a682-f2f2144b6005] Updated VIF entry in instance network info cache for port 3f756f52-9183-4c6e-b60f-3d97c69fb495. {{(pid=75229) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 10:00:37 user nova-compute[75229]: DEBUG nova.network.neutron [req-64d8f769-9dd5-4408-abca-3db6ffa7cd1d req-727ba824-0f0f-40da-8881-188bad1a5f0e service nova] [instance: d822d5e4-38d8-4ca7-a682-f2f2144b6005] Updating instance_info_cache with network_info: [{"id": "3f756f52-9183-4c6e-b60f-3d97c69fb495", "address": "fa:16:3e:94:54:20", "network": {"id": "118ea7c1-77c0-4660-b7b7-f311f6b0ec8a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1907578504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46620ac128944703899f22fe5439ba26", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f756f52-91", "ovs_interfaceid": "3f756f52-9183-4c6e-b60f-3d97c69fb495", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 10:00:37 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-64d8f769-9dd5-4408-abca-3db6ffa7cd1d req-727ba824-0f0f-40da-8881-188bad1a5f0e service nova] Releasing lock "refresh_cache-d822d5e4-38d8-4ca7-a682-f2f2144b6005" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 10:00:38 user nova-compute[75229]: DEBUG nova.compute.manager [None req-7a98b42c-0836-4f96-95de-8178f6352fb0 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] [instance: d822d5e4-38d8-4ca7-a682-f2f2144b6005] Start spawning the instance on the hypervisor. {{(pid=75229) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 10:00:38 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-7a98b42c-0836-4f96-95de-8178f6352fb0 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] [instance: d822d5e4-38d8-4ca7-a682-f2f2144b6005] Creating instance directory {{(pid=75229) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 10:00:38 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-7a98b42c-0836-4f96-95de-8178f6352fb0 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] [instance: d822d5e4-38d8-4ca7-a682-f2f2144b6005] Creating image(s)
Nov 14 10:00:38 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-7a98b42c-0836-4f96-95de-8178f6352fb0 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] [instance: d822d5e4-38d8-4ca7-a682-f2f2144b6005] Did not create local disks {{(pid=75229) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 14 10:00:38 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-7a98b42c-0836-4f96-95de-8178f6352fb0 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] [instance: d822d5e4-38d8-4ca7-a682-f2f2144b6005] Ensure instance console log exists: /opt/stack/data/nova/instances/d822d5e4-38d8-4ca7-a682-f2f2144b6005/console.log {{(pid=75229) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 10:00:38 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-7a98b42c-0836-4f96-95de-8178f6352fb0 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:00:38 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-7a98b42c-0836-4f96-95de-8178f6352fb0 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:00:38 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-7a98b42c-0836-4f96-95de-8178f6352fb0 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:00:38 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-7a98b42c-0836-4f96-95de-8178f6352fb0 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] [instance: d822d5e4-38d8-4ca7-a682-f2f2144b6005] Start _get_guest_xml network_info=[{"id": "3f756f52-9183-4c6e-b60f-3d97c69fb495", "address": "fa:16:3e:94:54:20", "network": {"id": "118ea7c1-77c0-4660-b7b7-f311f6b0ec8a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1907578504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46620ac128944703899f22fe5439ba26", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f756f52-91", "ovs_interfaceid": "3f756f52-9183-4c6e-b60f-3d97c69fb495", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:2977635e-b11f-4ab2-875c-e9f396b932dc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VaSGPUnJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'd822d5e4-38d8-4ca7-a682-f2f2144b6005', 'attached_at': '', 'detached_at': '', 'volume_id': '2977635e-b11f-4ab2-875c-e9f396b932dc', 'serial': '2977635e-b11f-4ab2-875c-e9f396b932dc'}, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'attachment_id': '4e7bed85-19ef-4265-9757-c10af167d0d2', 'guest_format': None, 'device_type': 'disk', 'volume_type': None} {{(pid=75229) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 10:00:38 user nova-compute[75229]: WARNING nova.virt.libvirt.driver [None req-7a98b42c-0836-4f96-95de-8178f6352fb0 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 10:00:38 user nova-compute[75229]: WARNING nova.virt.libvirt.driver [None req-7a98b42c-0836-4f96-95de-8178f6352fb0 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 10:00:38 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-7a98b42c-0836-4f96-95de-8178f6352fb0 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75229) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 10:00:38 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-7a98b42c-0836-4f96-95de-8178f6352fb0 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] CPU controller missing on host. {{(pid=75229) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 10:00:38 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-7a98b42c-0836-4f96-95de-8178f6352fb0 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75229) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 10:00:38 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-7a98b42c-0836-4f96-95de-8178f6352fb0 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] CPU controller found on host. {{(pid=75229) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 10:00:38 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-7a98b42c-0836-4f96-95de-8178f6352fb0 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75229) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 10:00:38 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-7a98b42c-0836-4f96-95de-8178f6352fb0 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T09:39:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 10:00:38 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-7a98b42c-0836-4f96-95de-8178f6352fb0 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Flavor limits 0:0:0 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 10:00:38 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-7a98b42c-0836-4f96-95de-8178f6352fb0 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Image limits 0:0:0 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 10:00:38 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-7a98b42c-0836-4f96-95de-8178f6352fb0 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Flavor pref 0:0:0 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 10:00:38 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-7a98b42c-0836-4f96-95de-8178f6352fb0 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Image pref 0:0:0 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 10:00:38 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-7a98b42c-0836-4f96-95de-8178f6352fb0 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 10:00:38 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-7a98b42c-0836-4f96-95de-8178f6352fb0 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 10:00:38 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-7a98b42c-0836-4f96-95de-8178f6352fb0 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75229) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 10:00:38 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-7a98b42c-0836-4f96-95de-8178f6352fb0 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Got 1 possible topologies {{(pid=75229) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 10:00:38 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-7a98b42c-0836-4f96-95de-8178f6352fb0 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 10:00:38 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-7a98b42c-0836-4f96-95de-8178f6352fb0 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 10:00:38 user nova-compute[75229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7a98b42c-0836-4f96-95de-8178f6352fb0 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] [instance: d822d5e4-38d8-4ca7-a682-f2f2144b6005] Calling os-brick to attach iSCSI Volume {{(pid=75229) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 10:00:38 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a98b42c-0836-4f96-95de-8178f6352fb0 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f73f85151b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2977635e-b11f-4ab2-875c-e9f396b932dc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VaSGPUnJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 10:00:38 user nova-compute[75229]: WARNING os_brick.initiator.connectors.base [None req-7a98b42c-0836-4f96-95de-8178f6352fb0 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 10:00:38 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-7a98b42c-0836-4f96-95de-8178f6352fb0 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 10:00:38 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-7a98b42c-0836-4f96-95de-8178f6352fb0 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 10:00:38 user nova-compute[75229]: WARNING os_brick.initiator.connectors.base [None req-7a98b42c-0836-4f96-95de-8178f6352fb0 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 10:00:38 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-7a98b42c-0836-4f96-95de-8178f6352fb0 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2977635e-b11f-4ab2-875c-e9f396b932dc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 10:00:38 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-7a98b42c-0836-4f96-95de-8178f6352fb0 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2977635e-b11f-4ab2-875c-e9f396b932dc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 10:00:38 user nova-compute[75229]: INFO os_brick.initiator.connectors.iscsi [None req-7a98b42c-0836-4f96-95de-8178f6352fb0 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 10:00:38 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2977635e-b11f-4ab2-875c-e9f396b932dc -p 172.16.0.220:3260 {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:00:38 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2977635e-b11f-4ab2-875c-e9f396b932dc -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:00:38 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb9842d7-d03c-4c82-aa12-7d031476345b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:00:38 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a98b42c-0836-4f96-95de-8178f6352fb0 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 10:00:38 user nova-compute[75229]:  {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 10:00:38 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2977635e-b11f-4ab2-875c-e9f396b932dc -p 172.16.0.220:3260 --interface default --op new {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:00:38 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2977635e-b11f-4ab2-875c-e9f396b932dc -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:00:38 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[403b8cba-3efb-4581-94b4-c6ca65910d98]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2977635e-b11f-4ab2-875c-e9f396b932dc] added\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:00:38 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a98b42c-0836-4f96-95de-8178f6352fb0 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2977635e-b11f-4ab2-875c-e9f396b932dc] added
Nov 14 10:00:38 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 10:00:38 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2977635e-b11f-4ab2-875c-e9f396b932dc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:00:38 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2977635e-b11f-4ab2-875c-e9f396b932dc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:00:38 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[1618d9ca-d8e1-4214-abae-02d41f68b905]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:00:38 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a98b42c-0836-4f96-95de-8178f6352fb0 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 10:00:38 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2977635e-b11f-4ab2-875c-e9f396b932dc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:00:38 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2977635e-b11f-4ab2-875c-e9f396b932dc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:00:38 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[11e837ad-2a92-41e3-8f55-6e11b8468723]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:00:38 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a98b42c-0836-4f96-95de-8178f6352fb0 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 10:00:38 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2977635e-b11f-4ab2-875c-e9f396b932dc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VaSGPUnJ {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:00:38 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2977635e-b11f-4ab2-875c-e9f396b932dc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VaSGPUnJ" returned: 0 in 0.018s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:00:38 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7b79652-6845-43dc-b077-5fbeaad524d7]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:00:38 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a98b42c-0836-4f96-95de-8178f6352fb0 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'VaSGPUnJ'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 10:00:38 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2977635e-b11f-4ab2-875c-e9f396b932dc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:00:38 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2977635e-b11f-4ab2-875c-e9f396b932dc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:00:38 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[68e42d37-0987-401b-9976-273acafe8495]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:00:38 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a98b42c-0836-4f96-95de-8178f6352fb0 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 10:00:38 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:00:38 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:00:38 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6ab5c42-e877-42d0-93ad-75f8fd17cff6]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aebc438-0289-44fe-ad84-4e696468f50e (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5efb0e0-a85c-46ec-8a9d-2763bf548023 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:143891e8-62eb-42d7-b076-db6f52b4f606 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2df516f3-0635-44ed-8a28-e74c0ebaeeaf (non-flash)\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:00:38 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a98b42c-0836-4f96-95de-8178f6352fb0 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aebc438-0289-44fe-ad84-4e696468f50e (non-flash)
Nov 14 10:00:38 user nova-compute[75229]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5efb0e0-a85c-46ec-8a9d-2763bf548023 (non-flash)
Nov 14 10:00:38 user nova-compute[75229]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:143891e8-62eb-42d7-b076-db6f52b4f606 (non-flash)
Nov 14 10:00:38 user nova-compute[75229]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2df516f3-0635-44ed-8a28-e74c0ebaeeaf (non-flash)
Nov 14 10:00:38 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 10:00:38 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a98b42c-0836-4f96-95de-8178f6352fb0 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aebc438-0289-44fe-ad84-4e696468f50e (non-flash)
Nov 14 10:00:38 user nova-compute[75229]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5efb0e0-a85c-46ec-8a9d-2763bf548023 (non-flash)
Nov 14 10:00:38 user nova-compute[75229]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:143891e8-62eb-42d7-b076-db6f52b4f606 (non-flash)
Nov 14 10:00:38 user nova-compute[75229]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2df516f3-0635-44ed-8a28-e74c0ebaeeaf (non-flash)
Nov 14 10:00:38 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 10:00:38 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2977635e-b11f-4ab2-875c-e9f396b932dc -p 172.16.0.220:3260 --login {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:00:38 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2977635e-b11f-4ab2-875c-e9f396b932dc -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:00:38 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[5eb41e9f-f29c-400b-a237-22d38e3e7889]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2977635e-b11f-4ab2-875c-e9f396b932dc, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2977635e-b11f-4ab2-875c-e9f396b932dc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:00:38 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a98b42c-0836-4f96-95de-8178f6352fb0 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2977635e-b11f-4ab2-875c-e9f396b932dc, portal: 172.16.0.220,3260]
Nov 14 10:00:38 user nova-compute[75229]: Login to [iface: default, target: iqn.2010-10.org.openstack:2977635e-b11f-4ab2-875c-e9f396b932dc, portal: 172.16.0.220,3260] successful.
Nov 14 10:00:38 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 10:00:38 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2977635e-b11f-4ab2-875c-e9f396b932dc -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:00:38 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2977635e-b11f-4ab2-875c-e9f396b932dc -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:00:38 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f54e515-65d4-4c6a-95cf-7a89606bf975]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:00:38 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a98b42c-0836-4f96-95de-8178f6352fb0 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 10:00:38 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:00:38 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:00:38 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[b93f2eb2-999f-47ec-8f79-e6487b3cba27]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aebc438-0289-44fe-ad84-4e696468f50e (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5efb0e0-a85c-46ec-8a9d-2763bf548023 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:143891e8-62eb-42d7-b076-db6f52b4f606 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2df516f3-0635-44ed-8a28-e74c0ebaeeaf (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2977635e-b11f-4ab2-875c-e9f396b932dc (non-flash)\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:00:38 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a98b42c-0836-4f96-95de-8178f6352fb0 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aebc438-0289-44fe-ad84-4e696468f50e (non-flash)
Nov 14 10:00:38 user nova-compute[75229]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5efb0e0-a85c-46ec-8a9d-2763bf548023 (non-flash)
Nov 14 10:00:38 user nova-compute[75229]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:143891e8-62eb-42d7-b076-db6f52b4f606 (non-flash)
Nov 14 10:00:38 user nova-compute[75229]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2df516f3-0635-44ed-8a28-e74c0ebaeeaf (non-flash)
Nov 14 10:00:38 user nova-compute[75229]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2977635e-b11f-4ab2-875c-e9f396b932dc (non-flash)
Nov 14 10:00:38 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 10:00:38 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a98b42c-0836-4f96-95de-8178f6352fb0 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aebc438-0289-44fe-ad84-4e696468f50e (non-flash)
Nov 14 10:00:38 user nova-compute[75229]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5efb0e0-a85c-46ec-8a9d-2763bf548023 (non-flash)
Nov 14 10:00:38 user nova-compute[75229]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:143891e8-62eb-42d7-b076-db6f52b4f606 (non-flash)
Nov 14 10:00:38 user nova-compute[75229]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2df516f3-0635-44ed-8a28-e74c0ebaeeaf (non-flash)
Nov 14 10:00:38 user nova-compute[75229]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2977635e-b11f-4ab2-875c-e9f396b932dc (non-flash)
Nov 14 10:00:38 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 10:00:38 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-7a98b42c-0836-4f96-95de-8178f6352fb0 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2977635e-b11f-4ab2-875c-e9f396b932dc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.274s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 10:00:38 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a98b42c-0836-4f96-95de-8178f6352fb0 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Connected to 172.16.0.220:3260 {{(pid=75229) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 10:00:38 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-7a98b42c-0836-4f96-95de-8178f6352fb0 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] HCTL ('36', '-', '-', 0) found on session 40 with lun 0 {{(pid=75229) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 10:00:38 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-7a98b42c-0836-4f96-95de-8178f6352fb0 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75229) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 10:00:38 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:00:38 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.017s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:00:38 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc8b797d-2445-480e-8634-290de1f23b71]: (4, ('- - 0', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:00:38 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-7a98b42c-0836-4f96-95de-8178f6352fb0 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Searching for a device in session 40 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75229) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 10:00:38 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a98b42c-0836-4f96-95de-8178f6352fb0 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:2977635e-b11f-4ab2-875c-e9f396b932dc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VaSGPUnJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75229) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 10:00:38 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:00:39 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-7a98b42c-0836-4f96-95de-8178f6352fb0 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.306s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 10:00:39 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a98b42c-0836-4f96-95de-8178f6352fb0 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] <== connect_volume: return (1307ms) {'type': 'block', 'scsi_wwn': '23031633932633638', 'path': '/dev/sde'} {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 10:00:39 user nova-compute[75229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7a98b42c-0836-4f96-95de-8178f6352fb0 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] [instance: d822d5e4-38d8-4ca7-a682-f2f2144b6005] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23031633932633638', 'path': '/dev/sde'} {{(pid=75229) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 10:00:39 user nova-compute[75229]: DEBUG nova.virt.libvirt.vif [None req-7a98b42c-0836-4f96-95de-8178f6352fb0 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T10:00:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1599799090',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1599799090',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1599799090',id=38,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL/Fx+ZqkknLgNPJ2yVd0tCjEVNGsbcpxMVwrZi/JJJlfpTSFfkoclUYXmNoXHeiNcE9pe2+U6gpoOkPULo7ZUsGfqSEpaen603sif45gUXHgSucQ6kfx+AWEHlsj1z7Fg==',key_name='tempest-keypair-739982694',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='46620ac128944703899f22fe5439ba26',ramdisk_id='',reservation_id='r-rvtr1vr3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2064993142',owner_user_name='tempest-TestVolumeBootPattern-2064993142-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T10:00:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c26f33e4cdf14ba796445959953f8685',uuid=d822d5e4-38d8-4ca7-a682-f2f2144b6005,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3f756f52-9183-4c6e-b60f-3d97c69fb495", "address": "fa:16:3e:94:54:20", "network": {"id": "118ea7c1-77c0-4660-b7b7-f311f6b0ec8a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1907578504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46620ac128944703899f22fe5439ba26", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f756f52-91", "ovs_interfaceid": "3f756f52-9183-4c6e-b60f-3d97c69fb495", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75229) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 10:00:39 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-7a98b42c-0836-4f96-95de-8178f6352fb0 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Converting VIF {"id": "3f756f52-9183-4c6e-b60f-3d97c69fb495", "address": "fa:16:3e:94:54:20", "network": {"id": "118ea7c1-77c0-4660-b7b7-f311f6b0ec8a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1907578504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46620ac128944703899f22fe5439ba26", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f756f52-91", "ovs_interfaceid": "3f756f52-9183-4c6e-b60f-3d97c69fb495", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 10:00:39 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-7a98b42c-0836-4f96-95de-8178f6352fb0 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:94:54:20,bridge_name='br-int',has_traffic_filtering=True,id=3f756f52-9183-4c6e-b60f-3d97c69fb495,network=Network(118ea7c1-77c0-4660-b7b7-f311f6b0ec8a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3f756f52-91') {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 10:00:39 user nova-compute[75229]: DEBUG nova.objects.instance [None req-7a98b42c-0836-4f96-95de-8178f6352fb0 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Lazy-loading 'pci_devices' on Instance uuid d822d5e4-38d8-4ca7-a682-f2f2144b6005 {{(pid=75229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 10:00:39 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-7a98b42c-0836-4f96-95de-8178f6352fb0 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] [instance: d822d5e4-38d8-4ca7-a682-f2f2144b6005] End _get_guest_xml xml=<domain type="kvm">
Nov 14 10:00:39 user nova-compute[75229]:   <uuid>d822d5e4-38d8-4ca7-a682-f2f2144b6005</uuid>
Nov 14 10:00:39 user nova-compute[75229]:   <name>instance-00000026</name>
Nov 14 10:00:39 user nova-compute[75229]:   <memory>524288</memory>
Nov 14 10:00:39 user nova-compute[75229]:   <vcpu>1</vcpu>
Nov 14 10:00:39 user nova-compute[75229]:   <metadata>
Nov 14 10:00:39 user nova-compute[75229]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 10:00:39 user nova-compute[75229]:       <nova:package version="0.0.0"/>
Nov 14 10:00:39 user nova-compute[75229]:       <nova:name>tempest-TestVolumeBootPattern-volume-backed-server-1599799090</nova:name>
Nov 14 10:00:39 user nova-compute[75229]:       <nova:creationTime>2023-11-14 10:00:38</nova:creationTime>
Nov 14 10:00:39 user nova-compute[75229]:       <nova:flavor name="m1.tiny">
Nov 14 10:00:39 user nova-compute[75229]:         <nova:memory>512</nova:memory>
Nov 14 10:00:39 user nova-compute[75229]:         <nova:disk>1</nova:disk>
Nov 14 10:00:39 user nova-compute[75229]:         <nova:swap>0</nova:swap>
Nov 14 10:00:39 user nova-compute[75229]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 10:00:39 user nova-compute[75229]:         <nova:vcpus>1</nova:vcpus>
Nov 14 10:00:39 user nova-compute[75229]:       </nova:flavor>
Nov 14 10:00:39 user nova-compute[75229]:       <nova:owner>
Nov 14 10:00:39 user nova-compute[75229]:         <nova:user uuid="c26f33e4cdf14ba796445959953f8685">tempest-TestVolumeBootPattern-2064993142-project-member</nova:user>
Nov 14 10:00:39 user nova-compute[75229]:         <nova:project uuid="46620ac128944703899f22fe5439ba26">tempest-TestVolumeBootPattern-2064993142</nova:project>
Nov 14 10:00:39 user nova-compute[75229]:       </nova:owner>
Nov 14 10:00:39 user nova-compute[75229]:       <nova:ports>
Nov 14 10:00:39 user nova-compute[75229]:         <nova:port uuid="3f756f52-9183-4c6e-b60f-3d97c69fb495">
Nov 14 10:00:39 user nova-compute[75229]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 14 10:00:39 user nova-compute[75229]:         </nova:port>
Nov 14 10:00:39 user nova-compute[75229]:       </nova:ports>
Nov 14 10:00:39 user nova-compute[75229]:     </nova:instance>
Nov 14 10:00:39 user nova-compute[75229]:   </metadata>
Nov 14 10:00:39 user nova-compute[75229]:   <sysinfo type="smbios">
Nov 14 10:00:39 user nova-compute[75229]:     <system>
Nov 14 10:00:39 user nova-compute[75229]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 10:00:39 user nova-compute[75229]:       <entry name="product">OpenStack Nova</entry>
Nov 14 10:00:39 user nova-compute[75229]:       <entry name="version">0.0.0</entry>
Nov 14 10:00:39 user nova-compute[75229]:       <entry name="serial">d822d5e4-38d8-4ca7-a682-f2f2144b6005</entry>
Nov 14 10:00:39 user nova-compute[75229]:       <entry name="uuid">d822d5e4-38d8-4ca7-a682-f2f2144b6005</entry>
Nov 14 10:00:39 user nova-compute[75229]:       <entry name="family">Virtual Machine</entry>
Nov 14 10:00:39 user nova-compute[75229]:     </system>
Nov 14 10:00:39 user nova-compute[75229]:   </sysinfo>
Nov 14 10:00:39 user nova-compute[75229]:   <os>
Nov 14 10:00:39 user nova-compute[75229]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 10:00:39 user nova-compute[75229]:     <boot dev="hd"/>
Nov 14 10:00:39 user nova-compute[75229]:     <smbios mode="sysinfo"/>
Nov 14 10:00:39 user nova-compute[75229]:   </os>
Nov 14 10:00:39 user nova-compute[75229]:   <features>
Nov 14 10:00:39 user nova-compute[75229]:     <acpi/>
Nov 14 10:00:39 user nova-compute[75229]:     <apic/>
Nov 14 10:00:39 user nova-compute[75229]:     <vmcoreinfo/>
Nov 14 10:00:39 user nova-compute[75229]:   </features>
Nov 14 10:00:39 user nova-compute[75229]:   <clock offset="utc">
Nov 14 10:00:39 user nova-compute[75229]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 10:00:39 user nova-compute[75229]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 10:00:39 user nova-compute[75229]:     <timer name="hpet" present="no"/>
Nov 14 10:00:39 user nova-compute[75229]:   </clock>
Nov 14 10:00:39 user nova-compute[75229]:   <cpu mode="custom" match="exact">
Nov 14 10:00:39 user nova-compute[75229]:     <model>Nehalem</model>
Nov 14 10:00:39 user nova-compute[75229]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 10:00:39 user nova-compute[75229]:   </cpu>
Nov 14 10:00:39 user nova-compute[75229]:   <devices>
Nov 14 10:00:39 user nova-compute[75229]:     <disk type="block" device="disk">
Nov 14 10:00:39 user nova-compute[75229]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 10:00:39 user nova-compute[75229]:       <source dev="/dev/sde"/>
Nov 14 10:00:39 user nova-compute[75229]:       <target dev="vda" bus="virtio"/>
Nov 14 10:00:39 user nova-compute[75229]:       <serial>2977635e-b11f-4ab2-875c-e9f396b932dc</serial>
Nov 14 10:00:39 user nova-compute[75229]:     </disk>
Nov 14 10:00:39 user nova-compute[75229]:     <interface type="ethernet">
Nov 14 10:00:39 user nova-compute[75229]:       <mac address="fa:16:3e:94:54:20"/>
Nov 14 10:00:39 user nova-compute[75229]:       <model type="virtio"/>
Nov 14 10:00:39 user nova-compute[75229]:       <mtu size="1442"/>
Nov 14 10:00:39 user nova-compute[75229]:       <target dev="tap3f756f52-91"/>
Nov 14 10:00:39 user nova-compute[75229]:     </interface>
Nov 14 10:00:39 user nova-compute[75229]:     <serial type="pty">
Nov 14 10:00:39 user nova-compute[75229]:       <log file="/opt/stack/data/nova/instances/d822d5e4-38d8-4ca7-a682-f2f2144b6005/console.log" append="off"/>
Nov 14 10:00:39 user nova-compute[75229]:     </serial>
Nov 14 10:00:39 user nova-compute[75229]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 10:00:39 user nova-compute[75229]:     <video>
Nov 14 10:00:39 user nova-compute[75229]:       <model type="virtio"/>
Nov 14 10:00:39 user nova-compute[75229]:     </video>
Nov 14 10:00:39 user nova-compute[75229]:     <rng model="virtio">
Nov 14 10:00:39 user nova-compute[75229]:       <backend model="random">/dev/urandom</backend>
Nov 14 10:00:39 user nova-compute[75229]:     </rng>
Nov 14 10:00:39 user nova-compute[75229]:     <controller type="usb" index="0" model="none"/>
Nov 14 10:00:39 user nova-compute[75229]:     <memballoon model="virtio">
Nov 14 10:00:39 user nova-compute[75229]:       <stats period="10"/>
Nov 14 10:00:39 user nova-compute[75229]:     </memballoon>
Nov 14 10:00:39 user nova-compute[75229]:   </devices>
Nov 14 10:00:39 user nova-compute[75229]: </domain>
Nov 14 10:00:39 user nova-compute[75229]:  {{(pid=75229) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 10:00:39 user nova-compute[75229]: DEBUG nova.virt.libvirt.vif [None req-7a98b42c-0836-4f96-95de-8178f6352fb0 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T10:00:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1599799090',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1599799090',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1599799090',id=38,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL/Fx+ZqkknLgNPJ2yVd0tCjEVNGsbcpxMVwrZi/JJJlfpTSFfkoclUYXmNoXHeiNcE9pe2+U6gpoOkPULo7ZUsGfqSEpaen603sif45gUXHgSucQ6kfx+AWEHlsj1z7Fg==',key_name='tempest-keypair-739982694',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='46620ac128944703899f22fe5439ba26',ramdisk_id='',reservation_id='r-rvtr1vr3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2064993142',owner_user_name='tempest-TestVolumeBootPattern-2064993142-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T10:00:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c26f33e4cdf14ba796445959953f8685',uuid=d822d5e4-38d8-4ca7-a682-f2f2144b6005,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3f756f52-9183-4c6e-b60f-3d97c69fb495", "address": "fa:16:3e:94:54:20", "network": {"id": "118ea7c1-77c0-4660-b7b7-f311f6b0ec8a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1907578504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46620ac128944703899f22fe5439ba26", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f756f52-91", "ovs_interfaceid": "3f756f52-9183-4c6e-b60f-3d97c69fb495", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 10:00:39 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-7a98b42c-0836-4f96-95de-8178f6352fb0 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Converting VIF {"id": "3f756f52-9183-4c6e-b60f-3d97c69fb495", "address": "fa:16:3e:94:54:20", "network": {"id": "118ea7c1-77c0-4660-b7b7-f311f6b0ec8a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1907578504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46620ac128944703899f22fe5439ba26", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f756f52-91", "ovs_interfaceid": "3f756f52-9183-4c6e-b60f-3d97c69fb495", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 10:00:39 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-7a98b42c-0836-4f96-95de-8178f6352fb0 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:94:54:20,bridge_name='br-int',has_traffic_filtering=True,id=3f756f52-9183-4c6e-b60f-3d97c69fb495,network=Network(118ea7c1-77c0-4660-b7b7-f311f6b0ec8a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3f756f52-91') {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 10:00:39 user nova-compute[75229]: DEBUG os_vif [None req-7a98b42c-0836-4f96-95de-8178f6352fb0 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:94:54:20,bridge_name='br-int',has_traffic_filtering=True,id=3f756f52-9183-4c6e-b60f-3d97c69fb495,network=Network(118ea7c1-77c0-4660-b7b7-f311f6b0ec8a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3f756f52-91') {{(pid=75229) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 10:00:39 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:00:39 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 10:00:39 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 10:00:39 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:00:39 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '72c8cddb-2a10-5810-9887-062a788c03da', '_type': 'linux-noop'}}, row=False) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 10:00:39 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:00:39 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 10:00:39 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:00:39 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3f756f52-91, may_exist=True, interface_attrs={}) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 10:00:39 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3f756f52-91, col_values=(('qos', UUID('664be255-d3a0-45d4-8eec-f0762117f9c4')),), if_exists=True) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 10:00:39 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3f756f52-91, col_values=(('external_ids', {'iface-id': '3f756f52-9183-4c6e-b60f-3d97c69fb495', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:94:54:20', 'vm-uuid': 'd822d5e4-38d8-4ca7-a682-f2f2144b6005'}),), if_exists=True) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 10:00:39 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:00:39 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 10:00:39 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:00:39 user nova-compute[75229]: INFO os_vif [None req-7a98b42c-0836-4f96-95de-8178f6352fb0 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:94:54:20,bridge_name='br-int',has_traffic_filtering=True,id=3f756f52-9183-4c6e-b60f-3d97c69fb495,network=Network(118ea7c1-77c0-4660-b7b7-f311f6b0ec8a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3f756f52-91')
Nov 14 10:00:39 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-7a98b42c-0836-4f96-95de-8178f6352fb0 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] No BDM found with device name vda, not building metadata. {{(pid=75229) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 10:00:39 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-7a98b42c-0836-4f96-95de-8178f6352fb0 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] No VIF found with MAC fa:16:3e:94:54:20, not building metadata {{(pid=75229) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 10:00:40 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:00:40 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:00:40 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:00:41 user nova-compute[75229]: DEBUG nova.compute.manager [req-6f75d943-f1d3-4dc7-9120-47d4a74af9ae req-fddd56f1-7d6e-440c-8bbb-7cf65b227cf1 service nova] [instance: d822d5e4-38d8-4ca7-a682-f2f2144b6005] Received event network-vif-plugged-3f756f52-9183-4c6e-b60f-3d97c69fb495 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 10:00:41 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-6f75d943-f1d3-4dc7-9120-47d4a74af9ae req-fddd56f1-7d6e-440c-8bbb-7cf65b227cf1 service nova] Acquiring lock "d822d5e4-38d8-4ca7-a682-f2f2144b6005-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:00:41 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-6f75d943-f1d3-4dc7-9120-47d4a74af9ae req-fddd56f1-7d6e-440c-8bbb-7cf65b227cf1 service nova] Lock "d822d5e4-38d8-4ca7-a682-f2f2144b6005-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:00:41 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-6f75d943-f1d3-4dc7-9120-47d4a74af9ae req-fddd56f1-7d6e-440c-8bbb-7cf65b227cf1 service nova] Lock "d822d5e4-38d8-4ca7-a682-f2f2144b6005-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:00:41 user nova-compute[75229]: DEBUG nova.compute.manager [req-6f75d943-f1d3-4dc7-9120-47d4a74af9ae req-fddd56f1-7d6e-440c-8bbb-7cf65b227cf1 service nova] [instance: d822d5e4-38d8-4ca7-a682-f2f2144b6005] No waiting events found dispatching network-vif-plugged-3f756f52-9183-4c6e-b60f-3d97c69fb495 {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 10:00:41 user nova-compute[75229]: WARNING nova.compute.manager [req-6f75d943-f1d3-4dc7-9120-47d4a74af9ae req-fddd56f1-7d6e-440c-8bbb-7cf65b227cf1 service nova] [instance: d822d5e4-38d8-4ca7-a682-f2f2144b6005] Received unexpected event network-vif-plugged-3f756f52-9183-4c6e-b60f-3d97c69fb495 for instance with vm_state building and task_state spawning.
Nov 14 10:00:41 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:00:41 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:00:41 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:00:41 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:00:43 user nova-compute[75229]: DEBUG nova.compute.manager [None req-7a98b42c-0836-4f96-95de-8178f6352fb0 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] [instance: d822d5e4-38d8-4ca7-a682-f2f2144b6005] Instance event wait completed in 0 seconds for  {{(pid=75229) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 10:00:43 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-7a98b42c-0836-4f96-95de-8178f6352fb0 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] [instance: d822d5e4-38d8-4ca7-a682-f2f2144b6005] Guest created on hypervisor {{(pid=75229) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 10:00:43 user nova-compute[75229]: INFO nova.virt.libvirt.driver [-] [instance: d822d5e4-38d8-4ca7-a682-f2f2144b6005] Instance spawned successfully.
Nov 14 10:00:43 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-7a98b42c-0836-4f96-95de-8178f6352fb0 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] [instance: d822d5e4-38d8-4ca7-a682-f2f2144b6005] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 10:00:43 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-7a98b42c-0836-4f96-95de-8178f6352fb0 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] [instance: d822d5e4-38d8-4ca7-a682-f2f2144b6005] Found default for hw_cdrom_bus of ide {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 10:00:43 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-7a98b42c-0836-4f96-95de-8178f6352fb0 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] [instance: d822d5e4-38d8-4ca7-a682-f2f2144b6005] Found default for hw_disk_bus of virtio {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 10:00:43 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-7a98b42c-0836-4f96-95de-8178f6352fb0 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] [instance: d822d5e4-38d8-4ca7-a682-f2f2144b6005] Found default for hw_input_bus of None {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 10:00:43 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-7a98b42c-0836-4f96-95de-8178f6352fb0 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] [instance: d822d5e4-38d8-4ca7-a682-f2f2144b6005] Found default for hw_pointer_model of None {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 10:00:43 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-7a98b42c-0836-4f96-95de-8178f6352fb0 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] [instance: d822d5e4-38d8-4ca7-a682-f2f2144b6005] Found default for hw_video_model of virtio {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 10:00:43 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-7a98b42c-0836-4f96-95de-8178f6352fb0 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] [instance: d822d5e4-38d8-4ca7-a682-f2f2144b6005] Found default for hw_vif_model of virtio {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 10:00:43 user nova-compute[75229]: INFO nova.compute.manager [None req-7a98b42c-0836-4f96-95de-8178f6352fb0 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] [instance: d822d5e4-38d8-4ca7-a682-f2f2144b6005] Took 4.99 seconds to spawn the instance on the hypervisor.
Nov 14 10:00:43 user nova-compute[75229]: DEBUG nova.compute.manager [None req-7a98b42c-0836-4f96-95de-8178f6352fb0 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] [instance: d822d5e4-38d8-4ca7-a682-f2f2144b6005] Checking state {{(pid=75229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 10:00:43 user nova-compute[75229]: DEBUG nova.compute.manager [req-2976ccd8-4e60-478e-87d3-09ac2b2bc43e req-2e8f8c8f-e1f6-4c7b-8b82-b96769eaf59d service nova] [instance: d822d5e4-38d8-4ca7-a682-f2f2144b6005] Received event network-vif-plugged-3f756f52-9183-4c6e-b60f-3d97c69fb495 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 10:00:43 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-2976ccd8-4e60-478e-87d3-09ac2b2bc43e req-2e8f8c8f-e1f6-4c7b-8b82-b96769eaf59d service nova] Acquiring lock "d822d5e4-38d8-4ca7-a682-f2f2144b6005-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:00:43 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-2976ccd8-4e60-478e-87d3-09ac2b2bc43e req-2e8f8c8f-e1f6-4c7b-8b82-b96769eaf59d service nova] Lock "d822d5e4-38d8-4ca7-a682-f2f2144b6005-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:00:43 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-2976ccd8-4e60-478e-87d3-09ac2b2bc43e req-2e8f8c8f-e1f6-4c7b-8b82-b96769eaf59d service nova] Lock "d822d5e4-38d8-4ca7-a682-f2f2144b6005-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:00:43 user nova-compute[75229]: DEBUG nova.compute.manager [req-2976ccd8-4e60-478e-87d3-09ac2b2bc43e req-2e8f8c8f-e1f6-4c7b-8b82-b96769eaf59d service nova] [instance: d822d5e4-38d8-4ca7-a682-f2f2144b6005] No waiting events found dispatching network-vif-plugged-3f756f52-9183-4c6e-b60f-3d97c69fb495 {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 10:00:43 user nova-compute[75229]: WARNING nova.compute.manager [req-2976ccd8-4e60-478e-87d3-09ac2b2bc43e req-2e8f8c8f-e1f6-4c7b-8b82-b96769eaf59d service nova] [instance: d822d5e4-38d8-4ca7-a682-f2f2144b6005] Received unexpected event network-vif-plugged-3f756f52-9183-4c6e-b60f-3d97c69fb495 for instance with vm_state building and task_state spawning.
Nov 14 10:00:43 user nova-compute[75229]: INFO nova.compute.manager [None req-7a98b42c-0836-4f96-95de-8178f6352fb0 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] [instance: d822d5e4-38d8-4ca7-a682-f2f2144b6005] Took 10.37 seconds to build instance.
Nov 14 10:00:43 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-7a98b42c-0836-4f96-95de-8178f6352fb0 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Lock "d822d5e4-38d8-4ca7-a682-f2f2144b6005" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.476s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:00:43 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:00:44 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:00:49 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 10:00:50 user nova-compute[75229]: WARNING nova.virt.libvirt.driver [None req-dc9718f8-13ae-442c-b823-b2447bf2a748 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance eba59006-83c1-4bda-b9f5-f3be4d1e5e58 is timed out.
Nov 14 10:00:50 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-dc9718f8-13ae-442c-b823-b2447bf2a748 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Successfully detached device vdb from instance eba59006-83c1-4bda-b9f5-f3be4d1e5e58 from the live domain config.
Nov 14 10:00:50 user nova-compute[75229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dc9718f8-13ae-442c-b823-b2447bf2a748 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] [instance: eba59006-83c1-4bda-b9f5-f3be4d1e5e58] calling os-brick to detach iSCSI Volume {{(pid=75229) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 10:00:50 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc9718f8-13ae-442c-b823-b2447bf2a748 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f73f85151b0>, {'target_iqn': 'iqn.2010-10.org.openstack:2df516f3-0635-44ed-8a28-e74c0ebaeeaf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eIxMbNfz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 10:00:50 user nova-compute[75229]: WARNING os_brick.initiator.connectors.base [None req-dc9718f8-13ae-442c-b823-b2447bf2a748 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 10:00:50 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-dc9718f8-13ae-442c-b823-b2447bf2a748 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 10:00:50 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-dc9718f8-13ae-442c-b823-b2447bf2a748 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 10:00:50 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:00:50 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:00:50 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8f427e3-d306-45dd-b100-4c0a8f80626e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a5efb0e0-a85c-46ec-8a9d-2763bf548023\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:143891e8-62eb-42d7-b076-db6f52b4f606\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2df516f3-0635-44ed-8a28-e74c0ebaeeaf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2977635e-b11f-4ab2-875c-e9f396b932dc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5aebc438-0289-44fe-ad84-4e696468f50e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:00:50 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc9718f8-13ae-442c-b823-b2447bf2a748 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 10:00:50 user nova-compute[75229]: No targets found.
Nov 14 10:00:50 user nova-compute[75229]: iSNS:
Nov 14 10:00:50 user nova-compute[75229]: No targets found.
Nov 14 10:00:50 user nova-compute[75229]: STATIC:
Nov 14 10:00:50 user nova-compute[75229]: Target: iqn.2010-10.org.openstack:a5efb0e0-a85c-46ec-8a9d-2763bf548023
Nov 14 10:00:50 user nova-compute[75229]:         Portal: 172.16.0.220:3260,-1
Nov 14 10:00:50 user nova-compute[75229]:                 Iface Name: default
Nov 14 10:00:50 user nova-compute[75229]: Target: iqn.2010-10.org.openstack:143891e8-62eb-42d7-b076-db6f52b4f606
Nov 14 10:00:50 user nova-compute[75229]:         Portal: 172.16.0.220:3260,-1
Nov 14 10:00:50 user nova-compute[75229]:                 Iface Name: default
Nov 14 10:00:50 user nova-compute[75229]: Target: iqn.2010-10.org.openstack:2df516f3-0635-44ed-8a28-e74c0ebaeeaf
Nov 14 10:00:50 user nova-compute[75229]:         Portal: 172.16.0.220:3260,-1
Nov 14 10:00:50 user nova-compute[75229]:                 Iface Name: default
Nov 14 10:00:50 user nova-compute[75229]: Target: iqn.2010-10.org.openstack:2977635e-b11f-4ab2-875c-e9f396b932dc
Nov 14 10:00:50 user nova-compute[75229]:         Portal: 172.16.0.220:3260,-1
Nov 14 10:00:50 user nova-compute[75229]:                 Iface Name: default
Nov 14 10:00:50 user nova-compute[75229]: Target: iqn.2010-10.org.openstack:5aebc438-0289-44fe-ad84-4e696468f50e
Nov 14 10:00:50 user nova-compute[75229]:         Portal: 172.16.0.220:3260,-1
Nov 14 10:00:50 user nova-compute[75229]:                 Iface Name: default
Nov 14 10:00:50 user nova-compute[75229]: FIRMWARE:
Nov 14 10:00:50 user nova-compute[75229]: No targets found.
Nov 14 10:00:50 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 10:00:50 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc9718f8-13ae-442c-b823-b2447bf2a748 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 10:00:50 user nova-compute[75229]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 10:00:50 user nova-compute[75229]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75229) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 10:00:50 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc9718f8-13ae-442c-b823-b2447bf2a748 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2df516f3-0635-44ed-8a28-e74c0ebaeeaf', 0)] {{(pid=75229) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 10:00:50 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:00:50 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:00:50 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b476c2a-e78e-4257-9788-07e00879ba25]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:143891e8-62eb-42d7-b076-db6f52b4f606\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2977635e-b11f-4ab2-875c-e9f396b932dc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2df516f3-0635-44ed-8a28-e74c0ebaeeaf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5aebc438-0289-44fe-ad84-4e696468f50e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a5efb0e0-a85c-46ec-8a9d-2763bf548023\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:00:50 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:00:50 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:00:50 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[877326c7-cd9c-4d0a-b012-7dfc4eae4a46]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aebc438-0289-44fe-ad84-4e696468f50e (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5efb0e0-a85c-46ec-8a9d-2763bf548023 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:143891e8-62eb-42d7-b076-db6f52b4f606 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2df516f3-0635-44ed-8a28-e74c0ebaeeaf (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2977635e-b11f-4ab2-875c-e9f396b932dc (non-flash)\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:00:50 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc9718f8-13ae-442c-b823-b2447bf2a748 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aebc438-0289-44fe-ad84-4e696468f50e (non-flash)
Nov 14 10:00:50 user nova-compute[75229]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5efb0e0-a85c-46ec-8a9d-2763bf548023 (non-flash)
Nov 14 10:00:50 user nova-compute[75229]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:143891e8-62eb-42d7-b076-db6f52b4f606 (non-flash)
Nov 14 10:00:50 user nova-compute[75229]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2df516f3-0635-44ed-8a28-e74c0ebaeeaf (non-flash)
Nov 14 10:00:50 user nova-compute[75229]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2977635e-b11f-4ab2-875c-e9f396b932dc (non-flash)
Nov 14 10:00:50 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 10:00:50 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc9718f8-13ae-442c-b823-b2447bf2a748 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aebc438-0289-44fe-ad84-4e696468f50e (non-flash)
Nov 14 10:00:50 user nova-compute[75229]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5efb0e0-a85c-46ec-8a9d-2763bf548023 (non-flash)
Nov 14 10:00:50 user nova-compute[75229]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:143891e8-62eb-42d7-b076-db6f52b4f606 (non-flash)
Nov 14 10:00:50 user nova-compute[75229]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2df516f3-0635-44ed-8a28-e74c0ebaeeaf (non-flash)
Nov 14 10:00:50 user nova-compute[75229]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2977635e-b11f-4ab2-875c-e9f396b932dc (non-flash)
Nov 14 10:00:50 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 10:00:50 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc9718f8-13ae-442c-b823-b2447bf2a748 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f74181c8f70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2df516f3-0635-44ed-8a28-e74c0ebaeeaf'): ({'sdd'}, set())}) {{(pid=75229) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 10:00:50 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-dc9718f8-13ae-442c-b823-b2447bf2a748 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Removing single pathed devices sdd {{(pid=75229) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 10:00:50 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:00:51 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:00:51 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[93841ac4-5c75-4f0a-8057-ba01d2c25da2]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:00:51 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:00:51 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.017s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:00:51 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[371f3fb7-fc70-44d7-9c61-31cc7dd166ad]: (4, ('ok\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:00:51 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-dc9718f8-13ae-442c-b823-b2447bf2a748 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Flushing IO for device /dev/sdd {{(pid=75229) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 10:00:51 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:00:51 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.012s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:00:51 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[db39f084-18b9-4c43-aea6-b33a3d5674dc]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:00:51 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-dc9718f8-13ae-442c-b823-b2447bf2a748 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75229) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 10:00:51 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:00:51 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.039s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:00:51 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[22617eaf-b407-4a0a-a7b1-ff7f09ba5c66]: (4, ('1', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:00:51 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-dc9718f8-13ae-442c-b823-b2447bf2a748 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75229) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 10:00:51 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-dc9718f8-13ae-442c-b823-b2447bf2a748 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] SCSI volumes sdd have been removed. {{(pid=75229) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 10:00:51 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc9718f8-13ae-442c-b823-b2447bf2a748 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2df516f3-0635-44ed-8a28-e74c0ebaeeaf')] {{(pid=75229) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 10:00:51 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2df516f3-0635-44ed-8a28-e74c0ebaeeaf -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:00:51 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2df516f3-0635-44ed-8a28-e74c0ebaeeaf -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:00:51 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad9221d8-d265-4789-9177-5bf052132e7e]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:00:51 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc9718f8-13ae-442c-b823-b2447bf2a748 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 10:00:51 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2df516f3-0635-44ed-8a28-e74c0ebaeeaf -p 172.16.0.220:3260 --logout {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:00:51 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2df516f3-0635-44ed-8a28-e74c0ebaeeaf -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:00:51 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c97c63b-ff1f-4685-a791-265f8fd419c1]: (4, ('Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:2df516f3-0635-44ed-8a28-e74c0ebaeeaf, portal: 172.16.0.220,3260]\nLogout of [sid: 39, target: iqn.2010-10.org.openstack:2df516f3-0635-44ed-8a28-e74c0ebaeeaf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:00:51 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc9718f8-13ae-442c-b823-b2447bf2a748 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:2df516f3-0635-44ed-8a28-e74c0ebaeeaf, portal: 172.16.0.220,3260]
Nov 14 10:00:51 user nova-compute[75229]: Logout of [sid: 39, target: iqn.2010-10.org.openstack:2df516f3-0635-44ed-8a28-e74c0ebaeeaf, portal: 172.16.0.220,3260] successful.
Nov 14 10:00:51 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 10:00:51 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2df516f3-0635-44ed-8a28-e74c0ebaeeaf -p 172.16.0.220:3260 --op delete {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:00:51 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2df516f3-0635-44ed-8a28-e74c0ebaeeaf -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:00:51 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[00db6187-ddf9-4046-94d5-56fe51934319]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:00:51 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc9718f8-13ae-442c-b823-b2447bf2a748 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 10:00:51 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-dc9718f8-13ae-442c-b823-b2447bf2a748 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.317s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 10:00:51 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc9718f8-13ae-442c-b823-b2447bf2a748 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] <== disconnect_volume: return (318ms) None {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 10:00:51 user nova-compute[75229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dc9718f8-13ae-442c-b823-b2447bf2a748 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] [instance: eba59006-83c1-4bda-b9f5-f3be4d1e5e58] Disconnected iSCSI Volume {{(pid=75229) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 10:00:51 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:00:51 user nova-compute[75229]: DEBUG nova.objects.instance [None req-dc9718f8-13ae-442c-b823-b2447bf2a748 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Lazy-loading 'flavor' on Instance uuid eba59006-83c1-4bda-b9f5-f3be4d1e5e58 {{(pid=75229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 10:00:52 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-dc9718f8-13ae-442c-b823-b2447bf2a748 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Lock "eba59006-83c1-4bda-b9f5-f3be4d1e5e58" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.706s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:00:53 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:00:54 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:00:54 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:00:54 user nova-compute[75229]: DEBUG nova.compute.manager [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Starting heal instance info cache {{(pid=75229) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 10:00:54 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Acquiring lock "refresh_cache-cda8c5ad-e70c-4021-bace-d55831c4bc78" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 10:00:54 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Acquired lock "refresh_cache-cda8c5ad-e70c-4021-bace-d55831c4bc78" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 10:00:54 user nova-compute[75229]: DEBUG nova.network.neutron [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] [instance: cda8c5ad-e70c-4021-bace-d55831c4bc78] Forcefully refreshing network info cache for instance {{(pid=75229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 10:00:55 user nova-compute[75229]: DEBUG nova.network.neutron [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] [instance: cda8c5ad-e70c-4021-bace-d55831c4bc78] Updating instance_info_cache with network_info: [{"id": "c88498e8-25f8-4546-b007-b1dc853b3ccb", "address": "fa:16:3e:c4:17:f3", "network": {"id": "6a700b61-4aa6-440b-87e6-a3525a5cb918", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-448680331-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8babb73006da4977a1fe2bdb35e08d8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc88498e8-25", "ovs_interfaceid": "c88498e8-25f8-4546-b007-b1dc853b3ccb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 10:00:55 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Releasing lock "refresh_cache-cda8c5ad-e70c-4021-bace-d55831c4bc78" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 10:00:55 user nova-compute[75229]: DEBUG nova.compute.manager [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] [instance: cda8c5ad-e70c-4021-bace-d55831c4bc78] Updated the network info_cache for instance {{(pid=75229) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 10:00:56 user nova-compute[75229]: INFO nova.compute.manager [None req-b5bd5d0c-ab03-4294-a357-c8256bec0a98 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] [instance: 589f4750-fac6-4e99-a430-0cda339808bc] Get console output
Nov 14 10:00:56 user nova-compute[75229]: INFO nova.privsep.libvirt [-] Ignored error while reading from instance console pty: can't concat NoneType to bytes
Nov 14 10:00:57 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:00:57 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:00:58 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:00:59 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:01:00 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:01:00 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:01:00 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:01:00 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:01:00 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Auditing locally available compute resources for user (node: user) {{(pid=75229) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 10:01:00 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cda8c5ad-e70c-4021-bace-d55831c4bc78/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:01:01 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cda8c5ad-e70c-4021-bace-d55831c4bc78/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:01:01 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cda8c5ad-e70c-4021-bace-d55831c4bc78/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:01:01 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cda8c5ad-e70c-4021-bace-d55831c4bc78/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:01:01 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7750cbc-b3d0-44aa-8b88-c291ba007a8a/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:01:01 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7750cbc-b3d0-44aa-8b88-c291ba007a8a/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:01:01 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7750cbc-b3d0-44aa-8b88-c291ba007a8a/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:01:01 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7750cbc-b3d0-44aa-8b88-c291ba007a8a/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:01:01 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75229) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 10:01:01 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eba59006-83c1-4bda-b9f5-f3be4d1e5e58/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:01:01 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:01:01 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eba59006-83c1-4bda-b9f5-f3be4d1e5e58/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:01:01 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eba59006-83c1-4bda-b9f5-f3be4d1e5e58/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:01:02 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eba59006-83c1-4bda-b9f5-f3be4d1e5e58/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:01:02 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75229) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 10:01:02 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c9fe69e-3f9d-4b30-a9e4-efc3e83efa17/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:01:02 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c9fe69e-3f9d-4b30-a9e4-efc3e83efa17/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:01:02 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c9fe69e-3f9d-4b30-a9e4-efc3e83efa17/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:01:02 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c9fe69e-3f9d-4b30-a9e4-efc3e83efa17/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:01:02 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75229) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 10:01:02 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abb8e340-164d-4bc2-a503-7e8ea3c9b35b/disk.rescue --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:01:02 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abb8e340-164d-4bc2-a503-7e8ea3c9b35b/disk.rescue --force-share --output=json" returned: 0 in 0.206s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:01:02 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abb8e340-164d-4bc2-a503-7e8ea3c9b35b/disk.rescue --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:01:02 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abb8e340-164d-4bc2-a503-7e8ea3c9b35b/disk.rescue --force-share --output=json" returned: 0 in 0.181s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:01:02 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] skipping disk /opt/stack/data/nova/instances/abb8e340-164d-4bc2-a503-7e8ea3c9b35b/disk (vdb) as it is a volume {{(pid=75229) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 10:01:02 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5170e9e-66e3-4df1-9807-4958cac6480e/disk.rescue --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:01:03 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5170e9e-66e3-4df1-9807-4958cac6480e/disk.rescue --force-share --output=json" returned: 0 in 0.186s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:01:03 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5170e9e-66e3-4df1-9807-4958cac6480e/disk.rescue --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:01:03 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5170e9e-66e3-4df1-9807-4958cac6480e/disk.rescue --force-share --output=json" returned: 0 in 0.187s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:01:03 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5170e9e-66e3-4df1-9807-4958cac6480e/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:01:03 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5170e9e-66e3-4df1-9807-4958cac6480e/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:01:03 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5170e9e-66e3-4df1-9807-4958cac6480e/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:01:03 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5170e9e-66e3-4df1-9807-4958cac6480e/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:01:04 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:01:04 user nova-compute[75229]: WARNING nova.virt.libvirt.driver [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 10:01:04 user nova-compute[75229]: WARNING nova.virt.libvirt.driver [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 10:01:04 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Hypervisor/Node resource view: name=user free_ram=7929MB free_disk=25.06792449951172GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75229) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 10:01:04 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:01:04 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:01:04 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Instance a7750cbc-b3d0-44aa-8b88-c291ba007a8a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 10:01:04 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Instance 4c9fe69e-3f9d-4b30-a9e4-efc3e83efa17 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 10:01:04 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Instance b5170e9e-66e3-4df1-9807-4958cac6480e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 10:01:04 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Instance cda8c5ad-e70c-4021-bace-d55831c4bc78 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 10:01:04 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Instance 30ae1f73-e0f3-4e26-987e-a684471a160d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 10:01:04 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Instance 589f4750-fac6-4e99-a430-0cda339808bc actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 10:01:04 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Instance abb8e340-164d-4bc2-a503-7e8ea3c9b35b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 10:01:04 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Instance eba59006-83c1-4bda-b9f5-f3be4d1e5e58 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 10:01:04 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Instance d822d5e4-38d8-4ca7-a682-f2f2144b6005 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 10:01:04 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=75229) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 10:01:04 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=75229) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 10:01:04 user nova-compute[75229]: DEBUG nova.compute.provider_tree [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Inventory has not changed in ProviderTree for provider: d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 {{(pid=75229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 10:01:04 user nova-compute[75229]: DEBUG nova.scheduler.client.report [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Inventory has not changed for provider d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 10:01:04 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Compute_service record updated for user:user {{(pid=75229) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 10:01:04 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.452s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:01:04 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:01:06 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:01:06 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:01:06 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:01:06 user nova-compute[75229]: DEBUG nova.compute.manager [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75229) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 10:01:06 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:01:07 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:01:08 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:01:09 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:01:09 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:01:12 user nova-compute[75229]: INFO nova.compute.manager [None req-6927c406-ddb0-4de9-81aa-2df63195261d tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] [instance: abb8e340-164d-4bc2-a503-7e8ea3c9b35b] Unrescuing
Nov 14 10:01:12 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-6927c406-ddb0-4de9-81aa-2df63195261d tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Acquiring lock "refresh_cache-abb8e340-164d-4bc2-a503-7e8ea3c9b35b" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 10:01:12 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-6927c406-ddb0-4de9-81aa-2df63195261d tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Acquired lock "refresh_cache-abb8e340-164d-4bc2-a503-7e8ea3c9b35b" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 10:01:12 user nova-compute[75229]: DEBUG nova.network.neutron [None req-6927c406-ddb0-4de9-81aa-2df63195261d tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] [instance: abb8e340-164d-4bc2-a503-7e8ea3c9b35b] Building network info cache for instance {{(pid=75229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 10:01:13 user nova-compute[75229]: DEBUG nova.network.neutron [None req-6927c406-ddb0-4de9-81aa-2df63195261d tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] [instance: abb8e340-164d-4bc2-a503-7e8ea3c9b35b] Updating instance_info_cache with network_info: [{"id": "37ce4717-9a82-41c6-9d89-f1e55b9ae398", "address": "fa:16:3e:92:c4:4b", "network": {"id": "22eed29e-7148-42f9-b4c7-b97811cba8eb", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2000485731-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.13", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46457b27e3ed416e827c3c22449fb512", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37ce4717-9a", "ovs_interfaceid": "37ce4717-9a82-41c6-9d89-f1e55b9ae398", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 10:01:13 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-6927c406-ddb0-4de9-81aa-2df63195261d tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Releasing lock "refresh_cache-abb8e340-164d-4bc2-a503-7e8ea3c9b35b" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 10:01:13 user nova-compute[75229]: DEBUG nova.objects.instance [None req-6927c406-ddb0-4de9-81aa-2df63195261d tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Lazy-loading 'flavor' on Instance uuid abb8e340-164d-4bc2-a503-7e8ea3c9b35b {{(pid=75229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 10:01:13 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:01:13 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:01:13 user nova-compute[75229]: DEBUG nova.compute.manager [req-fb1fc41d-de93-4a9d-9a21-1bca684a2031 req-5d6680d0-941b-47f1-a718-b74403a012cd service nova] [instance: abb8e340-164d-4bc2-a503-7e8ea3c9b35b] Received event network-vif-unplugged-37ce4717-9a82-41c6-9d89-f1e55b9ae398 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 10:01:13 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-fb1fc41d-de93-4a9d-9a21-1bca684a2031 req-5d6680d0-941b-47f1-a718-b74403a012cd service nova] Acquiring lock "abb8e340-164d-4bc2-a503-7e8ea3c9b35b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:01:13 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-fb1fc41d-de93-4a9d-9a21-1bca684a2031 req-5d6680d0-941b-47f1-a718-b74403a012cd service nova] Lock "abb8e340-164d-4bc2-a503-7e8ea3c9b35b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:01:13 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-fb1fc41d-de93-4a9d-9a21-1bca684a2031 req-5d6680d0-941b-47f1-a718-b74403a012cd service nova] Lock "abb8e340-164d-4bc2-a503-7e8ea3c9b35b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:01:13 user nova-compute[75229]: DEBUG nova.compute.manager [req-fb1fc41d-de93-4a9d-9a21-1bca684a2031 req-5d6680d0-941b-47f1-a718-b74403a012cd service nova] [instance: abb8e340-164d-4bc2-a503-7e8ea3c9b35b] No waiting events found dispatching network-vif-unplugged-37ce4717-9a82-41c6-9d89-f1e55b9ae398 {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 10:01:13 user nova-compute[75229]: WARNING nova.compute.manager [req-fb1fc41d-de93-4a9d-9a21-1bca684a2031 req-5d6680d0-941b-47f1-a718-b74403a012cd service nova] [instance: abb8e340-164d-4bc2-a503-7e8ea3c9b35b] Received unexpected event network-vif-unplugged-37ce4717-9a82-41c6-9d89-f1e55b9ae398 for instance with vm_state rescued and task_state unrescuing.
Nov 14 10:01:13 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:01:13 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:01:13 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:01:13 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:01:13 user nova-compute[75229]: INFO nova.virt.libvirt.driver [-] [instance: abb8e340-164d-4bc2-a503-7e8ea3c9b35b] Instance destroyed successfully.
Nov 14 10:01:14 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:01:15 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-cc1e22a8-8940-450c-8df8-57dfb48e2196 tempest-TestShelveInstance-1161595377 tempest-TestShelveInstance-1161595377-project-member] Acquiring lock "abe7e145-d3bc-49a1-83be-793488de828b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:01:15 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-cc1e22a8-8940-450c-8df8-57dfb48e2196 tempest-TestShelveInstance-1161595377 tempest-TestShelveInstance-1161595377-project-member] Lock "abe7e145-d3bc-49a1-83be-793488de828b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:01:15 user nova-compute[75229]: DEBUG nova.compute.manager [None req-cc1e22a8-8940-450c-8df8-57dfb48e2196 tempest-TestShelveInstance-1161595377 tempest-TestShelveInstance-1161595377-project-member] [instance: abe7e145-d3bc-49a1-83be-793488de828b] Starting instance... {{(pid=75229) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 10:01:15 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-cc1e22a8-8940-450c-8df8-57dfb48e2196 tempest-TestShelveInstance-1161595377 tempest-TestShelveInstance-1161595377-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:01:15 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-cc1e22a8-8940-450c-8df8-57dfb48e2196 tempest-TestShelveInstance-1161595377 tempest-TestShelveInstance-1161595377-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:01:15 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-cc1e22a8-8940-450c-8df8-57dfb48e2196 tempest-TestShelveInstance-1161595377 tempest-TestShelveInstance-1161595377-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75229) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 10:01:15 user nova-compute[75229]: INFO nova.compute.claims [None req-cc1e22a8-8940-450c-8df8-57dfb48e2196 tempest-TestShelveInstance-1161595377 tempest-TestShelveInstance-1161595377-project-member] [instance: abe7e145-d3bc-49a1-83be-793488de828b] Claim successful on node user
Nov 14 10:01:15 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:01:15 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:01:15 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:01:15 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:01:15 user nova-compute[75229]: DEBUG nova.compute.provider_tree [None req-cc1e22a8-8940-450c-8df8-57dfb48e2196 tempest-TestShelveInstance-1161595377 tempest-TestShelveInstance-1161595377-project-member] Inventory has not changed in ProviderTree for provider: d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 {{(pid=75229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 10:01:15 user nova-compute[75229]: DEBUG nova.scheduler.client.report [None req-cc1e22a8-8940-450c-8df8-57dfb48e2196 tempest-TestShelveInstance-1161595377 tempest-TestShelveInstance-1161595377-project-member] Inventory has not changed for provider d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 10:01:15 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-cc1e22a8-8940-450c-8df8-57dfb48e2196 tempest-TestShelveInstance-1161595377 tempest-TestShelveInstance-1161595377-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.487s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:01:15 user nova-compute[75229]: DEBUG nova.compute.manager [None req-cc1e22a8-8940-450c-8df8-57dfb48e2196 tempest-TestShelveInstance-1161595377 tempest-TestShelveInstance-1161595377-project-member] [instance: abe7e145-d3bc-49a1-83be-793488de828b] Start building networks asynchronously for instance. {{(pid=75229) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 10:01:15 user nova-compute[75229]: DEBUG nova.compute.manager [req-ed82599d-b15e-41d1-929e-4830adf8d292 req-77ed824c-e27d-46ab-af2a-a4fdc4cf6ea8 service nova] [instance: abb8e340-164d-4bc2-a503-7e8ea3c9b35b] Received event network-vif-plugged-37ce4717-9a82-41c6-9d89-f1e55b9ae398 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 10:01:15 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-ed82599d-b15e-41d1-929e-4830adf8d292 req-77ed824c-e27d-46ab-af2a-a4fdc4cf6ea8 service nova] Acquiring lock "abb8e340-164d-4bc2-a503-7e8ea3c9b35b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:01:15 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-ed82599d-b15e-41d1-929e-4830adf8d292 req-77ed824c-e27d-46ab-af2a-a4fdc4cf6ea8 service nova] Lock "abb8e340-164d-4bc2-a503-7e8ea3c9b35b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:01:15 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-ed82599d-b15e-41d1-929e-4830adf8d292 req-77ed824c-e27d-46ab-af2a-a4fdc4cf6ea8 service nova] Lock "abb8e340-164d-4bc2-a503-7e8ea3c9b35b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.003s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:01:15 user nova-compute[75229]: DEBUG nova.compute.manager [req-ed82599d-b15e-41d1-929e-4830adf8d292 req-77ed824c-e27d-46ab-af2a-a4fdc4cf6ea8 service nova] [instance: abb8e340-164d-4bc2-a503-7e8ea3c9b35b] No waiting events found dispatching network-vif-plugged-37ce4717-9a82-41c6-9d89-f1e55b9ae398 {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 10:01:15 user nova-compute[75229]: WARNING nova.compute.manager [req-ed82599d-b15e-41d1-929e-4830adf8d292 req-77ed824c-e27d-46ab-af2a-a4fdc4cf6ea8 service nova] [instance: abb8e340-164d-4bc2-a503-7e8ea3c9b35b] Received unexpected event network-vif-plugged-37ce4717-9a82-41c6-9d89-f1e55b9ae398 for instance with vm_state rescued and task_state unrescuing.
Nov 14 10:01:15 user nova-compute[75229]: DEBUG nova.compute.manager [None req-cc1e22a8-8940-450c-8df8-57dfb48e2196 tempest-TestShelveInstance-1161595377 tempest-TestShelveInstance-1161595377-project-member] [instance: abe7e145-d3bc-49a1-83be-793488de828b] Allocating IP information in the background. {{(pid=75229) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 10:01:15 user nova-compute[75229]: DEBUG nova.network.neutron [None req-cc1e22a8-8940-450c-8df8-57dfb48e2196 tempest-TestShelveInstance-1161595377 tempest-TestShelveInstance-1161595377-project-member] [instance: abe7e145-d3bc-49a1-83be-793488de828b] allocate_for_instance() {{(pid=75229) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 10:01:15 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-cc1e22a8-8940-450c-8df8-57dfb48e2196 tempest-TestShelveInstance-1161595377 tempest-TestShelveInstance-1161595377-project-member] [instance: abe7e145-d3bc-49a1-83be-793488de828b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 10:01:15 user nova-compute[75229]: DEBUG nova.compute.manager [None req-cc1e22a8-8940-450c-8df8-57dfb48e2196 tempest-TestShelveInstance-1161595377 tempest-TestShelveInstance-1161595377-project-member] [instance: abe7e145-d3bc-49a1-83be-793488de828b] Start building block device mappings for instance. {{(pid=75229) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 10:01:15 user nova-compute[75229]: INFO nova.virt.block_device [None req-cc1e22a8-8940-450c-8df8-57dfb48e2196 tempest-TestShelveInstance-1161595377 tempest-TestShelveInstance-1161595377-project-member] [instance: abe7e145-d3bc-49a1-83be-793488de828b] Booting with volume e4a6dca6-1581-494f-afe5-3aac2b4d2c15 at /dev/vda
Nov 14 10:01:15 user nova-compute[75229]: DEBUG nova.policy [None req-cc1e22a8-8940-450c-8df8-57dfb48e2196 tempest-TestShelveInstance-1161595377 tempest-TestShelveInstance-1161595377-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'cd2c5b18ddd44bf18089cf001e012ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d1aa0aeea4145b69bf310c4d9b649d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75229) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 10:01:16 user nova-compute[75229]: DEBUG os_brick.utils [None req-cc1e22a8-8940-450c-8df8-57dfb48e2196 tempest-TestShelveInstance-1161595377 tempest-TestShelveInstance-1161595377-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 10:01:16 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:01:16 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:01:16 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[96bb60cd-8b36-4da7-a1cd-b0ac9c30f26a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f1154031c835\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:01:16 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:01:16 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:01:16 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[86a1ff55-294e-4746-a9e4-b758679061a3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:01:16 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:01:16 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:01:16 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc4ba5b7-3376-4018-90f1-c6911749f948]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:01:16 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca81b5dc-1d0f-46a2-9211-3f970e9ae79c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:01:16 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-cc1e22a8-8940-450c-8df8-57dfb48e2196 tempest-TestShelveInstance-1161595377 tempest-TestShelveInstance-1161595377-project-member] Running cmd (subprocess): nvme version {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:01:16 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-cc1e22a8-8940-450c-8df8-57dfb48e2196 tempest-TestShelveInstance-1161595377 tempest-TestShelveInstance-1161595377-project-member] 'nvme version' failed. Not Retrying. {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 10:01:16 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.nvmeof [None req-cc1e22a8-8940-450c-8df8-57dfb48e2196 tempest-TestShelveInstance-1161595377 tempest-TestShelveInstance-1161595377-project-member] nvme not present on system {{(pid=75229) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 10:01:16 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:01:16 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 10:01:16 user nova-compute[75229]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 10:01:16 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[252bec8c-6f42-4bb1-826c-8ce2b08e164d]: (4, '') {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:01:16 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.lightos [None req-cc1e22a8-8940-450c-8df8-57dfb48e2196 tempest-TestShelveInstance-1161595377 tempest-TestShelveInstance-1161595377-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75229) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 10:01:16 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.lightos [None req-cc1e22a8-8940-450c-8df8-57dfb48e2196 tempest-TestShelveInstance-1161595377 tempest-TestShelveInstance-1161595377-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75229) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 10:01:16 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.lightos [None req-cc1e22a8-8940-450c-8df8-57dfb48e2196 tempest-TestShelveInstance-1161595377 tempest-TestShelveInstance-1161595377-project-member] LIGHTOS: no hostnqn found. {{(pid=75229) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 10:01:16 user nova-compute[75229]: DEBUG os_brick.utils [None req-cc1e22a8-8940-450c-8df8-57dfb48e2196 tempest-TestShelveInstance-1161595377 tempest-TestShelveInstance-1161595377-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f1154031c835', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 10:01:16 user nova-compute[75229]: DEBUG nova.virt.block_device [None req-cc1e22a8-8940-450c-8df8-57dfb48e2196 tempest-TestShelveInstance-1161595377 tempest-TestShelveInstance-1161595377-project-member] [instance: abe7e145-d3bc-49a1-83be-793488de828b] Updating existing volume attachment record: c15bfded-9e9c-4e7d-924e-6d0d97ce874a {{(pid=75229) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 10:01:17 user nova-compute[75229]: DEBUG nova.network.neutron [None req-cc1e22a8-8940-450c-8df8-57dfb48e2196 tempest-TestShelveInstance-1161595377 tempest-TestShelveInstance-1161595377-project-member] [instance: abe7e145-d3bc-49a1-83be-793488de828b] Successfully created port: fe62c72a-f69b-4109-bfa3-e4a51fa43d0e {{(pid=75229) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 10:01:17 user nova-compute[75229]: DEBUG nova.compute.manager [None req-6927c406-ddb0-4de9-81aa-2df63195261d tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] [instance: abb8e340-164d-4bc2-a503-7e8ea3c9b35b] Checking state {{(pid=75229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 10:01:17 user nova-compute[75229]: DEBUG nova.compute.manager [req-35106bb7-277a-4fda-9e05-6010a0386297 req-4be3c3dc-75b9-489b-b703-d90dc34b6650 service nova] [instance: abb8e340-164d-4bc2-a503-7e8ea3c9b35b] Received event network-vif-plugged-37ce4717-9a82-41c6-9d89-f1e55b9ae398 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 10:01:17 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-35106bb7-277a-4fda-9e05-6010a0386297 req-4be3c3dc-75b9-489b-b703-d90dc34b6650 service nova] Acquiring lock "abb8e340-164d-4bc2-a503-7e8ea3c9b35b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:01:17 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-35106bb7-277a-4fda-9e05-6010a0386297 req-4be3c3dc-75b9-489b-b703-d90dc34b6650 service nova] Lock "abb8e340-164d-4bc2-a503-7e8ea3c9b35b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:01:17 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-35106bb7-277a-4fda-9e05-6010a0386297 req-4be3c3dc-75b9-489b-b703-d90dc34b6650 service nova] Lock "abb8e340-164d-4bc2-a503-7e8ea3c9b35b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:01:17 user nova-compute[75229]: DEBUG nova.compute.manager [req-35106bb7-277a-4fda-9e05-6010a0386297 req-4be3c3dc-75b9-489b-b703-d90dc34b6650 service nova] [instance: abb8e340-164d-4bc2-a503-7e8ea3c9b35b] No waiting events found dispatching network-vif-plugged-37ce4717-9a82-41c6-9d89-f1e55b9ae398 {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 10:01:17 user nova-compute[75229]: WARNING nova.compute.manager [req-35106bb7-277a-4fda-9e05-6010a0386297 req-4be3c3dc-75b9-489b-b703-d90dc34b6650 service nova] [instance: abb8e340-164d-4bc2-a503-7e8ea3c9b35b] Received unexpected event network-vif-plugged-37ce4717-9a82-41c6-9d89-f1e55b9ae398 for instance with vm_state active and task_state None.
Nov 14 10:01:17 user nova-compute[75229]: DEBUG nova.compute.manager [req-35106bb7-277a-4fda-9e05-6010a0386297 req-4be3c3dc-75b9-489b-b703-d90dc34b6650 service nova] [instance: abb8e340-164d-4bc2-a503-7e8ea3c9b35b] Received event network-vif-plugged-37ce4717-9a82-41c6-9d89-f1e55b9ae398 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 10:01:17 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-35106bb7-277a-4fda-9e05-6010a0386297 req-4be3c3dc-75b9-489b-b703-d90dc34b6650 service nova] Acquiring lock "abb8e340-164d-4bc2-a503-7e8ea3c9b35b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:01:17 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-35106bb7-277a-4fda-9e05-6010a0386297 req-4be3c3dc-75b9-489b-b703-d90dc34b6650 service nova] Lock "abb8e340-164d-4bc2-a503-7e8ea3c9b35b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:01:17 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-35106bb7-277a-4fda-9e05-6010a0386297 req-4be3c3dc-75b9-489b-b703-d90dc34b6650 service nova] Lock "abb8e340-164d-4bc2-a503-7e8ea3c9b35b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:01:17 user nova-compute[75229]: DEBUG nova.compute.manager [req-35106bb7-277a-4fda-9e05-6010a0386297 req-4be3c3dc-75b9-489b-b703-d90dc34b6650 service nova] [instance: abb8e340-164d-4bc2-a503-7e8ea3c9b35b] No waiting events found dispatching network-vif-plugged-37ce4717-9a82-41c6-9d89-f1e55b9ae398 {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 10:01:17 user nova-compute[75229]: WARNING nova.compute.manager [req-35106bb7-277a-4fda-9e05-6010a0386297 req-4be3c3dc-75b9-489b-b703-d90dc34b6650 service nova] [instance: abb8e340-164d-4bc2-a503-7e8ea3c9b35b] Received unexpected event network-vif-plugged-37ce4717-9a82-41c6-9d89-f1e55b9ae398 for instance with vm_state active and task_state None.
Nov 14 10:01:18 user nova-compute[75229]: DEBUG nova.network.neutron [None req-cc1e22a8-8940-450c-8df8-57dfb48e2196 tempest-TestShelveInstance-1161595377 tempest-TestShelveInstance-1161595377-project-member] [instance: abe7e145-d3bc-49a1-83be-793488de828b] Successfully updated port: fe62c72a-f69b-4109-bfa3-e4a51fa43d0e {{(pid=75229) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 10:01:18 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-cc1e22a8-8940-450c-8df8-57dfb48e2196 tempest-TestShelveInstance-1161595377 tempest-TestShelveInstance-1161595377-project-member] Acquiring lock "refresh_cache-abe7e145-d3bc-49a1-83be-793488de828b" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 10:01:18 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-cc1e22a8-8940-450c-8df8-57dfb48e2196 tempest-TestShelveInstance-1161595377 tempest-TestShelveInstance-1161595377-project-member] Acquired lock "refresh_cache-abe7e145-d3bc-49a1-83be-793488de828b" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 10:01:18 user nova-compute[75229]: DEBUG nova.network.neutron [None req-cc1e22a8-8940-450c-8df8-57dfb48e2196 tempest-TestShelveInstance-1161595377 tempest-TestShelveInstance-1161595377-project-member] [instance: abe7e145-d3bc-49a1-83be-793488de828b] Building network info cache for instance {{(pid=75229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 10:01:18 user nova-compute[75229]: DEBUG nova.compute.manager [req-8062bc5e-47d6-4920-9df8-c2d37762af10 req-32596788-eeea-429b-9ddc-452df02a32c8 service nova] [instance: abe7e145-d3bc-49a1-83be-793488de828b] Received event network-changed-fe62c72a-f69b-4109-bfa3-e4a51fa43d0e {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 10:01:18 user nova-compute[75229]: DEBUG nova.compute.manager [req-8062bc5e-47d6-4920-9df8-c2d37762af10 req-32596788-eeea-429b-9ddc-452df02a32c8 service nova] [instance: abe7e145-d3bc-49a1-83be-793488de828b] Refreshing instance network info cache due to event network-changed-fe62c72a-f69b-4109-bfa3-e4a51fa43d0e. {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 10:01:18 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-8062bc5e-47d6-4920-9df8-c2d37762af10 req-32596788-eeea-429b-9ddc-452df02a32c8 service nova] Acquiring lock "refresh_cache-abe7e145-d3bc-49a1-83be-793488de828b" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 10:01:18 user nova-compute[75229]: DEBUG nova.network.neutron [None req-cc1e22a8-8940-450c-8df8-57dfb48e2196 tempest-TestShelveInstance-1161595377 tempest-TestShelveInstance-1161595377-project-member] [instance: abe7e145-d3bc-49a1-83be-793488de828b] Instance cache missing network info. {{(pid=75229) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 10:01:18 user nova-compute[75229]: DEBUG nova.network.neutron [None req-cc1e22a8-8940-450c-8df8-57dfb48e2196 tempest-TestShelveInstance-1161595377 tempest-TestShelveInstance-1161595377-project-member] [instance: abe7e145-d3bc-49a1-83be-793488de828b] Updating instance_info_cache with network_info: [{"id": "fe62c72a-f69b-4109-bfa3-e4a51fa43d0e", "address": "fa:16:3e:f8:a3:e5", "network": {"id": "f0c67d05-ffe2-4866-baa3-fa4acaeadaa1", "bridge": "br-int", "label": "tempest-TestShelveInstance-1922554351-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d1aa0aeea4145b69bf310c4d9b649d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe62c72a-f6", "ovs_interfaceid": "fe62c72a-f69b-4109-bfa3-e4a51fa43d0e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 10:01:18 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-cc1e22a8-8940-450c-8df8-57dfb48e2196 tempest-TestShelveInstance-1161595377 tempest-TestShelveInstance-1161595377-project-member] Releasing lock "refresh_cache-abe7e145-d3bc-49a1-83be-793488de828b" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 10:01:18 user nova-compute[75229]: DEBUG nova.compute.manager [None req-cc1e22a8-8940-450c-8df8-57dfb48e2196 tempest-TestShelveInstance-1161595377 tempest-TestShelveInstance-1161595377-project-member] [instance: abe7e145-d3bc-49a1-83be-793488de828b] Instance network_info: |[{"id": "fe62c72a-f69b-4109-bfa3-e4a51fa43d0e", "address": "fa:16:3e:f8:a3:e5", "network": {"id": "f0c67d05-ffe2-4866-baa3-fa4acaeadaa1", "bridge": "br-int", "label": "tempest-TestShelveInstance-1922554351-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d1aa0aeea4145b69bf310c4d9b649d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe62c72a-f6", "ovs_interfaceid": "fe62c72a-f69b-4109-bfa3-e4a51fa43d0e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75229) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 10:01:18 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-8062bc5e-47d6-4920-9df8-c2d37762af10 req-32596788-eeea-429b-9ddc-452df02a32c8 service nova] Acquired lock "refresh_cache-abe7e145-d3bc-49a1-83be-793488de828b" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 10:01:18 user nova-compute[75229]: DEBUG nova.network.neutron [req-8062bc5e-47d6-4920-9df8-c2d37762af10 req-32596788-eeea-429b-9ddc-452df02a32c8 service nova] [instance: abe7e145-d3bc-49a1-83be-793488de828b] Refreshing network info cache for port fe62c72a-f69b-4109-bfa3-e4a51fa43d0e {{(pid=75229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 10:01:18 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:01:18 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:01:18 user nova-compute[75229]: DEBUG nova.network.neutron [req-8062bc5e-47d6-4920-9df8-c2d37762af10 req-32596788-eeea-429b-9ddc-452df02a32c8 service nova] [instance: abe7e145-d3bc-49a1-83be-793488de828b] Updated VIF entry in instance network info cache for port fe62c72a-f69b-4109-bfa3-e4a51fa43d0e. {{(pid=75229) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 10:01:18 user nova-compute[75229]: DEBUG nova.network.neutron [req-8062bc5e-47d6-4920-9df8-c2d37762af10 req-32596788-eeea-429b-9ddc-452df02a32c8 service nova] [instance: abe7e145-d3bc-49a1-83be-793488de828b] Updating instance_info_cache with network_info: [{"id": "fe62c72a-f69b-4109-bfa3-e4a51fa43d0e", "address": "fa:16:3e:f8:a3:e5", "network": {"id": "f0c67d05-ffe2-4866-baa3-fa4acaeadaa1", "bridge": "br-int", "label": "tempest-TestShelveInstance-1922554351-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d1aa0aeea4145b69bf310c4d9b649d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe62c72a-f6", "ovs_interfaceid": "fe62c72a-f69b-4109-bfa3-e4a51fa43d0e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 10:01:18 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-8062bc5e-47d6-4920-9df8-c2d37762af10 req-32596788-eeea-429b-9ddc-452df02a32c8 service nova] Releasing lock "refresh_cache-abe7e145-d3bc-49a1-83be-793488de828b" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 10:01:19 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:01:20 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-d9009eec-3dc0-4053-bd80-a554092c6fe1 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Acquiring lock "eba59006-83c1-4bda-b9f5-f3be4d1e5e58" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:01:20 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-d9009eec-3dc0-4053-bd80-a554092c6fe1 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Lock "eba59006-83c1-4bda-b9f5-f3be4d1e5e58" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:01:20 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-d9009eec-3dc0-4053-bd80-a554092c6fe1 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Acquiring lock "eba59006-83c1-4bda-b9f5-f3be4d1e5e58-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:01:20 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-d9009eec-3dc0-4053-bd80-a554092c6fe1 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Lock "eba59006-83c1-4bda-b9f5-f3be4d1e5e58-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:01:20 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-d9009eec-3dc0-4053-bd80-a554092c6fe1 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Lock "eba59006-83c1-4bda-b9f5-f3be4d1e5e58-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:01:20 user nova-compute[75229]: INFO nova.compute.manager [None req-d9009eec-3dc0-4053-bd80-a554092c6fe1 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] [instance: eba59006-83c1-4bda-b9f5-f3be4d1e5e58] Terminating instance
Nov 14 10:01:20 user nova-compute[75229]: DEBUG nova.compute.manager [None req-d9009eec-3dc0-4053-bd80-a554092c6fe1 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] [instance: eba59006-83c1-4bda-b9f5-f3be4d1e5e58] Start destroying the instance on the hypervisor. {{(pid=75229) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 10:01:20 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:01:20 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:01:20 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:01:20 user nova-compute[75229]: DEBUG nova.compute.manager [None req-cc1e22a8-8940-450c-8df8-57dfb48e2196 tempest-TestShelveInstance-1161595377 tempest-TestShelveInstance-1161595377-project-member] [instance: abe7e145-d3bc-49a1-83be-793488de828b] Start spawning the instance on the hypervisor. {{(pid=75229) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 10:01:20 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-cc1e22a8-8940-450c-8df8-57dfb48e2196 tempest-TestShelveInstance-1161595377 tempest-TestShelveInstance-1161595377-project-member] [instance: abe7e145-d3bc-49a1-83be-793488de828b] Creating instance directory {{(pid=75229) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 10:01:20 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-cc1e22a8-8940-450c-8df8-57dfb48e2196 tempest-TestShelveInstance-1161595377 tempest-TestShelveInstance-1161595377-project-member] [instance: abe7e145-d3bc-49a1-83be-793488de828b] Creating image(s)
Nov 14 10:01:20 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-cc1e22a8-8940-450c-8df8-57dfb48e2196 tempest-TestShelveInstance-1161595377 tempest-TestShelveInstance-1161595377-project-member] [instance: abe7e145-d3bc-49a1-83be-793488de828b] Did not create local disks {{(pid=75229) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 14 10:01:20 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-cc1e22a8-8940-450c-8df8-57dfb48e2196 tempest-TestShelveInstance-1161595377 tempest-TestShelveInstance-1161595377-project-member] [instance: abe7e145-d3bc-49a1-83be-793488de828b] Ensure instance console log exists: /opt/stack/data/nova/instances/abe7e145-d3bc-49a1-83be-793488de828b/console.log {{(pid=75229) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 10:01:20 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-cc1e22a8-8940-450c-8df8-57dfb48e2196 tempest-TestShelveInstance-1161595377 tempest-TestShelveInstance-1161595377-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:01:20 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-cc1e22a8-8940-450c-8df8-57dfb48e2196 tempest-TestShelveInstance-1161595377 tempest-TestShelveInstance-1161595377-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:01:20 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-cc1e22a8-8940-450c-8df8-57dfb48e2196 tempest-TestShelveInstance-1161595377 tempest-TestShelveInstance-1161595377-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:01:20 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-cc1e22a8-8940-450c-8df8-57dfb48e2196 tempest-TestShelveInstance-1161595377 tempest-TestShelveInstance-1161595377-project-member] [instance: abe7e145-d3bc-49a1-83be-793488de828b] Start _get_guest_xml network_info=[{"id": "fe62c72a-f69b-4109-bfa3-e4a51fa43d0e", "address": "fa:16:3e:f8:a3:e5", "network": {"id": "f0c67d05-ffe2-4866-baa3-fa4acaeadaa1", "bridge": "br-int", "label": "tempest-TestShelveInstance-1922554351-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d1aa0aeea4145b69bf310c4d9b649d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe62c72a-f6", "ovs_interfaceid": "fe62c72a-f69b-4109-bfa3-e4a51fa43d0e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:e4a6dca6-1581-494f-afe5-3aac2b4d2c15', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VCFjOGhf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'abe7e145-d3bc-49a1-83be-793488de828b', 'attached_at': '', 'detached_at': '', 'volume_id': 'e4a6dca6-1581-494f-afe5-3aac2b4d2c15', 'serial': 'e4a6dca6-1581-494f-afe5-3aac2b4d2c15'}, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'attachment_id': 'c15bfded-9e9c-4e7d-924e-6d0d97ce874a', 'guest_format': None, 'device_type': 'disk', 'volume_type': None} {{(pid=75229) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 10:01:21 user nova-compute[75229]: WARNING nova.virt.libvirt.driver [None req-cc1e22a8-8940-450c-8df8-57dfb48e2196 tempest-TestShelveInstance-1161595377 tempest-TestShelveInstance-1161595377-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 10:01:21 user nova-compute[75229]: WARNING nova.virt.libvirt.driver [None req-cc1e22a8-8940-450c-8df8-57dfb48e2196 tempest-TestShelveInstance-1161595377 tempest-TestShelveInstance-1161595377-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 10:01:21 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-cc1e22a8-8940-450c-8df8-57dfb48e2196 tempest-TestShelveInstance-1161595377 tempest-TestShelveInstance-1161595377-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75229) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 10:01:21 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-cc1e22a8-8940-450c-8df8-57dfb48e2196 tempest-TestShelveInstance-1161595377 tempest-TestShelveInstance-1161595377-project-member] CPU controller missing on host. {{(pid=75229) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 10:01:21 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-cc1e22a8-8940-450c-8df8-57dfb48e2196 tempest-TestShelveInstance-1161595377 tempest-TestShelveInstance-1161595377-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75229) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 10:01:21 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-cc1e22a8-8940-450c-8df8-57dfb48e2196 tempest-TestShelveInstance-1161595377 tempest-TestShelveInstance-1161595377-project-member] CPU controller found on host. {{(pid=75229) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 10:01:21 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-cc1e22a8-8940-450c-8df8-57dfb48e2196 tempest-TestShelveInstance-1161595377 tempest-TestShelveInstance-1161595377-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75229) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 10:01:21 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-cc1e22a8-8940-450c-8df8-57dfb48e2196 tempest-TestShelveInstance-1161595377 tempest-TestShelveInstance-1161595377-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T09:39:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 10:01:21 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-cc1e22a8-8940-450c-8df8-57dfb48e2196 tempest-TestShelveInstance-1161595377 tempest-TestShelveInstance-1161595377-project-member] Flavor limits 0:0:0 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 10:01:21 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-cc1e22a8-8940-450c-8df8-57dfb48e2196 tempest-TestShelveInstance-1161595377 tempest-TestShelveInstance-1161595377-project-member] Image limits 0:0:0 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 10:01:21 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-cc1e22a8-8940-450c-8df8-57dfb48e2196 tempest-TestShelveInstance-1161595377 tempest-TestShelveInstance-1161595377-project-member] Flavor pref 0:0:0 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 10:01:21 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-cc1e22a8-8940-450c-8df8-57dfb48e2196 tempest-TestShelveInstance-1161595377 tempest-TestShelveInstance-1161595377-project-member] Image pref 0:0:0 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 10:01:21 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-cc1e22a8-8940-450c-8df8-57dfb48e2196 tempest-TestShelveInstance-1161595377 tempest-TestShelveInstance-1161595377-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 10:01:21 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-cc1e22a8-8940-450c-8df8-57dfb48e2196 tempest-TestShelveInstance-1161595377 tempest-TestShelveInstance-1161595377-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 10:01:21 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-cc1e22a8-8940-450c-8df8-57dfb48e2196 tempest-TestShelveInstance-1161595377 tempest-TestShelveInstance-1161595377-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75229) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 10:01:21 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-cc1e22a8-8940-450c-8df8-57dfb48e2196 tempest-TestShelveInstance-1161595377 tempest-TestShelveInstance-1161595377-project-member] Got 1 possible topologies {{(pid=75229) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 10:01:21 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-cc1e22a8-8940-450c-8df8-57dfb48e2196 tempest-TestShelveInstance-1161595377 tempest-TestShelveInstance-1161595377-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 10:01:21 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-cc1e22a8-8940-450c-8df8-57dfb48e2196 tempest-TestShelveInstance-1161595377 tempest-TestShelveInstance-1161595377-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 10:01:21 user nova-compute[75229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cc1e22a8-8940-450c-8df8-57dfb48e2196 tempest-TestShelveInstance-1161595377 tempest-TestShelveInstance-1161595377-project-member] [instance: abe7e145-d3bc-49a1-83be-793488de828b] Calling os-brick to attach iSCSI Volume {{(pid=75229) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 10:01:21 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc1e22a8-8940-450c-8df8-57dfb48e2196 tempest-TestShelveInstance-1161595377 tempest-TestShelveInstance-1161595377-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f73f85151b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e4a6dca6-1581-494f-afe5-3aac2b4d2c15', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VCFjOGhf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 10:01:21 user nova-compute[75229]: WARNING os_brick.initiator.connectors.base [None req-cc1e22a8-8940-450c-8df8-57dfb48e2196 tempest-TestShelveInstance-1161595377 tempest-TestShelveInstance-1161595377-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 10:01:21 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-cc1e22a8-8940-450c-8df8-57dfb48e2196 tempest-TestShelveInstance-1161595377 tempest-TestShelveInstance-1161595377-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 10:01:21 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-cc1e22a8-8940-450c-8df8-57dfb48e2196 tempest-TestShelveInstance-1161595377 tempest-TestShelveInstance-1161595377-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 10:01:21 user nova-compute[75229]: WARNING os_brick.initiator.connectors.base [None req-cc1e22a8-8940-450c-8df8-57dfb48e2196 tempest-TestShelveInstance-1161595377 tempest-TestShelveInstance-1161595377-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 10:01:21 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-cc1e22a8-8940-450c-8df8-57dfb48e2196 tempest-TestShelveInstance-1161595377 tempest-TestShelveInstance-1161595377-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e4a6dca6-1581-494f-afe5-3aac2b4d2c15" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 10:01:21 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-cc1e22a8-8940-450c-8df8-57dfb48e2196 tempest-TestShelveInstance-1161595377 tempest-TestShelveInstance-1161595377-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e4a6dca6-1581-494f-afe5-3aac2b4d2c15" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 10:01:21 user nova-compute[75229]: INFO os_brick.initiator.connectors.iscsi [None req-cc1e22a8-8940-450c-8df8-57dfb48e2196 tempest-TestShelveInstance-1161595377 tempest-TestShelveInstance-1161595377-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 10:01:21 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4a6dca6-1581-494f-afe5-3aac2b4d2c15 -p 172.16.0.220:3260 {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:01:21 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4a6dca6-1581-494f-afe5-3aac2b4d2c15 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:01:21 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b871135-e84c-49a9-b88f-0c3aed015101]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:01:21 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc1e22a8-8940-450c-8df8-57dfb48e2196 tempest-TestShelveInstance-1161595377 tempest-TestShelveInstance-1161595377-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 10:01:21 user nova-compute[75229]:  {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 10:01:21 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4a6dca6-1581-494f-afe5-3aac2b4d2c15 -p 172.16.0.220:3260 --interface default --op new {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:01:21 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4a6dca6-1581-494f-afe5-3aac2b4d2c15 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:01:21 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa9467c5-7600-4aa4-8bef-5d5f0e14b3d4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e4a6dca6-1581-494f-afe5-3aac2b4d2c15] added\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:01:21 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc1e22a8-8940-450c-8df8-57dfb48e2196 tempest-TestShelveInstance-1161595377 tempest-TestShelveInstance-1161595377-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e4a6dca6-1581-494f-afe5-3aac2b4d2c15] added
Nov 14 10:01:21 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 10:01:21 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4a6dca6-1581-494f-afe5-3aac2b4d2c15 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:01:21 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4a6dca6-1581-494f-afe5-3aac2b4d2c15 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:01:21 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdc29522-6c98-47d8-99ba-222bf9448a20]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:01:21 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc1e22a8-8940-450c-8df8-57dfb48e2196 tempest-TestShelveInstance-1161595377 tempest-TestShelveInstance-1161595377-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 10:01:21 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4a6dca6-1581-494f-afe5-3aac2b4d2c15 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:01:21 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4a6dca6-1581-494f-afe5-3aac2b4d2c15 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:01:21 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[991a7dce-3638-4135-b325-6c4ad10eec88]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:01:21 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc1e22a8-8940-450c-8df8-57dfb48e2196 tempest-TestShelveInstance-1161595377 tempest-TestShelveInstance-1161595377-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 10:01:21 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4a6dca6-1581-494f-afe5-3aac2b4d2c15 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VCFjOGhf {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:01:21 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4a6dca6-1581-494f-afe5-3aac2b4d2c15 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VCFjOGhf" returned: 0 in 0.018s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:01:21 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d7e6e48-0de9-4f7d-882a-53dfc3177e2a]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:01:21 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc1e22a8-8940-450c-8df8-57dfb48e2196 tempest-TestShelveInstance-1161595377 tempest-TestShelveInstance-1161595377-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'VCFjOGhf'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 10:01:21 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4a6dca6-1581-494f-afe5-3aac2b4d2c15 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:01:21 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4a6dca6-1581-494f-afe5-3aac2b4d2c15 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:01:21 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[a930c5fc-50b4-4f97-899f-5f8d1db75e87]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:01:21 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc1e22a8-8940-450c-8df8-57dfb48e2196 tempest-TestShelveInstance-1161595377 tempest-TestShelveInstance-1161595377-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 10:01:21 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:01:21 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:01:21 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[93b7c6e8-1011-4ba8-95d2-2d2944574493]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aebc438-0289-44fe-ad84-4e696468f50e (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5efb0e0-a85c-46ec-8a9d-2763bf548023 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:143891e8-62eb-42d7-b076-db6f52b4f606 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2977635e-b11f-4ab2-875c-e9f396b932dc (non-flash)\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:01:21 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc1e22a8-8940-450c-8df8-57dfb48e2196 tempest-TestShelveInstance-1161595377 tempest-TestShelveInstance-1161595377-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aebc438-0289-44fe-ad84-4e696468f50e (non-flash)
Nov 14 10:01:21 user nova-compute[75229]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5efb0e0-a85c-46ec-8a9d-2763bf548023 (non-flash)
Nov 14 10:01:21 user nova-compute[75229]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:143891e8-62eb-42d7-b076-db6f52b4f606 (non-flash)
Nov 14 10:01:21 user nova-compute[75229]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2977635e-b11f-4ab2-875c-e9f396b932dc (non-flash)
Nov 14 10:01:21 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 10:01:21 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc1e22a8-8940-450c-8df8-57dfb48e2196 tempest-TestShelveInstance-1161595377 tempest-TestShelveInstance-1161595377-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aebc438-0289-44fe-ad84-4e696468f50e (non-flash)
Nov 14 10:01:21 user nova-compute[75229]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5efb0e0-a85c-46ec-8a9d-2763bf548023 (non-flash)
Nov 14 10:01:21 user nova-compute[75229]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:143891e8-62eb-42d7-b076-db6f52b4f606 (non-flash)
Nov 14 10:01:21 user nova-compute[75229]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2977635e-b11f-4ab2-875c-e9f396b932dc (non-flash)
Nov 14 10:01:21 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 10:01:21 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4a6dca6-1581-494f-afe5-3aac2b4d2c15 -p 172.16.0.220:3260 --login {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:01:21 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4a6dca6-1581-494f-afe5-3aac2b4d2c15 -p 172.16.0.220:3260 --login" returned: 0 in 0.079s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:01:21 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[10bfddaa-811e-4232-bdf0-87da83740944]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e4a6dca6-1581-494f-afe5-3aac2b4d2c15, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e4a6dca6-1581-494f-afe5-3aac2b4d2c15, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:01:21 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc1e22a8-8940-450c-8df8-57dfb48e2196 tempest-TestShelveInstance-1161595377 tempest-TestShelveInstance-1161595377-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e4a6dca6-1581-494f-afe5-3aac2b4d2c15, portal: 172.16.0.220,3260]
Nov 14 10:01:21 user nova-compute[75229]: Login to [iface: default, target: iqn.2010-10.org.openstack:e4a6dca6-1581-494f-afe5-3aac2b4d2c15, portal: 172.16.0.220,3260] successful.
Nov 14 10:01:21 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 10:01:21 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4a6dca6-1581-494f-afe5-3aac2b4d2c15 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:01:21 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4a6dca6-1581-494f-afe5-3aac2b4d2c15 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:01:21 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[292b014c-841c-436e-afc4-49f94a2b79db]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:01:21 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc1e22a8-8940-450c-8df8-57dfb48e2196 tempest-TestShelveInstance-1161595377 tempest-TestShelveInstance-1161595377-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 10:01:21 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:01:21 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:01:21 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fdc105f-a11e-45e4-96f8-601ad4c24856]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aebc438-0289-44fe-ad84-4e696468f50e (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5efb0e0-a85c-46ec-8a9d-2763bf548023 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:143891e8-62eb-42d7-b076-db6f52b4f606 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2977635e-b11f-4ab2-875c-e9f396b932dc (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4a6dca6-1581-494f-afe5-3aac2b4d2c15 (non-flash)\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:01:21 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc1e22a8-8940-450c-8df8-57dfb48e2196 tempest-TestShelveInstance-1161595377 tempest-TestShelveInstance-1161595377-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aebc438-0289-44fe-ad84-4e696468f50e (non-flash)
Nov 14 10:01:21 user nova-compute[75229]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5efb0e0-a85c-46ec-8a9d-2763bf548023 (non-flash)
Nov 14 10:01:21 user nova-compute[75229]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:143891e8-62eb-42d7-b076-db6f52b4f606 (non-flash)
Nov 14 10:01:21 user nova-compute[75229]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2977635e-b11f-4ab2-875c-e9f396b932dc (non-flash)
Nov 14 10:01:21 user nova-compute[75229]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4a6dca6-1581-494f-afe5-3aac2b4d2c15 (non-flash)
Nov 14 10:01:21 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 10:01:21 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc1e22a8-8940-450c-8df8-57dfb48e2196 tempest-TestShelveInstance-1161595377 tempest-TestShelveInstance-1161595377-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aebc438-0289-44fe-ad84-4e696468f50e (non-flash)
Nov 14 10:01:21 user nova-compute[75229]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5efb0e0-a85c-46ec-8a9d-2763bf548023 (non-flash)
Nov 14 10:01:21 user nova-compute[75229]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:143891e8-62eb-42d7-b076-db6f52b4f606 (non-flash)
Nov 14 10:01:21 user nova-compute[75229]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2977635e-b11f-4ab2-875c-e9f396b932dc (non-flash)
Nov 14 10:01:21 user nova-compute[75229]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4a6dca6-1581-494f-afe5-3aac2b4d2c15 (non-flash)
Nov 14 10:01:21 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 10:01:21 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-cc1e22a8-8940-450c-8df8-57dfb48e2196 tempest-TestShelveInstance-1161595377 tempest-TestShelveInstance-1161595377-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e4a6dca6-1581-494f-afe5-3aac2b4d2c15" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.316s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 10:01:21 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc1e22a8-8940-450c-8df8-57dfb48e2196 tempest-TestShelveInstance-1161595377 tempest-TestShelveInstance-1161595377-project-member] Connected to 172.16.0.220:3260 {{(pid=75229) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 10:01:21 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-cc1e22a8-8940-450c-8df8-57dfb48e2196 tempest-TestShelveInstance-1161595377 tempest-TestShelveInstance-1161595377-project-member] HCTL ('35', '-', '-', 0) found on session 41 with lun 0 {{(pid=75229) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 10:01:21 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-cc1e22a8-8940-450c-8df8-57dfb48e2196 tempest-TestShelveInstance-1161595377 tempest-TestShelveInstance-1161595377-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75229) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 10:01:21 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:01:21 user nova-compute[75229]: DEBUG nova.compute.manager [req-8fd0c633-5e86-4535-899a-500b65494ae7 req-22f584df-0950-4250-962e-a80ff68f4895 service nova] [instance: eba59006-83c1-4bda-b9f5-f3be4d1e5e58] Received event network-vif-unplugged-3eec6b6f-28b1-4026-b81a-22c88d1f94a4 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 10:01:21 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-8fd0c633-5e86-4535-899a-500b65494ae7 req-22f584df-0950-4250-962e-a80ff68f4895 service nova] Acquiring lock "eba59006-83c1-4bda-b9f5-f3be4d1e5e58-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:01:21 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-8fd0c633-5e86-4535-899a-500b65494ae7 req-22f584df-0950-4250-962e-a80ff68f4895 service nova] Lock "eba59006-83c1-4bda-b9f5-f3be4d1e5e58-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:01:21 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-8fd0c633-5e86-4535-899a-500b65494ae7 req-22f584df-0950-4250-962e-a80ff68f4895 service nova] Lock "eba59006-83c1-4bda-b9f5-f3be4d1e5e58-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:01:21 user nova-compute[75229]: DEBUG nova.compute.manager [req-8fd0c633-5e86-4535-899a-500b65494ae7 req-22f584df-0950-4250-962e-a80ff68f4895 service nova] [instance: eba59006-83c1-4bda-b9f5-f3be4d1e5e58] No waiting events found dispatching network-vif-unplugged-3eec6b6f-28b1-4026-b81a-22c88d1f94a4 {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 10:01:21 user nova-compute[75229]: DEBUG nova.compute.manager [req-8fd0c633-5e86-4535-899a-500b65494ae7 req-22f584df-0950-4250-962e-a80ff68f4895 service nova] [instance: eba59006-83c1-4bda-b9f5-f3be4d1e5e58] Received event network-vif-unplugged-3eec6b6f-28b1-4026-b81a-22c88d1f94a4 for instance with task_state deleting. {{(pid=75229) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 10:01:21 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.019s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:01:21 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d582e5a-f15c-4acf-b5f8-cee87d7762a8]: (4, ('- - 0', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:01:21 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-cc1e22a8-8940-450c-8df8-57dfb48e2196 tempest-TestShelveInstance-1161595377 tempest-TestShelveInstance-1161595377-project-member] Searching for a device in session 41 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75229) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 10:01:21 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc1e22a8-8940-450c-8df8-57dfb48e2196 tempest-TestShelveInstance-1161595377 tempest-TestShelveInstance-1161595377-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:e4a6dca6-1581-494f-afe5-3aac2b4d2c15', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VCFjOGhf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75229) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 10:01:21 user nova-compute[75229]: INFO nova.virt.libvirt.driver [-] [instance: eba59006-83c1-4bda-b9f5-f3be4d1e5e58] Instance destroyed successfully.
Nov 14 10:01:21 user nova-compute[75229]: DEBUG nova.objects.instance [None req-d9009eec-3dc0-4053-bd80-a554092c6fe1 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Lazy-loading 'resources' on Instance uuid eba59006-83c1-4bda-b9f5-f3be4d1e5e58 {{(pid=75229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 10:01:21 user nova-compute[75229]: DEBUG nova.virt.libvirt.vif [None req-d9009eec-3dc0-4053-bd80-a554092c6fe1 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T09:58:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1194693438',display_name='tempest-AttachVolumeNegativeTest-server-1194693438',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1194693438',id=37,image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEGArvZaufn98L/n8qe2G/tMbxpeJIFyBc3Sy+z02pn+jM1N9OPNiOdEk/tKM43bM6T65GvcsHCI7BkPQknWTS/YFjBkC5TVU0CgY0hjM5R93g1H95A5vsED7YJjsKnXtQ==',key_name='tempest-keypair-1144153704',keypairs=<?>,launch_index=0,launched_at=2023-11-14T09:58:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8b8d48c38c7344f5b12d0ed5b9392554',ramdisk_id='',reservation_id='r-nraikvdc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-140392099',owner_user_name='tempest-AttachVolumeNegativeTest-140392099-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T09:58:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3b8313e365eb4970a58c412768e959bf',uuid=eba59006-83c1-4bda-b9f5-f3be4d1e5e58,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3eec6b6f-28b1-4026-b81a-22c88d1f94a4", "address": "fa:16:3e:8c:7a:8a", "network": {"id": "bd407caa-6ef6-400d-9327-3179dc1d8da4", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-29933774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.61", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b8d48c38c7344f5b12d0ed5b9392554", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3eec6b6f-28", "ovs_interfaceid": "3eec6b6f-28b1-4026-b81a-22c88d1f94a4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 10:01:21 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-d9009eec-3dc0-4053-bd80-a554092c6fe1 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Converting VIF {"id": "3eec6b6f-28b1-4026-b81a-22c88d1f94a4", "address": "fa:16:3e:8c:7a:8a", "network": {"id": "bd407caa-6ef6-400d-9327-3179dc1d8da4", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-29933774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.61", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b8d48c38c7344f5b12d0ed5b9392554", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3eec6b6f-28", "ovs_interfaceid": "3eec6b6f-28b1-4026-b81a-22c88d1f94a4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 10:01:21 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-d9009eec-3dc0-4053-bd80-a554092c6fe1 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8c:7a:8a,bridge_name='br-int',has_traffic_filtering=True,id=3eec6b6f-28b1-4026-b81a-22c88d1f94a4,network=Network(bd407caa-6ef6-400d-9327-3179dc1d8da4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3eec6b6f-28') {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 10:01:21 user nova-compute[75229]: DEBUG os_vif [None req-d9009eec-3dc0-4053-bd80-a554092c6fe1 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8c:7a:8a,bridge_name='br-int',has_traffic_filtering=True,id=3eec6b6f-28b1-4026-b81a-22c88d1f94a4,network=Network(bd407caa-6ef6-400d-9327-3179dc1d8da4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3eec6b6f-28') {{(pid=75229) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 10:01:21 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:01:21 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3eec6b6f-28, bridge=br-int, if_exists=True) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 10:01:21 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:01:21 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 10:01:21 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:01:21 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=35036d1d-1acb-456f-aa54-8ec2bbf24e2b) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 10:01:21 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:01:21 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:01:21 user nova-compute[75229]: INFO os_vif [None req-d9009eec-3dc0-4053-bd80-a554092c6fe1 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8c:7a:8a,bridge_name='br-int',has_traffic_filtering=True,id=3eec6b6f-28b1-4026-b81a-22c88d1f94a4,network=Network(bd407caa-6ef6-400d-9327-3179dc1d8da4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3eec6b6f-28')
Nov 14 10:01:21 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-d9009eec-3dc0-4053-bd80-a554092c6fe1 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] [instance: eba59006-83c1-4bda-b9f5-f3be4d1e5e58] Deleting instance files /opt/stack/data/nova/instances/eba59006-83c1-4bda-b9f5-f3be4d1e5e58_del
Nov 14 10:01:21 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-d9009eec-3dc0-4053-bd80-a554092c6fe1 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] [instance: eba59006-83c1-4bda-b9f5-f3be4d1e5e58] Deletion of /opt/stack/data/nova/instances/eba59006-83c1-4bda-b9f5-f3be4d1e5e58_del complete
Nov 14 10:01:21 user nova-compute[75229]: INFO nova.compute.manager [None req-d9009eec-3dc0-4053-bd80-a554092c6fe1 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] [instance: eba59006-83c1-4bda-b9f5-f3be4d1e5e58] Took 1.14 seconds to destroy the instance on the hypervisor.
Nov 14 10:01:21 user nova-compute[75229]: DEBUG oslo.service.loopingcall [None req-d9009eec-3dc0-4053-bd80-a554092c6fe1 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75229) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 10:01:21 user nova-compute[75229]: DEBUG nova.compute.manager [-] [instance: eba59006-83c1-4bda-b9f5-f3be4d1e5e58] Deallocating network for instance {{(pid=75229) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 10:01:21 user nova-compute[75229]: DEBUG nova.network.neutron [-] [instance: eba59006-83c1-4bda-b9f5-f3be4d1e5e58] deallocate_for_instance() {{(pid=75229) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 10:01:22 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-cc1e22a8-8940-450c-8df8-57dfb48e2196 tempest-TestShelveInstance-1161595377 tempest-TestShelveInstance-1161595377-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.364s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 10:01:22 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc1e22a8-8940-450c-8df8-57dfb48e2196 tempest-TestShelveInstance-1161595377 tempest-TestShelveInstance-1161595377-project-member] <== connect_volume: return (1367ms) {'type': 'block', 'scsi_wwn': '23162366231343262', 'path': '/dev/sdd'} {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 10:01:22 user nova-compute[75229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cc1e22a8-8940-450c-8df8-57dfb48e2196 tempest-TestShelveInstance-1161595377 tempest-TestShelveInstance-1161595377-project-member] [instance: abe7e145-d3bc-49a1-83be-793488de828b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23162366231343262', 'path': '/dev/sdd'} {{(pid=75229) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 10:01:22 user nova-compute[75229]: DEBUG nova.virt.libvirt.vif [None req-cc1e22a8-8940-450c-8df8-57dfb48e2196 tempest-TestShelveInstance-1161595377 tempest-TestShelveInstance-1161595377-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T10:01:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1956352286',display_name='tempest-TestShelveInstance-server-1956352286',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1956352286',id=39,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLok8uDDoJEyioPdIocdaZ5mZahqhblgQ0EaVI+XqvZ5awYdli0p5VbxXjHgh+7IXxcRUPZZKXYprbMW6OXihRZCCr8OWYnUiMmEy0FQ5s4gHpX4TAp2yBSEZomFcAdpKw==',key_name='tempest-TestShelveInstance-743585374',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0d1aa0aeea4145b69bf310c4d9b649d0',ramdisk_id='',reservation_id='r-ysbldy6n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-1161595377',owner_user_name='tempest-TestShelveInstance-1161595377-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T10:01:16Z,user_data=None,user_id='cd2c5b18ddd44bf18089cf001e012ebb',uuid=abe7e145-d3bc-49a1-83be-793488de828b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fe62c72a-f69b-4109-bfa3-e4a51fa43d0e", "address": "fa:16:3e:f8:a3:e5", "network": {"id": "f0c67d05-ffe2-4866-baa3-fa4acaeadaa1", "bridge": "br-int", "label": "tempest-TestShelveInstance-1922554351-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d1aa0aeea4145b69bf310c4d9b649d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe62c72a-f6", "ovs_interfaceid": "fe62c72a-f69b-4109-bfa3-e4a51fa43d0e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75229) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 10:01:22 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-cc1e22a8-8940-450c-8df8-57dfb48e2196 tempest-TestShelveInstance-1161595377 tempest-TestShelveInstance-1161595377-project-member] Converting VIF {"id": "fe62c72a-f69b-4109-bfa3-e4a51fa43d0e", "address": "fa:16:3e:f8:a3:e5", "network": {"id": "f0c67d05-ffe2-4866-baa3-fa4acaeadaa1", "bridge": "br-int", "label": "tempest-TestShelveInstance-1922554351-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d1aa0aeea4145b69bf310c4d9b649d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe62c72a-f6", "ovs_interfaceid": "fe62c72a-f69b-4109-bfa3-e4a51fa43d0e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 10:01:22 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-cc1e22a8-8940-450c-8df8-57dfb48e2196 tempest-TestShelveInstance-1161595377 tempest-TestShelveInstance-1161595377-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f8:a3:e5,bridge_name='br-int',has_traffic_filtering=True,id=fe62c72a-f69b-4109-bfa3-e4a51fa43d0e,network=Network(f0c67d05-ffe2-4866-baa3-fa4acaeadaa1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe62c72a-f6') {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 10:01:22 user nova-compute[75229]: DEBUG nova.objects.instance [None req-cc1e22a8-8940-450c-8df8-57dfb48e2196 tempest-TestShelveInstance-1161595377 tempest-TestShelveInstance-1161595377-project-member] Lazy-loading 'pci_devices' on Instance uuid abe7e145-d3bc-49a1-83be-793488de828b {{(pid=75229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 10:01:22 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-cc1e22a8-8940-450c-8df8-57dfb48e2196 tempest-TestShelveInstance-1161595377 tempest-TestShelveInstance-1161595377-project-member] [instance: abe7e145-d3bc-49a1-83be-793488de828b] End _get_guest_xml xml=<domain type="kvm">
Nov 14 10:01:22 user nova-compute[75229]:   <uuid>abe7e145-d3bc-49a1-83be-793488de828b</uuid>
Nov 14 10:01:22 user nova-compute[75229]:   <name>instance-00000027</name>
Nov 14 10:01:22 user nova-compute[75229]:   <memory>524288</memory>
Nov 14 10:01:22 user nova-compute[75229]:   <vcpu>1</vcpu>
Nov 14 10:01:22 user nova-compute[75229]:   <metadata>
Nov 14 10:01:22 user nova-compute[75229]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 10:01:22 user nova-compute[75229]:       <nova:package version="0.0.0"/>
Nov 14 10:01:22 user nova-compute[75229]:       <nova:name>tempest-TestShelveInstance-server-1956352286</nova:name>
Nov 14 10:01:22 user nova-compute[75229]:       <nova:creationTime>2023-11-14 10:01:21</nova:creationTime>
Nov 14 10:01:22 user nova-compute[75229]:       <nova:flavor name="m1.tiny">
Nov 14 10:01:22 user nova-compute[75229]:         <nova:memory>512</nova:memory>
Nov 14 10:01:22 user nova-compute[75229]:         <nova:disk>1</nova:disk>
Nov 14 10:01:22 user nova-compute[75229]:         <nova:swap>0</nova:swap>
Nov 14 10:01:22 user nova-compute[75229]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 10:01:22 user nova-compute[75229]:         <nova:vcpus>1</nova:vcpus>
Nov 14 10:01:22 user nova-compute[75229]:       </nova:flavor>
Nov 14 10:01:22 user nova-compute[75229]:       <nova:owner>
Nov 14 10:01:22 user nova-compute[75229]:         <nova:user uuid="cd2c5b18ddd44bf18089cf001e012ebb">tempest-TestShelveInstance-1161595377-project-member</nova:user>
Nov 14 10:01:22 user nova-compute[75229]:         <nova:project uuid="0d1aa0aeea4145b69bf310c4d9b649d0">tempest-TestShelveInstance-1161595377</nova:project>
Nov 14 10:01:22 user nova-compute[75229]:       </nova:owner>
Nov 14 10:01:22 user nova-compute[75229]:       <nova:ports>
Nov 14 10:01:22 user nova-compute[75229]:         <nova:port uuid="fe62c72a-f69b-4109-bfa3-e4a51fa43d0e">
Nov 14 10:01:22 user nova-compute[75229]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 14 10:01:22 user nova-compute[75229]:         </nova:port>
Nov 14 10:01:22 user nova-compute[75229]:       </nova:ports>
Nov 14 10:01:22 user nova-compute[75229]:     </nova:instance>
Nov 14 10:01:22 user nova-compute[75229]:   </metadata>
Nov 14 10:01:22 user nova-compute[75229]:   <sysinfo type="smbios">
Nov 14 10:01:22 user nova-compute[75229]:     <system>
Nov 14 10:01:22 user nova-compute[75229]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 10:01:22 user nova-compute[75229]:       <entry name="product">OpenStack Nova</entry>
Nov 14 10:01:22 user nova-compute[75229]:       <entry name="version">0.0.0</entry>
Nov 14 10:01:22 user nova-compute[75229]:       <entry name="serial">abe7e145-d3bc-49a1-83be-793488de828b</entry>
Nov 14 10:01:22 user nova-compute[75229]:       <entry name="uuid">abe7e145-d3bc-49a1-83be-793488de828b</entry>
Nov 14 10:01:22 user nova-compute[75229]:       <entry name="family">Virtual Machine</entry>
Nov 14 10:01:22 user nova-compute[75229]:     </system>
Nov 14 10:01:22 user nova-compute[75229]:   </sysinfo>
Nov 14 10:01:22 user nova-compute[75229]:   <os>
Nov 14 10:01:22 user nova-compute[75229]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 10:01:22 user nova-compute[75229]:     <boot dev="hd"/>
Nov 14 10:01:22 user nova-compute[75229]:     <smbios mode="sysinfo"/>
Nov 14 10:01:22 user nova-compute[75229]:   </os>
Nov 14 10:01:22 user nova-compute[75229]:   <features>
Nov 14 10:01:22 user nova-compute[75229]:     <acpi/>
Nov 14 10:01:22 user nova-compute[75229]:     <apic/>
Nov 14 10:01:22 user nova-compute[75229]:     <vmcoreinfo/>
Nov 14 10:01:22 user nova-compute[75229]:   </features>
Nov 14 10:01:22 user nova-compute[75229]:   <clock offset="utc">
Nov 14 10:01:22 user nova-compute[75229]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 10:01:22 user nova-compute[75229]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 10:01:22 user nova-compute[75229]:     <timer name="hpet" present="no"/>
Nov 14 10:01:22 user nova-compute[75229]:   </clock>
Nov 14 10:01:22 user nova-compute[75229]:   <cpu mode="custom" match="exact">
Nov 14 10:01:22 user nova-compute[75229]:     <model>Nehalem</model>
Nov 14 10:01:22 user nova-compute[75229]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 10:01:22 user nova-compute[75229]:   </cpu>
Nov 14 10:01:22 user nova-compute[75229]:   <devices>
Nov 14 10:01:22 user nova-compute[75229]:     <disk type="block" device="disk">
Nov 14 10:01:22 user nova-compute[75229]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 10:01:22 user nova-compute[75229]:       <source dev="/dev/sdd"/>
Nov 14 10:01:22 user nova-compute[75229]:       <target dev="vda" bus="virtio"/>
Nov 14 10:01:22 user nova-compute[75229]:       <serial>e4a6dca6-1581-494f-afe5-3aac2b4d2c15</serial>
Nov 14 10:01:22 user nova-compute[75229]:     </disk>
Nov 14 10:01:22 user nova-compute[75229]:     <interface type="ethernet">
Nov 14 10:01:22 user nova-compute[75229]:       <mac address="fa:16:3e:f8:a3:e5"/>
Nov 14 10:01:22 user nova-compute[75229]:       <model type="virtio"/>
Nov 14 10:01:22 user nova-compute[75229]:       <mtu size="1442"/>
Nov 14 10:01:22 user nova-compute[75229]:       <target dev="tapfe62c72a-f6"/>
Nov 14 10:01:22 user nova-compute[75229]:     </interface>
Nov 14 10:01:22 user nova-compute[75229]:     <serial type="pty">
Nov 14 10:01:22 user nova-compute[75229]:       <log file="/opt/stack/data/nova/instances/abe7e145-d3bc-49a1-83be-793488de828b/console.log" append="off"/>
Nov 14 10:01:22 user nova-compute[75229]:     </serial>
Nov 14 10:01:22 user nova-compute[75229]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 10:01:22 user nova-compute[75229]:     <video>
Nov 14 10:01:22 user nova-compute[75229]:       <model type="virtio"/>
Nov 14 10:01:22 user nova-compute[75229]:     </video>
Nov 14 10:01:22 user nova-compute[75229]:     <rng model="virtio">
Nov 14 10:01:22 user nova-compute[75229]:       <backend model="random">/dev/urandom</backend>
Nov 14 10:01:22 user nova-compute[75229]:     </rng>
Nov 14 10:01:22 user nova-compute[75229]:     <controller type="usb" index="0" model="none"/>
Nov 14 10:01:22 user nova-compute[75229]:     <memballoon model="virtio">
Nov 14 10:01:22 user nova-compute[75229]:       <stats period="10"/>
Nov 14 10:01:22 user nova-compute[75229]:     </memballoon>
Nov 14 10:01:22 user nova-compute[75229]:   </devices>
Nov 14 10:01:22 user nova-compute[75229]: </domain>
Nov 14 10:01:22 user nova-compute[75229]:  {{(pid=75229) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 10:01:22 user nova-compute[75229]: DEBUG nova.virt.libvirt.vif [None req-cc1e22a8-8940-450c-8df8-57dfb48e2196 tempest-TestShelveInstance-1161595377 tempest-TestShelveInstance-1161595377-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T10:01:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1956352286',display_name='tempest-TestShelveInstance-server-1956352286',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1956352286',id=39,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLok8uDDoJEyioPdIocdaZ5mZahqhblgQ0EaVI+XqvZ5awYdli0p5VbxXjHgh+7IXxcRUPZZKXYprbMW6OXihRZCCr8OWYnUiMmEy0FQ5s4gHpX4TAp2yBSEZomFcAdpKw==',key_name='tempest-TestShelveInstance-743585374',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0d1aa0aeea4145b69bf310c4d9b649d0',ramdisk_id='',reservation_id='r-ysbldy6n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-1161595377',owner_user_name='tempest-TestShelveInstance-1161595377-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T10:01:16Z,user_data=None,user_id='cd2c5b18ddd44bf18089cf001e012ebb',uuid=abe7e145-d3bc-49a1-83be-793488de828b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fe62c72a-f69b-4109-bfa3-e4a51fa43d0e", "address": "fa:16:3e:f8:a3:e5", "network": {"id": "f0c67d05-ffe2-4866-baa3-fa4acaeadaa1", "bridge": "br-int", "label": "tempest-TestShelveInstance-1922554351-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d1aa0aeea4145b69bf310c4d9b649d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe62c72a-f6", "ovs_interfaceid": "fe62c72a-f69b-4109-bfa3-e4a51fa43d0e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 10:01:22 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-cc1e22a8-8940-450c-8df8-57dfb48e2196 tempest-TestShelveInstance-1161595377 tempest-TestShelveInstance-1161595377-project-member] Converting VIF {"id": "fe62c72a-f69b-4109-bfa3-e4a51fa43d0e", "address": "fa:16:3e:f8:a3:e5", "network": {"id": "f0c67d05-ffe2-4866-baa3-fa4acaeadaa1", "bridge": "br-int", "label": "tempest-TestShelveInstance-1922554351-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d1aa0aeea4145b69bf310c4d9b649d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe62c72a-f6", "ovs_interfaceid": "fe62c72a-f69b-4109-bfa3-e4a51fa43d0e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 10:01:22 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-cc1e22a8-8940-450c-8df8-57dfb48e2196 tempest-TestShelveInstance-1161595377 tempest-TestShelveInstance-1161595377-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f8:a3:e5,bridge_name='br-int',has_traffic_filtering=True,id=fe62c72a-f69b-4109-bfa3-e4a51fa43d0e,network=Network(f0c67d05-ffe2-4866-baa3-fa4acaeadaa1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe62c72a-f6') {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 10:01:22 user nova-compute[75229]: DEBUG os_vif [None req-cc1e22a8-8940-450c-8df8-57dfb48e2196 tempest-TestShelveInstance-1161595377 tempest-TestShelveInstance-1161595377-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f8:a3:e5,bridge_name='br-int',has_traffic_filtering=True,id=fe62c72a-f69b-4109-bfa3-e4a51fa43d0e,network=Network(f0c67d05-ffe2-4866-baa3-fa4acaeadaa1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe62c72a-f6') {{(pid=75229) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 10:01:22 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:01:22 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 10:01:22 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 10:01:22 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:01:22 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b3f0b2a5-66e2-5d99-b04d-74b93c0599ef', '_type': 'linux-noop'}}, row=False) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 10:01:22 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:01:22 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:01:22 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:01:22 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfe62c72a-f6, may_exist=True, interface_attrs={}) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 10:01:22 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapfe62c72a-f6, col_values=(('qos', UUID('1e64555f-d140-438a-8c67-046b85d5ce22')),), if_exists=True) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 10:01:22 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapfe62c72a-f6, col_values=(('external_ids', {'iface-id': 'fe62c72a-f69b-4109-bfa3-e4a51fa43d0e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f8:a3:e5', 'vm-uuid': 'abe7e145-d3bc-49a1-83be-793488de828b'}),), if_exists=True) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 10:01:22 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:01:22 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 10:01:22 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:01:22 user nova-compute[75229]: INFO os_vif [None req-cc1e22a8-8940-450c-8df8-57dfb48e2196 tempest-TestShelveInstance-1161595377 tempest-TestShelveInstance-1161595377-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f8:a3:e5,bridge_name='br-int',has_traffic_filtering=True,id=fe62c72a-f69b-4109-bfa3-e4a51fa43d0e,network=Network(f0c67d05-ffe2-4866-baa3-fa4acaeadaa1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe62c72a-f6')
Nov 14 10:01:22 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-cc1e22a8-8940-450c-8df8-57dfb48e2196 tempest-TestShelveInstance-1161595377 tempest-TestShelveInstance-1161595377-project-member] No BDM found with device name vda, not building metadata. {{(pid=75229) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 10:01:22 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-cc1e22a8-8940-450c-8df8-57dfb48e2196 tempest-TestShelveInstance-1161595377 tempest-TestShelveInstance-1161595377-project-member] No VIF found with MAC fa:16:3e:f8:a3:e5, not building metadata {{(pid=75229) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 10:01:22 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:01:23 user nova-compute[75229]: DEBUG nova.network.neutron [-] [instance: eba59006-83c1-4bda-b9f5-f3be4d1e5e58] Updating instance_info_cache with network_info: [] {{(pid=75229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 10:01:23 user nova-compute[75229]: INFO nova.compute.manager [-] [instance: eba59006-83c1-4bda-b9f5-f3be4d1e5e58] Took 1.57 seconds to deallocate network for instance.
Nov 14 10:01:23 user nova-compute[75229]: DEBUG nova.compute.manager [req-d1215c6a-de74-4266-8aaf-72aff5753429 req-87749e57-3910-4dc2-a413-ba7db611abb5 service nova] [instance: eba59006-83c1-4bda-b9f5-f3be4d1e5e58] Received event network-vif-deleted-3eec6b6f-28b1-4026-b81a-22c88d1f94a4 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 10:01:23 user nova-compute[75229]: INFO nova.compute.manager [req-d1215c6a-de74-4266-8aaf-72aff5753429 req-87749e57-3910-4dc2-a413-ba7db611abb5 service nova] [instance: eba59006-83c1-4bda-b9f5-f3be4d1e5e58] Neutron deleted interface 3eec6b6f-28b1-4026-b81a-22c88d1f94a4; detaching it from the instance and deleting it from the info cache
Nov 14 10:01:23 user nova-compute[75229]: DEBUG nova.network.neutron [req-d1215c6a-de74-4266-8aaf-72aff5753429 req-87749e57-3910-4dc2-a413-ba7db611abb5 service nova] [instance: eba59006-83c1-4bda-b9f5-f3be4d1e5e58] Updating instance_info_cache with network_info: [] {{(pid=75229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 10:01:23 user nova-compute[75229]: DEBUG nova.compute.manager [req-d1215c6a-de74-4266-8aaf-72aff5753429 req-87749e57-3910-4dc2-a413-ba7db611abb5 service nova] [instance: eba59006-83c1-4bda-b9f5-f3be4d1e5e58] Detach interface failed, port_id=3eec6b6f-28b1-4026-b81a-22c88d1f94a4, reason: Instance eba59006-83c1-4bda-b9f5-f3be4d1e5e58 could not be found. {{(pid=75229) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 14 10:01:23 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-d9009eec-3dc0-4053-bd80-a554092c6fe1 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:01:23 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-d9009eec-3dc0-4053-bd80-a554092c6fe1 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:01:23 user nova-compute[75229]: DEBUG nova.compute.manager [req-bdaccc9e-41b8-4d08-8ff9-03c524cc6b75 req-ea244ac9-293f-4510-99b7-50a969c7a053 service nova] [instance: eba59006-83c1-4bda-b9f5-f3be4d1e5e58] Received event network-vif-plugged-3eec6b6f-28b1-4026-b81a-22c88d1f94a4 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 10:01:23 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-bdaccc9e-41b8-4d08-8ff9-03c524cc6b75 req-ea244ac9-293f-4510-99b7-50a969c7a053 service nova] Acquiring lock "eba59006-83c1-4bda-b9f5-f3be4d1e5e58-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:01:23 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-bdaccc9e-41b8-4d08-8ff9-03c524cc6b75 req-ea244ac9-293f-4510-99b7-50a969c7a053 service nova] Lock "eba59006-83c1-4bda-b9f5-f3be4d1e5e58-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:01:23 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-bdaccc9e-41b8-4d08-8ff9-03c524cc6b75 req-ea244ac9-293f-4510-99b7-50a969c7a053 service nova] Lock "eba59006-83c1-4bda-b9f5-f3be4d1e5e58-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:01:23 user nova-compute[75229]: DEBUG nova.compute.manager [req-bdaccc9e-41b8-4d08-8ff9-03c524cc6b75 req-ea244ac9-293f-4510-99b7-50a969c7a053 service nova] [instance: eba59006-83c1-4bda-b9f5-f3be4d1e5e58] No waiting events found dispatching network-vif-plugged-3eec6b6f-28b1-4026-b81a-22c88d1f94a4 {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 10:01:23 user nova-compute[75229]: WARNING nova.compute.manager [req-bdaccc9e-41b8-4d08-8ff9-03c524cc6b75 req-ea244ac9-293f-4510-99b7-50a969c7a053 service nova] [instance: eba59006-83c1-4bda-b9f5-f3be4d1e5e58] Received unexpected event network-vif-plugged-3eec6b6f-28b1-4026-b81a-22c88d1f94a4 for instance with vm_state deleted and task_state None.
Nov 14 10:01:23 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:01:23 user nova-compute[75229]: DEBUG nova.compute.provider_tree [None req-d9009eec-3dc0-4053-bd80-a554092c6fe1 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Inventory has not changed in ProviderTree for provider: d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 {{(pid=75229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 10:01:23 user nova-compute[75229]: DEBUG nova.scheduler.client.report [None req-d9009eec-3dc0-4053-bd80-a554092c6fe1 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Inventory has not changed for provider d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 10:01:23 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-d9009eec-3dc0-4053-bd80-a554092c6fe1 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.407s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:01:23 user nova-compute[75229]: INFO nova.scheduler.client.report [None req-d9009eec-3dc0-4053-bd80-a554092c6fe1 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Deleted allocations for instance eba59006-83c1-4bda-b9f5-f3be4d1e5e58
Nov 14 10:01:24 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-d9009eec-3dc0-4053-bd80-a554092c6fe1 tempest-AttachVolumeNegativeTest-140392099 tempest-AttachVolumeNegativeTest-140392099-project-member] Lock "eba59006-83c1-4bda-b9f5-f3be4d1e5e58" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.340s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:01:24 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:01:24 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:01:24 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:01:24 user nova-compute[75229]: DEBUG nova.compute.manager [req-a6fe69cc-cad9-4bd3-ba79-0f0e694b6ef5 req-0fa404dc-dcc0-4237-8f29-c906f1e599a9 service nova] [instance: abe7e145-d3bc-49a1-83be-793488de828b] Received event network-vif-plugged-fe62c72a-f69b-4109-bfa3-e4a51fa43d0e {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 10:01:24 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-a6fe69cc-cad9-4bd3-ba79-0f0e694b6ef5 req-0fa404dc-dcc0-4237-8f29-c906f1e599a9 service nova] Acquiring lock "abe7e145-d3bc-49a1-83be-793488de828b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:01:24 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-a6fe69cc-cad9-4bd3-ba79-0f0e694b6ef5 req-0fa404dc-dcc0-4237-8f29-c906f1e599a9 service nova] Lock "abe7e145-d3bc-49a1-83be-793488de828b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:01:24 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-a6fe69cc-cad9-4bd3-ba79-0f0e694b6ef5 req-0fa404dc-dcc0-4237-8f29-c906f1e599a9 service nova] Lock "abe7e145-d3bc-49a1-83be-793488de828b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:01:24 user nova-compute[75229]: DEBUG nova.compute.manager [req-a6fe69cc-cad9-4bd3-ba79-0f0e694b6ef5 req-0fa404dc-dcc0-4237-8f29-c906f1e599a9 service nova] [instance: abe7e145-d3bc-49a1-83be-793488de828b] No waiting events found dispatching network-vif-plugged-fe62c72a-f69b-4109-bfa3-e4a51fa43d0e {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 10:01:24 user nova-compute[75229]: WARNING nova.compute.manager [req-a6fe69cc-cad9-4bd3-ba79-0f0e694b6ef5 req-0fa404dc-dcc0-4237-8f29-c906f1e599a9 service nova] [instance: abe7e145-d3bc-49a1-83be-793488de828b] Received unexpected event network-vif-plugged-fe62c72a-f69b-4109-bfa3-e4a51fa43d0e for instance with vm_state building and task_state spawning.
Nov 14 10:01:24 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:01:24 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:01:24 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:01:24 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:01:24 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:01:26 user nova-compute[75229]: DEBUG nova.compute.manager [None req-cc1e22a8-8940-450c-8df8-57dfb48e2196 tempest-TestShelveInstance-1161595377 tempest-TestShelveInstance-1161595377-project-member] [instance: abe7e145-d3bc-49a1-83be-793488de828b] Instance event wait completed in 0 seconds for  {{(pid=75229) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 10:01:26 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-cc1e22a8-8940-450c-8df8-57dfb48e2196 tempest-TestShelveInstance-1161595377 tempest-TestShelveInstance-1161595377-project-member] [instance: abe7e145-d3bc-49a1-83be-793488de828b] Guest created on hypervisor {{(pid=75229) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 10:01:26 user nova-compute[75229]: INFO nova.virt.libvirt.driver [-] [instance: abe7e145-d3bc-49a1-83be-793488de828b] Instance spawned successfully.
Nov 14 10:01:26 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-cc1e22a8-8940-450c-8df8-57dfb48e2196 tempest-TestShelveInstance-1161595377 tempest-TestShelveInstance-1161595377-project-member] [instance: abe7e145-d3bc-49a1-83be-793488de828b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 10:01:26 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-cc1e22a8-8940-450c-8df8-57dfb48e2196 tempest-TestShelveInstance-1161595377 tempest-TestShelveInstance-1161595377-project-member] [instance: abe7e145-d3bc-49a1-83be-793488de828b] Found default for hw_cdrom_bus of ide {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 10:01:26 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-cc1e22a8-8940-450c-8df8-57dfb48e2196 tempest-TestShelveInstance-1161595377 tempest-TestShelveInstance-1161595377-project-member] [instance: abe7e145-d3bc-49a1-83be-793488de828b] Found default for hw_disk_bus of virtio {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 10:01:26 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-cc1e22a8-8940-450c-8df8-57dfb48e2196 tempest-TestShelveInstance-1161595377 tempest-TestShelveInstance-1161595377-project-member] [instance: abe7e145-d3bc-49a1-83be-793488de828b] Found default for hw_input_bus of None {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 10:01:26 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-cc1e22a8-8940-450c-8df8-57dfb48e2196 tempest-TestShelveInstance-1161595377 tempest-TestShelveInstance-1161595377-project-member] [instance: abe7e145-d3bc-49a1-83be-793488de828b] Found default for hw_pointer_model of None {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 10:01:26 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-cc1e22a8-8940-450c-8df8-57dfb48e2196 tempest-TestShelveInstance-1161595377 tempest-TestShelveInstance-1161595377-project-member] [instance: abe7e145-d3bc-49a1-83be-793488de828b] Found default for hw_video_model of virtio {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 10:01:26 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-cc1e22a8-8940-450c-8df8-57dfb48e2196 tempest-TestShelveInstance-1161595377 tempest-TestShelveInstance-1161595377-project-member] [instance: abe7e145-d3bc-49a1-83be-793488de828b] Found default for hw_vif_model of virtio {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 10:01:26 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:01:26 user nova-compute[75229]: INFO nova.compute.manager [None req-cc1e22a8-8940-450c-8df8-57dfb48e2196 tempest-TestShelveInstance-1161595377 tempest-TestShelveInstance-1161595377-project-member] [instance: abe7e145-d3bc-49a1-83be-793488de828b] Took 5.38 seconds to spawn the instance on the hypervisor.
Nov 14 10:01:26 user nova-compute[75229]: DEBUG nova.compute.manager [None req-cc1e22a8-8940-450c-8df8-57dfb48e2196 tempest-TestShelveInstance-1161595377 tempest-TestShelveInstance-1161595377-project-member] [instance: abe7e145-d3bc-49a1-83be-793488de828b] Checking state {{(pid=75229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 10:01:26 user nova-compute[75229]: DEBUG nova.compute.manager [req-d2827550-a314-4f17-ac46-9d992862a952 req-e7f08e19-ae68-4efd-aef1-69f5181757da service nova] [instance: abe7e145-d3bc-49a1-83be-793488de828b] Received event network-vif-plugged-fe62c72a-f69b-4109-bfa3-e4a51fa43d0e {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 10:01:26 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-d2827550-a314-4f17-ac46-9d992862a952 req-e7f08e19-ae68-4efd-aef1-69f5181757da service nova] Acquiring lock "abe7e145-d3bc-49a1-83be-793488de828b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:01:26 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-d2827550-a314-4f17-ac46-9d992862a952 req-e7f08e19-ae68-4efd-aef1-69f5181757da service nova] Lock "abe7e145-d3bc-49a1-83be-793488de828b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:01:26 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-d2827550-a314-4f17-ac46-9d992862a952 req-e7f08e19-ae68-4efd-aef1-69f5181757da service nova] Lock "abe7e145-d3bc-49a1-83be-793488de828b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:01:26 user nova-compute[75229]: DEBUG nova.compute.manager [req-d2827550-a314-4f17-ac46-9d992862a952 req-e7f08e19-ae68-4efd-aef1-69f5181757da service nova] [instance: abe7e145-d3bc-49a1-83be-793488de828b] No waiting events found dispatching network-vif-plugged-fe62c72a-f69b-4109-bfa3-e4a51fa43d0e {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 10:01:26 user nova-compute[75229]: WARNING nova.compute.manager [req-d2827550-a314-4f17-ac46-9d992862a952 req-e7f08e19-ae68-4efd-aef1-69f5181757da service nova] [instance: abe7e145-d3bc-49a1-83be-793488de828b] Received unexpected event network-vif-plugged-fe62c72a-f69b-4109-bfa3-e4a51fa43d0e for instance with vm_state building and task_state spawning.
Nov 14 10:01:26 user nova-compute[75229]: INFO nova.compute.manager [None req-cc1e22a8-8940-450c-8df8-57dfb48e2196 tempest-TestShelveInstance-1161595377 tempest-TestShelveInstance-1161595377-project-member] [instance: abe7e145-d3bc-49a1-83be-793488de828b] Took 11.33 seconds to build instance.
Nov 14 10:01:26 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-cc1e22a8-8940-450c-8df8-57dfb48e2196 tempest-TestShelveInstance-1161595377 tempest-TestShelveInstance-1161595377-project-member] Lock "abe7e145-d3bc-49a1-83be-793488de828b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.423s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:01:27 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:01:28 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:01:29 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:01:31 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:01:32 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:01:33 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:01:34 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:01:36 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:01:37 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:01:38 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:01:40 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-b5f3d0ea-ffde-48ef-9888-ddd916d07fee tempest-TestServerVolumeAttachScenarioOldVersion-2038862331 tempest-TestServerVolumeAttachScenarioOldVersion-2038862331-project-member] Acquiring lock "7469b999-196b-41c7-9d30-f810b74eaa99" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:01:40 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-b5f3d0ea-ffde-48ef-9888-ddd916d07fee tempest-TestServerVolumeAttachScenarioOldVersion-2038862331 tempest-TestServerVolumeAttachScenarioOldVersion-2038862331-project-member] Lock "7469b999-196b-41c7-9d30-f810b74eaa99" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:01:40 user nova-compute[75229]: DEBUG nova.compute.manager [None req-b5f3d0ea-ffde-48ef-9888-ddd916d07fee tempest-TestServerVolumeAttachScenarioOldVersion-2038862331 tempest-TestServerVolumeAttachScenarioOldVersion-2038862331-project-member] [instance: 7469b999-196b-41c7-9d30-f810b74eaa99] Starting instance... {{(pid=75229) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 10:01:40 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-b5f3d0ea-ffde-48ef-9888-ddd916d07fee tempest-TestServerVolumeAttachScenarioOldVersion-2038862331 tempest-TestServerVolumeAttachScenarioOldVersion-2038862331-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:01:40 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-b5f3d0ea-ffde-48ef-9888-ddd916d07fee tempest-TestServerVolumeAttachScenarioOldVersion-2038862331 tempest-TestServerVolumeAttachScenarioOldVersion-2038862331-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:01:40 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-b5f3d0ea-ffde-48ef-9888-ddd916d07fee tempest-TestServerVolumeAttachScenarioOldVersion-2038862331 tempest-TestServerVolumeAttachScenarioOldVersion-2038862331-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75229) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 10:01:40 user nova-compute[75229]: INFO nova.compute.claims [None req-b5f3d0ea-ffde-48ef-9888-ddd916d07fee tempest-TestServerVolumeAttachScenarioOldVersion-2038862331 tempest-TestServerVolumeAttachScenarioOldVersion-2038862331-project-member] [instance: 7469b999-196b-41c7-9d30-f810b74eaa99] Claim successful on node user
Nov 14 10:01:41 user nova-compute[75229]: DEBUG nova.compute.provider_tree [None req-b5f3d0ea-ffde-48ef-9888-ddd916d07fee tempest-TestServerVolumeAttachScenarioOldVersion-2038862331 tempest-TestServerVolumeAttachScenarioOldVersion-2038862331-project-member] Inventory has not changed in ProviderTree for provider: d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 {{(pid=75229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 10:01:41 user nova-compute[75229]: DEBUG nova.scheduler.client.report [None req-b5f3d0ea-ffde-48ef-9888-ddd916d07fee tempest-TestServerVolumeAttachScenarioOldVersion-2038862331 tempest-TestServerVolumeAttachScenarioOldVersion-2038862331-project-member] Inventory has not changed for provider d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 10:01:41 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-b5f3d0ea-ffde-48ef-9888-ddd916d07fee tempest-TestServerVolumeAttachScenarioOldVersion-2038862331 tempest-TestServerVolumeAttachScenarioOldVersion-2038862331-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.473s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:01:41 user nova-compute[75229]: DEBUG nova.compute.manager [None req-b5f3d0ea-ffde-48ef-9888-ddd916d07fee tempest-TestServerVolumeAttachScenarioOldVersion-2038862331 tempest-TestServerVolumeAttachScenarioOldVersion-2038862331-project-member] [instance: 7469b999-196b-41c7-9d30-f810b74eaa99] Start building networks asynchronously for instance. {{(pid=75229) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 10:01:41 user nova-compute[75229]: DEBUG nova.compute.manager [None req-b5f3d0ea-ffde-48ef-9888-ddd916d07fee tempest-TestServerVolumeAttachScenarioOldVersion-2038862331 tempest-TestServerVolumeAttachScenarioOldVersion-2038862331-project-member] [instance: 7469b999-196b-41c7-9d30-f810b74eaa99] Allocating IP information in the background. {{(pid=75229) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 10:01:41 user nova-compute[75229]: DEBUG nova.network.neutron [None req-b5f3d0ea-ffde-48ef-9888-ddd916d07fee tempest-TestServerVolumeAttachScenarioOldVersion-2038862331 tempest-TestServerVolumeAttachScenarioOldVersion-2038862331-project-member] [instance: 7469b999-196b-41c7-9d30-f810b74eaa99] allocate_for_instance() {{(pid=75229) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 10:01:41 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-b5f3d0ea-ffde-48ef-9888-ddd916d07fee tempest-TestServerVolumeAttachScenarioOldVersion-2038862331 tempest-TestServerVolumeAttachScenarioOldVersion-2038862331-project-member] [instance: 7469b999-196b-41c7-9d30-f810b74eaa99] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 10:01:41 user nova-compute[75229]: DEBUG nova.compute.manager [None req-b5f3d0ea-ffde-48ef-9888-ddd916d07fee tempest-TestServerVolumeAttachScenarioOldVersion-2038862331 tempest-TestServerVolumeAttachScenarioOldVersion-2038862331-project-member] [instance: 7469b999-196b-41c7-9d30-f810b74eaa99] Start building block device mappings for instance. {{(pid=75229) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 10:01:41 user nova-compute[75229]: DEBUG nova.policy [None req-b5f3d0ea-ffde-48ef-9888-ddd916d07fee tempest-TestServerVolumeAttachScenarioOldVersion-2038862331 tempest-TestServerVolumeAttachScenarioOldVersion-2038862331-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'afa8393617b14f119a096f14703b2b08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '806563ad6acd48dfae9a5d6bba121eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75229) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 10:01:41 user nova-compute[75229]: DEBUG nova.compute.manager [None req-b5f3d0ea-ffde-48ef-9888-ddd916d07fee tempest-TestServerVolumeAttachScenarioOldVersion-2038862331 tempest-TestServerVolumeAttachScenarioOldVersion-2038862331-project-member] [instance: 7469b999-196b-41c7-9d30-f810b74eaa99] Start spawning the instance on the hypervisor. {{(pid=75229) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 10:01:41 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-b5f3d0ea-ffde-48ef-9888-ddd916d07fee tempest-TestServerVolumeAttachScenarioOldVersion-2038862331 tempest-TestServerVolumeAttachScenarioOldVersion-2038862331-project-member] [instance: 7469b999-196b-41c7-9d30-f810b74eaa99] Creating instance directory {{(pid=75229) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 10:01:41 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-b5f3d0ea-ffde-48ef-9888-ddd916d07fee tempest-TestServerVolumeAttachScenarioOldVersion-2038862331 tempest-TestServerVolumeAttachScenarioOldVersion-2038862331-project-member] [instance: 7469b999-196b-41c7-9d30-f810b74eaa99] Creating image(s)
Nov 14 10:01:41 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-b5f3d0ea-ffde-48ef-9888-ddd916d07fee tempest-TestServerVolumeAttachScenarioOldVersion-2038862331 tempest-TestServerVolumeAttachScenarioOldVersion-2038862331-project-member] Acquiring lock "/opt/stack/data/nova/instances/7469b999-196b-41c7-9d30-f810b74eaa99/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:01:41 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-b5f3d0ea-ffde-48ef-9888-ddd916d07fee tempest-TestServerVolumeAttachScenarioOldVersion-2038862331 tempest-TestServerVolumeAttachScenarioOldVersion-2038862331-project-member] Lock "/opt/stack/data/nova/instances/7469b999-196b-41c7-9d30-f810b74eaa99/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:01:41 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-b5f3d0ea-ffde-48ef-9888-ddd916d07fee tempest-TestServerVolumeAttachScenarioOldVersion-2038862331 tempest-TestServerVolumeAttachScenarioOldVersion-2038862331-project-member] Lock "/opt/stack/data/nova/instances/7469b999-196b-41c7-9d30-f810b74eaa99/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:01:41 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-b5f3d0ea-ffde-48ef-9888-ddd916d07fee tempest-TestServerVolumeAttachScenarioOldVersion-2038862331 tempest-TestServerVolumeAttachScenarioOldVersion-2038862331-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6 --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:01:41 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-b5f3d0ea-ffde-48ef-9888-ddd916d07fee tempest-TestServerVolumeAttachScenarioOldVersion-2038862331 tempest-TestServerVolumeAttachScenarioOldVersion-2038862331-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6 --force-share --output=json" returned: 0 in 0.177s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:01:41 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-b5f3d0ea-ffde-48ef-9888-ddd916d07fee tempest-TestServerVolumeAttachScenarioOldVersion-2038862331 tempest-TestServerVolumeAttachScenarioOldVersion-2038862331-project-member] Acquiring lock "4f30e3fe703d2381679612a57b1fb80a467f60b6" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:01:41 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-b5f3d0ea-ffde-48ef-9888-ddd916d07fee tempest-TestServerVolumeAttachScenarioOldVersion-2038862331 tempest-TestServerVolumeAttachScenarioOldVersion-2038862331-project-member] Lock "4f30e3fe703d2381679612a57b1fb80a467f60b6" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:01:41 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-b5f3d0ea-ffde-48ef-9888-ddd916d07fee tempest-TestServerVolumeAttachScenarioOldVersion-2038862331 tempest-TestServerVolumeAttachScenarioOldVersion-2038862331-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6 --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:01:41 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-b5f3d0ea-ffde-48ef-9888-ddd916d07fee tempest-TestServerVolumeAttachScenarioOldVersion-2038862331 tempest-TestServerVolumeAttachScenarioOldVersion-2038862331-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6 --force-share --output=json" returned: 0 in 0.214s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:01:41 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-b5f3d0ea-ffde-48ef-9888-ddd916d07fee tempest-TestServerVolumeAttachScenarioOldVersion-2038862331 tempest-TestServerVolumeAttachScenarioOldVersion-2038862331-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6,backing_fmt=raw /opt/stack/data/nova/instances/7469b999-196b-41c7-9d30-f810b74eaa99/disk 1073741824 {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:01:41 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-b5f3d0ea-ffde-48ef-9888-ddd916d07fee tempest-TestServerVolumeAttachScenarioOldVersion-2038862331 tempest-TestServerVolumeAttachScenarioOldVersion-2038862331-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6,backing_fmt=raw /opt/stack/data/nova/instances/7469b999-196b-41c7-9d30-f810b74eaa99/disk 1073741824" returned: 0 in 0.073s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:01:41 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-b5f3d0ea-ffde-48ef-9888-ddd916d07fee tempest-TestServerVolumeAttachScenarioOldVersion-2038862331 tempest-TestServerVolumeAttachScenarioOldVersion-2038862331-project-member] Lock "4f30e3fe703d2381679612a57b1fb80a467f60b6" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.295s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:01:41 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-b5f3d0ea-ffde-48ef-9888-ddd916d07fee tempest-TestServerVolumeAttachScenarioOldVersion-2038862331 tempest-TestServerVolumeAttachScenarioOldVersion-2038862331-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6 --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:01:41 user nova-compute[75229]: DEBUG nova.network.neutron [None req-b5f3d0ea-ffde-48ef-9888-ddd916d07fee tempest-TestServerVolumeAttachScenarioOldVersion-2038862331 tempest-TestServerVolumeAttachScenarioOldVersion-2038862331-project-member] [instance: 7469b999-196b-41c7-9d30-f810b74eaa99] Successfully created port: 66f829f3-daca-440d-9674-c0a116921e54 {{(pid=75229) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 10:01:41 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-b5f3d0ea-ffde-48ef-9888-ddd916d07fee tempest-TestServerVolumeAttachScenarioOldVersion-2038862331 tempest-TestServerVolumeAttachScenarioOldVersion-2038862331-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6 --force-share --output=json" returned: 0 in 0.182s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:01:41 user nova-compute[75229]: DEBUG nova.virt.disk.api [None req-b5f3d0ea-ffde-48ef-9888-ddd916d07fee tempest-TestServerVolumeAttachScenarioOldVersion-2038862331 tempest-TestServerVolumeAttachScenarioOldVersion-2038862331-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7469b999-196b-41c7-9d30-f810b74eaa99/disk. size=1073741824 {{(pid=75229) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 10:01:41 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-b5f3d0ea-ffde-48ef-9888-ddd916d07fee tempest-TestServerVolumeAttachScenarioOldVersion-2038862331 tempest-TestServerVolumeAttachScenarioOldVersion-2038862331-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7469b999-196b-41c7-9d30-f810b74eaa99/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:01:42 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-b5f3d0ea-ffde-48ef-9888-ddd916d07fee tempest-TestServerVolumeAttachScenarioOldVersion-2038862331 tempest-TestServerVolumeAttachScenarioOldVersion-2038862331-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7469b999-196b-41c7-9d30-f810b74eaa99/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:01:42 user nova-compute[75229]: DEBUG nova.virt.disk.api [None req-b5f3d0ea-ffde-48ef-9888-ddd916d07fee tempest-TestServerVolumeAttachScenarioOldVersion-2038862331 tempest-TestServerVolumeAttachScenarioOldVersion-2038862331-project-member] Cannot resize image /opt/stack/data/nova/instances/7469b999-196b-41c7-9d30-f810b74eaa99/disk to a smaller size. {{(pid=75229) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 10:01:42 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-b5f3d0ea-ffde-48ef-9888-ddd916d07fee tempest-TestServerVolumeAttachScenarioOldVersion-2038862331 tempest-TestServerVolumeAttachScenarioOldVersion-2038862331-project-member] [instance: 7469b999-196b-41c7-9d30-f810b74eaa99] Created local disks {{(pid=75229) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 10:01:42 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-b5f3d0ea-ffde-48ef-9888-ddd916d07fee tempest-TestServerVolumeAttachScenarioOldVersion-2038862331 tempest-TestServerVolumeAttachScenarioOldVersion-2038862331-project-member] [instance: 7469b999-196b-41c7-9d30-f810b74eaa99] Ensure instance console log exists: /opt/stack/data/nova/instances/7469b999-196b-41c7-9d30-f810b74eaa99/console.log {{(pid=75229) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 10:01:42 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-b5f3d0ea-ffde-48ef-9888-ddd916d07fee tempest-TestServerVolumeAttachScenarioOldVersion-2038862331 tempest-TestServerVolumeAttachScenarioOldVersion-2038862331-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:01:42 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-b5f3d0ea-ffde-48ef-9888-ddd916d07fee tempest-TestServerVolumeAttachScenarioOldVersion-2038862331 tempest-TestServerVolumeAttachScenarioOldVersion-2038862331-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:01:42 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-b5f3d0ea-ffde-48ef-9888-ddd916d07fee tempest-TestServerVolumeAttachScenarioOldVersion-2038862331 tempest-TestServerVolumeAttachScenarioOldVersion-2038862331-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:01:42 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:01:42 user nova-compute[75229]: DEBUG nova.network.neutron [None req-b5f3d0ea-ffde-48ef-9888-ddd916d07fee tempest-TestServerVolumeAttachScenarioOldVersion-2038862331 tempest-TestServerVolumeAttachScenarioOldVersion-2038862331-project-member] [instance: 7469b999-196b-41c7-9d30-f810b74eaa99] Successfully updated port: 66f829f3-daca-440d-9674-c0a116921e54 {{(pid=75229) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 10:01:42 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-b5f3d0ea-ffde-48ef-9888-ddd916d07fee tempest-TestServerVolumeAttachScenarioOldVersion-2038862331 tempest-TestServerVolumeAttachScenarioOldVersion-2038862331-project-member] Acquiring lock "refresh_cache-7469b999-196b-41c7-9d30-f810b74eaa99" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 10:01:42 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-b5f3d0ea-ffde-48ef-9888-ddd916d07fee tempest-TestServerVolumeAttachScenarioOldVersion-2038862331 tempest-TestServerVolumeAttachScenarioOldVersion-2038862331-project-member] Acquired lock "refresh_cache-7469b999-196b-41c7-9d30-f810b74eaa99" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 10:01:42 user nova-compute[75229]: DEBUG nova.network.neutron [None req-b5f3d0ea-ffde-48ef-9888-ddd916d07fee tempest-TestServerVolumeAttachScenarioOldVersion-2038862331 tempest-TestServerVolumeAttachScenarioOldVersion-2038862331-project-member] [instance: 7469b999-196b-41c7-9d30-f810b74eaa99] Building network info cache for instance {{(pid=75229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 10:01:42 user nova-compute[75229]: DEBUG nova.compute.manager [req-50ca41a4-8c9f-4907-9ab3-834a71bbcc21 req-40ad0b61-1288-49f2-933d-a4052b0d4e62 service nova] [instance: 7469b999-196b-41c7-9d30-f810b74eaa99] Received event network-changed-66f829f3-daca-440d-9674-c0a116921e54 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 10:01:42 user nova-compute[75229]: DEBUG nova.compute.manager [req-50ca41a4-8c9f-4907-9ab3-834a71bbcc21 req-40ad0b61-1288-49f2-933d-a4052b0d4e62 service nova] [instance: 7469b999-196b-41c7-9d30-f810b74eaa99] Refreshing instance network info cache due to event network-changed-66f829f3-daca-440d-9674-c0a116921e54. {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 10:01:42 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-50ca41a4-8c9f-4907-9ab3-834a71bbcc21 req-40ad0b61-1288-49f2-933d-a4052b0d4e62 service nova] Acquiring lock "refresh_cache-7469b999-196b-41c7-9d30-f810b74eaa99" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 10:01:42 user nova-compute[75229]: DEBUG nova.network.neutron [None req-b5f3d0ea-ffde-48ef-9888-ddd916d07fee tempest-TestServerVolumeAttachScenarioOldVersion-2038862331 tempest-TestServerVolumeAttachScenarioOldVersion-2038862331-project-member] [instance: 7469b999-196b-41c7-9d30-f810b74eaa99] Instance cache missing network info. {{(pid=75229) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 10:01:42 user nova-compute[75229]: DEBUG nova.network.neutron [None req-b5f3d0ea-ffde-48ef-9888-ddd916d07fee tempest-TestServerVolumeAttachScenarioOldVersion-2038862331 tempest-TestServerVolumeAttachScenarioOldVersion-2038862331-project-member] [instance: 7469b999-196b-41c7-9d30-f810b74eaa99] Updating instance_info_cache with network_info: [{"id": "66f829f3-daca-440d-9674-c0a116921e54", "address": "fa:16:3e:49:6b:8f", "network": {"id": "a8102981-d4c0-4a9f-a380-1bd0c4b230af", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1874599352-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "806563ad6acd48dfae9a5d6bba121eae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66f829f3-da", "ovs_interfaceid": "66f829f3-daca-440d-9674-c0a116921e54", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 10:01:42 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-b5f3d0ea-ffde-48ef-9888-ddd916d07fee tempest-TestServerVolumeAttachScenarioOldVersion-2038862331 tempest-TestServerVolumeAttachScenarioOldVersion-2038862331-project-member] Releasing lock "refresh_cache-7469b999-196b-41c7-9d30-f810b74eaa99" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 10:01:42 user nova-compute[75229]: DEBUG nova.compute.manager [None req-b5f3d0ea-ffde-48ef-9888-ddd916d07fee tempest-TestServerVolumeAttachScenarioOldVersion-2038862331 tempest-TestServerVolumeAttachScenarioOldVersion-2038862331-project-member] [instance: 7469b999-196b-41c7-9d30-f810b74eaa99] Instance network_info: |[{"id": "66f829f3-daca-440d-9674-c0a116921e54", "address": "fa:16:3e:49:6b:8f", "network": {"id": "a8102981-d4c0-4a9f-a380-1bd0c4b230af", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1874599352-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "806563ad6acd48dfae9a5d6bba121eae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66f829f3-da", "ovs_interfaceid": "66f829f3-daca-440d-9674-c0a116921e54", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75229) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 10:01:42 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-50ca41a4-8c9f-4907-9ab3-834a71bbcc21 req-40ad0b61-1288-49f2-933d-a4052b0d4e62 service nova] Acquired lock "refresh_cache-7469b999-196b-41c7-9d30-f810b74eaa99" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 10:01:42 user nova-compute[75229]: DEBUG nova.network.neutron [req-50ca41a4-8c9f-4907-9ab3-834a71bbcc21 req-40ad0b61-1288-49f2-933d-a4052b0d4e62 service nova] [instance: 7469b999-196b-41c7-9d30-f810b74eaa99] Refreshing network info cache for port 66f829f3-daca-440d-9674-c0a116921e54 {{(pid=75229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 10:01:42 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-b5f3d0ea-ffde-48ef-9888-ddd916d07fee tempest-TestServerVolumeAttachScenarioOldVersion-2038862331 tempest-TestServerVolumeAttachScenarioOldVersion-2038862331-project-member] [instance: 7469b999-196b-41c7-9d30-f810b74eaa99] Start _get_guest_xml network_info=[{"id": "66f829f3-daca-440d-9674-c0a116921e54", "address": "fa:16:3e:49:6b:8f", "network": {"id": "a8102981-d4c0-4a9f-a380-1bd0c4b230af", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1874599352-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "806563ad6acd48dfae9a5d6bba121eae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66f829f3-da", "ovs_interfaceid": "66f829f3-daca-440d-9674-c0a116921e54", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T09:40:10Z,direct_url=<?>,disk_format='qcow2',id=3bef8470-ecc7-40e3-95d4-9254348ea72d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='de5a91106b6948ed937a7178ff9464c4',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T09:40:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'disk_bus': 'virtio', 'guest_format': None, 'encryption_secret_uuid': None, 'size': 0, 'device_type': 'disk', 'image_id': '3bef8470-ecc7-40e3-95d4-9254348ea72d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75229) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 10:01:42 user nova-compute[75229]: WARNING nova.virt.libvirt.driver [None req-b5f3d0ea-ffde-48ef-9888-ddd916d07fee tempest-TestServerVolumeAttachScenarioOldVersion-2038862331 tempest-TestServerVolumeAttachScenarioOldVersion-2038862331-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 10:01:42 user nova-compute[75229]: WARNING nova.virt.libvirt.driver [None req-b5f3d0ea-ffde-48ef-9888-ddd916d07fee tempest-TestServerVolumeAttachScenarioOldVersion-2038862331 tempest-TestServerVolumeAttachScenarioOldVersion-2038862331-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 10:01:42 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-b5f3d0ea-ffde-48ef-9888-ddd916d07fee tempest-TestServerVolumeAttachScenarioOldVersion-2038862331 tempest-TestServerVolumeAttachScenarioOldVersion-2038862331-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75229) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 10:01:42 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-b5f3d0ea-ffde-48ef-9888-ddd916d07fee tempest-TestServerVolumeAttachScenarioOldVersion-2038862331 tempest-TestServerVolumeAttachScenarioOldVersion-2038862331-project-member] CPU controller missing on host. {{(pid=75229) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 10:01:42 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-b5f3d0ea-ffde-48ef-9888-ddd916d07fee tempest-TestServerVolumeAttachScenarioOldVersion-2038862331 tempest-TestServerVolumeAttachScenarioOldVersion-2038862331-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75229) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 10:01:42 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-b5f3d0ea-ffde-48ef-9888-ddd916d07fee tempest-TestServerVolumeAttachScenarioOldVersion-2038862331 tempest-TestServerVolumeAttachScenarioOldVersion-2038862331-project-member] CPU controller found on host. {{(pid=75229) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 10:01:42 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-b5f3d0ea-ffde-48ef-9888-ddd916d07fee tempest-TestServerVolumeAttachScenarioOldVersion-2038862331 tempest-TestServerVolumeAttachScenarioOldVersion-2038862331-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75229) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 10:01:42 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-b5f3d0ea-ffde-48ef-9888-ddd916d07fee tempest-TestServerVolumeAttachScenarioOldVersion-2038862331 tempest-TestServerVolumeAttachScenarioOldVersion-2038862331-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T09:39:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T09:40:10Z,direct_url=<?>,disk_format='qcow2',id=3bef8470-ecc7-40e3-95d4-9254348ea72d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='de5a91106b6948ed937a7178ff9464c4',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T09:40:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 10:01:42 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-b5f3d0ea-ffde-48ef-9888-ddd916d07fee tempest-TestServerVolumeAttachScenarioOldVersion-2038862331 tempest-TestServerVolumeAttachScenarioOldVersion-2038862331-project-member] Flavor limits 0:0:0 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 10:01:42 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-b5f3d0ea-ffde-48ef-9888-ddd916d07fee tempest-TestServerVolumeAttachScenarioOldVersion-2038862331 tempest-TestServerVolumeAttachScenarioOldVersion-2038862331-project-member] Image limits 0:0:0 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 10:01:42 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-b5f3d0ea-ffde-48ef-9888-ddd916d07fee tempest-TestServerVolumeAttachScenarioOldVersion-2038862331 tempest-TestServerVolumeAttachScenarioOldVersion-2038862331-project-member] Flavor pref 0:0:0 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 10:01:42 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-b5f3d0ea-ffde-48ef-9888-ddd916d07fee tempest-TestServerVolumeAttachScenarioOldVersion-2038862331 tempest-TestServerVolumeAttachScenarioOldVersion-2038862331-project-member] Image pref 0:0:0 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 10:01:42 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-b5f3d0ea-ffde-48ef-9888-ddd916d07fee tempest-TestServerVolumeAttachScenarioOldVersion-2038862331 tempest-TestServerVolumeAttachScenarioOldVersion-2038862331-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 10:01:42 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-b5f3d0ea-ffde-48ef-9888-ddd916d07fee tempest-TestServerVolumeAttachScenarioOldVersion-2038862331 tempest-TestServerVolumeAttachScenarioOldVersion-2038862331-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 10:01:42 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-b5f3d0ea-ffde-48ef-9888-ddd916d07fee tempest-TestServerVolumeAttachScenarioOldVersion-2038862331 tempest-TestServerVolumeAttachScenarioOldVersion-2038862331-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75229) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 10:01:42 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-b5f3d0ea-ffde-48ef-9888-ddd916d07fee tempest-TestServerVolumeAttachScenarioOldVersion-2038862331 tempest-TestServerVolumeAttachScenarioOldVersion-2038862331-project-member] Got 1 possible topologies {{(pid=75229) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 10:01:42 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-b5f3d0ea-ffde-48ef-9888-ddd916d07fee tempest-TestServerVolumeAttachScenarioOldVersion-2038862331 tempest-TestServerVolumeAttachScenarioOldVersion-2038862331-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 10:01:42 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-b5f3d0ea-ffde-48ef-9888-ddd916d07fee tempest-TestServerVolumeAttachScenarioOldVersion-2038862331 tempest-TestServerVolumeAttachScenarioOldVersion-2038862331-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 10:01:42 user nova-compute[75229]: DEBUG nova.virt.libvirt.vif [None req-b5f3d0ea-ffde-48ef-9888-ddd916d07fee tempest-TestServerVolumeAttachScenarioOldVersion-2038862331 tempest-TestServerVolumeAttachScenarioOldVersion-2038862331-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T10:01:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1346504140',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1346504140',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1346504',id=40,image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLaTpU6/5A3kp8dqKIJiFl9IeD1ipYyI8RZ1VwVl/+hfHrAsAXzAMBpo+byEk9ZZxg5j/4JopWyxZA6Di/CFxCKPA9qX3NS80VdWP/bSd0AhLUc+38pLtWPCT0AA1fEU0Q==',key_name='tempest-keypair-113203845',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='806563ad6acd48dfae9a5d6bba121eae',ramdisk_id='',reservation_id='r-c80v5jhy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-2038862331',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-2038862331-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T10:01:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='afa8393617b14f119a096f14703b2b08',uuid=7469b999-196b-41c7-9d30-f810b74eaa99,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "66f829f3-daca-440d-9674-c0a116921e54", "address": "fa:16:3e:49:6b:8f", "network": {"id": "a8102981-d4c0-4a9f-a380-1bd0c4b230af", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1874599352-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "806563ad6acd48dfae9a5d6bba121eae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66f829f3-da", "ovs_interfaceid": "66f829f3-daca-440d-9674-c0a116921e54", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75229) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 10:01:42 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-b5f3d0ea-ffde-48ef-9888-ddd916d07fee tempest-TestServerVolumeAttachScenarioOldVersion-2038862331 tempest-TestServerVolumeAttachScenarioOldVersion-2038862331-project-member] Converting VIF {"id": "66f829f3-daca-440d-9674-c0a116921e54", "address": "fa:16:3e:49:6b:8f", "network": {"id": "a8102981-d4c0-4a9f-a380-1bd0c4b230af", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1874599352-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "806563ad6acd48dfae9a5d6bba121eae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66f829f3-da", "ovs_interfaceid": "66f829f3-daca-440d-9674-c0a116921e54", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 10:01:42 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-b5f3d0ea-ffde-48ef-9888-ddd916d07fee tempest-TestServerVolumeAttachScenarioOldVersion-2038862331 tempest-TestServerVolumeAttachScenarioOldVersion-2038862331-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:49:6b:8f,bridge_name='br-int',has_traffic_filtering=True,id=66f829f3-daca-440d-9674-c0a116921e54,network=Network(a8102981-d4c0-4a9f-a380-1bd0c4b230af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap66f829f3-da') {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 10:01:42 user nova-compute[75229]: DEBUG nova.objects.instance [None req-b5f3d0ea-ffde-48ef-9888-ddd916d07fee tempest-TestServerVolumeAttachScenarioOldVersion-2038862331 tempest-TestServerVolumeAttachScenarioOldVersion-2038862331-project-member] Lazy-loading 'pci_devices' on Instance uuid 7469b999-196b-41c7-9d30-f810b74eaa99 {{(pid=75229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 10:01:42 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-b5f3d0ea-ffde-48ef-9888-ddd916d07fee tempest-TestServerVolumeAttachScenarioOldVersion-2038862331 tempest-TestServerVolumeAttachScenarioOldVersion-2038862331-project-member] [instance: 7469b999-196b-41c7-9d30-f810b74eaa99] End _get_guest_xml xml=<domain type="kvm">
Nov 14 10:01:42 user nova-compute[75229]:   <uuid>7469b999-196b-41c7-9d30-f810b74eaa99</uuid>
Nov 14 10:01:42 user nova-compute[75229]:   <name>instance-00000028</name>
Nov 14 10:01:42 user nova-compute[75229]:   <memory>524288</memory>
Nov 14 10:01:42 user nova-compute[75229]:   <vcpu>1</vcpu>
Nov 14 10:01:42 user nova-compute[75229]:   <metadata>
Nov 14 10:01:42 user nova-compute[75229]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 10:01:42 user nova-compute[75229]:       <nova:package version="0.0.0"/>
Nov 14 10:01:42 user nova-compute[75229]:       <nova:name>tempest-TestServerVolumeAttachScenarioOldVersion-server-1346504140</nova:name>
Nov 14 10:01:42 user nova-compute[75229]:       <nova:creationTime>2023-11-14 10:01:42</nova:creationTime>
Nov 14 10:01:42 user nova-compute[75229]:       <nova:flavor name="m1.tiny">
Nov 14 10:01:42 user nova-compute[75229]:         <nova:memory>512</nova:memory>
Nov 14 10:01:42 user nova-compute[75229]:         <nova:disk>1</nova:disk>
Nov 14 10:01:42 user nova-compute[75229]:         <nova:swap>0</nova:swap>
Nov 14 10:01:42 user nova-compute[75229]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 10:01:42 user nova-compute[75229]:         <nova:vcpus>1</nova:vcpus>
Nov 14 10:01:42 user nova-compute[75229]:       </nova:flavor>
Nov 14 10:01:42 user nova-compute[75229]:       <nova:owner>
Nov 14 10:01:42 user nova-compute[75229]:         <nova:user uuid="afa8393617b14f119a096f14703b2b08">tempest-TestServerVolumeAttachScenarioOldVersion-2038862331-project-member</nova:user>
Nov 14 10:01:42 user nova-compute[75229]:         <nova:project uuid="806563ad6acd48dfae9a5d6bba121eae">tempest-TestServerVolumeAttachScenarioOldVersion-2038862331</nova:project>
Nov 14 10:01:42 user nova-compute[75229]:       </nova:owner>
Nov 14 10:01:42 user nova-compute[75229]:       <nova:root type="image" uuid="3bef8470-ecc7-40e3-95d4-9254348ea72d"/>
Nov 14 10:01:42 user nova-compute[75229]:       <nova:ports>
Nov 14 10:01:42 user nova-compute[75229]:         <nova:port uuid="66f829f3-daca-440d-9674-c0a116921e54">
Nov 14 10:01:42 user nova-compute[75229]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 14 10:01:42 user nova-compute[75229]:         </nova:port>
Nov 14 10:01:42 user nova-compute[75229]:       </nova:ports>
Nov 14 10:01:42 user nova-compute[75229]:     </nova:instance>
Nov 14 10:01:42 user nova-compute[75229]:   </metadata>
Nov 14 10:01:42 user nova-compute[75229]:   <sysinfo type="smbios">
Nov 14 10:01:42 user nova-compute[75229]:     <system>
Nov 14 10:01:42 user nova-compute[75229]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 10:01:42 user nova-compute[75229]:       <entry name="product">OpenStack Nova</entry>
Nov 14 10:01:42 user nova-compute[75229]:       <entry name="version">0.0.0</entry>
Nov 14 10:01:42 user nova-compute[75229]:       <entry name="serial">7469b999-196b-41c7-9d30-f810b74eaa99</entry>
Nov 14 10:01:42 user nova-compute[75229]:       <entry name="uuid">7469b999-196b-41c7-9d30-f810b74eaa99</entry>
Nov 14 10:01:42 user nova-compute[75229]:       <entry name="family">Virtual Machine</entry>
Nov 14 10:01:42 user nova-compute[75229]:     </system>
Nov 14 10:01:42 user nova-compute[75229]:   </sysinfo>
Nov 14 10:01:42 user nova-compute[75229]:   <os>
Nov 14 10:01:42 user nova-compute[75229]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 10:01:42 user nova-compute[75229]:     <boot dev="hd"/>
Nov 14 10:01:42 user nova-compute[75229]:     <smbios mode="sysinfo"/>
Nov 14 10:01:42 user nova-compute[75229]:   </os>
Nov 14 10:01:42 user nova-compute[75229]:   <features>
Nov 14 10:01:42 user nova-compute[75229]:     <acpi/>
Nov 14 10:01:42 user nova-compute[75229]:     <apic/>
Nov 14 10:01:42 user nova-compute[75229]:     <vmcoreinfo/>
Nov 14 10:01:42 user nova-compute[75229]:   </features>
Nov 14 10:01:42 user nova-compute[75229]:   <clock offset="utc">
Nov 14 10:01:42 user nova-compute[75229]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 10:01:42 user nova-compute[75229]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 10:01:42 user nova-compute[75229]:     <timer name="hpet" present="no"/>
Nov 14 10:01:42 user nova-compute[75229]:   </clock>
Nov 14 10:01:42 user nova-compute[75229]:   <cpu mode="custom" match="exact">
Nov 14 10:01:42 user nova-compute[75229]:     <model>Nehalem</model>
Nov 14 10:01:42 user nova-compute[75229]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 10:01:42 user nova-compute[75229]:   </cpu>
Nov 14 10:01:42 user nova-compute[75229]:   <devices>
Nov 14 10:01:42 user nova-compute[75229]:     <disk type="file" device="disk">
Nov 14 10:01:42 user nova-compute[75229]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 10:01:42 user nova-compute[75229]:       <source file="/opt/stack/data/nova/instances/7469b999-196b-41c7-9d30-f810b74eaa99/disk"/>
Nov 14 10:01:42 user nova-compute[75229]:       <target dev="vda" bus="virtio"/>
Nov 14 10:01:42 user nova-compute[75229]:     </disk>
Nov 14 10:01:42 user nova-compute[75229]:     <interface type="ethernet">
Nov 14 10:01:42 user nova-compute[75229]:       <mac address="fa:16:3e:49:6b:8f"/>
Nov 14 10:01:42 user nova-compute[75229]:       <model type="virtio"/>
Nov 14 10:01:42 user nova-compute[75229]:       <mtu size="1442"/>
Nov 14 10:01:42 user nova-compute[75229]:       <target dev="tap66f829f3-da"/>
Nov 14 10:01:42 user nova-compute[75229]:     </interface>
Nov 14 10:01:42 user nova-compute[75229]:     <serial type="pty">
Nov 14 10:01:42 user nova-compute[75229]:       <log file="/opt/stack/data/nova/instances/7469b999-196b-41c7-9d30-f810b74eaa99/console.log" append="off"/>
Nov 14 10:01:42 user nova-compute[75229]:     </serial>
Nov 14 10:01:42 user nova-compute[75229]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 10:01:42 user nova-compute[75229]:     <video>
Nov 14 10:01:42 user nova-compute[75229]:       <model type="virtio"/>
Nov 14 10:01:42 user nova-compute[75229]:     </video>
Nov 14 10:01:42 user nova-compute[75229]:     <rng model="virtio">
Nov 14 10:01:42 user nova-compute[75229]:       <backend model="random">/dev/urandom</backend>
Nov 14 10:01:42 user nova-compute[75229]:     </rng>
Nov 14 10:01:42 user nova-compute[75229]:     <controller type="usb" index="0" model="none"/>
Nov 14 10:01:42 user nova-compute[75229]:     <memballoon model="virtio">
Nov 14 10:01:42 user nova-compute[75229]:       <stats period="10"/>
Nov 14 10:01:42 user nova-compute[75229]:     </memballoon>
Nov 14 10:01:42 user nova-compute[75229]:   </devices>
Nov 14 10:01:42 user nova-compute[75229]: </domain>
Nov 14 10:01:42 user nova-compute[75229]:  {{(pid=75229) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 10:01:42 user nova-compute[75229]: DEBUG nova.virt.libvirt.vif [None req-b5f3d0ea-ffde-48ef-9888-ddd916d07fee tempest-TestServerVolumeAttachScenarioOldVersion-2038862331 tempest-TestServerVolumeAttachScenarioOldVersion-2038862331-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T10:01:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1346504140',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1346504140',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1346504',id=40,image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLaTpU6/5A3kp8dqKIJiFl9IeD1ipYyI8RZ1VwVl/+hfHrAsAXzAMBpo+byEk9ZZxg5j/4JopWyxZA6Di/CFxCKPA9qX3NS80VdWP/bSd0AhLUc+38pLtWPCT0AA1fEU0Q==',key_name='tempest-keypair-113203845',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='806563ad6acd48dfae9a5d6bba121eae',ramdisk_id='',reservation_id='r-c80v5jhy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-2038862331',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-2038862331-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T10:01:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='afa8393617b14f119a096f14703b2b08',uuid=7469b999-196b-41c7-9d30-f810b74eaa99,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "66f829f3-daca-440d-9674-c0a116921e54", "address": "fa:16:3e:49:6b:8f", "network": {"id": "a8102981-d4c0-4a9f-a380-1bd0c4b230af", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1874599352-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "806563ad6acd48dfae9a5d6bba121eae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66f829f3-da", "ovs_interfaceid": "66f829f3-daca-440d-9674-c0a116921e54", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 10:01:42 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-b5f3d0ea-ffde-48ef-9888-ddd916d07fee tempest-TestServerVolumeAttachScenarioOldVersion-2038862331 tempest-TestServerVolumeAttachScenarioOldVersion-2038862331-project-member] Converting VIF {"id": "66f829f3-daca-440d-9674-c0a116921e54", "address": "fa:16:3e:49:6b:8f", "network": {"id": "a8102981-d4c0-4a9f-a380-1bd0c4b230af", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1874599352-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "806563ad6acd48dfae9a5d6bba121eae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66f829f3-da", "ovs_interfaceid": "66f829f3-daca-440d-9674-c0a116921e54", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 10:01:42 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-b5f3d0ea-ffde-48ef-9888-ddd916d07fee tempest-TestServerVolumeAttachScenarioOldVersion-2038862331 tempest-TestServerVolumeAttachScenarioOldVersion-2038862331-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:49:6b:8f,bridge_name='br-int',has_traffic_filtering=True,id=66f829f3-daca-440d-9674-c0a116921e54,network=Network(a8102981-d4c0-4a9f-a380-1bd0c4b230af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap66f829f3-da') {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 10:01:42 user nova-compute[75229]: DEBUG os_vif [None req-b5f3d0ea-ffde-48ef-9888-ddd916d07fee tempest-TestServerVolumeAttachScenarioOldVersion-2038862331 tempest-TestServerVolumeAttachScenarioOldVersion-2038862331-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:49:6b:8f,bridge_name='br-int',has_traffic_filtering=True,id=66f829f3-daca-440d-9674-c0a116921e54,network=Network(a8102981-d4c0-4a9f-a380-1bd0c4b230af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap66f829f3-da') {{(pid=75229) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 10:01:42 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:01:42 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 10:01:42 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 10:01:42 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:01:42 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'bcbe1b4a-cdfc-5caf-87fc-5d9fb0714dfd', '_type': 'linux-noop'}}, row=False) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 10:01:42 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:01:42 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 10:01:42 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:01:42 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap66f829f3-da, may_exist=True, interface_attrs={}) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 10:01:42 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap66f829f3-da, col_values=(('qos', UUID('752499ee-cb9c-48d7-96f4-907471087f27')),), if_exists=True) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 10:01:42 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap66f829f3-da, col_values=(('external_ids', {'iface-id': '66f829f3-daca-440d-9674-c0a116921e54', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:49:6b:8f', 'vm-uuid': '7469b999-196b-41c7-9d30-f810b74eaa99'}),), if_exists=True) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 10:01:42 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:01:42 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 10:01:42 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:01:42 user nova-compute[75229]: INFO os_vif [None req-b5f3d0ea-ffde-48ef-9888-ddd916d07fee tempest-TestServerVolumeAttachScenarioOldVersion-2038862331 tempest-TestServerVolumeAttachScenarioOldVersion-2038862331-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:49:6b:8f,bridge_name='br-int',has_traffic_filtering=True,id=66f829f3-daca-440d-9674-c0a116921e54,network=Network(a8102981-d4c0-4a9f-a380-1bd0c4b230af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap66f829f3-da')
Nov 14 10:01:43 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-b5f3d0ea-ffde-48ef-9888-ddd916d07fee tempest-TestServerVolumeAttachScenarioOldVersion-2038862331 tempest-TestServerVolumeAttachScenarioOldVersion-2038862331-project-member] No BDM found with device name vda, not building metadata. {{(pid=75229) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 10:01:43 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-b5f3d0ea-ffde-48ef-9888-ddd916d07fee tempest-TestServerVolumeAttachScenarioOldVersion-2038862331 tempest-TestServerVolumeAttachScenarioOldVersion-2038862331-project-member] No VIF found with MAC fa:16:3e:49:6b:8f, not building metadata {{(pid=75229) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 10:01:43 user nova-compute[75229]: DEBUG nova.network.neutron [req-50ca41a4-8c9f-4907-9ab3-834a71bbcc21 req-40ad0b61-1288-49f2-933d-a4052b0d4e62 service nova] [instance: 7469b999-196b-41c7-9d30-f810b74eaa99] Updated VIF entry in instance network info cache for port 66f829f3-daca-440d-9674-c0a116921e54. {{(pid=75229) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 10:01:43 user nova-compute[75229]: DEBUG nova.network.neutron [req-50ca41a4-8c9f-4907-9ab3-834a71bbcc21 req-40ad0b61-1288-49f2-933d-a4052b0d4e62 service nova] [instance: 7469b999-196b-41c7-9d30-f810b74eaa99] Updating instance_info_cache with network_info: [{"id": "66f829f3-daca-440d-9674-c0a116921e54", "address": "fa:16:3e:49:6b:8f", "network": {"id": "a8102981-d4c0-4a9f-a380-1bd0c4b230af", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1874599352-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "806563ad6acd48dfae9a5d6bba121eae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66f829f3-da", "ovs_interfaceid": "66f829f3-daca-440d-9674-c0a116921e54", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 10:01:43 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-50ca41a4-8c9f-4907-9ab3-834a71bbcc21 req-40ad0b61-1288-49f2-933d-a4052b0d4e62 service nova] Releasing lock "refresh_cache-7469b999-196b-41c7-9d30-f810b74eaa99" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 10:01:43 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:01:44 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:01:44 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:01:44 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:01:44 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:01:44 user nova-compute[75229]: DEBUG nova.compute.manager [req-fec0eb60-7646-4b50-890b-4719286f1667 req-1491d69b-7aa1-4866-8f87-9876cb322bb1 service nova] [instance: 7469b999-196b-41c7-9d30-f810b74eaa99] Received event network-vif-plugged-66f829f3-daca-440d-9674-c0a116921e54 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 10:01:44 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-fec0eb60-7646-4b50-890b-4719286f1667 req-1491d69b-7aa1-4866-8f87-9876cb322bb1 service nova] Acquiring lock "7469b999-196b-41c7-9d30-f810b74eaa99-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:01:44 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-fec0eb60-7646-4b50-890b-4719286f1667 req-1491d69b-7aa1-4866-8f87-9876cb322bb1 service nova] Lock "7469b999-196b-41c7-9d30-f810b74eaa99-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:01:44 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-fec0eb60-7646-4b50-890b-4719286f1667 req-1491d69b-7aa1-4866-8f87-9876cb322bb1 service nova] Lock "7469b999-196b-41c7-9d30-f810b74eaa99-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:01:44 user nova-compute[75229]: DEBUG nova.compute.manager [req-fec0eb60-7646-4b50-890b-4719286f1667 req-1491d69b-7aa1-4866-8f87-9876cb322bb1 service nova] [instance: 7469b999-196b-41c7-9d30-f810b74eaa99] No waiting events found dispatching network-vif-plugged-66f829f3-daca-440d-9674-c0a116921e54 {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 10:01:44 user nova-compute[75229]: WARNING nova.compute.manager [req-fec0eb60-7646-4b50-890b-4719286f1667 req-1491d69b-7aa1-4866-8f87-9876cb322bb1 service nova] [instance: 7469b999-196b-41c7-9d30-f810b74eaa99] Received unexpected event network-vif-plugged-66f829f3-daca-440d-9674-c0a116921e54 for instance with vm_state building and task_state spawning.
Nov 14 10:01:44 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:01:44 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:01:46 user nova-compute[75229]: DEBUG nova.compute.manager [None req-b5f3d0ea-ffde-48ef-9888-ddd916d07fee tempest-TestServerVolumeAttachScenarioOldVersion-2038862331 tempest-TestServerVolumeAttachScenarioOldVersion-2038862331-project-member] [instance: 7469b999-196b-41c7-9d30-f810b74eaa99] Instance event wait completed in 0 seconds for  {{(pid=75229) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 10:01:46 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-b5f3d0ea-ffde-48ef-9888-ddd916d07fee tempest-TestServerVolumeAttachScenarioOldVersion-2038862331 tempest-TestServerVolumeAttachScenarioOldVersion-2038862331-project-member] [instance: 7469b999-196b-41c7-9d30-f810b74eaa99] Guest created on hypervisor {{(pid=75229) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 10:01:46 user nova-compute[75229]: INFO nova.virt.libvirt.driver [-] [instance: 7469b999-196b-41c7-9d30-f810b74eaa99] Instance spawned successfully.
Nov 14 10:01:46 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-b5f3d0ea-ffde-48ef-9888-ddd916d07fee tempest-TestServerVolumeAttachScenarioOldVersion-2038862331 tempest-TestServerVolumeAttachScenarioOldVersion-2038862331-project-member] [instance: 7469b999-196b-41c7-9d30-f810b74eaa99] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 10:01:46 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-b5f3d0ea-ffde-48ef-9888-ddd916d07fee tempest-TestServerVolumeAttachScenarioOldVersion-2038862331 tempest-TestServerVolumeAttachScenarioOldVersion-2038862331-project-member] [instance: 7469b999-196b-41c7-9d30-f810b74eaa99] Found default for hw_cdrom_bus of ide {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 10:01:46 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-b5f3d0ea-ffde-48ef-9888-ddd916d07fee tempest-TestServerVolumeAttachScenarioOldVersion-2038862331 tempest-TestServerVolumeAttachScenarioOldVersion-2038862331-project-member] [instance: 7469b999-196b-41c7-9d30-f810b74eaa99] Found default for hw_disk_bus of virtio {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 10:01:46 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-b5f3d0ea-ffde-48ef-9888-ddd916d07fee tempest-TestServerVolumeAttachScenarioOldVersion-2038862331 tempest-TestServerVolumeAttachScenarioOldVersion-2038862331-project-member] [instance: 7469b999-196b-41c7-9d30-f810b74eaa99] Found default for hw_input_bus of None {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 10:01:46 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-b5f3d0ea-ffde-48ef-9888-ddd916d07fee tempest-TestServerVolumeAttachScenarioOldVersion-2038862331 tempest-TestServerVolumeAttachScenarioOldVersion-2038862331-project-member] [instance: 7469b999-196b-41c7-9d30-f810b74eaa99] Found default for hw_pointer_model of None {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 10:01:46 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-b5f3d0ea-ffde-48ef-9888-ddd916d07fee tempest-TestServerVolumeAttachScenarioOldVersion-2038862331 tempest-TestServerVolumeAttachScenarioOldVersion-2038862331-project-member] [instance: 7469b999-196b-41c7-9d30-f810b74eaa99] Found default for hw_video_model of virtio {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 10:01:46 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-b5f3d0ea-ffde-48ef-9888-ddd916d07fee tempest-TestServerVolumeAttachScenarioOldVersion-2038862331 tempest-TestServerVolumeAttachScenarioOldVersion-2038862331-project-member] [instance: 7469b999-196b-41c7-9d30-f810b74eaa99] Found default for hw_vif_model of virtio {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 10:01:46 user nova-compute[75229]: DEBUG nova.compute.manager [req-f138d84d-f707-4b8b-b7c3-f8a03a285909 req-8629a66c-dd7e-4721-9886-5756295b8b7e service nova] [instance: 7469b999-196b-41c7-9d30-f810b74eaa99] Received event network-vif-plugged-66f829f3-daca-440d-9674-c0a116921e54 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 10:01:46 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-f138d84d-f707-4b8b-b7c3-f8a03a285909 req-8629a66c-dd7e-4721-9886-5756295b8b7e service nova] Acquiring lock "7469b999-196b-41c7-9d30-f810b74eaa99-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:01:46 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-f138d84d-f707-4b8b-b7c3-f8a03a285909 req-8629a66c-dd7e-4721-9886-5756295b8b7e service nova] Lock "7469b999-196b-41c7-9d30-f810b74eaa99-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:01:46 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-f138d84d-f707-4b8b-b7c3-f8a03a285909 req-8629a66c-dd7e-4721-9886-5756295b8b7e service nova] Lock "7469b999-196b-41c7-9d30-f810b74eaa99-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:01:46 user nova-compute[75229]: DEBUG nova.compute.manager [req-f138d84d-f707-4b8b-b7c3-f8a03a285909 req-8629a66c-dd7e-4721-9886-5756295b8b7e service nova] [instance: 7469b999-196b-41c7-9d30-f810b74eaa99] No waiting events found dispatching network-vif-plugged-66f829f3-daca-440d-9674-c0a116921e54 {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 10:01:46 user nova-compute[75229]: WARNING nova.compute.manager [req-f138d84d-f707-4b8b-b7c3-f8a03a285909 req-8629a66c-dd7e-4721-9886-5756295b8b7e service nova] [instance: 7469b999-196b-41c7-9d30-f810b74eaa99] Received unexpected event network-vif-plugged-66f829f3-daca-440d-9674-c0a116921e54 for instance with vm_state building and task_state spawning.
Nov 14 10:01:46 user nova-compute[75229]: INFO nova.compute.manager [None req-b5f3d0ea-ffde-48ef-9888-ddd916d07fee tempest-TestServerVolumeAttachScenarioOldVersion-2038862331 tempest-TestServerVolumeAttachScenarioOldVersion-2038862331-project-member] [instance: 7469b999-196b-41c7-9d30-f810b74eaa99] Took 5.28 seconds to spawn the instance on the hypervisor.
Nov 14 10:01:46 user nova-compute[75229]: DEBUG nova.compute.manager [None req-b5f3d0ea-ffde-48ef-9888-ddd916d07fee tempest-TestServerVolumeAttachScenarioOldVersion-2038862331 tempest-TestServerVolumeAttachScenarioOldVersion-2038862331-project-member] [instance: 7469b999-196b-41c7-9d30-f810b74eaa99] Checking state {{(pid=75229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 10:01:46 user nova-compute[75229]: INFO nova.compute.manager [None req-b5f3d0ea-ffde-48ef-9888-ddd916d07fee tempest-TestServerVolumeAttachScenarioOldVersion-2038862331 tempest-TestServerVolumeAttachScenarioOldVersion-2038862331-project-member] [instance: 7469b999-196b-41c7-9d30-f810b74eaa99] Took 6.09 seconds to build instance.
Nov 14 10:01:46 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-b5f3d0ea-ffde-48ef-9888-ddd916d07fee tempest-TestServerVolumeAttachScenarioOldVersion-2038862331 tempest-TestServerVolumeAttachScenarioOldVersion-2038862331-project-member] Lock "7469b999-196b-41c7-9d30-f810b74eaa99" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.229s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:01:47 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:01:48 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:01:52 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:01:52 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:01:53 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:01:54 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:01:54 user nova-compute[75229]: DEBUG nova.compute.manager [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Starting heal instance info cache {{(pid=75229) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 10:01:54 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Acquiring lock "refresh_cache-589f4750-fac6-4e99-a430-0cda339808bc" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 10:01:54 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Acquired lock "refresh_cache-589f4750-fac6-4e99-a430-0cda339808bc" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 10:01:54 user nova-compute[75229]: DEBUG nova.network.neutron [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] [instance: 589f4750-fac6-4e99-a430-0cda339808bc] Forcefully refreshing network info cache for instance {{(pid=75229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 10:01:55 user nova-compute[75229]: DEBUG nova.network.neutron [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] [instance: 589f4750-fac6-4e99-a430-0cda339808bc] Updating instance_info_cache with network_info: [{"id": "e10815ba-0472-4ed0-af80-b4d0904580af", "address": "fa:16:3e:aa:81:3e", "network": {"id": "5dfc532f-3d5d-4342-b7f1-12c9c3992a54", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1457278473-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.147", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46e65cdd021f4a3db7c9254bb6d98b46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape10815ba-04", "ovs_interfaceid": "e10815ba-0472-4ed0-af80-b4d0904580af", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 10:01:55 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Releasing lock "refresh_cache-589f4750-fac6-4e99-a430-0cda339808bc" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 10:01:55 user nova-compute[75229]: DEBUG nova.compute.manager [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] [instance: 589f4750-fac6-4e99-a430-0cda339808bc] Updated the network info_cache for instance {{(pid=75229) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 10:01:57 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-78f7dda9-4b8d-4c49-86fd-d94c24a10633 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Acquiring lock "589f4750-fac6-4e99-a430-0cda339808bc" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:01:57 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-78f7dda9-4b8d-4c49-86fd-d94c24a10633 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Lock "589f4750-fac6-4e99-a430-0cda339808bc" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:01:57 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-78f7dda9-4b8d-4c49-86fd-d94c24a10633 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Acquiring lock "589f4750-fac6-4e99-a430-0cda339808bc-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:01:57 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-78f7dda9-4b8d-4c49-86fd-d94c24a10633 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Lock "589f4750-fac6-4e99-a430-0cda339808bc-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:01:57 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-78f7dda9-4b8d-4c49-86fd-d94c24a10633 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Lock "589f4750-fac6-4e99-a430-0cda339808bc-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:01:57 user nova-compute[75229]: INFO nova.compute.manager [None req-78f7dda9-4b8d-4c49-86fd-d94c24a10633 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] [instance: 589f4750-fac6-4e99-a430-0cda339808bc] Terminating instance
Nov 14 10:01:57 user nova-compute[75229]: DEBUG nova.compute.manager [None req-78f7dda9-4b8d-4c49-86fd-d94c24a10633 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] [instance: 589f4750-fac6-4e99-a430-0cda339808bc] Start destroying the instance on the hypervisor. {{(pid=75229) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 10:01:57 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:01:57 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:01:57 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:01:57 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:01:57 user nova-compute[75229]: DEBUG nova.compute.manager [req-03506277-87da-469a-b400-8a3bff594ebb req-5f97483c-ca47-421f-85e3-dbaefdf1f7ed service nova] [instance: 589f4750-fac6-4e99-a430-0cda339808bc] Received event network-vif-unplugged-e10815ba-0472-4ed0-af80-b4d0904580af {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 10:01:57 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-03506277-87da-469a-b400-8a3bff594ebb req-5f97483c-ca47-421f-85e3-dbaefdf1f7ed service nova] Acquiring lock "589f4750-fac6-4e99-a430-0cda339808bc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:01:57 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-03506277-87da-469a-b400-8a3bff594ebb req-5f97483c-ca47-421f-85e3-dbaefdf1f7ed service nova] Lock "589f4750-fac6-4e99-a430-0cda339808bc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:01:57 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-03506277-87da-469a-b400-8a3bff594ebb req-5f97483c-ca47-421f-85e3-dbaefdf1f7ed service nova] Lock "589f4750-fac6-4e99-a430-0cda339808bc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:01:57 user nova-compute[75229]: DEBUG nova.compute.manager [req-03506277-87da-469a-b400-8a3bff594ebb req-5f97483c-ca47-421f-85e3-dbaefdf1f7ed service nova] [instance: 589f4750-fac6-4e99-a430-0cda339808bc] No waiting events found dispatching network-vif-unplugged-e10815ba-0472-4ed0-af80-b4d0904580af {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 10:01:57 user nova-compute[75229]: DEBUG nova.compute.manager [req-03506277-87da-469a-b400-8a3bff594ebb req-5f97483c-ca47-421f-85e3-dbaefdf1f7ed service nova] [instance: 589f4750-fac6-4e99-a430-0cda339808bc] Received event network-vif-unplugged-e10815ba-0472-4ed0-af80-b4d0904580af for instance with task_state deleting. {{(pid=75229) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 10:01:57 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:01:58 user nova-compute[75229]: INFO nova.virt.libvirt.driver [-] [instance: 589f4750-fac6-4e99-a430-0cda339808bc] Instance destroyed successfully.
Nov 14 10:01:58 user nova-compute[75229]: DEBUG nova.objects.instance [None req-78f7dda9-4b8d-4c49-86fd-d94c24a10633 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Lazy-loading 'resources' on Instance uuid 589f4750-fac6-4e99-a430-0cda339808bc {{(pid=75229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 10:01:58 user nova-compute[75229]: DEBUG nova.virt.libvirt.vif [None req-78f7dda9-4b8d-4c49-86fd-d94c24a10633 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T09:55:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-724442357',display_name='tempest-ServerActionsTestOtherA-server-724442357',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-724442357',id=32,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGYpQZFb1U6nMdMA0U7Y/y+mR6NDiU0zUt1gWS7fx0RnGUEMiKL0fCtTR70lVN1zodlPi6pkSulrGMUx3iNoziRzj8cN92z29zHcNE44hvJVgwbBcM00kPn071ndMRlk4g==',key_name='tempest-keypair-397181797',keypairs=<?>,launch_index=0,launched_at=2023-11-14T09:57:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='46e65cdd021f4a3db7c9254bb6d98b46',ramdisk_id='',reservation_id='r-lre1lh5y',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-280196295',owner_user_name='tempest-ServerActionsTestOtherA-280196295-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T09:59:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c0c381a0f6124f1ca6ce85c057b9143a',uuid=589f4750-fac6-4e99-a430-0cda339808bc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e10815ba-0472-4ed0-af80-b4d0904580af", "address": "fa:16:3e:aa:81:3e", "network": {"id": "5dfc532f-3d5d-4342-b7f1-12c9c3992a54", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1457278473-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.147", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46e65cdd021f4a3db7c9254bb6d98b46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape10815ba-04", "ovs_interfaceid": "e10815ba-0472-4ed0-af80-b4d0904580af", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 10:01:58 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-78f7dda9-4b8d-4c49-86fd-d94c24a10633 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Converting VIF {"id": "e10815ba-0472-4ed0-af80-b4d0904580af", "address": "fa:16:3e:aa:81:3e", "network": {"id": "5dfc532f-3d5d-4342-b7f1-12c9c3992a54", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1457278473-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.147", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46e65cdd021f4a3db7c9254bb6d98b46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape10815ba-04", "ovs_interfaceid": "e10815ba-0472-4ed0-af80-b4d0904580af", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 10:01:58 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-78f7dda9-4b8d-4c49-86fd-d94c24a10633 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:aa:81:3e,bridge_name='br-int',has_traffic_filtering=True,id=e10815ba-0472-4ed0-af80-b4d0904580af,network=Network(5dfc532f-3d5d-4342-b7f1-12c9c3992a54),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape10815ba-04') {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 10:01:58 user nova-compute[75229]: DEBUG os_vif [None req-78f7dda9-4b8d-4c49-86fd-d94c24a10633 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:aa:81:3e,bridge_name='br-int',has_traffic_filtering=True,id=e10815ba-0472-4ed0-af80-b4d0904580af,network=Network(5dfc532f-3d5d-4342-b7f1-12c9c3992a54),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape10815ba-04') {{(pid=75229) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 10:01:58 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:01:58 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape10815ba-04, bridge=br-int, if_exists=True) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 10:01:58 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:01:58 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:01:58 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:01:58 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6bf23fc0-d087-4473-8d7a-2058d5ef3034) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 10:01:58 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:01:58 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 10:01:58 user nova-compute[75229]: INFO os_vif [None req-78f7dda9-4b8d-4c49-86fd-d94c24a10633 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:aa:81:3e,bridge_name='br-int',has_traffic_filtering=True,id=e10815ba-0472-4ed0-af80-b4d0904580af,network=Network(5dfc532f-3d5d-4342-b7f1-12c9c3992a54),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape10815ba-04')
Nov 14 10:01:58 user nova-compute[75229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-78f7dda9-4b8d-4c49-86fd-d94c24a10633 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] [instance: 589f4750-fac6-4e99-a430-0cda339808bc] calling os-brick to detach iSCSI Volume {{(pid=75229) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 10:01:58 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-78f7dda9-4b8d-4c49-86fd-d94c24a10633 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f73f85151b0>, {'target_iqn': 'iqn.2010-10.org.openstack:a5efb0e0-a85c-46ec-8a9d-2763bf548023', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MNpaKqUc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 10:01:58 user nova-compute[75229]: WARNING os_brick.initiator.connectors.base [None req-78f7dda9-4b8d-4c49-86fd-d94c24a10633 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 10:01:58 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-78f7dda9-4b8d-4c49-86fd-d94c24a10633 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 10:01:58 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-78f7dda9-4b8d-4c49-86fd-d94c24a10633 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 10:01:58 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:01:58 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:01:58 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[133f3f72-a432-4dd0-b9c1-21577317c26b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a5efb0e0-a85c-46ec-8a9d-2763bf548023\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:143891e8-62eb-42d7-b076-db6f52b4f606\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2977635e-b11f-4ab2-875c-e9f396b932dc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5aebc438-0289-44fe-ad84-4e696468f50e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e4a6dca6-1581-494f-afe5-3aac2b4d2c15\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:01:58 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-78f7dda9-4b8d-4c49-86fd-d94c24a10633 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 10:01:58 user nova-compute[75229]: No targets found.
Nov 14 10:01:58 user nova-compute[75229]: iSNS:
Nov 14 10:01:58 user nova-compute[75229]: No targets found.
Nov 14 10:01:58 user nova-compute[75229]: STATIC:
Nov 14 10:01:58 user nova-compute[75229]: Target: iqn.2010-10.org.openstack:a5efb0e0-a85c-46ec-8a9d-2763bf548023
Nov 14 10:01:58 user nova-compute[75229]:         Portal: 172.16.0.220:3260,-1
Nov 14 10:01:58 user nova-compute[75229]:                 Iface Name: default
Nov 14 10:01:58 user nova-compute[75229]: Target: iqn.2010-10.org.openstack:143891e8-62eb-42d7-b076-db6f52b4f606
Nov 14 10:01:58 user nova-compute[75229]:         Portal: 172.16.0.220:3260,-1
Nov 14 10:01:58 user nova-compute[75229]:                 Iface Name: default
Nov 14 10:01:58 user nova-compute[75229]: Target: iqn.2010-10.org.openstack:2977635e-b11f-4ab2-875c-e9f396b932dc
Nov 14 10:01:58 user nova-compute[75229]:         Portal: 172.16.0.220:3260,-1
Nov 14 10:01:58 user nova-compute[75229]:                 Iface Name: default
Nov 14 10:01:58 user nova-compute[75229]: Target: iqn.2010-10.org.openstack:5aebc438-0289-44fe-ad84-4e696468f50e
Nov 14 10:01:58 user nova-compute[75229]:         Portal: 172.16.0.220:3260,-1
Nov 14 10:01:58 user nova-compute[75229]:                 Iface Name: default
Nov 14 10:01:58 user nova-compute[75229]: Target: iqn.2010-10.org.openstack:e4a6dca6-1581-494f-afe5-3aac2b4d2c15
Nov 14 10:01:58 user nova-compute[75229]:         Portal: 172.16.0.220:3260,-1
Nov 14 10:01:58 user nova-compute[75229]:                 Iface Name: default
Nov 14 10:01:58 user nova-compute[75229]: FIRMWARE:
Nov 14 10:01:58 user nova-compute[75229]: No targets found.
Nov 14 10:01:58 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 10:01:58 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-78f7dda9-4b8d-4c49-86fd-d94c24a10633 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 10:01:58 user nova-compute[75229]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 10:01:58 user nova-compute[75229]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75229) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 10:01:58 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-78f7dda9-4b8d-4c49-86fd-d94c24a10633 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a5efb0e0-a85c-46ec-8a9d-2763bf548023', 0)] {{(pid=75229) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 10:01:58 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:01:58 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:01:58 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfa8f7bf-6f0e-4687-8aff-56e83dee8229]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:143891e8-62eb-42d7-b076-db6f52b4f606\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2977635e-b11f-4ab2-875c-e9f396b932dc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5aebc438-0289-44fe-ad84-4e696468f50e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a5efb0e0-a85c-46ec-8a9d-2763bf548023\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e4a6dca6-1581-494f-afe5-3aac2b4d2c15\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:01:58 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:01:58 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:01:58 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ab2de5e-6f12-440e-aab9-85ecb2159f3c]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aebc438-0289-44fe-ad84-4e696468f50e (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5efb0e0-a85c-46ec-8a9d-2763bf548023 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:143891e8-62eb-42d7-b076-db6f52b4f606 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2977635e-b11f-4ab2-875c-e9f396b932dc (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4a6dca6-1581-494f-afe5-3aac2b4d2c15 (non-flash)\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:01:58 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-78f7dda9-4b8d-4c49-86fd-d94c24a10633 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aebc438-0289-44fe-ad84-4e696468f50e (non-flash)
Nov 14 10:01:58 user nova-compute[75229]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5efb0e0-a85c-46ec-8a9d-2763bf548023 (non-flash)
Nov 14 10:01:58 user nova-compute[75229]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:143891e8-62eb-42d7-b076-db6f52b4f606 (non-flash)
Nov 14 10:01:58 user nova-compute[75229]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2977635e-b11f-4ab2-875c-e9f396b932dc (non-flash)
Nov 14 10:01:58 user nova-compute[75229]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4a6dca6-1581-494f-afe5-3aac2b4d2c15 (non-flash)
Nov 14 10:01:58 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 10:01:58 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-78f7dda9-4b8d-4c49-86fd-d94c24a10633 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aebc438-0289-44fe-ad84-4e696468f50e (non-flash)
Nov 14 10:01:58 user nova-compute[75229]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5efb0e0-a85c-46ec-8a9d-2763bf548023 (non-flash)
Nov 14 10:01:58 user nova-compute[75229]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:143891e8-62eb-42d7-b076-db6f52b4f606 (non-flash)
Nov 14 10:01:58 user nova-compute[75229]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2977635e-b11f-4ab2-875c-e9f396b932dc (non-flash)
Nov 14 10:01:58 user nova-compute[75229]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4a6dca6-1581-494f-afe5-3aac2b4d2c15 (non-flash)
Nov 14 10:01:58 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 10:01:58 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-78f7dda9-4b8d-4c49-86fd-d94c24a10633 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7428bee440>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a5efb0e0-a85c-46ec-8a9d-2763bf548023'): ({'sdb'}, set())}) {{(pid=75229) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 10:01:58 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-78f7dda9-4b8d-4c49-86fd-d94c24a10633 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Removing single pathed devices sdb {{(pid=75229) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 10:01:58 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:01:58 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:01:58 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[3016792c-04f2-4eaa-914c-fca745cac31e]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:01:58 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:01:58 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.032s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:01:58 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[a55b336f-4a3f-419c-9ed2-137accb2b023]: (4, ('ok\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:01:58 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-78f7dda9-4b8d-4c49-86fd-d94c24a10633 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Flushing IO for device /dev/sdb {{(pid=75229) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 10:01:58 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:01:58 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:01:58 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[a496f69c-0782-4595-84cd-f68ad0123ff4]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:01:58 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-78f7dda9-4b8d-4c49-86fd-d94c24a10633 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75229) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 10:01:58 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:01:58 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.034s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:01:58 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[de3779ae-e325-4c55-b7f4-6d3feabe9bd0]: (4, ('1', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:01:58 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-78f7dda9-4b8d-4c49-86fd-d94c24a10633 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75229) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 10:01:58 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-78f7dda9-4b8d-4c49-86fd-d94c24a10633 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] SCSI volumes sdb have been removed. {{(pid=75229) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 10:01:58 user nova-compute[75229]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-26265396161366132', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_58e469e', '/dev/disk/by-id/scsi-1SCST_BIO58e469e-be9aa6a22a116ef1') {{(pid=86458) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 14 10:01:58 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[041e3aec-c507-4b70-b88c-06431cb05672]: (4, None) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:01:58 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-78f7dda9-4b8d-4c49-86fd-d94c24a10633 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a5efb0e0-a85c-46ec-8a9d-2763bf548023')] {{(pid=75229) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 10:01:58 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5efb0e0-a85c-46ec-8a9d-2763bf548023 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:01:58 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5efb0e0-a85c-46ec-8a9d-2763bf548023 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:01:58 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[c99a5adf-4e70-4898-87ce-46932ba443bc]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:01:58 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-78f7dda9-4b8d-4c49-86fd-d94c24a10633 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 10:01:58 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5efb0e0-a85c-46ec-8a9d-2763bf548023 -p 172.16.0.220:3260 --logout {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:01:58 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5efb0e0-a85c-46ec-8a9d-2763bf548023 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:01:58 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab422303-8609-401d-a0c6-35d9886a3e35]: (4, ('Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:a5efb0e0-a85c-46ec-8a9d-2763bf548023, portal: 172.16.0.220,3260]\nLogout of [sid: 35, target: iqn.2010-10.org.openstack:a5efb0e0-a85c-46ec-8a9d-2763bf548023, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:01:58 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-78f7dda9-4b8d-4c49-86fd-d94c24a10633 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:a5efb0e0-a85c-46ec-8a9d-2763bf548023, portal: 172.16.0.220,3260]
Nov 14 10:01:58 user nova-compute[75229]: Logout of [sid: 35, target: iqn.2010-10.org.openstack:a5efb0e0-a85c-46ec-8a9d-2763bf548023, portal: 172.16.0.220,3260] successful.
Nov 14 10:01:58 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 10:01:58 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5efb0e0-a85c-46ec-8a9d-2763bf548023 -p 172.16.0.220:3260 --op delete {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:01:58 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5efb0e0-a85c-46ec-8a9d-2763bf548023 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:01:58 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[2711800c-8198-45ca-8948-a5c0338143ad]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:01:58 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-78f7dda9-4b8d-4c49-86fd-d94c24a10633 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 10:01:58 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-78f7dda9-4b8d-4c49-86fd-d94c24a10633 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.321s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 10:01:58 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-78f7dda9-4b8d-4c49-86fd-d94c24a10633 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] <== disconnect_volume: return (325ms) None {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 10:01:58 user nova-compute[75229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-78f7dda9-4b8d-4c49-86fd-d94c24a10633 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] [instance: 589f4750-fac6-4e99-a430-0cda339808bc] Disconnected iSCSI Volume {{(pid=75229) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 10:01:58 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-78f7dda9-4b8d-4c49-86fd-d94c24a10633 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] [instance: 589f4750-fac6-4e99-a430-0cda339808bc] Deleting instance files /opt/stack/data/nova/instances/589f4750-fac6-4e99-a430-0cda339808bc_del
Nov 14 10:01:58 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-78f7dda9-4b8d-4c49-86fd-d94c24a10633 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] [instance: 589f4750-fac6-4e99-a430-0cda339808bc] Deletion of /opt/stack/data/nova/instances/589f4750-fac6-4e99-a430-0cda339808bc_del complete
Nov 14 10:01:58 user nova-compute[75229]: INFO nova.compute.manager [None req-78f7dda9-4b8d-4c49-86fd-d94c24a10633 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] [instance: 589f4750-fac6-4e99-a430-0cda339808bc] Took 1.18 seconds to destroy the instance on the hypervisor.
Nov 14 10:01:58 user nova-compute[75229]: DEBUG oslo.service.loopingcall [None req-78f7dda9-4b8d-4c49-86fd-d94c24a10633 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75229) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 10:01:58 user nova-compute[75229]: DEBUG nova.compute.manager [-] [instance: 589f4750-fac6-4e99-a430-0cda339808bc] Deallocating network for instance {{(pid=75229) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 10:01:58 user nova-compute[75229]: DEBUG nova.network.neutron [-] [instance: 589f4750-fac6-4e99-a430-0cda339808bc] deallocate_for_instance() {{(pid=75229) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 10:01:58 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:01:58 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:01:59 user nova-compute[75229]: DEBUG nova.network.neutron [-] [instance: 589f4750-fac6-4e99-a430-0cda339808bc] Updating instance_info_cache with network_info: [] {{(pid=75229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 10:01:59 user nova-compute[75229]: INFO nova.compute.manager [-] [instance: 589f4750-fac6-4e99-a430-0cda339808bc] Took 0.75 seconds to deallocate network for instance.
Nov 14 10:01:59 user nova-compute[75229]: DEBUG nova.compute.manager [req-ad2e4fd7-b771-4d32-9029-68d9f6ab18c5 req-1a8a0c8c-8ec9-4fcf-a6b1-f59d70666ed4 service nova] [instance: 589f4750-fac6-4e99-a430-0cda339808bc] Received event network-vif-deleted-e10815ba-0472-4ed0-af80-b4d0904580af {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 10:01:59 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:01:59 user nova-compute[75229]: DEBUG nova.compute.manager [req-892e7369-e0af-498b-8401-b034f90f4eb9 req-1faaf5d2-46ba-464e-817d-8d69faa41d0e service nova] [instance: 589f4750-fac6-4e99-a430-0cda339808bc] Received event network-vif-plugged-e10815ba-0472-4ed0-af80-b4d0904580af {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 10:01:59 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-892e7369-e0af-498b-8401-b034f90f4eb9 req-1faaf5d2-46ba-464e-817d-8d69faa41d0e service nova] Acquiring lock "589f4750-fac6-4e99-a430-0cda339808bc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:01:59 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-892e7369-e0af-498b-8401-b034f90f4eb9 req-1faaf5d2-46ba-464e-817d-8d69faa41d0e service nova] Lock "589f4750-fac6-4e99-a430-0cda339808bc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:01:59 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-892e7369-e0af-498b-8401-b034f90f4eb9 req-1faaf5d2-46ba-464e-817d-8d69faa41d0e service nova] Lock "589f4750-fac6-4e99-a430-0cda339808bc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:01:59 user nova-compute[75229]: DEBUG nova.compute.manager [req-892e7369-e0af-498b-8401-b034f90f4eb9 req-1faaf5d2-46ba-464e-817d-8d69faa41d0e service nova] [instance: 589f4750-fac6-4e99-a430-0cda339808bc] No waiting events found dispatching network-vif-plugged-e10815ba-0472-4ed0-af80-b4d0904580af {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 10:01:59 user nova-compute[75229]: WARNING nova.compute.manager [req-892e7369-e0af-498b-8401-b034f90f4eb9 req-1faaf5d2-46ba-464e-817d-8d69faa41d0e service nova] [instance: 589f4750-fac6-4e99-a430-0cda339808bc] Received unexpected event network-vif-plugged-e10815ba-0472-4ed0-af80-b4d0904580af for instance with vm_state active and task_state deleting.
Nov 14 10:02:00 user nova-compute[75229]: INFO nova.compute.manager [None req-78f7dda9-4b8d-4c49-86fd-d94c24a10633 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] [instance: 589f4750-fac6-4e99-a430-0cda339808bc] Took 0.78 seconds to detach 1 volumes for instance.
Nov 14 10:02:00 user nova-compute[75229]: DEBUG nova.compute.manager [None req-78f7dda9-4b8d-4c49-86fd-d94c24a10633 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] [instance: 589f4750-fac6-4e99-a430-0cda339808bc] Deleting volume: a5efb0e0-a85c-46ec-8a9d-2763bf548023 {{(pid=75229) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 14 10:02:00 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-78f7dda9-4b8d-4c49-86fd-d94c24a10633 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:02:00 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-78f7dda9-4b8d-4c49-86fd-d94c24a10633 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:02:00 user nova-compute[75229]: DEBUG nova.compute.provider_tree [None req-78f7dda9-4b8d-4c49-86fd-d94c24a10633 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Inventory has not changed in ProviderTree for provider: d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 {{(pid=75229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 10:02:00 user nova-compute[75229]: DEBUG nova.scheduler.client.report [None req-78f7dda9-4b8d-4c49-86fd-d94c24a10633 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Inventory has not changed for provider d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 10:02:00 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-78f7dda9-4b8d-4c49-86fd-d94c24a10633 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.304s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:02:00 user nova-compute[75229]: INFO nova.scheduler.client.report [None req-78f7dda9-4b8d-4c49-86fd-d94c24a10633 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Deleted allocations for instance 589f4750-fac6-4e99-a430-0cda339808bc
Nov 14 10:02:00 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-78f7dda9-4b8d-4c49-86fd-d94c24a10633 tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Lock "589f4750-fac6-4e99-a430-0cda339808bc" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.259s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:02:00 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:02:00 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:02:00 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:02:00 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:02:00 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Auditing locally available compute resources for user (node: user) {{(pid=75229) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 10:02:00 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75229) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 10:02:00 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cda8c5ad-e70c-4021-bace-d55831c4bc78/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:02:01 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cda8c5ad-e70c-4021-bace-d55831c4bc78/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:02:01 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cda8c5ad-e70c-4021-bace-d55831c4bc78/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:02:01 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cda8c5ad-e70c-4021-bace-d55831c4bc78/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:02:01 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7750cbc-b3d0-44aa-8b88-c291ba007a8a/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:02:01 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7750cbc-b3d0-44aa-8b88-c291ba007a8a/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:02:01 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7750cbc-b3d0-44aa-8b88-c291ba007a8a/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:02:01 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7750cbc-b3d0-44aa-8b88-c291ba007a8a/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:02:01 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75229) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 10:02:01 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c9fe69e-3f9d-4b30-a9e4-efc3e83efa17/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:02:01 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c9fe69e-3f9d-4b30-a9e4-efc3e83efa17/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:02:01 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c9fe69e-3f9d-4b30-a9e4-efc3e83efa17/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:02:02 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c9fe69e-3f9d-4b30-a9e4-efc3e83efa17/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:02:02 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7469b999-196b-41c7-9d30-f810b74eaa99/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:02:02 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7469b999-196b-41c7-9d30-f810b74eaa99/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:02:02 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7469b999-196b-41c7-9d30-f810b74eaa99/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:02:02 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7469b999-196b-41c7-9d30-f810b74eaa99/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:02:02 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75229) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 10:02:02 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abb8e340-164d-4bc2-a503-7e8ea3c9b35b/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:02:02 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abb8e340-164d-4bc2-a503-7e8ea3c9b35b/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:02:02 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abb8e340-164d-4bc2-a503-7e8ea3c9b35b/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:02:02 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abb8e340-164d-4bc2-a503-7e8ea3c9b35b/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:02:02 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=75229) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 10:02:02 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5170e9e-66e3-4df1-9807-4958cac6480e/disk.rescue --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:02:02 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5170e9e-66e3-4df1-9807-4958cac6480e/disk.rescue --force-share --output=json" returned: 0 in 0.170s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:02:02 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5170e9e-66e3-4df1-9807-4958cac6480e/disk.rescue --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:02:03 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5170e9e-66e3-4df1-9807-4958cac6480e/disk.rescue --force-share --output=json" returned: 0 in 0.170s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:02:03 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5170e9e-66e3-4df1-9807-4958cac6480e/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:02:03 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:02:03 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5170e9e-66e3-4df1-9807-4958cac6480e/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:02:03 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5170e9e-66e3-4df1-9807-4958cac6480e/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:02:03 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5170e9e-66e3-4df1-9807-4958cac6480e/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:02:03 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:02:03 user nova-compute[75229]: WARNING nova.virt.libvirt.driver [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 10:02:03 user nova-compute[75229]: WARNING nova.virt.libvirt.driver [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 10:02:03 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Hypervisor/Node resource view: name=user free_ram=7794MB free_disk=25.080013275146484GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75229) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 10:02:03 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:02:03 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:02:04 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Instance a7750cbc-b3d0-44aa-8b88-c291ba007a8a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 10:02:04 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Instance 4c9fe69e-3f9d-4b30-a9e4-efc3e83efa17 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 10:02:04 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Instance b5170e9e-66e3-4df1-9807-4958cac6480e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 10:02:04 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Instance cda8c5ad-e70c-4021-bace-d55831c4bc78 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 10:02:04 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Instance 30ae1f73-e0f3-4e26-987e-a684471a160d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 10:02:04 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Instance abb8e340-164d-4bc2-a503-7e8ea3c9b35b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 10:02:04 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Instance d822d5e4-38d8-4ca7-a682-f2f2144b6005 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 10:02:04 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Instance abe7e145-d3bc-49a1-83be-793488de828b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 10:02:04 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Instance 7469b999-196b-41c7-9d30-f810b74eaa99 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 10:02:04 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=75229) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 10:02:04 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=75229) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 10:02:04 user nova-compute[75229]: DEBUG nova.compute.provider_tree [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Inventory has not changed in ProviderTree for provider: d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 {{(pid=75229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 10:02:04 user nova-compute[75229]: DEBUG nova.scheduler.client.report [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Inventory has not changed for provider d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 10:02:04 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Compute_service record updated for user:user {{(pid=75229) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 10:02:04 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.388s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:02:07 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:02:07 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:02:07 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:02:07 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:02:07 user nova-compute[75229]: DEBUG nova.compute.manager [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75229) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 10:02:08 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:02:08 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:02:13 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:02:13 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:02:15 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:02:18 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:02:18 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:02:21 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:02:21 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-8bfc9687-2a0e-47b1-aa2e-1b2913a1f331 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Acquiring lock "c1679275-ebb1-4f15-80a4-b8fd614fc34b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:02:21 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-8bfc9687-2a0e-47b1-aa2e-1b2913a1f331 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Lock "c1679275-ebb1-4f15-80a4-b8fd614fc34b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:02:21 user nova-compute[75229]: DEBUG nova.compute.manager [None req-8bfc9687-2a0e-47b1-aa2e-1b2913a1f331 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] [instance: c1679275-ebb1-4f15-80a4-b8fd614fc34b] Starting instance... {{(pid=75229) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 10:02:21 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-8bfc9687-2a0e-47b1-aa2e-1b2913a1f331 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:02:21 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-8bfc9687-2a0e-47b1-aa2e-1b2913a1f331 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:02:21 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-8bfc9687-2a0e-47b1-aa2e-1b2913a1f331 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75229) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 10:02:21 user nova-compute[75229]: INFO nova.compute.claims [None req-8bfc9687-2a0e-47b1-aa2e-1b2913a1f331 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] [instance: c1679275-ebb1-4f15-80a4-b8fd614fc34b] Claim successful on node user
Nov 14 10:02:22 user nova-compute[75229]: DEBUG nova.compute.provider_tree [None req-8bfc9687-2a0e-47b1-aa2e-1b2913a1f331 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Inventory has not changed in ProviderTree for provider: d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 {{(pid=75229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 10:02:22 user nova-compute[75229]: DEBUG nova.scheduler.client.report [None req-8bfc9687-2a0e-47b1-aa2e-1b2913a1f331 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Inventory has not changed for provider d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 10:02:22 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-8bfc9687-2a0e-47b1-aa2e-1b2913a1f331 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.402s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:02:22 user nova-compute[75229]: DEBUG nova.compute.manager [None req-8bfc9687-2a0e-47b1-aa2e-1b2913a1f331 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] [instance: c1679275-ebb1-4f15-80a4-b8fd614fc34b] Start building networks asynchronously for instance. {{(pid=75229) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 10:02:22 user nova-compute[75229]: DEBUG nova.compute.manager [None req-8bfc9687-2a0e-47b1-aa2e-1b2913a1f331 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] [instance: c1679275-ebb1-4f15-80a4-b8fd614fc34b] Allocating IP information in the background. {{(pid=75229) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 10:02:22 user nova-compute[75229]: DEBUG nova.network.neutron [None req-8bfc9687-2a0e-47b1-aa2e-1b2913a1f331 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] [instance: c1679275-ebb1-4f15-80a4-b8fd614fc34b] allocate_for_instance() {{(pid=75229) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 10:02:22 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-8bfc9687-2a0e-47b1-aa2e-1b2913a1f331 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] [instance: c1679275-ebb1-4f15-80a4-b8fd614fc34b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 10:02:22 user nova-compute[75229]: DEBUG nova.compute.manager [None req-8bfc9687-2a0e-47b1-aa2e-1b2913a1f331 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] [instance: c1679275-ebb1-4f15-80a4-b8fd614fc34b] Start building block device mappings for instance. {{(pid=75229) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 10:02:22 user nova-compute[75229]: DEBUG nova.policy [None req-8bfc9687-2a0e-47b1-aa2e-1b2913a1f331 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a8825cd49e9349f28576b704c4c4d717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8babb73006da4977a1fe2bdb35e08d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75229) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 10:02:22 user nova-compute[75229]: DEBUG nova.compute.manager [None req-8bfc9687-2a0e-47b1-aa2e-1b2913a1f331 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] [instance: c1679275-ebb1-4f15-80a4-b8fd614fc34b] Start spawning the instance on the hypervisor. {{(pid=75229) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 10:02:22 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-8bfc9687-2a0e-47b1-aa2e-1b2913a1f331 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] [instance: c1679275-ebb1-4f15-80a4-b8fd614fc34b] Creating instance directory {{(pid=75229) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 10:02:22 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-8bfc9687-2a0e-47b1-aa2e-1b2913a1f331 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] [instance: c1679275-ebb1-4f15-80a4-b8fd614fc34b] Creating image(s)
Nov 14 10:02:22 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-8bfc9687-2a0e-47b1-aa2e-1b2913a1f331 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Acquiring lock "/opt/stack/data/nova/instances/c1679275-ebb1-4f15-80a4-b8fd614fc34b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:02:22 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-8bfc9687-2a0e-47b1-aa2e-1b2913a1f331 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Lock "/opt/stack/data/nova/instances/c1679275-ebb1-4f15-80a4-b8fd614fc34b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:02:22 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-8bfc9687-2a0e-47b1-aa2e-1b2913a1f331 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Lock "/opt/stack/data/nova/instances/c1679275-ebb1-4f15-80a4-b8fd614fc34b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.010s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:02:22 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-8bfc9687-2a0e-47b1-aa2e-1b2913a1f331 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6 --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:02:22 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-8bfc9687-2a0e-47b1-aa2e-1b2913a1f331 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6 --force-share --output=json" returned: 0 in 0.206s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:02:22 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-8bfc9687-2a0e-47b1-aa2e-1b2913a1f331 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Acquiring lock "4f30e3fe703d2381679612a57b1fb80a467f60b6" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:02:22 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-8bfc9687-2a0e-47b1-aa2e-1b2913a1f331 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Lock "4f30e3fe703d2381679612a57b1fb80a467f60b6" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:02:22 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-8bfc9687-2a0e-47b1-aa2e-1b2913a1f331 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6 --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:02:22 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-8bfc9687-2a0e-47b1-aa2e-1b2913a1f331 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6 --force-share --output=json" returned: 0 in 0.241s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:02:22 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-8bfc9687-2a0e-47b1-aa2e-1b2913a1f331 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6,backing_fmt=raw /opt/stack/data/nova/instances/c1679275-ebb1-4f15-80a4-b8fd614fc34b/disk 1073741824 {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:02:22 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-8bfc9687-2a0e-47b1-aa2e-1b2913a1f331 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6,backing_fmt=raw /opt/stack/data/nova/instances/c1679275-ebb1-4f15-80a4-b8fd614fc34b/disk 1073741824" returned: 0 in 0.089s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:02:22 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-8bfc9687-2a0e-47b1-aa2e-1b2913a1f331 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Lock "4f30e3fe703d2381679612a57b1fb80a467f60b6" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.338s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:02:22 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-8bfc9687-2a0e-47b1-aa2e-1b2913a1f331 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6 --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:02:23 user nova-compute[75229]: DEBUG nova.network.neutron [None req-8bfc9687-2a0e-47b1-aa2e-1b2913a1f331 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] [instance: c1679275-ebb1-4f15-80a4-b8fd614fc34b] Successfully created port: 2a5dfb7a-fd65-41fc-9997-8c2d25ea44a7 {{(pid=75229) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 10:02:23 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:02:23 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-8bfc9687-2a0e-47b1-aa2e-1b2913a1f331 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6 --force-share --output=json" returned: 0 in 0.247s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:02:23 user nova-compute[75229]: DEBUG nova.virt.disk.api [None req-8bfc9687-2a0e-47b1-aa2e-1b2913a1f331 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c1679275-ebb1-4f15-80a4-b8fd614fc34b/disk. size=1073741824 {{(pid=75229) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 10:02:23 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-8bfc9687-2a0e-47b1-aa2e-1b2913a1f331 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1679275-ebb1-4f15-80a4-b8fd614fc34b/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:02:23 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-8bfc9687-2a0e-47b1-aa2e-1b2913a1f331 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1679275-ebb1-4f15-80a4-b8fd614fc34b/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:02:23 user nova-compute[75229]: DEBUG nova.virt.disk.api [None req-8bfc9687-2a0e-47b1-aa2e-1b2913a1f331 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Cannot resize image /opt/stack/data/nova/instances/c1679275-ebb1-4f15-80a4-b8fd614fc34b/disk to a smaller size. {{(pid=75229) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 10:02:23 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-8bfc9687-2a0e-47b1-aa2e-1b2913a1f331 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] [instance: c1679275-ebb1-4f15-80a4-b8fd614fc34b] Created local disks {{(pid=75229) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 10:02:23 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-8bfc9687-2a0e-47b1-aa2e-1b2913a1f331 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] [instance: c1679275-ebb1-4f15-80a4-b8fd614fc34b] Ensure instance console log exists: /opt/stack/data/nova/instances/c1679275-ebb1-4f15-80a4-b8fd614fc34b/console.log {{(pid=75229) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 10:02:23 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-8bfc9687-2a0e-47b1-aa2e-1b2913a1f331 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:02:23 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-8bfc9687-2a0e-47b1-aa2e-1b2913a1f331 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:02:23 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-8bfc9687-2a0e-47b1-aa2e-1b2913a1f331 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:02:24 user nova-compute[75229]: DEBUG nova.network.neutron [None req-8bfc9687-2a0e-47b1-aa2e-1b2913a1f331 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] [instance: c1679275-ebb1-4f15-80a4-b8fd614fc34b] Successfully updated port: 2a5dfb7a-fd65-41fc-9997-8c2d25ea44a7 {{(pid=75229) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 10:02:24 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-8bfc9687-2a0e-47b1-aa2e-1b2913a1f331 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Acquiring lock "refresh_cache-c1679275-ebb1-4f15-80a4-b8fd614fc34b" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 10:02:24 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-8bfc9687-2a0e-47b1-aa2e-1b2913a1f331 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Acquired lock "refresh_cache-c1679275-ebb1-4f15-80a4-b8fd614fc34b" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 10:02:24 user nova-compute[75229]: DEBUG nova.network.neutron [None req-8bfc9687-2a0e-47b1-aa2e-1b2913a1f331 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] [instance: c1679275-ebb1-4f15-80a4-b8fd614fc34b] Building network info cache for instance {{(pid=75229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 10:02:24 user nova-compute[75229]: DEBUG nova.compute.manager [req-8768deb0-3736-4d13-beb1-dc54998b0b5b req-6ab508da-e1f1-48b5-8ed2-f174364c262b service nova] [instance: c1679275-ebb1-4f15-80a4-b8fd614fc34b] Received event network-changed-2a5dfb7a-fd65-41fc-9997-8c2d25ea44a7 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 10:02:24 user nova-compute[75229]: DEBUG nova.compute.manager [req-8768deb0-3736-4d13-beb1-dc54998b0b5b req-6ab508da-e1f1-48b5-8ed2-f174364c262b service nova] [instance: c1679275-ebb1-4f15-80a4-b8fd614fc34b] Refreshing instance network info cache due to event network-changed-2a5dfb7a-fd65-41fc-9997-8c2d25ea44a7. {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 10:02:24 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-8768deb0-3736-4d13-beb1-dc54998b0b5b req-6ab508da-e1f1-48b5-8ed2-f174364c262b service nova] Acquiring lock "refresh_cache-c1679275-ebb1-4f15-80a4-b8fd614fc34b" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 10:02:24 user nova-compute[75229]: DEBUG nova.network.neutron [None req-8bfc9687-2a0e-47b1-aa2e-1b2913a1f331 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] [instance: c1679275-ebb1-4f15-80a4-b8fd614fc34b] Instance cache missing network info. {{(pid=75229) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 10:02:24 user nova-compute[75229]: DEBUG nova.network.neutron [None req-8bfc9687-2a0e-47b1-aa2e-1b2913a1f331 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] [instance: c1679275-ebb1-4f15-80a4-b8fd614fc34b] Updating instance_info_cache with network_info: [{"id": "2a5dfb7a-fd65-41fc-9997-8c2d25ea44a7", "address": "fa:16:3e:1f:d7:f3", "network": {"id": "6a700b61-4aa6-440b-87e6-a3525a5cb918", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-448680331-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8babb73006da4977a1fe2bdb35e08d8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a5dfb7a-fd", "ovs_interfaceid": "2a5dfb7a-fd65-41fc-9997-8c2d25ea44a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 10:02:24 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-8bfc9687-2a0e-47b1-aa2e-1b2913a1f331 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Releasing lock "refresh_cache-c1679275-ebb1-4f15-80a4-b8fd614fc34b" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 10:02:24 user nova-compute[75229]: DEBUG nova.compute.manager [None req-8bfc9687-2a0e-47b1-aa2e-1b2913a1f331 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] [instance: c1679275-ebb1-4f15-80a4-b8fd614fc34b] Instance network_info: |[{"id": "2a5dfb7a-fd65-41fc-9997-8c2d25ea44a7", "address": "fa:16:3e:1f:d7:f3", "network": {"id": "6a700b61-4aa6-440b-87e6-a3525a5cb918", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-448680331-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8babb73006da4977a1fe2bdb35e08d8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a5dfb7a-fd", "ovs_interfaceid": "2a5dfb7a-fd65-41fc-9997-8c2d25ea44a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75229) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 10:02:24 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-8768deb0-3736-4d13-beb1-dc54998b0b5b req-6ab508da-e1f1-48b5-8ed2-f174364c262b service nova] Acquired lock "refresh_cache-c1679275-ebb1-4f15-80a4-b8fd614fc34b" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 10:02:24 user nova-compute[75229]: DEBUG nova.network.neutron [req-8768deb0-3736-4d13-beb1-dc54998b0b5b req-6ab508da-e1f1-48b5-8ed2-f174364c262b service nova] [instance: c1679275-ebb1-4f15-80a4-b8fd614fc34b] Refreshing network info cache for port 2a5dfb7a-fd65-41fc-9997-8c2d25ea44a7 {{(pid=75229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 10:02:24 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-8bfc9687-2a0e-47b1-aa2e-1b2913a1f331 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] [instance: c1679275-ebb1-4f15-80a4-b8fd614fc34b] Start _get_guest_xml network_info=[{"id": "2a5dfb7a-fd65-41fc-9997-8c2d25ea44a7", "address": "fa:16:3e:1f:d7:f3", "network": {"id": "6a700b61-4aa6-440b-87e6-a3525a5cb918", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-448680331-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8babb73006da4977a1fe2bdb35e08d8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a5dfb7a-fd", "ovs_interfaceid": "2a5dfb7a-fd65-41fc-9997-8c2d25ea44a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T09:40:10Z,direct_url=<?>,disk_format='qcow2',id=3bef8470-ecc7-40e3-95d4-9254348ea72d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='de5a91106b6948ed937a7178ff9464c4',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T09:40:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'disk_bus': 'virtio', 'guest_format': None, 'encryption_secret_uuid': None, 'size': 0, 'device_type': 'disk', 'image_id': '3bef8470-ecc7-40e3-95d4-9254348ea72d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75229) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 10:02:24 user nova-compute[75229]: WARNING nova.virt.libvirt.driver [None req-8bfc9687-2a0e-47b1-aa2e-1b2913a1f331 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 10:02:24 user nova-compute[75229]: WARNING nova.virt.libvirt.driver [None req-8bfc9687-2a0e-47b1-aa2e-1b2913a1f331 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 10:02:24 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-8bfc9687-2a0e-47b1-aa2e-1b2913a1f331 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75229) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 10:02:24 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-8bfc9687-2a0e-47b1-aa2e-1b2913a1f331 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] CPU controller missing on host. {{(pid=75229) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 10:02:24 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-8bfc9687-2a0e-47b1-aa2e-1b2913a1f331 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75229) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 10:02:24 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-8bfc9687-2a0e-47b1-aa2e-1b2913a1f331 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] CPU controller found on host. {{(pid=75229) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 10:02:24 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-8bfc9687-2a0e-47b1-aa2e-1b2913a1f331 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75229) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 10:02:24 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-8bfc9687-2a0e-47b1-aa2e-1b2913a1f331 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T09:39:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T09:40:10Z,direct_url=<?>,disk_format='qcow2',id=3bef8470-ecc7-40e3-95d4-9254348ea72d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='de5a91106b6948ed937a7178ff9464c4',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T09:40:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 10:02:24 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-8bfc9687-2a0e-47b1-aa2e-1b2913a1f331 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Flavor limits 0:0:0 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 10:02:24 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-8bfc9687-2a0e-47b1-aa2e-1b2913a1f331 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Image limits 0:0:0 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 10:02:24 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-8bfc9687-2a0e-47b1-aa2e-1b2913a1f331 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Flavor pref 0:0:0 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 10:02:24 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-8bfc9687-2a0e-47b1-aa2e-1b2913a1f331 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Image pref 0:0:0 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 10:02:24 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-8bfc9687-2a0e-47b1-aa2e-1b2913a1f331 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 10:02:24 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-8bfc9687-2a0e-47b1-aa2e-1b2913a1f331 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 10:02:24 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-8bfc9687-2a0e-47b1-aa2e-1b2913a1f331 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75229) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 10:02:24 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-8bfc9687-2a0e-47b1-aa2e-1b2913a1f331 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Got 1 possible topologies {{(pid=75229) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 10:02:24 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-8bfc9687-2a0e-47b1-aa2e-1b2913a1f331 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 10:02:24 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-8bfc9687-2a0e-47b1-aa2e-1b2913a1f331 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 10:02:24 user nova-compute[75229]: DEBUG nova.virt.libvirt.vif [None req-8bfc9687-2a0e-47b1-aa2e-1b2913a1f331 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T10:02:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1519406851',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1519406851',id=41,image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8babb73006da4977a1fe2bdb35e08d8f',ramdisk_id='',reservation_id='r-jphuxmn0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-189750210',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T10:02:22Z,user_data=None,user_id='a8825cd49e9349f28576b704c4c4d717',uuid=c1679275-ebb1-4f15-80a4-b8fd614fc34b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2a5dfb7a-fd65-41fc-9997-8c2d25ea44a7", "address": "fa:16:3e:1f:d7:f3", "network": {"id": "6a700b61-4aa6-440b-87e6-a3525a5cb918", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-448680331-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8babb73006da4977a1fe2bdb35e08d8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a5dfb7a-fd", "ovs_interfaceid": "2a5dfb7a-fd65-41fc-9997-8c2d25ea44a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75229) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 10:02:24 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-8bfc9687-2a0e-47b1-aa2e-1b2913a1f331 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Converting VIF {"id": "2a5dfb7a-fd65-41fc-9997-8c2d25ea44a7", "address": "fa:16:3e:1f:d7:f3", "network": {"id": "6a700b61-4aa6-440b-87e6-a3525a5cb918", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-448680331-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8babb73006da4977a1fe2bdb35e08d8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a5dfb7a-fd", "ovs_interfaceid": "2a5dfb7a-fd65-41fc-9997-8c2d25ea44a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 10:02:24 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-8bfc9687-2a0e-47b1-aa2e-1b2913a1f331 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1f:d7:f3,bridge_name='br-int',has_traffic_filtering=True,id=2a5dfb7a-fd65-41fc-9997-8c2d25ea44a7,network=Network(6a700b61-4aa6-440b-87e6-a3525a5cb918),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a5dfb7a-fd') {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 10:02:24 user nova-compute[75229]: DEBUG nova.objects.instance [None req-8bfc9687-2a0e-47b1-aa2e-1b2913a1f331 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Lazy-loading 'pci_devices' on Instance uuid c1679275-ebb1-4f15-80a4-b8fd614fc34b {{(pid=75229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 10:02:24 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-8bfc9687-2a0e-47b1-aa2e-1b2913a1f331 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] [instance: c1679275-ebb1-4f15-80a4-b8fd614fc34b] End _get_guest_xml xml=<domain type="kvm">
Nov 14 10:02:24 user nova-compute[75229]:   <uuid>c1679275-ebb1-4f15-80a4-b8fd614fc34b</uuid>
Nov 14 10:02:24 user nova-compute[75229]:   <name>instance-00000029</name>
Nov 14 10:02:24 user nova-compute[75229]:   <memory>524288</memory>
Nov 14 10:02:24 user nova-compute[75229]:   <vcpu>1</vcpu>
Nov 14 10:02:24 user nova-compute[75229]:   <metadata>
Nov 14 10:02:24 user nova-compute[75229]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 10:02:24 user nova-compute[75229]:       <nova:package version="0.0.0"/>
Nov 14 10:02:24 user nova-compute[75229]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1519406851</nova:name>
Nov 14 10:02:24 user nova-compute[75229]:       <nova:creationTime>2023-11-14 10:02:24</nova:creationTime>
Nov 14 10:02:24 user nova-compute[75229]:       <nova:flavor name="m1.tiny">
Nov 14 10:02:24 user nova-compute[75229]:         <nova:memory>512</nova:memory>
Nov 14 10:02:24 user nova-compute[75229]:         <nova:disk>1</nova:disk>
Nov 14 10:02:24 user nova-compute[75229]:         <nova:swap>0</nova:swap>
Nov 14 10:02:24 user nova-compute[75229]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 10:02:24 user nova-compute[75229]:         <nova:vcpus>1</nova:vcpus>
Nov 14 10:02:24 user nova-compute[75229]:       </nova:flavor>
Nov 14 10:02:24 user nova-compute[75229]:       <nova:owner>
Nov 14 10:02:24 user nova-compute[75229]:         <nova:user uuid="a8825cd49e9349f28576b704c4c4d717">tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member</nova:user>
Nov 14 10:02:24 user nova-compute[75229]:         <nova:project uuid="8babb73006da4977a1fe2bdb35e08d8f">tempest-ServerBootFromVolumeStableRescueTest-189750210</nova:project>
Nov 14 10:02:24 user nova-compute[75229]:       </nova:owner>
Nov 14 10:02:24 user nova-compute[75229]:       <nova:root type="image" uuid="3bef8470-ecc7-40e3-95d4-9254348ea72d"/>
Nov 14 10:02:24 user nova-compute[75229]:       <nova:ports>
Nov 14 10:02:24 user nova-compute[75229]:         <nova:port uuid="2a5dfb7a-fd65-41fc-9997-8c2d25ea44a7">
Nov 14 10:02:24 user nova-compute[75229]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 14 10:02:24 user nova-compute[75229]:         </nova:port>
Nov 14 10:02:24 user nova-compute[75229]:       </nova:ports>
Nov 14 10:02:24 user nova-compute[75229]:     </nova:instance>
Nov 14 10:02:24 user nova-compute[75229]:   </metadata>
Nov 14 10:02:24 user nova-compute[75229]:   <sysinfo type="smbios">
Nov 14 10:02:24 user nova-compute[75229]:     <system>
Nov 14 10:02:24 user nova-compute[75229]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 10:02:24 user nova-compute[75229]:       <entry name="product">OpenStack Nova</entry>
Nov 14 10:02:24 user nova-compute[75229]:       <entry name="version">0.0.0</entry>
Nov 14 10:02:24 user nova-compute[75229]:       <entry name="serial">c1679275-ebb1-4f15-80a4-b8fd614fc34b</entry>
Nov 14 10:02:24 user nova-compute[75229]:       <entry name="uuid">c1679275-ebb1-4f15-80a4-b8fd614fc34b</entry>
Nov 14 10:02:24 user nova-compute[75229]:       <entry name="family">Virtual Machine</entry>
Nov 14 10:02:24 user nova-compute[75229]:     </system>
Nov 14 10:02:24 user nova-compute[75229]:   </sysinfo>
Nov 14 10:02:24 user nova-compute[75229]:   <os>
Nov 14 10:02:24 user nova-compute[75229]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 10:02:24 user nova-compute[75229]:     <boot dev="hd"/>
Nov 14 10:02:24 user nova-compute[75229]:     <smbios mode="sysinfo"/>
Nov 14 10:02:24 user nova-compute[75229]:   </os>
Nov 14 10:02:24 user nova-compute[75229]:   <features>
Nov 14 10:02:24 user nova-compute[75229]:     <acpi/>
Nov 14 10:02:24 user nova-compute[75229]:     <apic/>
Nov 14 10:02:24 user nova-compute[75229]:     <vmcoreinfo/>
Nov 14 10:02:24 user nova-compute[75229]:   </features>
Nov 14 10:02:24 user nova-compute[75229]:   <clock offset="utc">
Nov 14 10:02:24 user nova-compute[75229]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 10:02:24 user nova-compute[75229]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 10:02:24 user nova-compute[75229]:     <timer name="hpet" present="no"/>
Nov 14 10:02:24 user nova-compute[75229]:   </clock>
Nov 14 10:02:24 user nova-compute[75229]:   <cpu mode="custom" match="exact">
Nov 14 10:02:24 user nova-compute[75229]:     <model>Nehalem</model>
Nov 14 10:02:24 user nova-compute[75229]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 10:02:24 user nova-compute[75229]:   </cpu>
Nov 14 10:02:24 user nova-compute[75229]:   <devices>
Nov 14 10:02:24 user nova-compute[75229]:     <disk type="file" device="disk">
Nov 14 10:02:24 user nova-compute[75229]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 10:02:24 user nova-compute[75229]:       <source file="/opt/stack/data/nova/instances/c1679275-ebb1-4f15-80a4-b8fd614fc34b/disk"/>
Nov 14 10:02:24 user nova-compute[75229]:       <target dev="vda" bus="virtio"/>
Nov 14 10:02:24 user nova-compute[75229]:     </disk>
Nov 14 10:02:24 user nova-compute[75229]:     <interface type="ethernet">
Nov 14 10:02:24 user nova-compute[75229]:       <mac address="fa:16:3e:1f:d7:f3"/>
Nov 14 10:02:24 user nova-compute[75229]:       <model type="virtio"/>
Nov 14 10:02:24 user nova-compute[75229]:       <mtu size="1442"/>
Nov 14 10:02:24 user nova-compute[75229]:       <target dev="tap2a5dfb7a-fd"/>
Nov 14 10:02:24 user nova-compute[75229]:     </interface>
Nov 14 10:02:24 user nova-compute[75229]:     <serial type="pty">
Nov 14 10:02:24 user nova-compute[75229]:       <log file="/opt/stack/data/nova/instances/c1679275-ebb1-4f15-80a4-b8fd614fc34b/console.log" append="off"/>
Nov 14 10:02:24 user nova-compute[75229]:     </serial>
Nov 14 10:02:24 user nova-compute[75229]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 10:02:24 user nova-compute[75229]:     <video>
Nov 14 10:02:24 user nova-compute[75229]:       <model type="virtio"/>
Nov 14 10:02:24 user nova-compute[75229]:     </video>
Nov 14 10:02:24 user nova-compute[75229]:     <rng model="virtio">
Nov 14 10:02:24 user nova-compute[75229]:       <backend model="random">/dev/urandom</backend>
Nov 14 10:02:24 user nova-compute[75229]:     </rng>
Nov 14 10:02:24 user nova-compute[75229]:     <controller type="usb" index="0" model="none"/>
Nov 14 10:02:24 user nova-compute[75229]:     <memballoon model="virtio">
Nov 14 10:02:24 user nova-compute[75229]:       <stats period="10"/>
Nov 14 10:02:24 user nova-compute[75229]:     </memballoon>
Nov 14 10:02:24 user nova-compute[75229]:   </devices>
Nov 14 10:02:24 user nova-compute[75229]: </domain>
Nov 14 10:02:24 user nova-compute[75229]:  {{(pid=75229) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 10:02:24 user nova-compute[75229]: DEBUG nova.virt.libvirt.vif [None req-8bfc9687-2a0e-47b1-aa2e-1b2913a1f331 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T10:02:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1519406851',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1519406851',id=41,image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8babb73006da4977a1fe2bdb35e08d8f',ramdisk_id='',reservation_id='r-jphuxmn0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-189750210',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T10:02:22Z,user_data=None,user_id='a8825cd49e9349f28576b704c4c4d717',uuid=c1679275-ebb1-4f15-80a4-b8fd614fc34b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2a5dfb7a-fd65-41fc-9997-8c2d25ea44a7", "address": "fa:16:3e:1f:d7:f3", "network": {"id": "6a700b61-4aa6-440b-87e6-a3525a5cb918", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-448680331-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8babb73006da4977a1fe2bdb35e08d8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a5dfb7a-fd", "ovs_interfaceid": "2a5dfb7a-fd65-41fc-9997-8c2d25ea44a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 10:02:24 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-8bfc9687-2a0e-47b1-aa2e-1b2913a1f331 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Converting VIF {"id": "2a5dfb7a-fd65-41fc-9997-8c2d25ea44a7", "address": "fa:16:3e:1f:d7:f3", "network": {"id": "6a700b61-4aa6-440b-87e6-a3525a5cb918", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-448680331-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8babb73006da4977a1fe2bdb35e08d8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a5dfb7a-fd", "ovs_interfaceid": "2a5dfb7a-fd65-41fc-9997-8c2d25ea44a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 10:02:24 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-8bfc9687-2a0e-47b1-aa2e-1b2913a1f331 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1f:d7:f3,bridge_name='br-int',has_traffic_filtering=True,id=2a5dfb7a-fd65-41fc-9997-8c2d25ea44a7,network=Network(6a700b61-4aa6-440b-87e6-a3525a5cb918),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a5dfb7a-fd') {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 10:02:24 user nova-compute[75229]: DEBUG os_vif [None req-8bfc9687-2a0e-47b1-aa2e-1b2913a1f331 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1f:d7:f3,bridge_name='br-int',has_traffic_filtering=True,id=2a5dfb7a-fd65-41fc-9997-8c2d25ea44a7,network=Network(6a700b61-4aa6-440b-87e6-a3525a5cb918),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a5dfb7a-fd') {{(pid=75229) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 10:02:24 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:02:24 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 10:02:24 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 10:02:24 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:02:24 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7b82f9dd-a2e0-5d22-8690-15e9b7d4edce', '_type': 'linux-noop'}}, row=False) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 10:02:24 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:02:24 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 10:02:24 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:02:24 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2a5dfb7a-fd, may_exist=True, interface_attrs={}) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 10:02:24 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2a5dfb7a-fd, col_values=(('qos', UUID('015e6458-9d63-4ae9-9d1e-22f634a75be5')),), if_exists=True) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 10:02:24 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2a5dfb7a-fd, col_values=(('external_ids', {'iface-id': '2a5dfb7a-fd65-41fc-9997-8c2d25ea44a7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1f:d7:f3', 'vm-uuid': 'c1679275-ebb1-4f15-80a4-b8fd614fc34b'}),), if_exists=True) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 10:02:24 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:02:24 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 10:02:24 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:02:24 user nova-compute[75229]: INFO os_vif [None req-8bfc9687-2a0e-47b1-aa2e-1b2913a1f331 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1f:d7:f3,bridge_name='br-int',has_traffic_filtering=True,id=2a5dfb7a-fd65-41fc-9997-8c2d25ea44a7,network=Network(6a700b61-4aa6-440b-87e6-a3525a5cb918),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a5dfb7a-fd')
Nov 14 10:02:24 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-8bfc9687-2a0e-47b1-aa2e-1b2913a1f331 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] No BDM found with device name vda, not building metadata. {{(pid=75229) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 10:02:24 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-8bfc9687-2a0e-47b1-aa2e-1b2913a1f331 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] No VIF found with MAC fa:16:3e:1f:d7:f3, not building metadata {{(pid=75229) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 10:02:24 user nova-compute[75229]: DEBUG nova.compute.manager [req-3c549b0b-d9da-49ee-839d-70e077350bb2 req-dcfd5308-91e2-459f-a3d9-f2dea1c6ee5b service nova] [instance: d822d5e4-38d8-4ca7-a682-f2f2144b6005] Received event network-changed-3f756f52-9183-4c6e-b60f-3d97c69fb495 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 10:02:24 user nova-compute[75229]: DEBUG nova.compute.manager [req-3c549b0b-d9da-49ee-839d-70e077350bb2 req-dcfd5308-91e2-459f-a3d9-f2dea1c6ee5b service nova] [instance: d822d5e4-38d8-4ca7-a682-f2f2144b6005] Refreshing instance network info cache due to event network-changed-3f756f52-9183-4c6e-b60f-3d97c69fb495. {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 10:02:24 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-3c549b0b-d9da-49ee-839d-70e077350bb2 req-dcfd5308-91e2-459f-a3d9-f2dea1c6ee5b service nova] Acquiring lock "refresh_cache-d822d5e4-38d8-4ca7-a682-f2f2144b6005" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 10:02:24 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-3c549b0b-d9da-49ee-839d-70e077350bb2 req-dcfd5308-91e2-459f-a3d9-f2dea1c6ee5b service nova] Acquired lock "refresh_cache-d822d5e4-38d8-4ca7-a682-f2f2144b6005" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 10:02:24 user nova-compute[75229]: DEBUG nova.network.neutron [req-3c549b0b-d9da-49ee-839d-70e077350bb2 req-dcfd5308-91e2-459f-a3d9-f2dea1c6ee5b service nova] [instance: d822d5e4-38d8-4ca7-a682-f2f2144b6005] Refreshing network info cache for port 3f756f52-9183-4c6e-b60f-3d97c69fb495 {{(pid=75229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 10:02:25 user nova-compute[75229]: DEBUG nova.network.neutron [req-8768deb0-3736-4d13-beb1-dc54998b0b5b req-6ab508da-e1f1-48b5-8ed2-f174364c262b service nova] [instance: c1679275-ebb1-4f15-80a4-b8fd614fc34b] Updated VIF entry in instance network info cache for port 2a5dfb7a-fd65-41fc-9997-8c2d25ea44a7. {{(pid=75229) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 10:02:25 user nova-compute[75229]: DEBUG nova.network.neutron [req-8768deb0-3736-4d13-beb1-dc54998b0b5b req-6ab508da-e1f1-48b5-8ed2-f174364c262b service nova] [instance: c1679275-ebb1-4f15-80a4-b8fd614fc34b] Updating instance_info_cache with network_info: [{"id": "2a5dfb7a-fd65-41fc-9997-8c2d25ea44a7", "address": "fa:16:3e:1f:d7:f3", "network": {"id": "6a700b61-4aa6-440b-87e6-a3525a5cb918", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-448680331-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8babb73006da4977a1fe2bdb35e08d8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a5dfb7a-fd", "ovs_interfaceid": "2a5dfb7a-fd65-41fc-9997-8c2d25ea44a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 10:02:25 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-8768deb0-3736-4d13-beb1-dc54998b0b5b req-6ab508da-e1f1-48b5-8ed2-f174364c262b service nova] Releasing lock "refresh_cache-c1679275-ebb1-4f15-80a4-b8fd614fc34b" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 10:02:25 user nova-compute[75229]: DEBUG nova.network.neutron [req-3c549b0b-d9da-49ee-839d-70e077350bb2 req-dcfd5308-91e2-459f-a3d9-f2dea1c6ee5b service nova] [instance: d822d5e4-38d8-4ca7-a682-f2f2144b6005] Updated VIF entry in instance network info cache for port 3f756f52-9183-4c6e-b60f-3d97c69fb495. {{(pid=75229) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 10:02:25 user nova-compute[75229]: DEBUG nova.network.neutron [req-3c549b0b-d9da-49ee-839d-70e077350bb2 req-dcfd5308-91e2-459f-a3d9-f2dea1c6ee5b service nova] [instance: d822d5e4-38d8-4ca7-a682-f2f2144b6005] Updating instance_info_cache with network_info: [{"id": "3f756f52-9183-4c6e-b60f-3d97c69fb495", "address": "fa:16:3e:94:54:20", "network": {"id": "118ea7c1-77c0-4660-b7b7-f311f6b0ec8a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1907578504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.10", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46620ac128944703899f22fe5439ba26", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f756f52-91", "ovs_interfaceid": "3f756f52-9183-4c6e-b60f-3d97c69fb495", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 10:02:25 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-3c549b0b-d9da-49ee-839d-70e077350bb2 req-dcfd5308-91e2-459f-a3d9-f2dea1c6ee5b service nova] Releasing lock "refresh_cache-d822d5e4-38d8-4ca7-a682-f2f2144b6005" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 10:02:25 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:02:25 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:02:25 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:02:25 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:02:26 user nova-compute[75229]: DEBUG nova.compute.manager [req-14f8f524-1c44-4a6b-820e-0bea9e5af554 req-92e555cb-d981-4ec0-ae74-c67beb172a4a service nova] [instance: c1679275-ebb1-4f15-80a4-b8fd614fc34b] Received event network-vif-plugged-2a5dfb7a-fd65-41fc-9997-8c2d25ea44a7 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 10:02:26 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-14f8f524-1c44-4a6b-820e-0bea9e5af554 req-92e555cb-d981-4ec0-ae74-c67beb172a4a service nova] Acquiring lock "c1679275-ebb1-4f15-80a4-b8fd614fc34b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:02:26 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-14f8f524-1c44-4a6b-820e-0bea9e5af554 req-92e555cb-d981-4ec0-ae74-c67beb172a4a service nova] Lock "c1679275-ebb1-4f15-80a4-b8fd614fc34b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:02:26 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-14f8f524-1c44-4a6b-820e-0bea9e5af554 req-92e555cb-d981-4ec0-ae74-c67beb172a4a service nova] Lock "c1679275-ebb1-4f15-80a4-b8fd614fc34b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:02:26 user nova-compute[75229]: DEBUG nova.compute.manager [req-14f8f524-1c44-4a6b-820e-0bea9e5af554 req-92e555cb-d981-4ec0-ae74-c67beb172a4a service nova] [instance: c1679275-ebb1-4f15-80a4-b8fd614fc34b] No waiting events found dispatching network-vif-plugged-2a5dfb7a-fd65-41fc-9997-8c2d25ea44a7 {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 10:02:26 user nova-compute[75229]: WARNING nova.compute.manager [req-14f8f524-1c44-4a6b-820e-0bea9e5af554 req-92e555cb-d981-4ec0-ae74-c67beb172a4a service nova] [instance: c1679275-ebb1-4f15-80a4-b8fd614fc34b] Received unexpected event network-vif-plugged-2a5dfb7a-fd65-41fc-9997-8c2d25ea44a7 for instance with vm_state building and task_state spawning.
Nov 14 10:02:26 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:02:26 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:02:28 user nova-compute[75229]: DEBUG nova.compute.manager [None req-8bfc9687-2a0e-47b1-aa2e-1b2913a1f331 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] [instance: c1679275-ebb1-4f15-80a4-b8fd614fc34b] Instance event wait completed in 0 seconds for  {{(pid=75229) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 10:02:28 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-8bfc9687-2a0e-47b1-aa2e-1b2913a1f331 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] [instance: c1679275-ebb1-4f15-80a4-b8fd614fc34b] Guest created on hypervisor {{(pid=75229) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 10:02:28 user nova-compute[75229]: INFO nova.virt.libvirt.driver [-] [instance: c1679275-ebb1-4f15-80a4-b8fd614fc34b] Instance spawned successfully.
Nov 14 10:02:28 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-8bfc9687-2a0e-47b1-aa2e-1b2913a1f331 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] [instance: c1679275-ebb1-4f15-80a4-b8fd614fc34b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 10:02:28 user nova-compute[75229]: DEBUG nova.compute.manager [req-bf8e7c4a-8126-483a-b203-50cbd12d0ea2 req-fc70a355-9c1d-47fc-9bff-d65dc1d5b2cd service nova] [instance: c1679275-ebb1-4f15-80a4-b8fd614fc34b] Received event network-vif-plugged-2a5dfb7a-fd65-41fc-9997-8c2d25ea44a7 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 10:02:28 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-bf8e7c4a-8126-483a-b203-50cbd12d0ea2 req-fc70a355-9c1d-47fc-9bff-d65dc1d5b2cd service nova] Acquiring lock "c1679275-ebb1-4f15-80a4-b8fd614fc34b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:02:28 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-bf8e7c4a-8126-483a-b203-50cbd12d0ea2 req-fc70a355-9c1d-47fc-9bff-d65dc1d5b2cd service nova] Lock "c1679275-ebb1-4f15-80a4-b8fd614fc34b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:02:28 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-bf8e7c4a-8126-483a-b203-50cbd12d0ea2 req-fc70a355-9c1d-47fc-9bff-d65dc1d5b2cd service nova] Lock "c1679275-ebb1-4f15-80a4-b8fd614fc34b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:02:28 user nova-compute[75229]: DEBUG nova.compute.manager [req-bf8e7c4a-8126-483a-b203-50cbd12d0ea2 req-fc70a355-9c1d-47fc-9bff-d65dc1d5b2cd service nova] [instance: c1679275-ebb1-4f15-80a4-b8fd614fc34b] No waiting events found dispatching network-vif-plugged-2a5dfb7a-fd65-41fc-9997-8c2d25ea44a7 {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 10:02:28 user nova-compute[75229]: WARNING nova.compute.manager [req-bf8e7c4a-8126-483a-b203-50cbd12d0ea2 req-fc70a355-9c1d-47fc-9bff-d65dc1d5b2cd service nova] [instance: c1679275-ebb1-4f15-80a4-b8fd614fc34b] Received unexpected event network-vif-plugged-2a5dfb7a-fd65-41fc-9997-8c2d25ea44a7 for instance with vm_state building and task_state spawning.
Nov 14 10:02:28 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-8bfc9687-2a0e-47b1-aa2e-1b2913a1f331 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] [instance: c1679275-ebb1-4f15-80a4-b8fd614fc34b] Found default for hw_cdrom_bus of ide {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 10:02:28 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-8bfc9687-2a0e-47b1-aa2e-1b2913a1f331 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] [instance: c1679275-ebb1-4f15-80a4-b8fd614fc34b] Found default for hw_disk_bus of virtio {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 10:02:28 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-8bfc9687-2a0e-47b1-aa2e-1b2913a1f331 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] [instance: c1679275-ebb1-4f15-80a4-b8fd614fc34b] Found default for hw_input_bus of None {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 10:02:28 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-8bfc9687-2a0e-47b1-aa2e-1b2913a1f331 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] [instance: c1679275-ebb1-4f15-80a4-b8fd614fc34b] Found default for hw_pointer_model of None {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 10:02:28 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-8bfc9687-2a0e-47b1-aa2e-1b2913a1f331 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] [instance: c1679275-ebb1-4f15-80a4-b8fd614fc34b] Found default for hw_video_model of virtio {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 10:02:28 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-8bfc9687-2a0e-47b1-aa2e-1b2913a1f331 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] [instance: c1679275-ebb1-4f15-80a4-b8fd614fc34b] Found default for hw_vif_model of virtio {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 10:02:28 user nova-compute[75229]: INFO nova.compute.manager [None req-8bfc9687-2a0e-47b1-aa2e-1b2913a1f331 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] [instance: c1679275-ebb1-4f15-80a4-b8fd614fc34b] Took 5.88 seconds to spawn the instance on the hypervisor.
Nov 14 10:02:28 user nova-compute[75229]: DEBUG nova.compute.manager [None req-8bfc9687-2a0e-47b1-aa2e-1b2913a1f331 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] [instance: c1679275-ebb1-4f15-80a4-b8fd614fc34b] Checking state {{(pid=75229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 10:02:28 user nova-compute[75229]: INFO nova.compute.manager [None req-8bfc9687-2a0e-47b1-aa2e-1b2913a1f331 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] [instance: c1679275-ebb1-4f15-80a4-b8fd614fc34b] Took 6.65 seconds to build instance.
Nov 14 10:02:28 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-8bfc9687-2a0e-47b1-aa2e-1b2913a1f331 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Lock "c1679275-ebb1-4f15-80a4-b8fd614fc34b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.805s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:02:28 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:02:28 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:02:29 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:02:30 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-3bcc0936-e173-42a4-9a48-fa8e636ddd5c tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Acquiring lock "c3f1afd9-958f-4942-b341-6e1f46a0c831" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:02:30 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-3bcc0936-e173-42a4-9a48-fa8e636ddd5c tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Lock "c3f1afd9-958f-4942-b341-6e1f46a0c831" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:02:30 user nova-compute[75229]: DEBUG nova.compute.manager [None req-3bcc0936-e173-42a4-9a48-fa8e636ddd5c tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] [instance: c3f1afd9-958f-4942-b341-6e1f46a0c831] Starting instance... {{(pid=75229) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 10:02:31 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-3bcc0936-e173-42a4-9a48-fa8e636ddd5c tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:02:31 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-3bcc0936-e173-42a4-9a48-fa8e636ddd5c tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:02:31 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-3bcc0936-e173-42a4-9a48-fa8e636ddd5c tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75229) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 10:02:31 user nova-compute[75229]: INFO nova.compute.claims [None req-3bcc0936-e173-42a4-9a48-fa8e636ddd5c tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] [instance: c3f1afd9-958f-4942-b341-6e1f46a0c831] Claim successful on node user
Nov 14 10:02:31 user nova-compute[75229]: DEBUG nova.compute.provider_tree [None req-3bcc0936-e173-42a4-9a48-fa8e636ddd5c tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Inventory has not changed in ProviderTree for provider: d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 {{(pid=75229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 10:02:31 user nova-compute[75229]: DEBUG nova.scheduler.client.report [None req-3bcc0936-e173-42a4-9a48-fa8e636ddd5c tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Inventory has not changed for provider d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 10:02:31 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-3bcc0936-e173-42a4-9a48-fa8e636ddd5c tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.494s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:02:31 user nova-compute[75229]: DEBUG nova.compute.manager [None req-3bcc0936-e173-42a4-9a48-fa8e636ddd5c tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] [instance: c3f1afd9-958f-4942-b341-6e1f46a0c831] Start building networks asynchronously for instance. {{(pid=75229) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 10:02:31 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-3bcc0936-e173-42a4-9a48-fa8e636ddd5c tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] [instance: c3f1afd9-958f-4942-b341-6e1f46a0c831] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 10:02:31 user nova-compute[75229]: DEBUG nova.compute.manager [None req-3bcc0936-e173-42a4-9a48-fa8e636ddd5c tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] [instance: c3f1afd9-958f-4942-b341-6e1f46a0c831] Allocating IP information in the background. {{(pid=75229) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 10:02:31 user nova-compute[75229]: DEBUG nova.network.neutron [None req-3bcc0936-e173-42a4-9a48-fa8e636ddd5c tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] [instance: c3f1afd9-958f-4942-b341-6e1f46a0c831] allocate_for_instance() {{(pid=75229) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 10:02:31 user nova-compute[75229]: DEBUG nova.compute.manager [None req-3bcc0936-e173-42a4-9a48-fa8e636ddd5c tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] [instance: c3f1afd9-958f-4942-b341-6e1f46a0c831] Start building block device mappings for instance. {{(pid=75229) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 10:02:31 user nova-compute[75229]: INFO nova.virt.block_device [None req-3bcc0936-e173-42a4-9a48-fa8e636ddd5c tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] [instance: c3f1afd9-958f-4942-b341-6e1f46a0c831] Booting with volume snapshot 1cd3d6d5-1406-4cb4-9ade-217eb51b0014 at /dev/vda
Nov 14 10:02:31 user nova-compute[75229]: DEBUG nova.policy [None req-3bcc0936-e173-42a4-9a48-fa8e636ddd5c tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c26f33e4cdf14ba796445959953f8685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46620ac128944703899f22fe5439ba26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75229) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 10:02:32 user nova-compute[75229]: DEBUG nova.network.neutron [None req-3bcc0936-e173-42a4-9a48-fa8e636ddd5c tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] [instance: c3f1afd9-958f-4942-b341-6e1f46a0c831] Successfully created port: d97c0909-9495-4af2-add5-bd9a848dd755 {{(pid=75229) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 10:02:33 user nova-compute[75229]: DEBUG nova.network.neutron [None req-3bcc0936-e173-42a4-9a48-fa8e636ddd5c tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] [instance: c3f1afd9-958f-4942-b341-6e1f46a0c831] Successfully updated port: d97c0909-9495-4af2-add5-bd9a848dd755 {{(pid=75229) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 10:02:33 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-3bcc0936-e173-42a4-9a48-fa8e636ddd5c tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Acquiring lock "refresh_cache-c3f1afd9-958f-4942-b341-6e1f46a0c831" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 10:02:33 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-3bcc0936-e173-42a4-9a48-fa8e636ddd5c tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Acquired lock "refresh_cache-c3f1afd9-958f-4942-b341-6e1f46a0c831" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 10:02:33 user nova-compute[75229]: DEBUG nova.network.neutron [None req-3bcc0936-e173-42a4-9a48-fa8e636ddd5c tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] [instance: c3f1afd9-958f-4942-b341-6e1f46a0c831] Building network info cache for instance {{(pid=75229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 10:02:33 user nova-compute[75229]: DEBUG nova.compute.manager [req-83dc485a-a20f-46e2-91e3-d7b402e4db4b req-bcef1166-16fa-4c4f-bf16-1d51e3e9d223 service nova] [instance: c3f1afd9-958f-4942-b341-6e1f46a0c831] Received event network-changed-d97c0909-9495-4af2-add5-bd9a848dd755 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 10:02:33 user nova-compute[75229]: DEBUG nova.compute.manager [req-83dc485a-a20f-46e2-91e3-d7b402e4db4b req-bcef1166-16fa-4c4f-bf16-1d51e3e9d223 service nova] [instance: c3f1afd9-958f-4942-b341-6e1f46a0c831] Refreshing instance network info cache due to event network-changed-d97c0909-9495-4af2-add5-bd9a848dd755. {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 10:02:33 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-83dc485a-a20f-46e2-91e3-d7b402e4db4b req-bcef1166-16fa-4c4f-bf16-1d51e3e9d223 service nova] Acquiring lock "refresh_cache-c3f1afd9-958f-4942-b341-6e1f46a0c831" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 10:02:33 user nova-compute[75229]: DEBUG nova.network.neutron [None req-3bcc0936-e173-42a4-9a48-fa8e636ddd5c tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] [instance: c3f1afd9-958f-4942-b341-6e1f46a0c831] Instance cache missing network info. {{(pid=75229) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 10:02:33 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:02:33 user nova-compute[75229]: DEBUG nova.network.neutron [None req-3bcc0936-e173-42a4-9a48-fa8e636ddd5c tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] [instance: c3f1afd9-958f-4942-b341-6e1f46a0c831] Updating instance_info_cache with network_info: [{"id": "d97c0909-9495-4af2-add5-bd9a848dd755", "address": "fa:16:3e:6f:4e:f9", "network": {"id": "118ea7c1-77c0-4660-b7b7-f311f6b0ec8a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1907578504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46620ac128944703899f22fe5439ba26", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd97c0909-94", "ovs_interfaceid": "d97c0909-9495-4af2-add5-bd9a848dd755", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 10:02:33 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-3bcc0936-e173-42a4-9a48-fa8e636ddd5c tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Releasing lock "refresh_cache-c3f1afd9-958f-4942-b341-6e1f46a0c831" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 10:02:33 user nova-compute[75229]: DEBUG nova.compute.manager [None req-3bcc0936-e173-42a4-9a48-fa8e636ddd5c tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] [instance: c3f1afd9-958f-4942-b341-6e1f46a0c831] Instance network_info: |[{"id": "d97c0909-9495-4af2-add5-bd9a848dd755", "address": "fa:16:3e:6f:4e:f9", "network": {"id": "118ea7c1-77c0-4660-b7b7-f311f6b0ec8a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1907578504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46620ac128944703899f22fe5439ba26", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd97c0909-94", "ovs_interfaceid": "d97c0909-9495-4af2-add5-bd9a848dd755", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75229) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 10:02:33 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-83dc485a-a20f-46e2-91e3-d7b402e4db4b req-bcef1166-16fa-4c4f-bf16-1d51e3e9d223 service nova] Acquired lock "refresh_cache-c3f1afd9-958f-4942-b341-6e1f46a0c831" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 10:02:33 user nova-compute[75229]: DEBUG nova.network.neutron [req-83dc485a-a20f-46e2-91e3-d7b402e4db4b req-bcef1166-16fa-4c4f-bf16-1d51e3e9d223 service nova] [instance: c3f1afd9-958f-4942-b341-6e1f46a0c831] Refreshing network info cache for port d97c0909-9495-4af2-add5-bd9a848dd755 {{(pid=75229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 10:02:34 user nova-compute[75229]: DEBUG nova.network.neutron [req-83dc485a-a20f-46e2-91e3-d7b402e4db4b req-bcef1166-16fa-4c4f-bf16-1d51e3e9d223 service nova] [instance: c3f1afd9-958f-4942-b341-6e1f46a0c831] Updated VIF entry in instance network info cache for port d97c0909-9495-4af2-add5-bd9a848dd755. {{(pid=75229) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 10:02:34 user nova-compute[75229]: DEBUG nova.network.neutron [req-83dc485a-a20f-46e2-91e3-d7b402e4db4b req-bcef1166-16fa-4c4f-bf16-1d51e3e9d223 service nova] [instance: c3f1afd9-958f-4942-b341-6e1f46a0c831] Updating instance_info_cache with network_info: [{"id": "d97c0909-9495-4af2-add5-bd9a848dd755", "address": "fa:16:3e:6f:4e:f9", "network": {"id": "118ea7c1-77c0-4660-b7b7-f311f6b0ec8a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1907578504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46620ac128944703899f22fe5439ba26", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd97c0909-94", "ovs_interfaceid": "d97c0909-9495-4af2-add5-bd9a848dd755", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 10:02:34 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-83dc485a-a20f-46e2-91e3-d7b402e4db4b req-bcef1166-16fa-4c4f-bf16-1d51e3e9d223 service nova] Releasing lock "refresh_cache-c3f1afd9-958f-4942-b341-6e1f46a0c831" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 10:02:34 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:02:37 user nova-compute[75229]: DEBUG os_brick.utils [None req-3bcc0936-e173-42a4-9a48-fa8e636ddd5c tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 10:02:37 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:02:37 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:02:37 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[069796e4-4f5c-4c2a-9673-a32a95f235fb]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f1154031c835\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:02:37 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:02:37 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:02:37 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[e81463cc-bae5-464c-b0d0-74e9de9a501d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:02:37 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:02:37 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:02:37 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c43a765-e787-4ef7-9297-3766cba3ec33]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:02:37 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[a46e6ed9-f4b5-4b2f-8d6e-a0747a851157]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:02:37 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-3bcc0936-e173-42a4-9a48-fa8e636ddd5c tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Running cmd (subprocess): nvme version {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:02:37 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-3bcc0936-e173-42a4-9a48-fa8e636ddd5c tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] 'nvme version' failed. Not Retrying. {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 10:02:37 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3bcc0936-e173-42a4-9a48-fa8e636ddd5c tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] nvme not present on system {{(pid=75229) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 10:02:37 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:02:37 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 10:02:37 user nova-compute[75229]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 10:02:37 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[127188f6-cee6-409f-ad77-e7950f72bc70]: (4, '') {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:02:37 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.lightos [None req-3bcc0936-e173-42a4-9a48-fa8e636ddd5c tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75229) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 10:02:37 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.lightos [None req-3bcc0936-e173-42a4-9a48-fa8e636ddd5c tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75229) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 10:02:37 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.lightos [None req-3bcc0936-e173-42a4-9a48-fa8e636ddd5c tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] LIGHTOS: no hostnqn found. {{(pid=75229) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 10:02:37 user nova-compute[75229]: DEBUG os_brick.utils [None req-3bcc0936-e173-42a4-9a48-fa8e636ddd5c tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] <== get_connector_properties: return (115ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f1154031c835', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 10:02:37 user nova-compute[75229]: DEBUG nova.virt.block_device [None req-3bcc0936-e173-42a4-9a48-fa8e636ddd5c tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] [instance: c3f1afd9-958f-4942-b341-6e1f46a0c831] Updating existing volume attachment record: 4c96f151-8481-4711-9b7c-1de2d7cd4905 {{(pid=75229) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 10:02:39 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:02:42 user nova-compute[75229]: DEBUG nova.compute.manager [None req-3bcc0936-e173-42a4-9a48-fa8e636ddd5c tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] [instance: c3f1afd9-958f-4942-b341-6e1f46a0c831] Start spawning the instance on the hypervisor. {{(pid=75229) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 10:02:42 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-3bcc0936-e173-42a4-9a48-fa8e636ddd5c tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] [instance: c3f1afd9-958f-4942-b341-6e1f46a0c831] Creating instance directory {{(pid=75229) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 10:02:42 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-3bcc0936-e173-42a4-9a48-fa8e636ddd5c tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] [instance: c3f1afd9-958f-4942-b341-6e1f46a0c831] Creating image(s)
Nov 14 10:02:42 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-3bcc0936-e173-42a4-9a48-fa8e636ddd5c tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] [instance: c3f1afd9-958f-4942-b341-6e1f46a0c831] Did not create local disks {{(pid=75229) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 14 10:02:42 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-3bcc0936-e173-42a4-9a48-fa8e636ddd5c tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] [instance: c3f1afd9-958f-4942-b341-6e1f46a0c831] Ensure instance console log exists: /opt/stack/data/nova/instances/c3f1afd9-958f-4942-b341-6e1f46a0c831/console.log {{(pid=75229) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 10:02:42 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-3bcc0936-e173-42a4-9a48-fa8e636ddd5c tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:02:42 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-3bcc0936-e173-42a4-9a48-fa8e636ddd5c tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:02:42 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-3bcc0936-e173-42a4-9a48-fa8e636ddd5c tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:02:42 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-3bcc0936-e173-42a4-9a48-fa8e636ddd5c tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] [instance: c3f1afd9-958f-4942-b341-6e1f46a0c831] Start _get_guest_xml network_info=[{"id": "d97c0909-9495-4af2-add5-bd9a848dd755", "address": "fa:16:3e:6f:4e:f9", "network": {"id": "118ea7c1-77c0-4660-b7b7-f311f6b0ec8a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1907578504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46620ac128944703899f22fe5439ba26", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd97c0909-94", "ovs_interfaceid": "d97c0909-9495-4af2-add5-bd9a848dd755", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-11-14T10:02:27Z,direct_url=<?>,disk_format='qcow2',id=a73bae01-636f-4ff9-a077-79b25dfed578,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-1087154620',owner='46620ac128944703899f22fe5439ba26',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-11-14T10:02:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:64caa5ab-59eb-4251-9cef-f8576154c443', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zNJrebdA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'c3f1afd9-958f-4942-b341-6e1f46a0c831', 'attached_at': '', 'detached_at': '', 'volume_id': '64caa5ab-59eb-4251-9cef-f8576154c443', 'serial': '64caa5ab-59eb-4251-9cef-f8576154c443'}, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'attachment_id': '4c96f151-8481-4711-9b7c-1de2d7cd4905', 'guest_format': None, 'device_type': 'disk', 'volume_type': None} {{(pid=75229) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 10:02:42 user nova-compute[75229]: WARNING nova.virt.libvirt.driver [None req-3bcc0936-e173-42a4-9a48-fa8e636ddd5c tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 10:02:42 user nova-compute[75229]: WARNING nova.virt.libvirt.driver [None req-3bcc0936-e173-42a4-9a48-fa8e636ddd5c tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 10:02:42 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-3bcc0936-e173-42a4-9a48-fa8e636ddd5c tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75229) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 10:02:42 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-3bcc0936-e173-42a4-9a48-fa8e636ddd5c tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] CPU controller missing on host. {{(pid=75229) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 10:02:42 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-3bcc0936-e173-42a4-9a48-fa8e636ddd5c tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75229) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 10:02:42 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-3bcc0936-e173-42a4-9a48-fa8e636ddd5c tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] CPU controller found on host. {{(pid=75229) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 10:02:42 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-3bcc0936-e173-42a4-9a48-fa8e636ddd5c tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75229) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 10:02:42 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-3bcc0936-e173-42a4-9a48-fa8e636ddd5c tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T09:39:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-11-14T10:02:27Z,direct_url=<?>,disk_format='qcow2',id=a73bae01-636f-4ff9-a077-79b25dfed578,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-1087154620',owner='46620ac128944703899f22fe5439ba26',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-11-14T10:02:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 10:02:42 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-3bcc0936-e173-42a4-9a48-fa8e636ddd5c tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Flavor limits 0:0:0 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 10:02:42 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-3bcc0936-e173-42a4-9a48-fa8e636ddd5c tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Image limits 0:0:0 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 10:02:42 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-3bcc0936-e173-42a4-9a48-fa8e636ddd5c tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Flavor pref 0:0:0 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 10:02:42 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-3bcc0936-e173-42a4-9a48-fa8e636ddd5c tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Image pref 0:0:0 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 10:02:42 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-3bcc0936-e173-42a4-9a48-fa8e636ddd5c tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 10:02:42 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-3bcc0936-e173-42a4-9a48-fa8e636ddd5c tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 10:02:42 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-3bcc0936-e173-42a4-9a48-fa8e636ddd5c tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75229) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 10:02:42 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-3bcc0936-e173-42a4-9a48-fa8e636ddd5c tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Got 1 possible topologies {{(pid=75229) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 10:02:42 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-3bcc0936-e173-42a4-9a48-fa8e636ddd5c tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 10:02:42 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-3bcc0936-e173-42a4-9a48-fa8e636ddd5c tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 10:02:42 user nova-compute[75229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3bcc0936-e173-42a4-9a48-fa8e636ddd5c tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] [instance: c3f1afd9-958f-4942-b341-6e1f46a0c831] Calling os-brick to attach iSCSI Volume {{(pid=75229) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 10:02:42 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bcc0936-e173-42a4-9a48-fa8e636ddd5c tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f73f85151b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:64caa5ab-59eb-4251-9cef-f8576154c443', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zNJrebdA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 10:02:42 user nova-compute[75229]: WARNING os_brick.initiator.connectors.base [None req-3bcc0936-e173-42a4-9a48-fa8e636ddd5c tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 10:02:42 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-3bcc0936-e173-42a4-9a48-fa8e636ddd5c tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 10:02:42 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-3bcc0936-e173-42a4-9a48-fa8e636ddd5c tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 10:02:42 user nova-compute[75229]: WARNING os_brick.initiator.connectors.base [None req-3bcc0936-e173-42a4-9a48-fa8e636ddd5c tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 10:02:42 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-3bcc0936-e173-42a4-9a48-fa8e636ddd5c tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:64caa5ab-59eb-4251-9cef-f8576154c443" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 10:02:42 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-3bcc0936-e173-42a4-9a48-fa8e636ddd5c tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:64caa5ab-59eb-4251-9cef-f8576154c443" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 10:02:42 user nova-compute[75229]: INFO os_brick.initiator.connectors.iscsi [None req-3bcc0936-e173-42a4-9a48-fa8e636ddd5c tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 10:02:42 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64caa5ab-59eb-4251-9cef-f8576154c443 -p 172.16.0.220:3260 {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:02:42 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64caa5ab-59eb-4251-9cef-f8576154c443 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:02:42 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[78ef533d-d0e4-4f3c-9cf4-78451066a39c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:02:42 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bcc0936-e173-42a4-9a48-fa8e636ddd5c tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 10:02:42 user nova-compute[75229]:  {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 10:02:42 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64caa5ab-59eb-4251-9cef-f8576154c443 -p 172.16.0.220:3260 --interface default --op new {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:02:42 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64caa5ab-59eb-4251-9cef-f8576154c443 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:02:42 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7f2dd09-6a1f-417c-ac45-5695ad274f9b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:64caa5ab-59eb-4251-9cef-f8576154c443] added\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:02:42 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bcc0936-e173-42a4-9a48-fa8e636ddd5c tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:64caa5ab-59eb-4251-9cef-f8576154c443] added
Nov 14 10:02:42 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 10:02:42 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64caa5ab-59eb-4251-9cef-f8576154c443 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:02:42 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64caa5ab-59eb-4251-9cef-f8576154c443 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:02:42 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ca5417f-b6a0-430d-8fec-17b88164b015]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:02:42 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bcc0936-e173-42a4-9a48-fa8e636ddd5c tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 10:02:42 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64caa5ab-59eb-4251-9cef-f8576154c443 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:02:42 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64caa5ab-59eb-4251-9cef-f8576154c443 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:02:42 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[92706261-bb7f-46d4-8721-78f522915ba4]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:02:42 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bcc0936-e173-42a4-9a48-fa8e636ddd5c tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 10:02:42 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64caa5ab-59eb-4251-9cef-f8576154c443 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zNJrebdA {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:02:42 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64caa5ab-59eb-4251-9cef-f8576154c443 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zNJrebdA" returned: 0 in 0.017s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:02:42 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[021fe016-eebd-4821-9471-bc7075cdcab7]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:02:42 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bcc0936-e173-42a4-9a48-fa8e636ddd5c tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zNJrebdA'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 10:02:42 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64caa5ab-59eb-4251-9cef-f8576154c443 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:02:42 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64caa5ab-59eb-4251-9cef-f8576154c443 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:02:42 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6603ab6-a673-4384-b5d3-51b8776587be]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:02:42 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bcc0936-e173-42a4-9a48-fa8e636ddd5c tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 10:02:42 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:02:42 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:02:42 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8bbb12c-4669-4c38-b2c5-24b12cae2637]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aebc438-0289-44fe-ad84-4e696468f50e (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:143891e8-62eb-42d7-b076-db6f52b4f606 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2977635e-b11f-4ab2-875c-e9f396b932dc (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4a6dca6-1581-494f-afe5-3aac2b4d2c15 (non-flash)\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:02:42 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bcc0936-e173-42a4-9a48-fa8e636ddd5c tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aebc438-0289-44fe-ad84-4e696468f50e (non-flash)
Nov 14 10:02:42 user nova-compute[75229]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:143891e8-62eb-42d7-b076-db6f52b4f606 (non-flash)
Nov 14 10:02:42 user nova-compute[75229]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2977635e-b11f-4ab2-875c-e9f396b932dc (non-flash)
Nov 14 10:02:42 user nova-compute[75229]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4a6dca6-1581-494f-afe5-3aac2b4d2c15 (non-flash)
Nov 14 10:02:42 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 10:02:42 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bcc0936-e173-42a4-9a48-fa8e636ddd5c tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aebc438-0289-44fe-ad84-4e696468f50e (non-flash)
Nov 14 10:02:42 user nova-compute[75229]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:143891e8-62eb-42d7-b076-db6f52b4f606 (non-flash)
Nov 14 10:02:42 user nova-compute[75229]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2977635e-b11f-4ab2-875c-e9f396b932dc (non-flash)
Nov 14 10:02:42 user nova-compute[75229]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4a6dca6-1581-494f-afe5-3aac2b4d2c15 (non-flash)
Nov 14 10:02:42 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 10:02:42 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64caa5ab-59eb-4251-9cef-f8576154c443 -p 172.16.0.220:3260 --login {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:02:42 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64caa5ab-59eb-4251-9cef-f8576154c443 -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:02:42 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[e726f715-4306-4523-aa86-e960025490cb]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:64caa5ab-59eb-4251-9cef-f8576154c443, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:64caa5ab-59eb-4251-9cef-f8576154c443, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:02:42 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bcc0936-e173-42a4-9a48-fa8e636ddd5c tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:64caa5ab-59eb-4251-9cef-f8576154c443, portal: 172.16.0.220,3260]
Nov 14 10:02:42 user nova-compute[75229]: Login to [iface: default, target: iqn.2010-10.org.openstack:64caa5ab-59eb-4251-9cef-f8576154c443, portal: 172.16.0.220,3260] successful.
Nov 14 10:02:42 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 10:02:42 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64caa5ab-59eb-4251-9cef-f8576154c443 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:02:42 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64caa5ab-59eb-4251-9cef-f8576154c443 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:02:42 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[62831a0e-8463-4f20-b5a9-06dbc8e931ae]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:02:42 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bcc0936-e173-42a4-9a48-fa8e636ddd5c tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 10:02:42 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:02:42 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:02:42 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[f283c038-f511-467c-8655-6fb2d84b8a43]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aebc438-0289-44fe-ad84-4e696468f50e (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:143891e8-62eb-42d7-b076-db6f52b4f606 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2977635e-b11f-4ab2-875c-e9f396b932dc (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4a6dca6-1581-494f-afe5-3aac2b4d2c15 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64caa5ab-59eb-4251-9cef-f8576154c443 (non-flash)\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:02:42 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bcc0936-e173-42a4-9a48-fa8e636ddd5c tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aebc438-0289-44fe-ad84-4e696468f50e (non-flash)
Nov 14 10:02:42 user nova-compute[75229]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:143891e8-62eb-42d7-b076-db6f52b4f606 (non-flash)
Nov 14 10:02:42 user nova-compute[75229]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2977635e-b11f-4ab2-875c-e9f396b932dc (non-flash)
Nov 14 10:02:42 user nova-compute[75229]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4a6dca6-1581-494f-afe5-3aac2b4d2c15 (non-flash)
Nov 14 10:02:42 user nova-compute[75229]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64caa5ab-59eb-4251-9cef-f8576154c443 (non-flash)
Nov 14 10:02:42 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 10:02:42 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bcc0936-e173-42a4-9a48-fa8e636ddd5c tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aebc438-0289-44fe-ad84-4e696468f50e (non-flash)
Nov 14 10:02:42 user nova-compute[75229]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:143891e8-62eb-42d7-b076-db6f52b4f606 (non-flash)
Nov 14 10:02:42 user nova-compute[75229]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2977635e-b11f-4ab2-875c-e9f396b932dc (non-flash)
Nov 14 10:02:42 user nova-compute[75229]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4a6dca6-1581-494f-afe5-3aac2b4d2c15 (non-flash)
Nov 14 10:02:42 user nova-compute[75229]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64caa5ab-59eb-4251-9cef-f8576154c443 (non-flash)
Nov 14 10:02:42 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 10:02:42 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-3bcc0936-e173-42a4-9a48-fa8e636ddd5c tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:64caa5ab-59eb-4251-9cef-f8576154c443" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.282s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 10:02:42 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bcc0936-e173-42a4-9a48-fa8e636ddd5c tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Connected to 172.16.0.220:3260 {{(pid=75229) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 10:02:42 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-3bcc0936-e173-42a4-9a48-fa8e636ddd5c tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] HCTL ('33', '-', '-', 0) found on session 42 with lun 0 {{(pid=75229) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 10:02:42 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-3bcc0936-e173-42a4-9a48-fa8e636ddd5c tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75229) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 10:02:42 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:02:43 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:02:43 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f043df3-50d7-4b2c-af86-9a78839297a2]: (4, ('- - 0', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:02:43 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-3bcc0936-e173-42a4-9a48-fa8e636ddd5c tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Searching for a device in session 42 and hctl ['33', '*', '*', 0] yield: None {{(pid=75229) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 10:02:43 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:02:44 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-3bcc0936-e173-42a4-9a48-fa8e636ddd5c tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Searching for a device in session 42 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75229) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 10:02:44 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bcc0936-e173-42a4-9a48-fa8e636ddd5c tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:64caa5ab-59eb-4251-9cef-f8576154c443', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zNJrebdA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75229) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 10:02:44 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-3bcc0936-e173-42a4-9a48-fa8e636ddd5c tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.312s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 10:02:44 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bcc0936-e173-42a4-9a48-fa8e636ddd5c tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] <== connect_volume: return (1314ms) {'type': 'block', 'scsi_wwn': '26431306631653561', 'path': '/dev/sdb'} {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 10:02:44 user nova-compute[75229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3bcc0936-e173-42a4-9a48-fa8e636ddd5c tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] [instance: c3f1afd9-958f-4942-b341-6e1f46a0c831] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26431306631653561', 'path': '/dev/sdb'} {{(pid=75229) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 10:02:44 user nova-compute[75229]: DEBUG nova.virt.libvirt.vif [None req-3bcc0936-e173-42a4-9a48-fa8e636ddd5c tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T10:02:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-194967460',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-194967460',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-194967460',id=42,image_ref='a73bae01-636f-4ff9-a077-79b25dfed578',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKGquYHi5GjDfDS0FaMvWSyQa01T6gskJkOB7tYQYZYh94+Gr0NIT1untrqUqWJZjoQhvO/MeVpvdz5vs/YzGL46c7c0IIBCM8UgQMVAflkGdZjVdtI4ZF5hjz0STmriUw==',key_name='tempest-keypair-1097653983',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='46620ac128944703899f22fe5439ba26',ramdisk_id='',reservation_id='r-aokjmo5a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-2064993142',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-2064993142-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2064993142',owner_user_name='tempest-TestVolumeBootPattern-2064993142-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T10:02:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c26f33e4cdf14ba796445959953f8685',uuid=c3f1afd9-958f-4942-b341-6e1f46a0c831,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d97c0909-9495-4af2-add5-bd9a848dd755", "address": "fa:16:3e:6f:4e:f9", "network": {"id": "118ea7c1-77c0-4660-b7b7-f311f6b0ec8a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1907578504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46620ac128944703899f22fe5439ba26", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd97c0909-94", "ovs_interfaceid": "d97c0909-9495-4af2-add5-bd9a848dd755", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75229) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 10:02:44 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-3bcc0936-e173-42a4-9a48-fa8e636ddd5c tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Converting VIF {"id": "d97c0909-9495-4af2-add5-bd9a848dd755", "address": "fa:16:3e:6f:4e:f9", "network": {"id": "118ea7c1-77c0-4660-b7b7-f311f6b0ec8a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1907578504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46620ac128944703899f22fe5439ba26", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd97c0909-94", "ovs_interfaceid": "d97c0909-9495-4af2-add5-bd9a848dd755", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 10:02:44 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-3bcc0936-e173-42a4-9a48-fa8e636ddd5c tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6f:4e:f9,bridge_name='br-int',has_traffic_filtering=True,id=d97c0909-9495-4af2-add5-bd9a848dd755,network=Network(118ea7c1-77c0-4660-b7b7-f311f6b0ec8a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd97c0909-94') {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 10:02:44 user nova-compute[75229]: DEBUG nova.objects.instance [None req-3bcc0936-e173-42a4-9a48-fa8e636ddd5c tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Lazy-loading 'pci_devices' on Instance uuid c3f1afd9-958f-4942-b341-6e1f46a0c831 {{(pid=75229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 10:02:44 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-3bcc0936-e173-42a4-9a48-fa8e636ddd5c tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] [instance: c3f1afd9-958f-4942-b341-6e1f46a0c831] End _get_guest_xml xml=<domain type="kvm">
Nov 14 10:02:44 user nova-compute[75229]:   <uuid>c3f1afd9-958f-4942-b341-6e1f46a0c831</uuid>
Nov 14 10:02:44 user nova-compute[75229]:   <name>instance-0000002a</name>
Nov 14 10:02:44 user nova-compute[75229]:   <memory>524288</memory>
Nov 14 10:02:44 user nova-compute[75229]:   <vcpu>1</vcpu>
Nov 14 10:02:44 user nova-compute[75229]:   <metadata>
Nov 14 10:02:44 user nova-compute[75229]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 10:02:44 user nova-compute[75229]:       <nova:package version="0.0.0"/>
Nov 14 10:02:44 user nova-compute[75229]:       <nova:name>tempest-TestVolumeBootPattern-image-snapshot-server-194967460</nova:name>
Nov 14 10:02:44 user nova-compute[75229]:       <nova:creationTime>2023-11-14 10:02:42</nova:creationTime>
Nov 14 10:02:44 user nova-compute[75229]:       <nova:flavor name="m1.tiny">
Nov 14 10:02:44 user nova-compute[75229]:         <nova:memory>512</nova:memory>
Nov 14 10:02:44 user nova-compute[75229]:         <nova:disk>1</nova:disk>
Nov 14 10:02:44 user nova-compute[75229]:         <nova:swap>0</nova:swap>
Nov 14 10:02:44 user nova-compute[75229]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 10:02:44 user nova-compute[75229]:         <nova:vcpus>1</nova:vcpus>
Nov 14 10:02:44 user nova-compute[75229]:       </nova:flavor>
Nov 14 10:02:44 user nova-compute[75229]:       <nova:owner>
Nov 14 10:02:44 user nova-compute[75229]:         <nova:user uuid="c26f33e4cdf14ba796445959953f8685">tempest-TestVolumeBootPattern-2064993142-project-member</nova:user>
Nov 14 10:02:44 user nova-compute[75229]:         <nova:project uuid="46620ac128944703899f22fe5439ba26">tempest-TestVolumeBootPattern-2064993142</nova:project>
Nov 14 10:02:44 user nova-compute[75229]:       </nova:owner>
Nov 14 10:02:44 user nova-compute[75229]:       <nova:root type="image" uuid="a73bae01-636f-4ff9-a077-79b25dfed578"/>
Nov 14 10:02:44 user nova-compute[75229]:       <nova:ports>
Nov 14 10:02:44 user nova-compute[75229]:         <nova:port uuid="d97c0909-9495-4af2-add5-bd9a848dd755">
Nov 14 10:02:44 user nova-compute[75229]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 14 10:02:44 user nova-compute[75229]:         </nova:port>
Nov 14 10:02:44 user nova-compute[75229]:       </nova:ports>
Nov 14 10:02:44 user nova-compute[75229]:     </nova:instance>
Nov 14 10:02:44 user nova-compute[75229]:   </metadata>
Nov 14 10:02:44 user nova-compute[75229]:   <sysinfo type="smbios">
Nov 14 10:02:44 user nova-compute[75229]:     <system>
Nov 14 10:02:44 user nova-compute[75229]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 10:02:44 user nova-compute[75229]:       <entry name="product">OpenStack Nova</entry>
Nov 14 10:02:44 user nova-compute[75229]:       <entry name="version">0.0.0</entry>
Nov 14 10:02:44 user nova-compute[75229]:       <entry name="serial">c3f1afd9-958f-4942-b341-6e1f46a0c831</entry>
Nov 14 10:02:44 user nova-compute[75229]:       <entry name="uuid">c3f1afd9-958f-4942-b341-6e1f46a0c831</entry>
Nov 14 10:02:44 user nova-compute[75229]:       <entry name="family">Virtual Machine</entry>
Nov 14 10:02:44 user nova-compute[75229]:     </system>
Nov 14 10:02:44 user nova-compute[75229]:   </sysinfo>
Nov 14 10:02:44 user nova-compute[75229]:   <os>
Nov 14 10:02:44 user nova-compute[75229]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 10:02:44 user nova-compute[75229]:     <boot dev="hd"/>
Nov 14 10:02:44 user nova-compute[75229]:     <smbios mode="sysinfo"/>
Nov 14 10:02:44 user nova-compute[75229]:   </os>
Nov 14 10:02:44 user nova-compute[75229]:   <features>
Nov 14 10:02:44 user nova-compute[75229]:     <acpi/>
Nov 14 10:02:44 user nova-compute[75229]:     <apic/>
Nov 14 10:02:44 user nova-compute[75229]:     <vmcoreinfo/>
Nov 14 10:02:44 user nova-compute[75229]:   </features>
Nov 14 10:02:44 user nova-compute[75229]:   <clock offset="utc">
Nov 14 10:02:44 user nova-compute[75229]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 10:02:44 user nova-compute[75229]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 10:02:44 user nova-compute[75229]:     <timer name="hpet" present="no"/>
Nov 14 10:02:44 user nova-compute[75229]:   </clock>
Nov 14 10:02:44 user nova-compute[75229]:   <cpu mode="custom" match="exact">
Nov 14 10:02:44 user nova-compute[75229]:     <model>Nehalem</model>
Nov 14 10:02:44 user nova-compute[75229]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 10:02:44 user nova-compute[75229]:   </cpu>
Nov 14 10:02:44 user nova-compute[75229]:   <devices>
Nov 14 10:02:44 user nova-compute[75229]:     <disk type="block" device="disk">
Nov 14 10:02:44 user nova-compute[75229]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 10:02:44 user nova-compute[75229]:       <source dev="/dev/sdb"/>
Nov 14 10:02:44 user nova-compute[75229]:       <target dev="vda" bus="virtio"/>
Nov 14 10:02:44 user nova-compute[75229]:       <serial>64caa5ab-59eb-4251-9cef-f8576154c443</serial>
Nov 14 10:02:44 user nova-compute[75229]:     </disk>
Nov 14 10:02:44 user nova-compute[75229]:     <interface type="ethernet">
Nov 14 10:02:44 user nova-compute[75229]:       <mac address="fa:16:3e:6f:4e:f9"/>
Nov 14 10:02:44 user nova-compute[75229]:       <model type="virtio"/>
Nov 14 10:02:44 user nova-compute[75229]:       <mtu size="1442"/>
Nov 14 10:02:44 user nova-compute[75229]:       <target dev="tapd97c0909-94"/>
Nov 14 10:02:44 user nova-compute[75229]:     </interface>
Nov 14 10:02:44 user nova-compute[75229]:     <serial type="pty">
Nov 14 10:02:44 user nova-compute[75229]:       <log file="/opt/stack/data/nova/instances/c3f1afd9-958f-4942-b341-6e1f46a0c831/console.log" append="off"/>
Nov 14 10:02:44 user nova-compute[75229]:     </serial>
Nov 14 10:02:44 user nova-compute[75229]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 10:02:44 user nova-compute[75229]:     <video>
Nov 14 10:02:44 user nova-compute[75229]:       <model type="virtio"/>
Nov 14 10:02:44 user nova-compute[75229]:     </video>
Nov 14 10:02:44 user nova-compute[75229]:     <rng model="virtio">
Nov 14 10:02:44 user nova-compute[75229]:       <backend model="random">/dev/urandom</backend>
Nov 14 10:02:44 user nova-compute[75229]:     </rng>
Nov 14 10:02:44 user nova-compute[75229]:     <controller type="usb" index="0" model="none"/>
Nov 14 10:02:44 user nova-compute[75229]:     <memballoon model="virtio">
Nov 14 10:02:44 user nova-compute[75229]:       <stats period="10"/>
Nov 14 10:02:44 user nova-compute[75229]:     </memballoon>
Nov 14 10:02:44 user nova-compute[75229]:   </devices>
Nov 14 10:02:44 user nova-compute[75229]: </domain>
Nov 14 10:02:44 user nova-compute[75229]:  {{(pid=75229) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 10:02:44 user nova-compute[75229]: DEBUG nova.virt.libvirt.vif [None req-3bcc0936-e173-42a4-9a48-fa8e636ddd5c tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T10:02:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-194967460',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-194967460',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-194967460',id=42,image_ref='a73bae01-636f-4ff9-a077-79b25dfed578',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKGquYHi5GjDfDS0FaMvWSyQa01T6gskJkOB7tYQYZYh94+Gr0NIT1untrqUqWJZjoQhvO/MeVpvdz5vs/YzGL46c7c0IIBCM8UgQMVAflkGdZjVdtI4ZF5hjz0STmriUw==',key_name='tempest-keypair-1097653983',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='46620ac128944703899f22fe5439ba26',ramdisk_id='',reservation_id='r-aokjmo5a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-2064993142',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-2064993142-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2064993142',owner_user_name='tempest-TestVolumeBootPattern-2064993142-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T10:02:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c26f33e4cdf14ba796445959953f8685',uuid=c3f1afd9-958f-4942-b341-6e1f46a0c831,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d97c0909-9495-4af2-add5-bd9a848dd755", "address": "fa:16:3e:6f:4e:f9", "network": {"id": "118ea7c1-77c0-4660-b7b7-f311f6b0ec8a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1907578504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46620ac128944703899f22fe5439ba26", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd97c0909-94", "ovs_interfaceid": "d97c0909-9495-4af2-add5-bd9a848dd755", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 10:02:44 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-3bcc0936-e173-42a4-9a48-fa8e636ddd5c tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Converting VIF {"id": "d97c0909-9495-4af2-add5-bd9a848dd755", "address": "fa:16:3e:6f:4e:f9", "network": {"id": "118ea7c1-77c0-4660-b7b7-f311f6b0ec8a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1907578504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46620ac128944703899f22fe5439ba26", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd97c0909-94", "ovs_interfaceid": "d97c0909-9495-4af2-add5-bd9a848dd755", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 10:02:44 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-3bcc0936-e173-42a4-9a48-fa8e636ddd5c tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6f:4e:f9,bridge_name='br-int',has_traffic_filtering=True,id=d97c0909-9495-4af2-add5-bd9a848dd755,network=Network(118ea7c1-77c0-4660-b7b7-f311f6b0ec8a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd97c0909-94') {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 10:02:44 user nova-compute[75229]: DEBUG os_vif [None req-3bcc0936-e173-42a4-9a48-fa8e636ddd5c tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6f:4e:f9,bridge_name='br-int',has_traffic_filtering=True,id=d97c0909-9495-4af2-add5-bd9a848dd755,network=Network(118ea7c1-77c0-4660-b7b7-f311f6b0ec8a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd97c0909-94') {{(pid=75229) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 10:02:44 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:02:44 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 10:02:44 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 10:02:44 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:02:44 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ff8f3d47-929f-5edb-808d-3f79eb74ab80', '_type': 'linux-noop'}}, row=False) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 10:02:44 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:02:44 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:02:44 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:02:44 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd97c0909-94, may_exist=True, interface_attrs={}) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 10:02:44 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd97c0909-94, col_values=(('qos', UUID('d0d5d535-8c42-4cf9-a01a-2aac14cc423e')),), if_exists=True) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 10:02:44 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd97c0909-94, col_values=(('external_ids', {'iface-id': 'd97c0909-9495-4af2-add5-bd9a848dd755', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6f:4e:f9', 'vm-uuid': 'c3f1afd9-958f-4942-b341-6e1f46a0c831'}),), if_exists=True) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 10:02:44 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:02:44 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 10:02:44 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:02:44 user nova-compute[75229]: INFO os_vif [None req-3bcc0936-e173-42a4-9a48-fa8e636ddd5c tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6f:4e:f9,bridge_name='br-int',has_traffic_filtering=True,id=d97c0909-9495-4af2-add5-bd9a848dd755,network=Network(118ea7c1-77c0-4660-b7b7-f311f6b0ec8a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd97c0909-94')
Nov 14 10:02:44 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-3bcc0936-e173-42a4-9a48-fa8e636ddd5c tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] No BDM found with device name vda, not building metadata. {{(pid=75229) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 10:02:44 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-3bcc0936-e173-42a4-9a48-fa8e636ddd5c tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] No VIF found with MAC fa:16:3e:6f:4e:f9, not building metadata {{(pid=75229) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 10:02:45 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:02:45 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:02:45 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:02:45 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:02:45 user nova-compute[75229]: DEBUG nova.compute.manager [req-48be7875-5bfd-45fa-8e18-3410a2df5bec req-83539010-1d22-45b2-afb9-d279f816f042 service nova] [instance: c3f1afd9-958f-4942-b341-6e1f46a0c831] Received event network-vif-plugged-d97c0909-9495-4af2-add5-bd9a848dd755 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 10:02:45 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-48be7875-5bfd-45fa-8e18-3410a2df5bec req-83539010-1d22-45b2-afb9-d279f816f042 service nova] Acquiring lock "c3f1afd9-958f-4942-b341-6e1f46a0c831-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:02:45 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-48be7875-5bfd-45fa-8e18-3410a2df5bec req-83539010-1d22-45b2-afb9-d279f816f042 service nova] Lock "c3f1afd9-958f-4942-b341-6e1f46a0c831-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:02:45 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-48be7875-5bfd-45fa-8e18-3410a2df5bec req-83539010-1d22-45b2-afb9-d279f816f042 service nova] Lock "c3f1afd9-958f-4942-b341-6e1f46a0c831-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:02:45 user nova-compute[75229]: DEBUG nova.compute.manager [req-48be7875-5bfd-45fa-8e18-3410a2df5bec req-83539010-1d22-45b2-afb9-d279f816f042 service nova] [instance: c3f1afd9-958f-4942-b341-6e1f46a0c831] No waiting events found dispatching network-vif-plugged-d97c0909-9495-4af2-add5-bd9a848dd755 {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 10:02:45 user nova-compute[75229]: WARNING nova.compute.manager [req-48be7875-5bfd-45fa-8e18-3410a2df5bec req-83539010-1d22-45b2-afb9-d279f816f042 service nova] [instance: c3f1afd9-958f-4942-b341-6e1f46a0c831] Received unexpected event network-vif-plugged-d97c0909-9495-4af2-add5-bd9a848dd755 for instance with vm_state building and task_state spawning.
Nov 14 10:02:45 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:02:45 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:02:47 user nova-compute[75229]: DEBUG nova.compute.manager [None req-3bcc0936-e173-42a4-9a48-fa8e636ddd5c tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] [instance: c3f1afd9-958f-4942-b341-6e1f46a0c831] Instance event wait completed in 0 seconds for  {{(pid=75229) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 10:02:47 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-3bcc0936-e173-42a4-9a48-fa8e636ddd5c tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] [instance: c3f1afd9-958f-4942-b341-6e1f46a0c831] Guest created on hypervisor {{(pid=75229) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 10:02:47 user nova-compute[75229]: INFO nova.virt.libvirt.driver [-] [instance: c3f1afd9-958f-4942-b341-6e1f46a0c831] Instance spawned successfully.
Nov 14 10:02:47 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-3bcc0936-e173-42a4-9a48-fa8e636ddd5c tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] [instance: c3f1afd9-958f-4942-b341-6e1f46a0c831] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 10:02:47 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-3bcc0936-e173-42a4-9a48-fa8e636ddd5c tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] [instance: c3f1afd9-958f-4942-b341-6e1f46a0c831] Found default for hw_input_bus of None {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 10:02:47 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-3bcc0936-e173-42a4-9a48-fa8e636ddd5c tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] [instance: c3f1afd9-958f-4942-b341-6e1f46a0c831] Found default for hw_pointer_model of None {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 10:02:47 user nova-compute[75229]: INFO nova.compute.manager [None req-3bcc0936-e173-42a4-9a48-fa8e636ddd5c tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] [instance: c3f1afd9-958f-4942-b341-6e1f46a0c831] Took 4.94 seconds to spawn the instance on the hypervisor.
Nov 14 10:02:47 user nova-compute[75229]: DEBUG nova.compute.manager [None req-3bcc0936-e173-42a4-9a48-fa8e636ddd5c tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] [instance: c3f1afd9-958f-4942-b341-6e1f46a0c831] Checking state {{(pid=75229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 10:02:47 user nova-compute[75229]: DEBUG nova.compute.manager [req-3fc5dde6-d2d0-484b-b7af-d9fcca4ef7ac req-dc2a5195-c824-44fc-baf3-2c831fcbd26b service nova] [instance: c3f1afd9-958f-4942-b341-6e1f46a0c831] Received event network-vif-plugged-d97c0909-9495-4af2-add5-bd9a848dd755 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 10:02:47 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-3fc5dde6-d2d0-484b-b7af-d9fcca4ef7ac req-dc2a5195-c824-44fc-baf3-2c831fcbd26b service nova] Acquiring lock "c3f1afd9-958f-4942-b341-6e1f46a0c831-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:02:47 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-3fc5dde6-d2d0-484b-b7af-d9fcca4ef7ac req-dc2a5195-c824-44fc-baf3-2c831fcbd26b service nova] Lock "c3f1afd9-958f-4942-b341-6e1f46a0c831-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:02:47 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-3fc5dde6-d2d0-484b-b7af-d9fcca4ef7ac req-dc2a5195-c824-44fc-baf3-2c831fcbd26b service nova] Lock "c3f1afd9-958f-4942-b341-6e1f46a0c831-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:02:47 user nova-compute[75229]: DEBUG nova.compute.manager [req-3fc5dde6-d2d0-484b-b7af-d9fcca4ef7ac req-dc2a5195-c824-44fc-baf3-2c831fcbd26b service nova] [instance: c3f1afd9-958f-4942-b341-6e1f46a0c831] No waiting events found dispatching network-vif-plugged-d97c0909-9495-4af2-add5-bd9a848dd755 {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 10:02:47 user nova-compute[75229]: WARNING nova.compute.manager [req-3fc5dde6-d2d0-484b-b7af-d9fcca4ef7ac req-dc2a5195-c824-44fc-baf3-2c831fcbd26b service nova] [instance: c3f1afd9-958f-4942-b341-6e1f46a0c831] Received unexpected event network-vif-plugged-d97c0909-9495-4af2-add5-bd9a848dd755 for instance with vm_state building and task_state spawning.
Nov 14 10:02:47 user nova-compute[75229]: INFO nova.compute.manager [None req-3bcc0936-e173-42a4-9a48-fa8e636ddd5c tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] [instance: c3f1afd9-958f-4942-b341-6e1f46a0c831] Took 16.63 seconds to build instance.
Nov 14 10:02:47 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-3bcc0936-e173-42a4-9a48-fa8e636ddd5c tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Lock "c3f1afd9-958f-4942-b341-6e1f46a0c831" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.831s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:02:48 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:02:49 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:02:50 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-1f451785-1a6e-4905-a789-eb17e74809cb tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Acquiring lock "a7750cbc-b3d0-44aa-8b88-c291ba007a8a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:02:50 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-1f451785-1a6e-4905-a789-eb17e74809cb tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Lock "a7750cbc-b3d0-44aa-8b88-c291ba007a8a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:02:50 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-1f451785-1a6e-4905-a789-eb17e74809cb tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Acquiring lock "a7750cbc-b3d0-44aa-8b88-c291ba007a8a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:02:50 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-1f451785-1a6e-4905-a789-eb17e74809cb tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Lock "a7750cbc-b3d0-44aa-8b88-c291ba007a8a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:02:50 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-1f451785-1a6e-4905-a789-eb17e74809cb tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Lock "a7750cbc-b3d0-44aa-8b88-c291ba007a8a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:02:50 user nova-compute[75229]: INFO nova.compute.manager [None req-1f451785-1a6e-4905-a789-eb17e74809cb tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] [instance: a7750cbc-b3d0-44aa-8b88-c291ba007a8a] Terminating instance
Nov 14 10:02:50 user nova-compute[75229]: DEBUG nova.compute.manager [None req-1f451785-1a6e-4905-a789-eb17e74809cb tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] [instance: a7750cbc-b3d0-44aa-8b88-c291ba007a8a] Start destroying the instance on the hypervisor. {{(pid=75229) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 10:02:50 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:02:50 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:02:50 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:02:50 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:02:50 user nova-compute[75229]: DEBUG nova.compute.manager [req-2e0a5233-ad3b-4252-94f2-83a9c1a945a1 req-6d07c6c2-ab6e-4647-a0c7-1f05c957daa0 service nova] [instance: a7750cbc-b3d0-44aa-8b88-c291ba007a8a] Received event network-vif-unplugged-e5b20e94-618c-4c51-b20f-1d3f1fb921b6 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 10:02:50 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-2e0a5233-ad3b-4252-94f2-83a9c1a945a1 req-6d07c6c2-ab6e-4647-a0c7-1f05c957daa0 service nova] Acquiring lock "a7750cbc-b3d0-44aa-8b88-c291ba007a8a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:02:50 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-2e0a5233-ad3b-4252-94f2-83a9c1a945a1 req-6d07c6c2-ab6e-4647-a0c7-1f05c957daa0 service nova] Lock "a7750cbc-b3d0-44aa-8b88-c291ba007a8a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:02:50 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-2e0a5233-ad3b-4252-94f2-83a9c1a945a1 req-6d07c6c2-ab6e-4647-a0c7-1f05c957daa0 service nova] Lock "a7750cbc-b3d0-44aa-8b88-c291ba007a8a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:02:50 user nova-compute[75229]: DEBUG nova.compute.manager [req-2e0a5233-ad3b-4252-94f2-83a9c1a945a1 req-6d07c6c2-ab6e-4647-a0c7-1f05c957daa0 service nova] [instance: a7750cbc-b3d0-44aa-8b88-c291ba007a8a] No waiting events found dispatching network-vif-unplugged-e5b20e94-618c-4c51-b20f-1d3f1fb921b6 {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 10:02:50 user nova-compute[75229]: DEBUG nova.compute.manager [req-2e0a5233-ad3b-4252-94f2-83a9c1a945a1 req-6d07c6c2-ab6e-4647-a0c7-1f05c957daa0 service nova] [instance: a7750cbc-b3d0-44aa-8b88-c291ba007a8a] Received event network-vif-unplugged-e5b20e94-618c-4c51-b20f-1d3f1fb921b6 for instance with task_state deleting. {{(pid=75229) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 10:02:50 user nova-compute[75229]: INFO nova.virt.libvirt.driver [-] [instance: a7750cbc-b3d0-44aa-8b88-c291ba007a8a] Instance destroyed successfully.
Nov 14 10:02:50 user nova-compute[75229]: DEBUG nova.objects.instance [None req-1f451785-1a6e-4905-a789-eb17e74809cb tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Lazy-loading 'resources' on Instance uuid a7750cbc-b3d0-44aa-8b88-c291ba007a8a {{(pid=75229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 10:02:50 user nova-compute[75229]: DEBUG nova.virt.libvirt.vif [None req-1f451785-1a6e-4905-a789-eb17e74809cb tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T09:43:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1269545577',display_name='tempest-ServerActionsTestOtherA-server-1269545577',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1269545577',id=3,image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGYpQZFb1U6nMdMA0U7Y/y+mR6NDiU0zUt1gWS7fx0RnGUEMiKL0fCtTR70lVN1zodlPi6pkSulrGMUx3iNoziRzj8cN92z29zHcNE44hvJVgwbBcM00kPn071ndMRlk4g==',key_name='tempest-keypair-397181797',keypairs=<?>,launch_index=0,launched_at=2023-11-14T09:44:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='46e65cdd021f4a3db7c9254bb6d98b46',ramdisk_id='',reservation_id='r-q0n9455h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-280196295',owner_user_name='tempest-ServerActionsTestOtherA-280196295-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T09:44:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c0c381a0f6124f1ca6ce85c057b9143a',uuid=a7750cbc-b3d0-44aa-8b88-c291ba007a8a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e5b20e94-618c-4c51-b20f-1d3f1fb921b6", "address": "fa:16:3e:e5:e8:ed", "network": {"id": "5dfc532f-3d5d-4342-b7f1-12c9c3992a54", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1457278473-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46e65cdd021f4a3db7c9254bb6d98b46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5b20e94-61", "ovs_interfaceid": "e5b20e94-618c-4c51-b20f-1d3f1fb921b6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 10:02:50 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-1f451785-1a6e-4905-a789-eb17e74809cb tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Converting VIF {"id": "e5b20e94-618c-4c51-b20f-1d3f1fb921b6", "address": "fa:16:3e:e5:e8:ed", "network": {"id": "5dfc532f-3d5d-4342-b7f1-12c9c3992a54", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1457278473-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46e65cdd021f4a3db7c9254bb6d98b46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5b20e94-61", "ovs_interfaceid": "e5b20e94-618c-4c51-b20f-1d3f1fb921b6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 10:02:50 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-1f451785-1a6e-4905-a789-eb17e74809cb tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e5:e8:ed,bridge_name='br-int',has_traffic_filtering=True,id=e5b20e94-618c-4c51-b20f-1d3f1fb921b6,network=Network(5dfc532f-3d5d-4342-b7f1-12c9c3992a54),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape5b20e94-61') {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 10:02:50 user nova-compute[75229]: DEBUG os_vif [None req-1f451785-1a6e-4905-a789-eb17e74809cb tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e5:e8:ed,bridge_name='br-int',has_traffic_filtering=True,id=e5b20e94-618c-4c51-b20f-1d3f1fb921b6,network=Network(5dfc532f-3d5d-4342-b7f1-12c9c3992a54),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape5b20e94-61') {{(pid=75229) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 10:02:50 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:02:50 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape5b20e94-61, bridge=br-int, if_exists=True) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 10:02:50 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:02:50 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 10:02:50 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:02:50 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1abcb6a6-cdc8-4d08-a569-33e230f83adc) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 10:02:50 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:02:50 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 10:02:50 user nova-compute[75229]: INFO os_vif [None req-1f451785-1a6e-4905-a789-eb17e74809cb tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e5:e8:ed,bridge_name='br-int',has_traffic_filtering=True,id=e5b20e94-618c-4c51-b20f-1d3f1fb921b6,network=Network(5dfc532f-3d5d-4342-b7f1-12c9c3992a54),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape5b20e94-61')
Nov 14 10:02:50 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-1f451785-1a6e-4905-a789-eb17e74809cb tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] [instance: a7750cbc-b3d0-44aa-8b88-c291ba007a8a] Deleting instance files /opt/stack/data/nova/instances/a7750cbc-b3d0-44aa-8b88-c291ba007a8a_del
Nov 14 10:02:50 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-1f451785-1a6e-4905-a789-eb17e74809cb tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] [instance: a7750cbc-b3d0-44aa-8b88-c291ba007a8a] Deletion of /opt/stack/data/nova/instances/a7750cbc-b3d0-44aa-8b88-c291ba007a8a_del complete
Nov 14 10:02:50 user nova-compute[75229]: INFO nova.compute.manager [None req-1f451785-1a6e-4905-a789-eb17e74809cb tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] [instance: a7750cbc-b3d0-44aa-8b88-c291ba007a8a] Took 0.73 seconds to destroy the instance on the hypervisor.
Nov 14 10:02:50 user nova-compute[75229]: DEBUG oslo.service.loopingcall [None req-1f451785-1a6e-4905-a789-eb17e74809cb tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75229) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 10:02:50 user nova-compute[75229]: DEBUG nova.compute.manager [-] [instance: a7750cbc-b3d0-44aa-8b88-c291ba007a8a] Deallocating network for instance {{(pid=75229) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 10:02:50 user nova-compute[75229]: DEBUG nova.network.neutron [-] [instance: a7750cbc-b3d0-44aa-8b88-c291ba007a8a] deallocate_for_instance() {{(pid=75229) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 10:02:51 user nova-compute[75229]: DEBUG nova.network.neutron [-] [instance: a7750cbc-b3d0-44aa-8b88-c291ba007a8a] Updating instance_info_cache with network_info: [] {{(pid=75229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 10:02:51 user nova-compute[75229]: INFO nova.compute.manager [-] [instance: a7750cbc-b3d0-44aa-8b88-c291ba007a8a] Took 0.44 seconds to deallocate network for instance.
Nov 14 10:02:51 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-1f451785-1a6e-4905-a789-eb17e74809cb tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:02:51 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-1f451785-1a6e-4905-a789-eb17e74809cb tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:02:51 user nova-compute[75229]: DEBUG nova.compute.provider_tree [None req-1f451785-1a6e-4905-a789-eb17e74809cb tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Inventory has not changed in ProviderTree for provider: d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 {{(pid=75229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 10:02:51 user nova-compute[75229]: DEBUG nova.scheduler.client.report [None req-1f451785-1a6e-4905-a789-eb17e74809cb tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Inventory has not changed for provider d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 10:02:51 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-1f451785-1a6e-4905-a789-eb17e74809cb tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.531s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:02:51 user nova-compute[75229]: INFO nova.scheduler.client.report [None req-1f451785-1a6e-4905-a789-eb17e74809cb tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Deleted allocations for instance a7750cbc-b3d0-44aa-8b88-c291ba007a8a
Nov 14 10:02:52 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-1f451785-1a6e-4905-a789-eb17e74809cb tempest-ServerActionsTestOtherA-280196295 tempest-ServerActionsTestOtherA-280196295-project-member] Lock "a7750cbc-b3d0-44aa-8b88-c291ba007a8a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.906s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:02:52 user nova-compute[75229]: DEBUG nova.compute.manager [req-3b65de47-869b-42ce-92c2-546ebcb5928e req-b28a7261-72a8-4cd5-ba74-3b6ec3a9cc21 service nova] [instance: a7750cbc-b3d0-44aa-8b88-c291ba007a8a] Received event network-vif-plugged-e5b20e94-618c-4c51-b20f-1d3f1fb921b6 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 10:02:52 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-3b65de47-869b-42ce-92c2-546ebcb5928e req-b28a7261-72a8-4cd5-ba74-3b6ec3a9cc21 service nova] Acquiring lock "a7750cbc-b3d0-44aa-8b88-c291ba007a8a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:02:52 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-3b65de47-869b-42ce-92c2-546ebcb5928e req-b28a7261-72a8-4cd5-ba74-3b6ec3a9cc21 service nova] Lock "a7750cbc-b3d0-44aa-8b88-c291ba007a8a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:02:52 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-3b65de47-869b-42ce-92c2-546ebcb5928e req-b28a7261-72a8-4cd5-ba74-3b6ec3a9cc21 service nova] Lock "a7750cbc-b3d0-44aa-8b88-c291ba007a8a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:02:52 user nova-compute[75229]: DEBUG nova.compute.manager [req-3b65de47-869b-42ce-92c2-546ebcb5928e req-b28a7261-72a8-4cd5-ba74-3b6ec3a9cc21 service nova] [instance: a7750cbc-b3d0-44aa-8b88-c291ba007a8a] No waiting events found dispatching network-vif-plugged-e5b20e94-618c-4c51-b20f-1d3f1fb921b6 {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 10:02:52 user nova-compute[75229]: WARNING nova.compute.manager [req-3b65de47-869b-42ce-92c2-546ebcb5928e req-b28a7261-72a8-4cd5-ba74-3b6ec3a9cc21 service nova] [instance: a7750cbc-b3d0-44aa-8b88-c291ba007a8a] Received unexpected event network-vif-plugged-e5b20e94-618c-4c51-b20f-1d3f1fb921b6 for instance with vm_state deleted and task_state None.
Nov 14 10:02:52 user nova-compute[75229]: DEBUG nova.compute.manager [req-3b65de47-869b-42ce-92c2-546ebcb5928e req-b28a7261-72a8-4cd5-ba74-3b6ec3a9cc21 service nova] [instance: a7750cbc-b3d0-44aa-8b88-c291ba007a8a] Received event network-vif-deleted-e5b20e94-618c-4c51-b20f-1d3f1fb921b6 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 10:02:53 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:02:54 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:02:55 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:02:55 user nova-compute[75229]: DEBUG nova.compute.manager [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Starting heal instance info cache {{(pid=75229) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 10:02:55 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Acquiring lock "refresh_cache-30ae1f73-e0f3-4e26-987e-a684471a160d" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 10:02:55 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Acquired lock "refresh_cache-30ae1f73-e0f3-4e26-987e-a684471a160d" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 10:02:55 user nova-compute[75229]: DEBUG nova.network.neutron [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] [instance: 30ae1f73-e0f3-4e26-987e-a684471a160d] Forcefully refreshing network info cache for instance {{(pid=75229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 10:02:55 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:02:56 user nova-compute[75229]: DEBUG nova.network.neutron [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] [instance: 30ae1f73-e0f3-4e26-987e-a684471a160d] Updating instance_info_cache with network_info: [{"id": "c087c657-8eee-4e8e-bef1-4281129597ae", "address": "fa:16:3e:aa:d3:e3", "network": {"id": "6a700b61-4aa6-440b-87e6-a3525a5cb918", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-448680331-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8babb73006da4977a1fe2bdb35e08d8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc087c657-8e", "ovs_interfaceid": "c087c657-8eee-4e8e-bef1-4281129597ae", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 10:02:56 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Releasing lock "refresh_cache-30ae1f73-e0f3-4e26-987e-a684471a160d" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 10:02:56 user nova-compute[75229]: DEBUG nova.compute.manager [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] [instance: 30ae1f73-e0f3-4e26-987e-a684471a160d] Updated the network info_cache for instance {{(pid=75229) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 10:02:58 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:02:59 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:02:59 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:03:00 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:03:01 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:03:01 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:03:01 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:03:01 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:03:01 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Auditing locally available compute resources for user (node: user) {{(pid=75229) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 10:03:01 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75229) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 10:03:01 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cda8c5ad-e70c-4021-bace-d55831c4bc78/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:03:02 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cda8c5ad-e70c-4021-bace-d55831c4bc78/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:03:02 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cda8c5ad-e70c-4021-bace-d55831c4bc78/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:03:02 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cda8c5ad-e70c-4021-bace-d55831c4bc78/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:03:02 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1679275-ebb1-4f15-80a4-b8fd614fc34b/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:03:02 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1679275-ebb1-4f15-80a4-b8fd614fc34b/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:03:02 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1679275-ebb1-4f15-80a4-b8fd614fc34b/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:03:02 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1679275-ebb1-4f15-80a4-b8fd614fc34b/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:03:02 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75229) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 10:03:02 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c9fe69e-3f9d-4b30-a9e4-efc3e83efa17/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:03:02 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c9fe69e-3f9d-4b30-a9e4-efc3e83efa17/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:03:02 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c9fe69e-3f9d-4b30-a9e4-efc3e83efa17/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:03:03 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c9fe69e-3f9d-4b30-a9e4-efc3e83efa17/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:03:03 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7469b999-196b-41c7-9d30-f810b74eaa99/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:03:03 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7469b999-196b-41c7-9d30-f810b74eaa99/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:03:03 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7469b999-196b-41c7-9d30-f810b74eaa99/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:03:03 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7469b999-196b-41c7-9d30-f810b74eaa99/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:03:03 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75229) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 10:03:03 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75229) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 10:03:03 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abb8e340-164d-4bc2-a503-7e8ea3c9b35b/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:03:03 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abb8e340-164d-4bc2-a503-7e8ea3c9b35b/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:03:03 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abb8e340-164d-4bc2-a503-7e8ea3c9b35b/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:03:03 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abb8e340-164d-4bc2-a503-7e8ea3c9b35b/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:03:03 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=75229) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 10:03:03 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5170e9e-66e3-4df1-9807-4958cac6480e/disk.rescue --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:03:03 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:03:03 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5170e9e-66e3-4df1-9807-4958cac6480e/disk.rescue --force-share --output=json" returned: 0 in 0.182s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:03:03 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5170e9e-66e3-4df1-9807-4958cac6480e/disk.rescue --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:03:04 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5170e9e-66e3-4df1-9807-4958cac6480e/disk.rescue --force-share --output=json" returned: 0 in 0.167s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:03:04 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5170e9e-66e3-4df1-9807-4958cac6480e/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:03:04 user nova-compute[75229]: DEBUG nova.compute.manager [req-29db1bfa-d8d4-48db-a904-e1c083e3e71d req-572b6b90-4858-4127-9ed1-b436d9b13385 service nova] [instance: abb8e340-164d-4bc2-a503-7e8ea3c9b35b] Received event network-changed-37ce4717-9a82-41c6-9d89-f1e55b9ae398 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 10:03:04 user nova-compute[75229]: DEBUG nova.compute.manager [req-29db1bfa-d8d4-48db-a904-e1c083e3e71d req-572b6b90-4858-4127-9ed1-b436d9b13385 service nova] [instance: abb8e340-164d-4bc2-a503-7e8ea3c9b35b] Refreshing instance network info cache due to event network-changed-37ce4717-9a82-41c6-9d89-f1e55b9ae398. {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 10:03:04 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-29db1bfa-d8d4-48db-a904-e1c083e3e71d req-572b6b90-4858-4127-9ed1-b436d9b13385 service nova] Acquiring lock "refresh_cache-abb8e340-164d-4bc2-a503-7e8ea3c9b35b" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 10:03:04 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-29db1bfa-d8d4-48db-a904-e1c083e3e71d req-572b6b90-4858-4127-9ed1-b436d9b13385 service nova] Acquired lock "refresh_cache-abb8e340-164d-4bc2-a503-7e8ea3c9b35b" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 10:03:04 user nova-compute[75229]: DEBUG nova.network.neutron [req-29db1bfa-d8d4-48db-a904-e1c083e3e71d req-572b6b90-4858-4127-9ed1-b436d9b13385 service nova] [instance: abb8e340-164d-4bc2-a503-7e8ea3c9b35b] Refreshing network info cache for port 37ce4717-9a82-41c6-9d89-f1e55b9ae398 {{(pid=75229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 10:03:04 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5170e9e-66e3-4df1-9807-4958cac6480e/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:03:04 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5170e9e-66e3-4df1-9807-4958cac6480e/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:03:04 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5170e9e-66e3-4df1-9807-4958cac6480e/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:03:04 user nova-compute[75229]: WARNING nova.virt.libvirt.driver [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 10:03:04 user nova-compute[75229]: WARNING nova.virt.libvirt.driver [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 10:03:04 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Hypervisor/Node resource view: name=user free_ram=7726MB free_disk=25.064693450927734GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75229) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 10:03:04 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:03:04 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:03:04 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-4058143c-202a-41ab-a4a4-0cb44deb3768 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Acquiring lock "abb8e340-164d-4bc2-a503-7e8ea3c9b35b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:03:04 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-4058143c-202a-41ab-a4a4-0cb44deb3768 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Lock "abb8e340-164d-4bc2-a503-7e8ea3c9b35b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:03:04 user nova-compute[75229]: INFO nova.compute.manager [None req-4058143c-202a-41ab-a4a4-0cb44deb3768 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] [instance: abb8e340-164d-4bc2-a503-7e8ea3c9b35b] Detaching volume 143891e8-62eb-42d7-b076-db6f52b4f606
Nov 14 10:03:05 user nova-compute[75229]: INFO nova.virt.block_device [None req-4058143c-202a-41ab-a4a4-0cb44deb3768 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] [instance: abb8e340-164d-4bc2-a503-7e8ea3c9b35b] Attempting to driver detach volume 143891e8-62eb-42d7-b076-db6f52b4f606 from mountpoint /dev/vdb
Nov 14 10:03:05 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-4058143c-202a-41ab-a4a4-0cb44deb3768 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Attempting to detach device vdb from instance abb8e340-164d-4bc2-a503-7e8ea3c9b35b from the persistent domain config. {{(pid=75229) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 10:03:05 user nova-compute[75229]: DEBUG nova.virt.libvirt.guest [None req-4058143c-202a-41ab-a4a4-0cb44deb3768 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 10:03:05 user nova-compute[75229]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 10:03:05 user nova-compute[75229]:   <source dev="/dev/sdf"/>
Nov 14 10:03:05 user nova-compute[75229]:   <target dev="vdb" bus="virtio"/>
Nov 14 10:03:05 user nova-compute[75229]:   <serial>143891e8-62eb-42d7-b076-db6f52b4f606</serial>
Nov 14 10:03:05 user nova-compute[75229]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 10:03:05 user nova-compute[75229]: </disk>
Nov 14 10:03:05 user nova-compute[75229]:  {{(pid=75229) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 10:03:05 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-4058143c-202a-41ab-a4a4-0cb44deb3768 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Successfully detached device vdb from instance abb8e340-164d-4bc2-a503-7e8ea3c9b35b from the persistent domain config.
Nov 14 10:03:05 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-4058143c-202a-41ab-a4a4-0cb44deb3768 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance abb8e340-164d-4bc2-a503-7e8ea3c9b35b from the live domain config. {{(pid=75229) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 10:03:05 user nova-compute[75229]: DEBUG nova.virt.libvirt.guest [None req-4058143c-202a-41ab-a4a4-0cb44deb3768 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 10:03:05 user nova-compute[75229]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 10:03:05 user nova-compute[75229]:   <source dev="/dev/sdf"/>
Nov 14 10:03:05 user nova-compute[75229]:   <target dev="vdb" bus="virtio"/>
Nov 14 10:03:05 user nova-compute[75229]:   <serial>143891e8-62eb-42d7-b076-db6f52b4f606</serial>
Nov 14 10:03:05 user nova-compute[75229]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 10:03:05 user nova-compute[75229]: </disk>
Nov 14 10:03:05 user nova-compute[75229]:  {{(pid=75229) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 10:03:05 user nova-compute[75229]: DEBUG nova.network.neutron [req-29db1bfa-d8d4-48db-a904-e1c083e3e71d req-572b6b90-4858-4127-9ed1-b436d9b13385 service nova] [instance: abb8e340-164d-4bc2-a503-7e8ea3c9b35b] Updated VIF entry in instance network info cache for port 37ce4717-9a82-41c6-9d89-f1e55b9ae398. {{(pid=75229) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 10:03:05 user nova-compute[75229]: DEBUG nova.network.neutron [req-29db1bfa-d8d4-48db-a904-e1c083e3e71d req-572b6b90-4858-4127-9ed1-b436d9b13385 service nova] [instance: abb8e340-164d-4bc2-a503-7e8ea3c9b35b] Updating instance_info_cache with network_info: [{"id": "37ce4717-9a82-41c6-9d89-f1e55b9ae398", "address": "fa:16:3e:92:c4:4b", "network": {"id": "22eed29e-7148-42f9-b4c7-b97811cba8eb", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2000485731-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.13", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46457b27e3ed416e827c3c22449fb512", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37ce4717-9a", "ovs_interfaceid": "37ce4717-9a82-41c6-9d89-f1e55b9ae398", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 10:03:05 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Instance 4c9fe69e-3f9d-4b30-a9e4-efc3e83efa17 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 10:03:05 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Instance b5170e9e-66e3-4df1-9807-4958cac6480e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 10:03:05 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Instance cda8c5ad-e70c-4021-bace-d55831c4bc78 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 10:03:05 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Instance 30ae1f73-e0f3-4e26-987e-a684471a160d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 10:03:05 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Instance abb8e340-164d-4bc2-a503-7e8ea3c9b35b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 10:03:05 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Instance d822d5e4-38d8-4ca7-a682-f2f2144b6005 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 10:03:05 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Instance abe7e145-d3bc-49a1-83be-793488de828b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 10:03:05 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Instance 7469b999-196b-41c7-9d30-f810b74eaa99 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 10:03:05 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Instance c1679275-ebb1-4f15-80a4-b8fd614fc34b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 10:03:05 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Instance c3f1afd9-958f-4942-b341-6e1f46a0c831 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 10:03:05 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75229) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 10:03:05 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75229) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 10:03:05 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-29db1bfa-d8d4-48db-a904-e1c083e3e71d req-572b6b90-4858-4127-9ed1-b436d9b13385 service nova] Releasing lock "refresh_cache-abb8e340-164d-4bc2-a503-7e8ea3c9b35b" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 10:03:05 user nova-compute[75229]: DEBUG nova.compute.provider_tree [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Inventory has not changed in ProviderTree for provider: d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 {{(pid=75229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 10:03:05 user nova-compute[75229]: DEBUG nova.scheduler.client.report [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Inventory has not changed for provider d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 10:03:05 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Compute_service record updated for user:user {{(pid=75229) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 10:03:05 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.504s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:03:05 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-4058143c-202a-41ab-a4a4-0cb44deb3768 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance abb8e340-164d-4bc2-a503-7e8ea3c9b35b {{(pid=75229) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 10:03:05 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:03:06 user nova-compute[75229]: DEBUG nova.compute.manager [req-fc44ad6b-df2f-4de7-8e4a-0308182b812f req-473a5b57-409b-49fc-942c-9218ae5e1f05 service nova] [instance: abb8e340-164d-4bc2-a503-7e8ea3c9b35b] Received event network-changed-37ce4717-9a82-41c6-9d89-f1e55b9ae398 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 10:03:06 user nova-compute[75229]: DEBUG nova.compute.manager [req-fc44ad6b-df2f-4de7-8e4a-0308182b812f req-473a5b57-409b-49fc-942c-9218ae5e1f05 service nova] [instance: abb8e340-164d-4bc2-a503-7e8ea3c9b35b] Refreshing instance network info cache due to event network-changed-37ce4717-9a82-41c6-9d89-f1e55b9ae398. {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 10:03:06 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-fc44ad6b-df2f-4de7-8e4a-0308182b812f req-473a5b57-409b-49fc-942c-9218ae5e1f05 service nova] Acquiring lock "refresh_cache-abb8e340-164d-4bc2-a503-7e8ea3c9b35b" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 10:03:06 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-fc44ad6b-df2f-4de7-8e4a-0308182b812f req-473a5b57-409b-49fc-942c-9218ae5e1f05 service nova] Acquired lock "refresh_cache-abb8e340-164d-4bc2-a503-7e8ea3c9b35b" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 10:03:06 user nova-compute[75229]: DEBUG nova.network.neutron [req-fc44ad6b-df2f-4de7-8e4a-0308182b812f req-473a5b57-409b-49fc-942c-9218ae5e1f05 service nova] [instance: abb8e340-164d-4bc2-a503-7e8ea3c9b35b] Refreshing network info cache for port 37ce4717-9a82-41c6-9d89-f1e55b9ae398 {{(pid=75229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 10:03:06 user nova-compute[75229]: DEBUG nova.network.neutron [req-fc44ad6b-df2f-4de7-8e4a-0308182b812f req-473a5b57-409b-49fc-942c-9218ae5e1f05 service nova] [instance: abb8e340-164d-4bc2-a503-7e8ea3c9b35b] Updated VIF entry in instance network info cache for port 37ce4717-9a82-41c6-9d89-f1e55b9ae398. {{(pid=75229) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 10:03:06 user nova-compute[75229]: DEBUG nova.network.neutron [req-fc44ad6b-df2f-4de7-8e4a-0308182b812f req-473a5b57-409b-49fc-942c-9218ae5e1f05 service nova] [instance: abb8e340-164d-4bc2-a503-7e8ea3c9b35b] Updating instance_info_cache with network_info: [{"id": "37ce4717-9a82-41c6-9d89-f1e55b9ae398", "address": "fa:16:3e:92:c4:4b", "network": {"id": "22eed29e-7148-42f9-b4c7-b97811cba8eb", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2000485731-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.13", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46457b27e3ed416e827c3c22449fb512", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37ce4717-9a", "ovs_interfaceid": "37ce4717-9a82-41c6-9d89-f1e55b9ae398", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 10:03:06 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-fc44ad6b-df2f-4de7-8e4a-0308182b812f req-473a5b57-409b-49fc-942c-9218ae5e1f05 service nova] Releasing lock "refresh_cache-abb8e340-164d-4bc2-a503-7e8ea3c9b35b" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 10:03:07 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:03:07 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:03:07 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:03:07 user nova-compute[75229]: DEBUG nova.compute.manager [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75229) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 10:03:07 user nova-compute[75229]: DEBUG nova.compute.manager [req-3aac3676-5fd4-43f9-8b01-a7ca96b57c8d req-b716f16e-4bd7-4311-a8ed-a81a7e196b98 service nova] [instance: abe7e145-d3bc-49a1-83be-793488de828b] Received event network-changed-fe62c72a-f69b-4109-bfa3-e4a51fa43d0e {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 10:03:07 user nova-compute[75229]: DEBUG nova.compute.manager [req-3aac3676-5fd4-43f9-8b01-a7ca96b57c8d req-b716f16e-4bd7-4311-a8ed-a81a7e196b98 service nova] [instance: abe7e145-d3bc-49a1-83be-793488de828b] Refreshing instance network info cache due to event network-changed-fe62c72a-f69b-4109-bfa3-e4a51fa43d0e. {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 10:03:07 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-3aac3676-5fd4-43f9-8b01-a7ca96b57c8d req-b716f16e-4bd7-4311-a8ed-a81a7e196b98 service nova] Acquiring lock "refresh_cache-abe7e145-d3bc-49a1-83be-793488de828b" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 10:03:07 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-3aac3676-5fd4-43f9-8b01-a7ca96b57c8d req-b716f16e-4bd7-4311-a8ed-a81a7e196b98 service nova] Acquired lock "refresh_cache-abe7e145-d3bc-49a1-83be-793488de828b" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 10:03:07 user nova-compute[75229]: DEBUG nova.network.neutron [req-3aac3676-5fd4-43f9-8b01-a7ca96b57c8d req-b716f16e-4bd7-4311-a8ed-a81a7e196b98 service nova] [instance: abe7e145-d3bc-49a1-83be-793488de828b] Refreshing network info cache for port fe62c72a-f69b-4109-bfa3-e4a51fa43d0e {{(pid=75229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 10:03:07 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:03:08 user nova-compute[75229]: DEBUG nova.network.neutron [req-3aac3676-5fd4-43f9-8b01-a7ca96b57c8d req-b716f16e-4bd7-4311-a8ed-a81a7e196b98 service nova] [instance: abe7e145-d3bc-49a1-83be-793488de828b] Updated VIF entry in instance network info cache for port fe62c72a-f69b-4109-bfa3-e4a51fa43d0e. {{(pid=75229) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 10:03:08 user nova-compute[75229]: DEBUG nova.network.neutron [req-3aac3676-5fd4-43f9-8b01-a7ca96b57c8d req-b716f16e-4bd7-4311-a8ed-a81a7e196b98 service nova] [instance: abe7e145-d3bc-49a1-83be-793488de828b] Updating instance_info_cache with network_info: [{"id": "fe62c72a-f69b-4109-bfa3-e4a51fa43d0e", "address": "fa:16:3e:f8:a3:e5", "network": {"id": "f0c67d05-ffe2-4866-baa3-fa4acaeadaa1", "bridge": "br-int", "label": "tempest-TestShelveInstance-1922554351-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.5", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d1aa0aeea4145b69bf310c4d9b649d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe62c72a-f6", "ovs_interfaceid": "fe62c72a-f69b-4109-bfa3-e4a51fa43d0e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 10:03:08 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-3aac3676-5fd4-43f9-8b01-a7ca96b57c8d req-b716f16e-4bd7-4311-a8ed-a81a7e196b98 service nova] Releasing lock "refresh_cache-abe7e145-d3bc-49a1-83be-793488de828b" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 10:03:08 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-7a6fe828-ce4e-4612-8628-05b6738a322b tempest-TestShelveInstance-1161595377 tempest-TestShelveInstance-1161595377-project-member] Acquiring lock "abe7e145-d3bc-49a1-83be-793488de828b" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:03:08 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-7a6fe828-ce4e-4612-8628-05b6738a322b tempest-TestShelveInstance-1161595377 tempest-TestShelveInstance-1161595377-project-member] Lock "abe7e145-d3bc-49a1-83be-793488de828b" acquired by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:03:08 user nova-compute[75229]: INFO nova.compute.manager [None req-7a6fe828-ce4e-4612-8628-05b6738a322b tempest-TestShelveInstance-1161595377 tempest-TestShelveInstance-1161595377-project-member] [instance: abe7e145-d3bc-49a1-83be-793488de828b] Shelve offloading
Nov 14 10:03:08 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:03:08 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:03:08 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:03:08 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:03:08 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:03:09 user nova-compute[75229]: INFO nova.virt.libvirt.driver [-] [instance: abe7e145-d3bc-49a1-83be-793488de828b] Instance destroyed successfully.
Nov 14 10:03:09 user nova-compute[75229]: DEBUG nova.compute.manager [None req-7a6fe828-ce4e-4612-8628-05b6738a322b tempest-TestShelveInstance-1161595377 tempest-TestShelveInstance-1161595377-project-member] [instance: abe7e145-d3bc-49a1-83be-793488de828b] Checking state {{(pid=75229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 10:03:09 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-7a6fe828-ce4e-4612-8628-05b6738a322b tempest-TestShelveInstance-1161595377 tempest-TestShelveInstance-1161595377-project-member] Acquiring lock "refresh_cache-abe7e145-d3bc-49a1-83be-793488de828b" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 10:03:09 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-7a6fe828-ce4e-4612-8628-05b6738a322b tempest-TestShelveInstance-1161595377 tempest-TestShelveInstance-1161595377-project-member] Acquired lock "refresh_cache-abe7e145-d3bc-49a1-83be-793488de828b" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 10:03:09 user nova-compute[75229]: DEBUG nova.network.neutron [None req-7a6fe828-ce4e-4612-8628-05b6738a322b tempest-TestShelveInstance-1161595377 tempest-TestShelveInstance-1161595377-project-member] [instance: abe7e145-d3bc-49a1-83be-793488de828b] Building network info cache for instance {{(pid=75229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 10:03:09 user nova-compute[75229]: DEBUG nova.network.neutron [None req-7a6fe828-ce4e-4612-8628-05b6738a322b tempest-TestShelveInstance-1161595377 tempest-TestShelveInstance-1161595377-project-member] [instance: abe7e145-d3bc-49a1-83be-793488de828b] Updating instance_info_cache with network_info: [{"id": "fe62c72a-f69b-4109-bfa3-e4a51fa43d0e", "address": "fa:16:3e:f8:a3:e5", "network": {"id": "f0c67d05-ffe2-4866-baa3-fa4acaeadaa1", "bridge": "br-int", "label": "tempest-TestShelveInstance-1922554351-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.5", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d1aa0aeea4145b69bf310c4d9b649d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe62c72a-f6", "ovs_interfaceid": "fe62c72a-f69b-4109-bfa3-e4a51fa43d0e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 10:03:09 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-7a6fe828-ce4e-4612-8628-05b6738a322b tempest-TestShelveInstance-1161595377 tempest-TestShelveInstance-1161595377-project-member] Releasing lock "refresh_cache-abe7e145-d3bc-49a1-83be-793488de828b" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 10:03:09 user nova-compute[75229]: DEBUG nova.compute.manager [req-f22f25fd-2dcb-4af4-80a1-5caf6ac775d9 req-b8b4ed2f-e77d-4173-b04a-31be10b419a9 service nova] [instance: abe7e145-d3bc-49a1-83be-793488de828b] Received event network-vif-unplugged-fe62c72a-f69b-4109-bfa3-e4a51fa43d0e {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 10:03:09 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-f22f25fd-2dcb-4af4-80a1-5caf6ac775d9 req-b8b4ed2f-e77d-4173-b04a-31be10b419a9 service nova] Acquiring lock "abe7e145-d3bc-49a1-83be-793488de828b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:03:09 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-f22f25fd-2dcb-4af4-80a1-5caf6ac775d9 req-b8b4ed2f-e77d-4173-b04a-31be10b419a9 service nova] Lock "abe7e145-d3bc-49a1-83be-793488de828b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:03:09 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-f22f25fd-2dcb-4af4-80a1-5caf6ac775d9 req-b8b4ed2f-e77d-4173-b04a-31be10b419a9 service nova] Lock "abe7e145-d3bc-49a1-83be-793488de828b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:03:09 user nova-compute[75229]: DEBUG nova.compute.manager [req-f22f25fd-2dcb-4af4-80a1-5caf6ac775d9 req-b8b4ed2f-e77d-4173-b04a-31be10b419a9 service nova] [instance: abe7e145-d3bc-49a1-83be-793488de828b] No waiting events found dispatching network-vif-unplugged-fe62c72a-f69b-4109-bfa3-e4a51fa43d0e {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 10:03:09 user nova-compute[75229]: WARNING nova.compute.manager [req-f22f25fd-2dcb-4af4-80a1-5caf6ac775d9 req-b8b4ed2f-e77d-4173-b04a-31be10b419a9 service nova] [instance: abe7e145-d3bc-49a1-83be-793488de828b] Received unexpected event network-vif-unplugged-fe62c72a-f69b-4109-bfa3-e4a51fa43d0e for instance with vm_state active and task_state shelving.
Nov 14 10:03:09 user nova-compute[75229]: DEBUG nova.compute.manager [req-f22f25fd-2dcb-4af4-80a1-5caf6ac775d9 req-b8b4ed2f-e77d-4173-b04a-31be10b419a9 service nova] [instance: abe7e145-d3bc-49a1-83be-793488de828b] Received event network-vif-plugged-fe62c72a-f69b-4109-bfa3-e4a51fa43d0e {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 10:03:09 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-f22f25fd-2dcb-4af4-80a1-5caf6ac775d9 req-b8b4ed2f-e77d-4173-b04a-31be10b419a9 service nova] Acquiring lock "abe7e145-d3bc-49a1-83be-793488de828b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:03:09 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-f22f25fd-2dcb-4af4-80a1-5caf6ac775d9 req-b8b4ed2f-e77d-4173-b04a-31be10b419a9 service nova] Lock "abe7e145-d3bc-49a1-83be-793488de828b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:03:09 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-f22f25fd-2dcb-4af4-80a1-5caf6ac775d9 req-b8b4ed2f-e77d-4173-b04a-31be10b419a9 service nova] Lock "abe7e145-d3bc-49a1-83be-793488de828b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:03:09 user nova-compute[75229]: DEBUG nova.compute.manager [req-f22f25fd-2dcb-4af4-80a1-5caf6ac775d9 req-b8b4ed2f-e77d-4173-b04a-31be10b419a9 service nova] [instance: abe7e145-d3bc-49a1-83be-793488de828b] No waiting events found dispatching network-vif-plugged-fe62c72a-f69b-4109-bfa3-e4a51fa43d0e {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 10:03:09 user nova-compute[75229]: WARNING nova.compute.manager [req-f22f25fd-2dcb-4af4-80a1-5caf6ac775d9 req-b8b4ed2f-e77d-4173-b04a-31be10b419a9 service nova] [instance: abe7e145-d3bc-49a1-83be-793488de828b] Received unexpected event network-vif-plugged-fe62c72a-f69b-4109-bfa3-e4a51fa43d0e for instance with vm_state active and task_state shelving.
Nov 14 10:03:10 user nova-compute[75229]: INFO nova.virt.libvirt.driver [-] [instance: abe7e145-d3bc-49a1-83be-793488de828b] Instance destroyed successfully.
Nov 14 10:03:10 user nova-compute[75229]: DEBUG nova.objects.instance [None req-7a6fe828-ce4e-4612-8628-05b6738a322b tempest-TestShelveInstance-1161595377 tempest-TestShelveInstance-1161595377-project-member] Lazy-loading 'resources' on Instance uuid abe7e145-d3bc-49a1-83be-793488de828b {{(pid=75229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 10:03:10 user nova-compute[75229]: DEBUG nova.virt.libvirt.vif [None req-7a6fe828-ce4e-4612-8628-05b6738a322b tempest-TestShelveInstance-1161595377 tempest-TestShelveInstance-1161595377-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T10:01:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1956352286',display_name='tempest-TestShelveInstance-server-1956352286',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1956352286',id=39,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLok8uDDoJEyioPdIocdaZ5mZahqhblgQ0EaVI+XqvZ5awYdli0p5VbxXjHgh+7IXxcRUPZZKXYprbMW6OXihRZCCr8OWYnUiMmEy0FQ5s4gHpX4TAp2yBSEZomFcAdpKw==',key_name='tempest-TestShelveInstance-743585374',keypairs=<?>,launch_index=0,launched_at=2023-11-14T10:01:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0d1aa0aeea4145b69bf310c4d9b649d0',ramdisk_id='',reservation_id='r-ysbldy6n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1161595377',owner_user_name='tempest-TestShelveInstance-1161595377-project-member'},tags=<?>,task_state='shelving',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T10:01:26Z,user_data=None,user_id='cd2c5b18ddd44bf18089cf001e012ebb',uuid=abe7e145-d3bc-49a1-83be-793488de828b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fe62c72a-f69b-4109-bfa3-e4a51fa43d0e", "address": "fa:16:3e:f8:a3:e5", "network": {"id": "f0c67d05-ffe2-4866-baa3-fa4acaeadaa1", "bridge": "br-int", "label": "tempest-TestShelveInstance-1922554351-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.5", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d1aa0aeea4145b69bf310c4d9b649d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe62c72a-f6", "ovs_interfaceid": "fe62c72a-f69b-4109-bfa3-e4a51fa43d0e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 10:03:10 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-7a6fe828-ce4e-4612-8628-05b6738a322b tempest-TestShelveInstance-1161595377 tempest-TestShelveInstance-1161595377-project-member] Converting VIF {"id": "fe62c72a-f69b-4109-bfa3-e4a51fa43d0e", "address": "fa:16:3e:f8:a3:e5", "network": {"id": "f0c67d05-ffe2-4866-baa3-fa4acaeadaa1", "bridge": "br-int", "label": "tempest-TestShelveInstance-1922554351-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.5", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d1aa0aeea4145b69bf310c4d9b649d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe62c72a-f6", "ovs_interfaceid": "fe62c72a-f69b-4109-bfa3-e4a51fa43d0e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 10:03:10 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-7a6fe828-ce4e-4612-8628-05b6738a322b tempest-TestShelveInstance-1161595377 tempest-TestShelveInstance-1161595377-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f8:a3:e5,bridge_name='br-int',has_traffic_filtering=True,id=fe62c72a-f69b-4109-bfa3-e4a51fa43d0e,network=Network(f0c67d05-ffe2-4866-baa3-fa4acaeadaa1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe62c72a-f6') {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 10:03:10 user nova-compute[75229]: DEBUG os_vif [None req-7a6fe828-ce4e-4612-8628-05b6738a322b tempest-TestShelveInstance-1161595377 tempest-TestShelveInstance-1161595377-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f8:a3:e5,bridge_name='br-int',has_traffic_filtering=True,id=fe62c72a-f69b-4109-bfa3-e4a51fa43d0e,network=Network(f0c67d05-ffe2-4866-baa3-fa4acaeadaa1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe62c72a-f6') {{(pid=75229) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 10:03:10 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:03:10 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfe62c72a-f6, bridge=br-int, if_exists=True) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 10:03:10 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:03:10 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 10:03:10 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:03:10 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1e64555f-d140-438a-8c67-046b85d5ce22) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 10:03:10 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:03:10 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:03:10 user nova-compute[75229]: INFO os_vif [None req-7a6fe828-ce4e-4612-8628-05b6738a322b tempest-TestShelveInstance-1161595377 tempest-TestShelveInstance-1161595377-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f8:a3:e5,bridge_name='br-int',has_traffic_filtering=True,id=fe62c72a-f69b-4109-bfa3-e4a51fa43d0e,network=Network(f0c67d05-ffe2-4866-baa3-fa4acaeadaa1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe62c72a-f6')
Nov 14 10:03:10 user nova-compute[75229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7a6fe828-ce4e-4612-8628-05b6738a322b tempest-TestShelveInstance-1161595377 tempest-TestShelveInstance-1161595377-project-member] [instance: abe7e145-d3bc-49a1-83be-793488de828b] calling os-brick to detach iSCSI Volume {{(pid=75229) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 10:03:10 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a6fe828-ce4e-4612-8628-05b6738a322b tempest-TestShelveInstance-1161595377 tempest-TestShelveInstance-1161595377-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f73f85151b0>, {'target_iqn': 'iqn.2010-10.org.openstack:e4a6dca6-1581-494f-afe5-3aac2b4d2c15', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VCFjOGhf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 10:03:10 user nova-compute[75229]: WARNING os_brick.initiator.connectors.base [None req-7a6fe828-ce4e-4612-8628-05b6738a322b tempest-TestShelveInstance-1161595377 tempest-TestShelveInstance-1161595377-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 10:03:10 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-7a6fe828-ce4e-4612-8628-05b6738a322b tempest-TestShelveInstance-1161595377 tempest-TestShelveInstance-1161595377-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 10:03:10 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-7a6fe828-ce4e-4612-8628-05b6738a322b tempest-TestShelveInstance-1161595377 tempest-TestShelveInstance-1161595377-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 10:03:10 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:03:10 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:03:10 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[804102c8-d98d-426e-9a66-274a21aaaf44]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:143891e8-62eb-42d7-b076-db6f52b4f606\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2977635e-b11f-4ab2-875c-e9f396b932dc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:64caa5ab-59eb-4251-9cef-f8576154c443\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5aebc438-0289-44fe-ad84-4e696468f50e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e4a6dca6-1581-494f-afe5-3aac2b4d2c15\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:03:10 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a6fe828-ce4e-4612-8628-05b6738a322b tempest-TestShelveInstance-1161595377 tempest-TestShelveInstance-1161595377-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 10:03:10 user nova-compute[75229]: No targets found.
Nov 14 10:03:10 user nova-compute[75229]: iSNS:
Nov 14 10:03:10 user nova-compute[75229]: No targets found.
Nov 14 10:03:10 user nova-compute[75229]: STATIC:
Nov 14 10:03:10 user nova-compute[75229]: Target: iqn.2010-10.org.openstack:143891e8-62eb-42d7-b076-db6f52b4f606
Nov 14 10:03:10 user nova-compute[75229]:         Portal: 172.16.0.220:3260,-1
Nov 14 10:03:10 user nova-compute[75229]:                 Iface Name: default
Nov 14 10:03:10 user nova-compute[75229]: Target: iqn.2010-10.org.openstack:2977635e-b11f-4ab2-875c-e9f396b932dc
Nov 14 10:03:10 user nova-compute[75229]:         Portal: 172.16.0.220:3260,-1
Nov 14 10:03:10 user nova-compute[75229]:                 Iface Name: default
Nov 14 10:03:10 user nova-compute[75229]: Target: iqn.2010-10.org.openstack:64caa5ab-59eb-4251-9cef-f8576154c443
Nov 14 10:03:10 user nova-compute[75229]:         Portal: 172.16.0.220:3260,-1
Nov 14 10:03:10 user nova-compute[75229]:                 Iface Name: default
Nov 14 10:03:10 user nova-compute[75229]: Target: iqn.2010-10.org.openstack:5aebc438-0289-44fe-ad84-4e696468f50e
Nov 14 10:03:10 user nova-compute[75229]:         Portal: 172.16.0.220:3260,-1
Nov 14 10:03:10 user nova-compute[75229]:                 Iface Name: default
Nov 14 10:03:10 user nova-compute[75229]: Target: iqn.2010-10.org.openstack:e4a6dca6-1581-494f-afe5-3aac2b4d2c15
Nov 14 10:03:10 user nova-compute[75229]:         Portal: 172.16.0.220:3260,-1
Nov 14 10:03:10 user nova-compute[75229]:                 Iface Name: default
Nov 14 10:03:10 user nova-compute[75229]: FIRMWARE:
Nov 14 10:03:10 user nova-compute[75229]: No targets found.
Nov 14 10:03:10 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 10:03:10 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a6fe828-ce4e-4612-8628-05b6738a322b tempest-TestShelveInstance-1161595377 tempest-TestShelveInstance-1161595377-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 10:03:10 user nova-compute[75229]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 10:03:10 user nova-compute[75229]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75229) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 10:03:10 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a6fe828-ce4e-4612-8628-05b6738a322b tempest-TestShelveInstance-1161595377 tempest-TestShelveInstance-1161595377-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e4a6dca6-1581-494f-afe5-3aac2b4d2c15', 0)] {{(pid=75229) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 10:03:10 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:03:10 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:03:10 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c768838-b808-4abe-af08-d6291161fc5d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:143891e8-62eb-42d7-b076-db6f52b4f606\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2977635e-b11f-4ab2-875c-e9f396b932dc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5aebc438-0289-44fe-ad84-4e696468f50e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:64caa5ab-59eb-4251-9cef-f8576154c443\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e4a6dca6-1581-494f-afe5-3aac2b4d2c15\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:03:10 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:03:10 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:03:10 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2bc37ac-78cd-4102-909c-c5a82578a087]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aebc438-0289-44fe-ad84-4e696468f50e (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:143891e8-62eb-42d7-b076-db6f52b4f606 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2977635e-b11f-4ab2-875c-e9f396b932dc (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4a6dca6-1581-494f-afe5-3aac2b4d2c15 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64caa5ab-59eb-4251-9cef-f8576154c443 (non-flash)\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:03:10 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a6fe828-ce4e-4612-8628-05b6738a322b tempest-TestShelveInstance-1161595377 tempest-TestShelveInstance-1161595377-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aebc438-0289-44fe-ad84-4e696468f50e (non-flash)
Nov 14 10:03:10 user nova-compute[75229]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:143891e8-62eb-42d7-b076-db6f52b4f606 (non-flash)
Nov 14 10:03:10 user nova-compute[75229]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2977635e-b11f-4ab2-875c-e9f396b932dc (non-flash)
Nov 14 10:03:10 user nova-compute[75229]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4a6dca6-1581-494f-afe5-3aac2b4d2c15 (non-flash)
Nov 14 10:03:10 user nova-compute[75229]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64caa5ab-59eb-4251-9cef-f8576154c443 (non-flash)
Nov 14 10:03:10 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 10:03:10 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a6fe828-ce4e-4612-8628-05b6738a322b tempest-TestShelveInstance-1161595377 tempest-TestShelveInstance-1161595377-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aebc438-0289-44fe-ad84-4e696468f50e (non-flash)
Nov 14 10:03:10 user nova-compute[75229]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:143891e8-62eb-42d7-b076-db6f52b4f606 (non-flash)
Nov 14 10:03:10 user nova-compute[75229]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2977635e-b11f-4ab2-875c-e9f396b932dc (non-flash)
Nov 14 10:03:10 user nova-compute[75229]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4a6dca6-1581-494f-afe5-3aac2b4d2c15 (non-flash)
Nov 14 10:03:10 user nova-compute[75229]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64caa5ab-59eb-4251-9cef-f8576154c443 (non-flash)
Nov 14 10:03:10 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 10:03:10 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a6fe828-ce4e-4612-8628-05b6738a322b tempest-TestShelveInstance-1161595377 tempest-TestShelveInstance-1161595377-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f73d4ebdbd0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e4a6dca6-1581-494f-afe5-3aac2b4d2c15'): ({'sdd'}, set())}) {{(pid=75229) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 10:03:10 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-7a6fe828-ce4e-4612-8628-05b6738a322b tempest-TestShelveInstance-1161595377 tempest-TestShelveInstance-1161595377-project-member] Removing single pathed devices sdd {{(pid=75229) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 10:03:10 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:03:10 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:03:10 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[167ae5cb-0a5d-4660-820f-1a6c617eb1b3]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:03:10 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:03:10 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.017s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:03:10 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0a9583b-55b9-476f-bfa6-4387146b3552]: (4, ('ok\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:03:10 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-7a6fe828-ce4e-4612-8628-05b6738a322b tempest-TestShelveInstance-1161595377 tempest-TestShelveInstance-1161595377-project-member] Flushing IO for device /dev/sdd {{(pid=75229) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 10:03:10 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:03:10 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.012s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:03:10 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6a69032-ad55-4b7f-925f-d0fb9a967e6e]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:03:10 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-7a6fe828-ce4e-4612-8628-05b6738a322b tempest-TestShelveInstance-1161595377 tempest-TestShelveInstance-1161595377-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75229) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 10:03:10 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:03:10 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.045s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:03:10 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6159ddb-1405-411a-8425-5966f488c6bf]: (4, ('1', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:03:10 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-7a6fe828-ce4e-4612-8628-05b6738a322b tempest-TestShelveInstance-1161595377 tempest-TestShelveInstance-1161595377-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75229) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 10:03:10 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-7a6fe828-ce4e-4612-8628-05b6738a322b tempest-TestShelveInstance-1161595377 tempest-TestShelveInstance-1161595377-project-member] SCSI volumes sdd have been removed. {{(pid=75229) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 10:03:10 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a6fe828-ce4e-4612-8628-05b6738a322b tempest-TestShelveInstance-1161595377 tempest-TestShelveInstance-1161595377-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e4a6dca6-1581-494f-afe5-3aac2b4d2c15')] {{(pid=75229) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 10:03:10 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4a6dca6-1581-494f-afe5-3aac2b4d2c15 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:03:10 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4a6dca6-1581-494f-afe5-3aac2b4d2c15 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:03:10 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe638720-4fd9-4b81-b3ca-d3e9828f659f]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:03:10 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a6fe828-ce4e-4612-8628-05b6738a322b tempest-TestShelveInstance-1161595377 tempest-TestShelveInstance-1161595377-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 10:03:10 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4a6dca6-1581-494f-afe5-3aac2b4d2c15 -p 172.16.0.220:3260 --logout {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:03:10 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4a6dca6-1581-494f-afe5-3aac2b4d2c15 -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:03:10 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf452934-88b9-40b1-b953-8edef799cf5b]: (4, ('Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:e4a6dca6-1581-494f-afe5-3aac2b4d2c15, portal: 172.16.0.220,3260]\nLogout of [sid: 41, target: iqn.2010-10.org.openstack:e4a6dca6-1581-494f-afe5-3aac2b4d2c15, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:03:10 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a6fe828-ce4e-4612-8628-05b6738a322b tempest-TestShelveInstance-1161595377 tempest-TestShelveInstance-1161595377-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:e4a6dca6-1581-494f-afe5-3aac2b4d2c15, portal: 172.16.0.220,3260]
Nov 14 10:03:10 user nova-compute[75229]: Logout of [sid: 41, target: iqn.2010-10.org.openstack:e4a6dca6-1581-494f-afe5-3aac2b4d2c15, portal: 172.16.0.220,3260] successful.
Nov 14 10:03:10 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 10:03:10 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4a6dca6-1581-494f-afe5-3aac2b4d2c15 -p 172.16.0.220:3260 --op delete {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:03:10 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4a6dca6-1581-494f-afe5-3aac2b4d2c15 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:03:10 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[e841ff31-b4ff-447a-ba8a-9585eb2d1be8]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:03:10 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a6fe828-ce4e-4612-8628-05b6738a322b tempest-TestShelveInstance-1161595377 tempest-TestShelveInstance-1161595377-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 10:03:10 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-7a6fe828-ce4e-4612-8628-05b6738a322b tempest-TestShelveInstance-1161595377 tempest-TestShelveInstance-1161595377-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.313s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 10:03:10 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a6fe828-ce4e-4612-8628-05b6738a322b tempest-TestShelveInstance-1161595377 tempest-TestShelveInstance-1161595377-project-member] <== disconnect_volume: return (314ms) None {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 10:03:10 user nova-compute[75229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7a6fe828-ce4e-4612-8628-05b6738a322b tempest-TestShelveInstance-1161595377 tempest-TestShelveInstance-1161595377-project-member] [instance: abe7e145-d3bc-49a1-83be-793488de828b] Disconnected iSCSI Volume {{(pid=75229) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 10:03:10 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-7a6fe828-ce4e-4612-8628-05b6738a322b tempest-TestShelveInstance-1161595377 tempest-TestShelveInstance-1161595377-project-member] [instance: abe7e145-d3bc-49a1-83be-793488de828b] Deleting instance files /opt/stack/data/nova/instances/abe7e145-d3bc-49a1-83be-793488de828b_del
Nov 14 10:03:10 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-7a6fe828-ce4e-4612-8628-05b6738a322b tempest-TestShelveInstance-1161595377 tempest-TestShelveInstance-1161595377-project-member] [instance: abe7e145-d3bc-49a1-83be-793488de828b] Deletion of /opt/stack/data/nova/instances/abe7e145-d3bc-49a1-83be-793488de828b_del complete
Nov 14 10:03:11 user nova-compute[75229]: INFO nova.scheduler.client.report [None req-7a6fe828-ce4e-4612-8628-05b6738a322b tempest-TestShelveInstance-1161595377 tempest-TestShelveInstance-1161595377-project-member] Deleted allocations for instance abe7e145-d3bc-49a1-83be-793488de828b
Nov 14 10:03:11 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-7a6fe828-ce4e-4612-8628-05b6738a322b tempest-TestShelveInstance-1161595377 tempest-TestShelveInstance-1161595377-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:03:11 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-7a6fe828-ce4e-4612-8628-05b6738a322b tempest-TestShelveInstance-1161595377 tempest-TestShelveInstance-1161595377-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:03:11 user nova-compute[75229]: DEBUG nova.objects.instance [None req-7a6fe828-ce4e-4612-8628-05b6738a322b tempest-TestShelveInstance-1161595377 tempest-TestShelveInstance-1161595377-project-member] Lazy-loading 'numa_topology' on Instance uuid abe7e145-d3bc-49a1-83be-793488de828b {{(pid=75229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 10:03:11 user nova-compute[75229]: DEBUG nova.objects.base [None req-7a6fe828-ce4e-4612-8628-05b6738a322b tempest-TestShelveInstance-1161595377 tempest-TestShelveInstance-1161595377-project-member] Object Instance<abe7e145-d3bc-49a1-83be-793488de828b> lazy-loaded attributes: resources,numa_topology {{(pid=75229) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 10:03:11 user nova-compute[75229]: DEBUG nova.compute.provider_tree [None req-7a6fe828-ce4e-4612-8628-05b6738a322b tempest-TestShelveInstance-1161595377 tempest-TestShelveInstance-1161595377-project-member] Inventory has not changed in ProviderTree for provider: d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 {{(pid=75229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 10:03:11 user nova-compute[75229]: DEBUG nova.scheduler.client.report [None req-7a6fe828-ce4e-4612-8628-05b6738a322b tempest-TestShelveInstance-1161595377 tempest-TestShelveInstance-1161595377-project-member] Inventory has not changed for provider d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 10:03:12 user nova-compute[75229]: DEBUG nova.compute.manager [req-f6119b2a-cdce-4d46-82ad-c2fa62e668a4 req-8ebfa23e-323f-452a-ba7b-8d26555ac17b service nova] [instance: abe7e145-d3bc-49a1-83be-793488de828b] Received event network-changed-fe62c72a-f69b-4109-bfa3-e4a51fa43d0e {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 10:03:12 user nova-compute[75229]: DEBUG nova.compute.manager [req-f6119b2a-cdce-4d46-82ad-c2fa62e668a4 req-8ebfa23e-323f-452a-ba7b-8d26555ac17b service nova] [instance: abe7e145-d3bc-49a1-83be-793488de828b] Refreshing instance network info cache due to event network-changed-fe62c72a-f69b-4109-bfa3-e4a51fa43d0e. {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 10:03:12 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-f6119b2a-cdce-4d46-82ad-c2fa62e668a4 req-8ebfa23e-323f-452a-ba7b-8d26555ac17b service nova] Acquiring lock "refresh_cache-abe7e145-d3bc-49a1-83be-793488de828b" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 10:03:12 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-f6119b2a-cdce-4d46-82ad-c2fa62e668a4 req-8ebfa23e-323f-452a-ba7b-8d26555ac17b service nova] Acquired lock "refresh_cache-abe7e145-d3bc-49a1-83be-793488de828b" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 10:03:12 user nova-compute[75229]: DEBUG nova.network.neutron [req-f6119b2a-cdce-4d46-82ad-c2fa62e668a4 req-8ebfa23e-323f-452a-ba7b-8d26555ac17b service nova] [instance: abe7e145-d3bc-49a1-83be-793488de828b] Refreshing network info cache for port fe62c72a-f69b-4109-bfa3-e4a51fa43d0e {{(pid=75229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 10:03:12 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-7a6fe828-ce4e-4612-8628-05b6738a322b tempest-TestShelveInstance-1161595377 tempest-TestShelveInstance-1161595377-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.306s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:03:12 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-7a6fe828-ce4e-4612-8628-05b6738a322b tempest-TestShelveInstance-1161595377 tempest-TestShelveInstance-1161595377-project-member] Lock "abe7e145-d3bc-49a1-83be-793488de828b" "released" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: held 3.863s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:03:12 user nova-compute[75229]: DEBUG nova.network.neutron [req-f6119b2a-cdce-4d46-82ad-c2fa62e668a4 req-8ebfa23e-323f-452a-ba7b-8d26555ac17b service nova] [instance: abe7e145-d3bc-49a1-83be-793488de828b] Updated VIF entry in instance network info cache for port fe62c72a-f69b-4109-bfa3-e4a51fa43d0e. {{(pid=75229) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 10:03:12 user nova-compute[75229]: DEBUG nova.network.neutron [req-f6119b2a-cdce-4d46-82ad-c2fa62e668a4 req-8ebfa23e-323f-452a-ba7b-8d26555ac17b service nova] [instance: abe7e145-d3bc-49a1-83be-793488de828b] Updating instance_info_cache with network_info: [{"id": "fe62c72a-f69b-4109-bfa3-e4a51fa43d0e", "address": "fa:16:3e:f8:a3:e5", "network": {"id": "f0c67d05-ffe2-4866-baa3-fa4acaeadaa1", "bridge": null, "label": "tempest-TestShelveInstance-1922554351-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.5", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d1aa0aeea4145b69bf310c4d9b649d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tapfe62c72a-f6", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 10:03:12 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-f6119b2a-cdce-4d46-82ad-c2fa62e668a4 req-8ebfa23e-323f-452a-ba7b-8d26555ac17b service nova] Releasing lock "refresh_cache-abe7e145-d3bc-49a1-83be-793488de828b" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 10:03:13 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:03:15 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:03:18 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:03:20 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:03:23 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:03:25 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:03:25 user nova-compute[75229]: WARNING nova.virt.libvirt.driver [None req-4058143c-202a-41ab-a4a4-0cb44deb3768 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance abb8e340-164d-4bc2-a503-7e8ea3c9b35b is timed out.
Nov 14 10:03:25 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-4058143c-202a-41ab-a4a4-0cb44deb3768 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Successfully detached device vdb from instance abb8e340-164d-4bc2-a503-7e8ea3c9b35b from the live domain config.
Nov 14 10:03:25 user nova-compute[75229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4058143c-202a-41ab-a4a4-0cb44deb3768 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] [instance: abb8e340-164d-4bc2-a503-7e8ea3c9b35b] calling os-brick to detach iSCSI Volume {{(pid=75229) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 10:03:25 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-4058143c-202a-41ab-a4a4-0cb44deb3768 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f73f85151b0>, {'target_iqn': 'iqn.2010-10.org.openstack:143891e8-62eb-42d7-b076-db6f52b4f606', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ubwOngiF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 10:03:25 user nova-compute[75229]: WARNING os_brick.initiator.connectors.base [None req-4058143c-202a-41ab-a4a4-0cb44deb3768 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 10:03:25 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-4058143c-202a-41ab-a4a4-0cb44deb3768 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 10:03:25 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-4058143c-202a-41ab-a4a4-0cb44deb3768 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 10:03:25 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:03:25 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:03:25 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff1f5bac-b463-4597-9574-7293c2475998]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:143891e8-62eb-42d7-b076-db6f52b4f606\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2977635e-b11f-4ab2-875c-e9f396b932dc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:64caa5ab-59eb-4251-9cef-f8576154c443\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5aebc438-0289-44fe-ad84-4e696468f50e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:03:25 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-4058143c-202a-41ab-a4a4-0cb44deb3768 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 10:03:25 user nova-compute[75229]: No targets found.
Nov 14 10:03:25 user nova-compute[75229]: iSNS:
Nov 14 10:03:25 user nova-compute[75229]: No targets found.
Nov 14 10:03:25 user nova-compute[75229]: STATIC:
Nov 14 10:03:25 user nova-compute[75229]: Target: iqn.2010-10.org.openstack:143891e8-62eb-42d7-b076-db6f52b4f606
Nov 14 10:03:25 user nova-compute[75229]:         Portal: 172.16.0.220:3260,-1
Nov 14 10:03:25 user nova-compute[75229]:                 Iface Name: default
Nov 14 10:03:25 user nova-compute[75229]: Target: iqn.2010-10.org.openstack:2977635e-b11f-4ab2-875c-e9f396b932dc
Nov 14 10:03:25 user nova-compute[75229]:         Portal: 172.16.0.220:3260,-1
Nov 14 10:03:25 user nova-compute[75229]:                 Iface Name: default
Nov 14 10:03:25 user nova-compute[75229]: Target: iqn.2010-10.org.openstack:64caa5ab-59eb-4251-9cef-f8576154c443
Nov 14 10:03:25 user nova-compute[75229]:         Portal: 172.16.0.220:3260,-1
Nov 14 10:03:25 user nova-compute[75229]:                 Iface Name: default
Nov 14 10:03:25 user nova-compute[75229]: Target: iqn.2010-10.org.openstack:5aebc438-0289-44fe-ad84-4e696468f50e
Nov 14 10:03:25 user nova-compute[75229]:         Portal: 172.16.0.220:3260,-1
Nov 14 10:03:25 user nova-compute[75229]:                 Iface Name: default
Nov 14 10:03:25 user nova-compute[75229]: FIRMWARE:
Nov 14 10:03:25 user nova-compute[75229]: No targets found.
Nov 14 10:03:25 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 10:03:25 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-4058143c-202a-41ab-a4a4-0cb44deb3768 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 10:03:25 user nova-compute[75229]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 10:03:25 user nova-compute[75229]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75229) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 10:03:25 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-4058143c-202a-41ab-a4a4-0cb44deb3768 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:143891e8-62eb-42d7-b076-db6f52b4f606', 0)] {{(pid=75229) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 10:03:25 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:03:25 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:03:25 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[06cd015c-3dc5-44b0-9adb-6341c7dce334]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:143891e8-62eb-42d7-b076-db6f52b4f606\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2977635e-b11f-4ab2-875c-e9f396b932dc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5aebc438-0289-44fe-ad84-4e696468f50e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:64caa5ab-59eb-4251-9cef-f8576154c443\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:03:25 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:03:25 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:03:25 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[9335425d-9440-46ec-b4f6-663a57d731e6]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aebc438-0289-44fe-ad84-4e696468f50e (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:143891e8-62eb-42d7-b076-db6f52b4f606 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2977635e-b11f-4ab2-875c-e9f396b932dc (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64caa5ab-59eb-4251-9cef-f8576154c443 (non-flash)\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:03:25 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-4058143c-202a-41ab-a4a4-0cb44deb3768 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aebc438-0289-44fe-ad84-4e696468f50e (non-flash)
Nov 14 10:03:25 user nova-compute[75229]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:143891e8-62eb-42d7-b076-db6f52b4f606 (non-flash)
Nov 14 10:03:25 user nova-compute[75229]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2977635e-b11f-4ab2-875c-e9f396b932dc (non-flash)
Nov 14 10:03:25 user nova-compute[75229]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64caa5ab-59eb-4251-9cef-f8576154c443 (non-flash)
Nov 14 10:03:25 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 10:03:25 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-4058143c-202a-41ab-a4a4-0cb44deb3768 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aebc438-0289-44fe-ad84-4e696468f50e (non-flash)
Nov 14 10:03:25 user nova-compute[75229]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:143891e8-62eb-42d7-b076-db6f52b4f606 (non-flash)
Nov 14 10:03:25 user nova-compute[75229]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2977635e-b11f-4ab2-875c-e9f396b932dc (non-flash)
Nov 14 10:03:25 user nova-compute[75229]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64caa5ab-59eb-4251-9cef-f8576154c443 (non-flash)
Nov 14 10:03:25 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 10:03:25 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-4058143c-202a-41ab-a4a4-0cb44deb3768 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f73f8524430>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:143891e8-62eb-42d7-b076-db6f52b4f606'): ({'sdf'}, set())}) {{(pid=75229) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 10:03:25 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-4058143c-202a-41ab-a4a4-0cb44deb3768 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Removing single pathed devices sdf {{(pid=75229) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 10:03:25 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:03:25 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:03:25 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[378ce4f8-02fc-448e-8ed9-0d97e0b0dd28]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:03:25 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:03:25 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.019s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:03:25 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd2c4559-75d9-4219-a530-52a33f14a4dd]: (4, ('ok\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:03:25 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-4058143c-202a-41ab-a4a4-0cb44deb3768 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Flushing IO for device /dev/sdf {{(pid=75229) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 10:03:25 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:03:25 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.013s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:03:25 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b58de81-12af-490e-98e0-627d99475eca]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:03:25 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-4058143c-202a-41ab-a4a4-0cb44deb3768 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75229) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 10:03:25 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:03:25 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.043s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:03:25 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdd70963-6775-41af-9fcf-a22fa04e8e52]: (4, ('1', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:03:25 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-4058143c-202a-41ab-a4a4-0cb44deb3768 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75229) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 10:03:25 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-4058143c-202a-41ab-a4a4-0cb44deb3768 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] SCSI volumes sdf have been removed. {{(pid=75229) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 10:03:25 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-4058143c-202a-41ab-a4a4-0cb44deb3768 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:143891e8-62eb-42d7-b076-db6f52b4f606')] {{(pid=75229) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 10:03:25 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:143891e8-62eb-42d7-b076-db6f52b4f606 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:03:25 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:143891e8-62eb-42d7-b076-db6f52b4f606 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:03:25 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[11d071bc-e323-4079-8df1-570e118d989d]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:03:25 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-4058143c-202a-41ab-a4a4-0cb44deb3768 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 10:03:25 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:143891e8-62eb-42d7-b076-db6f52b4f606 -p 172.16.0.220:3260 --logout {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:03:25 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:143891e8-62eb-42d7-b076-db6f52b4f606 -p 172.16.0.220:3260 --logout" returned: 0 in 0.047s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:03:25 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b53a1ef-10bc-4eff-ad12-99e690bdc69a]: (4, ('Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:143891e8-62eb-42d7-b076-db6f52b4f606, portal: 172.16.0.220,3260]\nLogout of [sid: 38, target: iqn.2010-10.org.openstack:143891e8-62eb-42d7-b076-db6f52b4f606, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:03:25 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-4058143c-202a-41ab-a4a4-0cb44deb3768 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:143891e8-62eb-42d7-b076-db6f52b4f606, portal: 172.16.0.220,3260]
Nov 14 10:03:25 user nova-compute[75229]: Logout of [sid: 38, target: iqn.2010-10.org.openstack:143891e8-62eb-42d7-b076-db6f52b4f606, portal: 172.16.0.220,3260] successful.
Nov 14 10:03:25 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 10:03:25 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:143891e8-62eb-42d7-b076-db6f52b4f606 -p 172.16.0.220:3260 --op delete {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:03:25 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:143891e8-62eb-42d7-b076-db6f52b4f606 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:03:25 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d35e17e-ce96-4b3d-a1e9-6c2f5cbaa71f]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:03:25 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-4058143c-202a-41ab-a4a4-0cb44deb3768 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 10:03:25 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-4058143c-202a-41ab-a4a4-0cb44deb3768 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.308s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 10:03:25 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-4058143c-202a-41ab-a4a4-0cb44deb3768 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] <== disconnect_volume: return (309ms) None {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 10:03:25 user nova-compute[75229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4058143c-202a-41ab-a4a4-0cb44deb3768 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] [instance: abb8e340-164d-4bc2-a503-7e8ea3c9b35b] Disconnected iSCSI Volume {{(pid=75229) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 10:03:26 user nova-compute[75229]: DEBUG nova.objects.instance [None req-4058143c-202a-41ab-a4a4-0cb44deb3768 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Lazy-loading 'flavor' on Instance uuid abb8e340-164d-4bc2-a503-7e8ea3c9b35b {{(pid=75229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 10:03:26 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-4058143c-202a-41ab-a4a4-0cb44deb3768 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Lock "abb8e340-164d-4bc2-a503-7e8ea3c9b35b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.642s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:03:27 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-a5295160-13ab-48f2-9e39-2744ea306c80 tempest-VolumesNegativeTest-186454050 tempest-VolumesNegativeTest-186454050-project-member] Acquiring lock "de62e75a-207e-4aa3-a592-52f48577c2b9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:03:27 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-a5295160-13ab-48f2-9e39-2744ea306c80 tempest-VolumesNegativeTest-186454050 tempest-VolumesNegativeTest-186454050-project-member] Lock "de62e75a-207e-4aa3-a592-52f48577c2b9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:03:27 user nova-compute[75229]: DEBUG nova.compute.manager [None req-a5295160-13ab-48f2-9e39-2744ea306c80 tempest-VolumesNegativeTest-186454050 tempest-VolumesNegativeTest-186454050-project-member] [instance: de62e75a-207e-4aa3-a592-52f48577c2b9] Starting instance... {{(pid=75229) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 10:03:27 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-a5295160-13ab-48f2-9e39-2744ea306c80 tempest-VolumesNegativeTest-186454050 tempest-VolumesNegativeTest-186454050-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:03:27 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-a5295160-13ab-48f2-9e39-2744ea306c80 tempest-VolumesNegativeTest-186454050 tempest-VolumesNegativeTest-186454050-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:03:27 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-a5295160-13ab-48f2-9e39-2744ea306c80 tempest-VolumesNegativeTest-186454050 tempest-VolumesNegativeTest-186454050-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75229) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 10:03:27 user nova-compute[75229]: INFO nova.compute.claims [None req-a5295160-13ab-48f2-9e39-2744ea306c80 tempest-VolumesNegativeTest-186454050 tempest-VolumesNegativeTest-186454050-project-member] [instance: de62e75a-207e-4aa3-a592-52f48577c2b9] Claim successful on node user
Nov 14 10:03:28 user nova-compute[75229]: DEBUG nova.compute.provider_tree [None req-a5295160-13ab-48f2-9e39-2744ea306c80 tempest-VolumesNegativeTest-186454050 tempest-VolumesNegativeTest-186454050-project-member] Inventory has not changed in ProviderTree for provider: d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 {{(pid=75229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 10:03:28 user nova-compute[75229]: DEBUG nova.scheduler.client.report [None req-a5295160-13ab-48f2-9e39-2744ea306c80 tempest-VolumesNegativeTest-186454050 tempest-VolumesNegativeTest-186454050-project-member] Inventory has not changed for provider d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 10:03:28 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-a5295160-13ab-48f2-9e39-2744ea306c80 tempest-VolumesNegativeTest-186454050 tempest-VolumesNegativeTest-186454050-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.462s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:03:28 user nova-compute[75229]: DEBUG nova.compute.manager [None req-a5295160-13ab-48f2-9e39-2744ea306c80 tempest-VolumesNegativeTest-186454050 tempest-VolumesNegativeTest-186454050-project-member] [instance: de62e75a-207e-4aa3-a592-52f48577c2b9] Start building networks asynchronously for instance. {{(pid=75229) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 10:03:28 user nova-compute[75229]: DEBUG nova.compute.manager [None req-a5295160-13ab-48f2-9e39-2744ea306c80 tempest-VolumesNegativeTest-186454050 tempest-VolumesNegativeTest-186454050-project-member] [instance: de62e75a-207e-4aa3-a592-52f48577c2b9] Allocating IP information in the background. {{(pid=75229) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 10:03:28 user nova-compute[75229]: DEBUG nova.network.neutron [None req-a5295160-13ab-48f2-9e39-2744ea306c80 tempest-VolumesNegativeTest-186454050 tempest-VolumesNegativeTest-186454050-project-member] [instance: de62e75a-207e-4aa3-a592-52f48577c2b9] allocate_for_instance() {{(pid=75229) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 10:03:28 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-a5295160-13ab-48f2-9e39-2744ea306c80 tempest-VolumesNegativeTest-186454050 tempest-VolumesNegativeTest-186454050-project-member] [instance: de62e75a-207e-4aa3-a592-52f48577c2b9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 10:03:28 user nova-compute[75229]: DEBUG nova.compute.manager [None req-a5295160-13ab-48f2-9e39-2744ea306c80 tempest-VolumesNegativeTest-186454050 tempest-VolumesNegativeTest-186454050-project-member] [instance: de62e75a-207e-4aa3-a592-52f48577c2b9] Start building block device mappings for instance. {{(pid=75229) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 10:03:28 user nova-compute[75229]: DEBUG nova.policy [None req-a5295160-13ab-48f2-9e39-2744ea306c80 tempest-VolumesNegativeTest-186454050 tempest-VolumesNegativeTest-186454050-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '404095151f914441bc37c25126bc533a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b47a87b353824259be3f2bc2a9b3c0c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75229) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 10:03:28 user nova-compute[75229]: DEBUG nova.compute.manager [None req-a5295160-13ab-48f2-9e39-2744ea306c80 tempest-VolumesNegativeTest-186454050 tempest-VolumesNegativeTest-186454050-project-member] [instance: de62e75a-207e-4aa3-a592-52f48577c2b9] Start spawning the instance on the hypervisor. {{(pid=75229) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 10:03:28 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-a5295160-13ab-48f2-9e39-2744ea306c80 tempest-VolumesNegativeTest-186454050 tempest-VolumesNegativeTest-186454050-project-member] [instance: de62e75a-207e-4aa3-a592-52f48577c2b9] Creating instance directory {{(pid=75229) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 10:03:28 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-a5295160-13ab-48f2-9e39-2744ea306c80 tempest-VolumesNegativeTest-186454050 tempest-VolumesNegativeTest-186454050-project-member] [instance: de62e75a-207e-4aa3-a592-52f48577c2b9] Creating image(s)
Nov 14 10:03:28 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-a5295160-13ab-48f2-9e39-2744ea306c80 tempest-VolumesNegativeTest-186454050 tempest-VolumesNegativeTest-186454050-project-member] Acquiring lock "/opt/stack/data/nova/instances/de62e75a-207e-4aa3-a592-52f48577c2b9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:03:28 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-a5295160-13ab-48f2-9e39-2744ea306c80 tempest-VolumesNegativeTest-186454050 tempest-VolumesNegativeTest-186454050-project-member] Lock "/opt/stack/data/nova/instances/de62e75a-207e-4aa3-a592-52f48577c2b9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:03:28 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-a5295160-13ab-48f2-9e39-2744ea306c80 tempest-VolumesNegativeTest-186454050 tempest-VolumesNegativeTest-186454050-project-member] Lock "/opt/stack/data/nova/instances/de62e75a-207e-4aa3-a592-52f48577c2b9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:03:28 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-a5295160-13ab-48f2-9e39-2744ea306c80 tempest-VolumesNegativeTest-186454050 tempest-VolumesNegativeTest-186454050-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6 --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:03:28 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-a5295160-13ab-48f2-9e39-2744ea306c80 tempest-VolumesNegativeTest-186454050 tempest-VolumesNegativeTest-186454050-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6 --force-share --output=json" returned: 0 in 0.186s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:03:28 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-a5295160-13ab-48f2-9e39-2744ea306c80 tempest-VolumesNegativeTest-186454050 tempest-VolumesNegativeTest-186454050-project-member] Acquiring lock "4f30e3fe703d2381679612a57b1fb80a467f60b6" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:03:28 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-a5295160-13ab-48f2-9e39-2744ea306c80 tempest-VolumesNegativeTest-186454050 tempest-VolumesNegativeTest-186454050-project-member] Lock "4f30e3fe703d2381679612a57b1fb80a467f60b6" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:03:28 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-a5295160-13ab-48f2-9e39-2744ea306c80 tempest-VolumesNegativeTest-186454050 tempest-VolumesNegativeTest-186454050-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6 --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:03:28 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-a5295160-13ab-48f2-9e39-2744ea306c80 tempest-VolumesNegativeTest-186454050 tempest-VolumesNegativeTest-186454050-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6 --force-share --output=json" returned: 0 in 0.169s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:03:28 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-a5295160-13ab-48f2-9e39-2744ea306c80 tempest-VolumesNegativeTest-186454050 tempest-VolumesNegativeTest-186454050-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6,backing_fmt=raw /opt/stack/data/nova/instances/de62e75a-207e-4aa3-a592-52f48577c2b9/disk 1073741824 {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:03:28 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-a5295160-13ab-48f2-9e39-2744ea306c80 tempest-VolumesNegativeTest-186454050 tempest-VolumesNegativeTest-186454050-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6,backing_fmt=raw /opt/stack/data/nova/instances/de62e75a-207e-4aa3-a592-52f48577c2b9/disk 1073741824" returned: 0 in 0.053s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:03:28 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-a5295160-13ab-48f2-9e39-2744ea306c80 tempest-VolumesNegativeTest-186454050 tempest-VolumesNegativeTest-186454050-project-member] Lock "4f30e3fe703d2381679612a57b1fb80a467f60b6" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.229s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:03:28 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-a5295160-13ab-48f2-9e39-2744ea306c80 tempest-VolumesNegativeTest-186454050 tempest-VolumesNegativeTest-186454050-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6 --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:03:28 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-a5295160-13ab-48f2-9e39-2744ea306c80 tempest-VolumesNegativeTest-186454050 tempest-VolumesNegativeTest-186454050-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6 --force-share --output=json" returned: 0 in 0.172s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:03:28 user nova-compute[75229]: DEBUG nova.virt.disk.api [None req-a5295160-13ab-48f2-9e39-2744ea306c80 tempest-VolumesNegativeTest-186454050 tempest-VolumesNegativeTest-186454050-project-member] Checking if we can resize image /opt/stack/data/nova/instances/de62e75a-207e-4aa3-a592-52f48577c2b9/disk. size=1073741824 {{(pid=75229) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 10:03:28 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-a5295160-13ab-48f2-9e39-2744ea306c80 tempest-VolumesNegativeTest-186454050 tempest-VolumesNegativeTest-186454050-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de62e75a-207e-4aa3-a592-52f48577c2b9/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:03:28 user nova-compute[75229]: DEBUG nova.network.neutron [None req-a5295160-13ab-48f2-9e39-2744ea306c80 tempest-VolumesNegativeTest-186454050 tempest-VolumesNegativeTest-186454050-project-member] [instance: de62e75a-207e-4aa3-a592-52f48577c2b9] Successfully created port: f9fd5735-8c69-47ca-ab17-2461bf22a2bc {{(pid=75229) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 10:03:29 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-a5295160-13ab-48f2-9e39-2744ea306c80 tempest-VolumesNegativeTest-186454050 tempest-VolumesNegativeTest-186454050-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de62e75a-207e-4aa3-a592-52f48577c2b9/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:03:29 user nova-compute[75229]: DEBUG nova.virt.disk.api [None req-a5295160-13ab-48f2-9e39-2744ea306c80 tempest-VolumesNegativeTest-186454050 tempest-VolumesNegativeTest-186454050-project-member] Cannot resize image /opt/stack/data/nova/instances/de62e75a-207e-4aa3-a592-52f48577c2b9/disk to a smaller size. {{(pid=75229) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 10:03:29 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-a5295160-13ab-48f2-9e39-2744ea306c80 tempest-VolumesNegativeTest-186454050 tempest-VolumesNegativeTest-186454050-project-member] [instance: de62e75a-207e-4aa3-a592-52f48577c2b9] Created local disks {{(pid=75229) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 10:03:29 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-a5295160-13ab-48f2-9e39-2744ea306c80 tempest-VolumesNegativeTest-186454050 tempest-VolumesNegativeTest-186454050-project-member] [instance: de62e75a-207e-4aa3-a592-52f48577c2b9] Ensure instance console log exists: /opt/stack/data/nova/instances/de62e75a-207e-4aa3-a592-52f48577c2b9/console.log {{(pid=75229) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 10:03:29 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-a5295160-13ab-48f2-9e39-2744ea306c80 tempest-VolumesNegativeTest-186454050 tempest-VolumesNegativeTest-186454050-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:03:29 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-a5295160-13ab-48f2-9e39-2744ea306c80 tempest-VolumesNegativeTest-186454050 tempest-VolumesNegativeTest-186454050-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:03:29 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-a5295160-13ab-48f2-9e39-2744ea306c80 tempest-VolumesNegativeTest-186454050 tempest-VolumesNegativeTest-186454050-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:03:29 user nova-compute[75229]: DEBUG nova.network.neutron [None req-a5295160-13ab-48f2-9e39-2744ea306c80 tempest-VolumesNegativeTest-186454050 tempest-VolumesNegativeTest-186454050-project-member] [instance: de62e75a-207e-4aa3-a592-52f48577c2b9] Successfully updated port: f9fd5735-8c69-47ca-ab17-2461bf22a2bc {{(pid=75229) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 10:03:29 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-a5295160-13ab-48f2-9e39-2744ea306c80 tempest-VolumesNegativeTest-186454050 tempest-VolumesNegativeTest-186454050-project-member] Acquiring lock "refresh_cache-de62e75a-207e-4aa3-a592-52f48577c2b9" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 10:03:29 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-a5295160-13ab-48f2-9e39-2744ea306c80 tempest-VolumesNegativeTest-186454050 tempest-VolumesNegativeTest-186454050-project-member] Acquired lock "refresh_cache-de62e75a-207e-4aa3-a592-52f48577c2b9" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 10:03:29 user nova-compute[75229]: DEBUG nova.network.neutron [None req-a5295160-13ab-48f2-9e39-2744ea306c80 tempest-VolumesNegativeTest-186454050 tempest-VolumesNegativeTest-186454050-project-member] [instance: de62e75a-207e-4aa3-a592-52f48577c2b9] Building network info cache for instance {{(pid=75229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 10:03:29 user nova-compute[75229]: DEBUG nova.compute.manager [req-1fe5f642-54bf-4ce1-aca4-cfea6d54c242 req-71f5efd3-ddd4-454e-a80a-98204d16b241 service nova] [instance: de62e75a-207e-4aa3-a592-52f48577c2b9] Received event network-changed-f9fd5735-8c69-47ca-ab17-2461bf22a2bc {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 10:03:29 user nova-compute[75229]: DEBUG nova.compute.manager [req-1fe5f642-54bf-4ce1-aca4-cfea6d54c242 req-71f5efd3-ddd4-454e-a80a-98204d16b241 service nova] [instance: de62e75a-207e-4aa3-a592-52f48577c2b9] Refreshing instance network info cache due to event network-changed-f9fd5735-8c69-47ca-ab17-2461bf22a2bc. {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 10:03:29 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-1fe5f642-54bf-4ce1-aca4-cfea6d54c242 req-71f5efd3-ddd4-454e-a80a-98204d16b241 service nova] Acquiring lock "refresh_cache-de62e75a-207e-4aa3-a592-52f48577c2b9" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 10:03:29 user nova-compute[75229]: DEBUG nova.network.neutron [None req-a5295160-13ab-48f2-9e39-2744ea306c80 tempest-VolumesNegativeTest-186454050 tempest-VolumesNegativeTest-186454050-project-member] [instance: de62e75a-207e-4aa3-a592-52f48577c2b9] Instance cache missing network info. {{(pid=75229) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 10:03:29 user nova-compute[75229]: DEBUG nova.network.neutron [None req-a5295160-13ab-48f2-9e39-2744ea306c80 tempest-VolumesNegativeTest-186454050 tempest-VolumesNegativeTest-186454050-project-member] [instance: de62e75a-207e-4aa3-a592-52f48577c2b9] Updating instance_info_cache with network_info: [{"id": "f9fd5735-8c69-47ca-ab17-2461bf22a2bc", "address": "fa:16:3e:8b:8b:54", "network": {"id": "f6b0322a-9240-4814-9056-7fabc91b097a", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.76", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "de5a91106b6948ed937a7178ff9464c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9fd5735-8c", "ovs_interfaceid": "f9fd5735-8c69-47ca-ab17-2461bf22a2bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 10:03:29 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-a5295160-13ab-48f2-9e39-2744ea306c80 tempest-VolumesNegativeTest-186454050 tempest-VolumesNegativeTest-186454050-project-member] Releasing lock "refresh_cache-de62e75a-207e-4aa3-a592-52f48577c2b9" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 10:03:29 user nova-compute[75229]: DEBUG nova.compute.manager [None req-a5295160-13ab-48f2-9e39-2744ea306c80 tempest-VolumesNegativeTest-186454050 tempest-VolumesNegativeTest-186454050-project-member] [instance: de62e75a-207e-4aa3-a592-52f48577c2b9] Instance network_info: |[{"id": "f9fd5735-8c69-47ca-ab17-2461bf22a2bc", "address": "fa:16:3e:8b:8b:54", "network": {"id": "f6b0322a-9240-4814-9056-7fabc91b097a", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.76", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "de5a91106b6948ed937a7178ff9464c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9fd5735-8c", "ovs_interfaceid": "f9fd5735-8c69-47ca-ab17-2461bf22a2bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75229) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 10:03:29 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-1fe5f642-54bf-4ce1-aca4-cfea6d54c242 req-71f5efd3-ddd4-454e-a80a-98204d16b241 service nova] Acquired lock "refresh_cache-de62e75a-207e-4aa3-a592-52f48577c2b9" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 10:03:29 user nova-compute[75229]: DEBUG nova.network.neutron [req-1fe5f642-54bf-4ce1-aca4-cfea6d54c242 req-71f5efd3-ddd4-454e-a80a-98204d16b241 service nova] [instance: de62e75a-207e-4aa3-a592-52f48577c2b9] Refreshing network info cache for port f9fd5735-8c69-47ca-ab17-2461bf22a2bc {{(pid=75229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 10:03:29 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-a5295160-13ab-48f2-9e39-2744ea306c80 tempest-VolumesNegativeTest-186454050 tempest-VolumesNegativeTest-186454050-project-member] [instance: de62e75a-207e-4aa3-a592-52f48577c2b9] Start _get_guest_xml network_info=[{"id": "f9fd5735-8c69-47ca-ab17-2461bf22a2bc", "address": "fa:16:3e:8b:8b:54", "network": {"id": "f6b0322a-9240-4814-9056-7fabc91b097a", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.76", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "de5a91106b6948ed937a7178ff9464c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9fd5735-8c", "ovs_interfaceid": "f9fd5735-8c69-47ca-ab17-2461bf22a2bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T09:40:10Z,direct_url=<?>,disk_format='qcow2',id=3bef8470-ecc7-40e3-95d4-9254348ea72d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='de5a91106b6948ed937a7178ff9464c4',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T09:40:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'disk_bus': 'virtio', 'guest_format': None, 'encryption_secret_uuid': None, 'size': 0, 'device_type': 'disk', 'image_id': '3bef8470-ecc7-40e3-95d4-9254348ea72d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75229) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 10:03:29 user nova-compute[75229]: WARNING nova.virt.libvirt.driver [None req-a5295160-13ab-48f2-9e39-2744ea306c80 tempest-VolumesNegativeTest-186454050 tempest-VolumesNegativeTest-186454050-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 10:03:29 user nova-compute[75229]: WARNING nova.virt.libvirt.driver [None req-a5295160-13ab-48f2-9e39-2744ea306c80 tempest-VolumesNegativeTest-186454050 tempest-VolumesNegativeTest-186454050-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 10:03:29 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-a5295160-13ab-48f2-9e39-2744ea306c80 tempest-VolumesNegativeTest-186454050 tempest-VolumesNegativeTest-186454050-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75229) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 10:03:29 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-a5295160-13ab-48f2-9e39-2744ea306c80 tempest-VolumesNegativeTest-186454050 tempest-VolumesNegativeTest-186454050-project-member] CPU controller missing on host. {{(pid=75229) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 10:03:29 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-a5295160-13ab-48f2-9e39-2744ea306c80 tempest-VolumesNegativeTest-186454050 tempest-VolumesNegativeTest-186454050-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75229) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 10:03:29 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-a5295160-13ab-48f2-9e39-2744ea306c80 tempest-VolumesNegativeTest-186454050 tempest-VolumesNegativeTest-186454050-project-member] CPU controller found on host. {{(pid=75229) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 10:03:29 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-a5295160-13ab-48f2-9e39-2744ea306c80 tempest-VolumesNegativeTest-186454050 tempest-VolumesNegativeTest-186454050-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75229) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 10:03:29 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-a5295160-13ab-48f2-9e39-2744ea306c80 tempest-VolumesNegativeTest-186454050 tempest-VolumesNegativeTest-186454050-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T09:39:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T09:40:10Z,direct_url=<?>,disk_format='qcow2',id=3bef8470-ecc7-40e3-95d4-9254348ea72d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='de5a91106b6948ed937a7178ff9464c4',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T09:40:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 10:03:29 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-a5295160-13ab-48f2-9e39-2744ea306c80 tempest-VolumesNegativeTest-186454050 tempest-VolumesNegativeTest-186454050-project-member] Flavor limits 0:0:0 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 10:03:29 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-a5295160-13ab-48f2-9e39-2744ea306c80 tempest-VolumesNegativeTest-186454050 tempest-VolumesNegativeTest-186454050-project-member] Image limits 0:0:0 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 10:03:29 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-a5295160-13ab-48f2-9e39-2744ea306c80 tempest-VolumesNegativeTest-186454050 tempest-VolumesNegativeTest-186454050-project-member] Flavor pref 0:0:0 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 10:03:29 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-a5295160-13ab-48f2-9e39-2744ea306c80 tempest-VolumesNegativeTest-186454050 tempest-VolumesNegativeTest-186454050-project-member] Image pref 0:0:0 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 10:03:29 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-a5295160-13ab-48f2-9e39-2744ea306c80 tempest-VolumesNegativeTest-186454050 tempest-VolumesNegativeTest-186454050-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 10:03:29 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-a5295160-13ab-48f2-9e39-2744ea306c80 tempest-VolumesNegativeTest-186454050 tempest-VolumesNegativeTest-186454050-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 10:03:29 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-a5295160-13ab-48f2-9e39-2744ea306c80 tempest-VolumesNegativeTest-186454050 tempest-VolumesNegativeTest-186454050-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75229) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 10:03:29 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-a5295160-13ab-48f2-9e39-2744ea306c80 tempest-VolumesNegativeTest-186454050 tempest-VolumesNegativeTest-186454050-project-member] Got 1 possible topologies {{(pid=75229) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 10:03:29 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-a5295160-13ab-48f2-9e39-2744ea306c80 tempest-VolumesNegativeTest-186454050 tempest-VolumesNegativeTest-186454050-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 10:03:29 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-a5295160-13ab-48f2-9e39-2744ea306c80 tempest-VolumesNegativeTest-186454050 tempest-VolumesNegativeTest-186454050-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 10:03:29 user nova-compute[75229]: DEBUG nova.virt.libvirt.vif [None req-a5295160-13ab-48f2-9e39-2744ea306c80 tempest-VolumesNegativeTest-186454050 tempest-VolumesNegativeTest-186454050-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T10:03:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-809592276',display_name='tempest-VolumesNegativeTest-instance-809592276',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-809592276',id=43,image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b47a87b353824259be3f2bc2a9b3c0c3',ramdisk_id='',reservation_id='r-ra043shb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-186454050',owner_user_name='tempest-VolumesNegativeTest-186454050-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T10:03:28Z,user_data=None,user_id='404095151f914441bc37c25126bc533a',uuid=de62e75a-207e-4aa3-a592-52f48577c2b9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f9fd5735-8c69-47ca-ab17-2461bf22a2bc", "address": "fa:16:3e:8b:8b:54", "network": {"id": "f6b0322a-9240-4814-9056-7fabc91b097a", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.76", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "de5a91106b6948ed937a7178ff9464c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9fd5735-8c", "ovs_interfaceid": "f9fd5735-8c69-47ca-ab17-2461bf22a2bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75229) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 10:03:29 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-a5295160-13ab-48f2-9e39-2744ea306c80 tempest-VolumesNegativeTest-186454050 tempest-VolumesNegativeTest-186454050-project-member] Converting VIF {"id": "f9fd5735-8c69-47ca-ab17-2461bf22a2bc", "address": "fa:16:3e:8b:8b:54", "network": {"id": "f6b0322a-9240-4814-9056-7fabc91b097a", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.76", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "de5a91106b6948ed937a7178ff9464c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9fd5735-8c", "ovs_interfaceid": "f9fd5735-8c69-47ca-ab17-2461bf22a2bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 10:03:29 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-a5295160-13ab-48f2-9e39-2744ea306c80 tempest-VolumesNegativeTest-186454050 tempest-VolumesNegativeTest-186454050-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8b:8b:54,bridge_name='br-int',has_traffic_filtering=True,id=f9fd5735-8c69-47ca-ab17-2461bf22a2bc,network=Network(f6b0322a-9240-4814-9056-7fabc91b097a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9fd5735-8c') {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 10:03:29 user nova-compute[75229]: DEBUG nova.objects.instance [None req-a5295160-13ab-48f2-9e39-2744ea306c80 tempest-VolumesNegativeTest-186454050 tempest-VolumesNegativeTest-186454050-project-member] Lazy-loading 'pci_devices' on Instance uuid de62e75a-207e-4aa3-a592-52f48577c2b9 {{(pid=75229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 10:03:29 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-a5295160-13ab-48f2-9e39-2744ea306c80 tempest-VolumesNegativeTest-186454050 tempest-VolumesNegativeTest-186454050-project-member] [instance: de62e75a-207e-4aa3-a592-52f48577c2b9] End _get_guest_xml xml=<domain type="kvm">
Nov 14 10:03:29 user nova-compute[75229]:   <uuid>de62e75a-207e-4aa3-a592-52f48577c2b9</uuid>
Nov 14 10:03:29 user nova-compute[75229]:   <name>instance-0000002b</name>
Nov 14 10:03:29 user nova-compute[75229]:   <memory>524288</memory>
Nov 14 10:03:29 user nova-compute[75229]:   <vcpu>1</vcpu>
Nov 14 10:03:29 user nova-compute[75229]:   <metadata>
Nov 14 10:03:29 user nova-compute[75229]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 10:03:29 user nova-compute[75229]:       <nova:package version="0.0.0"/>
Nov 14 10:03:29 user nova-compute[75229]:       <nova:name>tempest-VolumesNegativeTest-instance-809592276</nova:name>
Nov 14 10:03:29 user nova-compute[75229]:       <nova:creationTime>2023-11-14 10:03:29</nova:creationTime>
Nov 14 10:03:29 user nova-compute[75229]:       <nova:flavor name="m1.tiny">
Nov 14 10:03:29 user nova-compute[75229]:         <nova:memory>512</nova:memory>
Nov 14 10:03:29 user nova-compute[75229]:         <nova:disk>1</nova:disk>
Nov 14 10:03:29 user nova-compute[75229]:         <nova:swap>0</nova:swap>
Nov 14 10:03:29 user nova-compute[75229]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 10:03:29 user nova-compute[75229]:         <nova:vcpus>1</nova:vcpus>
Nov 14 10:03:29 user nova-compute[75229]:       </nova:flavor>
Nov 14 10:03:29 user nova-compute[75229]:       <nova:owner>
Nov 14 10:03:29 user nova-compute[75229]:         <nova:user uuid="404095151f914441bc37c25126bc533a">tempest-VolumesNegativeTest-186454050-project-member</nova:user>
Nov 14 10:03:29 user nova-compute[75229]:         <nova:project uuid="b47a87b353824259be3f2bc2a9b3c0c3">tempest-VolumesNegativeTest-186454050</nova:project>
Nov 14 10:03:29 user nova-compute[75229]:       </nova:owner>
Nov 14 10:03:29 user nova-compute[75229]:       <nova:root type="image" uuid="3bef8470-ecc7-40e3-95d4-9254348ea72d"/>
Nov 14 10:03:29 user nova-compute[75229]:       <nova:ports>
Nov 14 10:03:29 user nova-compute[75229]:         <nova:port uuid="f9fd5735-8c69-47ca-ab17-2461bf22a2bc">
Nov 14 10:03:29 user nova-compute[75229]:           <nova:ip type="fixed" address="192.168.233.76" ipVersion="4"/>
Nov 14 10:03:29 user nova-compute[75229]:         </nova:port>
Nov 14 10:03:29 user nova-compute[75229]:       </nova:ports>
Nov 14 10:03:29 user nova-compute[75229]:     </nova:instance>
Nov 14 10:03:29 user nova-compute[75229]:   </metadata>
Nov 14 10:03:29 user nova-compute[75229]:   <sysinfo type="smbios">
Nov 14 10:03:29 user nova-compute[75229]:     <system>
Nov 14 10:03:29 user nova-compute[75229]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 10:03:29 user nova-compute[75229]:       <entry name="product">OpenStack Nova</entry>
Nov 14 10:03:29 user nova-compute[75229]:       <entry name="version">0.0.0</entry>
Nov 14 10:03:29 user nova-compute[75229]:       <entry name="serial">de62e75a-207e-4aa3-a592-52f48577c2b9</entry>
Nov 14 10:03:29 user nova-compute[75229]:       <entry name="uuid">de62e75a-207e-4aa3-a592-52f48577c2b9</entry>
Nov 14 10:03:29 user nova-compute[75229]:       <entry name="family">Virtual Machine</entry>
Nov 14 10:03:29 user nova-compute[75229]:     </system>
Nov 14 10:03:29 user nova-compute[75229]:   </sysinfo>
Nov 14 10:03:29 user nova-compute[75229]:   <os>
Nov 14 10:03:29 user nova-compute[75229]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 10:03:29 user nova-compute[75229]:     <boot dev="hd"/>
Nov 14 10:03:29 user nova-compute[75229]:     <smbios mode="sysinfo"/>
Nov 14 10:03:29 user nova-compute[75229]:   </os>
Nov 14 10:03:29 user nova-compute[75229]:   <features>
Nov 14 10:03:29 user nova-compute[75229]:     <acpi/>
Nov 14 10:03:29 user nova-compute[75229]:     <apic/>
Nov 14 10:03:29 user nova-compute[75229]:     <vmcoreinfo/>
Nov 14 10:03:29 user nova-compute[75229]:   </features>
Nov 14 10:03:29 user nova-compute[75229]:   <clock offset="utc">
Nov 14 10:03:29 user nova-compute[75229]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 10:03:29 user nova-compute[75229]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 10:03:29 user nova-compute[75229]:     <timer name="hpet" present="no"/>
Nov 14 10:03:29 user nova-compute[75229]:   </clock>
Nov 14 10:03:29 user nova-compute[75229]:   <cpu mode="custom" match="exact">
Nov 14 10:03:29 user nova-compute[75229]:     <model>Nehalem</model>
Nov 14 10:03:29 user nova-compute[75229]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 10:03:29 user nova-compute[75229]:   </cpu>
Nov 14 10:03:29 user nova-compute[75229]:   <devices>
Nov 14 10:03:29 user nova-compute[75229]:     <disk type="file" device="disk">
Nov 14 10:03:29 user nova-compute[75229]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 10:03:29 user nova-compute[75229]:       <source file="/opt/stack/data/nova/instances/de62e75a-207e-4aa3-a592-52f48577c2b9/disk"/>
Nov 14 10:03:29 user nova-compute[75229]:       <target dev="vda" bus="virtio"/>
Nov 14 10:03:29 user nova-compute[75229]:     </disk>
Nov 14 10:03:29 user nova-compute[75229]:     <interface type="ethernet">
Nov 14 10:03:29 user nova-compute[75229]:       <mac address="fa:16:3e:8b:8b:54"/>
Nov 14 10:03:29 user nova-compute[75229]:       <model type="virtio"/>
Nov 14 10:03:29 user nova-compute[75229]:       <mtu size="1442"/>
Nov 14 10:03:29 user nova-compute[75229]:       <target dev="tapf9fd5735-8c"/>
Nov 14 10:03:29 user nova-compute[75229]:     </interface>
Nov 14 10:03:29 user nova-compute[75229]:     <serial type="pty">
Nov 14 10:03:29 user nova-compute[75229]:       <log file="/opt/stack/data/nova/instances/de62e75a-207e-4aa3-a592-52f48577c2b9/console.log" append="off"/>
Nov 14 10:03:29 user nova-compute[75229]:     </serial>
Nov 14 10:03:29 user nova-compute[75229]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 10:03:29 user nova-compute[75229]:     <video>
Nov 14 10:03:29 user nova-compute[75229]:       <model type="virtio"/>
Nov 14 10:03:29 user nova-compute[75229]:     </video>
Nov 14 10:03:29 user nova-compute[75229]:     <rng model="virtio">
Nov 14 10:03:29 user nova-compute[75229]:       <backend model="random">/dev/urandom</backend>
Nov 14 10:03:29 user nova-compute[75229]:     </rng>
Nov 14 10:03:29 user nova-compute[75229]:     <controller type="usb" index="0" model="none"/>
Nov 14 10:03:29 user nova-compute[75229]:     <memballoon model="virtio">
Nov 14 10:03:29 user nova-compute[75229]:       <stats period="10"/>
Nov 14 10:03:29 user nova-compute[75229]:     </memballoon>
Nov 14 10:03:29 user nova-compute[75229]:   </devices>
Nov 14 10:03:29 user nova-compute[75229]: </domain>
Nov 14 10:03:29 user nova-compute[75229]:  {{(pid=75229) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 10:03:29 user nova-compute[75229]: DEBUG nova.virt.libvirt.vif [None req-a5295160-13ab-48f2-9e39-2744ea306c80 tempest-VolumesNegativeTest-186454050 tempest-VolumesNegativeTest-186454050-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T10:03:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-809592276',display_name='tempest-VolumesNegativeTest-instance-809592276',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-809592276',id=43,image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b47a87b353824259be3f2bc2a9b3c0c3',ramdisk_id='',reservation_id='r-ra043shb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-186454050',owner_user_name='tempest-VolumesNegativeTest-186454050-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T10:03:28Z,user_data=None,user_id='404095151f914441bc37c25126bc533a',uuid=de62e75a-207e-4aa3-a592-52f48577c2b9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f9fd5735-8c69-47ca-ab17-2461bf22a2bc", "address": "fa:16:3e:8b:8b:54", "network": {"id": "f6b0322a-9240-4814-9056-7fabc91b097a", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.76", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "de5a91106b6948ed937a7178ff9464c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9fd5735-8c", "ovs_interfaceid": "f9fd5735-8c69-47ca-ab17-2461bf22a2bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 10:03:29 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-a5295160-13ab-48f2-9e39-2744ea306c80 tempest-VolumesNegativeTest-186454050 tempest-VolumesNegativeTest-186454050-project-member] Converting VIF {"id": "f9fd5735-8c69-47ca-ab17-2461bf22a2bc", "address": "fa:16:3e:8b:8b:54", "network": {"id": "f6b0322a-9240-4814-9056-7fabc91b097a", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.76", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "de5a91106b6948ed937a7178ff9464c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9fd5735-8c", "ovs_interfaceid": "f9fd5735-8c69-47ca-ab17-2461bf22a2bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 10:03:29 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-a5295160-13ab-48f2-9e39-2744ea306c80 tempest-VolumesNegativeTest-186454050 tempest-VolumesNegativeTest-186454050-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8b:8b:54,bridge_name='br-int',has_traffic_filtering=True,id=f9fd5735-8c69-47ca-ab17-2461bf22a2bc,network=Network(f6b0322a-9240-4814-9056-7fabc91b097a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9fd5735-8c') {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 10:03:29 user nova-compute[75229]: DEBUG os_vif [None req-a5295160-13ab-48f2-9e39-2744ea306c80 tempest-VolumesNegativeTest-186454050 tempest-VolumesNegativeTest-186454050-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8b:8b:54,bridge_name='br-int',has_traffic_filtering=True,id=f9fd5735-8c69-47ca-ab17-2461bf22a2bc,network=Network(f6b0322a-9240-4814-9056-7fabc91b097a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9fd5735-8c') {{(pid=75229) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 10:03:29 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:03:29 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 10:03:29 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 10:03:29 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:03:29 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd10f326b-66ec-50e1-83d1-c8f95b3ff2c7', '_type': 'linux-noop'}}, row=False) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 10:03:29 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:03:29 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:03:29 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:03:29 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf9fd5735-8c, may_exist=True, interface_attrs={}) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 10:03:29 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf9fd5735-8c, col_values=(('qos', UUID('909ca202-8e56-4821-8b04-06f0d8aacc1d')),), if_exists=True) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 10:03:29 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf9fd5735-8c, col_values=(('external_ids', {'iface-id': 'f9fd5735-8c69-47ca-ab17-2461bf22a2bc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8b:8b:54', 'vm-uuid': 'de62e75a-207e-4aa3-a592-52f48577c2b9'}),), if_exists=True) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 10:03:29 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:03:29 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 10:03:29 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:03:30 user nova-compute[75229]: INFO os_vif [None req-a5295160-13ab-48f2-9e39-2744ea306c80 tempest-VolumesNegativeTest-186454050 tempest-VolumesNegativeTest-186454050-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8b:8b:54,bridge_name='br-int',has_traffic_filtering=True,id=f9fd5735-8c69-47ca-ab17-2461bf22a2bc,network=Network(f6b0322a-9240-4814-9056-7fabc91b097a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9fd5735-8c')
Nov 14 10:03:30 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-a5295160-13ab-48f2-9e39-2744ea306c80 tempest-VolumesNegativeTest-186454050 tempest-VolumesNegativeTest-186454050-project-member] No BDM found with device name vda, not building metadata. {{(pid=75229) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 10:03:30 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-a5295160-13ab-48f2-9e39-2744ea306c80 tempest-VolumesNegativeTest-186454050 tempest-VolumesNegativeTest-186454050-project-member] No VIF found with MAC fa:16:3e:8b:8b:54, not building metadata {{(pid=75229) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 10:03:30 user nova-compute[75229]: DEBUG nova.network.neutron [req-1fe5f642-54bf-4ce1-aca4-cfea6d54c242 req-71f5efd3-ddd4-454e-a80a-98204d16b241 service nova] [instance: de62e75a-207e-4aa3-a592-52f48577c2b9] Updated VIF entry in instance network info cache for port f9fd5735-8c69-47ca-ab17-2461bf22a2bc. {{(pid=75229) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 10:03:30 user nova-compute[75229]: DEBUG nova.network.neutron [req-1fe5f642-54bf-4ce1-aca4-cfea6d54c242 req-71f5efd3-ddd4-454e-a80a-98204d16b241 service nova] [instance: de62e75a-207e-4aa3-a592-52f48577c2b9] Updating instance_info_cache with network_info: [{"id": "f9fd5735-8c69-47ca-ab17-2461bf22a2bc", "address": "fa:16:3e:8b:8b:54", "network": {"id": "f6b0322a-9240-4814-9056-7fabc91b097a", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.76", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "de5a91106b6948ed937a7178ff9464c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9fd5735-8c", "ovs_interfaceid": "f9fd5735-8c69-47ca-ab17-2461bf22a2bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 10:03:30 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-1fe5f642-54bf-4ce1-aca4-cfea6d54c242 req-71f5efd3-ddd4-454e-a80a-98204d16b241 service nova] Releasing lock "refresh_cache-de62e75a-207e-4aa3-a592-52f48577c2b9" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 10:03:31 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:03:31 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:03:31 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:03:31 user nova-compute[75229]: DEBUG nova.compute.manager [req-12998bb5-e566-4da5-b8a2-a95779d97810 req-26ab50b9-c994-4966-b027-93751da34dcc service nova] [instance: de62e75a-207e-4aa3-a592-52f48577c2b9] Received event network-vif-plugged-f9fd5735-8c69-47ca-ab17-2461bf22a2bc {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 10:03:31 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-12998bb5-e566-4da5-b8a2-a95779d97810 req-26ab50b9-c994-4966-b027-93751da34dcc service nova] Acquiring lock "de62e75a-207e-4aa3-a592-52f48577c2b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:03:31 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-12998bb5-e566-4da5-b8a2-a95779d97810 req-26ab50b9-c994-4966-b027-93751da34dcc service nova] Lock "de62e75a-207e-4aa3-a592-52f48577c2b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:03:31 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-12998bb5-e566-4da5-b8a2-a95779d97810 req-26ab50b9-c994-4966-b027-93751da34dcc service nova] Lock "de62e75a-207e-4aa3-a592-52f48577c2b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:03:31 user nova-compute[75229]: DEBUG nova.compute.manager [req-12998bb5-e566-4da5-b8a2-a95779d97810 req-26ab50b9-c994-4966-b027-93751da34dcc service nova] [instance: de62e75a-207e-4aa3-a592-52f48577c2b9] No waiting events found dispatching network-vif-plugged-f9fd5735-8c69-47ca-ab17-2461bf22a2bc {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 10:03:31 user nova-compute[75229]: WARNING nova.compute.manager [req-12998bb5-e566-4da5-b8a2-a95779d97810 req-26ab50b9-c994-4966-b027-93751da34dcc service nova] [instance: de62e75a-207e-4aa3-a592-52f48577c2b9] Received unexpected event network-vif-plugged-f9fd5735-8c69-47ca-ab17-2461bf22a2bc for instance with vm_state building and task_state spawning.
Nov 14 10:03:31 user nova-compute[75229]: DEBUG nova.compute.manager [req-2c5d5b6e-407f-452d-acc5-c451b18abc51 req-8bef3c95-be6a-4409-a93c-d41af87dc89c service nova] [instance: 7469b999-196b-41c7-9d30-f810b74eaa99] Received event network-changed-66f829f3-daca-440d-9674-c0a116921e54 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 10:03:31 user nova-compute[75229]: DEBUG nova.compute.manager [req-2c5d5b6e-407f-452d-acc5-c451b18abc51 req-8bef3c95-be6a-4409-a93c-d41af87dc89c service nova] [instance: 7469b999-196b-41c7-9d30-f810b74eaa99] Refreshing instance network info cache due to event network-changed-66f829f3-daca-440d-9674-c0a116921e54. {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 10:03:31 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-2c5d5b6e-407f-452d-acc5-c451b18abc51 req-8bef3c95-be6a-4409-a93c-d41af87dc89c service nova] Acquiring lock "refresh_cache-7469b999-196b-41c7-9d30-f810b74eaa99" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 10:03:31 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-2c5d5b6e-407f-452d-acc5-c451b18abc51 req-8bef3c95-be6a-4409-a93c-d41af87dc89c service nova] Acquired lock "refresh_cache-7469b999-196b-41c7-9d30-f810b74eaa99" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 10:03:31 user nova-compute[75229]: DEBUG nova.network.neutron [req-2c5d5b6e-407f-452d-acc5-c451b18abc51 req-8bef3c95-be6a-4409-a93c-d41af87dc89c service nova] [instance: 7469b999-196b-41c7-9d30-f810b74eaa99] Refreshing network info cache for port 66f829f3-daca-440d-9674-c0a116921e54 {{(pid=75229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 10:03:31 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:03:31 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:03:31 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:03:32 user nova-compute[75229]: DEBUG nova.network.neutron [req-2c5d5b6e-407f-452d-acc5-c451b18abc51 req-8bef3c95-be6a-4409-a93c-d41af87dc89c service nova] [instance: 7469b999-196b-41c7-9d30-f810b74eaa99] Updated VIF entry in instance network info cache for port 66f829f3-daca-440d-9674-c0a116921e54. {{(pid=75229) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 10:03:32 user nova-compute[75229]: DEBUG nova.network.neutron [req-2c5d5b6e-407f-452d-acc5-c451b18abc51 req-8bef3c95-be6a-4409-a93c-d41af87dc89c service nova] [instance: 7469b999-196b-41c7-9d30-f810b74eaa99] Updating instance_info_cache with network_info: [{"id": "66f829f3-daca-440d-9674-c0a116921e54", "address": "fa:16:3e:49:6b:8f", "network": {"id": "a8102981-d4c0-4a9f-a380-1bd0c4b230af", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1874599352-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.241", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "806563ad6acd48dfae9a5d6bba121eae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66f829f3-da", "ovs_interfaceid": "66f829f3-daca-440d-9674-c0a116921e54", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 10:03:32 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-2c5d5b6e-407f-452d-acc5-c451b18abc51 req-8bef3c95-be6a-4409-a93c-d41af87dc89c service nova] Releasing lock "refresh_cache-7469b999-196b-41c7-9d30-f810b74eaa99" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 10:03:33 user nova-compute[75229]: DEBUG nova.compute.manager [None req-a5295160-13ab-48f2-9e39-2744ea306c80 tempest-VolumesNegativeTest-186454050 tempest-VolumesNegativeTest-186454050-project-member] [instance: de62e75a-207e-4aa3-a592-52f48577c2b9] Instance event wait completed in 0 seconds for  {{(pid=75229) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 10:03:33 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-a5295160-13ab-48f2-9e39-2744ea306c80 tempest-VolumesNegativeTest-186454050 tempest-VolumesNegativeTest-186454050-project-member] [instance: de62e75a-207e-4aa3-a592-52f48577c2b9] Guest created on hypervisor {{(pid=75229) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 10:03:33 user nova-compute[75229]: INFO nova.virt.libvirt.driver [-] [instance: de62e75a-207e-4aa3-a592-52f48577c2b9] Instance spawned successfully.
Nov 14 10:03:33 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-a5295160-13ab-48f2-9e39-2744ea306c80 tempest-VolumesNegativeTest-186454050 tempest-VolumesNegativeTest-186454050-project-member] [instance: de62e75a-207e-4aa3-a592-52f48577c2b9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 10:03:33 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-a5295160-13ab-48f2-9e39-2744ea306c80 tempest-VolumesNegativeTest-186454050 tempest-VolumesNegativeTest-186454050-project-member] [instance: de62e75a-207e-4aa3-a592-52f48577c2b9] Found default for hw_cdrom_bus of ide {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 10:03:33 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-a5295160-13ab-48f2-9e39-2744ea306c80 tempest-VolumesNegativeTest-186454050 tempest-VolumesNegativeTest-186454050-project-member] [instance: de62e75a-207e-4aa3-a592-52f48577c2b9] Found default for hw_disk_bus of virtio {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 10:03:33 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-a5295160-13ab-48f2-9e39-2744ea306c80 tempest-VolumesNegativeTest-186454050 tempest-VolumesNegativeTest-186454050-project-member] [instance: de62e75a-207e-4aa3-a592-52f48577c2b9] Found default for hw_input_bus of None {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 10:03:33 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-a5295160-13ab-48f2-9e39-2744ea306c80 tempest-VolumesNegativeTest-186454050 tempest-VolumesNegativeTest-186454050-project-member] [instance: de62e75a-207e-4aa3-a592-52f48577c2b9] Found default for hw_pointer_model of None {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 10:03:33 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-a5295160-13ab-48f2-9e39-2744ea306c80 tempest-VolumesNegativeTest-186454050 tempest-VolumesNegativeTest-186454050-project-member] [instance: de62e75a-207e-4aa3-a592-52f48577c2b9] Found default for hw_video_model of virtio {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 10:03:33 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-a5295160-13ab-48f2-9e39-2744ea306c80 tempest-VolumesNegativeTest-186454050 tempest-VolumesNegativeTest-186454050-project-member] [instance: de62e75a-207e-4aa3-a592-52f48577c2b9] Found default for hw_vif_model of virtio {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 10:03:33 user nova-compute[75229]: INFO nova.compute.manager [None req-a5295160-13ab-48f2-9e39-2744ea306c80 tempest-VolumesNegativeTest-186454050 tempest-VolumesNegativeTest-186454050-project-member] [instance: de62e75a-207e-4aa3-a592-52f48577c2b9] Took 5.29 seconds to spawn the instance on the hypervisor.
Nov 14 10:03:33 user nova-compute[75229]: DEBUG nova.compute.manager [None req-a5295160-13ab-48f2-9e39-2744ea306c80 tempest-VolumesNegativeTest-186454050 tempest-VolumesNegativeTest-186454050-project-member] [instance: de62e75a-207e-4aa3-a592-52f48577c2b9] Checking state {{(pid=75229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 10:03:33 user nova-compute[75229]: DEBUG nova.compute.manager [req-3c66b645-213b-47ac-8937-05d9e8e3125b req-c4c978ff-5af1-4d85-8a4a-82fe42061f38 service nova] [instance: de62e75a-207e-4aa3-a592-52f48577c2b9] Received event network-vif-plugged-f9fd5735-8c69-47ca-ab17-2461bf22a2bc {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 10:03:33 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-3c66b645-213b-47ac-8937-05d9e8e3125b req-c4c978ff-5af1-4d85-8a4a-82fe42061f38 service nova] Acquiring lock "de62e75a-207e-4aa3-a592-52f48577c2b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:03:33 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-3c66b645-213b-47ac-8937-05d9e8e3125b req-c4c978ff-5af1-4d85-8a4a-82fe42061f38 service nova] Lock "de62e75a-207e-4aa3-a592-52f48577c2b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:03:33 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-3c66b645-213b-47ac-8937-05d9e8e3125b req-c4c978ff-5af1-4d85-8a4a-82fe42061f38 service nova] Lock "de62e75a-207e-4aa3-a592-52f48577c2b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:03:33 user nova-compute[75229]: DEBUG nova.compute.manager [req-3c66b645-213b-47ac-8937-05d9e8e3125b req-c4c978ff-5af1-4d85-8a4a-82fe42061f38 service nova] [instance: de62e75a-207e-4aa3-a592-52f48577c2b9] No waiting events found dispatching network-vif-plugged-f9fd5735-8c69-47ca-ab17-2461bf22a2bc {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 10:03:33 user nova-compute[75229]: WARNING nova.compute.manager [req-3c66b645-213b-47ac-8937-05d9e8e3125b req-c4c978ff-5af1-4d85-8a4a-82fe42061f38 service nova] [instance: de62e75a-207e-4aa3-a592-52f48577c2b9] Received unexpected event network-vif-plugged-f9fd5735-8c69-47ca-ab17-2461bf22a2bc for instance with vm_state building and task_state spawning.
Nov 14 10:03:33 user nova-compute[75229]: INFO nova.compute.manager [None req-a5295160-13ab-48f2-9e39-2744ea306c80 tempest-VolumesNegativeTest-186454050 tempest-VolumesNegativeTest-186454050-project-member] [instance: de62e75a-207e-4aa3-a592-52f48577c2b9] Took 6.05 seconds to build instance.
Nov 14 10:03:33 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-a5295160-13ab-48f2-9e39-2744ea306c80 tempest-VolumesNegativeTest-186454050 tempest-VolumesNegativeTest-186454050-project-member] Lock "de62e75a-207e-4aa3-a592-52f48577c2b9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.151s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:03:33 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:03:34 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-e16ecdcc-fbdf-4c75-9a80-6d2745ae7e45 tempest-TestServerVolumeAttachScenarioOldVersion-2038862331 tempest-TestServerVolumeAttachScenarioOldVersion-2038862331-project-member] Acquiring lock "7469b999-196b-41c7-9d30-f810b74eaa99" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:03:34 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-e16ecdcc-fbdf-4c75-9a80-6d2745ae7e45 tempest-TestServerVolumeAttachScenarioOldVersion-2038862331 tempest-TestServerVolumeAttachScenarioOldVersion-2038862331-project-member] Lock "7469b999-196b-41c7-9d30-f810b74eaa99" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:03:34 user nova-compute[75229]: DEBUG nova.objects.instance [None req-e16ecdcc-fbdf-4c75-9a80-6d2745ae7e45 tempest-TestServerVolumeAttachScenarioOldVersion-2038862331 tempest-TestServerVolumeAttachScenarioOldVersion-2038862331-project-member] Lazy-loading 'flavor' on Instance uuid 7469b999-196b-41c7-9d30-f810b74eaa99 {{(pid=75229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 10:03:34 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-e16ecdcc-fbdf-4c75-9a80-6d2745ae7e45 tempest-TestServerVolumeAttachScenarioOldVersion-2038862331 tempest-TestServerVolumeAttachScenarioOldVersion-2038862331-project-member] Lock "7469b999-196b-41c7-9d30-f810b74eaa99" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:03:34 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-e16ecdcc-fbdf-4c75-9a80-6d2745ae7e45 tempest-TestServerVolumeAttachScenarioOldVersion-2038862331 tempest-TestServerVolumeAttachScenarioOldVersion-2038862331-project-member] Acquiring lock "7469b999-196b-41c7-9d30-f810b74eaa99" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:03:34 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-e16ecdcc-fbdf-4c75-9a80-6d2745ae7e45 tempest-TestServerVolumeAttachScenarioOldVersion-2038862331 tempest-TestServerVolumeAttachScenarioOldVersion-2038862331-project-member] Lock "7469b999-196b-41c7-9d30-f810b74eaa99" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:03:34 user nova-compute[75229]: INFO nova.compute.manager [None req-e16ecdcc-fbdf-4c75-9a80-6d2745ae7e45 tempest-TestServerVolumeAttachScenarioOldVersion-2038862331 tempest-TestServerVolumeAttachScenarioOldVersion-2038862331-project-member] [instance: 7469b999-196b-41c7-9d30-f810b74eaa99] Attaching volume 55d338b4-2353-4501-b00d-fafa0dfe8758 to /dev/vdb
Nov 14 10:03:34 user nova-compute[75229]: DEBUG os_brick.utils [None req-e16ecdcc-fbdf-4c75-9a80-6d2745ae7e45 tempest-TestServerVolumeAttachScenarioOldVersion-2038862331 tempest-TestServerVolumeAttachScenarioOldVersion-2038862331-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 10:03:34 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:03:34 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:03:34 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[a78f8ec7-fde3-43d5-997a-8976305da64f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f1154031c835\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:03:34 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:03:34 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:03:34 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[a04670e6-9a4b-49fa-a06c-91281cb439d8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:03:34 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:03:34 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:03:34 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ecdbac6-8f38-4e96-a4cf-9a2280749962]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:03:34 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7c396d3-ca9d-4e9d-8c70-c5c0cebe444b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:03:34 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-e16ecdcc-fbdf-4c75-9a80-6d2745ae7e45 tempest-TestServerVolumeAttachScenarioOldVersion-2038862331 tempest-TestServerVolumeAttachScenarioOldVersion-2038862331-project-member] Running cmd (subprocess): nvme version {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:03:34 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-e16ecdcc-fbdf-4c75-9a80-6d2745ae7e45 tempest-TestServerVolumeAttachScenarioOldVersion-2038862331 tempest-TestServerVolumeAttachScenarioOldVersion-2038862331-project-member] 'nvme version' failed. Not Retrying. {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 10:03:34 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e16ecdcc-fbdf-4c75-9a80-6d2745ae7e45 tempest-TestServerVolumeAttachScenarioOldVersion-2038862331 tempest-TestServerVolumeAttachScenarioOldVersion-2038862331-project-member] nvme not present on system {{(pid=75229) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 10:03:34 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:03:34 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 10:03:34 user nova-compute[75229]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 10:03:34 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c3943cc-978a-4bec-953c-0ebb2144bec2]: (4, '') {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:03:34 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.lightos [None req-e16ecdcc-fbdf-4c75-9a80-6d2745ae7e45 tempest-TestServerVolumeAttachScenarioOldVersion-2038862331 tempest-TestServerVolumeAttachScenarioOldVersion-2038862331-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75229) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 10:03:34 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.lightos [None req-e16ecdcc-fbdf-4c75-9a80-6d2745ae7e45 tempest-TestServerVolumeAttachScenarioOldVersion-2038862331 tempest-TestServerVolumeAttachScenarioOldVersion-2038862331-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75229) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 10:03:34 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.lightos [None req-e16ecdcc-fbdf-4c75-9a80-6d2745ae7e45 tempest-TestServerVolumeAttachScenarioOldVersion-2038862331 tempest-TestServerVolumeAttachScenarioOldVersion-2038862331-project-member] LIGHTOS: no hostnqn found. {{(pid=75229) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 10:03:34 user nova-compute[75229]: DEBUG os_brick.utils [None req-e16ecdcc-fbdf-4c75-9a80-6d2745ae7e45 tempest-TestServerVolumeAttachScenarioOldVersion-2038862331 tempest-TestServerVolumeAttachScenarioOldVersion-2038862331-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f1154031c835', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 10:03:34 user nova-compute[75229]: DEBUG nova.virt.block_device [None req-e16ecdcc-fbdf-4c75-9a80-6d2745ae7e45 tempest-TestServerVolumeAttachScenarioOldVersion-2038862331 tempest-TestServerVolumeAttachScenarioOldVersion-2038862331-project-member] [instance: 7469b999-196b-41c7-9d30-f810b74eaa99] Updating existing volume attachment record: f62a86b5-871f-44dc-9d39-ef8af11e4cfd {{(pid=75229) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 10:03:34 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:03:38 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:03:39 user nova-compute[75229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e16ecdcc-fbdf-4c75-9a80-6d2745ae7e45 tempest-TestServerVolumeAttachScenarioOldVersion-2038862331 tempest-TestServerVolumeAttachScenarioOldVersion-2038862331-project-member] [instance: 7469b999-196b-41c7-9d30-f810b74eaa99] Calling os-brick to attach iSCSI Volume {{(pid=75229) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 10:03:39 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-e16ecdcc-fbdf-4c75-9a80-6d2745ae7e45 tempest-TestServerVolumeAttachScenarioOldVersion-2038862331 tempest-TestServerVolumeAttachScenarioOldVersion-2038862331-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f73f85151b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:55d338b4-2353-4501-b00d-fafa0dfe8758', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FjirgtNV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 10:03:39 user nova-compute[75229]: WARNING os_brick.initiator.connectors.base [None req-e16ecdcc-fbdf-4c75-9a80-6d2745ae7e45 tempest-TestServerVolumeAttachScenarioOldVersion-2038862331 tempest-TestServerVolumeAttachScenarioOldVersion-2038862331-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 10:03:39 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-e16ecdcc-fbdf-4c75-9a80-6d2745ae7e45 tempest-TestServerVolumeAttachScenarioOldVersion-2038862331 tempest-TestServerVolumeAttachScenarioOldVersion-2038862331-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 10:03:39 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-e16ecdcc-fbdf-4c75-9a80-6d2745ae7e45 tempest-TestServerVolumeAttachScenarioOldVersion-2038862331 tempest-TestServerVolumeAttachScenarioOldVersion-2038862331-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 10:03:39 user nova-compute[75229]: WARNING os_brick.initiator.connectors.base [None req-e16ecdcc-fbdf-4c75-9a80-6d2745ae7e45 tempest-TestServerVolumeAttachScenarioOldVersion-2038862331 tempest-TestServerVolumeAttachScenarioOldVersion-2038862331-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 10:03:39 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-e16ecdcc-fbdf-4c75-9a80-6d2745ae7e45 tempest-TestServerVolumeAttachScenarioOldVersion-2038862331 tempest-TestServerVolumeAttachScenarioOldVersion-2038862331-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:55d338b4-2353-4501-b00d-fafa0dfe8758" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 10:03:39 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-e16ecdcc-fbdf-4c75-9a80-6d2745ae7e45 tempest-TestServerVolumeAttachScenarioOldVersion-2038862331 tempest-TestServerVolumeAttachScenarioOldVersion-2038862331-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:55d338b4-2353-4501-b00d-fafa0dfe8758" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 10:03:39 user nova-compute[75229]: INFO os_brick.initiator.connectors.iscsi [None req-e16ecdcc-fbdf-4c75-9a80-6d2745ae7e45 tempest-TestServerVolumeAttachScenarioOldVersion-2038862331 tempest-TestServerVolumeAttachScenarioOldVersion-2038862331-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 10:03:39 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55d338b4-2353-4501-b00d-fafa0dfe8758 -p 172.16.0.220:3260 {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:03:39 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55d338b4-2353-4501-b00d-fafa0dfe8758 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:03:39 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[47c5479e-6550-439e-ad5f-8501aaa3a590]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:03:39 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-e16ecdcc-fbdf-4c75-9a80-6d2745ae7e45 tempest-TestServerVolumeAttachScenarioOldVersion-2038862331 tempest-TestServerVolumeAttachScenarioOldVersion-2038862331-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 10:03:39 user nova-compute[75229]:  {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 10:03:39 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55d338b4-2353-4501-b00d-fafa0dfe8758 -p 172.16.0.220:3260 --interface default --op new {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:03:39 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55d338b4-2353-4501-b00d-fafa0dfe8758 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:03:39 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[edba95a2-a7a3-4639-bc1c-c181fc859335]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:55d338b4-2353-4501-b00d-fafa0dfe8758] added\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:03:39 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-e16ecdcc-fbdf-4c75-9a80-6d2745ae7e45 tempest-TestServerVolumeAttachScenarioOldVersion-2038862331 tempest-TestServerVolumeAttachScenarioOldVersion-2038862331-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:55d338b4-2353-4501-b00d-fafa0dfe8758] added
Nov 14 10:03:39 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 10:03:39 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55d338b4-2353-4501-b00d-fafa0dfe8758 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:03:39 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55d338b4-2353-4501-b00d-fafa0dfe8758 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:03:39 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[372c7333-2221-477b-949e-84fdc00e9bb2]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:03:39 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-e16ecdcc-fbdf-4c75-9a80-6d2745ae7e45 tempest-TestServerVolumeAttachScenarioOldVersion-2038862331 tempest-TestServerVolumeAttachScenarioOldVersion-2038862331-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 10:03:39 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55d338b4-2353-4501-b00d-fafa0dfe8758 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:03:39 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55d338b4-2353-4501-b00d-fafa0dfe8758 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:03:39 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[115e101b-27f8-48c5-9940-a16b7cbe98dc]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:03:39 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-e16ecdcc-fbdf-4c75-9a80-6d2745ae7e45 tempest-TestServerVolumeAttachScenarioOldVersion-2038862331 tempest-TestServerVolumeAttachScenarioOldVersion-2038862331-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 10:03:39 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55d338b4-2353-4501-b00d-fafa0dfe8758 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FjirgtNV {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:03:39 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55d338b4-2353-4501-b00d-fafa0dfe8758 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FjirgtNV" returned: 0 in 0.017s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:03:39 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[2389ead5-ada4-4985-a953-650f6e68bfac]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:03:39 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-e16ecdcc-fbdf-4c75-9a80-6d2745ae7e45 tempest-TestServerVolumeAttachScenarioOldVersion-2038862331 tempest-TestServerVolumeAttachScenarioOldVersion-2038862331-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'FjirgtNV'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 10:03:39 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55d338b4-2353-4501-b00d-fafa0dfe8758 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:03:39 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55d338b4-2353-4501-b00d-fafa0dfe8758 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:03:39 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[b667ae2f-64c6-4dca-a150-66f4689a58ed]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:03:39 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-e16ecdcc-fbdf-4c75-9a80-6d2745ae7e45 tempest-TestServerVolumeAttachScenarioOldVersion-2038862331 tempest-TestServerVolumeAttachScenarioOldVersion-2038862331-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 10:03:39 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:03:39 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:03:39 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[bef5c248-ec92-4db6-a6f2-8e3f86e7d826]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aebc438-0289-44fe-ad84-4e696468f50e (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2977635e-b11f-4ab2-875c-e9f396b932dc (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64caa5ab-59eb-4251-9cef-f8576154c443 (non-flash)\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:03:39 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-e16ecdcc-fbdf-4c75-9a80-6d2745ae7e45 tempest-TestServerVolumeAttachScenarioOldVersion-2038862331 tempest-TestServerVolumeAttachScenarioOldVersion-2038862331-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aebc438-0289-44fe-ad84-4e696468f50e (non-flash)
Nov 14 10:03:39 user nova-compute[75229]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2977635e-b11f-4ab2-875c-e9f396b932dc (non-flash)
Nov 14 10:03:39 user nova-compute[75229]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64caa5ab-59eb-4251-9cef-f8576154c443 (non-flash)
Nov 14 10:03:39 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 10:03:39 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-e16ecdcc-fbdf-4c75-9a80-6d2745ae7e45 tempest-TestServerVolumeAttachScenarioOldVersion-2038862331 tempest-TestServerVolumeAttachScenarioOldVersion-2038862331-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aebc438-0289-44fe-ad84-4e696468f50e (non-flash)
Nov 14 10:03:39 user nova-compute[75229]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2977635e-b11f-4ab2-875c-e9f396b932dc (non-flash)
Nov 14 10:03:39 user nova-compute[75229]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64caa5ab-59eb-4251-9cef-f8576154c443 (non-flash)
Nov 14 10:03:39 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 10:03:39 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55d338b4-2353-4501-b00d-fafa0dfe8758 -p 172.16.0.220:3260 --login {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:03:39 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55d338b4-2353-4501-b00d-fafa0dfe8758 -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:03:39 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[ead5f33b-7bed-42f1-885d-f3d12fa15cfc]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:55d338b4-2353-4501-b00d-fafa0dfe8758, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:55d338b4-2353-4501-b00d-fafa0dfe8758, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:03:39 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-e16ecdcc-fbdf-4c75-9a80-6d2745ae7e45 tempest-TestServerVolumeAttachScenarioOldVersion-2038862331 tempest-TestServerVolumeAttachScenarioOldVersion-2038862331-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:55d338b4-2353-4501-b00d-fafa0dfe8758, portal: 172.16.0.220,3260]
Nov 14 10:03:39 user nova-compute[75229]: Login to [iface: default, target: iqn.2010-10.org.openstack:55d338b4-2353-4501-b00d-fafa0dfe8758, portal: 172.16.0.220,3260] successful.
Nov 14 10:03:39 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 10:03:39 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55d338b4-2353-4501-b00d-fafa0dfe8758 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:03:39 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55d338b4-2353-4501-b00d-fafa0dfe8758 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:03:39 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[95d5adf1-2a13-43c9-b6f6-7fb4631437ab]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:03:39 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-e16ecdcc-fbdf-4c75-9a80-6d2745ae7e45 tempest-TestServerVolumeAttachScenarioOldVersion-2038862331 tempest-TestServerVolumeAttachScenarioOldVersion-2038862331-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 10:03:39 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:03:39 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:03:39 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[55d456aa-6fc3-4c1f-9e45-ec0740461ada]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aebc438-0289-44fe-ad84-4e696468f50e (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2977635e-b11f-4ab2-875c-e9f396b932dc (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64caa5ab-59eb-4251-9cef-f8576154c443 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55d338b4-2353-4501-b00d-fafa0dfe8758 (non-flash)\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:03:39 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-e16ecdcc-fbdf-4c75-9a80-6d2745ae7e45 tempest-TestServerVolumeAttachScenarioOldVersion-2038862331 tempest-TestServerVolumeAttachScenarioOldVersion-2038862331-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aebc438-0289-44fe-ad84-4e696468f50e (non-flash)
Nov 14 10:03:39 user nova-compute[75229]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2977635e-b11f-4ab2-875c-e9f396b932dc (non-flash)
Nov 14 10:03:39 user nova-compute[75229]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64caa5ab-59eb-4251-9cef-f8576154c443 (non-flash)
Nov 14 10:03:39 user nova-compute[75229]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55d338b4-2353-4501-b00d-fafa0dfe8758 (non-flash)
Nov 14 10:03:39 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 10:03:39 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-e16ecdcc-fbdf-4c75-9a80-6d2745ae7e45 tempest-TestServerVolumeAttachScenarioOldVersion-2038862331 tempest-TestServerVolumeAttachScenarioOldVersion-2038862331-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aebc438-0289-44fe-ad84-4e696468f50e (non-flash)
Nov 14 10:03:39 user nova-compute[75229]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2977635e-b11f-4ab2-875c-e9f396b932dc (non-flash)
Nov 14 10:03:39 user nova-compute[75229]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64caa5ab-59eb-4251-9cef-f8576154c443 (non-flash)
Nov 14 10:03:39 user nova-compute[75229]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55d338b4-2353-4501-b00d-fafa0dfe8758 (non-flash)
Nov 14 10:03:39 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 10:03:39 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-e16ecdcc-fbdf-4c75-9a80-6d2745ae7e45 tempest-TestServerVolumeAttachScenarioOldVersion-2038862331 tempest-TestServerVolumeAttachScenarioOldVersion-2038862331-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:55d338b4-2353-4501-b00d-fafa0dfe8758" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.281s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 10:03:39 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-e16ecdcc-fbdf-4c75-9a80-6d2745ae7e45 tempest-TestServerVolumeAttachScenarioOldVersion-2038862331 tempest-TestServerVolumeAttachScenarioOldVersion-2038862331-project-member] Connected to 172.16.0.220:3260 {{(pid=75229) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 10:03:39 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-e16ecdcc-fbdf-4c75-9a80-6d2745ae7e45 tempest-TestServerVolumeAttachScenarioOldVersion-2038862331 tempest-TestServerVolumeAttachScenarioOldVersion-2038862331-project-member] HCTL ('35', '-', '-', 0) found on session 43 with lun 0 {{(pid=75229) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 10:03:39 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-e16ecdcc-fbdf-4c75-9a80-6d2745ae7e45 tempest-TestServerVolumeAttachScenarioOldVersion-2038862331 tempest-TestServerVolumeAttachScenarioOldVersion-2038862331-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75229) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 10:03:39 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:03:39 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:03:39 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e824c7b-7665-4bda-876d-253c932d1bd1]: (4, ('- - 0', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:03:39 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-e16ecdcc-fbdf-4c75-9a80-6d2745ae7e45 tempest-TestServerVolumeAttachScenarioOldVersion-2038862331 tempest-TestServerVolumeAttachScenarioOldVersion-2038862331-project-member] Searching for a device in session 43 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75229) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 10:03:39 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-e16ecdcc-fbdf-4c75-9a80-6d2745ae7e45 tempest-TestServerVolumeAttachScenarioOldVersion-2038862331 tempest-TestServerVolumeAttachScenarioOldVersion-2038862331-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:55d338b4-2353-4501-b00d-fafa0dfe8758', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FjirgtNV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75229) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 10:03:39 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:03:40 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-e16ecdcc-fbdf-4c75-9a80-6d2745ae7e45 tempest-TestServerVolumeAttachScenarioOldVersion-2038862331 tempest-TestServerVolumeAttachScenarioOldVersion-2038862331-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.318s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 10:03:40 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-e16ecdcc-fbdf-4c75-9a80-6d2745ae7e45 tempest-TestServerVolumeAttachScenarioOldVersion-2038862331 tempest-TestServerVolumeAttachScenarioOldVersion-2038862331-project-member] <== connect_volume: return (1320ms) {'type': 'block', 'scsi_wwn': '26361633761386539', 'path': '/dev/sdd'} {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 10:03:40 user nova-compute[75229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e16ecdcc-fbdf-4c75-9a80-6d2745ae7e45 tempest-TestServerVolumeAttachScenarioOldVersion-2038862331 tempest-TestServerVolumeAttachScenarioOldVersion-2038862331-project-member] [instance: 7469b999-196b-41c7-9d30-f810b74eaa99] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26361633761386539', 'path': '/dev/sdd'} {{(pid=75229) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 10:03:40 user nova-compute[75229]: DEBUG nova.objects.instance [None req-e16ecdcc-fbdf-4c75-9a80-6d2745ae7e45 tempest-TestServerVolumeAttachScenarioOldVersion-2038862331 tempest-TestServerVolumeAttachScenarioOldVersion-2038862331-project-member] Lazy-loading 'flavor' on Instance uuid 7469b999-196b-41c7-9d30-f810b74eaa99 {{(pid=75229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 10:03:40 user nova-compute[75229]: DEBUG nova.virt.libvirt.guest [None req-e16ecdcc-fbdf-4c75-9a80-6d2745ae7e45 tempest-TestServerVolumeAttachScenarioOldVersion-2038862331 tempest-TestServerVolumeAttachScenarioOldVersion-2038862331-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 10:03:40 user nova-compute[75229]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 10:03:40 user nova-compute[75229]:   <source dev="/dev/sdd"/>
Nov 14 10:03:40 user nova-compute[75229]:   <target dev="vdb" bus="virtio"/>
Nov 14 10:03:40 user nova-compute[75229]:   <serial>55d338b4-2353-4501-b00d-fafa0dfe8758</serial>
Nov 14 10:03:40 user nova-compute[75229]: </disk>
Nov 14 10:03:40 user nova-compute[75229]:  {{(pid=75229) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 10:03:40 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:03:40 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-e16ecdcc-fbdf-4c75-9a80-6d2745ae7e45 tempest-TestServerVolumeAttachScenarioOldVersion-2038862331 tempest-TestServerVolumeAttachScenarioOldVersion-2038862331-project-member] No BDM found with device name vda, not building metadata. {{(pid=75229) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 10:03:40 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-e16ecdcc-fbdf-4c75-9a80-6d2745ae7e45 tempest-TestServerVolumeAttachScenarioOldVersion-2038862331 tempest-TestServerVolumeAttachScenarioOldVersion-2038862331-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75229) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 10:03:40 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-e16ecdcc-fbdf-4c75-9a80-6d2745ae7e45 tempest-TestServerVolumeAttachScenarioOldVersion-2038862331 tempest-TestServerVolumeAttachScenarioOldVersion-2038862331-project-member] No VIF found with MAC fa:16:3e:49:6b:8f, not building metadata {{(pid=75229) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 10:03:41 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-e16ecdcc-fbdf-4c75-9a80-6d2745ae7e45 tempest-TestServerVolumeAttachScenarioOldVersion-2038862331 tempest-TestServerVolumeAttachScenarioOldVersion-2038862331-project-member] Lock "7469b999-196b-41c7-9d30-f810b74eaa99" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.718s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:03:43 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-4e4e6ab2-3668-4c99-881f-c8736dbdd3bb tempest-TestServerVolumeAttachScenarioOldVersion-2038862331 tempest-TestServerVolumeAttachScenarioOldVersion-2038862331-project-member] Acquiring lock "7469b999-196b-41c7-9d30-f810b74eaa99" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:03:43 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-4e4e6ab2-3668-4c99-881f-c8736dbdd3bb tempest-TestServerVolumeAttachScenarioOldVersion-2038862331 tempest-TestServerVolumeAttachScenarioOldVersion-2038862331-project-member] Lock "7469b999-196b-41c7-9d30-f810b74eaa99" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:03:43 user nova-compute[75229]: INFO nova.compute.manager [None req-4e4e6ab2-3668-4c99-881f-c8736dbdd3bb tempest-TestServerVolumeAttachScenarioOldVersion-2038862331 tempest-TestServerVolumeAttachScenarioOldVersion-2038862331-project-member] [instance: 7469b999-196b-41c7-9d30-f810b74eaa99] Detaching volume 55d338b4-2353-4501-b00d-fafa0dfe8758
Nov 14 10:03:43 user nova-compute[75229]: INFO nova.virt.block_device [None req-4e4e6ab2-3668-4c99-881f-c8736dbdd3bb tempest-TestServerVolumeAttachScenarioOldVersion-2038862331 tempest-TestServerVolumeAttachScenarioOldVersion-2038862331-project-member] [instance: 7469b999-196b-41c7-9d30-f810b74eaa99] Attempting to driver detach volume 55d338b4-2353-4501-b00d-fafa0dfe8758 from mountpoint /dev/vdb
Nov 14 10:03:43 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-4e4e6ab2-3668-4c99-881f-c8736dbdd3bb tempest-TestServerVolumeAttachScenarioOldVersion-2038862331 tempest-TestServerVolumeAttachScenarioOldVersion-2038862331-project-member] Attempting to detach device vdb from instance 7469b999-196b-41c7-9d30-f810b74eaa99 from the persistent domain config. {{(pid=75229) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 10:03:43 user nova-compute[75229]: DEBUG nova.virt.libvirt.guest [None req-4e4e6ab2-3668-4c99-881f-c8736dbdd3bb tempest-TestServerVolumeAttachScenarioOldVersion-2038862331 tempest-TestServerVolumeAttachScenarioOldVersion-2038862331-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 10:03:43 user nova-compute[75229]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 10:03:43 user nova-compute[75229]:   <source dev="/dev/sdd"/>
Nov 14 10:03:43 user nova-compute[75229]:   <target dev="vdb" bus="virtio"/>
Nov 14 10:03:43 user nova-compute[75229]:   <serial>55d338b4-2353-4501-b00d-fafa0dfe8758</serial>
Nov 14 10:03:43 user nova-compute[75229]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 10:03:43 user nova-compute[75229]: </disk>
Nov 14 10:03:43 user nova-compute[75229]:  {{(pid=75229) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 10:03:43 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-4e4e6ab2-3668-4c99-881f-c8736dbdd3bb tempest-TestServerVolumeAttachScenarioOldVersion-2038862331 tempest-TestServerVolumeAttachScenarioOldVersion-2038862331-project-member] Successfully detached device vdb from instance 7469b999-196b-41c7-9d30-f810b74eaa99 from the persistent domain config.
Nov 14 10:03:43 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-4e4e6ab2-3668-4c99-881f-c8736dbdd3bb tempest-TestServerVolumeAttachScenarioOldVersion-2038862331 tempest-TestServerVolumeAttachScenarioOldVersion-2038862331-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 7469b999-196b-41c7-9d30-f810b74eaa99 from the live domain config. {{(pid=75229) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 10:03:43 user nova-compute[75229]: DEBUG nova.virt.libvirt.guest [None req-4e4e6ab2-3668-4c99-881f-c8736dbdd3bb tempest-TestServerVolumeAttachScenarioOldVersion-2038862331 tempest-TestServerVolumeAttachScenarioOldVersion-2038862331-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 10:03:43 user nova-compute[75229]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 10:03:43 user nova-compute[75229]:   <source dev="/dev/sdd"/>
Nov 14 10:03:43 user nova-compute[75229]:   <target dev="vdb" bus="virtio"/>
Nov 14 10:03:43 user nova-compute[75229]:   <serial>55d338b4-2353-4501-b00d-fafa0dfe8758</serial>
Nov 14 10:03:43 user nova-compute[75229]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 10:03:43 user nova-compute[75229]: </disk>
Nov 14 10:03:43 user nova-compute[75229]:  {{(pid=75229) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 10:03:44 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-4e4e6ab2-3668-4c99-881f-c8736dbdd3bb tempest-TestServerVolumeAttachScenarioOldVersion-2038862331 tempest-TestServerVolumeAttachScenarioOldVersion-2038862331-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 7469b999-196b-41c7-9d30-f810b74eaa99 {{(pid=75229) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 10:03:44 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:03:44 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:03:48 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:03:49 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:03:49 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:03:51 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:03:53 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:03:54 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:03:55 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:03:55 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-57306f0d-e48c-483d-b92b-209b6bb5ec8b tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Acquiring lock "abb8e340-164d-4bc2-a503-7e8ea3c9b35b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:03:55 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-57306f0d-e48c-483d-b92b-209b6bb5ec8b tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Lock "abb8e340-164d-4bc2-a503-7e8ea3c9b35b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:03:55 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-57306f0d-e48c-483d-b92b-209b6bb5ec8b tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Acquiring lock "abb8e340-164d-4bc2-a503-7e8ea3c9b35b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:03:55 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-57306f0d-e48c-483d-b92b-209b6bb5ec8b tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Lock "abb8e340-164d-4bc2-a503-7e8ea3c9b35b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:03:55 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-57306f0d-e48c-483d-b92b-209b6bb5ec8b tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Lock "abb8e340-164d-4bc2-a503-7e8ea3c9b35b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:03:55 user nova-compute[75229]: INFO nova.compute.manager [None req-57306f0d-e48c-483d-b92b-209b6bb5ec8b tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] [instance: abb8e340-164d-4bc2-a503-7e8ea3c9b35b] Terminating instance
Nov 14 10:03:55 user nova-compute[75229]: DEBUG nova.compute.manager [None req-57306f0d-e48c-483d-b92b-209b6bb5ec8b tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] [instance: abb8e340-164d-4bc2-a503-7e8ea3c9b35b] Start destroying the instance on the hypervisor. {{(pid=75229) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 10:03:55 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:03:55 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:03:55 user nova-compute[75229]: DEBUG nova.compute.manager [req-8ff29324-31c1-4990-943f-7c23d1fd0c3d req-f62ec43c-a0a9-4645-bdf9-be3cd307798d service nova] [instance: abb8e340-164d-4bc2-a503-7e8ea3c9b35b] Received event network-vif-unplugged-37ce4717-9a82-41c6-9d89-f1e55b9ae398 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 10:03:55 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-8ff29324-31c1-4990-943f-7c23d1fd0c3d req-f62ec43c-a0a9-4645-bdf9-be3cd307798d service nova] Acquiring lock "abb8e340-164d-4bc2-a503-7e8ea3c9b35b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:03:55 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-8ff29324-31c1-4990-943f-7c23d1fd0c3d req-f62ec43c-a0a9-4645-bdf9-be3cd307798d service nova] Lock "abb8e340-164d-4bc2-a503-7e8ea3c9b35b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:03:55 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-8ff29324-31c1-4990-943f-7c23d1fd0c3d req-f62ec43c-a0a9-4645-bdf9-be3cd307798d service nova] Lock "abb8e340-164d-4bc2-a503-7e8ea3c9b35b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:03:55 user nova-compute[75229]: DEBUG nova.compute.manager [req-8ff29324-31c1-4990-943f-7c23d1fd0c3d req-f62ec43c-a0a9-4645-bdf9-be3cd307798d service nova] [instance: abb8e340-164d-4bc2-a503-7e8ea3c9b35b] No waiting events found dispatching network-vif-unplugged-37ce4717-9a82-41c6-9d89-f1e55b9ae398 {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 10:03:55 user nova-compute[75229]: DEBUG nova.compute.manager [req-8ff29324-31c1-4990-943f-7c23d1fd0c3d req-f62ec43c-a0a9-4645-bdf9-be3cd307798d service nova] [instance: abb8e340-164d-4bc2-a503-7e8ea3c9b35b] Received event network-vif-unplugged-37ce4717-9a82-41c6-9d89-f1e55b9ae398 for instance with task_state deleting. {{(pid=75229) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 10:03:55 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:03:55 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:03:55 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:03:55 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:03:55 user nova-compute[75229]: INFO nova.virt.libvirt.driver [-] [instance: abb8e340-164d-4bc2-a503-7e8ea3c9b35b] Instance destroyed successfully.
Nov 14 10:03:55 user nova-compute[75229]: DEBUG nova.objects.instance [None req-57306f0d-e48c-483d-b92b-209b6bb5ec8b tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Lazy-loading 'resources' on Instance uuid abb8e340-164d-4bc2-a503-7e8ea3c9b35b {{(pid=75229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 10:03:55 user nova-compute[75229]: DEBUG nova.virt.libvirt.vif [None req-57306f0d-e48c-483d-b92b-209b6bb5ec8b tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T09:57:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-852653284',display_name='tempest-ServerRescueNegativeTestJSON-server-852653284',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-852653284',id=35,image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIdhYa6J6ux6sEyjhtSOnIdcpfqYBU0T4i4xdWqDC4Ach0c+1fPVMeRgGZTsfJf+pkb1r79lSZ/ejqownl7uMFcdcqgEpgtqZeQb5GYf0i6txS0oNHoP6L0HNRQYfOpjeg==',key_name='tempest-keypair-411272448',keypairs=<?>,launch_index=0,launched_at=2023-11-14T09:59:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='46457b27e3ed416e827c3c22449fb512',ramdisk_id='',reservation_id='r-ajfymruw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-557279920',owner_user_name='tempest-ServerRescueNegativeTestJSON-557279920-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T10:01:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a3cb33a5c522499e8cd254edd5e15879',uuid=abb8e340-164d-4bc2-a503-7e8ea3c9b35b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "37ce4717-9a82-41c6-9d89-f1e55b9ae398", "address": "fa:16:3e:92:c4:4b", "network": {"id": "22eed29e-7148-42f9-b4c7-b97811cba8eb", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2000485731-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.13", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46457b27e3ed416e827c3c22449fb512", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37ce4717-9a", "ovs_interfaceid": "37ce4717-9a82-41c6-9d89-f1e55b9ae398", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 10:03:55 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-57306f0d-e48c-483d-b92b-209b6bb5ec8b tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Converting VIF {"id": "37ce4717-9a82-41c6-9d89-f1e55b9ae398", "address": "fa:16:3e:92:c4:4b", "network": {"id": "22eed29e-7148-42f9-b4c7-b97811cba8eb", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2000485731-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.13", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46457b27e3ed416e827c3c22449fb512", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37ce4717-9a", "ovs_interfaceid": "37ce4717-9a82-41c6-9d89-f1e55b9ae398", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 10:03:55 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-57306f0d-e48c-483d-b92b-209b6bb5ec8b tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:92:c4:4b,bridge_name='br-int',has_traffic_filtering=True,id=37ce4717-9a82-41c6-9d89-f1e55b9ae398,network=Network(22eed29e-7148-42f9-b4c7-b97811cba8eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37ce4717-9a') {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 10:03:55 user nova-compute[75229]: DEBUG os_vif [None req-57306f0d-e48c-483d-b92b-209b6bb5ec8b tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:92:c4:4b,bridge_name='br-int',has_traffic_filtering=True,id=37ce4717-9a82-41c6-9d89-f1e55b9ae398,network=Network(22eed29e-7148-42f9-b4c7-b97811cba8eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37ce4717-9a') {{(pid=75229) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 10:03:55 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:03:55 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap37ce4717-9a, bridge=br-int, if_exists=True) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 10:03:55 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:03:55 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 10:03:55 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:03:55 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=cb0c383a-53c2-42d9-8b11-aa3d781afe84) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 10:03:55 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:03:55 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 10:03:55 user nova-compute[75229]: INFO os_vif [None req-57306f0d-e48c-483d-b92b-209b6bb5ec8b tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:92:c4:4b,bridge_name='br-int',has_traffic_filtering=True,id=37ce4717-9a82-41c6-9d89-f1e55b9ae398,network=Network(22eed29e-7148-42f9-b4c7-b97811cba8eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37ce4717-9a')
Nov 14 10:03:55 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-57306f0d-e48c-483d-b92b-209b6bb5ec8b tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] [instance: abb8e340-164d-4bc2-a503-7e8ea3c9b35b] Deleting instance files /opt/stack/data/nova/instances/abb8e340-164d-4bc2-a503-7e8ea3c9b35b_del
Nov 14 10:03:55 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-57306f0d-e48c-483d-b92b-209b6bb5ec8b tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] [instance: abb8e340-164d-4bc2-a503-7e8ea3c9b35b] Deletion of /opt/stack/data/nova/instances/abb8e340-164d-4bc2-a503-7e8ea3c9b35b_del complete
Nov 14 10:03:56 user nova-compute[75229]: INFO nova.compute.manager [None req-57306f0d-e48c-483d-b92b-209b6bb5ec8b tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] [instance: abb8e340-164d-4bc2-a503-7e8ea3c9b35b] Took 1.02 seconds to destroy the instance on the hypervisor.
Nov 14 10:03:56 user nova-compute[75229]: DEBUG oslo.service.loopingcall [None req-57306f0d-e48c-483d-b92b-209b6bb5ec8b tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75229) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 10:03:56 user nova-compute[75229]: DEBUG nova.compute.manager [-] [instance: abb8e340-164d-4bc2-a503-7e8ea3c9b35b] Deallocating network for instance {{(pid=75229) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 10:03:56 user nova-compute[75229]: DEBUG nova.network.neutron [-] [instance: abb8e340-164d-4bc2-a503-7e8ea3c9b35b] deallocate_for_instance() {{(pid=75229) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 10:03:56 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:03:56 user nova-compute[75229]: DEBUG nova.compute.manager [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Starting heal instance info cache {{(pid=75229) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 10:03:56 user nova-compute[75229]: DEBUG nova.compute.manager [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] [instance: abb8e340-164d-4bc2-a503-7e8ea3c9b35b] Skipping network cache update for instance because it is being deleted. {{(pid=75229) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9971}}
Nov 14 10:03:56 user nova-compute[75229]: DEBUG nova.compute.manager [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Didn't find any instances for network info cache update. {{(pid=75229) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 14 10:03:56 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bcec78f7-7f14-484a-8182-78e7207a0fc9 tempest-ServerActionsV293TestJSON-1571447010 tempest-ServerActionsV293TestJSON-1571447010-project-member] Acquiring lock "3795dd8f-8a10-4939-8f2c-bacefe5f5aa1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:03:56 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bcec78f7-7f14-484a-8182-78e7207a0fc9 tempest-ServerActionsV293TestJSON-1571447010 tempest-ServerActionsV293TestJSON-1571447010-project-member] Lock "3795dd8f-8a10-4939-8f2c-bacefe5f5aa1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:03:56 user nova-compute[75229]: DEBUG nova.compute.manager [None req-bcec78f7-7f14-484a-8182-78e7207a0fc9 tempest-ServerActionsV293TestJSON-1571447010 tempest-ServerActionsV293TestJSON-1571447010-project-member] [instance: 3795dd8f-8a10-4939-8f2c-bacefe5f5aa1] Starting instance... {{(pid=75229) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 10:03:56 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bcec78f7-7f14-484a-8182-78e7207a0fc9 tempest-ServerActionsV293TestJSON-1571447010 tempest-ServerActionsV293TestJSON-1571447010-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:03:56 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bcec78f7-7f14-484a-8182-78e7207a0fc9 tempest-ServerActionsV293TestJSON-1571447010 tempest-ServerActionsV293TestJSON-1571447010-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:03:56 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-bcec78f7-7f14-484a-8182-78e7207a0fc9 tempest-ServerActionsV293TestJSON-1571447010 tempest-ServerActionsV293TestJSON-1571447010-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75229) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 10:03:56 user nova-compute[75229]: INFO nova.compute.claims [None req-bcec78f7-7f14-484a-8182-78e7207a0fc9 tempest-ServerActionsV293TestJSON-1571447010 tempest-ServerActionsV293TestJSON-1571447010-project-member] [instance: 3795dd8f-8a10-4939-8f2c-bacefe5f5aa1] Claim successful on node user
Nov 14 10:03:57 user nova-compute[75229]: DEBUG nova.compute.manager [req-b693f09c-f516-4485-b47a-095805799151 req-d85684be-2d5d-4c4a-b53c-e842cb43ade8 service nova] [instance: abb8e340-164d-4bc2-a503-7e8ea3c9b35b] Received event network-vif-plugged-37ce4717-9a82-41c6-9d89-f1e55b9ae398 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 10:03:57 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-b693f09c-f516-4485-b47a-095805799151 req-d85684be-2d5d-4c4a-b53c-e842cb43ade8 service nova] Acquiring lock "abb8e340-164d-4bc2-a503-7e8ea3c9b35b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:03:57 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-b693f09c-f516-4485-b47a-095805799151 req-d85684be-2d5d-4c4a-b53c-e842cb43ade8 service nova] Lock "abb8e340-164d-4bc2-a503-7e8ea3c9b35b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:03:57 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-b693f09c-f516-4485-b47a-095805799151 req-d85684be-2d5d-4c4a-b53c-e842cb43ade8 service nova] Lock "abb8e340-164d-4bc2-a503-7e8ea3c9b35b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:03:57 user nova-compute[75229]: DEBUG nova.compute.manager [req-b693f09c-f516-4485-b47a-095805799151 req-d85684be-2d5d-4c4a-b53c-e842cb43ade8 service nova] [instance: abb8e340-164d-4bc2-a503-7e8ea3c9b35b] No waiting events found dispatching network-vif-plugged-37ce4717-9a82-41c6-9d89-f1e55b9ae398 {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 10:03:57 user nova-compute[75229]: WARNING nova.compute.manager [req-b693f09c-f516-4485-b47a-095805799151 req-d85684be-2d5d-4c4a-b53c-e842cb43ade8 service nova] [instance: abb8e340-164d-4bc2-a503-7e8ea3c9b35b] Received unexpected event network-vif-plugged-37ce4717-9a82-41c6-9d89-f1e55b9ae398 for instance with vm_state active and task_state deleting.
Nov 14 10:03:57 user nova-compute[75229]: DEBUG nova.compute.provider_tree [None req-bcec78f7-7f14-484a-8182-78e7207a0fc9 tempest-ServerActionsV293TestJSON-1571447010 tempest-ServerActionsV293TestJSON-1571447010-project-member] Inventory has not changed in ProviderTree for provider: d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 {{(pid=75229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 10:03:57 user nova-compute[75229]: DEBUG nova.scheduler.client.report [None req-bcec78f7-7f14-484a-8182-78e7207a0fc9 tempest-ServerActionsV293TestJSON-1571447010 tempest-ServerActionsV293TestJSON-1571447010-project-member] Inventory has not changed for provider d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 10:03:57 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bcec78f7-7f14-484a-8182-78e7207a0fc9 tempest-ServerActionsV293TestJSON-1571447010 tempest-ServerActionsV293TestJSON-1571447010-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.444s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:03:57 user nova-compute[75229]: DEBUG nova.compute.manager [None req-bcec78f7-7f14-484a-8182-78e7207a0fc9 tempest-ServerActionsV293TestJSON-1571447010 tempest-ServerActionsV293TestJSON-1571447010-project-member] [instance: 3795dd8f-8a10-4939-8f2c-bacefe5f5aa1] Start building networks asynchronously for instance. {{(pid=75229) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 10:03:57 user nova-compute[75229]: DEBUG nova.network.neutron [-] [instance: abb8e340-164d-4bc2-a503-7e8ea3c9b35b] Updating instance_info_cache with network_info: [] {{(pid=75229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 10:03:57 user nova-compute[75229]: INFO nova.compute.manager [-] [instance: abb8e340-164d-4bc2-a503-7e8ea3c9b35b] Took 1.42 seconds to deallocate network for instance.
Nov 14 10:03:57 user nova-compute[75229]: DEBUG nova.compute.manager [None req-bcec78f7-7f14-484a-8182-78e7207a0fc9 tempest-ServerActionsV293TestJSON-1571447010 tempest-ServerActionsV293TestJSON-1571447010-project-member] [instance: 3795dd8f-8a10-4939-8f2c-bacefe5f5aa1] Allocating IP information in the background. {{(pid=75229) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 10:03:57 user nova-compute[75229]: DEBUG nova.network.neutron [None req-bcec78f7-7f14-484a-8182-78e7207a0fc9 tempest-ServerActionsV293TestJSON-1571447010 tempest-ServerActionsV293TestJSON-1571447010-project-member] [instance: 3795dd8f-8a10-4939-8f2c-bacefe5f5aa1] allocate_for_instance() {{(pid=75229) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 10:03:57 user nova-compute[75229]: DEBUG nova.compute.manager [req-90ef7c35-7b27-4638-8d45-3daf8911c137 req-8408c31d-4489-48e9-91f7-c420a93f0210 service nova] [instance: abb8e340-164d-4bc2-a503-7e8ea3c9b35b] Received event network-vif-deleted-37ce4717-9a82-41c6-9d89-f1e55b9ae398 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 10:03:57 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-bcec78f7-7f14-484a-8182-78e7207a0fc9 tempest-ServerActionsV293TestJSON-1571447010 tempest-ServerActionsV293TestJSON-1571447010-project-member] [instance: 3795dd8f-8a10-4939-8f2c-bacefe5f5aa1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 10:03:57 user nova-compute[75229]: DEBUG nova.compute.manager [None req-bcec78f7-7f14-484a-8182-78e7207a0fc9 tempest-ServerActionsV293TestJSON-1571447010 tempest-ServerActionsV293TestJSON-1571447010-project-member] [instance: 3795dd8f-8a10-4939-8f2c-bacefe5f5aa1] Start building block device mappings for instance. {{(pid=75229) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 10:03:57 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-57306f0d-e48c-483d-b92b-209b6bb5ec8b tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:03:57 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-57306f0d-e48c-483d-b92b-209b6bb5ec8b tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:03:57 user nova-compute[75229]: DEBUG nova.policy [None req-bcec78f7-7f14-484a-8182-78e7207a0fc9 tempest-ServerActionsV293TestJSON-1571447010 tempest-ServerActionsV293TestJSON-1571447010-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ccb15ed1f78c4c97a06b44dd1d833693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd2def4493b6471c86ad547a2e21eaf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75229) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 10:03:57 user nova-compute[75229]: INFO nova.virt.block_device [None req-bcec78f7-7f14-484a-8182-78e7207a0fc9 tempest-ServerActionsV293TestJSON-1571447010 tempest-ServerActionsV293TestJSON-1571447010-project-member] [instance: 3795dd8f-8a10-4939-8f2c-bacefe5f5aa1] Booting with volume 4ddb200b-47ca-4449-9973-be76424a6761 at /dev/vda
Nov 14 10:03:57 user nova-compute[75229]: DEBUG os_brick.utils [None req-bcec78f7-7f14-484a-8182-78e7207a0fc9 tempest-ServerActionsV293TestJSON-1571447010 tempest-ServerActionsV293TestJSON-1571447010-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 10:03:57 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:03:57 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:03:57 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[94949adb-91a4-42d2-a7a6-cb2de5aceb8f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f1154031c835\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:03:57 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:03:57 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:03:57 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[20e6ba55-3314-46c6-a9f2-c692910355d1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:03:57 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:03:57 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:03:57 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ce04174-db0c-4836-b482-645cff9bce16]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:03:57 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b825342-e1e5-49d9-81e4-9bd9ecad0c61]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:03:57 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bcec78f7-7f14-484a-8182-78e7207a0fc9 tempest-ServerActionsV293TestJSON-1571447010 tempest-ServerActionsV293TestJSON-1571447010-project-member] Running cmd (subprocess): nvme version {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:03:57 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bcec78f7-7f14-484a-8182-78e7207a0fc9 tempest-ServerActionsV293TestJSON-1571447010 tempest-ServerActionsV293TestJSON-1571447010-project-member] 'nvme version' failed. Not Retrying. {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 10:03:57 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.nvmeof [None req-bcec78f7-7f14-484a-8182-78e7207a0fc9 tempest-ServerActionsV293TestJSON-1571447010 tempest-ServerActionsV293TestJSON-1571447010-project-member] nvme not present on system {{(pid=75229) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 10:03:57 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:03:57 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 10:03:57 user nova-compute[75229]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 10:03:57 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[de439f3d-4f46-4000-bcd8-bfbcba923544]: (4, '') {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:03:57 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.lightos [None req-bcec78f7-7f14-484a-8182-78e7207a0fc9 tempest-ServerActionsV293TestJSON-1571447010 tempest-ServerActionsV293TestJSON-1571447010-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75229) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 10:03:57 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.lightos [None req-bcec78f7-7f14-484a-8182-78e7207a0fc9 tempest-ServerActionsV293TestJSON-1571447010 tempest-ServerActionsV293TestJSON-1571447010-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75229) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 10:03:57 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.lightos [None req-bcec78f7-7f14-484a-8182-78e7207a0fc9 tempest-ServerActionsV293TestJSON-1571447010 tempest-ServerActionsV293TestJSON-1571447010-project-member] LIGHTOS: no hostnqn found. {{(pid=75229) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 10:03:57 user nova-compute[75229]: DEBUG os_brick.utils [None req-bcec78f7-7f14-484a-8182-78e7207a0fc9 tempest-ServerActionsV293TestJSON-1571447010 tempest-ServerActionsV293TestJSON-1571447010-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f1154031c835', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 10:03:57 user nova-compute[75229]: DEBUG nova.virt.block_device [None req-bcec78f7-7f14-484a-8182-78e7207a0fc9 tempest-ServerActionsV293TestJSON-1571447010 tempest-ServerActionsV293TestJSON-1571447010-project-member] [instance: 3795dd8f-8a10-4939-8f2c-bacefe5f5aa1] Updating existing volume attachment record: c21d4ba2-62b1-4aeb-8480-771c64ba9741 {{(pid=75229) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 10:03:57 user nova-compute[75229]: DEBUG nova.compute.provider_tree [None req-57306f0d-e48c-483d-b92b-209b6bb5ec8b tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Inventory has not changed in ProviderTree for provider: d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 {{(pid=75229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 10:03:57 user nova-compute[75229]: DEBUG nova.scheduler.client.report [None req-57306f0d-e48c-483d-b92b-209b6bb5ec8b tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Inventory has not changed for provider d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 10:03:57 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-57306f0d-e48c-483d-b92b-209b6bb5ec8b tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.412s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:03:57 user nova-compute[75229]: INFO nova.scheduler.client.report [None req-57306f0d-e48c-483d-b92b-209b6bb5ec8b tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Deleted allocations for instance abb8e340-164d-4bc2-a503-7e8ea3c9b35b
Nov 14 10:03:58 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-57306f0d-e48c-483d-b92b-209b6bb5ec8b tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Lock "abb8e340-164d-4bc2-a503-7e8ea3c9b35b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.038s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:03:58 user nova-compute[75229]: DEBUG nova.network.neutron [None req-bcec78f7-7f14-484a-8182-78e7207a0fc9 tempest-ServerActionsV293TestJSON-1571447010 tempest-ServerActionsV293TestJSON-1571447010-project-member] [instance: 3795dd8f-8a10-4939-8f2c-bacefe5f5aa1] Successfully created port: c22c2020-a8ff-4cd5-8b78-89b1bb277e8c {{(pid=75229) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 10:03:58 user nova-compute[75229]: DEBUG nova.network.neutron [None req-bcec78f7-7f14-484a-8182-78e7207a0fc9 tempest-ServerActionsV293TestJSON-1571447010 tempest-ServerActionsV293TestJSON-1571447010-project-member] [instance: 3795dd8f-8a10-4939-8f2c-bacefe5f5aa1] Successfully updated port: c22c2020-a8ff-4cd5-8b78-89b1bb277e8c {{(pid=75229) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 10:03:58 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bcec78f7-7f14-484a-8182-78e7207a0fc9 tempest-ServerActionsV293TestJSON-1571447010 tempest-ServerActionsV293TestJSON-1571447010-project-member] Acquiring lock "refresh_cache-3795dd8f-8a10-4939-8f2c-bacefe5f5aa1" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 10:03:58 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bcec78f7-7f14-484a-8182-78e7207a0fc9 tempest-ServerActionsV293TestJSON-1571447010 tempest-ServerActionsV293TestJSON-1571447010-project-member] Acquired lock "refresh_cache-3795dd8f-8a10-4939-8f2c-bacefe5f5aa1" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 10:03:58 user nova-compute[75229]: DEBUG nova.network.neutron [None req-bcec78f7-7f14-484a-8182-78e7207a0fc9 tempest-ServerActionsV293TestJSON-1571447010 tempest-ServerActionsV293TestJSON-1571447010-project-member] [instance: 3795dd8f-8a10-4939-8f2c-bacefe5f5aa1] Building network info cache for instance {{(pid=75229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 10:03:58 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:03:58 user nova-compute[75229]: DEBUG nova.network.neutron [None req-bcec78f7-7f14-484a-8182-78e7207a0fc9 tempest-ServerActionsV293TestJSON-1571447010 tempest-ServerActionsV293TestJSON-1571447010-project-member] [instance: 3795dd8f-8a10-4939-8f2c-bacefe5f5aa1] Instance cache missing network info. {{(pid=75229) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 10:03:59 user nova-compute[75229]: DEBUG nova.network.neutron [None req-bcec78f7-7f14-484a-8182-78e7207a0fc9 tempest-ServerActionsV293TestJSON-1571447010 tempest-ServerActionsV293TestJSON-1571447010-project-member] [instance: 3795dd8f-8a10-4939-8f2c-bacefe5f5aa1] Updating instance_info_cache with network_info: [{"id": "c22c2020-a8ff-4cd5-8b78-89b1bb277e8c", "address": "fa:16:3e:a6:6b:f6", "network": {"id": "cd37c3e7-5ffe-4b5d-a25c-a2bd288cb9d2", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-156456501-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd2def4493b6471c86ad547a2e21eaf8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc22c2020-a8", "ovs_interfaceid": "c22c2020-a8ff-4cd5-8b78-89b1bb277e8c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 10:03:59 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bcec78f7-7f14-484a-8182-78e7207a0fc9 tempest-ServerActionsV293TestJSON-1571447010 tempest-ServerActionsV293TestJSON-1571447010-project-member] Releasing lock "refresh_cache-3795dd8f-8a10-4939-8f2c-bacefe5f5aa1" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 10:03:59 user nova-compute[75229]: DEBUG nova.compute.manager [None req-bcec78f7-7f14-484a-8182-78e7207a0fc9 tempest-ServerActionsV293TestJSON-1571447010 tempest-ServerActionsV293TestJSON-1571447010-project-member] [instance: 3795dd8f-8a10-4939-8f2c-bacefe5f5aa1] Instance network_info: |[{"id": "c22c2020-a8ff-4cd5-8b78-89b1bb277e8c", "address": "fa:16:3e:a6:6b:f6", "network": {"id": "cd37c3e7-5ffe-4b5d-a25c-a2bd288cb9d2", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-156456501-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd2def4493b6471c86ad547a2e21eaf8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc22c2020-a8", "ovs_interfaceid": "c22c2020-a8ff-4cd5-8b78-89b1bb277e8c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75229) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 10:03:59 user nova-compute[75229]: DEBUG nova.compute.manager [req-69e1d520-c1dd-43d3-832a-48d399de2445 req-8b60e624-90c0-44f1-b613-7d9c744a414c service nova] [instance: 3795dd8f-8a10-4939-8f2c-bacefe5f5aa1] Received event network-changed-c22c2020-a8ff-4cd5-8b78-89b1bb277e8c {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 10:03:59 user nova-compute[75229]: DEBUG nova.compute.manager [req-69e1d520-c1dd-43d3-832a-48d399de2445 req-8b60e624-90c0-44f1-b613-7d9c744a414c service nova] [instance: 3795dd8f-8a10-4939-8f2c-bacefe5f5aa1] Refreshing instance network info cache due to event network-changed-c22c2020-a8ff-4cd5-8b78-89b1bb277e8c. {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 10:03:59 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-69e1d520-c1dd-43d3-832a-48d399de2445 req-8b60e624-90c0-44f1-b613-7d9c744a414c service nova] Acquiring lock "refresh_cache-3795dd8f-8a10-4939-8f2c-bacefe5f5aa1" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 10:03:59 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-69e1d520-c1dd-43d3-832a-48d399de2445 req-8b60e624-90c0-44f1-b613-7d9c744a414c service nova] Acquired lock "refresh_cache-3795dd8f-8a10-4939-8f2c-bacefe5f5aa1" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 10:03:59 user nova-compute[75229]: DEBUG nova.network.neutron [req-69e1d520-c1dd-43d3-832a-48d399de2445 req-8b60e624-90c0-44f1-b613-7d9c744a414c service nova] [instance: 3795dd8f-8a10-4939-8f2c-bacefe5f5aa1] Refreshing network info cache for port c22c2020-a8ff-4cd5-8b78-89b1bb277e8c {{(pid=75229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 10:04:00 user nova-compute[75229]: DEBUG nova.network.neutron [req-69e1d520-c1dd-43d3-832a-48d399de2445 req-8b60e624-90c0-44f1-b613-7d9c744a414c service nova] [instance: 3795dd8f-8a10-4939-8f2c-bacefe5f5aa1] Updated VIF entry in instance network info cache for port c22c2020-a8ff-4cd5-8b78-89b1bb277e8c. {{(pid=75229) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 10:04:00 user nova-compute[75229]: DEBUG nova.network.neutron [req-69e1d520-c1dd-43d3-832a-48d399de2445 req-8b60e624-90c0-44f1-b613-7d9c744a414c service nova] [instance: 3795dd8f-8a10-4939-8f2c-bacefe5f5aa1] Updating instance_info_cache with network_info: [{"id": "c22c2020-a8ff-4cd5-8b78-89b1bb277e8c", "address": "fa:16:3e:a6:6b:f6", "network": {"id": "cd37c3e7-5ffe-4b5d-a25c-a2bd288cb9d2", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-156456501-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd2def4493b6471c86ad547a2e21eaf8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc22c2020-a8", "ovs_interfaceid": "c22c2020-a8ff-4cd5-8b78-89b1bb277e8c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 10:04:00 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-69e1d520-c1dd-43d3-832a-48d399de2445 req-8b60e624-90c0-44f1-b613-7d9c744a414c service nova] Releasing lock "refresh_cache-3795dd8f-8a10-4939-8f2c-bacefe5f5aa1" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 10:04:00 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:04:01 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:04:01 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:04:02 user nova-compute[75229]: DEBUG nova.compute.manager [None req-bcec78f7-7f14-484a-8182-78e7207a0fc9 tempest-ServerActionsV293TestJSON-1571447010 tempest-ServerActionsV293TestJSON-1571447010-project-member] [instance: 3795dd8f-8a10-4939-8f2c-bacefe5f5aa1] Start spawning the instance on the hypervisor. {{(pid=75229) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 10:04:02 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-bcec78f7-7f14-484a-8182-78e7207a0fc9 tempest-ServerActionsV293TestJSON-1571447010 tempest-ServerActionsV293TestJSON-1571447010-project-member] [instance: 3795dd8f-8a10-4939-8f2c-bacefe5f5aa1] Creating instance directory {{(pid=75229) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 10:04:02 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-bcec78f7-7f14-484a-8182-78e7207a0fc9 tempest-ServerActionsV293TestJSON-1571447010 tempest-ServerActionsV293TestJSON-1571447010-project-member] [instance: 3795dd8f-8a10-4939-8f2c-bacefe5f5aa1] Creating image(s)
Nov 14 10:04:02 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-bcec78f7-7f14-484a-8182-78e7207a0fc9 tempest-ServerActionsV293TestJSON-1571447010 tempest-ServerActionsV293TestJSON-1571447010-project-member] [instance: 3795dd8f-8a10-4939-8f2c-bacefe5f5aa1] Did not create local disks {{(pid=75229) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 14 10:04:02 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-bcec78f7-7f14-484a-8182-78e7207a0fc9 tempest-ServerActionsV293TestJSON-1571447010 tempest-ServerActionsV293TestJSON-1571447010-project-member] [instance: 3795dd8f-8a10-4939-8f2c-bacefe5f5aa1] Ensure instance console log exists: /opt/stack/data/nova/instances/3795dd8f-8a10-4939-8f2c-bacefe5f5aa1/console.log {{(pid=75229) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 10:04:02 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bcec78f7-7f14-484a-8182-78e7207a0fc9 tempest-ServerActionsV293TestJSON-1571447010 tempest-ServerActionsV293TestJSON-1571447010-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:04:02 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bcec78f7-7f14-484a-8182-78e7207a0fc9 tempest-ServerActionsV293TestJSON-1571447010 tempest-ServerActionsV293TestJSON-1571447010-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:04:02 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bcec78f7-7f14-484a-8182-78e7207a0fc9 tempest-ServerActionsV293TestJSON-1571447010 tempest-ServerActionsV293TestJSON-1571447010-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:04:02 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-bcec78f7-7f14-484a-8182-78e7207a0fc9 tempest-ServerActionsV293TestJSON-1571447010 tempest-ServerActionsV293TestJSON-1571447010-project-member] [instance: 3795dd8f-8a10-4939-8f2c-bacefe5f5aa1] Start _get_guest_xml network_info=[{"id": "c22c2020-a8ff-4cd5-8b78-89b1bb277e8c", "address": "fa:16:3e:a6:6b:f6", "network": {"id": "cd37c3e7-5ffe-4b5d-a25c-a2bd288cb9d2", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-156456501-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd2def4493b6471c86ad547a2e21eaf8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc22c2020-a8", "ovs_interfaceid": "c22c2020-a8ff-4cd5-8b78-89b1bb277e8c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:4ddb200b-47ca-4449-9973-be76424a6761', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OQUwLneK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '3795dd8f-8a10-4939-8f2c-bacefe5f5aa1', 'attached_at': '', 'detached_at': '', 'volume_id': '4ddb200b-47ca-4449-9973-be76424a6761', 'serial': '4ddb200b-47ca-4449-9973-be76424a6761'}, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'attachment_id': 'c21d4ba2-62b1-4aeb-8480-771c64ba9741', 'guest_format': None, 'device_type': 'disk', 'volume_type': None} {{(pid=75229) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 10:04:02 user nova-compute[75229]: WARNING nova.virt.libvirt.driver [None req-bcec78f7-7f14-484a-8182-78e7207a0fc9 tempest-ServerActionsV293TestJSON-1571447010 tempest-ServerActionsV293TestJSON-1571447010-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 10:04:02 user nova-compute[75229]: WARNING nova.virt.libvirt.driver [None req-bcec78f7-7f14-484a-8182-78e7207a0fc9 tempest-ServerActionsV293TestJSON-1571447010 tempest-ServerActionsV293TestJSON-1571447010-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 10:04:02 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-bcec78f7-7f14-484a-8182-78e7207a0fc9 tempest-ServerActionsV293TestJSON-1571447010 tempest-ServerActionsV293TestJSON-1571447010-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75229) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 10:04:02 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-bcec78f7-7f14-484a-8182-78e7207a0fc9 tempest-ServerActionsV293TestJSON-1571447010 tempest-ServerActionsV293TestJSON-1571447010-project-member] CPU controller missing on host. {{(pid=75229) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 10:04:02 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-bcec78f7-7f14-484a-8182-78e7207a0fc9 tempest-ServerActionsV293TestJSON-1571447010 tempest-ServerActionsV293TestJSON-1571447010-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75229) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 10:04:02 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-bcec78f7-7f14-484a-8182-78e7207a0fc9 tempest-ServerActionsV293TestJSON-1571447010 tempest-ServerActionsV293TestJSON-1571447010-project-member] CPU controller found on host. {{(pid=75229) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 10:04:02 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-bcec78f7-7f14-484a-8182-78e7207a0fc9 tempest-ServerActionsV293TestJSON-1571447010 tempest-ServerActionsV293TestJSON-1571447010-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75229) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 10:04:02 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-bcec78f7-7f14-484a-8182-78e7207a0fc9 tempest-ServerActionsV293TestJSON-1571447010 tempest-ServerActionsV293TestJSON-1571447010-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T09:39:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 10:04:02 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-bcec78f7-7f14-484a-8182-78e7207a0fc9 tempest-ServerActionsV293TestJSON-1571447010 tempest-ServerActionsV293TestJSON-1571447010-project-member] Flavor limits 0:0:0 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 10:04:02 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-bcec78f7-7f14-484a-8182-78e7207a0fc9 tempest-ServerActionsV293TestJSON-1571447010 tempest-ServerActionsV293TestJSON-1571447010-project-member] Image limits 0:0:0 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 10:04:02 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-bcec78f7-7f14-484a-8182-78e7207a0fc9 tempest-ServerActionsV293TestJSON-1571447010 tempest-ServerActionsV293TestJSON-1571447010-project-member] Flavor pref 0:0:0 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 10:04:02 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-bcec78f7-7f14-484a-8182-78e7207a0fc9 tempest-ServerActionsV293TestJSON-1571447010 tempest-ServerActionsV293TestJSON-1571447010-project-member] Image pref 0:0:0 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 10:04:02 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-bcec78f7-7f14-484a-8182-78e7207a0fc9 tempest-ServerActionsV293TestJSON-1571447010 tempest-ServerActionsV293TestJSON-1571447010-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 10:04:02 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-bcec78f7-7f14-484a-8182-78e7207a0fc9 tempest-ServerActionsV293TestJSON-1571447010 tempest-ServerActionsV293TestJSON-1571447010-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 10:04:02 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-bcec78f7-7f14-484a-8182-78e7207a0fc9 tempest-ServerActionsV293TestJSON-1571447010 tempest-ServerActionsV293TestJSON-1571447010-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75229) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 10:04:02 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-bcec78f7-7f14-484a-8182-78e7207a0fc9 tempest-ServerActionsV293TestJSON-1571447010 tempest-ServerActionsV293TestJSON-1571447010-project-member] Got 1 possible topologies {{(pid=75229) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 10:04:02 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-bcec78f7-7f14-484a-8182-78e7207a0fc9 tempest-ServerActionsV293TestJSON-1571447010 tempest-ServerActionsV293TestJSON-1571447010-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 10:04:02 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-bcec78f7-7f14-484a-8182-78e7207a0fc9 tempest-ServerActionsV293TestJSON-1571447010 tempest-ServerActionsV293TestJSON-1571447010-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 10:04:02 user nova-compute[75229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bcec78f7-7f14-484a-8182-78e7207a0fc9 tempest-ServerActionsV293TestJSON-1571447010 tempest-ServerActionsV293TestJSON-1571447010-project-member] [instance: 3795dd8f-8a10-4939-8f2c-bacefe5f5aa1] Calling os-brick to attach iSCSI Volume {{(pid=75229) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 10:04:02 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcec78f7-7f14-484a-8182-78e7207a0fc9 tempest-ServerActionsV293TestJSON-1571447010 tempest-ServerActionsV293TestJSON-1571447010-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f73f85151b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4ddb200b-47ca-4449-9973-be76424a6761', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OQUwLneK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 10:04:02 user nova-compute[75229]: WARNING os_brick.initiator.connectors.base [None req-bcec78f7-7f14-484a-8182-78e7207a0fc9 tempest-ServerActionsV293TestJSON-1571447010 tempest-ServerActionsV293TestJSON-1571447010-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 10:04:02 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-bcec78f7-7f14-484a-8182-78e7207a0fc9 tempest-ServerActionsV293TestJSON-1571447010 tempest-ServerActionsV293TestJSON-1571447010-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 10:04:02 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-bcec78f7-7f14-484a-8182-78e7207a0fc9 tempest-ServerActionsV293TestJSON-1571447010 tempest-ServerActionsV293TestJSON-1571447010-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 10:04:02 user nova-compute[75229]: WARNING os_brick.initiator.connectors.base [None req-bcec78f7-7f14-484a-8182-78e7207a0fc9 tempest-ServerActionsV293TestJSON-1571447010 tempest-ServerActionsV293TestJSON-1571447010-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 10:04:02 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-bcec78f7-7f14-484a-8182-78e7207a0fc9 tempest-ServerActionsV293TestJSON-1571447010 tempest-ServerActionsV293TestJSON-1571447010-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4ddb200b-47ca-4449-9973-be76424a6761" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 10:04:02 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-bcec78f7-7f14-484a-8182-78e7207a0fc9 tempest-ServerActionsV293TestJSON-1571447010 tempest-ServerActionsV293TestJSON-1571447010-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4ddb200b-47ca-4449-9973-be76424a6761" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 10:04:02 user nova-compute[75229]: INFO os_brick.initiator.connectors.iscsi [None req-bcec78f7-7f14-484a-8182-78e7207a0fc9 tempest-ServerActionsV293TestJSON-1571447010 tempest-ServerActionsV293TestJSON-1571447010-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 10:04:02 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ddb200b-47ca-4449-9973-be76424a6761 -p 172.16.0.220:3260 {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:04:02 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ddb200b-47ca-4449-9973-be76424a6761 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:04:02 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[71abbbd9-ecfe-4fe8-8f37-6d1fd56cd3ec]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:04:02 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcec78f7-7f14-484a-8182-78e7207a0fc9 tempest-ServerActionsV293TestJSON-1571447010 tempest-ServerActionsV293TestJSON-1571447010-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 10:04:02 user nova-compute[75229]:  {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 10:04:02 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ddb200b-47ca-4449-9973-be76424a6761 -p 172.16.0.220:3260 --interface default --op new {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:04:02 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ddb200b-47ca-4449-9973-be76424a6761 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:04:02 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[3952ebc4-f7aa-49a5-8ea3-1bb3d0fd5e16]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4ddb200b-47ca-4449-9973-be76424a6761] added\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:04:02 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcec78f7-7f14-484a-8182-78e7207a0fc9 tempest-ServerActionsV293TestJSON-1571447010 tempest-ServerActionsV293TestJSON-1571447010-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4ddb200b-47ca-4449-9973-be76424a6761] added
Nov 14 10:04:02 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 10:04:02 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ddb200b-47ca-4449-9973-be76424a6761 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:04:02 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ddb200b-47ca-4449-9973-be76424a6761 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:04:02 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[ade11ebb-6cd1-4c32-ae0c-6fb121460f79]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:04:02 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcec78f7-7f14-484a-8182-78e7207a0fc9 tempest-ServerActionsV293TestJSON-1571447010 tempest-ServerActionsV293TestJSON-1571447010-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 10:04:02 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ddb200b-47ca-4449-9973-be76424a6761 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:04:02 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ddb200b-47ca-4449-9973-be76424a6761 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:04:02 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc0d3b38-6d34-4557-90d4-06b38503c2c2]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:04:02 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcec78f7-7f14-484a-8182-78e7207a0fc9 tempest-ServerActionsV293TestJSON-1571447010 tempest-ServerActionsV293TestJSON-1571447010-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 10:04:02 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ddb200b-47ca-4449-9973-be76424a6761 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OQUwLneK {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:04:02 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ddb200b-47ca-4449-9973-be76424a6761 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OQUwLneK" returned: 0 in 0.017s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:04:02 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc2a591a-e0e0-460a-9872-8e3606e39338]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:04:02 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcec78f7-7f14-484a-8182-78e7207a0fc9 tempest-ServerActionsV293TestJSON-1571447010 tempest-ServerActionsV293TestJSON-1571447010-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'OQUwLneK'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 10:04:02 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ddb200b-47ca-4449-9973-be76424a6761 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:04:02 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ddb200b-47ca-4449-9973-be76424a6761 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:04:02 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[82a254df-8dce-4ce7-b73d-695156621578]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:04:02 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcec78f7-7f14-484a-8182-78e7207a0fc9 tempest-ServerActionsV293TestJSON-1571447010 tempest-ServerActionsV293TestJSON-1571447010-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 10:04:02 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:04:02 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:04:02 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[61ae2d2e-3536-4e30-8888-bfd790d37715]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aebc438-0289-44fe-ad84-4e696468f50e (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2977635e-b11f-4ab2-875c-e9f396b932dc (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64caa5ab-59eb-4251-9cef-f8576154c443 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55d338b4-2353-4501-b00d-fafa0dfe8758 (non-flash)\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:04:02 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcec78f7-7f14-484a-8182-78e7207a0fc9 tempest-ServerActionsV293TestJSON-1571447010 tempest-ServerActionsV293TestJSON-1571447010-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aebc438-0289-44fe-ad84-4e696468f50e (non-flash)
Nov 14 10:04:02 user nova-compute[75229]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2977635e-b11f-4ab2-875c-e9f396b932dc (non-flash)
Nov 14 10:04:02 user nova-compute[75229]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64caa5ab-59eb-4251-9cef-f8576154c443 (non-flash)
Nov 14 10:04:02 user nova-compute[75229]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55d338b4-2353-4501-b00d-fafa0dfe8758 (non-flash)
Nov 14 10:04:02 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 10:04:02 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcec78f7-7f14-484a-8182-78e7207a0fc9 tempest-ServerActionsV293TestJSON-1571447010 tempest-ServerActionsV293TestJSON-1571447010-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aebc438-0289-44fe-ad84-4e696468f50e (non-flash)
Nov 14 10:04:02 user nova-compute[75229]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2977635e-b11f-4ab2-875c-e9f396b932dc (non-flash)
Nov 14 10:04:02 user nova-compute[75229]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64caa5ab-59eb-4251-9cef-f8576154c443 (non-flash)
Nov 14 10:04:02 user nova-compute[75229]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55d338b4-2353-4501-b00d-fafa0dfe8758 (non-flash)
Nov 14 10:04:02 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 10:04:02 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ddb200b-47ca-4449-9973-be76424a6761 -p 172.16.0.220:3260 --login {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:04:02 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ddb200b-47ca-4449-9973-be76424a6761 -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:04:02 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9696b31-00c6-419e-bcb9-db80dd8c6183]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4ddb200b-47ca-4449-9973-be76424a6761, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4ddb200b-47ca-4449-9973-be76424a6761, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:04:02 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcec78f7-7f14-484a-8182-78e7207a0fc9 tempest-ServerActionsV293TestJSON-1571447010 tempest-ServerActionsV293TestJSON-1571447010-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4ddb200b-47ca-4449-9973-be76424a6761, portal: 172.16.0.220,3260]
Nov 14 10:04:02 user nova-compute[75229]: Login to [iface: default, target: iqn.2010-10.org.openstack:4ddb200b-47ca-4449-9973-be76424a6761, portal: 172.16.0.220,3260] successful.
Nov 14 10:04:02 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 10:04:02 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ddb200b-47ca-4449-9973-be76424a6761 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:04:02 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ddb200b-47ca-4449-9973-be76424a6761 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:04:02 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[f03631e9-8bd1-44f9-b712-c4dded84151b]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:04:02 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcec78f7-7f14-484a-8182-78e7207a0fc9 tempest-ServerActionsV293TestJSON-1571447010 tempest-ServerActionsV293TestJSON-1571447010-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 10:04:02 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:04:02 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:04:02 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[a29d1ee9-29d4-40ff-a11e-07a765627690]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aebc438-0289-44fe-ad84-4e696468f50e (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2977635e-b11f-4ab2-875c-e9f396b932dc (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64caa5ab-59eb-4251-9cef-f8576154c443 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55d338b4-2353-4501-b00d-fafa0dfe8758 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ddb200b-47ca-4449-9973-be76424a6761 (non-flash)\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:04:02 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcec78f7-7f14-484a-8182-78e7207a0fc9 tempest-ServerActionsV293TestJSON-1571447010 tempest-ServerActionsV293TestJSON-1571447010-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aebc438-0289-44fe-ad84-4e696468f50e (non-flash)
Nov 14 10:04:02 user nova-compute[75229]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2977635e-b11f-4ab2-875c-e9f396b932dc (non-flash)
Nov 14 10:04:02 user nova-compute[75229]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64caa5ab-59eb-4251-9cef-f8576154c443 (non-flash)
Nov 14 10:04:02 user nova-compute[75229]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55d338b4-2353-4501-b00d-fafa0dfe8758 (non-flash)
Nov 14 10:04:02 user nova-compute[75229]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ddb200b-47ca-4449-9973-be76424a6761 (non-flash)
Nov 14 10:04:02 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 10:04:02 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcec78f7-7f14-484a-8182-78e7207a0fc9 tempest-ServerActionsV293TestJSON-1571447010 tempest-ServerActionsV293TestJSON-1571447010-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aebc438-0289-44fe-ad84-4e696468f50e (non-flash)
Nov 14 10:04:02 user nova-compute[75229]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2977635e-b11f-4ab2-875c-e9f396b932dc (non-flash)
Nov 14 10:04:02 user nova-compute[75229]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64caa5ab-59eb-4251-9cef-f8576154c443 (non-flash)
Nov 14 10:04:02 user nova-compute[75229]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55d338b4-2353-4501-b00d-fafa0dfe8758 (non-flash)
Nov 14 10:04:02 user nova-compute[75229]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ddb200b-47ca-4449-9973-be76424a6761 (non-flash)
Nov 14 10:04:02 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 10:04:02 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-bcec78f7-7f14-484a-8182-78e7207a0fc9 tempest-ServerActionsV293TestJSON-1571447010 tempest-ServerActionsV293TestJSON-1571447010-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4ddb200b-47ca-4449-9973-be76424a6761" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.269s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 10:04:02 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcec78f7-7f14-484a-8182-78e7207a0fc9 tempest-ServerActionsV293TestJSON-1571447010 tempest-ServerActionsV293TestJSON-1571447010-project-member] Connected to 172.16.0.220:3260 {{(pid=75229) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 10:04:02 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-bcec78f7-7f14-484a-8182-78e7207a0fc9 tempest-ServerActionsV293TestJSON-1571447010 tempest-ServerActionsV293TestJSON-1571447010-project-member] HCTL ('37', '-', '-', 0) found on session 44 with lun 0 {{(pid=75229) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 10:04:02 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-bcec78f7-7f14-484a-8182-78e7207a0fc9 tempest-ServerActionsV293TestJSON-1571447010 tempest-ServerActionsV293TestJSON-1571447010-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75229) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 10:04:02 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:04:02 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.016s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:04:02 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4baf246-22d5-4b72-a4c5-29349dc86245]: (4, ('- - 0', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:04:02 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-bcec78f7-7f14-484a-8182-78e7207a0fc9 tempest-ServerActionsV293TestJSON-1571447010 tempest-ServerActionsV293TestJSON-1571447010-project-member] Searching for a device in session 44 and hctl ['37', '*', '*', 0] yield: None {{(pid=75229) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 10:04:03 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-bcec78f7-7f14-484a-8182-78e7207a0fc9 tempest-ServerActionsV293TestJSON-1571447010 tempest-ServerActionsV293TestJSON-1571447010-project-member] Searching for a device in session 44 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75229) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 10:04:03 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcec78f7-7f14-484a-8182-78e7207a0fc9 tempest-ServerActionsV293TestJSON-1571447010 tempest-ServerActionsV293TestJSON-1571447010-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:4ddb200b-47ca-4449-9973-be76424a6761', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OQUwLneK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75229) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 10:04:03 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-bcec78f7-7f14-484a-8182-78e7207a0fc9 tempest-ServerActionsV293TestJSON-1571447010 tempest-ServerActionsV293TestJSON-1571447010-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.299s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 10:04:03 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcec78f7-7f14-484a-8182-78e7207a0fc9 tempest-ServerActionsV293TestJSON-1571447010 tempest-ServerActionsV293TestJSON-1571447010-project-member] <== connect_volume: return (1300ms) {'type': 'block', 'scsi_wwn': '23163333931393131', 'path': '/dev/sdf'} {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 10:04:03 user nova-compute[75229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bcec78f7-7f14-484a-8182-78e7207a0fc9 tempest-ServerActionsV293TestJSON-1571447010 tempest-ServerActionsV293TestJSON-1571447010-project-member] [instance: 3795dd8f-8a10-4939-8f2c-bacefe5f5aa1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23163333931393131', 'path': '/dev/sdf'} {{(pid=75229) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 10:04:03 user nova-compute[75229]: DEBUG nova.virt.libvirt.vif [None req-bcec78f7-7f14-484a-8182-78e7207a0fc9 tempest-ServerActionsV293TestJSON-1571447010 tempest-ServerActionsV293TestJSON-1571447010-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T10:03:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-227769429',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-227769429',id=44,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFUp8y3q6YJE91W5mLt9TtiRsU0SK+1Tlv+h5RVCK8xvWSBDaBLlNygtiA4MzTbH6VU4efuvwyj9xakV6WTmEsQqXHmG4tvUv4ckhtOrRf2abxMbK7PzCZvHKp/bva3DgA==',key_name='tempest-keypair-1083609012',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dd2def4493b6471c86ad547a2e21eaf8',ramdisk_id='',reservation_id='r-3orn8wim',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-1571447010',owner_user_name='tempest-ServerActionsV293TestJSON-1571447010-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T10:03:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ccb15ed1f78c4c97a06b44dd1d833693',uuid=3795dd8f-8a10-4939-8f2c-bacefe5f5aa1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c22c2020-a8ff-4cd5-8b78-89b1bb277e8c", "address": "fa:16:3e:a6:6b:f6", "network": {"id": "cd37c3e7-5ffe-4b5d-a25c-a2bd288cb9d2", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-156456501-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd2def4493b6471c86ad547a2e21eaf8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc22c2020-a8", "ovs_interfaceid": "c22c2020-a8ff-4cd5-8b78-89b1bb277e8c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75229) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 10:04:03 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-bcec78f7-7f14-484a-8182-78e7207a0fc9 tempest-ServerActionsV293TestJSON-1571447010 tempest-ServerActionsV293TestJSON-1571447010-project-member] Converting VIF {"id": "c22c2020-a8ff-4cd5-8b78-89b1bb277e8c", "address": "fa:16:3e:a6:6b:f6", "network": {"id": "cd37c3e7-5ffe-4b5d-a25c-a2bd288cb9d2", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-156456501-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd2def4493b6471c86ad547a2e21eaf8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc22c2020-a8", "ovs_interfaceid": "c22c2020-a8ff-4cd5-8b78-89b1bb277e8c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 10:04:03 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-bcec78f7-7f14-484a-8182-78e7207a0fc9 tempest-ServerActionsV293TestJSON-1571447010 tempest-ServerActionsV293TestJSON-1571447010-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a6:6b:f6,bridge_name='br-int',has_traffic_filtering=True,id=c22c2020-a8ff-4cd5-8b78-89b1bb277e8c,network=Network(cd37c3e7-5ffe-4b5d-a25c-a2bd288cb9d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc22c2020-a8') {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 10:04:03 user nova-compute[75229]: DEBUG nova.objects.instance [None req-bcec78f7-7f14-484a-8182-78e7207a0fc9 tempest-ServerActionsV293TestJSON-1571447010 tempest-ServerActionsV293TestJSON-1571447010-project-member] Lazy-loading 'pci_devices' on Instance uuid 3795dd8f-8a10-4939-8f2c-bacefe5f5aa1 {{(pid=75229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 10:04:03 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-bcec78f7-7f14-484a-8182-78e7207a0fc9 tempest-ServerActionsV293TestJSON-1571447010 tempest-ServerActionsV293TestJSON-1571447010-project-member] [instance: 3795dd8f-8a10-4939-8f2c-bacefe5f5aa1] End _get_guest_xml xml=<domain type="kvm">
Nov 14 10:04:03 user nova-compute[75229]:   <uuid>3795dd8f-8a10-4939-8f2c-bacefe5f5aa1</uuid>
Nov 14 10:04:03 user nova-compute[75229]:   <name>instance-0000002c</name>
Nov 14 10:04:03 user nova-compute[75229]:   <memory>524288</memory>
Nov 14 10:04:03 user nova-compute[75229]:   <vcpu>1</vcpu>
Nov 14 10:04:03 user nova-compute[75229]:   <metadata>
Nov 14 10:04:03 user nova-compute[75229]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 10:04:03 user nova-compute[75229]:       <nova:package version="0.0.0"/>
Nov 14 10:04:03 user nova-compute[75229]:       <nova:name>tempest-ServerActionsV293TestJSON-server-227769429</nova:name>
Nov 14 10:04:03 user nova-compute[75229]:       <nova:creationTime>2023-11-14 10:04:02</nova:creationTime>
Nov 14 10:04:03 user nova-compute[75229]:       <nova:flavor name="m1.tiny">
Nov 14 10:04:03 user nova-compute[75229]:         <nova:memory>512</nova:memory>
Nov 14 10:04:03 user nova-compute[75229]:         <nova:disk>1</nova:disk>
Nov 14 10:04:03 user nova-compute[75229]:         <nova:swap>0</nova:swap>
Nov 14 10:04:03 user nova-compute[75229]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 10:04:03 user nova-compute[75229]:         <nova:vcpus>1</nova:vcpus>
Nov 14 10:04:03 user nova-compute[75229]:       </nova:flavor>
Nov 14 10:04:03 user nova-compute[75229]:       <nova:owner>
Nov 14 10:04:03 user nova-compute[75229]:         <nova:user uuid="ccb15ed1f78c4c97a06b44dd1d833693">tempest-ServerActionsV293TestJSON-1571447010-project-member</nova:user>
Nov 14 10:04:03 user nova-compute[75229]:         <nova:project uuid="dd2def4493b6471c86ad547a2e21eaf8">tempest-ServerActionsV293TestJSON-1571447010</nova:project>
Nov 14 10:04:03 user nova-compute[75229]:       </nova:owner>
Nov 14 10:04:03 user nova-compute[75229]:       <nova:ports>
Nov 14 10:04:03 user nova-compute[75229]:         <nova:port uuid="c22c2020-a8ff-4cd5-8b78-89b1bb277e8c">
Nov 14 10:04:03 user nova-compute[75229]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 14 10:04:03 user nova-compute[75229]:         </nova:port>
Nov 14 10:04:03 user nova-compute[75229]:       </nova:ports>
Nov 14 10:04:03 user nova-compute[75229]:     </nova:instance>
Nov 14 10:04:03 user nova-compute[75229]:   </metadata>
Nov 14 10:04:03 user nova-compute[75229]:   <sysinfo type="smbios">
Nov 14 10:04:03 user nova-compute[75229]:     <system>
Nov 14 10:04:03 user nova-compute[75229]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 10:04:03 user nova-compute[75229]:       <entry name="product">OpenStack Nova</entry>
Nov 14 10:04:03 user nova-compute[75229]:       <entry name="version">0.0.0</entry>
Nov 14 10:04:03 user nova-compute[75229]:       <entry name="serial">3795dd8f-8a10-4939-8f2c-bacefe5f5aa1</entry>
Nov 14 10:04:03 user nova-compute[75229]:       <entry name="uuid">3795dd8f-8a10-4939-8f2c-bacefe5f5aa1</entry>
Nov 14 10:04:03 user nova-compute[75229]:       <entry name="family">Virtual Machine</entry>
Nov 14 10:04:03 user nova-compute[75229]:     </system>
Nov 14 10:04:03 user nova-compute[75229]:   </sysinfo>
Nov 14 10:04:03 user nova-compute[75229]:   <os>
Nov 14 10:04:03 user nova-compute[75229]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 10:04:03 user nova-compute[75229]:     <boot dev="hd"/>
Nov 14 10:04:03 user nova-compute[75229]:     <smbios mode="sysinfo"/>
Nov 14 10:04:03 user nova-compute[75229]:   </os>
Nov 14 10:04:03 user nova-compute[75229]:   <features>
Nov 14 10:04:03 user nova-compute[75229]:     <acpi/>
Nov 14 10:04:03 user nova-compute[75229]:     <apic/>
Nov 14 10:04:03 user nova-compute[75229]:     <vmcoreinfo/>
Nov 14 10:04:03 user nova-compute[75229]:   </features>
Nov 14 10:04:03 user nova-compute[75229]:   <clock offset="utc">
Nov 14 10:04:03 user nova-compute[75229]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 10:04:03 user nova-compute[75229]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 10:04:03 user nova-compute[75229]:     <timer name="hpet" present="no"/>
Nov 14 10:04:03 user nova-compute[75229]:   </clock>
Nov 14 10:04:03 user nova-compute[75229]:   <cpu mode="custom" match="exact">
Nov 14 10:04:03 user nova-compute[75229]:     <model>Nehalem</model>
Nov 14 10:04:03 user nova-compute[75229]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 10:04:03 user nova-compute[75229]:   </cpu>
Nov 14 10:04:03 user nova-compute[75229]:   <devices>
Nov 14 10:04:03 user nova-compute[75229]:     <disk type="block" device="disk">
Nov 14 10:04:03 user nova-compute[75229]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 10:04:03 user nova-compute[75229]:       <source dev="/dev/sdf"/>
Nov 14 10:04:03 user nova-compute[75229]:       <target dev="vda" bus="virtio"/>
Nov 14 10:04:03 user nova-compute[75229]:       <serial>4ddb200b-47ca-4449-9973-be76424a6761</serial>
Nov 14 10:04:03 user nova-compute[75229]:     </disk>
Nov 14 10:04:03 user nova-compute[75229]:     <interface type="ethernet">
Nov 14 10:04:03 user nova-compute[75229]:       <mac address="fa:16:3e:a6:6b:f6"/>
Nov 14 10:04:03 user nova-compute[75229]:       <model type="virtio"/>
Nov 14 10:04:03 user nova-compute[75229]:       <mtu size="1442"/>
Nov 14 10:04:03 user nova-compute[75229]:       <target dev="tapc22c2020-a8"/>
Nov 14 10:04:03 user nova-compute[75229]:     </interface>
Nov 14 10:04:03 user nova-compute[75229]:     <serial type="pty">
Nov 14 10:04:03 user nova-compute[75229]:       <log file="/opt/stack/data/nova/instances/3795dd8f-8a10-4939-8f2c-bacefe5f5aa1/console.log" append="off"/>
Nov 14 10:04:03 user nova-compute[75229]:     </serial>
Nov 14 10:04:03 user nova-compute[75229]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 10:04:03 user nova-compute[75229]:     <video>
Nov 14 10:04:03 user nova-compute[75229]:       <model type="virtio"/>
Nov 14 10:04:03 user nova-compute[75229]:     </video>
Nov 14 10:04:03 user nova-compute[75229]:     <rng model="virtio">
Nov 14 10:04:03 user nova-compute[75229]:       <backend model="random">/dev/urandom</backend>
Nov 14 10:04:03 user nova-compute[75229]:     </rng>
Nov 14 10:04:03 user nova-compute[75229]:     <controller type="usb" index="0" model="none"/>
Nov 14 10:04:03 user nova-compute[75229]:     <memballoon model="virtio">
Nov 14 10:04:03 user nova-compute[75229]:       <stats period="10"/>
Nov 14 10:04:03 user nova-compute[75229]:     </memballoon>
Nov 14 10:04:03 user nova-compute[75229]:   </devices>
Nov 14 10:04:03 user nova-compute[75229]: </domain>
Nov 14 10:04:03 user nova-compute[75229]:  {{(pid=75229) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 10:04:03 user nova-compute[75229]: DEBUG nova.virt.libvirt.vif [None req-bcec78f7-7f14-484a-8182-78e7207a0fc9 tempest-ServerActionsV293TestJSON-1571447010 tempest-ServerActionsV293TestJSON-1571447010-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T10:03:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-227769429',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-227769429',id=44,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFUp8y3q6YJE91W5mLt9TtiRsU0SK+1Tlv+h5RVCK8xvWSBDaBLlNygtiA4MzTbH6VU4efuvwyj9xakV6WTmEsQqXHmG4tvUv4ckhtOrRf2abxMbK7PzCZvHKp/bva3DgA==',key_name='tempest-keypair-1083609012',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dd2def4493b6471c86ad547a2e21eaf8',ramdisk_id='',reservation_id='r-3orn8wim',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-1571447010',owner_user_name='tempest-ServerActionsV293TestJSON-1571447010-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T10:03:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ccb15ed1f78c4c97a06b44dd1d833693',uuid=3795dd8f-8a10-4939-8f2c-bacefe5f5aa1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c22c2020-a8ff-4cd5-8b78-89b1bb277e8c", "address": "fa:16:3e:a6:6b:f6", "network": {"id": "cd37c3e7-5ffe-4b5d-a25c-a2bd288cb9d2", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-156456501-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd2def4493b6471c86ad547a2e21eaf8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc22c2020-a8", "ovs_interfaceid": "c22c2020-a8ff-4cd5-8b78-89b1bb277e8c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 10:04:03 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-bcec78f7-7f14-484a-8182-78e7207a0fc9 tempest-ServerActionsV293TestJSON-1571447010 tempest-ServerActionsV293TestJSON-1571447010-project-member] Converting VIF {"id": "c22c2020-a8ff-4cd5-8b78-89b1bb277e8c", "address": "fa:16:3e:a6:6b:f6", "network": {"id": "cd37c3e7-5ffe-4b5d-a25c-a2bd288cb9d2", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-156456501-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd2def4493b6471c86ad547a2e21eaf8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc22c2020-a8", "ovs_interfaceid": "c22c2020-a8ff-4cd5-8b78-89b1bb277e8c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 10:04:03 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-bcec78f7-7f14-484a-8182-78e7207a0fc9 tempest-ServerActionsV293TestJSON-1571447010 tempest-ServerActionsV293TestJSON-1571447010-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a6:6b:f6,bridge_name='br-int',has_traffic_filtering=True,id=c22c2020-a8ff-4cd5-8b78-89b1bb277e8c,network=Network(cd37c3e7-5ffe-4b5d-a25c-a2bd288cb9d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc22c2020-a8') {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 10:04:03 user nova-compute[75229]: DEBUG os_vif [None req-bcec78f7-7f14-484a-8182-78e7207a0fc9 tempest-ServerActionsV293TestJSON-1571447010 tempest-ServerActionsV293TestJSON-1571447010-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a6:6b:f6,bridge_name='br-int',has_traffic_filtering=True,id=c22c2020-a8ff-4cd5-8b78-89b1bb277e8c,network=Network(cd37c3e7-5ffe-4b5d-a25c-a2bd288cb9d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc22c2020-a8') {{(pid=75229) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 10:04:03 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:04:03 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 10:04:03 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 10:04:03 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:04:03 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd0b8dff5-970e-538b-84d7-36a9c935053c', '_type': 'linux-noop'}}, row=False) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 10:04:03 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:04:03 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:04:03 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:04:03 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc22c2020-a8, may_exist=True, interface_attrs={}) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 10:04:03 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc22c2020-a8, col_values=(('qos', UUID('48fe1454-cf81-44f9-8fed-2a4b0cb6a4af')),), if_exists=True) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 10:04:03 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc22c2020-a8, col_values=(('external_ids', {'iface-id': 'c22c2020-a8ff-4cd5-8b78-89b1bb277e8c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a6:6b:f6', 'vm-uuid': '3795dd8f-8a10-4939-8f2c-bacefe5f5aa1'}),), if_exists=True) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 10:04:03 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:04:03 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 10:04:03 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:04:03 user nova-compute[75229]: INFO os_vif [None req-bcec78f7-7f14-484a-8182-78e7207a0fc9 tempest-ServerActionsV293TestJSON-1571447010 tempest-ServerActionsV293TestJSON-1571447010-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a6:6b:f6,bridge_name='br-int',has_traffic_filtering=True,id=c22c2020-a8ff-4cd5-8b78-89b1bb277e8c,network=Network(cd37c3e7-5ffe-4b5d-a25c-a2bd288cb9d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc22c2020-a8')
Nov 14 10:04:03 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-bcec78f7-7f14-484a-8182-78e7207a0fc9 tempest-ServerActionsV293TestJSON-1571447010 tempest-ServerActionsV293TestJSON-1571447010-project-member] No BDM found with device name vda, not building metadata. {{(pid=75229) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 10:04:03 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-bcec78f7-7f14-484a-8182-78e7207a0fc9 tempest-ServerActionsV293TestJSON-1571447010 tempest-ServerActionsV293TestJSON-1571447010-project-member] No VIF found with MAC fa:16:3e:a6:6b:f6, not building metadata {{(pid=75229) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 10:04:03 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:04:03 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:04:03 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:04:03 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:04:03 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:04:03 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Auditing locally available compute resources for user (node: user) {{(pid=75229) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 10:04:03 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:04:04 user nova-compute[75229]: WARNING nova.virt.libvirt.driver [None req-4e4e6ab2-3668-4c99-881f-c8736dbdd3bb tempest-TestServerVolumeAttachScenarioOldVersion-2038862331 tempest-TestServerVolumeAttachScenarioOldVersion-2038862331-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 7469b999-196b-41c7-9d30-f810b74eaa99 is timed out.
Nov 14 10:04:04 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-4e4e6ab2-3668-4c99-881f-c8736dbdd3bb tempest-TestServerVolumeAttachScenarioOldVersion-2038862331 tempest-TestServerVolumeAttachScenarioOldVersion-2038862331-project-member] Successfully detached device vdb from instance 7469b999-196b-41c7-9d30-f810b74eaa99 from the live domain config.
Nov 14 10:04:04 user nova-compute[75229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4e4e6ab2-3668-4c99-881f-c8736dbdd3bb tempest-TestServerVolumeAttachScenarioOldVersion-2038862331 tempest-TestServerVolumeAttachScenarioOldVersion-2038862331-project-member] [instance: 7469b999-196b-41c7-9d30-f810b74eaa99] calling os-brick to detach iSCSI Volume {{(pid=75229) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 10:04:04 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e4e6ab2-3668-4c99-881f-c8736dbdd3bb tempest-TestServerVolumeAttachScenarioOldVersion-2038862331 tempest-TestServerVolumeAttachScenarioOldVersion-2038862331-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f73f85151b0>, {'target_iqn': 'iqn.2010-10.org.openstack:55d338b4-2353-4501-b00d-fafa0dfe8758', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FjirgtNV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 10:04:04 user nova-compute[75229]: WARNING os_brick.initiator.connectors.base [None req-4e4e6ab2-3668-4c99-881f-c8736dbdd3bb tempest-TestServerVolumeAttachScenarioOldVersion-2038862331 tempest-TestServerVolumeAttachScenarioOldVersion-2038862331-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 10:04:04 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-4e4e6ab2-3668-4c99-881f-c8736dbdd3bb tempest-TestServerVolumeAttachScenarioOldVersion-2038862331 tempest-TestServerVolumeAttachScenarioOldVersion-2038862331-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 10:04:04 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-4e4e6ab2-3668-4c99-881f-c8736dbdd3bb tempest-TestServerVolumeAttachScenarioOldVersion-2038862331 tempest-TestServerVolumeAttachScenarioOldVersion-2038862331-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 10:04:04 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:04:04 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:04:04 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c464360-f9a7-4937-a455-51ade48dda0c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2977635e-b11f-4ab2-875c-e9f396b932dc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4ddb200b-47ca-4449-9973-be76424a6761\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:64caa5ab-59eb-4251-9cef-f8576154c443\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:55d338b4-2353-4501-b00d-fafa0dfe8758\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5aebc438-0289-44fe-ad84-4e696468f50e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:04:04 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e4e6ab2-3668-4c99-881f-c8736dbdd3bb tempest-TestServerVolumeAttachScenarioOldVersion-2038862331 tempest-TestServerVolumeAttachScenarioOldVersion-2038862331-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 10:04:04 user nova-compute[75229]: No targets found.
Nov 14 10:04:04 user nova-compute[75229]: iSNS:
Nov 14 10:04:04 user nova-compute[75229]: No targets found.
Nov 14 10:04:04 user nova-compute[75229]: STATIC:
Nov 14 10:04:04 user nova-compute[75229]: Target: iqn.2010-10.org.openstack:2977635e-b11f-4ab2-875c-e9f396b932dc
Nov 14 10:04:04 user nova-compute[75229]:         Portal: 172.16.0.220:3260,-1
Nov 14 10:04:04 user nova-compute[75229]:                 Iface Name: default
Nov 14 10:04:04 user nova-compute[75229]: Target: iqn.2010-10.org.openstack:4ddb200b-47ca-4449-9973-be76424a6761
Nov 14 10:04:04 user nova-compute[75229]:         Portal: 172.16.0.220:3260,-1
Nov 14 10:04:04 user nova-compute[75229]:                 Iface Name: default
Nov 14 10:04:04 user nova-compute[75229]: Target: iqn.2010-10.org.openstack:64caa5ab-59eb-4251-9cef-f8576154c443
Nov 14 10:04:04 user nova-compute[75229]:         Portal: 172.16.0.220:3260,-1
Nov 14 10:04:04 user nova-compute[75229]:                 Iface Name: default
Nov 14 10:04:04 user nova-compute[75229]: Target: iqn.2010-10.org.openstack:55d338b4-2353-4501-b00d-fafa0dfe8758
Nov 14 10:04:04 user nova-compute[75229]:         Portal: 172.16.0.220:3260,-1
Nov 14 10:04:04 user nova-compute[75229]:                 Iface Name: default
Nov 14 10:04:04 user nova-compute[75229]: Target: iqn.2010-10.org.openstack:5aebc438-0289-44fe-ad84-4e696468f50e
Nov 14 10:04:04 user nova-compute[75229]:         Portal: 172.16.0.220:3260,-1
Nov 14 10:04:04 user nova-compute[75229]:                 Iface Name: default
Nov 14 10:04:04 user nova-compute[75229]: FIRMWARE:
Nov 14 10:04:04 user nova-compute[75229]: No targets found.
Nov 14 10:04:04 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 10:04:04 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e4e6ab2-3668-4c99-881f-c8736dbdd3bb tempest-TestServerVolumeAttachScenarioOldVersion-2038862331 tempest-TestServerVolumeAttachScenarioOldVersion-2038862331-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 10:04:04 user nova-compute[75229]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 10:04:04 user nova-compute[75229]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75229) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 10:04:04 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e4e6ab2-3668-4c99-881f-c8736dbdd3bb tempest-TestServerVolumeAttachScenarioOldVersion-2038862331 tempest-TestServerVolumeAttachScenarioOldVersion-2038862331-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:55d338b4-2353-4501-b00d-fafa0dfe8758', 0)] {{(pid=75229) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 10:04:04 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:04:04 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:04:04 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa797b91-7b34-49ba-b7dd-0d0a34a2b9b6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2977635e-b11f-4ab2-875c-e9f396b932dc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4ddb200b-47ca-4449-9973-be76424a6761\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:55d338b4-2353-4501-b00d-fafa0dfe8758\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5aebc438-0289-44fe-ad84-4e696468f50e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:64caa5ab-59eb-4251-9cef-f8576154c443\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:04:04 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:04:04 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:04:04 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[849063a7-1432-45be-a368-6d6210051397]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aebc438-0289-44fe-ad84-4e696468f50e (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2977635e-b11f-4ab2-875c-e9f396b932dc (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64caa5ab-59eb-4251-9cef-f8576154c443 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55d338b4-2353-4501-b00d-fafa0dfe8758 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ddb200b-47ca-4449-9973-be76424a6761 (non-flash)\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:04:04 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e4e6ab2-3668-4c99-881f-c8736dbdd3bb tempest-TestServerVolumeAttachScenarioOldVersion-2038862331 tempest-TestServerVolumeAttachScenarioOldVersion-2038862331-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aebc438-0289-44fe-ad84-4e696468f50e (non-flash)
Nov 14 10:04:04 user nova-compute[75229]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2977635e-b11f-4ab2-875c-e9f396b932dc (non-flash)
Nov 14 10:04:04 user nova-compute[75229]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64caa5ab-59eb-4251-9cef-f8576154c443 (non-flash)
Nov 14 10:04:04 user nova-compute[75229]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55d338b4-2353-4501-b00d-fafa0dfe8758 (non-flash)
Nov 14 10:04:04 user nova-compute[75229]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ddb200b-47ca-4449-9973-be76424a6761 (non-flash)
Nov 14 10:04:04 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 10:04:04 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e4e6ab2-3668-4c99-881f-c8736dbdd3bb tempest-TestServerVolumeAttachScenarioOldVersion-2038862331 tempest-TestServerVolumeAttachScenarioOldVersion-2038862331-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aebc438-0289-44fe-ad84-4e696468f50e (non-flash)
Nov 14 10:04:04 user nova-compute[75229]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2977635e-b11f-4ab2-875c-e9f396b932dc (non-flash)
Nov 14 10:04:04 user nova-compute[75229]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64caa5ab-59eb-4251-9cef-f8576154c443 (non-flash)
Nov 14 10:04:04 user nova-compute[75229]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55d338b4-2353-4501-b00d-fafa0dfe8758 (non-flash)
Nov 14 10:04:04 user nova-compute[75229]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ddb200b-47ca-4449-9973-be76424a6761 (non-flash)
Nov 14 10:04:04 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 10:04:04 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e4e6ab2-3668-4c99-881f-c8736dbdd3bb tempest-TestServerVolumeAttachScenarioOldVersion-2038862331 tempest-TestServerVolumeAttachScenarioOldVersion-2038862331-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f73d4ec8f70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:55d338b4-2353-4501-b00d-fafa0dfe8758'): ({'sdd'}, set())}) {{(pid=75229) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 10:04:04 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-4e4e6ab2-3668-4c99-881f-c8736dbdd3bb tempest-TestServerVolumeAttachScenarioOldVersion-2038862331 tempest-TestServerVolumeAttachScenarioOldVersion-2038862331-project-member] Removing single pathed devices sdd {{(pid=75229) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 10:04:04 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:04:04 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:04:04 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[e37cd5f1-003d-47f3-9c98-d9be0f9b71c4]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:04:04 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:04:04 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.017s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:04:04 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[40b6375e-5586-4888-9412-49ae614984aa]: (4, ('ok\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:04:04 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-4e4e6ab2-3668-4c99-881f-c8736dbdd3bb tempest-TestServerVolumeAttachScenarioOldVersion-2038862331 tempest-TestServerVolumeAttachScenarioOldVersion-2038862331-project-member] Flushing IO for device /dev/sdd {{(pid=75229) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 10:04:04 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:04:04 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.012s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:04:04 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[17a8e456-496b-4527-a4e3-74a4adca9df5]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:04:04 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-4e4e6ab2-3668-4c99-881f-c8736dbdd3bb tempest-TestServerVolumeAttachScenarioOldVersion-2038862331 tempest-TestServerVolumeAttachScenarioOldVersion-2038862331-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75229) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 10:04:04 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:04:04 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.046s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:04:04 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a6fa424-c935-42d6-904b-bda9793bcbce]: (4, ('1', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:04:04 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-4e4e6ab2-3668-4c99-881f-c8736dbdd3bb tempest-TestServerVolumeAttachScenarioOldVersion-2038862331 tempest-TestServerVolumeAttachScenarioOldVersion-2038862331-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75229) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 10:04:04 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-4e4e6ab2-3668-4c99-881f-c8736dbdd3bb tempest-TestServerVolumeAttachScenarioOldVersion-2038862331 tempest-TestServerVolumeAttachScenarioOldVersion-2038862331-project-member] SCSI volumes sdd have been removed. {{(pid=75229) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 10:04:04 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e4e6ab2-3668-4c99-881f-c8736dbdd3bb tempest-TestServerVolumeAttachScenarioOldVersion-2038862331 tempest-TestServerVolumeAttachScenarioOldVersion-2038862331-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:55d338b4-2353-4501-b00d-fafa0dfe8758')] {{(pid=75229) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 10:04:04 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55d338b4-2353-4501-b00d-fafa0dfe8758 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:04:04 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55d338b4-2353-4501-b00d-fafa0dfe8758 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:04:04 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[266826c3-7acf-4207-a206-c3d078c7487b]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:04:04 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e4e6ab2-3668-4c99-881f-c8736dbdd3bb tempest-TestServerVolumeAttachScenarioOldVersion-2038862331 tempest-TestServerVolumeAttachScenarioOldVersion-2038862331-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 10:04:04 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55d338b4-2353-4501-b00d-fafa0dfe8758 -p 172.16.0.220:3260 --logout {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:04:04 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55d338b4-2353-4501-b00d-fafa0dfe8758 -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:04:04 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[59ef06d8-f887-4207-b350-f30f1becd415]: (4, ('Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:55d338b4-2353-4501-b00d-fafa0dfe8758, portal: 172.16.0.220,3260]\nLogout of [sid: 43, target: iqn.2010-10.org.openstack:55d338b4-2353-4501-b00d-fafa0dfe8758, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:04:04 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e4e6ab2-3668-4c99-881f-c8736dbdd3bb tempest-TestServerVolumeAttachScenarioOldVersion-2038862331 tempest-TestServerVolumeAttachScenarioOldVersion-2038862331-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:55d338b4-2353-4501-b00d-fafa0dfe8758, portal: 172.16.0.220,3260]
Nov 14 10:04:04 user nova-compute[75229]: Logout of [sid: 43, target: iqn.2010-10.org.openstack:55d338b4-2353-4501-b00d-fafa0dfe8758, portal: 172.16.0.220,3260] successful.
Nov 14 10:04:04 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 10:04:04 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55d338b4-2353-4501-b00d-fafa0dfe8758 -p 172.16.0.220:3260 --op delete {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:04:04 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55d338b4-2353-4501-b00d-fafa0dfe8758 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:04:04 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[16dbfb82-b5d7-4edf-a3ad-41a98f64de2f]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:04:04 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e4e6ab2-3668-4c99-881f-c8736dbdd3bb tempest-TestServerVolumeAttachScenarioOldVersion-2038862331 tempest-TestServerVolumeAttachScenarioOldVersion-2038862331-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 10:04:04 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-4e4e6ab2-3668-4c99-881f-c8736dbdd3bb tempest-TestServerVolumeAttachScenarioOldVersion-2038862331 tempest-TestServerVolumeAttachScenarioOldVersion-2038862331-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.324s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 10:04:04 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e4e6ab2-3668-4c99-881f-c8736dbdd3bb tempest-TestServerVolumeAttachScenarioOldVersion-2038862331 tempest-TestServerVolumeAttachScenarioOldVersion-2038862331-project-member] <== disconnect_volume: return (326ms) None {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 10:04:04 user nova-compute[75229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4e4e6ab2-3668-4c99-881f-c8736dbdd3bb tempest-TestServerVolumeAttachScenarioOldVersion-2038862331 tempest-TestServerVolumeAttachScenarioOldVersion-2038862331-project-member] [instance: 7469b999-196b-41c7-9d30-f810b74eaa99] Disconnected iSCSI Volume {{(pid=75229) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 10:04:04 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:04:04 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:04:04 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:04:05 user nova-compute[75229]: DEBUG nova.compute.manager [req-fe0eb554-4ae7-4412-8a8e-1743b3c442bd req-9a6aecf0-1104-4b96-817d-0f611753d0cb service nova] [instance: 3795dd8f-8a10-4939-8f2c-bacefe5f5aa1] Received event network-vif-plugged-c22c2020-a8ff-4cd5-8b78-89b1bb277e8c {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 10:04:05 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-fe0eb554-4ae7-4412-8a8e-1743b3c442bd req-9a6aecf0-1104-4b96-817d-0f611753d0cb service nova] Acquiring lock "3795dd8f-8a10-4939-8f2c-bacefe5f5aa1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:04:05 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-fe0eb554-4ae7-4412-8a8e-1743b3c442bd req-9a6aecf0-1104-4b96-817d-0f611753d0cb service nova] Lock "3795dd8f-8a10-4939-8f2c-bacefe5f5aa1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:04:05 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-fe0eb554-4ae7-4412-8a8e-1743b3c442bd req-9a6aecf0-1104-4b96-817d-0f611753d0cb service nova] Lock "3795dd8f-8a10-4939-8f2c-bacefe5f5aa1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:04:05 user nova-compute[75229]: DEBUG nova.compute.manager [req-fe0eb554-4ae7-4412-8a8e-1743b3c442bd req-9a6aecf0-1104-4b96-817d-0f611753d0cb service nova] [instance: 3795dd8f-8a10-4939-8f2c-bacefe5f5aa1] No waiting events found dispatching network-vif-plugged-c22c2020-a8ff-4cd5-8b78-89b1bb277e8c {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 10:04:05 user nova-compute[75229]: WARNING nova.compute.manager [req-fe0eb554-4ae7-4412-8a8e-1743b3c442bd req-9a6aecf0-1104-4b96-817d-0f611753d0cb service nova] [instance: 3795dd8f-8a10-4939-8f2c-bacefe5f5aa1] Received unexpected event network-vif-plugged-c22c2020-a8ff-4cd5-8b78-89b1bb277e8c for instance with vm_state building and task_state spawning.
Nov 14 10:04:05 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cda8c5ad-e70c-4021-bace-d55831c4bc78/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:04:05 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:04:05 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:04:05 user nova-compute[75229]: DEBUG nova.objects.instance [None req-4e4e6ab2-3668-4c99-881f-c8736dbdd3bb tempest-TestServerVolumeAttachScenarioOldVersion-2038862331 tempest-TestServerVolumeAttachScenarioOldVersion-2038862331-project-member] Lazy-loading 'flavor' on Instance uuid 7469b999-196b-41c7-9d30-f810b74eaa99 {{(pid=75229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 10:04:05 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cda8c5ad-e70c-4021-bace-d55831c4bc78/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:04:05 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cda8c5ad-e70c-4021-bace-d55831c4bc78/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:04:05 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-4e4e6ab2-3668-4c99-881f-c8736dbdd3bb tempest-TestServerVolumeAttachScenarioOldVersion-2038862331 tempest-TestServerVolumeAttachScenarioOldVersion-2038862331-project-member] Lock "7469b999-196b-41c7-9d30-f810b74eaa99" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.923s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:04:05 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cda8c5ad-e70c-4021-bace-d55831c4bc78/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:04:05 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=75229) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 10:04:05 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1679275-ebb1-4f15-80a4-b8fd614fc34b/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:04:05 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1679275-ebb1-4f15-80a4-b8fd614fc34b/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:04:05 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1679275-ebb1-4f15-80a4-b8fd614fc34b/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:04:06 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1679275-ebb1-4f15-80a4-b8fd614fc34b/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:04:06 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75229) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 10:04:06 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de62e75a-207e-4aa3-a592-52f48577c2b9/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:04:06 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de62e75a-207e-4aa3-a592-52f48577c2b9/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:04:06 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de62e75a-207e-4aa3-a592-52f48577c2b9/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:04:06 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de62e75a-207e-4aa3-a592-52f48577c2b9/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:04:06 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c9fe69e-3f9d-4b30-a9e4-efc3e83efa17/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:04:06 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c9fe69e-3f9d-4b30-a9e4-efc3e83efa17/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:04:06 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c9fe69e-3f9d-4b30-a9e4-efc3e83efa17/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:04:06 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c9fe69e-3f9d-4b30-a9e4-efc3e83efa17/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:04:06 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7469b999-196b-41c7-9d30-f810b74eaa99/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:04:06 user nova-compute[75229]: DEBUG nova.compute.manager [None req-bcec78f7-7f14-484a-8182-78e7207a0fc9 tempest-ServerActionsV293TestJSON-1571447010 tempest-ServerActionsV293TestJSON-1571447010-project-member] [instance: 3795dd8f-8a10-4939-8f2c-bacefe5f5aa1] Instance event wait completed in 0 seconds for  {{(pid=75229) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 10:04:06 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-bcec78f7-7f14-484a-8182-78e7207a0fc9 tempest-ServerActionsV293TestJSON-1571447010 tempest-ServerActionsV293TestJSON-1571447010-project-member] [instance: 3795dd8f-8a10-4939-8f2c-bacefe5f5aa1] Guest created on hypervisor {{(pid=75229) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 10:04:06 user nova-compute[75229]: INFO nova.virt.libvirt.driver [-] [instance: 3795dd8f-8a10-4939-8f2c-bacefe5f5aa1] Instance spawned successfully.
Nov 14 10:04:06 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-bcec78f7-7f14-484a-8182-78e7207a0fc9 tempest-ServerActionsV293TestJSON-1571447010 tempest-ServerActionsV293TestJSON-1571447010-project-member] [instance: 3795dd8f-8a10-4939-8f2c-bacefe5f5aa1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 10:04:07 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-bcec78f7-7f14-484a-8182-78e7207a0fc9 tempest-ServerActionsV293TestJSON-1571447010 tempest-ServerActionsV293TestJSON-1571447010-project-member] [instance: 3795dd8f-8a10-4939-8f2c-bacefe5f5aa1] Found default for hw_cdrom_bus of ide {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 10:04:07 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-bcec78f7-7f14-484a-8182-78e7207a0fc9 tempest-ServerActionsV293TestJSON-1571447010 tempest-ServerActionsV293TestJSON-1571447010-project-member] [instance: 3795dd8f-8a10-4939-8f2c-bacefe5f5aa1] Found default for hw_disk_bus of virtio {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 10:04:07 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-bcec78f7-7f14-484a-8182-78e7207a0fc9 tempest-ServerActionsV293TestJSON-1571447010 tempest-ServerActionsV293TestJSON-1571447010-project-member] [instance: 3795dd8f-8a10-4939-8f2c-bacefe5f5aa1] Found default for hw_input_bus of None {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 10:04:07 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-bcec78f7-7f14-484a-8182-78e7207a0fc9 tempest-ServerActionsV293TestJSON-1571447010 tempest-ServerActionsV293TestJSON-1571447010-project-member] [instance: 3795dd8f-8a10-4939-8f2c-bacefe5f5aa1] Found default for hw_pointer_model of None {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 10:04:07 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-bcec78f7-7f14-484a-8182-78e7207a0fc9 tempest-ServerActionsV293TestJSON-1571447010 tempest-ServerActionsV293TestJSON-1571447010-project-member] [instance: 3795dd8f-8a10-4939-8f2c-bacefe5f5aa1] Found default for hw_video_model of virtio {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 10:04:07 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-bcec78f7-7f14-484a-8182-78e7207a0fc9 tempest-ServerActionsV293TestJSON-1571447010 tempest-ServerActionsV293TestJSON-1571447010-project-member] [instance: 3795dd8f-8a10-4939-8f2c-bacefe5f5aa1] Found default for hw_vif_model of virtio {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 10:04:07 user nova-compute[75229]: INFO nova.compute.manager [None req-bcec78f7-7f14-484a-8182-78e7207a0fc9 tempest-ServerActionsV293TestJSON-1571447010 tempest-ServerActionsV293TestJSON-1571447010-project-member] [instance: 3795dd8f-8a10-4939-8f2c-bacefe5f5aa1] Took 5.00 seconds to spawn the instance on the hypervisor.
Nov 14 10:04:07 user nova-compute[75229]: DEBUG nova.compute.manager [None req-bcec78f7-7f14-484a-8182-78e7207a0fc9 tempest-ServerActionsV293TestJSON-1571447010 tempest-ServerActionsV293TestJSON-1571447010-project-member] [instance: 3795dd8f-8a10-4939-8f2c-bacefe5f5aa1] Checking state {{(pid=75229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 10:04:07 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7469b999-196b-41c7-9d30-f810b74eaa99/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:04:07 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7469b999-196b-41c7-9d30-f810b74eaa99/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:04:07 user nova-compute[75229]: DEBUG nova.compute.manager [req-8deb36ae-d7ab-4030-b405-49a7af303a2d req-761c3d03-2394-47fb-b84a-f278594cb0df service nova] [instance: 3795dd8f-8a10-4939-8f2c-bacefe5f5aa1] Received event network-vif-plugged-c22c2020-a8ff-4cd5-8b78-89b1bb277e8c {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 10:04:07 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-8deb36ae-d7ab-4030-b405-49a7af303a2d req-761c3d03-2394-47fb-b84a-f278594cb0df service nova] Acquiring lock "3795dd8f-8a10-4939-8f2c-bacefe5f5aa1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:04:07 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-8deb36ae-d7ab-4030-b405-49a7af303a2d req-761c3d03-2394-47fb-b84a-f278594cb0df service nova] Lock "3795dd8f-8a10-4939-8f2c-bacefe5f5aa1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:04:07 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-8deb36ae-d7ab-4030-b405-49a7af303a2d req-761c3d03-2394-47fb-b84a-f278594cb0df service nova] Lock "3795dd8f-8a10-4939-8f2c-bacefe5f5aa1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:04:07 user nova-compute[75229]: DEBUG nova.compute.manager [req-8deb36ae-d7ab-4030-b405-49a7af303a2d req-761c3d03-2394-47fb-b84a-f278594cb0df service nova] [instance: 3795dd8f-8a10-4939-8f2c-bacefe5f5aa1] No waiting events found dispatching network-vif-plugged-c22c2020-a8ff-4cd5-8b78-89b1bb277e8c {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 10:04:07 user nova-compute[75229]: WARNING nova.compute.manager [req-8deb36ae-d7ab-4030-b405-49a7af303a2d req-761c3d03-2394-47fb-b84a-f278594cb0df service nova] [instance: 3795dd8f-8a10-4939-8f2c-bacefe5f5aa1] Received unexpected event network-vif-plugged-c22c2020-a8ff-4cd5-8b78-89b1bb277e8c for instance with vm_state building and task_state spawning.
Nov 14 10:04:07 user nova-compute[75229]: INFO nova.compute.manager [None req-bcec78f7-7f14-484a-8182-78e7207a0fc9 tempest-ServerActionsV293TestJSON-1571447010 tempest-ServerActionsV293TestJSON-1571447010-project-member] [instance: 3795dd8f-8a10-4939-8f2c-bacefe5f5aa1] Took 10.31 seconds to build instance.
Nov 14 10:04:07 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bcec78f7-7f14-484a-8182-78e7207a0fc9 tempest-ServerActionsV293TestJSON-1571447010 tempest-ServerActionsV293TestJSON-1571447010-project-member] Lock "3795dd8f-8a10-4939-8f2c-bacefe5f5aa1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.436s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:04:07 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7469b999-196b-41c7-9d30-f810b74eaa99/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:04:07 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75229) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 10:04:07 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75229) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 10:04:07 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5170e9e-66e3-4df1-9807-4958cac6480e/disk.rescue --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:04:07 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5170e9e-66e3-4df1-9807-4958cac6480e/disk.rescue --force-share --output=json" returned: 0 in 0.181s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:04:07 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5170e9e-66e3-4df1-9807-4958cac6480e/disk.rescue --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:04:07 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5170e9e-66e3-4df1-9807-4958cac6480e/disk.rescue --force-share --output=json" returned: 0 in 0.187s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:04:07 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5170e9e-66e3-4df1-9807-4958cac6480e/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:04:07 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5170e9e-66e3-4df1-9807-4958cac6480e/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:04:07 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5170e9e-66e3-4df1-9807-4958cac6480e/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:04:08 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5170e9e-66e3-4df1-9807-4958cac6480e/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:04:08 user nova-compute[75229]: WARNING nova.virt.libvirt.driver [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 10:04:08 user nova-compute[75229]: WARNING nova.virt.libvirt.driver [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 10:04:08 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Hypervisor/Node resource view: name=user free_ram=7844MB free_disk=25.05950927734375GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75229) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 10:04:08 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:04:08 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:04:08 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:04:08 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Instance 4c9fe69e-3f9d-4b30-a9e4-efc3e83efa17 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 10:04:08 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Instance b5170e9e-66e3-4df1-9807-4958cac6480e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 10:04:08 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Instance cda8c5ad-e70c-4021-bace-d55831c4bc78 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 10:04:08 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Instance 30ae1f73-e0f3-4e26-987e-a684471a160d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 10:04:08 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Instance d822d5e4-38d8-4ca7-a682-f2f2144b6005 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 10:04:08 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Instance 7469b999-196b-41c7-9d30-f810b74eaa99 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 10:04:08 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Instance c1679275-ebb1-4f15-80a4-b8fd614fc34b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 10:04:08 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Instance c3f1afd9-958f-4942-b341-6e1f46a0c831 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 10:04:08 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Instance de62e75a-207e-4aa3-a592-52f48577c2b9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 10:04:08 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Instance 3795dd8f-8a10-4939-8f2c-bacefe5f5aa1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 10:04:08 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75229) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 10:04:08 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75229) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 10:04:08 user nova-compute[75229]: DEBUG nova.compute.provider_tree [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Inventory has not changed in ProviderTree for provider: d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 {{(pid=75229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 10:04:08 user nova-compute[75229]: DEBUG nova.scheduler.client.report [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Inventory has not changed for provider d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 10:04:08 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:04:08 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Compute_service record updated for user:user {{(pid=75229) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 10:04:08 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.431s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:04:11 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:04:11 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:04:11 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:04:11 user nova-compute[75229]: DEBUG nova.compute.manager [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75229) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 10:04:12 user nova-compute[75229]: DEBUG nova.compute.manager [None req-caa4c043-e337-4b1c-9838-9a5eaba70043 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] [instance: c1679275-ebb1-4f15-80a4-b8fd614fc34b] Checking state {{(pid=75229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 10:04:12 user nova-compute[75229]: INFO nova.compute.manager [None req-caa4c043-e337-4b1c-9838-9a5eaba70043 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] [instance: c1679275-ebb1-4f15-80a4-b8fd614fc34b] instance snapshotting
Nov 14 10:04:12 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-caa4c043-e337-4b1c-9838-9a5eaba70043 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] [instance: c1679275-ebb1-4f15-80a4-b8fd614fc34b] Beginning live snapshot process
Nov 14 10:04:13 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-caa4c043-e337-4b1c-9838-9a5eaba70043 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1679275-ebb1-4f15-80a4-b8fd614fc34b/disk --force-share --output=json -f qcow2 {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:04:13 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-caa4c043-e337-4b1c-9838-9a5eaba70043 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1679275-ebb1-4f15-80a4-b8fd614fc34b/disk --force-share --output=json -f qcow2" returned: 0 in 0.182s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:04:13 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-caa4c043-e337-4b1c-9838-9a5eaba70043 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1679275-ebb1-4f15-80a4-b8fd614fc34b/disk --force-share --output=json -f qcow2 {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:04:13 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-caa4c043-e337-4b1c-9838-9a5eaba70043 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1679275-ebb1-4f15-80a4-b8fd614fc34b/disk --force-share --output=json -f qcow2" returned: 0 in 0.202s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:04:13 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-caa4c043-e337-4b1c-9838-9a5eaba70043 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6 --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:04:13 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:04:13 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-caa4c043-e337-4b1c-9838-9a5eaba70043 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6 --force-share --output=json" returned: 0 in 0.171s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:04:13 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-caa4c043-e337-4b1c-9838-9a5eaba70043 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpj4uozp7b/bae4b6cd836b4b94997a121c930dbfef.delta 1073741824 {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:04:13 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-caa4c043-e337-4b1c-9838-9a5eaba70043 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpj4uozp7b/bae4b6cd836b4b94997a121c930dbfef.delta 1073741824" returned: 0 in 0.048s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:04:13 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-caa4c043-e337-4b1c-9838-9a5eaba70043 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] [instance: c1679275-ebb1-4f15-80a4-b8fd614fc34b] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 14 10:04:14 user nova-compute[75229]: DEBUG nova.virt.libvirt.guest [None req-caa4c043-e337-4b1c-9838-9a5eaba70043 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=75229) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 10:04:14 user nova-compute[75229]: DEBUG nova.virt.libvirt.guest [None req-caa4c043-e337-4b1c-9838-9a5eaba70043 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=75229) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 10:04:14 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-caa4c043-e337-4b1c-9838-9a5eaba70043 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] [instance: c1679275-ebb1-4f15-80a4-b8fd614fc34b] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 14 10:04:14 user nova-compute[75229]: DEBUG nova.privsep.utils [None req-caa4c043-e337-4b1c-9838-9a5eaba70043 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75229) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 14 10:04:14 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-caa4c043-e337-4b1c-9838-9a5eaba70043 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpj4uozp7b/bae4b6cd836b4b94997a121c930dbfef.delta /opt/stack/data/nova/instances/snapshots/tmpj4uozp7b/bae4b6cd836b4b94997a121c930dbfef {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:04:15 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-caa4c043-e337-4b1c-9838-9a5eaba70043 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpj4uozp7b/bae4b6cd836b4b94997a121c930dbfef.delta /opt/stack/data/nova/instances/snapshots/tmpj4uozp7b/bae4b6cd836b4b94997a121c930dbfef" returned: 0 in 0.534s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:04:15 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-caa4c043-e337-4b1c-9838-9a5eaba70043 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] [instance: c1679275-ebb1-4f15-80a4-b8fd614fc34b] Snapshot extracted, beginning image upload
Nov 14 10:04:17 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-caa4c043-e337-4b1c-9838-9a5eaba70043 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] [instance: c1679275-ebb1-4f15-80a4-b8fd614fc34b] Snapshot image upload complete
Nov 14 10:04:17 user nova-compute[75229]: INFO nova.compute.manager [None req-caa4c043-e337-4b1c-9838-9a5eaba70043 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] [instance: c1679275-ebb1-4f15-80a4-b8fd614fc34b] Took 5.18 seconds to snapshot the instance on the hypervisor.
Nov 14 10:04:18 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 10:04:18 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:04:18 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75229) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 10:04:18 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75229) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 10:04:18 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75229) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 10:04:18 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:04:19 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:04:21 user nova-compute[75229]: DEBUG nova.compute.manager [req-bbe3ad95-6865-4c48-83ee-9a12a6e1ef5c req-29f91ecc-3d83-433a-b059-e3d0efaccd2b service nova] [instance: c3f1afd9-958f-4942-b341-6e1f46a0c831] Received event network-changed-d97c0909-9495-4af2-add5-bd9a848dd755 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 10:04:21 user nova-compute[75229]: DEBUG nova.compute.manager [req-bbe3ad95-6865-4c48-83ee-9a12a6e1ef5c req-29f91ecc-3d83-433a-b059-e3d0efaccd2b service nova] [instance: c3f1afd9-958f-4942-b341-6e1f46a0c831] Refreshing instance network info cache due to event network-changed-d97c0909-9495-4af2-add5-bd9a848dd755. {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 10:04:21 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-bbe3ad95-6865-4c48-83ee-9a12a6e1ef5c req-29f91ecc-3d83-433a-b059-e3d0efaccd2b service nova] Acquiring lock "refresh_cache-c3f1afd9-958f-4942-b341-6e1f46a0c831" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 10:04:21 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-bbe3ad95-6865-4c48-83ee-9a12a6e1ef5c req-29f91ecc-3d83-433a-b059-e3d0efaccd2b service nova] Acquired lock "refresh_cache-c3f1afd9-958f-4942-b341-6e1f46a0c831" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 10:04:21 user nova-compute[75229]: DEBUG nova.network.neutron [req-bbe3ad95-6865-4c48-83ee-9a12a6e1ef5c req-29f91ecc-3d83-433a-b059-e3d0efaccd2b service nova] [instance: c3f1afd9-958f-4942-b341-6e1f46a0c831] Refreshing network info cache for port d97c0909-9495-4af2-add5-bd9a848dd755 {{(pid=75229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 10:04:22 user nova-compute[75229]: DEBUG nova.network.neutron [req-bbe3ad95-6865-4c48-83ee-9a12a6e1ef5c req-29f91ecc-3d83-433a-b059-e3d0efaccd2b service nova] [instance: c3f1afd9-958f-4942-b341-6e1f46a0c831] Updated VIF entry in instance network info cache for port d97c0909-9495-4af2-add5-bd9a848dd755. {{(pid=75229) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 10:04:22 user nova-compute[75229]: DEBUG nova.network.neutron [req-bbe3ad95-6865-4c48-83ee-9a12a6e1ef5c req-29f91ecc-3d83-433a-b059-e3d0efaccd2b service nova] [instance: c3f1afd9-958f-4942-b341-6e1f46a0c831] Updating instance_info_cache with network_info: [{"id": "d97c0909-9495-4af2-add5-bd9a848dd755", "address": "fa:16:3e:6f:4e:f9", "network": {"id": "118ea7c1-77c0-4660-b7b7-f311f6b0ec8a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1907578504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.90", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46620ac128944703899f22fe5439ba26", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd97c0909-94", "ovs_interfaceid": "d97c0909-9495-4af2-add5-bd9a848dd755", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 10:04:22 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-bbe3ad95-6865-4c48-83ee-9a12a6e1ef5c req-29f91ecc-3d83-433a-b059-e3d0efaccd2b service nova] Releasing lock "refresh_cache-c3f1afd9-958f-4942-b341-6e1f46a0c831" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 10:04:22 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-c66a792c-9d1d-40de-8291-c0ebca2c17be tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Acquiring lock "c3f1afd9-958f-4942-b341-6e1f46a0c831" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:04:22 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-c66a792c-9d1d-40de-8291-c0ebca2c17be tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Lock "c3f1afd9-958f-4942-b341-6e1f46a0c831" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:04:22 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-c66a792c-9d1d-40de-8291-c0ebca2c17be tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Acquiring lock "c3f1afd9-958f-4942-b341-6e1f46a0c831-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:04:22 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-c66a792c-9d1d-40de-8291-c0ebca2c17be tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Lock "c3f1afd9-958f-4942-b341-6e1f46a0c831-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:04:22 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-c66a792c-9d1d-40de-8291-c0ebca2c17be tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Lock "c3f1afd9-958f-4942-b341-6e1f46a0c831-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:04:22 user nova-compute[75229]: INFO nova.compute.manager [None req-c66a792c-9d1d-40de-8291-c0ebca2c17be tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] [instance: c3f1afd9-958f-4942-b341-6e1f46a0c831] Terminating instance
Nov 14 10:04:22 user nova-compute[75229]: DEBUG nova.compute.manager [None req-c66a792c-9d1d-40de-8291-c0ebca2c17be tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] [instance: c3f1afd9-958f-4942-b341-6e1f46a0c831] Start destroying the instance on the hypervisor. {{(pid=75229) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 10:04:22 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:04:22 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:04:22 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:04:22 user nova-compute[75229]: DEBUG nova.compute.manager [req-b9fcfcef-3d00-4adf-971d-6d96407a9971 req-3414909b-fb48-4e80-9c67-f57295d5f513 service nova] [instance: c3f1afd9-958f-4942-b341-6e1f46a0c831] Received event network-vif-unplugged-d97c0909-9495-4af2-add5-bd9a848dd755 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 10:04:22 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-b9fcfcef-3d00-4adf-971d-6d96407a9971 req-3414909b-fb48-4e80-9c67-f57295d5f513 service nova] Acquiring lock "c3f1afd9-958f-4942-b341-6e1f46a0c831-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:04:22 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-b9fcfcef-3d00-4adf-971d-6d96407a9971 req-3414909b-fb48-4e80-9c67-f57295d5f513 service nova] Lock "c3f1afd9-958f-4942-b341-6e1f46a0c831-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:04:22 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-b9fcfcef-3d00-4adf-971d-6d96407a9971 req-3414909b-fb48-4e80-9c67-f57295d5f513 service nova] Lock "c3f1afd9-958f-4942-b341-6e1f46a0c831-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:04:22 user nova-compute[75229]: DEBUG nova.compute.manager [req-b9fcfcef-3d00-4adf-971d-6d96407a9971 req-3414909b-fb48-4e80-9c67-f57295d5f513 service nova] [instance: c3f1afd9-958f-4942-b341-6e1f46a0c831] No waiting events found dispatching network-vif-unplugged-d97c0909-9495-4af2-add5-bd9a848dd755 {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 10:04:22 user nova-compute[75229]: DEBUG nova.compute.manager [req-b9fcfcef-3d00-4adf-971d-6d96407a9971 req-3414909b-fb48-4e80-9c67-f57295d5f513 service nova] [instance: c3f1afd9-958f-4942-b341-6e1f46a0c831] Received event network-vif-unplugged-d97c0909-9495-4af2-add5-bd9a848dd755 for instance with task_state deleting. {{(pid=75229) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 10:04:22 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:04:23 user nova-compute[75229]: INFO nova.virt.libvirt.driver [-] [instance: c3f1afd9-958f-4942-b341-6e1f46a0c831] Instance destroyed successfully.
Nov 14 10:04:23 user nova-compute[75229]: DEBUG nova.objects.instance [None req-c66a792c-9d1d-40de-8291-c0ebca2c17be tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Lazy-loading 'resources' on Instance uuid c3f1afd9-958f-4942-b341-6e1f46a0c831 {{(pid=75229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 10:04:23 user nova-compute[75229]: DEBUG nova.virt.libvirt.vif [None req-c66a792c-9d1d-40de-8291-c0ebca2c17be tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T10:02:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-194967460',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-194967460',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-194967460',id=42,image_ref='a73bae01-636f-4ff9-a077-79b25dfed578',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKGquYHi5GjDfDS0FaMvWSyQa01T6gskJkOB7tYQYZYh94+Gr0NIT1untrqUqWJZjoQhvO/MeVpvdz5vs/YzGL46c7c0IIBCM8UgQMVAflkGdZjVdtI4ZF5hjz0STmriUw==',key_name='tempest-keypair-1097653983',keypairs=<?>,launch_index=0,launched_at=2023-11-14T10:02:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='46620ac128944703899f22fe5439ba26',ramdisk_id='',reservation_id='r-aokjmo5a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-2064993142',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-2064993142-project-member',image_root_device_name='/dev/vda',owner_project_name='tempest-TestVolumeBootPattern-2064993142',owner_user_name='tempest-TestVolumeBootPattern-2064993142-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T10:02:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c26f33e4cdf14ba796445959953f8685',uuid=c3f1afd9-958f-4942-b341-6e1f46a0c831,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d97c0909-9495-4af2-add5-bd9a848dd755", "address": "fa:16:3e:6f:4e:f9", "network": {"id": "118ea7c1-77c0-4660-b7b7-f311f6b0ec8a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1907578504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.90", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46620ac128944703899f22fe5439ba26", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd97c0909-94", "ovs_interfaceid": "d97c0909-9495-4af2-add5-bd9a848dd755", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 10:04:23 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-c66a792c-9d1d-40de-8291-c0ebca2c17be tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Converting VIF {"id": "d97c0909-9495-4af2-add5-bd9a848dd755", "address": "fa:16:3e:6f:4e:f9", "network": {"id": "118ea7c1-77c0-4660-b7b7-f311f6b0ec8a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1907578504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.90", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46620ac128944703899f22fe5439ba26", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd97c0909-94", "ovs_interfaceid": "d97c0909-9495-4af2-add5-bd9a848dd755", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 10:04:23 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-c66a792c-9d1d-40de-8291-c0ebca2c17be tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6f:4e:f9,bridge_name='br-int',has_traffic_filtering=True,id=d97c0909-9495-4af2-add5-bd9a848dd755,network=Network(118ea7c1-77c0-4660-b7b7-f311f6b0ec8a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd97c0909-94') {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 10:04:23 user nova-compute[75229]: DEBUG os_vif [None req-c66a792c-9d1d-40de-8291-c0ebca2c17be tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6f:4e:f9,bridge_name='br-int',has_traffic_filtering=True,id=d97c0909-9495-4af2-add5-bd9a848dd755,network=Network(118ea7c1-77c0-4660-b7b7-f311f6b0ec8a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd97c0909-94') {{(pid=75229) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 10:04:23 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:04:23 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd97c0909-94, bridge=br-int, if_exists=True) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 10:04:23 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:04:23 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:04:23 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d0d5d535-8c42-4cf9-a01a-2aac14cc423e) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 10:04:23 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:04:23 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 10:04:23 user nova-compute[75229]: INFO os_vif [None req-c66a792c-9d1d-40de-8291-c0ebca2c17be tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6f:4e:f9,bridge_name='br-int',has_traffic_filtering=True,id=d97c0909-9495-4af2-add5-bd9a848dd755,network=Network(118ea7c1-77c0-4660-b7b7-f311f6b0ec8a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd97c0909-94')
Nov 14 10:04:23 user nova-compute[75229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c66a792c-9d1d-40de-8291-c0ebca2c17be tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] [instance: c3f1afd9-958f-4942-b341-6e1f46a0c831] calling os-brick to detach iSCSI Volume {{(pid=75229) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 10:04:23 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-c66a792c-9d1d-40de-8291-c0ebca2c17be tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f73f85151b0>, {'target_iqn': 'iqn.2010-10.org.openstack:64caa5ab-59eb-4251-9cef-f8576154c443', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zNJrebdA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 10:04:23 user nova-compute[75229]: WARNING os_brick.initiator.connectors.base [None req-c66a792c-9d1d-40de-8291-c0ebca2c17be tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 10:04:23 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-c66a792c-9d1d-40de-8291-c0ebca2c17be tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 10:04:23 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-c66a792c-9d1d-40de-8291-c0ebca2c17be tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 10:04:23 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:04:23 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:04:23 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7390aaa-f0a7-4d0c-acfe-7576c61fc86f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2977635e-b11f-4ab2-875c-e9f396b932dc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4ddb200b-47ca-4449-9973-be76424a6761\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:64caa5ab-59eb-4251-9cef-f8576154c443\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5aebc438-0289-44fe-ad84-4e696468f50e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:04:23 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-c66a792c-9d1d-40de-8291-c0ebca2c17be tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 10:04:23 user nova-compute[75229]: No targets found.
Nov 14 10:04:23 user nova-compute[75229]: iSNS:
Nov 14 10:04:23 user nova-compute[75229]: No targets found.
Nov 14 10:04:23 user nova-compute[75229]: STATIC:
Nov 14 10:04:23 user nova-compute[75229]: Target: iqn.2010-10.org.openstack:2977635e-b11f-4ab2-875c-e9f396b932dc
Nov 14 10:04:23 user nova-compute[75229]:         Portal: 172.16.0.220:3260,-1
Nov 14 10:04:23 user nova-compute[75229]:                 Iface Name: default
Nov 14 10:04:23 user nova-compute[75229]: Target: iqn.2010-10.org.openstack:4ddb200b-47ca-4449-9973-be76424a6761
Nov 14 10:04:23 user nova-compute[75229]:         Portal: 172.16.0.220:3260,-1
Nov 14 10:04:23 user nova-compute[75229]:                 Iface Name: default
Nov 14 10:04:23 user nova-compute[75229]: Target: iqn.2010-10.org.openstack:64caa5ab-59eb-4251-9cef-f8576154c443
Nov 14 10:04:23 user nova-compute[75229]:         Portal: 172.16.0.220:3260,-1
Nov 14 10:04:23 user nova-compute[75229]:                 Iface Name: default
Nov 14 10:04:23 user nova-compute[75229]: Target: iqn.2010-10.org.openstack:5aebc438-0289-44fe-ad84-4e696468f50e
Nov 14 10:04:23 user nova-compute[75229]:         Portal: 172.16.0.220:3260,-1
Nov 14 10:04:23 user nova-compute[75229]:                 Iface Name: default
Nov 14 10:04:23 user nova-compute[75229]: FIRMWARE:
Nov 14 10:04:23 user nova-compute[75229]: No targets found.
Nov 14 10:04:23 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 10:04:23 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-c66a792c-9d1d-40de-8291-c0ebca2c17be tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 10:04:23 user nova-compute[75229]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 10:04:23 user nova-compute[75229]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75229) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 10:04:23 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-c66a792c-9d1d-40de-8291-c0ebca2c17be tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:64caa5ab-59eb-4251-9cef-f8576154c443', 0)] {{(pid=75229) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 10:04:23 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:04:23 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:04:23 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[11679dce-9cbf-44a8-8407-46eea3449103]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2977635e-b11f-4ab2-875c-e9f396b932dc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4ddb200b-47ca-4449-9973-be76424a6761\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5aebc438-0289-44fe-ad84-4e696468f50e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:64caa5ab-59eb-4251-9cef-f8576154c443\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:04:23 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:04:23 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:04:23 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ec37ada-27e3-47cd-b075-8fffb1be5a84]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aebc438-0289-44fe-ad84-4e696468f50e (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2977635e-b11f-4ab2-875c-e9f396b932dc (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64caa5ab-59eb-4251-9cef-f8576154c443 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ddb200b-47ca-4449-9973-be76424a6761 (non-flash)\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:04:23 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-c66a792c-9d1d-40de-8291-c0ebca2c17be tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aebc438-0289-44fe-ad84-4e696468f50e (non-flash)
Nov 14 10:04:23 user nova-compute[75229]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2977635e-b11f-4ab2-875c-e9f396b932dc (non-flash)
Nov 14 10:04:23 user nova-compute[75229]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64caa5ab-59eb-4251-9cef-f8576154c443 (non-flash)
Nov 14 10:04:23 user nova-compute[75229]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ddb200b-47ca-4449-9973-be76424a6761 (non-flash)
Nov 14 10:04:23 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 10:04:23 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-c66a792c-9d1d-40de-8291-c0ebca2c17be tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aebc438-0289-44fe-ad84-4e696468f50e (non-flash)
Nov 14 10:04:23 user nova-compute[75229]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2977635e-b11f-4ab2-875c-e9f396b932dc (non-flash)
Nov 14 10:04:23 user nova-compute[75229]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64caa5ab-59eb-4251-9cef-f8576154c443 (non-flash)
Nov 14 10:04:23 user nova-compute[75229]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ddb200b-47ca-4449-9973-be76424a6761 (non-flash)
Nov 14 10:04:23 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 10:04:23 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-c66a792c-9d1d-40de-8291-c0ebca2c17be tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f73d4ecaef0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:64caa5ab-59eb-4251-9cef-f8576154c443'): ({'sdb'}, set())}) {{(pid=75229) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 10:04:23 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-c66a792c-9d1d-40de-8291-c0ebca2c17be tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Removing single pathed devices sdb {{(pid=75229) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 10:04:23 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:04:23 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:04:23 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f41bfb6-88df-47d3-8a0d-1652c33e380c]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:04:23 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:04:23 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.025s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:04:23 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[138e71c2-3979-4d2d-a21a-8406caca2edc]: (4, ('ok\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:04:23 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-c66a792c-9d1d-40de-8291-c0ebca2c17be tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Flushing IO for device /dev/sdb {{(pid=75229) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 10:04:23 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:04:23 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:04:23 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[0beff847-c3b5-43d8-846e-bd17b2fd06b3]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:04:23 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-c66a792c-9d1d-40de-8291-c0ebca2c17be tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75229) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 10:04:23 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:04:23 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.042s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:04:23 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c8b8829-9026-45a5-8353-4f8149f0b72c]: (4, ('1', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:04:23 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-c66a792c-9d1d-40de-8291-c0ebca2c17be tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75229) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 10:04:23 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-c66a792c-9d1d-40de-8291-c0ebca2c17be tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] SCSI volumes sdb have been removed. {{(pid=75229) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 10:04:23 user nova-compute[75229]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-26431306631653561', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_84bc782f', '/dev/disk/by-id/scsi-1SCST_BIO84bc782f-d10f1e5a56ac5bab') {{(pid=86458) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 14 10:04:23 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[55ff5966-035d-4eb5-a7e8-d0f8c26faa49]: (4, None) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:04:23 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-c66a792c-9d1d-40de-8291-c0ebca2c17be tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:64caa5ab-59eb-4251-9cef-f8576154c443')] {{(pid=75229) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 10:04:23 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64caa5ab-59eb-4251-9cef-f8576154c443 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:04:23 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64caa5ab-59eb-4251-9cef-f8576154c443 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:04:23 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[26503500-6702-41d1-ae5a-fe6d31095a4e]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:04:23 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-c66a792c-9d1d-40de-8291-c0ebca2c17be tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 10:04:23 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64caa5ab-59eb-4251-9cef-f8576154c443 -p 172.16.0.220:3260 --logout {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:04:23 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64caa5ab-59eb-4251-9cef-f8576154c443 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:04:23 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[78e1c618-459e-40b3-b74f-0efd369d9bf1]: (4, ('Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:64caa5ab-59eb-4251-9cef-f8576154c443, portal: 172.16.0.220,3260]\nLogout of [sid: 42, target: iqn.2010-10.org.openstack:64caa5ab-59eb-4251-9cef-f8576154c443, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:04:23 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-c66a792c-9d1d-40de-8291-c0ebca2c17be tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:64caa5ab-59eb-4251-9cef-f8576154c443, portal: 172.16.0.220,3260]
Nov 14 10:04:23 user nova-compute[75229]: Logout of [sid: 42, target: iqn.2010-10.org.openstack:64caa5ab-59eb-4251-9cef-f8576154c443, portal: 172.16.0.220,3260] successful.
Nov 14 10:04:23 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 10:04:23 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64caa5ab-59eb-4251-9cef-f8576154c443 -p 172.16.0.220:3260 --op delete {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:04:23 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64caa5ab-59eb-4251-9cef-f8576154c443 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:04:23 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e03c127-ad06-4405-bbde-e5bd99523f15]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:04:23 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-c66a792c-9d1d-40de-8291-c0ebca2c17be tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 10:04:23 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-c66a792c-9d1d-40de-8291-c0ebca2c17be tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.343s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 10:04:23 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-c66a792c-9d1d-40de-8291-c0ebca2c17be tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] <== disconnect_volume: return (345ms) None {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 10:04:23 user nova-compute[75229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c66a792c-9d1d-40de-8291-c0ebca2c17be tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] [instance: c3f1afd9-958f-4942-b341-6e1f46a0c831] Disconnected iSCSI Volume {{(pid=75229) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 10:04:23 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-c66a792c-9d1d-40de-8291-c0ebca2c17be tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] [instance: c3f1afd9-958f-4942-b341-6e1f46a0c831] Deleting instance files /opt/stack/data/nova/instances/c3f1afd9-958f-4942-b341-6e1f46a0c831_del
Nov 14 10:04:23 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-c66a792c-9d1d-40de-8291-c0ebca2c17be tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] [instance: c3f1afd9-958f-4942-b341-6e1f46a0c831] Deletion of /opt/stack/data/nova/instances/c3f1afd9-958f-4942-b341-6e1f46a0c831_del complete
Nov 14 10:04:23 user nova-compute[75229]: INFO nova.compute.manager [None req-c66a792c-9d1d-40de-8291-c0ebca2c17be tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] [instance: c3f1afd9-958f-4942-b341-6e1f46a0c831] Took 1.27 seconds to destroy the instance on the hypervisor.
Nov 14 10:04:23 user nova-compute[75229]: DEBUG oslo.service.loopingcall [None req-c66a792c-9d1d-40de-8291-c0ebca2c17be tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75229) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 10:04:23 user nova-compute[75229]: DEBUG nova.compute.manager [-] [instance: c3f1afd9-958f-4942-b341-6e1f46a0c831] Deallocating network for instance {{(pid=75229) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 10:04:23 user nova-compute[75229]: DEBUG nova.network.neutron [-] [instance: c3f1afd9-958f-4942-b341-6e1f46a0c831] deallocate_for_instance() {{(pid=75229) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 10:04:23 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:04:24 user nova-compute[75229]: DEBUG nova.network.neutron [-] [instance: c3f1afd9-958f-4942-b341-6e1f46a0c831] Updating instance_info_cache with network_info: [] {{(pid=75229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 10:04:24 user nova-compute[75229]: INFO nova.compute.manager [-] [instance: c3f1afd9-958f-4942-b341-6e1f46a0c831] Took 0.73 seconds to deallocate network for instance.
Nov 14 10:04:24 user nova-compute[75229]: DEBUG nova.compute.manager [req-9faebd96-eb36-414e-82b3-f5d4a2b5eb92 req-fdfdeb05-92f7-4958-bd66-6a542c1faddf service nova] [instance: c3f1afd9-958f-4942-b341-6e1f46a0c831] Received event network-vif-deleted-d97c0909-9495-4af2-add5-bd9a848dd755 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 10:04:24 user nova-compute[75229]: INFO nova.compute.manager [req-9faebd96-eb36-414e-82b3-f5d4a2b5eb92 req-fdfdeb05-92f7-4958-bd66-6a542c1faddf service nova] [instance: c3f1afd9-958f-4942-b341-6e1f46a0c831] Neutron deleted interface d97c0909-9495-4af2-add5-bd9a848dd755; detaching it from the instance and deleting it from the info cache
Nov 14 10:04:24 user nova-compute[75229]: DEBUG nova.network.neutron [req-9faebd96-eb36-414e-82b3-f5d4a2b5eb92 req-fdfdeb05-92f7-4958-bd66-6a542c1faddf service nova] [instance: c3f1afd9-958f-4942-b341-6e1f46a0c831] Updating instance_info_cache with network_info: [] {{(pid=75229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 10:04:24 user nova-compute[75229]: DEBUG nova.compute.manager [req-9faebd96-eb36-414e-82b3-f5d4a2b5eb92 req-fdfdeb05-92f7-4958-bd66-6a542c1faddf service nova] [instance: c3f1afd9-958f-4942-b341-6e1f46a0c831] Detach interface failed, port_id=d97c0909-9495-4af2-add5-bd9a848dd755, reason: Instance c3f1afd9-958f-4942-b341-6e1f46a0c831 could not be found. {{(pid=75229) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 14 10:04:25 user nova-compute[75229]: DEBUG nova.compute.manager [req-788e6133-3cfe-4c5b-b567-ace1319f807c req-4ff14912-e7c7-46b5-aa67-b48414486a61 service nova] [instance: c3f1afd9-958f-4942-b341-6e1f46a0c831] Received event network-vif-plugged-d97c0909-9495-4af2-add5-bd9a848dd755 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 10:04:25 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-788e6133-3cfe-4c5b-b567-ace1319f807c req-4ff14912-e7c7-46b5-aa67-b48414486a61 service nova] Acquiring lock "c3f1afd9-958f-4942-b341-6e1f46a0c831-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:04:25 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-788e6133-3cfe-4c5b-b567-ace1319f807c req-4ff14912-e7c7-46b5-aa67-b48414486a61 service nova] Lock "c3f1afd9-958f-4942-b341-6e1f46a0c831-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:04:25 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-788e6133-3cfe-4c5b-b567-ace1319f807c req-4ff14912-e7c7-46b5-aa67-b48414486a61 service nova] Lock "c3f1afd9-958f-4942-b341-6e1f46a0c831-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:04:25 user nova-compute[75229]: DEBUG nova.compute.manager [req-788e6133-3cfe-4c5b-b567-ace1319f807c req-4ff14912-e7c7-46b5-aa67-b48414486a61 service nova] [instance: c3f1afd9-958f-4942-b341-6e1f46a0c831] No waiting events found dispatching network-vif-plugged-d97c0909-9495-4af2-add5-bd9a848dd755 {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 10:04:25 user nova-compute[75229]: WARNING nova.compute.manager [req-788e6133-3cfe-4c5b-b567-ace1319f807c req-4ff14912-e7c7-46b5-aa67-b48414486a61 service nova] [instance: c3f1afd9-958f-4942-b341-6e1f46a0c831] Received unexpected event network-vif-plugged-d97c0909-9495-4af2-add5-bd9a848dd755 for instance with vm_state active and task_state deleting.
Nov 14 10:04:25 user nova-compute[75229]: INFO nova.compute.manager [None req-c66a792c-9d1d-40de-8291-c0ebca2c17be tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] [instance: c3f1afd9-958f-4942-b341-6e1f46a0c831] Took 0.85 seconds to detach 1 volumes for instance.
Nov 14 10:04:25 user nova-compute[75229]: DEBUG nova.compute.manager [None req-c66a792c-9d1d-40de-8291-c0ebca2c17be tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] [instance: c3f1afd9-958f-4942-b341-6e1f46a0c831] Deleting volume: 64caa5ab-59eb-4251-9cef-f8576154c443 {{(pid=75229) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 14 10:04:25 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-c66a792c-9d1d-40de-8291-c0ebca2c17be tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:04:25 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-c66a792c-9d1d-40de-8291-c0ebca2c17be tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:04:25 user nova-compute[75229]: DEBUG nova.compute.provider_tree [None req-c66a792c-9d1d-40de-8291-c0ebca2c17be tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Inventory has not changed in ProviderTree for provider: d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 {{(pid=75229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 10:04:25 user nova-compute[75229]: DEBUG nova.scheduler.client.report [None req-c66a792c-9d1d-40de-8291-c0ebca2c17be tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Inventory has not changed for provider d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 10:04:25 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-c66a792c-9d1d-40de-8291-c0ebca2c17be tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.304s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:04:25 user nova-compute[75229]: INFO nova.scheduler.client.report [None req-c66a792c-9d1d-40de-8291-c0ebca2c17be tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Deleted allocations for instance c3f1afd9-958f-4942-b341-6e1f46a0c831
Nov 14 10:04:25 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-c66a792c-9d1d-40de-8291-c0ebca2c17be tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Lock "c3f1afd9-958f-4942-b341-6e1f46a0c831" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.376s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:04:28 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:04:28 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:04:33 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:04:33 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:04:36 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-d5925cb2-dbd1-45a5-a33b-fe8e94f2431c tempest-TestServerVolumeAttachScenarioOldVersion-2038862331 tempest-TestServerVolumeAttachScenarioOldVersion-2038862331-project-member] Acquiring lock "7469b999-196b-41c7-9d30-f810b74eaa99" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:04:36 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-d5925cb2-dbd1-45a5-a33b-fe8e94f2431c tempest-TestServerVolumeAttachScenarioOldVersion-2038862331 tempest-TestServerVolumeAttachScenarioOldVersion-2038862331-project-member] Lock "7469b999-196b-41c7-9d30-f810b74eaa99" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:04:36 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-d5925cb2-dbd1-45a5-a33b-fe8e94f2431c tempest-TestServerVolumeAttachScenarioOldVersion-2038862331 tempest-TestServerVolumeAttachScenarioOldVersion-2038862331-project-member] Acquiring lock "7469b999-196b-41c7-9d30-f810b74eaa99-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:04:36 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-d5925cb2-dbd1-45a5-a33b-fe8e94f2431c tempest-TestServerVolumeAttachScenarioOldVersion-2038862331 tempest-TestServerVolumeAttachScenarioOldVersion-2038862331-project-member] Lock "7469b999-196b-41c7-9d30-f810b74eaa99-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:04:36 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-d5925cb2-dbd1-45a5-a33b-fe8e94f2431c tempest-TestServerVolumeAttachScenarioOldVersion-2038862331 tempest-TestServerVolumeAttachScenarioOldVersion-2038862331-project-member] Lock "7469b999-196b-41c7-9d30-f810b74eaa99-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:04:36 user nova-compute[75229]: INFO nova.compute.manager [None req-d5925cb2-dbd1-45a5-a33b-fe8e94f2431c tempest-TestServerVolumeAttachScenarioOldVersion-2038862331 tempest-TestServerVolumeAttachScenarioOldVersion-2038862331-project-member] [instance: 7469b999-196b-41c7-9d30-f810b74eaa99] Terminating instance
Nov 14 10:04:36 user nova-compute[75229]: DEBUG nova.compute.manager [None req-d5925cb2-dbd1-45a5-a33b-fe8e94f2431c tempest-TestServerVolumeAttachScenarioOldVersion-2038862331 tempest-TestServerVolumeAttachScenarioOldVersion-2038862331-project-member] [instance: 7469b999-196b-41c7-9d30-f810b74eaa99] Start destroying the instance on the hypervisor. {{(pid=75229) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 10:04:36 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:04:36 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:04:36 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:04:36 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:04:36 user nova-compute[75229]: DEBUG nova.compute.manager [req-665060db-7f76-4cdc-beec-bbf790c3dec7 req-0ea29be4-7513-470f-857b-66bd58060c35 service nova] [instance: 7469b999-196b-41c7-9d30-f810b74eaa99] Received event network-vif-unplugged-66f829f3-daca-440d-9674-c0a116921e54 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 10:04:36 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-665060db-7f76-4cdc-beec-bbf790c3dec7 req-0ea29be4-7513-470f-857b-66bd58060c35 service nova] Acquiring lock "7469b999-196b-41c7-9d30-f810b74eaa99-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:04:36 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-665060db-7f76-4cdc-beec-bbf790c3dec7 req-0ea29be4-7513-470f-857b-66bd58060c35 service nova] Lock "7469b999-196b-41c7-9d30-f810b74eaa99-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:04:36 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-665060db-7f76-4cdc-beec-bbf790c3dec7 req-0ea29be4-7513-470f-857b-66bd58060c35 service nova] Lock "7469b999-196b-41c7-9d30-f810b74eaa99-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:04:36 user nova-compute[75229]: DEBUG nova.compute.manager [req-665060db-7f76-4cdc-beec-bbf790c3dec7 req-0ea29be4-7513-470f-857b-66bd58060c35 service nova] [instance: 7469b999-196b-41c7-9d30-f810b74eaa99] No waiting events found dispatching network-vif-unplugged-66f829f3-daca-440d-9674-c0a116921e54 {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 10:04:36 user nova-compute[75229]: DEBUG nova.compute.manager [req-665060db-7f76-4cdc-beec-bbf790c3dec7 req-0ea29be4-7513-470f-857b-66bd58060c35 service nova] [instance: 7469b999-196b-41c7-9d30-f810b74eaa99] Received event network-vif-unplugged-66f829f3-daca-440d-9674-c0a116921e54 for instance with task_state deleting. {{(pid=75229) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 10:04:37 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:04:37 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:04:37 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:04:37 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:04:37 user nova-compute[75229]: INFO nova.virt.libvirt.driver [-] [instance: 7469b999-196b-41c7-9d30-f810b74eaa99] Instance destroyed successfully.
Nov 14 10:04:37 user nova-compute[75229]: DEBUG nova.objects.instance [None req-d5925cb2-dbd1-45a5-a33b-fe8e94f2431c tempest-TestServerVolumeAttachScenarioOldVersion-2038862331 tempest-TestServerVolumeAttachScenarioOldVersion-2038862331-project-member] Lazy-loading 'resources' on Instance uuid 7469b999-196b-41c7-9d30-f810b74eaa99 {{(pid=75229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 10:04:37 user nova-compute[75229]: DEBUG nova.virt.libvirt.vif [None req-d5925cb2-dbd1-45a5-a33b-fe8e94f2431c tempest-TestServerVolumeAttachScenarioOldVersion-2038862331 tempest-TestServerVolumeAttachScenarioOldVersion-2038862331-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T10:01:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1346504140',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1346504140',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1346504',id=40,image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLaTpU6/5A3kp8dqKIJiFl9IeD1ipYyI8RZ1VwVl/+hfHrAsAXzAMBpo+byEk9ZZxg5j/4JopWyxZA6Di/CFxCKPA9qX3NS80VdWP/bSd0AhLUc+38pLtWPCT0AA1fEU0Q==',key_name='tempest-keypair-113203845',keypairs=<?>,launch_index=0,launched_at=2023-11-14T10:01:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='806563ad6acd48dfae9a5d6bba121eae',ramdisk_id='',reservation_id='r-c80v5jhy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-2038862331',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-2038862331-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T10:01:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='afa8393617b14f119a096f14703b2b08',uuid=7469b999-196b-41c7-9d30-f810b74eaa99,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "66f829f3-daca-440d-9674-c0a116921e54", "address": "fa:16:3e:49:6b:8f", "network": {"id": "a8102981-d4c0-4a9f-a380-1bd0c4b230af", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1874599352-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.241", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "806563ad6acd48dfae9a5d6bba121eae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66f829f3-da", "ovs_interfaceid": "66f829f3-daca-440d-9674-c0a116921e54", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 10:04:37 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-d5925cb2-dbd1-45a5-a33b-fe8e94f2431c tempest-TestServerVolumeAttachScenarioOldVersion-2038862331 tempest-TestServerVolumeAttachScenarioOldVersion-2038862331-project-member] Converting VIF {"id": "66f829f3-daca-440d-9674-c0a116921e54", "address": "fa:16:3e:49:6b:8f", "network": {"id": "a8102981-d4c0-4a9f-a380-1bd0c4b230af", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1874599352-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.241", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "806563ad6acd48dfae9a5d6bba121eae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66f829f3-da", "ovs_interfaceid": "66f829f3-daca-440d-9674-c0a116921e54", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 10:04:37 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-d5925cb2-dbd1-45a5-a33b-fe8e94f2431c tempest-TestServerVolumeAttachScenarioOldVersion-2038862331 tempest-TestServerVolumeAttachScenarioOldVersion-2038862331-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:49:6b:8f,bridge_name='br-int',has_traffic_filtering=True,id=66f829f3-daca-440d-9674-c0a116921e54,network=Network(a8102981-d4c0-4a9f-a380-1bd0c4b230af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap66f829f3-da') {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 10:04:37 user nova-compute[75229]: DEBUG os_vif [None req-d5925cb2-dbd1-45a5-a33b-fe8e94f2431c tempest-TestServerVolumeAttachScenarioOldVersion-2038862331 tempest-TestServerVolumeAttachScenarioOldVersion-2038862331-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:49:6b:8f,bridge_name='br-int',has_traffic_filtering=True,id=66f829f3-daca-440d-9674-c0a116921e54,network=Network(a8102981-d4c0-4a9f-a380-1bd0c4b230af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap66f829f3-da') {{(pid=75229) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 10:04:37 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:04:37 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap66f829f3-da, bridge=br-int, if_exists=True) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 10:04:37 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:04:37 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 10:04:37 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:04:37 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=752499ee-cb9c-48d7-96f4-907471087f27) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 10:04:37 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:04:37 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:04:37 user nova-compute[75229]: INFO os_vif [None req-d5925cb2-dbd1-45a5-a33b-fe8e94f2431c tempest-TestServerVolumeAttachScenarioOldVersion-2038862331 tempest-TestServerVolumeAttachScenarioOldVersion-2038862331-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:49:6b:8f,bridge_name='br-int',has_traffic_filtering=True,id=66f829f3-daca-440d-9674-c0a116921e54,network=Network(a8102981-d4c0-4a9f-a380-1bd0c4b230af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap66f829f3-da')
Nov 14 10:04:37 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-d5925cb2-dbd1-45a5-a33b-fe8e94f2431c tempest-TestServerVolumeAttachScenarioOldVersion-2038862331 tempest-TestServerVolumeAttachScenarioOldVersion-2038862331-project-member] [instance: 7469b999-196b-41c7-9d30-f810b74eaa99] Deleting instance files /opt/stack/data/nova/instances/7469b999-196b-41c7-9d30-f810b74eaa99_del
Nov 14 10:04:37 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-d5925cb2-dbd1-45a5-a33b-fe8e94f2431c tempest-TestServerVolumeAttachScenarioOldVersion-2038862331 tempest-TestServerVolumeAttachScenarioOldVersion-2038862331-project-member] [instance: 7469b999-196b-41c7-9d30-f810b74eaa99] Deletion of /opt/stack/data/nova/instances/7469b999-196b-41c7-9d30-f810b74eaa99_del complete
Nov 14 10:04:37 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:04:37 user nova-compute[75229]: INFO nova.compute.manager [None req-d5925cb2-dbd1-45a5-a33b-fe8e94f2431c tempest-TestServerVolumeAttachScenarioOldVersion-2038862331 tempest-TestServerVolumeAttachScenarioOldVersion-2038862331-project-member] [instance: 7469b999-196b-41c7-9d30-f810b74eaa99] Took 0.88 seconds to destroy the instance on the hypervisor.
Nov 14 10:04:37 user nova-compute[75229]: DEBUG oslo.service.loopingcall [None req-d5925cb2-dbd1-45a5-a33b-fe8e94f2431c tempest-TestServerVolumeAttachScenarioOldVersion-2038862331 tempest-TestServerVolumeAttachScenarioOldVersion-2038862331-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75229) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 10:04:37 user nova-compute[75229]: DEBUG nova.compute.manager [-] [instance: 7469b999-196b-41c7-9d30-f810b74eaa99] Deallocating network for instance {{(pid=75229) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 10:04:37 user nova-compute[75229]: DEBUG nova.network.neutron [-] [instance: 7469b999-196b-41c7-9d30-f810b74eaa99] deallocate_for_instance() {{(pid=75229) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 10:04:37 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:04:37 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:04:37 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:04:37 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:04:37 user nova-compute[75229]: DEBUG nova.network.neutron [-] [instance: 7469b999-196b-41c7-9d30-f810b74eaa99] Updating instance_info_cache with network_info: [] {{(pid=75229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 10:04:37 user nova-compute[75229]: INFO nova.compute.manager [-] [instance: 7469b999-196b-41c7-9d30-f810b74eaa99] Took 0.76 seconds to deallocate network for instance.
Nov 14 10:04:38 user nova-compute[75229]: DEBUG nova.compute.manager [req-edfb2e63-31cb-4cdc-bc3f-cd0013f80561 req-6f1b7999-ae76-43b4-a56f-37c454a51a64 service nova] [instance: 7469b999-196b-41c7-9d30-f810b74eaa99] Received event network-vif-deleted-66f829f3-daca-440d-9674-c0a116921e54 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 10:04:38 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-d5925cb2-dbd1-45a5-a33b-fe8e94f2431c tempest-TestServerVolumeAttachScenarioOldVersion-2038862331 tempest-TestServerVolumeAttachScenarioOldVersion-2038862331-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:04:38 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-d5925cb2-dbd1-45a5-a33b-fe8e94f2431c tempest-TestServerVolumeAttachScenarioOldVersion-2038862331 tempest-TestServerVolumeAttachScenarioOldVersion-2038862331-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:04:38 user nova-compute[75229]: DEBUG nova.compute.provider_tree [None req-d5925cb2-dbd1-45a5-a33b-fe8e94f2431c tempest-TestServerVolumeAttachScenarioOldVersion-2038862331 tempest-TestServerVolumeAttachScenarioOldVersion-2038862331-project-member] Inventory has not changed in ProviderTree for provider: d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 {{(pid=75229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 10:04:38 user nova-compute[75229]: DEBUG nova.scheduler.client.report [None req-d5925cb2-dbd1-45a5-a33b-fe8e94f2431c tempest-TestServerVolumeAttachScenarioOldVersion-2038862331 tempest-TestServerVolumeAttachScenarioOldVersion-2038862331-project-member] Inventory has not changed for provider d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 10:04:38 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-d5925cb2-dbd1-45a5-a33b-fe8e94f2431c tempest-TestServerVolumeAttachScenarioOldVersion-2038862331 tempest-TestServerVolumeAttachScenarioOldVersion-2038862331-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.275s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:04:38 user nova-compute[75229]: INFO nova.scheduler.client.report [None req-d5925cb2-dbd1-45a5-a33b-fe8e94f2431c tempest-TestServerVolumeAttachScenarioOldVersion-2038862331 tempest-TestServerVolumeAttachScenarioOldVersion-2038862331-project-member] Deleted allocations for instance 7469b999-196b-41c7-9d30-f810b74eaa99
Nov 14 10:04:38 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-d5925cb2-dbd1-45a5-a33b-fe8e94f2431c tempest-TestServerVolumeAttachScenarioOldVersion-2038862331 tempest-TestServerVolumeAttachScenarioOldVersion-2038862331-project-member] Lock "7469b999-196b-41c7-9d30-f810b74eaa99" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.089s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:04:38 user nova-compute[75229]: DEBUG nova.compute.manager [req-c5957ac3-ae84-4904-9ba4-df6dac0ee556 req-dc29603a-85e2-41be-beb8-64dcfca3845f service nova] [instance: 7469b999-196b-41c7-9d30-f810b74eaa99] Received event network-vif-plugged-66f829f3-daca-440d-9674-c0a116921e54 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 10:04:38 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-c5957ac3-ae84-4904-9ba4-df6dac0ee556 req-dc29603a-85e2-41be-beb8-64dcfca3845f service nova] Acquiring lock "7469b999-196b-41c7-9d30-f810b74eaa99-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:04:38 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-c5957ac3-ae84-4904-9ba4-df6dac0ee556 req-dc29603a-85e2-41be-beb8-64dcfca3845f service nova] Lock "7469b999-196b-41c7-9d30-f810b74eaa99-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:04:38 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-c5957ac3-ae84-4904-9ba4-df6dac0ee556 req-dc29603a-85e2-41be-beb8-64dcfca3845f service nova] Lock "7469b999-196b-41c7-9d30-f810b74eaa99-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:04:38 user nova-compute[75229]: DEBUG nova.compute.manager [req-c5957ac3-ae84-4904-9ba4-df6dac0ee556 req-dc29603a-85e2-41be-beb8-64dcfca3845f service nova] [instance: 7469b999-196b-41c7-9d30-f810b74eaa99] No waiting events found dispatching network-vif-plugged-66f829f3-daca-440d-9674-c0a116921e54 {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 10:04:38 user nova-compute[75229]: WARNING nova.compute.manager [req-c5957ac3-ae84-4904-9ba4-df6dac0ee556 req-dc29603a-85e2-41be-beb8-64dcfca3845f service nova] [instance: 7469b999-196b-41c7-9d30-f810b74eaa99] Received unexpected event network-vif-plugged-66f829f3-daca-440d-9674-c0a116921e54 for instance with vm_state deleted and task_state None.
Nov 14 10:04:38 user nova-compute[75229]: DEBUG nova.compute.manager [req-c5957ac3-ae84-4904-9ba4-df6dac0ee556 req-dc29603a-85e2-41be-beb8-64dcfca3845f service nova] [instance: 7469b999-196b-41c7-9d30-f810b74eaa99] Received event network-vif-plugged-66f829f3-daca-440d-9674-c0a116921e54 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 10:04:38 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-c5957ac3-ae84-4904-9ba4-df6dac0ee556 req-dc29603a-85e2-41be-beb8-64dcfca3845f service nova] Acquiring lock "7469b999-196b-41c7-9d30-f810b74eaa99-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:04:38 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-c5957ac3-ae84-4904-9ba4-df6dac0ee556 req-dc29603a-85e2-41be-beb8-64dcfca3845f service nova] Lock "7469b999-196b-41c7-9d30-f810b74eaa99-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:04:38 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-c5957ac3-ae84-4904-9ba4-df6dac0ee556 req-dc29603a-85e2-41be-beb8-64dcfca3845f service nova] Lock "7469b999-196b-41c7-9d30-f810b74eaa99-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:04:38 user nova-compute[75229]: DEBUG nova.compute.manager [req-c5957ac3-ae84-4904-9ba4-df6dac0ee556 req-dc29603a-85e2-41be-beb8-64dcfca3845f service nova] [instance: 7469b999-196b-41c7-9d30-f810b74eaa99] No waiting events found dispatching network-vif-plugged-66f829f3-daca-440d-9674-c0a116921e54 {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 10:04:38 user nova-compute[75229]: WARNING nova.compute.manager [req-c5957ac3-ae84-4904-9ba4-df6dac0ee556 req-dc29603a-85e2-41be-beb8-64dcfca3845f service nova] [instance: 7469b999-196b-41c7-9d30-f810b74eaa99] Received unexpected event network-vif-plugged-66f829f3-daca-440d-9674-c0a116921e54 for instance with vm_state deleted and task_state None.
Nov 14 10:04:38 user nova-compute[75229]: DEBUG nova.compute.manager [req-c5957ac3-ae84-4904-9ba4-df6dac0ee556 req-dc29603a-85e2-41be-beb8-64dcfca3845f service nova] [instance: 7469b999-196b-41c7-9d30-f810b74eaa99] Received event network-vif-plugged-66f829f3-daca-440d-9674-c0a116921e54 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 10:04:38 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-c5957ac3-ae84-4904-9ba4-df6dac0ee556 req-dc29603a-85e2-41be-beb8-64dcfca3845f service nova] Acquiring lock "7469b999-196b-41c7-9d30-f810b74eaa99-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:04:38 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-c5957ac3-ae84-4904-9ba4-df6dac0ee556 req-dc29603a-85e2-41be-beb8-64dcfca3845f service nova] Lock "7469b999-196b-41c7-9d30-f810b74eaa99-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:04:38 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-c5957ac3-ae84-4904-9ba4-df6dac0ee556 req-dc29603a-85e2-41be-beb8-64dcfca3845f service nova] Lock "7469b999-196b-41c7-9d30-f810b74eaa99-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:04:38 user nova-compute[75229]: DEBUG nova.compute.manager [req-c5957ac3-ae84-4904-9ba4-df6dac0ee556 req-dc29603a-85e2-41be-beb8-64dcfca3845f service nova] [instance: 7469b999-196b-41c7-9d30-f810b74eaa99] No waiting events found dispatching network-vif-plugged-66f829f3-daca-440d-9674-c0a116921e54 {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 10:04:38 user nova-compute[75229]: WARNING nova.compute.manager [req-c5957ac3-ae84-4904-9ba4-df6dac0ee556 req-dc29603a-85e2-41be-beb8-64dcfca3845f service nova] [instance: 7469b999-196b-41c7-9d30-f810b74eaa99] Received unexpected event network-vif-plugged-66f829f3-daca-440d-9674-c0a116921e54 for instance with vm_state deleted and task_state None.
Nov 14 10:04:38 user nova-compute[75229]: DEBUG nova.compute.manager [req-c5957ac3-ae84-4904-9ba4-df6dac0ee556 req-dc29603a-85e2-41be-beb8-64dcfca3845f service nova] [instance: 7469b999-196b-41c7-9d30-f810b74eaa99] Received event network-vif-unplugged-66f829f3-daca-440d-9674-c0a116921e54 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 10:04:38 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-c5957ac3-ae84-4904-9ba4-df6dac0ee556 req-dc29603a-85e2-41be-beb8-64dcfca3845f service nova] Acquiring lock "7469b999-196b-41c7-9d30-f810b74eaa99-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:04:38 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-c5957ac3-ae84-4904-9ba4-df6dac0ee556 req-dc29603a-85e2-41be-beb8-64dcfca3845f service nova] Lock "7469b999-196b-41c7-9d30-f810b74eaa99-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:04:38 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-c5957ac3-ae84-4904-9ba4-df6dac0ee556 req-dc29603a-85e2-41be-beb8-64dcfca3845f service nova] Lock "7469b999-196b-41c7-9d30-f810b74eaa99-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:04:38 user nova-compute[75229]: DEBUG nova.compute.manager [req-c5957ac3-ae84-4904-9ba4-df6dac0ee556 req-dc29603a-85e2-41be-beb8-64dcfca3845f service nova] [instance: 7469b999-196b-41c7-9d30-f810b74eaa99] No waiting events found dispatching network-vif-unplugged-66f829f3-daca-440d-9674-c0a116921e54 {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 10:04:38 user nova-compute[75229]: WARNING nova.compute.manager [req-c5957ac3-ae84-4904-9ba4-df6dac0ee556 req-dc29603a-85e2-41be-beb8-64dcfca3845f service nova] [instance: 7469b999-196b-41c7-9d30-f810b74eaa99] Received unexpected event network-vif-unplugged-66f829f3-daca-440d-9674-c0a116921e54 for instance with vm_state deleted and task_state None.
Nov 14 10:04:38 user nova-compute[75229]: DEBUG nova.compute.manager [req-c5957ac3-ae84-4904-9ba4-df6dac0ee556 req-dc29603a-85e2-41be-beb8-64dcfca3845f service nova] [instance: 7469b999-196b-41c7-9d30-f810b74eaa99] Received event network-vif-plugged-66f829f3-daca-440d-9674-c0a116921e54 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 10:04:38 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-c5957ac3-ae84-4904-9ba4-df6dac0ee556 req-dc29603a-85e2-41be-beb8-64dcfca3845f service nova] Acquiring lock "7469b999-196b-41c7-9d30-f810b74eaa99-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:04:38 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-c5957ac3-ae84-4904-9ba4-df6dac0ee556 req-dc29603a-85e2-41be-beb8-64dcfca3845f service nova] Lock "7469b999-196b-41c7-9d30-f810b74eaa99-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:04:38 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-c5957ac3-ae84-4904-9ba4-df6dac0ee556 req-dc29603a-85e2-41be-beb8-64dcfca3845f service nova] Lock "7469b999-196b-41c7-9d30-f810b74eaa99-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:04:38 user nova-compute[75229]: DEBUG nova.compute.manager [req-c5957ac3-ae84-4904-9ba4-df6dac0ee556 req-dc29603a-85e2-41be-beb8-64dcfca3845f service nova] [instance: 7469b999-196b-41c7-9d30-f810b74eaa99] No waiting events found dispatching network-vif-plugged-66f829f3-daca-440d-9674-c0a116921e54 {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 10:04:38 user nova-compute[75229]: WARNING nova.compute.manager [req-c5957ac3-ae84-4904-9ba4-df6dac0ee556 req-dc29603a-85e2-41be-beb8-64dcfca3845f service nova] [instance: 7469b999-196b-41c7-9d30-f810b74eaa99] Received unexpected event network-vif-plugged-66f829f3-daca-440d-9674-c0a116921e54 for instance with vm_state deleted and task_state None.
Nov 14 10:04:38 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:04:42 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:04:45 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:04:47 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:04:50 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-03b7e39e-e998-40f7-873d-26290781a2ae tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Acquiring lock "b5170e9e-66e3-4df1-9807-4958cac6480e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:04:50 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-03b7e39e-e998-40f7-873d-26290781a2ae tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Lock "b5170e9e-66e3-4df1-9807-4958cac6480e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:04:50 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-03b7e39e-e998-40f7-873d-26290781a2ae tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Acquiring lock "b5170e9e-66e3-4df1-9807-4958cac6480e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:04:50 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-03b7e39e-e998-40f7-873d-26290781a2ae tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Lock "b5170e9e-66e3-4df1-9807-4958cac6480e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:04:50 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-03b7e39e-e998-40f7-873d-26290781a2ae tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Lock "b5170e9e-66e3-4df1-9807-4958cac6480e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:04:50 user nova-compute[75229]: INFO nova.compute.manager [None req-03b7e39e-e998-40f7-873d-26290781a2ae tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] [instance: b5170e9e-66e3-4df1-9807-4958cac6480e] Terminating instance
Nov 14 10:04:50 user nova-compute[75229]: DEBUG nova.compute.manager [None req-03b7e39e-e998-40f7-873d-26290781a2ae tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] [instance: b5170e9e-66e3-4df1-9807-4958cac6480e] Start destroying the instance on the hypervisor. {{(pid=75229) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 10:04:50 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:04:50 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:04:50 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:04:50 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:04:50 user nova-compute[75229]: DEBUG nova.compute.manager [req-f211d377-3542-40ac-abbf-685883cbb32b req-614e1b78-ef23-4db7-b1ba-c818684d35b9 service nova] [instance: b5170e9e-66e3-4df1-9807-4958cac6480e] Received event network-vif-unplugged-bed3fc1c-227e-44d2-85e1-589501a2e9dc {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 10:04:50 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-f211d377-3542-40ac-abbf-685883cbb32b req-614e1b78-ef23-4db7-b1ba-c818684d35b9 service nova] Acquiring lock "b5170e9e-66e3-4df1-9807-4958cac6480e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:04:50 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-f211d377-3542-40ac-abbf-685883cbb32b req-614e1b78-ef23-4db7-b1ba-c818684d35b9 service nova] Lock "b5170e9e-66e3-4df1-9807-4958cac6480e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:04:50 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-f211d377-3542-40ac-abbf-685883cbb32b req-614e1b78-ef23-4db7-b1ba-c818684d35b9 service nova] Lock "b5170e9e-66e3-4df1-9807-4958cac6480e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:04:50 user nova-compute[75229]: DEBUG nova.compute.manager [req-f211d377-3542-40ac-abbf-685883cbb32b req-614e1b78-ef23-4db7-b1ba-c818684d35b9 service nova] [instance: b5170e9e-66e3-4df1-9807-4958cac6480e] No waiting events found dispatching network-vif-unplugged-bed3fc1c-227e-44d2-85e1-589501a2e9dc {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 10:04:50 user nova-compute[75229]: DEBUG nova.compute.manager [req-f211d377-3542-40ac-abbf-685883cbb32b req-614e1b78-ef23-4db7-b1ba-c818684d35b9 service nova] [instance: b5170e9e-66e3-4df1-9807-4958cac6480e] Received event network-vif-unplugged-bed3fc1c-227e-44d2-85e1-589501a2e9dc for instance with task_state deleting. {{(pid=75229) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 10:04:51 user nova-compute[75229]: INFO nova.virt.libvirt.driver [-] [instance: b5170e9e-66e3-4df1-9807-4958cac6480e] Instance destroyed successfully.
Nov 14 10:04:51 user nova-compute[75229]: DEBUG nova.objects.instance [None req-03b7e39e-e998-40f7-873d-26290781a2ae tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Lazy-loading 'resources' on Instance uuid b5170e9e-66e3-4df1-9807-4958cac6480e {{(pid=75229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 10:04:51 user nova-compute[75229]: DEBUG nova.virt.libvirt.vif [None req-03b7e39e-e998-40f7-873d-26290781a2ae tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T09:48:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-939346932',display_name='tempest-ServerRescueNegativeTestJSON-server-939346932',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-939346932',id=19,image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-14T09:50:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='46457b27e3ed416e827c3c22449fb512',ramdisk_id='',reservation_id='r-wp091n1y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-557279920',owner_user_name='tempest-ServerRescueNegativeTestJSON-557279920-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T09:50:50Z,user_data=None,user_id='a3cb33a5c522499e8cd254edd5e15879',uuid=b5170e9e-66e3-4df1-9807-4958cac6480e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='rescued') vif={"id": "bed3fc1c-227e-44d2-85e1-589501a2e9dc", "address": "fa:16:3e:26:85:42", "network": {"id": "22eed29e-7148-42f9-b4c7-b97811cba8eb", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2000485731-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46457b27e3ed416e827c3c22449fb512", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbed3fc1c-22", "ovs_interfaceid": "bed3fc1c-227e-44d2-85e1-589501a2e9dc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 10:04:51 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-03b7e39e-e998-40f7-873d-26290781a2ae tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Converting VIF {"id": "bed3fc1c-227e-44d2-85e1-589501a2e9dc", "address": "fa:16:3e:26:85:42", "network": {"id": "22eed29e-7148-42f9-b4c7-b97811cba8eb", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2000485731-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46457b27e3ed416e827c3c22449fb512", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbed3fc1c-22", "ovs_interfaceid": "bed3fc1c-227e-44d2-85e1-589501a2e9dc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 10:04:51 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-03b7e39e-e998-40f7-873d-26290781a2ae tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:26:85:42,bridge_name='br-int',has_traffic_filtering=True,id=bed3fc1c-227e-44d2-85e1-589501a2e9dc,network=Network(22eed29e-7148-42f9-b4c7-b97811cba8eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbed3fc1c-22') {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 10:04:51 user nova-compute[75229]: DEBUG os_vif [None req-03b7e39e-e998-40f7-873d-26290781a2ae tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:26:85:42,bridge_name='br-int',has_traffic_filtering=True,id=bed3fc1c-227e-44d2-85e1-589501a2e9dc,network=Network(22eed29e-7148-42f9-b4c7-b97811cba8eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbed3fc1c-22') {{(pid=75229) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 10:04:51 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:04:51 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbed3fc1c-22, bridge=br-int, if_exists=True) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 10:04:51 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:04:51 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:04:51 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:04:51 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6b3f94b8-2469-4180-bd9b-e19e636a1b2a) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 10:04:51 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:04:51 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:04:51 user nova-compute[75229]: INFO os_vif [None req-03b7e39e-e998-40f7-873d-26290781a2ae tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:26:85:42,bridge_name='br-int',has_traffic_filtering=True,id=bed3fc1c-227e-44d2-85e1-589501a2e9dc,network=Network(22eed29e-7148-42f9-b4c7-b97811cba8eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbed3fc1c-22')
Nov 14 10:04:51 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-03b7e39e-e998-40f7-873d-26290781a2ae tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] [instance: b5170e9e-66e3-4df1-9807-4958cac6480e] Deleting instance files /opt/stack/data/nova/instances/b5170e9e-66e3-4df1-9807-4958cac6480e_del
Nov 14 10:04:51 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-03b7e39e-e998-40f7-873d-26290781a2ae tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] [instance: b5170e9e-66e3-4df1-9807-4958cac6480e] Deletion of /opt/stack/data/nova/instances/b5170e9e-66e3-4df1-9807-4958cac6480e_del complete
Nov 14 10:04:51 user nova-compute[75229]: INFO nova.compute.manager [None req-03b7e39e-e998-40f7-873d-26290781a2ae tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] [instance: b5170e9e-66e3-4df1-9807-4958cac6480e] Took 0.69 seconds to destroy the instance on the hypervisor.
Nov 14 10:04:51 user nova-compute[75229]: DEBUG oslo.service.loopingcall [None req-03b7e39e-e998-40f7-873d-26290781a2ae tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75229) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 10:04:51 user nova-compute[75229]: DEBUG nova.compute.manager [-] [instance: b5170e9e-66e3-4df1-9807-4958cac6480e] Deallocating network for instance {{(pid=75229) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 10:04:51 user nova-compute[75229]: DEBUG nova.network.neutron [-] [instance: b5170e9e-66e3-4df1-9807-4958cac6480e] deallocate_for_instance() {{(pid=75229) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 10:04:51 user nova-compute[75229]: DEBUG nova.network.neutron [-] [instance: b5170e9e-66e3-4df1-9807-4958cac6480e] Updating instance_info_cache with network_info: [] {{(pid=75229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 10:04:51 user nova-compute[75229]: INFO nova.compute.manager [-] [instance: b5170e9e-66e3-4df1-9807-4958cac6480e] Took 0.48 seconds to deallocate network for instance.
Nov 14 10:04:51 user nova-compute[75229]: DEBUG nova.compute.manager [req-f034b0cd-39b5-4da2-aa0c-7aeb72b25df8 req-6bc8cc5a-59ba-4436-95ac-8c9d5306b04b service nova] [instance: b5170e9e-66e3-4df1-9807-4958cac6480e] Received event network-vif-deleted-bed3fc1c-227e-44d2-85e1-589501a2e9dc {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 10:04:51 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-03b7e39e-e998-40f7-873d-26290781a2ae tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:04:51 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-03b7e39e-e998-40f7-873d-26290781a2ae tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:04:52 user nova-compute[75229]: DEBUG nova.compute.provider_tree [None req-03b7e39e-e998-40f7-873d-26290781a2ae tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Inventory has not changed in ProviderTree for provider: d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 {{(pid=75229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 10:04:52 user nova-compute[75229]: DEBUG nova.scheduler.client.report [None req-03b7e39e-e998-40f7-873d-26290781a2ae tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Inventory has not changed for provider d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 10:04:52 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-03b7e39e-e998-40f7-873d-26290781a2ae tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.266s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:04:52 user nova-compute[75229]: INFO nova.scheduler.client.report [None req-03b7e39e-e998-40f7-873d-26290781a2ae tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Deleted allocations for instance b5170e9e-66e3-4df1-9807-4958cac6480e
Nov 14 10:04:52 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-03b7e39e-e998-40f7-873d-26290781a2ae tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Lock "b5170e9e-66e3-4df1-9807-4958cac6480e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.637s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:04:53 user nova-compute[75229]: DEBUG nova.compute.manager [req-e79b5765-8e1a-405b-ab43-41e57fe97720 req-178608d3-6f83-4c59-a893-241c9d212f4f service nova] [instance: b5170e9e-66e3-4df1-9807-4958cac6480e] Received event network-vif-plugged-bed3fc1c-227e-44d2-85e1-589501a2e9dc {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 10:04:53 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-e79b5765-8e1a-405b-ab43-41e57fe97720 req-178608d3-6f83-4c59-a893-241c9d212f4f service nova] Acquiring lock "b5170e9e-66e3-4df1-9807-4958cac6480e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:04:53 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-e79b5765-8e1a-405b-ab43-41e57fe97720 req-178608d3-6f83-4c59-a893-241c9d212f4f service nova] Lock "b5170e9e-66e3-4df1-9807-4958cac6480e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:04:53 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-e79b5765-8e1a-405b-ab43-41e57fe97720 req-178608d3-6f83-4c59-a893-241c9d212f4f service nova] Lock "b5170e9e-66e3-4df1-9807-4958cac6480e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:04:53 user nova-compute[75229]: DEBUG nova.compute.manager [req-e79b5765-8e1a-405b-ab43-41e57fe97720 req-178608d3-6f83-4c59-a893-241c9d212f4f service nova] [instance: b5170e9e-66e3-4df1-9807-4958cac6480e] No waiting events found dispatching network-vif-plugged-bed3fc1c-227e-44d2-85e1-589501a2e9dc {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 10:04:53 user nova-compute[75229]: WARNING nova.compute.manager [req-e79b5765-8e1a-405b-ab43-41e57fe97720 req-178608d3-6f83-4c59-a893-241c9d212f4f service nova] [instance: b5170e9e-66e3-4df1-9807-4958cac6480e] Received unexpected event network-vif-plugged-bed3fc1c-227e-44d2-85e1-589501a2e9dc for instance with vm_state deleted and task_state None.
Nov 14 10:04:54 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:04:56 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:04:57 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:04:57 user nova-compute[75229]: DEBUG nova.compute.manager [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Starting heal instance info cache {{(pid=75229) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 10:04:57 user nova-compute[75229]: DEBUG nova.compute.manager [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Rebuilding the list of instances to heal {{(pid=75229) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 10:04:57 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Acquiring lock "refresh_cache-4c9fe69e-3f9d-4b30-a9e4-efc3e83efa17" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 10:04:57 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Acquired lock "refresh_cache-4c9fe69e-3f9d-4b30-a9e4-efc3e83efa17" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 10:04:57 user nova-compute[75229]: DEBUG nova.network.neutron [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] [instance: 4c9fe69e-3f9d-4b30-a9e4-efc3e83efa17] Forcefully refreshing network info cache for instance {{(pid=75229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 10:04:57 user nova-compute[75229]: DEBUG nova.objects.instance [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Lazy-loading 'info_cache' on Instance uuid 4c9fe69e-3f9d-4b30-a9e4-efc3e83efa17 {{(pid=75229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 10:04:58 user nova-compute[75229]: DEBUG nova.network.neutron [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] [instance: 4c9fe69e-3f9d-4b30-a9e4-efc3e83efa17] Updating instance_info_cache with network_info: [{"id": "235153d6-63c1-44d2-97cc-c083544e6790", "address": "fa:16:3e:a0:db:35", "network": {"id": "22eed29e-7148-42f9-b4c7-b97811cba8eb", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2000485731-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46457b27e3ed416e827c3c22449fb512", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap235153d6-63", "ovs_interfaceid": "235153d6-63c1-44d2-97cc-c083544e6790", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 10:04:58 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Releasing lock "refresh_cache-4c9fe69e-3f9d-4b30-a9e4-efc3e83efa17" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 10:04:58 user nova-compute[75229]: DEBUG nova.compute.manager [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] [instance: 4c9fe69e-3f9d-4b30-a9e4-efc3e83efa17] Updated the network info_cache for instance {{(pid=75229) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 10:04:59 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-19112987-8fcf-4309-89ce-fd119c195a72 tempest-TestShelveInstance-1161595377 tempest-TestShelveInstance-1161595377-project-member] Acquiring lock "abe7e145-d3bc-49a1-83be-793488de828b" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:04:59 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-19112987-8fcf-4309-89ce-fd119c195a72 tempest-TestShelveInstance-1161595377 tempest-TestShelveInstance-1161595377-project-member] Lock "abe7e145-d3bc-49a1-83be-793488de828b" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:04:59 user nova-compute[75229]: INFO nova.compute.manager [None req-19112987-8fcf-4309-89ce-fd119c195a72 tempest-TestShelveInstance-1161595377 tempest-TestShelveInstance-1161595377-project-member] [instance: abe7e145-d3bc-49a1-83be-793488de828b] Unshelving
Nov 14 10:04:59 user nova-compute[75229]: INFO nova.virt.block_device [None req-19112987-8fcf-4309-89ce-fd119c195a72 tempest-TestShelveInstance-1161595377 tempest-TestShelveInstance-1161595377-project-member] [instance: abe7e145-d3bc-49a1-83be-793488de828b] Booting with volume e4a6dca6-1581-494f-afe5-3aac2b4d2c15 at /dev/vda
Nov 14 10:04:59 user nova-compute[75229]: DEBUG os_brick.utils [None req-19112987-8fcf-4309-89ce-fd119c195a72 tempest-TestShelveInstance-1161595377 tempest-TestShelveInstance-1161595377-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 10:04:59 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:04:59 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:04:59 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c3b67ac-1b2b-45cc-b8fa-71ed80853de5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f1154031c835\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:04:59 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:04:59 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:04:59 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[1608a6d3-8047-4f8a-a1a0-4b994e681fda]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:04:59 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:04:59 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:04:59 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb4789d8-e7c8-40da-abc0-2dc08647e9f4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:04:59 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e346d00-c0a4-47df-9855-12a01668f190]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:04:59 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-19112987-8fcf-4309-89ce-fd119c195a72 tempest-TestShelveInstance-1161595377 tempest-TestShelveInstance-1161595377-project-member] Running cmd (subprocess): nvme version {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:04:59 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-19112987-8fcf-4309-89ce-fd119c195a72 tempest-TestShelveInstance-1161595377 tempest-TestShelveInstance-1161595377-project-member] 'nvme version' failed. Not Retrying. {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 10:04:59 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.nvmeof [None req-19112987-8fcf-4309-89ce-fd119c195a72 tempest-TestShelveInstance-1161595377 tempest-TestShelveInstance-1161595377-project-member] nvme not present on system {{(pid=75229) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 10:04:59 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:04:59 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 10:04:59 user nova-compute[75229]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 10:04:59 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b1427fe-4059-4df6-9eb9-6ae770ee0134]: (4, '') {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:04:59 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.lightos [None req-19112987-8fcf-4309-89ce-fd119c195a72 tempest-TestShelveInstance-1161595377 tempest-TestShelveInstance-1161595377-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75229) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 10:04:59 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.lightos [None req-19112987-8fcf-4309-89ce-fd119c195a72 tempest-TestShelveInstance-1161595377 tempest-TestShelveInstance-1161595377-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75229) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 10:04:59 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.lightos [None req-19112987-8fcf-4309-89ce-fd119c195a72 tempest-TestShelveInstance-1161595377 tempest-TestShelveInstance-1161595377-project-member] LIGHTOS: no hostnqn found. {{(pid=75229) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 10:04:59 user nova-compute[75229]: DEBUG os_brick.utils [None req-19112987-8fcf-4309-89ce-fd119c195a72 tempest-TestShelveInstance-1161595377 tempest-TestShelveInstance-1161595377-project-member] <== get_connector_properties: return (113ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f1154031c835', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 10:04:59 user nova-compute[75229]: DEBUG nova.virt.block_device [None req-19112987-8fcf-4309-89ce-fd119c195a72 tempest-TestShelveInstance-1161595377 tempest-TestShelveInstance-1161595377-project-member] [instance: abe7e145-d3bc-49a1-83be-793488de828b] Updating existing volume attachment record: 11c22975-92c3-43a9-b71d-e02f9d8ad163 {{(pid=75229) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 10:05:01 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 10:05:02 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:05:02 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:05:02 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:05:02 user nova-compute[75229]: DEBUG nova.compute.manager [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Cleaning up deleted instances {{(pid=75229) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 14 10:05:02 user nova-compute[75229]: DEBUG nova.compute.manager [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] There are 0 instances to clean {{(pid=75229) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 14 10:05:04 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-19112987-8fcf-4309-89ce-fd119c195a72 tempest-TestShelveInstance-1161595377 tempest-TestShelveInstance-1161595377-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:05:04 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-19112987-8fcf-4309-89ce-fd119c195a72 tempest-TestShelveInstance-1161595377 tempest-TestShelveInstance-1161595377-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:05:04 user nova-compute[75229]: DEBUG nova.objects.instance [None req-19112987-8fcf-4309-89ce-fd119c195a72 tempest-TestShelveInstance-1161595377 tempest-TestShelveInstance-1161595377-project-member] Lazy-loading 'pci_requests' on Instance uuid abe7e145-d3bc-49a1-83be-793488de828b {{(pid=75229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 10:05:04 user nova-compute[75229]: DEBUG nova.objects.instance [None req-19112987-8fcf-4309-89ce-fd119c195a72 tempest-TestShelveInstance-1161595377 tempest-TestShelveInstance-1161595377-project-member] Lazy-loading 'numa_topology' on Instance uuid abe7e145-d3bc-49a1-83be-793488de828b {{(pid=75229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 10:05:04 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-19112987-8fcf-4309-89ce-fd119c195a72 tempest-TestShelveInstance-1161595377 tempest-TestShelveInstance-1161595377-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75229) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 10:05:04 user nova-compute[75229]: INFO nova.compute.claims [None req-19112987-8fcf-4309-89ce-fd119c195a72 tempest-TestShelveInstance-1161595377 tempest-TestShelveInstance-1161595377-project-member] [instance: abe7e145-d3bc-49a1-83be-793488de828b] Claim successful on node user
Nov 14 10:05:04 user nova-compute[75229]: DEBUG nova.scheduler.client.report [None req-19112987-8fcf-4309-89ce-fd119c195a72 tempest-TestShelveInstance-1161595377 tempest-TestShelveInstance-1161595377-project-member] Refreshing inventories for resource provider d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 {{(pid=75229) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 14 10:05:04 user nova-compute[75229]: DEBUG nova.scheduler.client.report [None req-19112987-8fcf-4309-89ce-fd119c195a72 tempest-TestShelveInstance-1161595377 tempest-TestShelveInstance-1161595377-project-member] Updating ProviderTree inventory for provider d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75229) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 14 10:05:04 user nova-compute[75229]: DEBUG nova.compute.provider_tree [None req-19112987-8fcf-4309-89ce-fd119c195a72 tempest-TestShelveInstance-1161595377 tempest-TestShelveInstance-1161595377-project-member] Updating inventory in ProviderTree for provider d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 14 10:05:04 user nova-compute[75229]: DEBUG nova.scheduler.client.report [None req-19112987-8fcf-4309-89ce-fd119c195a72 tempest-TestShelveInstance-1161595377 tempest-TestShelveInstance-1161595377-project-member] Refreshing aggregate associations for resource provider d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3, aggregates: None {{(pid=75229) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 14 10:05:04 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:05:04 user nova-compute[75229]: DEBUG nova.scheduler.client.report [None req-19112987-8fcf-4309-89ce-fd119c195a72 tempest-TestShelveInstance-1161595377 tempest-TestShelveInstance-1161595377-project-member] Refreshing trait associations for resource provider d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3, traits: COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_MMX,HW_CPU_X86_SSE42,HW_CPU_X86_SSSE3,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_TRUSTED_CERTS,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSE,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_USB,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_RESCUE_BFV {{(pid=75229) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 14 10:05:04 user nova-compute[75229]: DEBUG nova.compute.provider_tree [None req-19112987-8fcf-4309-89ce-fd119c195a72 tempest-TestShelveInstance-1161595377 tempest-TestShelveInstance-1161595377-project-member] Inventory has not changed in ProviderTree for provider: d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 {{(pid=75229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 10:05:04 user nova-compute[75229]: DEBUG nova.scheduler.client.report [None req-19112987-8fcf-4309-89ce-fd119c195a72 tempest-TestShelveInstance-1161595377 tempest-TestShelveInstance-1161595377-project-member] Inventory has not changed for provider d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 10:05:04 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-19112987-8fcf-4309-89ce-fd119c195a72 tempest-TestShelveInstance-1161595377 tempest-TestShelveInstance-1161595377-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.481s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:05:05 user nova-compute[75229]: INFO nova.network.neutron [None req-19112987-8fcf-4309-89ce-fd119c195a72 tempest-TestShelveInstance-1161595377 tempest-TestShelveInstance-1161595377-project-member] [instance: abe7e145-d3bc-49a1-83be-793488de828b] Updating port fe62c72a-f69b-4109-bfa3-e4a51fa43d0e with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 14 10:05:05 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-19112987-8fcf-4309-89ce-fd119c195a72 tempest-TestShelveInstance-1161595377 tempest-TestShelveInstance-1161595377-project-member] Acquiring lock "refresh_cache-abe7e145-d3bc-49a1-83be-793488de828b" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 10:05:05 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-19112987-8fcf-4309-89ce-fd119c195a72 tempest-TestShelveInstance-1161595377 tempest-TestShelveInstance-1161595377-project-member] Acquired lock "refresh_cache-abe7e145-d3bc-49a1-83be-793488de828b" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 10:05:05 user nova-compute[75229]: DEBUG nova.network.neutron [None req-19112987-8fcf-4309-89ce-fd119c195a72 tempest-TestShelveInstance-1161595377 tempest-TestShelveInstance-1161595377-project-member] [instance: abe7e145-d3bc-49a1-83be-793488de828b] Building network info cache for instance {{(pid=75229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 10:05:05 user nova-compute[75229]: DEBUG nova.compute.manager [req-3baf77eb-ff5e-4677-a719-36b1b21fc420 req-d6e628e6-6ff6-4e76-8039-698f4881147f service nova] [instance: abe7e145-d3bc-49a1-83be-793488de828b] Received event network-changed-fe62c72a-f69b-4109-bfa3-e4a51fa43d0e {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 10:05:05 user nova-compute[75229]: DEBUG nova.compute.manager [req-3baf77eb-ff5e-4677-a719-36b1b21fc420 req-d6e628e6-6ff6-4e76-8039-698f4881147f service nova] [instance: abe7e145-d3bc-49a1-83be-793488de828b] Refreshing instance network info cache due to event network-changed-fe62c72a-f69b-4109-bfa3-e4a51fa43d0e. {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 10:05:05 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-3baf77eb-ff5e-4677-a719-36b1b21fc420 req-d6e628e6-6ff6-4e76-8039-698f4881147f service nova] Acquiring lock "refresh_cache-abe7e145-d3bc-49a1-83be-793488de828b" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 10:05:05 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:05:05 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:05:05 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:05:05 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:05:05 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Auditing locally available compute resources for user (node: user) {{(pid=75229) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 10:05:05 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cda8c5ad-e70c-4021-bace-d55831c4bc78/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:05:06 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cda8c5ad-e70c-4021-bace-d55831c4bc78/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:05:06 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cda8c5ad-e70c-4021-bace-d55831c4bc78/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:05:06 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 10:05:06 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cda8c5ad-e70c-4021-bace-d55831c4bc78/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:05:06 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=75229) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 10:05:06 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1679275-ebb1-4f15-80a4-b8fd614fc34b/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:05:06 user nova-compute[75229]: DEBUG nova.network.neutron [None req-19112987-8fcf-4309-89ce-fd119c195a72 tempest-TestShelveInstance-1161595377 tempest-TestShelveInstance-1161595377-project-member] [instance: abe7e145-d3bc-49a1-83be-793488de828b] Updating instance_info_cache with network_info: [{"id": "fe62c72a-f69b-4109-bfa3-e4a51fa43d0e", "address": "fa:16:3e:f8:a3:e5", "network": {"id": "f0c67d05-ffe2-4866-baa3-fa4acaeadaa1", "bridge": "br-int", "label": "tempest-TestShelveInstance-1922554351-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.5", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d1aa0aeea4145b69bf310c4d9b649d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe62c72a-f6", "ovs_interfaceid": "fe62c72a-f69b-4109-bfa3-e4a51fa43d0e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 10:05:06 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-19112987-8fcf-4309-89ce-fd119c195a72 tempest-TestShelveInstance-1161595377 tempest-TestShelveInstance-1161595377-project-member] Releasing lock "refresh_cache-abe7e145-d3bc-49a1-83be-793488de828b" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 10:05:06 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-19112987-8fcf-4309-89ce-fd119c195a72 tempest-TestShelveInstance-1161595377 tempest-TestShelveInstance-1161595377-project-member] [instance: abe7e145-d3bc-49a1-83be-793488de828b] Creating instance directory {{(pid=75229) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 10:05:06 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-19112987-8fcf-4309-89ce-fd119c195a72 tempest-TestShelveInstance-1161595377 tempest-TestShelveInstance-1161595377-project-member] [instance: abe7e145-d3bc-49a1-83be-793488de828b] Creating image(s)
Nov 14 10:05:06 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-19112987-8fcf-4309-89ce-fd119c195a72 tempest-TestShelveInstance-1161595377 tempest-TestShelveInstance-1161595377-project-member] [instance: abe7e145-d3bc-49a1-83be-793488de828b] Did not create local disks {{(pid=75229) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 14 10:05:06 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-19112987-8fcf-4309-89ce-fd119c195a72 tempest-TestShelveInstance-1161595377 tempest-TestShelveInstance-1161595377-project-member] [instance: abe7e145-d3bc-49a1-83be-793488de828b] Ensure instance console log exists: /opt/stack/data/nova/instances/abe7e145-d3bc-49a1-83be-793488de828b/console.log {{(pid=75229) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 10:05:06 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-19112987-8fcf-4309-89ce-fd119c195a72 tempest-TestShelveInstance-1161595377 tempest-TestShelveInstance-1161595377-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:05:06 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-19112987-8fcf-4309-89ce-fd119c195a72 tempest-TestShelveInstance-1161595377 tempest-TestShelveInstance-1161595377-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:05:06 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-19112987-8fcf-4309-89ce-fd119c195a72 tempest-TestShelveInstance-1161595377 tempest-TestShelveInstance-1161595377-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:05:06 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-19112987-8fcf-4309-89ce-fd119c195a72 tempest-TestShelveInstance-1161595377 tempest-TestShelveInstance-1161595377-project-member] [instance: abe7e145-d3bc-49a1-83be-793488de828b] Start _get_guest_xml network_info=[{"id": "fe62c72a-f69b-4109-bfa3-e4a51fa43d0e", "address": "fa:16:3e:f8:a3:e5", "network": {"id": "f0c67d05-ffe2-4866-baa3-fa4acaeadaa1", "bridge": "br-int", "label": "tempest-TestShelveInstance-1922554351-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.5", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d1aa0aeea4145b69bf310c4d9b649d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe62c72a-f6", "ovs_interfaceid": "fe62c72a-f69b-4109-bfa3-e4a51fa43d0e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:e4a6dca6-1581-494f-afe5-3aac2b4d2c15', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VCFjOGhf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'abe7e145-d3bc-49a1-83be-793488de828b', 'attached_at': '', 'detached_at': '', 'volume_id': 'e4a6dca6-1581-494f-afe5-3aac2b4d2c15', 'serial': 'e4a6dca6-1581-494f-afe5-3aac2b4d2c15'}, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'attachment_id': '11c22975-92c3-43a9-b71d-e02f9d8ad163', 'guest_format': None, 'device_type': 'disk', 'volume_type': None} {{(pid=75229) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 10:05:06 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-3baf77eb-ff5e-4677-a719-36b1b21fc420 req-d6e628e6-6ff6-4e76-8039-698f4881147f service nova] Acquired lock "refresh_cache-abe7e145-d3bc-49a1-83be-793488de828b" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 10:05:06 user nova-compute[75229]: DEBUG nova.network.neutron [req-3baf77eb-ff5e-4677-a719-36b1b21fc420 req-d6e628e6-6ff6-4e76-8039-698f4881147f service nova] [instance: abe7e145-d3bc-49a1-83be-793488de828b] Refreshing network info cache for port fe62c72a-f69b-4109-bfa3-e4a51fa43d0e {{(pid=75229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 10:05:06 user nova-compute[75229]: WARNING nova.virt.libvirt.driver [None req-19112987-8fcf-4309-89ce-fd119c195a72 tempest-TestShelveInstance-1161595377 tempest-TestShelveInstance-1161595377-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 10:05:06 user nova-compute[75229]: WARNING nova.virt.libvirt.driver [None req-19112987-8fcf-4309-89ce-fd119c195a72 tempest-TestShelveInstance-1161595377 tempest-TestShelveInstance-1161595377-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 10:05:06 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-19112987-8fcf-4309-89ce-fd119c195a72 tempest-TestShelveInstance-1161595377 tempest-TestShelveInstance-1161595377-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75229) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 10:05:06 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-19112987-8fcf-4309-89ce-fd119c195a72 tempest-TestShelveInstance-1161595377 tempest-TestShelveInstance-1161595377-project-member] CPU controller missing on host. {{(pid=75229) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 10:05:06 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-19112987-8fcf-4309-89ce-fd119c195a72 tempest-TestShelveInstance-1161595377 tempest-TestShelveInstance-1161595377-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75229) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 10:05:06 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-19112987-8fcf-4309-89ce-fd119c195a72 tempest-TestShelveInstance-1161595377 tempest-TestShelveInstance-1161595377-project-member] CPU controller found on host. {{(pid=75229) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 10:05:06 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-19112987-8fcf-4309-89ce-fd119c195a72 tempest-TestShelveInstance-1161595377 tempest-TestShelveInstance-1161595377-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75229) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 10:05:06 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-19112987-8fcf-4309-89ce-fd119c195a72 tempest-TestShelveInstance-1161595377 tempest-TestShelveInstance-1161595377-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T09:39:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 10:05:06 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-19112987-8fcf-4309-89ce-fd119c195a72 tempest-TestShelveInstance-1161595377 tempest-TestShelveInstance-1161595377-project-member] Flavor limits 0:0:0 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 10:05:06 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-19112987-8fcf-4309-89ce-fd119c195a72 tempest-TestShelveInstance-1161595377 tempest-TestShelveInstance-1161595377-project-member] Image limits 0:0:0 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 10:05:06 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-19112987-8fcf-4309-89ce-fd119c195a72 tempest-TestShelveInstance-1161595377 tempest-TestShelveInstance-1161595377-project-member] Flavor pref 0:0:0 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 10:05:06 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-19112987-8fcf-4309-89ce-fd119c195a72 tempest-TestShelveInstance-1161595377 tempest-TestShelveInstance-1161595377-project-member] Image pref 0:0:0 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 10:05:06 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-19112987-8fcf-4309-89ce-fd119c195a72 tempest-TestShelveInstance-1161595377 tempest-TestShelveInstance-1161595377-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 10:05:06 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-19112987-8fcf-4309-89ce-fd119c195a72 tempest-TestShelveInstance-1161595377 tempest-TestShelveInstance-1161595377-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 10:05:06 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-19112987-8fcf-4309-89ce-fd119c195a72 tempest-TestShelveInstance-1161595377 tempest-TestShelveInstance-1161595377-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75229) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 10:05:06 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-19112987-8fcf-4309-89ce-fd119c195a72 tempest-TestShelveInstance-1161595377 tempest-TestShelveInstance-1161595377-project-member] Got 1 possible topologies {{(pid=75229) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 10:05:06 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-19112987-8fcf-4309-89ce-fd119c195a72 tempest-TestShelveInstance-1161595377 tempest-TestShelveInstance-1161595377-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 10:05:06 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-19112987-8fcf-4309-89ce-fd119c195a72 tempest-TestShelveInstance-1161595377 tempest-TestShelveInstance-1161595377-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 10:05:06 user nova-compute[75229]: DEBUG nova.objects.instance [None req-19112987-8fcf-4309-89ce-fd119c195a72 tempest-TestShelveInstance-1161595377 tempest-TestShelveInstance-1161595377-project-member] Lazy-loading 'vcpu_model' on Instance uuid abe7e145-d3bc-49a1-83be-793488de828b {{(pid=75229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 10:05:06 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1679275-ebb1-4f15-80a4-b8fd614fc34b/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:05:06 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1679275-ebb1-4f15-80a4-b8fd614fc34b/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:05:06 user nova-compute[75229]: DEBUG nova.objects.base [None req-19112987-8fcf-4309-89ce-fd119c195a72 tempest-TestShelveInstance-1161595377 tempest-TestShelveInstance-1161595377-project-member] Object Instance<abe7e145-d3bc-49a1-83be-793488de828b> lazy-loaded attributes: pci_requests,vcpu_model {{(pid=75229) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 10:05:06 user nova-compute[75229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-19112987-8fcf-4309-89ce-fd119c195a72 tempest-TestShelveInstance-1161595377 tempest-TestShelveInstance-1161595377-project-member] [instance: abe7e145-d3bc-49a1-83be-793488de828b] Calling os-brick to attach iSCSI Volume {{(pid=75229) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 10:05:06 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-19112987-8fcf-4309-89ce-fd119c195a72 tempest-TestShelveInstance-1161595377 tempest-TestShelveInstance-1161595377-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f73f85151b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e4a6dca6-1581-494f-afe5-3aac2b4d2c15', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VCFjOGhf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 10:05:06 user nova-compute[75229]: WARNING os_brick.initiator.connectors.base [None req-19112987-8fcf-4309-89ce-fd119c195a72 tempest-TestShelveInstance-1161595377 tempest-TestShelveInstance-1161595377-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 10:05:06 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-19112987-8fcf-4309-89ce-fd119c195a72 tempest-TestShelveInstance-1161595377 tempest-TestShelveInstance-1161595377-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 10:05:06 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-19112987-8fcf-4309-89ce-fd119c195a72 tempest-TestShelveInstance-1161595377 tempest-TestShelveInstance-1161595377-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 10:05:06 user nova-compute[75229]: WARNING os_brick.initiator.connectors.base [None req-19112987-8fcf-4309-89ce-fd119c195a72 tempest-TestShelveInstance-1161595377 tempest-TestShelveInstance-1161595377-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 10:05:06 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-19112987-8fcf-4309-89ce-fd119c195a72 tempest-TestShelveInstance-1161595377 tempest-TestShelveInstance-1161595377-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e4a6dca6-1581-494f-afe5-3aac2b4d2c15" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 10:05:06 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-19112987-8fcf-4309-89ce-fd119c195a72 tempest-TestShelveInstance-1161595377 tempest-TestShelveInstance-1161595377-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e4a6dca6-1581-494f-afe5-3aac2b4d2c15" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 10:05:06 user nova-compute[75229]: INFO os_brick.initiator.connectors.iscsi [None req-19112987-8fcf-4309-89ce-fd119c195a72 tempest-TestShelveInstance-1161595377 tempest-TestShelveInstance-1161595377-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 10:05:06 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4a6dca6-1581-494f-afe5-3aac2b4d2c15 -p 172.16.0.220:3260 {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:05:06 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4a6dca6-1581-494f-afe5-3aac2b4d2c15 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:05:06 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[26289b22-87b3-4f8c-b254-971a020f5ac4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:05:06 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-19112987-8fcf-4309-89ce-fd119c195a72 tempest-TestShelveInstance-1161595377 tempest-TestShelveInstance-1161595377-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 10:05:06 user nova-compute[75229]:  {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 10:05:06 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4a6dca6-1581-494f-afe5-3aac2b4d2c15 -p 172.16.0.220:3260 --interface default --op new {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:05:06 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4a6dca6-1581-494f-afe5-3aac2b4d2c15 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:05:06 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b155eb9-d19d-4614-b0dd-102b03773883]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e4a6dca6-1581-494f-afe5-3aac2b4d2c15] added\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:05:06 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-19112987-8fcf-4309-89ce-fd119c195a72 tempest-TestShelveInstance-1161595377 tempest-TestShelveInstance-1161595377-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e4a6dca6-1581-494f-afe5-3aac2b4d2c15] added
Nov 14 10:05:06 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 10:05:06 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4a6dca6-1581-494f-afe5-3aac2b4d2c15 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:05:06 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4a6dca6-1581-494f-afe5-3aac2b4d2c15 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:05:06 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[5208436b-0bed-4546-96ce-a5c6d624d11f]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:05:06 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-19112987-8fcf-4309-89ce-fd119c195a72 tempest-TestShelveInstance-1161595377 tempest-TestShelveInstance-1161595377-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 10:05:06 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4a6dca6-1581-494f-afe5-3aac2b4d2c15 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:05:06 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1679275-ebb1-4f15-80a4-b8fd614fc34b/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:05:06 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75229) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 10:05:06 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4a6dca6-1581-494f-afe5-3aac2b4d2c15 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:05:06 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[93579507-cf16-49c7-b3d0-7735c553fd68]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:05:06 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-19112987-8fcf-4309-89ce-fd119c195a72 tempest-TestShelveInstance-1161595377 tempest-TestShelveInstance-1161595377-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 10:05:06 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4a6dca6-1581-494f-afe5-3aac2b4d2c15 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VCFjOGhf {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:05:06 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de62e75a-207e-4aa3-a592-52f48577c2b9/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:05:06 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4a6dca6-1581-494f-afe5-3aac2b4d2c15 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VCFjOGhf" returned: 0 in 0.018s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:05:06 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e4fe1a3-95d5-4956-8c4a-8473076bc22e]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:05:06 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-19112987-8fcf-4309-89ce-fd119c195a72 tempest-TestShelveInstance-1161595377 tempest-TestShelveInstance-1161595377-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'VCFjOGhf'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 10:05:06 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4a6dca6-1581-494f-afe5-3aac2b4d2c15 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:05:06 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4a6dca6-1581-494f-afe5-3aac2b4d2c15 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:05:06 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[afc7b708-a4f0-4055-a38b-8f36e90cc97f]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:05:06 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-19112987-8fcf-4309-89ce-fd119c195a72 tempest-TestShelveInstance-1161595377 tempest-TestShelveInstance-1161595377-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 10:05:06 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:05:06 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:05:06 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[75a65a58-cddb-4860-8bd4-6506d8d3ed23]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aebc438-0289-44fe-ad84-4e696468f50e (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2977635e-b11f-4ab2-875c-e9f396b932dc (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ddb200b-47ca-4449-9973-be76424a6761 (non-flash)\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:05:06 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-19112987-8fcf-4309-89ce-fd119c195a72 tempest-TestShelveInstance-1161595377 tempest-TestShelveInstance-1161595377-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aebc438-0289-44fe-ad84-4e696468f50e (non-flash)
Nov 14 10:05:06 user nova-compute[75229]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2977635e-b11f-4ab2-875c-e9f396b932dc (non-flash)
Nov 14 10:05:06 user nova-compute[75229]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ddb200b-47ca-4449-9973-be76424a6761 (non-flash)
Nov 14 10:05:06 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 10:05:06 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-19112987-8fcf-4309-89ce-fd119c195a72 tempest-TestShelveInstance-1161595377 tempest-TestShelveInstance-1161595377-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aebc438-0289-44fe-ad84-4e696468f50e (non-flash)
Nov 14 10:05:06 user nova-compute[75229]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2977635e-b11f-4ab2-875c-e9f396b932dc (non-flash)
Nov 14 10:05:06 user nova-compute[75229]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ddb200b-47ca-4449-9973-be76424a6761 (non-flash)
Nov 14 10:05:06 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 10:05:06 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4a6dca6-1581-494f-afe5-3aac2b4d2c15 -p 172.16.0.220:3260 --login {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:05:06 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4a6dca6-1581-494f-afe5-3aac2b4d2c15 -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:05:06 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe14e081-e811-4baa-a4ae-189cc9596bf4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e4a6dca6-1581-494f-afe5-3aac2b4d2c15, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e4a6dca6-1581-494f-afe5-3aac2b4d2c15, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:05:06 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-19112987-8fcf-4309-89ce-fd119c195a72 tempest-TestShelveInstance-1161595377 tempest-TestShelveInstance-1161595377-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e4a6dca6-1581-494f-afe5-3aac2b4d2c15, portal: 172.16.0.220,3260]
Nov 14 10:05:06 user nova-compute[75229]: Login to [iface: default, target: iqn.2010-10.org.openstack:e4a6dca6-1581-494f-afe5-3aac2b4d2c15, portal: 172.16.0.220,3260] successful.
Nov 14 10:05:06 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 10:05:06 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4a6dca6-1581-494f-afe5-3aac2b4d2c15 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:05:06 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de62e75a-207e-4aa3-a592-52f48577c2b9/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:05:06 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de62e75a-207e-4aa3-a592-52f48577c2b9/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:05:06 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4a6dca6-1581-494f-afe5-3aac2b4d2c15 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:05:06 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[06989713-0feb-4545-9717-455a30d7a376]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:05:06 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-19112987-8fcf-4309-89ce-fd119c195a72 tempest-TestShelveInstance-1161595377 tempest-TestShelveInstance-1161595377-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 10:05:06 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:05:06 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:05:06 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[8add4f31-a0be-40ea-8704-c3e3554d235d]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aebc438-0289-44fe-ad84-4e696468f50e (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2977635e-b11f-4ab2-875c-e9f396b932dc (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ddb200b-47ca-4449-9973-be76424a6761 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4a6dca6-1581-494f-afe5-3aac2b4d2c15 (non-flash)\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:05:06 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-19112987-8fcf-4309-89ce-fd119c195a72 tempest-TestShelveInstance-1161595377 tempest-TestShelveInstance-1161595377-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aebc438-0289-44fe-ad84-4e696468f50e (non-flash)
Nov 14 10:05:06 user nova-compute[75229]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2977635e-b11f-4ab2-875c-e9f396b932dc (non-flash)
Nov 14 10:05:06 user nova-compute[75229]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ddb200b-47ca-4449-9973-be76424a6761 (non-flash)
Nov 14 10:05:06 user nova-compute[75229]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4a6dca6-1581-494f-afe5-3aac2b4d2c15 (non-flash)
Nov 14 10:05:06 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 10:05:06 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-19112987-8fcf-4309-89ce-fd119c195a72 tempest-TestShelveInstance-1161595377 tempest-TestShelveInstance-1161595377-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aebc438-0289-44fe-ad84-4e696468f50e (non-flash)
Nov 14 10:05:06 user nova-compute[75229]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2977635e-b11f-4ab2-875c-e9f396b932dc (non-flash)
Nov 14 10:05:06 user nova-compute[75229]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ddb200b-47ca-4449-9973-be76424a6761 (non-flash)
Nov 14 10:05:06 user nova-compute[75229]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4a6dca6-1581-494f-afe5-3aac2b4d2c15 (non-flash)
Nov 14 10:05:06 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 10:05:06 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-19112987-8fcf-4309-89ce-fd119c195a72 tempest-TestShelveInstance-1161595377 tempest-TestShelveInstance-1161595377-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e4a6dca6-1581-494f-afe5-3aac2b4d2c15" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.354s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 10:05:06 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-19112987-8fcf-4309-89ce-fd119c195a72 tempest-TestShelveInstance-1161595377 tempest-TestShelveInstance-1161595377-project-member] Connected to 172.16.0.220:3260 {{(pid=75229) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 10:05:06 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-19112987-8fcf-4309-89ce-fd119c195a72 tempest-TestShelveInstance-1161595377 tempest-TestShelveInstance-1161595377-project-member] HCTL ('33', '-', '-', 0) found on session 45 with lun 0 {{(pid=75229) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 10:05:06 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-19112987-8fcf-4309-89ce-fd119c195a72 tempest-TestShelveInstance-1161595377 tempest-TestShelveInstance-1161595377-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75229) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 10:05:06 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:05:06 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:05:06 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[7928ae22-2073-4a9e-a99e-e2ac5e80731b]: (4, ('- - 0', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:05:06 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-19112987-8fcf-4309-89ce-fd119c195a72 tempest-TestShelveInstance-1161595377 tempest-TestShelveInstance-1161595377-project-member] Searching for a device in session 45 and hctl ['33', '*', '*', 0] yield: None {{(pid=75229) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 10:05:06 user nova-compute[75229]: DEBUG nova.network.neutron [req-3baf77eb-ff5e-4677-a719-36b1b21fc420 req-d6e628e6-6ff6-4e76-8039-698f4881147f service nova] [instance: abe7e145-d3bc-49a1-83be-793488de828b] Updated VIF entry in instance network info cache for port fe62c72a-f69b-4109-bfa3-e4a51fa43d0e. {{(pid=75229) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 10:05:06 user nova-compute[75229]: DEBUG nova.network.neutron [req-3baf77eb-ff5e-4677-a719-36b1b21fc420 req-d6e628e6-6ff6-4e76-8039-698f4881147f service nova] [instance: abe7e145-d3bc-49a1-83be-793488de828b] Updating instance_info_cache with network_info: [{"id": "fe62c72a-f69b-4109-bfa3-e4a51fa43d0e", "address": "fa:16:3e:f8:a3:e5", "network": {"id": "f0c67d05-ffe2-4866-baa3-fa4acaeadaa1", "bridge": "br-int", "label": "tempest-TestShelveInstance-1922554351-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.5", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d1aa0aeea4145b69bf310c4d9b649d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe62c72a-f6", "ovs_interfaceid": "fe62c72a-f69b-4109-bfa3-e4a51fa43d0e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 10:05:06 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-3baf77eb-ff5e-4677-a719-36b1b21fc420 req-d6e628e6-6ff6-4e76-8039-698f4881147f service nova] Releasing lock "refresh_cache-abe7e145-d3bc-49a1-83be-793488de828b" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 10:05:06 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de62e75a-207e-4aa3-a592-52f48577c2b9/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:05:06 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c9fe69e-3f9d-4b30-a9e4-efc3e83efa17/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:05:07 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c9fe69e-3f9d-4b30-a9e4-efc3e83efa17/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:05:07 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c9fe69e-3f9d-4b30-a9e4-efc3e83efa17/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:05:07 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c9fe69e-3f9d-4b30-a9e4-efc3e83efa17/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:05:07 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75229) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 10:05:07 user nova-compute[75229]: WARNING nova.virt.libvirt.driver [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 10:05:07 user nova-compute[75229]: WARNING nova.virt.libvirt.driver [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 10:05:07 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Hypervisor/Node resource view: name=user free_ram=8119MB free_disk=25.05630111694336GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75229) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 10:05:07 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:05:07 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:05:07 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Instance 4c9fe69e-3f9d-4b30-a9e4-efc3e83efa17 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 10:05:07 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Instance cda8c5ad-e70c-4021-bace-d55831c4bc78 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 10:05:07 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Instance 30ae1f73-e0f3-4e26-987e-a684471a160d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 10:05:07 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Instance d822d5e4-38d8-4ca7-a682-f2f2144b6005 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 10:05:07 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Instance c1679275-ebb1-4f15-80a4-b8fd614fc34b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 10:05:07 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Instance de62e75a-207e-4aa3-a592-52f48577c2b9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 10:05:07 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Instance 3795dd8f-8a10-4939-8f2c-bacefe5f5aa1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 10:05:07 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] [instance: abe7e145-d3bc-49a1-83be-793488de828b] Instance with task_state "spawning" is not being actively managed by this compute host but has allocations referencing this compute node (d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3): {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. Skipping heal of allocations during the task state transition. {{(pid=75229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1777}}
Nov 14 10:05:07 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=75229) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 10:05:07 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=75229) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 10:05:07 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-19112987-8fcf-4309-89ce-fd119c195a72 tempest-TestShelveInstance-1161595377 tempest-TestShelveInstance-1161595377-project-member] Searching for a device in session 45 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75229) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 10:05:07 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-19112987-8fcf-4309-89ce-fd119c195a72 tempest-TestShelveInstance-1161595377 tempest-TestShelveInstance-1161595377-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:e4a6dca6-1581-494f-afe5-3aac2b4d2c15', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VCFjOGhf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75229) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 10:05:07 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-19112987-8fcf-4309-89ce-fd119c195a72 tempest-TestShelveInstance-1161595377 tempest-TestShelveInstance-1161595377-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.390s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 10:05:07 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-19112987-8fcf-4309-89ce-fd119c195a72 tempest-TestShelveInstance-1161595377 tempest-TestShelveInstance-1161595377-project-member] <== connect_volume: return (1391ms) {'type': 'block', 'scsi_wwn': '23162366231343262', 'path': '/dev/sdb'} {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 10:05:07 user nova-compute[75229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-19112987-8fcf-4309-89ce-fd119c195a72 tempest-TestShelveInstance-1161595377 tempest-TestShelveInstance-1161595377-project-member] [instance: abe7e145-d3bc-49a1-83be-793488de828b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23162366231343262', 'path': '/dev/sdb'} {{(pid=75229) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 10:05:07 user nova-compute[75229]: DEBUG nova.virt.libvirt.vif [None req-19112987-8fcf-4309-89ce-fd119c195a72 tempest-TestShelveInstance-1161595377 tempest-TestShelveInstance-1161595377-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-14T10:01:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1956352286',display_name='tempest-TestShelveInstance-server-1956352286',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1956352286',id=39,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-743585374',keypairs=<?>,launch_index=0,launched_at=2023-11-14T10:01:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='0d1aa0aeea4145b69bf310c4d9b649d0',ramdisk_id='',reservation_id='r-ysbldy6n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1161595377',owner_user_name='tempest-TestShelveInstance-1161595377-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T10:05:00Z,user_data=None,user_id='cd2c5b18ddd44bf18089cf001e012ebb',uuid=abe7e145-d3bc-49a1-83be-793488de828b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "fe62c72a-f69b-4109-bfa3-e4a51fa43d0e", "address": "fa:16:3e:f8:a3:e5", "network": {"id": "f0c67d05-ffe2-4866-baa3-fa4acaeadaa1", "bridge": "br-int", "label": "tempest-TestShelveInstance-1922554351-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.5", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d1aa0aeea4145b69bf310c4d9b649d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe62c72a-f6", "ovs_interfaceid": "fe62c72a-f69b-4109-bfa3-e4a51fa43d0e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75229) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 10:05:07 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-19112987-8fcf-4309-89ce-fd119c195a72 tempest-TestShelveInstance-1161595377 tempest-TestShelveInstance-1161595377-project-member] Converting VIF {"id": "fe62c72a-f69b-4109-bfa3-e4a51fa43d0e", "address": "fa:16:3e:f8:a3:e5", "network": {"id": "f0c67d05-ffe2-4866-baa3-fa4acaeadaa1", "bridge": "br-int", "label": "tempest-TestShelveInstance-1922554351-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.5", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d1aa0aeea4145b69bf310c4d9b649d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe62c72a-f6", "ovs_interfaceid": "fe62c72a-f69b-4109-bfa3-e4a51fa43d0e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 10:05:07 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-19112987-8fcf-4309-89ce-fd119c195a72 tempest-TestShelveInstance-1161595377 tempest-TestShelveInstance-1161595377-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f8:a3:e5,bridge_name='br-int',has_traffic_filtering=True,id=fe62c72a-f69b-4109-bfa3-e4a51fa43d0e,network=Network(f0c67d05-ffe2-4866-baa3-fa4acaeadaa1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe62c72a-f6') {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 10:05:07 user nova-compute[75229]: DEBUG nova.objects.instance [None req-19112987-8fcf-4309-89ce-fd119c195a72 tempest-TestShelveInstance-1161595377 tempest-TestShelveInstance-1161595377-project-member] Lazy-loading 'pci_devices' on Instance uuid abe7e145-d3bc-49a1-83be-793488de828b {{(pid=75229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 10:05:07 user nova-compute[75229]: DEBUG nova.objects.base [None req-19112987-8fcf-4309-89ce-fd119c195a72 tempest-TestShelveInstance-1161595377 tempest-TestShelveInstance-1161595377-project-member] Object Instance<abe7e145-d3bc-49a1-83be-793488de828b> lazy-loaded attributes: pci_requests,vcpu_model,pci_devices {{(pid=75229) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 10:05:07 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-19112987-8fcf-4309-89ce-fd119c195a72 tempest-TestShelveInstance-1161595377 tempest-TestShelveInstance-1161595377-project-member] [instance: abe7e145-d3bc-49a1-83be-793488de828b] End _get_guest_xml xml=<domain type="kvm">
Nov 14 10:05:07 user nova-compute[75229]:   <uuid>abe7e145-d3bc-49a1-83be-793488de828b</uuid>
Nov 14 10:05:07 user nova-compute[75229]:   <name>instance-00000027</name>
Nov 14 10:05:07 user nova-compute[75229]:   <memory>524288</memory>
Nov 14 10:05:07 user nova-compute[75229]:   <vcpu>1</vcpu>
Nov 14 10:05:07 user nova-compute[75229]:   <metadata>
Nov 14 10:05:07 user nova-compute[75229]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 10:05:07 user nova-compute[75229]:       <nova:package version="0.0.0"/>
Nov 14 10:05:07 user nova-compute[75229]:       <nova:name>tempest-TestShelveInstance-server-1956352286</nova:name>
Nov 14 10:05:07 user nova-compute[75229]:       <nova:creationTime>2023-11-14 10:05:06</nova:creationTime>
Nov 14 10:05:07 user nova-compute[75229]:       <nova:flavor name="m1.tiny">
Nov 14 10:05:07 user nova-compute[75229]:         <nova:memory>512</nova:memory>
Nov 14 10:05:07 user nova-compute[75229]:         <nova:disk>1</nova:disk>
Nov 14 10:05:07 user nova-compute[75229]:         <nova:swap>0</nova:swap>
Nov 14 10:05:07 user nova-compute[75229]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 10:05:07 user nova-compute[75229]:         <nova:vcpus>1</nova:vcpus>
Nov 14 10:05:07 user nova-compute[75229]:       </nova:flavor>
Nov 14 10:05:07 user nova-compute[75229]:       <nova:owner>
Nov 14 10:05:07 user nova-compute[75229]:         <nova:user uuid="cd2c5b18ddd44bf18089cf001e012ebb">tempest-TestShelveInstance-1161595377-project-member</nova:user>
Nov 14 10:05:07 user nova-compute[75229]:         <nova:project uuid="0d1aa0aeea4145b69bf310c4d9b649d0">tempest-TestShelveInstance-1161595377</nova:project>
Nov 14 10:05:07 user nova-compute[75229]:       </nova:owner>
Nov 14 10:05:07 user nova-compute[75229]:       <nova:ports>
Nov 14 10:05:07 user nova-compute[75229]:         <nova:port uuid="fe62c72a-f69b-4109-bfa3-e4a51fa43d0e">
Nov 14 10:05:07 user nova-compute[75229]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 14 10:05:07 user nova-compute[75229]:         </nova:port>
Nov 14 10:05:07 user nova-compute[75229]:       </nova:ports>
Nov 14 10:05:07 user nova-compute[75229]:     </nova:instance>
Nov 14 10:05:07 user nova-compute[75229]:   </metadata>
Nov 14 10:05:07 user nova-compute[75229]:   <sysinfo type="smbios">
Nov 14 10:05:07 user nova-compute[75229]:     <system>
Nov 14 10:05:07 user nova-compute[75229]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 10:05:07 user nova-compute[75229]:       <entry name="product">OpenStack Nova</entry>
Nov 14 10:05:07 user nova-compute[75229]:       <entry name="version">0.0.0</entry>
Nov 14 10:05:07 user nova-compute[75229]:       <entry name="serial">abe7e145-d3bc-49a1-83be-793488de828b</entry>
Nov 14 10:05:07 user nova-compute[75229]:       <entry name="uuid">abe7e145-d3bc-49a1-83be-793488de828b</entry>
Nov 14 10:05:07 user nova-compute[75229]:       <entry name="family">Virtual Machine</entry>
Nov 14 10:05:07 user nova-compute[75229]:     </system>
Nov 14 10:05:07 user nova-compute[75229]:   </sysinfo>
Nov 14 10:05:07 user nova-compute[75229]:   <os>
Nov 14 10:05:07 user nova-compute[75229]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 10:05:07 user nova-compute[75229]:     <boot dev="hd"/>
Nov 14 10:05:07 user nova-compute[75229]:     <smbios mode="sysinfo"/>
Nov 14 10:05:07 user nova-compute[75229]:   </os>
Nov 14 10:05:07 user nova-compute[75229]:   <features>
Nov 14 10:05:07 user nova-compute[75229]:     <acpi/>
Nov 14 10:05:07 user nova-compute[75229]:     <apic/>
Nov 14 10:05:07 user nova-compute[75229]:     <vmcoreinfo/>
Nov 14 10:05:07 user nova-compute[75229]:   </features>
Nov 14 10:05:07 user nova-compute[75229]:   <clock offset="utc">
Nov 14 10:05:07 user nova-compute[75229]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 10:05:07 user nova-compute[75229]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 10:05:07 user nova-compute[75229]:     <timer name="hpet" present="no"/>
Nov 14 10:05:07 user nova-compute[75229]:   </clock>
Nov 14 10:05:07 user nova-compute[75229]:   <cpu mode="custom" match="exact">
Nov 14 10:05:07 user nova-compute[75229]:     <model>Nehalem</model>
Nov 14 10:05:07 user nova-compute[75229]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 10:05:07 user nova-compute[75229]:   </cpu>
Nov 14 10:05:07 user nova-compute[75229]:   <devices>
Nov 14 10:05:07 user nova-compute[75229]:     <disk type="block" device="disk">
Nov 14 10:05:07 user nova-compute[75229]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 10:05:07 user nova-compute[75229]:       <source dev="/dev/sdb"/>
Nov 14 10:05:07 user nova-compute[75229]:       <target dev="vda" bus="virtio"/>
Nov 14 10:05:07 user nova-compute[75229]:       <serial>e4a6dca6-1581-494f-afe5-3aac2b4d2c15</serial>
Nov 14 10:05:07 user nova-compute[75229]:     </disk>
Nov 14 10:05:07 user nova-compute[75229]:     <interface type="ethernet">
Nov 14 10:05:07 user nova-compute[75229]:       <mac address="fa:16:3e:f8:a3:e5"/>
Nov 14 10:05:07 user nova-compute[75229]:       <model type="virtio"/>
Nov 14 10:05:07 user nova-compute[75229]:       <mtu size="1442"/>
Nov 14 10:05:07 user nova-compute[75229]:       <target dev="tapfe62c72a-f6"/>
Nov 14 10:05:07 user nova-compute[75229]:     </interface>
Nov 14 10:05:07 user nova-compute[75229]:     <serial type="pty">
Nov 14 10:05:07 user nova-compute[75229]:       <log file="/opt/stack/data/nova/instances/abe7e145-d3bc-49a1-83be-793488de828b/console.log" append="off"/>
Nov 14 10:05:07 user nova-compute[75229]:     </serial>
Nov 14 10:05:07 user nova-compute[75229]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 10:05:07 user nova-compute[75229]:     <video>
Nov 14 10:05:07 user nova-compute[75229]:       <model type="virtio"/>
Nov 14 10:05:07 user nova-compute[75229]:     </video>
Nov 14 10:05:07 user nova-compute[75229]:     <rng model="virtio">
Nov 14 10:05:07 user nova-compute[75229]:       <backend model="random">/dev/urandom</backend>
Nov 14 10:05:07 user nova-compute[75229]:     </rng>
Nov 14 10:05:07 user nova-compute[75229]:     <controller type="usb" index="0" model="none"/>
Nov 14 10:05:07 user nova-compute[75229]:     <memballoon model="virtio">
Nov 14 10:05:07 user nova-compute[75229]:       <stats period="10"/>
Nov 14 10:05:07 user nova-compute[75229]:     </memballoon>
Nov 14 10:05:07 user nova-compute[75229]:   </devices>
Nov 14 10:05:07 user nova-compute[75229]: </domain>
Nov 14 10:05:07 user nova-compute[75229]:  {{(pid=75229) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 10:05:07 user nova-compute[75229]: DEBUG nova.virt.libvirt.vif [None req-19112987-8fcf-4309-89ce-fd119c195a72 tempest-TestShelveInstance-1161595377 tempest-TestShelveInstance-1161595377-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-14T10:01:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1956352286',display_name='tempest-TestShelveInstance-server-1956352286',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1956352286',id=39,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-743585374',keypairs=<?>,launch_index=0,launched_at=2023-11-14T10:01:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='0d1aa0aeea4145b69bf310c4d9b649d0',ramdisk_id='',reservation_id='r-ysbldy6n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1161595377',owner_user_name='tempest-TestShelveInstance-1161595377-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T10:05:00Z,user_data=None,user_id='cd2c5b18ddd44bf18089cf001e012ebb',uuid=abe7e145-d3bc-49a1-83be-793488de828b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "fe62c72a-f69b-4109-bfa3-e4a51fa43d0e", "address": "fa:16:3e:f8:a3:e5", "network": {"id": "f0c67d05-ffe2-4866-baa3-fa4acaeadaa1", "bridge": "br-int", "label": "tempest-TestShelveInstance-1922554351-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.5", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d1aa0aeea4145b69bf310c4d9b649d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe62c72a-f6", "ovs_interfaceid": "fe62c72a-f69b-4109-bfa3-e4a51fa43d0e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 10:05:07 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-19112987-8fcf-4309-89ce-fd119c195a72 tempest-TestShelveInstance-1161595377 tempest-TestShelveInstance-1161595377-project-member] Converting VIF {"id": "fe62c72a-f69b-4109-bfa3-e4a51fa43d0e", "address": "fa:16:3e:f8:a3:e5", "network": {"id": "f0c67d05-ffe2-4866-baa3-fa4acaeadaa1", "bridge": "br-int", "label": "tempest-TestShelveInstance-1922554351-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.5", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d1aa0aeea4145b69bf310c4d9b649d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe62c72a-f6", "ovs_interfaceid": "fe62c72a-f69b-4109-bfa3-e4a51fa43d0e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 10:05:07 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-19112987-8fcf-4309-89ce-fd119c195a72 tempest-TestShelveInstance-1161595377 tempest-TestShelveInstance-1161595377-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f8:a3:e5,bridge_name='br-int',has_traffic_filtering=True,id=fe62c72a-f69b-4109-bfa3-e4a51fa43d0e,network=Network(f0c67d05-ffe2-4866-baa3-fa4acaeadaa1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe62c72a-f6') {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 10:05:07 user nova-compute[75229]: DEBUG os_vif [None req-19112987-8fcf-4309-89ce-fd119c195a72 tempest-TestShelveInstance-1161595377 tempest-TestShelveInstance-1161595377-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f8:a3:e5,bridge_name='br-int',has_traffic_filtering=True,id=fe62c72a-f69b-4109-bfa3-e4a51fa43d0e,network=Network(f0c67d05-ffe2-4866-baa3-fa4acaeadaa1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe62c72a-f6') {{(pid=75229) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 10:05:07 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:05:07 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 10:05:07 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 10:05:07 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:05:07 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b3f0b2a5-66e2-5d99-b04d-74b93c0599ef', '_type': 'linux-noop'}}, row=False) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 10:05:07 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:05:07 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 10:05:07 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:05:07 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfe62c72a-f6, may_exist=True, interface_attrs={}) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 10:05:07 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapfe62c72a-f6, col_values=(('qos', UUID('f5924cf6-5b2f-4f83-ae6b-f296c2ba221d')),), if_exists=True) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 10:05:07 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapfe62c72a-f6, col_values=(('external_ids', {'iface-id': 'fe62c72a-f69b-4109-bfa3-e4a51fa43d0e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f8:a3:e5', 'vm-uuid': 'abe7e145-d3bc-49a1-83be-793488de828b'}),), if_exists=True) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 10:05:07 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:05:07 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 10:05:07 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:05:07 user nova-compute[75229]: INFO os_vif [None req-19112987-8fcf-4309-89ce-fd119c195a72 tempest-TestShelveInstance-1161595377 tempest-TestShelveInstance-1161595377-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f8:a3:e5,bridge_name='br-int',has_traffic_filtering=True,id=fe62c72a-f69b-4109-bfa3-e4a51fa43d0e,network=Network(f0c67d05-ffe2-4866-baa3-fa4acaeadaa1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe62c72a-f6')
Nov 14 10:05:08 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-19112987-8fcf-4309-89ce-fd119c195a72 tempest-TestShelveInstance-1161595377 tempest-TestShelveInstance-1161595377-project-member] No BDM found with device name vda, not building metadata. {{(pid=75229) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 10:05:08 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-19112987-8fcf-4309-89ce-fd119c195a72 tempest-TestShelveInstance-1161595377 tempest-TestShelveInstance-1161595377-project-member] No VIF found with MAC fa:16:3e:f8:a3:e5, not building metadata {{(pid=75229) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 10:05:08 user nova-compute[75229]: DEBUG nova.compute.provider_tree [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Inventory has not changed in ProviderTree for provider: d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 {{(pid=75229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 10:05:08 user nova-compute[75229]: DEBUG nova.scheduler.client.report [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Inventory has not changed for provider d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 10:05:08 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Compute_service record updated for user:user {{(pid=75229) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 10:05:08 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.437s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:05:09 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:05:09 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:05:09 user nova-compute[75229]: DEBUG nova.compute.manager [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75229) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 10:05:09 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:05:09 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:05:09 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:05:09 user nova-compute[75229]: DEBUG nova.compute.manager [req-bb6b6eb3-9fab-496f-b5ee-b7b649ffc603 req-9cffd8ae-1227-48e6-b2e1-241b92c9474c service nova] [instance: abe7e145-d3bc-49a1-83be-793488de828b] Received event network-vif-plugged-fe62c72a-f69b-4109-bfa3-e4a51fa43d0e {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 10:05:09 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-bb6b6eb3-9fab-496f-b5ee-b7b649ffc603 req-9cffd8ae-1227-48e6-b2e1-241b92c9474c service nova] Acquiring lock "abe7e145-d3bc-49a1-83be-793488de828b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:05:09 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-bb6b6eb3-9fab-496f-b5ee-b7b649ffc603 req-9cffd8ae-1227-48e6-b2e1-241b92c9474c service nova] Lock "abe7e145-d3bc-49a1-83be-793488de828b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:05:09 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-bb6b6eb3-9fab-496f-b5ee-b7b649ffc603 req-9cffd8ae-1227-48e6-b2e1-241b92c9474c service nova] Lock "abe7e145-d3bc-49a1-83be-793488de828b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:05:09 user nova-compute[75229]: DEBUG nova.compute.manager [req-bb6b6eb3-9fab-496f-b5ee-b7b649ffc603 req-9cffd8ae-1227-48e6-b2e1-241b92c9474c service nova] [instance: abe7e145-d3bc-49a1-83be-793488de828b] No waiting events found dispatching network-vif-plugged-fe62c72a-f69b-4109-bfa3-e4a51fa43d0e {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 10:05:09 user nova-compute[75229]: WARNING nova.compute.manager [req-bb6b6eb3-9fab-496f-b5ee-b7b649ffc603 req-9cffd8ae-1227-48e6-b2e1-241b92c9474c service nova] [instance: abe7e145-d3bc-49a1-83be-793488de828b] Received unexpected event network-vif-plugged-fe62c72a-f69b-4109-bfa3-e4a51fa43d0e for instance with vm_state shelved_offloaded and task_state spawning.
Nov 14 10:05:09 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:05:09 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:05:09 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:05:09 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:05:10 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:05:11 user nova-compute[75229]: DEBUG nova.compute.manager [None req-19112987-8fcf-4309-89ce-fd119c195a72 tempest-TestShelveInstance-1161595377 tempest-TestShelveInstance-1161595377-project-member] [instance: abe7e145-d3bc-49a1-83be-793488de828b] Instance event wait completed in 0 seconds for  {{(pid=75229) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 10:05:11 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-19112987-8fcf-4309-89ce-fd119c195a72 tempest-TestShelveInstance-1161595377 tempest-TestShelveInstance-1161595377-project-member] [instance: abe7e145-d3bc-49a1-83be-793488de828b] Guest created on hypervisor {{(pid=75229) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 10:05:11 user nova-compute[75229]: INFO nova.virt.libvirt.driver [-] [instance: abe7e145-d3bc-49a1-83be-793488de828b] Instance spawned successfully.
Nov 14 10:05:11 user nova-compute[75229]: DEBUG nova.compute.manager [None req-19112987-8fcf-4309-89ce-fd119c195a72 tempest-TestShelveInstance-1161595377 tempest-TestShelveInstance-1161595377-project-member] [instance: abe7e145-d3bc-49a1-83be-793488de828b] Checking state {{(pid=75229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 10:05:11 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-19112987-8fcf-4309-89ce-fd119c195a72 tempest-TestShelveInstance-1161595377 tempest-TestShelveInstance-1161595377-project-member] Lock "abe7e145-d3bc-49a1-83be-793488de828b" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 11.760s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:05:11 user nova-compute[75229]: DEBUG nova.compute.manager [req-e847b3d9-1256-4d19-83d6-aecac4b600e5 req-86191043-948d-462c-b70b-1e98094b2ecc service nova] [instance: abe7e145-d3bc-49a1-83be-793488de828b] Received event network-vif-plugged-fe62c72a-f69b-4109-bfa3-e4a51fa43d0e {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 10:05:11 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-e847b3d9-1256-4d19-83d6-aecac4b600e5 req-86191043-948d-462c-b70b-1e98094b2ecc service nova] Acquiring lock "abe7e145-d3bc-49a1-83be-793488de828b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:05:11 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-e847b3d9-1256-4d19-83d6-aecac4b600e5 req-86191043-948d-462c-b70b-1e98094b2ecc service nova] Lock "abe7e145-d3bc-49a1-83be-793488de828b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:05:11 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-e847b3d9-1256-4d19-83d6-aecac4b600e5 req-86191043-948d-462c-b70b-1e98094b2ecc service nova] Lock "abe7e145-d3bc-49a1-83be-793488de828b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:05:11 user nova-compute[75229]: DEBUG nova.compute.manager [req-e847b3d9-1256-4d19-83d6-aecac4b600e5 req-86191043-948d-462c-b70b-1e98094b2ecc service nova] [instance: abe7e145-d3bc-49a1-83be-793488de828b] No waiting events found dispatching network-vif-plugged-fe62c72a-f69b-4109-bfa3-e4a51fa43d0e {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 10:05:11 user nova-compute[75229]: WARNING nova.compute.manager [req-e847b3d9-1256-4d19-83d6-aecac4b600e5 req-86191043-948d-462c-b70b-1e98094b2ecc service nova] [instance: abe7e145-d3bc-49a1-83be-793488de828b] Received unexpected event network-vif-plugged-fe62c72a-f69b-4109-bfa3-e4a51fa43d0e for instance with vm_state active and task_state None.
Nov 14 10:05:12 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:05:13 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:05:14 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-793460a4-9005-4a85-8aef-db0df9886aed tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Acquiring lock "d822d5e4-38d8-4ca7-a682-f2f2144b6005" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:05:14 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-793460a4-9005-4a85-8aef-db0df9886aed tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Lock "d822d5e4-38d8-4ca7-a682-f2f2144b6005" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:05:14 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-793460a4-9005-4a85-8aef-db0df9886aed tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Acquiring lock "d822d5e4-38d8-4ca7-a682-f2f2144b6005-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:05:14 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-793460a4-9005-4a85-8aef-db0df9886aed tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Lock "d822d5e4-38d8-4ca7-a682-f2f2144b6005-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:05:14 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-793460a4-9005-4a85-8aef-db0df9886aed tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Lock "d822d5e4-38d8-4ca7-a682-f2f2144b6005-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:05:14 user nova-compute[75229]: INFO nova.compute.manager [None req-793460a4-9005-4a85-8aef-db0df9886aed tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] [instance: d822d5e4-38d8-4ca7-a682-f2f2144b6005] Terminating instance
Nov 14 10:05:14 user nova-compute[75229]: DEBUG nova.compute.manager [None req-793460a4-9005-4a85-8aef-db0df9886aed tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] [instance: d822d5e4-38d8-4ca7-a682-f2f2144b6005] Start destroying the instance on the hypervisor. {{(pid=75229) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 10:05:14 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:05:14 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:05:14 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:05:14 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:05:14 user nova-compute[75229]: DEBUG nova.compute.manager [req-32f687b8-46e0-4f5f-b9ee-a0823a5e2b38 req-c0b1642a-35ff-4d44-aa1e-909c6e8cd7e1 service nova] [instance: d822d5e4-38d8-4ca7-a682-f2f2144b6005] Received event network-vif-unplugged-3f756f52-9183-4c6e-b60f-3d97c69fb495 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 10:05:14 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-32f687b8-46e0-4f5f-b9ee-a0823a5e2b38 req-c0b1642a-35ff-4d44-aa1e-909c6e8cd7e1 service nova] Acquiring lock "d822d5e4-38d8-4ca7-a682-f2f2144b6005-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:05:14 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-32f687b8-46e0-4f5f-b9ee-a0823a5e2b38 req-c0b1642a-35ff-4d44-aa1e-909c6e8cd7e1 service nova] Lock "d822d5e4-38d8-4ca7-a682-f2f2144b6005-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:05:14 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-32f687b8-46e0-4f5f-b9ee-a0823a5e2b38 req-c0b1642a-35ff-4d44-aa1e-909c6e8cd7e1 service nova] Lock "d822d5e4-38d8-4ca7-a682-f2f2144b6005-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:05:14 user nova-compute[75229]: DEBUG nova.compute.manager [req-32f687b8-46e0-4f5f-b9ee-a0823a5e2b38 req-c0b1642a-35ff-4d44-aa1e-909c6e8cd7e1 service nova] [instance: d822d5e4-38d8-4ca7-a682-f2f2144b6005] No waiting events found dispatching network-vif-unplugged-3f756f52-9183-4c6e-b60f-3d97c69fb495 {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 10:05:14 user nova-compute[75229]: DEBUG nova.compute.manager [req-32f687b8-46e0-4f5f-b9ee-a0823a5e2b38 req-c0b1642a-35ff-4d44-aa1e-909c6e8cd7e1 service nova] [instance: d822d5e4-38d8-4ca7-a682-f2f2144b6005] Received event network-vif-unplugged-3f756f52-9183-4c6e-b60f-3d97c69fb495 for instance with task_state deleting. {{(pid=75229) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 10:05:14 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:05:14 user nova-compute[75229]: DEBUG nova.compute.manager [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75229) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 14 10:05:15 user nova-compute[75229]: INFO nova.virt.libvirt.driver [-] [instance: d822d5e4-38d8-4ca7-a682-f2f2144b6005] Instance destroyed successfully.
Nov 14 10:05:15 user nova-compute[75229]: DEBUG nova.objects.instance [None req-793460a4-9005-4a85-8aef-db0df9886aed tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Lazy-loading 'resources' on Instance uuid d822d5e4-38d8-4ca7-a682-f2f2144b6005 {{(pid=75229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 10:05:15 user nova-compute[75229]: DEBUG nova.virt.libvirt.vif [None req-793460a4-9005-4a85-8aef-db0df9886aed tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T10:00:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1599799090',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1599799090',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1599799090',id=38,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL/Fx+ZqkknLgNPJ2yVd0tCjEVNGsbcpxMVwrZi/JJJlfpTSFfkoclUYXmNoXHeiNcE9pe2+U6gpoOkPULo7ZUsGfqSEpaen603sif45gUXHgSucQ6kfx+AWEHlsj1z7Fg==',key_name='tempest-keypair-739982694',keypairs=<?>,launch_index=0,launched_at=2023-11-14T10:00:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='46620ac128944703899f22fe5439ba26',ramdisk_id='',reservation_id='r-rvtr1vr3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-2064993142',owner_user_name='tempest-TestVolumeBootPattern-2064993142-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T10:00:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c26f33e4cdf14ba796445959953f8685',uuid=d822d5e4-38d8-4ca7-a682-f2f2144b6005,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3f756f52-9183-4c6e-b60f-3d97c69fb495", "address": "fa:16:3e:94:54:20", "network": {"id": "118ea7c1-77c0-4660-b7b7-f311f6b0ec8a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1907578504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.10", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46620ac128944703899f22fe5439ba26", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f756f52-91", "ovs_interfaceid": "3f756f52-9183-4c6e-b60f-3d97c69fb495", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 10:05:15 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-793460a4-9005-4a85-8aef-db0df9886aed tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Converting VIF {"id": "3f756f52-9183-4c6e-b60f-3d97c69fb495", "address": "fa:16:3e:94:54:20", "network": {"id": "118ea7c1-77c0-4660-b7b7-f311f6b0ec8a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1907578504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.10", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46620ac128944703899f22fe5439ba26", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f756f52-91", "ovs_interfaceid": "3f756f52-9183-4c6e-b60f-3d97c69fb495", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 10:05:15 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-793460a4-9005-4a85-8aef-db0df9886aed tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:94:54:20,bridge_name='br-int',has_traffic_filtering=True,id=3f756f52-9183-4c6e-b60f-3d97c69fb495,network=Network(118ea7c1-77c0-4660-b7b7-f311f6b0ec8a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3f756f52-91') {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 10:05:15 user nova-compute[75229]: DEBUG os_vif [None req-793460a4-9005-4a85-8aef-db0df9886aed tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:94:54:20,bridge_name='br-int',has_traffic_filtering=True,id=3f756f52-9183-4c6e-b60f-3d97c69fb495,network=Network(118ea7c1-77c0-4660-b7b7-f311f6b0ec8a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3f756f52-91') {{(pid=75229) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 10:05:15 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:05:15 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3f756f52-91, bridge=br-int, if_exists=True) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 10:05:15 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:05:15 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:05:15 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:05:15 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=664be255-d3a0-45d4-8eec-f0762117f9c4) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 10:05:15 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:05:15 user nova-compute[75229]: INFO os_vif [None req-793460a4-9005-4a85-8aef-db0df9886aed tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:94:54:20,bridge_name='br-int',has_traffic_filtering=True,id=3f756f52-9183-4c6e-b60f-3d97c69fb495,network=Network(118ea7c1-77c0-4660-b7b7-f311f6b0ec8a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3f756f52-91')
Nov 14 10:05:15 user nova-compute[75229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-793460a4-9005-4a85-8aef-db0df9886aed tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] [instance: d822d5e4-38d8-4ca7-a682-f2f2144b6005] calling os-brick to detach iSCSI Volume {{(pid=75229) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 10:05:15 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-793460a4-9005-4a85-8aef-db0df9886aed tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f73f85151b0>, {'target_iqn': 'iqn.2010-10.org.openstack:2977635e-b11f-4ab2-875c-e9f396b932dc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VaSGPUnJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 10:05:15 user nova-compute[75229]: WARNING os_brick.initiator.connectors.base [None req-793460a4-9005-4a85-8aef-db0df9886aed tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 10:05:15 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-793460a4-9005-4a85-8aef-db0df9886aed tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 10:05:15 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-793460a4-9005-4a85-8aef-db0df9886aed tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 10:05:15 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:05:15 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:05:15 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc60078f-bd09-4a52-8886-6628eca3cc2b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2977635e-b11f-4ab2-875c-e9f396b932dc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4ddb200b-47ca-4449-9973-be76424a6761\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5aebc438-0289-44fe-ad84-4e696468f50e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e4a6dca6-1581-494f-afe5-3aac2b4d2c15\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:05:15 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-793460a4-9005-4a85-8aef-db0df9886aed tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 10:05:15 user nova-compute[75229]: No targets found.
Nov 14 10:05:15 user nova-compute[75229]: iSNS:
Nov 14 10:05:15 user nova-compute[75229]: No targets found.
Nov 14 10:05:15 user nova-compute[75229]: STATIC:
Nov 14 10:05:15 user nova-compute[75229]: Target: iqn.2010-10.org.openstack:2977635e-b11f-4ab2-875c-e9f396b932dc
Nov 14 10:05:15 user nova-compute[75229]:         Portal: 172.16.0.220:3260,-1
Nov 14 10:05:15 user nova-compute[75229]:                 Iface Name: default
Nov 14 10:05:15 user nova-compute[75229]: Target: iqn.2010-10.org.openstack:4ddb200b-47ca-4449-9973-be76424a6761
Nov 14 10:05:15 user nova-compute[75229]:         Portal: 172.16.0.220:3260,-1
Nov 14 10:05:15 user nova-compute[75229]:                 Iface Name: default
Nov 14 10:05:15 user nova-compute[75229]: Target: iqn.2010-10.org.openstack:5aebc438-0289-44fe-ad84-4e696468f50e
Nov 14 10:05:15 user nova-compute[75229]:         Portal: 172.16.0.220:3260,-1
Nov 14 10:05:15 user nova-compute[75229]:                 Iface Name: default
Nov 14 10:05:15 user nova-compute[75229]: Target: iqn.2010-10.org.openstack:e4a6dca6-1581-494f-afe5-3aac2b4d2c15
Nov 14 10:05:15 user nova-compute[75229]:         Portal: 172.16.0.220:3260,-1
Nov 14 10:05:15 user nova-compute[75229]:                 Iface Name: default
Nov 14 10:05:15 user nova-compute[75229]: FIRMWARE:
Nov 14 10:05:15 user nova-compute[75229]: No targets found.
Nov 14 10:05:15 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 10:05:15 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-793460a4-9005-4a85-8aef-db0df9886aed tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 10:05:15 user nova-compute[75229]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 10:05:15 user nova-compute[75229]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75229) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 10:05:15 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-793460a4-9005-4a85-8aef-db0df9886aed tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2977635e-b11f-4ab2-875c-e9f396b932dc', 0)] {{(pid=75229) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 10:05:15 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:05:15 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:05:15 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2bdf4cf-1753-40ef-9a2c-6863197b9afc]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2977635e-b11f-4ab2-875c-e9f396b932dc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4ddb200b-47ca-4449-9973-be76424a6761\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5aebc438-0289-44fe-ad84-4e696468f50e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e4a6dca6-1581-494f-afe5-3aac2b4d2c15\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:05:15 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:05:15 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:05:15 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[94eebb60-5711-48e8-9a04-110d63f6e7f8]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aebc438-0289-44fe-ad84-4e696468f50e (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2977635e-b11f-4ab2-875c-e9f396b932dc (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ddb200b-47ca-4449-9973-be76424a6761 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4a6dca6-1581-494f-afe5-3aac2b4d2c15 (non-flash)\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:05:15 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-793460a4-9005-4a85-8aef-db0df9886aed tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aebc438-0289-44fe-ad84-4e696468f50e (non-flash)
Nov 14 10:05:15 user nova-compute[75229]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2977635e-b11f-4ab2-875c-e9f396b932dc (non-flash)
Nov 14 10:05:15 user nova-compute[75229]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ddb200b-47ca-4449-9973-be76424a6761 (non-flash)
Nov 14 10:05:15 user nova-compute[75229]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4a6dca6-1581-494f-afe5-3aac2b4d2c15 (non-flash)
Nov 14 10:05:15 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 10:05:15 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-793460a4-9005-4a85-8aef-db0df9886aed tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aebc438-0289-44fe-ad84-4e696468f50e (non-flash)
Nov 14 10:05:15 user nova-compute[75229]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2977635e-b11f-4ab2-875c-e9f396b932dc (non-flash)
Nov 14 10:05:15 user nova-compute[75229]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ddb200b-47ca-4449-9973-be76424a6761 (non-flash)
Nov 14 10:05:15 user nova-compute[75229]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4a6dca6-1581-494f-afe5-3aac2b4d2c15 (non-flash)
Nov 14 10:05:15 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 10:05:15 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-793460a4-9005-4a85-8aef-db0df9886aed tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f73d4f5dc60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2977635e-b11f-4ab2-875c-e9f396b932dc'): ({'sde'}, set())}) {{(pid=75229) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 10:05:15 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-793460a4-9005-4a85-8aef-db0df9886aed tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Removing single pathed devices sde {{(pid=75229) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 10:05:15 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:05:15 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:05:15 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d5789d6-3144-422b-8173-d6192ea93115]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:05:15 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:05:15 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:05:15 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[7faa3bff-e720-4924-a5a2-c2dee7929441]: (4, ('ok\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:05:15 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-793460a4-9005-4a85-8aef-db0df9886aed tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Flushing IO for device /dev/sde {{(pid=75229) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 10:05:15 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:05:15 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.016s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:05:15 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[7881d7e8-0ce8-4a89-930f-4eccf2c9da35]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:05:15 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-793460a4-9005-4a85-8aef-db0df9886aed tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75229) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 10:05:15 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:05:15 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.053s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:05:15 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[29cfe697-2502-44c6-801a-1caf93256f1a]: (4, ('1', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:05:15 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-793460a4-9005-4a85-8aef-db0df9886aed tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75229) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 10:05:15 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-793460a4-9005-4a85-8aef-db0df9886aed tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] SCSI volumes sde have been removed. {{(pid=75229) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 10:05:15 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-793460a4-9005-4a85-8aef-db0df9886aed tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2977635e-b11f-4ab2-875c-e9f396b932dc')] {{(pid=75229) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 10:05:15 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2977635e-b11f-4ab2-875c-e9f396b932dc -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:05:15 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2977635e-b11f-4ab2-875c-e9f396b932dc -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:05:15 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[d04e1153-04c3-4908-ac65-806b69d139ad]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:05:15 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-793460a4-9005-4a85-8aef-db0df9886aed tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 10:05:15 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2977635e-b11f-4ab2-875c-e9f396b932dc -p 172.16.0.220:3260 --logout {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:05:15 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2977635e-b11f-4ab2-875c-e9f396b932dc -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:05:15 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[40e4fe8a-d09f-4e39-a3cb-5ca54887e54f]: (4, ('Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:2977635e-b11f-4ab2-875c-e9f396b932dc, portal: 172.16.0.220,3260]\nLogout of [sid: 40, target: iqn.2010-10.org.openstack:2977635e-b11f-4ab2-875c-e9f396b932dc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:05:15 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-793460a4-9005-4a85-8aef-db0df9886aed tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:2977635e-b11f-4ab2-875c-e9f396b932dc, portal: 172.16.0.220,3260]
Nov 14 10:05:15 user nova-compute[75229]: Logout of [sid: 40, target: iqn.2010-10.org.openstack:2977635e-b11f-4ab2-875c-e9f396b932dc, portal: 172.16.0.220,3260] successful.
Nov 14 10:05:15 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 10:05:15 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2977635e-b11f-4ab2-875c-e9f396b932dc -p 172.16.0.220:3260 --op delete {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:05:15 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2977635e-b11f-4ab2-875c-e9f396b932dc -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:05:15 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0429c21-dd4d-4b93-8e07-c86fc5f77cfb]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:05:15 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-793460a4-9005-4a85-8aef-db0df9886aed tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 10:05:15 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-793460a4-9005-4a85-8aef-db0df9886aed tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.335s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 10:05:15 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-793460a4-9005-4a85-8aef-db0df9886aed tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] <== disconnect_volume: return (336ms) None {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 10:05:15 user nova-compute[75229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-793460a4-9005-4a85-8aef-db0df9886aed tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] [instance: d822d5e4-38d8-4ca7-a682-f2f2144b6005] Disconnected iSCSI Volume {{(pid=75229) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 10:05:15 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-793460a4-9005-4a85-8aef-db0df9886aed tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] [instance: d822d5e4-38d8-4ca7-a682-f2f2144b6005] Deleting instance files /opt/stack/data/nova/instances/d822d5e4-38d8-4ca7-a682-f2f2144b6005_del
Nov 14 10:05:15 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-793460a4-9005-4a85-8aef-db0df9886aed tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] [instance: d822d5e4-38d8-4ca7-a682-f2f2144b6005] Deletion of /opt/stack/data/nova/instances/d822d5e4-38d8-4ca7-a682-f2f2144b6005_del complete
Nov 14 10:05:15 user nova-compute[75229]: INFO nova.compute.manager [None req-793460a4-9005-4a85-8aef-db0df9886aed tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] [instance: d822d5e4-38d8-4ca7-a682-f2f2144b6005] Took 1.19 seconds to destroy the instance on the hypervisor.
Nov 14 10:05:15 user nova-compute[75229]: DEBUG oslo.service.loopingcall [None req-793460a4-9005-4a85-8aef-db0df9886aed tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75229) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 10:05:15 user nova-compute[75229]: DEBUG nova.compute.manager [-] [instance: d822d5e4-38d8-4ca7-a682-f2f2144b6005] Deallocating network for instance {{(pid=75229) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 10:05:15 user nova-compute[75229]: DEBUG nova.network.neutron [-] [instance: d822d5e4-38d8-4ca7-a682-f2f2144b6005] deallocate_for_instance() {{(pid=75229) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 10:05:16 user nova-compute[75229]: DEBUG nova.network.neutron [-] [instance: d822d5e4-38d8-4ca7-a682-f2f2144b6005] Updating instance_info_cache with network_info: [] {{(pid=75229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 10:05:16 user nova-compute[75229]: INFO nova.compute.manager [-] [instance: d822d5e4-38d8-4ca7-a682-f2f2144b6005] Took 0.63 seconds to deallocate network for instance.
Nov 14 10:05:16 user nova-compute[75229]: DEBUG nova.compute.manager [req-d830b59c-ce19-4576-8153-03295a769afe req-ecc4f973-1970-458e-b554-55b6d3da4943 service nova] [instance: d822d5e4-38d8-4ca7-a682-f2f2144b6005] Received event network-vif-deleted-3f756f52-9183-4c6e-b60f-3d97c69fb495 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 10:05:16 user nova-compute[75229]: INFO nova.compute.manager [req-d830b59c-ce19-4576-8153-03295a769afe req-ecc4f973-1970-458e-b554-55b6d3da4943 service nova] [instance: d822d5e4-38d8-4ca7-a682-f2f2144b6005] Neutron deleted interface 3f756f52-9183-4c6e-b60f-3d97c69fb495; detaching it from the instance and deleting it from the info cache
Nov 14 10:05:16 user nova-compute[75229]: DEBUG nova.network.neutron [req-d830b59c-ce19-4576-8153-03295a769afe req-ecc4f973-1970-458e-b554-55b6d3da4943 service nova] [instance: d822d5e4-38d8-4ca7-a682-f2f2144b6005] Updating instance_info_cache with network_info: [] {{(pid=75229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 10:05:16 user nova-compute[75229]: DEBUG nova.compute.manager [req-d830b59c-ce19-4576-8153-03295a769afe req-ecc4f973-1970-458e-b554-55b6d3da4943 service nova] [instance: d822d5e4-38d8-4ca7-a682-f2f2144b6005] Detach interface failed, port_id=3f756f52-9183-4c6e-b60f-3d97c69fb495, reason: Instance d822d5e4-38d8-4ca7-a682-f2f2144b6005 could not be found. {{(pid=75229) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 14 10:05:16 user nova-compute[75229]: DEBUG nova.compute.manager [req-4487a949-30f5-4f8c-b206-70c5690dcbdc req-4fd11345-47c9-466f-b1ca-eff668fd9515 service nova] [instance: d822d5e4-38d8-4ca7-a682-f2f2144b6005] Received event network-vif-plugged-3f756f52-9183-4c6e-b60f-3d97c69fb495 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 10:05:16 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-4487a949-30f5-4f8c-b206-70c5690dcbdc req-4fd11345-47c9-466f-b1ca-eff668fd9515 service nova] Acquiring lock "d822d5e4-38d8-4ca7-a682-f2f2144b6005-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:05:16 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-4487a949-30f5-4f8c-b206-70c5690dcbdc req-4fd11345-47c9-466f-b1ca-eff668fd9515 service nova] Lock "d822d5e4-38d8-4ca7-a682-f2f2144b6005-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:05:16 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-4487a949-30f5-4f8c-b206-70c5690dcbdc req-4fd11345-47c9-466f-b1ca-eff668fd9515 service nova] Lock "d822d5e4-38d8-4ca7-a682-f2f2144b6005-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:05:16 user nova-compute[75229]: DEBUG nova.compute.manager [req-4487a949-30f5-4f8c-b206-70c5690dcbdc req-4fd11345-47c9-466f-b1ca-eff668fd9515 service nova] [instance: d822d5e4-38d8-4ca7-a682-f2f2144b6005] No waiting events found dispatching network-vif-plugged-3f756f52-9183-4c6e-b60f-3d97c69fb495 {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 10:05:16 user nova-compute[75229]: WARNING nova.compute.manager [req-4487a949-30f5-4f8c-b206-70c5690dcbdc req-4fd11345-47c9-466f-b1ca-eff668fd9515 service nova] [instance: d822d5e4-38d8-4ca7-a682-f2f2144b6005] Received unexpected event network-vif-plugged-3f756f52-9183-4c6e-b60f-3d97c69fb495 for instance with vm_state active and task_state deleting.
Nov 14 10:05:16 user nova-compute[75229]: INFO nova.compute.manager [None req-793460a4-9005-4a85-8aef-db0df9886aed tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] [instance: d822d5e4-38d8-4ca7-a682-f2f2144b6005] Took 0.88 seconds to detach 1 volumes for instance.
Nov 14 10:05:16 user nova-compute[75229]: DEBUG nova.compute.manager [None req-793460a4-9005-4a85-8aef-db0df9886aed tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] [instance: d822d5e4-38d8-4ca7-a682-f2f2144b6005] Deleting volume: 2977635e-b11f-4ab2-875c-e9f396b932dc {{(pid=75229) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 14 10:05:17 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-793460a4-9005-4a85-8aef-db0df9886aed tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:05:17 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-793460a4-9005-4a85-8aef-db0df9886aed tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:05:17 user nova-compute[75229]: DEBUG nova.compute.provider_tree [None req-793460a4-9005-4a85-8aef-db0df9886aed tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Inventory has not changed in ProviderTree for provider: d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 {{(pid=75229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 10:05:17 user nova-compute[75229]: DEBUG nova.scheduler.client.report [None req-793460a4-9005-4a85-8aef-db0df9886aed tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Inventory has not changed for provider d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 10:05:17 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-793460a4-9005-4a85-8aef-db0df9886aed tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.274s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:05:17 user nova-compute[75229]: INFO nova.scheduler.client.report [None req-793460a4-9005-4a85-8aef-db0df9886aed tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Deleted allocations for instance d822d5e4-38d8-4ca7-a682-f2f2144b6005
Nov 14 10:05:17 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-793460a4-9005-4a85-8aef-db0df9886aed tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Lock "d822d5e4-38d8-4ca7-a682-f2f2144b6005" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.190s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:05:17 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-de6d5925-0597-4180-b7f8-f7a598ddad53 tempest-VolumesNegativeTest-186454050 tempest-VolumesNegativeTest-186454050-project-member] Acquiring lock "de62e75a-207e-4aa3-a592-52f48577c2b9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:05:17 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-de6d5925-0597-4180-b7f8-f7a598ddad53 tempest-VolumesNegativeTest-186454050 tempest-VolumesNegativeTest-186454050-project-member] Lock "de62e75a-207e-4aa3-a592-52f48577c2b9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:05:17 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-de6d5925-0597-4180-b7f8-f7a598ddad53 tempest-VolumesNegativeTest-186454050 tempest-VolumesNegativeTest-186454050-project-member] Acquiring lock "de62e75a-207e-4aa3-a592-52f48577c2b9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:05:17 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-de6d5925-0597-4180-b7f8-f7a598ddad53 tempest-VolumesNegativeTest-186454050 tempest-VolumesNegativeTest-186454050-project-member] Lock "de62e75a-207e-4aa3-a592-52f48577c2b9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:05:17 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-de6d5925-0597-4180-b7f8-f7a598ddad53 tempest-VolumesNegativeTest-186454050 tempest-VolumesNegativeTest-186454050-project-member] Lock "de62e75a-207e-4aa3-a592-52f48577c2b9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:05:17 user nova-compute[75229]: INFO nova.compute.manager [None req-de6d5925-0597-4180-b7f8-f7a598ddad53 tempest-VolumesNegativeTest-186454050 tempest-VolumesNegativeTest-186454050-project-member] [instance: de62e75a-207e-4aa3-a592-52f48577c2b9] Terminating instance
Nov 14 10:05:17 user nova-compute[75229]: DEBUG nova.compute.manager [None req-de6d5925-0597-4180-b7f8-f7a598ddad53 tempest-VolumesNegativeTest-186454050 tempest-VolumesNegativeTest-186454050-project-member] [instance: de62e75a-207e-4aa3-a592-52f48577c2b9] Start destroying the instance on the hypervisor. {{(pid=75229) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 10:05:17 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:05:17 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:05:17 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:05:17 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:05:18 user nova-compute[75229]: DEBUG nova.compute.manager [req-18a00f29-b27e-448e-84b9-6a678757b3a5 req-e58eeff3-3b02-4d56-be03-75d15b7f11e2 service nova] [instance: de62e75a-207e-4aa3-a592-52f48577c2b9] Received event network-vif-unplugged-f9fd5735-8c69-47ca-ab17-2461bf22a2bc {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 10:05:18 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-18a00f29-b27e-448e-84b9-6a678757b3a5 req-e58eeff3-3b02-4d56-be03-75d15b7f11e2 service nova] Acquiring lock "de62e75a-207e-4aa3-a592-52f48577c2b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:05:18 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-18a00f29-b27e-448e-84b9-6a678757b3a5 req-e58eeff3-3b02-4d56-be03-75d15b7f11e2 service nova] Lock "de62e75a-207e-4aa3-a592-52f48577c2b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:05:18 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-18a00f29-b27e-448e-84b9-6a678757b3a5 req-e58eeff3-3b02-4d56-be03-75d15b7f11e2 service nova] Lock "de62e75a-207e-4aa3-a592-52f48577c2b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:05:18 user nova-compute[75229]: DEBUG nova.compute.manager [req-18a00f29-b27e-448e-84b9-6a678757b3a5 req-e58eeff3-3b02-4d56-be03-75d15b7f11e2 service nova] [instance: de62e75a-207e-4aa3-a592-52f48577c2b9] No waiting events found dispatching network-vif-unplugged-f9fd5735-8c69-47ca-ab17-2461bf22a2bc {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 10:05:18 user nova-compute[75229]: DEBUG nova.compute.manager [req-18a00f29-b27e-448e-84b9-6a678757b3a5 req-e58eeff3-3b02-4d56-be03-75d15b7f11e2 service nova] [instance: de62e75a-207e-4aa3-a592-52f48577c2b9] Received event network-vif-unplugged-f9fd5735-8c69-47ca-ab17-2461bf22a2bc for instance with task_state deleting. {{(pid=75229) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 10:05:18 user nova-compute[75229]: INFO nova.virt.libvirt.driver [-] [instance: de62e75a-207e-4aa3-a592-52f48577c2b9] Instance destroyed successfully.
Nov 14 10:05:18 user nova-compute[75229]: DEBUG nova.objects.instance [None req-de6d5925-0597-4180-b7f8-f7a598ddad53 tempest-VolumesNegativeTest-186454050 tempest-VolumesNegativeTest-186454050-project-member] Lazy-loading 'resources' on Instance uuid de62e75a-207e-4aa3-a592-52f48577c2b9 {{(pid=75229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 10:05:18 user nova-compute[75229]: DEBUG nova.virt.libvirt.vif [None req-de6d5925-0597-4180-b7f8-f7a598ddad53 tempest-VolumesNegativeTest-186454050 tempest-VolumesNegativeTest-186454050-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T10:03:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-809592276',display_name='tempest-VolumesNegativeTest-instance-809592276',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-809592276',id=43,image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-14T10:03:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b47a87b353824259be3f2bc2a9b3c0c3',ramdisk_id='',reservation_id='r-ra043shb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesNegativeTest-186454050',owner_user_name='tempest-VolumesNegativeTest-186454050-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T10:03:34Z,user_data=None,user_id='404095151f914441bc37c25126bc533a',uuid=de62e75a-207e-4aa3-a592-52f48577c2b9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f9fd5735-8c69-47ca-ab17-2461bf22a2bc", "address": "fa:16:3e:8b:8b:54", "network": {"id": "f6b0322a-9240-4814-9056-7fabc91b097a", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.76", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "de5a91106b6948ed937a7178ff9464c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9fd5735-8c", "ovs_interfaceid": "f9fd5735-8c69-47ca-ab17-2461bf22a2bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 10:05:18 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-de6d5925-0597-4180-b7f8-f7a598ddad53 tempest-VolumesNegativeTest-186454050 tempest-VolumesNegativeTest-186454050-project-member] Converting VIF {"id": "f9fd5735-8c69-47ca-ab17-2461bf22a2bc", "address": "fa:16:3e:8b:8b:54", "network": {"id": "f6b0322a-9240-4814-9056-7fabc91b097a", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.76", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "de5a91106b6948ed937a7178ff9464c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9fd5735-8c", "ovs_interfaceid": "f9fd5735-8c69-47ca-ab17-2461bf22a2bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 10:05:18 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-de6d5925-0597-4180-b7f8-f7a598ddad53 tempest-VolumesNegativeTest-186454050 tempest-VolumesNegativeTest-186454050-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8b:8b:54,bridge_name='br-int',has_traffic_filtering=True,id=f9fd5735-8c69-47ca-ab17-2461bf22a2bc,network=Network(f6b0322a-9240-4814-9056-7fabc91b097a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9fd5735-8c') {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 10:05:18 user nova-compute[75229]: DEBUG os_vif [None req-de6d5925-0597-4180-b7f8-f7a598ddad53 tempest-VolumesNegativeTest-186454050 tempest-VolumesNegativeTest-186454050-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8b:8b:54,bridge_name='br-int',has_traffic_filtering=True,id=f9fd5735-8c69-47ca-ab17-2461bf22a2bc,network=Network(f6b0322a-9240-4814-9056-7fabc91b097a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9fd5735-8c') {{(pid=75229) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 10:05:18 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:05:18 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf9fd5735-8c, bridge=br-int, if_exists=True) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 10:05:18 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:05:18 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 10:05:18 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:05:18 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=909ca202-8e56-4821-8b04-06f0d8aacc1d) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 10:05:18 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:05:18 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:05:18 user nova-compute[75229]: INFO os_vif [None req-de6d5925-0597-4180-b7f8-f7a598ddad53 tempest-VolumesNegativeTest-186454050 tempest-VolumesNegativeTest-186454050-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8b:8b:54,bridge_name='br-int',has_traffic_filtering=True,id=f9fd5735-8c69-47ca-ab17-2461bf22a2bc,network=Network(f6b0322a-9240-4814-9056-7fabc91b097a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9fd5735-8c')
Nov 14 10:05:18 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-de6d5925-0597-4180-b7f8-f7a598ddad53 tempest-VolumesNegativeTest-186454050 tempest-VolumesNegativeTest-186454050-project-member] [instance: de62e75a-207e-4aa3-a592-52f48577c2b9] Deleting instance files /opt/stack/data/nova/instances/de62e75a-207e-4aa3-a592-52f48577c2b9_del
Nov 14 10:05:18 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-de6d5925-0597-4180-b7f8-f7a598ddad53 tempest-VolumesNegativeTest-186454050 tempest-VolumesNegativeTest-186454050-project-member] [instance: de62e75a-207e-4aa3-a592-52f48577c2b9] Deletion of /opt/stack/data/nova/instances/de62e75a-207e-4aa3-a592-52f48577c2b9_del complete
Nov 14 10:05:18 user nova-compute[75229]: INFO nova.compute.manager [None req-de6d5925-0597-4180-b7f8-f7a598ddad53 tempest-VolumesNegativeTest-186454050 tempest-VolumesNegativeTest-186454050-project-member] [instance: de62e75a-207e-4aa3-a592-52f48577c2b9] Took 0.75 seconds to destroy the instance on the hypervisor.
Nov 14 10:05:18 user nova-compute[75229]: DEBUG oslo.service.loopingcall [None req-de6d5925-0597-4180-b7f8-f7a598ddad53 tempest-VolumesNegativeTest-186454050 tempest-VolumesNegativeTest-186454050-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75229) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 10:05:18 user nova-compute[75229]: DEBUG nova.compute.manager [-] [instance: de62e75a-207e-4aa3-a592-52f48577c2b9] Deallocating network for instance {{(pid=75229) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 10:05:18 user nova-compute[75229]: DEBUG nova.network.neutron [-] [instance: de62e75a-207e-4aa3-a592-52f48577c2b9] deallocate_for_instance() {{(pid=75229) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 10:05:18 user nova-compute[75229]: DEBUG nova.network.neutron [-] [instance: de62e75a-207e-4aa3-a592-52f48577c2b9] Updating instance_info_cache with network_info: [] {{(pid=75229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 10:05:18 user nova-compute[75229]: INFO nova.compute.manager [-] [instance: de62e75a-207e-4aa3-a592-52f48577c2b9] Took 0.46 seconds to deallocate network for instance.
Nov 14 10:05:18 user nova-compute[75229]: DEBUG nova.compute.manager [req-a4d6aee2-744c-4c97-be7f-0b747b1edc48 req-c3b46580-3896-4abf-8217-1c0692f07f27 service nova] [instance: de62e75a-207e-4aa3-a592-52f48577c2b9] Received event network-vif-deleted-f9fd5735-8c69-47ca-ab17-2461bf22a2bc {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 10:05:18 user nova-compute[75229]: INFO nova.compute.manager [req-a4d6aee2-744c-4c97-be7f-0b747b1edc48 req-c3b46580-3896-4abf-8217-1c0692f07f27 service nova] [instance: de62e75a-207e-4aa3-a592-52f48577c2b9] Neutron deleted interface f9fd5735-8c69-47ca-ab17-2461bf22a2bc; detaching it from the instance and deleting it from the info cache
Nov 14 10:05:18 user nova-compute[75229]: DEBUG nova.network.neutron [req-a4d6aee2-744c-4c97-be7f-0b747b1edc48 req-c3b46580-3896-4abf-8217-1c0692f07f27 service nova] [instance: de62e75a-207e-4aa3-a592-52f48577c2b9] Updating instance_info_cache with network_info: [] {{(pid=75229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 10:05:19 user nova-compute[75229]: DEBUG nova.compute.manager [req-a4d6aee2-744c-4c97-be7f-0b747b1edc48 req-c3b46580-3896-4abf-8217-1c0692f07f27 service nova] [instance: de62e75a-207e-4aa3-a592-52f48577c2b9] Detach interface failed, port_id=f9fd5735-8c69-47ca-ab17-2461bf22a2bc, reason: Instance de62e75a-207e-4aa3-a592-52f48577c2b9 could not be found. {{(pid=75229) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 14 10:05:19 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-de6d5925-0597-4180-b7f8-f7a598ddad53 tempest-VolumesNegativeTest-186454050 tempest-VolumesNegativeTest-186454050-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:05:19 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-de6d5925-0597-4180-b7f8-f7a598ddad53 tempest-VolumesNegativeTest-186454050 tempest-VolumesNegativeTest-186454050-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:05:19 user nova-compute[75229]: DEBUG nova.compute.provider_tree [None req-de6d5925-0597-4180-b7f8-f7a598ddad53 tempest-VolumesNegativeTest-186454050 tempest-VolumesNegativeTest-186454050-project-member] Inventory has not changed in ProviderTree for provider: d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 {{(pid=75229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 10:05:19 user nova-compute[75229]: DEBUG nova.scheduler.client.report [None req-de6d5925-0597-4180-b7f8-f7a598ddad53 tempest-VolumesNegativeTest-186454050 tempest-VolumesNegativeTest-186454050-project-member] Inventory has not changed for provider d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 10:05:19 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-de6d5925-0597-4180-b7f8-f7a598ddad53 tempest-VolumesNegativeTest-186454050 tempest-VolumesNegativeTest-186454050-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.250s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:05:19 user nova-compute[75229]: INFO nova.scheduler.client.report [None req-de6d5925-0597-4180-b7f8-f7a598ddad53 tempest-VolumesNegativeTest-186454050 tempest-VolumesNegativeTest-186454050-project-member] Deleted allocations for instance de62e75a-207e-4aa3-a592-52f48577c2b9
Nov 14 10:05:19 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-de6d5925-0597-4180-b7f8-f7a598ddad53 tempest-VolumesNegativeTest-186454050 tempest-VolumesNegativeTest-186454050-project-member] Lock "de62e75a-207e-4aa3-a592-52f48577c2b9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.632s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:05:20 user nova-compute[75229]: DEBUG nova.compute.manager [req-88542b6f-e766-4af9-bb2c-f27260fd4c30 req-df47929d-988a-4d32-9998-f2fdf7f12299 service nova] [instance: de62e75a-207e-4aa3-a592-52f48577c2b9] Received event network-vif-plugged-f9fd5735-8c69-47ca-ab17-2461bf22a2bc {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 10:05:20 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-88542b6f-e766-4af9-bb2c-f27260fd4c30 req-df47929d-988a-4d32-9998-f2fdf7f12299 service nova] Acquiring lock "de62e75a-207e-4aa3-a592-52f48577c2b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:05:20 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-88542b6f-e766-4af9-bb2c-f27260fd4c30 req-df47929d-988a-4d32-9998-f2fdf7f12299 service nova] Lock "de62e75a-207e-4aa3-a592-52f48577c2b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:05:20 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-88542b6f-e766-4af9-bb2c-f27260fd4c30 req-df47929d-988a-4d32-9998-f2fdf7f12299 service nova] Lock "de62e75a-207e-4aa3-a592-52f48577c2b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:05:20 user nova-compute[75229]: DEBUG nova.compute.manager [req-88542b6f-e766-4af9-bb2c-f27260fd4c30 req-df47929d-988a-4d32-9998-f2fdf7f12299 service nova] [instance: de62e75a-207e-4aa3-a592-52f48577c2b9] No waiting events found dispatching network-vif-plugged-f9fd5735-8c69-47ca-ab17-2461bf22a2bc {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 10:05:20 user nova-compute[75229]: WARNING nova.compute.manager [req-88542b6f-e766-4af9-bb2c-f27260fd4c30 req-df47929d-988a-4d32-9998-f2fdf7f12299 service nova] [instance: de62e75a-207e-4aa3-a592-52f48577c2b9] Received unexpected event network-vif-plugged-f9fd5735-8c69-47ca-ab17-2461bf22a2bc for instance with vm_state deleted and task_state None.
Nov 14 10:05:20 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-2e815009-11a2-4deb-8cd6-58327884f53c tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Acquiring lock "10d6bce1-e55f-429c-816d-3bef9029560a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:05:20 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-2e815009-11a2-4deb-8cd6-58327884f53c tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Lock "10d6bce1-e55f-429c-816d-3bef9029560a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:05:20 user nova-compute[75229]: DEBUG nova.compute.manager [None req-2e815009-11a2-4deb-8cd6-58327884f53c tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] [instance: 10d6bce1-e55f-429c-816d-3bef9029560a] Starting instance... {{(pid=75229) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 10:05:20 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-2e815009-11a2-4deb-8cd6-58327884f53c tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:05:20 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-2e815009-11a2-4deb-8cd6-58327884f53c tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:05:20 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-2e815009-11a2-4deb-8cd6-58327884f53c tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75229) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 10:05:20 user nova-compute[75229]: INFO nova.compute.claims [None req-2e815009-11a2-4deb-8cd6-58327884f53c tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] [instance: 10d6bce1-e55f-429c-816d-3bef9029560a] Claim successful on node user
Nov 14 10:05:21 user nova-compute[75229]: DEBUG nova.compute.provider_tree [None req-2e815009-11a2-4deb-8cd6-58327884f53c tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Inventory has not changed in ProviderTree for provider: d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 {{(pid=75229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 10:05:21 user nova-compute[75229]: DEBUG nova.scheduler.client.report [None req-2e815009-11a2-4deb-8cd6-58327884f53c tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Inventory has not changed for provider d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 10:05:21 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-2e815009-11a2-4deb-8cd6-58327884f53c tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.331s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:05:21 user nova-compute[75229]: DEBUG nova.compute.manager [None req-2e815009-11a2-4deb-8cd6-58327884f53c tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] [instance: 10d6bce1-e55f-429c-816d-3bef9029560a] Start building networks asynchronously for instance. {{(pid=75229) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 10:05:21 user nova-compute[75229]: DEBUG nova.compute.manager [None req-2e815009-11a2-4deb-8cd6-58327884f53c tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] [instance: 10d6bce1-e55f-429c-816d-3bef9029560a] Allocating IP information in the background. {{(pid=75229) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 10:05:21 user nova-compute[75229]: DEBUG nova.network.neutron [None req-2e815009-11a2-4deb-8cd6-58327884f53c tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] [instance: 10d6bce1-e55f-429c-816d-3bef9029560a] allocate_for_instance() {{(pid=75229) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 10:05:21 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-2e815009-11a2-4deb-8cd6-58327884f53c tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] [instance: 10d6bce1-e55f-429c-816d-3bef9029560a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 10:05:21 user nova-compute[75229]: DEBUG nova.compute.manager [None req-2e815009-11a2-4deb-8cd6-58327884f53c tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] [instance: 10d6bce1-e55f-429c-816d-3bef9029560a] Start building block device mappings for instance. {{(pid=75229) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 10:05:21 user nova-compute[75229]: INFO nova.virt.block_device [None req-2e815009-11a2-4deb-8cd6-58327884f53c tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] [instance: 10d6bce1-e55f-429c-816d-3bef9029560a] Booting with volume-backed-image 3bef8470-ecc7-40e3-95d4-9254348ea72d at /dev/vda
Nov 14 10:05:21 user nova-compute[75229]: DEBUG nova.policy [None req-2e815009-11a2-4deb-8cd6-58327884f53c tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a8825cd49e9349f28576b704c4c4d717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8babb73006da4977a1fe2bdb35e08d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75229) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 10:05:21 user nova-compute[75229]: DEBUG nova.network.neutron [None req-2e815009-11a2-4deb-8cd6-58327884f53c tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] [instance: 10d6bce1-e55f-429c-816d-3bef9029560a] Successfully created port: ea04ea8d-43a6-4f64-9e0b-cc2927f214f5 {{(pid=75229) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 10:05:22 user nova-compute[75229]: DEBUG nova.network.neutron [None req-2e815009-11a2-4deb-8cd6-58327884f53c tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] [instance: 10d6bce1-e55f-429c-816d-3bef9029560a] Successfully updated port: ea04ea8d-43a6-4f64-9e0b-cc2927f214f5 {{(pid=75229) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 10:05:22 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-2e815009-11a2-4deb-8cd6-58327884f53c tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Acquiring lock "refresh_cache-10d6bce1-e55f-429c-816d-3bef9029560a" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 10:05:22 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-2e815009-11a2-4deb-8cd6-58327884f53c tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Acquired lock "refresh_cache-10d6bce1-e55f-429c-816d-3bef9029560a" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 10:05:22 user nova-compute[75229]: DEBUG nova.network.neutron [None req-2e815009-11a2-4deb-8cd6-58327884f53c tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] [instance: 10d6bce1-e55f-429c-816d-3bef9029560a] Building network info cache for instance {{(pid=75229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 10:05:22 user nova-compute[75229]: DEBUG nova.network.neutron [None req-2e815009-11a2-4deb-8cd6-58327884f53c tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] [instance: 10d6bce1-e55f-429c-816d-3bef9029560a] Instance cache missing network info. {{(pid=75229) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 10:05:22 user nova-compute[75229]: DEBUG nova.compute.manager [req-1f8a8780-b135-48ac-8a10-a8d6ed308a4e req-f5c0e37f-4a2e-44c0-805e-f38b4f27f18c service nova] [instance: 10d6bce1-e55f-429c-816d-3bef9029560a] Received event network-changed-ea04ea8d-43a6-4f64-9e0b-cc2927f214f5 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 10:05:22 user nova-compute[75229]: DEBUG nova.compute.manager [req-1f8a8780-b135-48ac-8a10-a8d6ed308a4e req-f5c0e37f-4a2e-44c0-805e-f38b4f27f18c service nova] [instance: 10d6bce1-e55f-429c-816d-3bef9029560a] Refreshing instance network info cache due to event network-changed-ea04ea8d-43a6-4f64-9e0b-cc2927f214f5. {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 10:05:22 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-1f8a8780-b135-48ac-8a10-a8d6ed308a4e req-f5c0e37f-4a2e-44c0-805e-f38b4f27f18c service nova] Acquiring lock "refresh_cache-10d6bce1-e55f-429c-816d-3bef9029560a" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 10:05:22 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:05:22 user nova-compute[75229]: DEBUG nova.network.neutron [None req-2e815009-11a2-4deb-8cd6-58327884f53c tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] [instance: 10d6bce1-e55f-429c-816d-3bef9029560a] Updating instance_info_cache with network_info: [{"id": "ea04ea8d-43a6-4f64-9e0b-cc2927f214f5", "address": "fa:16:3e:e7:9f:f8", "network": {"id": "6a700b61-4aa6-440b-87e6-a3525a5cb918", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-448680331-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8babb73006da4977a1fe2bdb35e08d8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea04ea8d-43", "ovs_interfaceid": "ea04ea8d-43a6-4f64-9e0b-cc2927f214f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 10:05:22 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-2e815009-11a2-4deb-8cd6-58327884f53c tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Releasing lock "refresh_cache-10d6bce1-e55f-429c-816d-3bef9029560a" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 10:05:22 user nova-compute[75229]: DEBUG nova.compute.manager [None req-2e815009-11a2-4deb-8cd6-58327884f53c tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] [instance: 10d6bce1-e55f-429c-816d-3bef9029560a] Instance network_info: |[{"id": "ea04ea8d-43a6-4f64-9e0b-cc2927f214f5", "address": "fa:16:3e:e7:9f:f8", "network": {"id": "6a700b61-4aa6-440b-87e6-a3525a5cb918", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-448680331-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8babb73006da4977a1fe2bdb35e08d8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea04ea8d-43", "ovs_interfaceid": "ea04ea8d-43a6-4f64-9e0b-cc2927f214f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75229) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 10:05:22 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-1f8a8780-b135-48ac-8a10-a8d6ed308a4e req-f5c0e37f-4a2e-44c0-805e-f38b4f27f18c service nova] Acquired lock "refresh_cache-10d6bce1-e55f-429c-816d-3bef9029560a" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 10:05:22 user nova-compute[75229]: DEBUG nova.network.neutron [req-1f8a8780-b135-48ac-8a10-a8d6ed308a4e req-f5c0e37f-4a2e-44c0-805e-f38b4f27f18c service nova] [instance: 10d6bce1-e55f-429c-816d-3bef9029560a] Refreshing network info cache for port ea04ea8d-43a6-4f64-9e0b-cc2927f214f5 {{(pid=75229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 10:05:23 user nova-compute[75229]: DEBUG nova.network.neutron [req-1f8a8780-b135-48ac-8a10-a8d6ed308a4e req-f5c0e37f-4a2e-44c0-805e-f38b4f27f18c service nova] [instance: 10d6bce1-e55f-429c-816d-3bef9029560a] Updated VIF entry in instance network info cache for port ea04ea8d-43a6-4f64-9e0b-cc2927f214f5. {{(pid=75229) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 10:05:23 user nova-compute[75229]: DEBUG nova.network.neutron [req-1f8a8780-b135-48ac-8a10-a8d6ed308a4e req-f5c0e37f-4a2e-44c0-805e-f38b4f27f18c service nova] [instance: 10d6bce1-e55f-429c-816d-3bef9029560a] Updating instance_info_cache with network_info: [{"id": "ea04ea8d-43a6-4f64-9e0b-cc2927f214f5", "address": "fa:16:3e:e7:9f:f8", "network": {"id": "6a700b61-4aa6-440b-87e6-a3525a5cb918", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-448680331-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8babb73006da4977a1fe2bdb35e08d8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea04ea8d-43", "ovs_interfaceid": "ea04ea8d-43a6-4f64-9e0b-cc2927f214f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 10:05:23 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-1f8a8780-b135-48ac-8a10-a8d6ed308a4e req-f5c0e37f-4a2e-44c0-805e-f38b4f27f18c service nova] Releasing lock "refresh_cache-10d6bce1-e55f-429c-816d-3bef9029560a" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 10:05:23 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:05:26 user nova-compute[75229]: DEBUG os_brick.utils [None req-2e815009-11a2-4deb-8cd6-58327884f53c tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 10:05:26 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:05:27 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:05:27 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e89ae66-aeda-4536-9059-b8149ca102ff]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f1154031c835\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:05:27 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:05:27 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:05:27 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[887dae5e-7711-4481-9370-d0958e22dc1b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:05:27 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:05:27 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:05:27 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[c480c741-0ed8-4d17-ae36-29ab94f0edf4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:05:27 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[3498e4e0-5ab0-428f-aad8-37c00261e3f8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:05:27 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-2e815009-11a2-4deb-8cd6-58327884f53c tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Running cmd (subprocess): nvme version {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:05:27 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-2e815009-11a2-4deb-8cd6-58327884f53c tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] 'nvme version' failed. Not Retrying. {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 10:05:27 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2e815009-11a2-4deb-8cd6-58327884f53c tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] nvme not present on system {{(pid=75229) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 10:05:27 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:05:27 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 10:05:27 user nova-compute[75229]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 10:05:27 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ff9c21f-182b-4d3d-90da-fbce434cc46a]: (4, '') {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:05:27 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.lightos [None req-2e815009-11a2-4deb-8cd6-58327884f53c tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75229) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 10:05:27 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.lightos [None req-2e815009-11a2-4deb-8cd6-58327884f53c tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75229) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 10:05:27 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.lightos [None req-2e815009-11a2-4deb-8cd6-58327884f53c tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] LIGHTOS: no hostnqn found. {{(pid=75229) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 10:05:27 user nova-compute[75229]: DEBUG os_brick.utils [None req-2e815009-11a2-4deb-8cd6-58327884f53c tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] <== get_connector_properties: return (105ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f1154031c835', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 10:05:27 user nova-compute[75229]: DEBUG nova.virt.block_device [None req-2e815009-11a2-4deb-8cd6-58327884f53c tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] [instance: 10d6bce1-e55f-429c-816d-3bef9029560a] Updating existing volume attachment record: f2d4d89c-94d4-48df-af88-25f6e6896ef0 {{(pid=75229) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 10:05:28 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:05:28 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:05:30 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:05:31 user nova-compute[75229]: DEBUG nova.compute.manager [None req-2e815009-11a2-4deb-8cd6-58327884f53c tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] [instance: 10d6bce1-e55f-429c-816d-3bef9029560a] Start spawning the instance on the hypervisor. {{(pid=75229) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 10:05:31 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-2e815009-11a2-4deb-8cd6-58327884f53c tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] [instance: 10d6bce1-e55f-429c-816d-3bef9029560a] Creating instance directory {{(pid=75229) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 10:05:31 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-2e815009-11a2-4deb-8cd6-58327884f53c tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] [instance: 10d6bce1-e55f-429c-816d-3bef9029560a] Creating image(s)
Nov 14 10:05:31 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-2e815009-11a2-4deb-8cd6-58327884f53c tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] [instance: 10d6bce1-e55f-429c-816d-3bef9029560a] Did not create local disks {{(pid=75229) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 14 10:05:31 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-2e815009-11a2-4deb-8cd6-58327884f53c tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] [instance: 10d6bce1-e55f-429c-816d-3bef9029560a] Ensure instance console log exists: /opt/stack/data/nova/instances/10d6bce1-e55f-429c-816d-3bef9029560a/console.log {{(pid=75229) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 10:05:31 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-2e815009-11a2-4deb-8cd6-58327884f53c tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:05:31 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-2e815009-11a2-4deb-8cd6-58327884f53c tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:05:31 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-2e815009-11a2-4deb-8cd6-58327884f53c tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:05:31 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-2e815009-11a2-4deb-8cd6-58327884f53c tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] [instance: 10d6bce1-e55f-429c-816d-3bef9029560a] Start _get_guest_xml network_info=[{"id": "ea04ea8d-43a6-4f64-9e0b-cc2927f214f5", "address": "fa:16:3e:e7:9f:f8", "network": {"id": "6a700b61-4aa6-440b-87e6-a3525a5cb918", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-448680331-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8babb73006da4977a1fe2bdb35e08d8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea04ea8d-43", "ovs_interfaceid": "ea04ea8d-43a6-4f64-9e0b-cc2927f214f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T09:40:10Z,direct_url=<?>,disk_format='qcow2',id=3bef8470-ecc7-40e3-95d4-9254348ea72d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='de5a91106b6948ed937a7178ff9464c4',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T09:40:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:7aee6091-dab3-4c39-88a1-4bbb28dcab45', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LXKkTDrO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '10d6bce1-e55f-429c-816d-3bef9029560a', 'attached_at': '', 'detached_at': '', 'volume_id': '7aee6091-dab3-4c39-88a1-4bbb28dcab45', 'serial': '7aee6091-dab3-4c39-88a1-4bbb28dcab45'}, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'attachment_id': 'f2d4d89c-94d4-48df-af88-25f6e6896ef0', 'guest_format': None, 'device_type': 'disk', 'volume_type': None} {{(pid=75229) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 10:05:31 user nova-compute[75229]: WARNING nova.virt.libvirt.driver [None req-2e815009-11a2-4deb-8cd6-58327884f53c tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 10:05:31 user nova-compute[75229]: WARNING nova.virt.libvirt.driver [None req-2e815009-11a2-4deb-8cd6-58327884f53c tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 10:05:31 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-2e815009-11a2-4deb-8cd6-58327884f53c tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75229) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 10:05:31 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-2e815009-11a2-4deb-8cd6-58327884f53c tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] CPU controller missing on host. {{(pid=75229) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 10:05:31 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-2e815009-11a2-4deb-8cd6-58327884f53c tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75229) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 10:05:31 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-2e815009-11a2-4deb-8cd6-58327884f53c tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] CPU controller found on host. {{(pid=75229) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 10:05:31 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-2e815009-11a2-4deb-8cd6-58327884f53c tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75229) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 10:05:31 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-2e815009-11a2-4deb-8cd6-58327884f53c tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T09:39:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T09:40:10Z,direct_url=<?>,disk_format='qcow2',id=3bef8470-ecc7-40e3-95d4-9254348ea72d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='de5a91106b6948ed937a7178ff9464c4',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T09:40:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 10:05:31 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-2e815009-11a2-4deb-8cd6-58327884f53c tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Flavor limits 0:0:0 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 10:05:31 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-2e815009-11a2-4deb-8cd6-58327884f53c tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Image limits 0:0:0 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 10:05:31 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-2e815009-11a2-4deb-8cd6-58327884f53c tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Flavor pref 0:0:0 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 10:05:31 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-2e815009-11a2-4deb-8cd6-58327884f53c tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Image pref 0:0:0 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 10:05:31 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-2e815009-11a2-4deb-8cd6-58327884f53c tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 10:05:31 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-2e815009-11a2-4deb-8cd6-58327884f53c tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 10:05:31 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-2e815009-11a2-4deb-8cd6-58327884f53c tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75229) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 10:05:31 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-2e815009-11a2-4deb-8cd6-58327884f53c tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Got 1 possible topologies {{(pid=75229) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 10:05:31 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-2e815009-11a2-4deb-8cd6-58327884f53c tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 10:05:31 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-2e815009-11a2-4deb-8cd6-58327884f53c tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 10:05:31 user nova-compute[75229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2e815009-11a2-4deb-8cd6-58327884f53c tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] [instance: 10d6bce1-e55f-429c-816d-3bef9029560a] Calling os-brick to attach iSCSI Volume {{(pid=75229) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 10:05:31 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e815009-11a2-4deb-8cd6-58327884f53c tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f73f85151b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7aee6091-dab3-4c39-88a1-4bbb28dcab45', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LXKkTDrO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 10:05:31 user nova-compute[75229]: WARNING os_brick.initiator.connectors.base [None req-2e815009-11a2-4deb-8cd6-58327884f53c tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 10:05:31 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-2e815009-11a2-4deb-8cd6-58327884f53c tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 10:05:31 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-2e815009-11a2-4deb-8cd6-58327884f53c tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 10:05:31 user nova-compute[75229]: WARNING os_brick.initiator.connectors.base [None req-2e815009-11a2-4deb-8cd6-58327884f53c tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 10:05:31 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-2e815009-11a2-4deb-8cd6-58327884f53c tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7aee6091-dab3-4c39-88a1-4bbb28dcab45" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 10:05:31 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-2e815009-11a2-4deb-8cd6-58327884f53c tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7aee6091-dab3-4c39-88a1-4bbb28dcab45" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 10:05:31 user nova-compute[75229]: INFO os_brick.initiator.connectors.iscsi [None req-2e815009-11a2-4deb-8cd6-58327884f53c tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 10:05:31 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7aee6091-dab3-4c39-88a1-4bbb28dcab45 -p 172.16.0.220:3260 {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:05:31 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7aee6091-dab3-4c39-88a1-4bbb28dcab45 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:05:31 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[48723e35-3730-4c00-b877-4627191e4865]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:05:31 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e815009-11a2-4deb-8cd6-58327884f53c tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 10:05:31 user nova-compute[75229]:  {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 10:05:31 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7aee6091-dab3-4c39-88a1-4bbb28dcab45 -p 172.16.0.220:3260 --interface default --op new {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:05:31 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7aee6091-dab3-4c39-88a1-4bbb28dcab45 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:05:31 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[c47e90f6-2fc9-41b0-8739-1913d0ab6d89]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7aee6091-dab3-4c39-88a1-4bbb28dcab45] added\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:05:31 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e815009-11a2-4deb-8cd6-58327884f53c tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7aee6091-dab3-4c39-88a1-4bbb28dcab45] added
Nov 14 10:05:31 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 10:05:31 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7aee6091-dab3-4c39-88a1-4bbb28dcab45 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:05:31 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7aee6091-dab3-4c39-88a1-4bbb28dcab45 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:05:31 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[446b5599-0f4c-46d1-ba92-c6c25a36fc66]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:05:31 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e815009-11a2-4deb-8cd6-58327884f53c tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 10:05:31 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7aee6091-dab3-4c39-88a1-4bbb28dcab45 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:05:31 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7aee6091-dab3-4c39-88a1-4bbb28dcab45 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:05:31 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d01ca30-45df-4fa1-9c7f-8bfa823e559a]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:05:31 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e815009-11a2-4deb-8cd6-58327884f53c tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 10:05:31 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7aee6091-dab3-4c39-88a1-4bbb28dcab45 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LXKkTDrO {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:05:31 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7aee6091-dab3-4c39-88a1-4bbb28dcab45 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LXKkTDrO" returned: 0 in 0.018s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:05:31 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[24908ede-6aa3-4039-8383-c606a6b44c32]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:05:31 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e815009-11a2-4deb-8cd6-58327884f53c tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LXKkTDrO'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 10:05:31 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7aee6091-dab3-4c39-88a1-4bbb28dcab45 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:05:31 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7aee6091-dab3-4c39-88a1-4bbb28dcab45 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:05:31 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[95a566cd-47f9-41ea-8ac7-4e3bc050dc94]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:05:31 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e815009-11a2-4deb-8cd6-58327884f53c tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 10:05:31 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:05:31 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:05:31 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f0188a5-252b-48b6-8981-d166a64469d5]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aebc438-0289-44fe-ad84-4e696468f50e (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ddb200b-47ca-4449-9973-be76424a6761 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4a6dca6-1581-494f-afe5-3aac2b4d2c15 (non-flash)\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:05:31 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e815009-11a2-4deb-8cd6-58327884f53c tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aebc438-0289-44fe-ad84-4e696468f50e (non-flash)
Nov 14 10:05:31 user nova-compute[75229]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ddb200b-47ca-4449-9973-be76424a6761 (non-flash)
Nov 14 10:05:31 user nova-compute[75229]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4a6dca6-1581-494f-afe5-3aac2b4d2c15 (non-flash)
Nov 14 10:05:31 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 10:05:31 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e815009-11a2-4deb-8cd6-58327884f53c tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aebc438-0289-44fe-ad84-4e696468f50e (non-flash)
Nov 14 10:05:31 user nova-compute[75229]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ddb200b-47ca-4449-9973-be76424a6761 (non-flash)
Nov 14 10:05:31 user nova-compute[75229]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4a6dca6-1581-494f-afe5-3aac2b4d2c15 (non-flash)
Nov 14 10:05:31 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 10:05:31 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7aee6091-dab3-4c39-88a1-4bbb28dcab45 -p 172.16.0.220:3260 --login {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:05:31 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7aee6091-dab3-4c39-88a1-4bbb28dcab45 -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:05:31 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc79df71-b378-4d2d-95d9-4276daa4d276]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7aee6091-dab3-4c39-88a1-4bbb28dcab45, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7aee6091-dab3-4c39-88a1-4bbb28dcab45, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:05:31 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e815009-11a2-4deb-8cd6-58327884f53c tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7aee6091-dab3-4c39-88a1-4bbb28dcab45, portal: 172.16.0.220,3260]
Nov 14 10:05:31 user nova-compute[75229]: Login to [iface: default, target: iqn.2010-10.org.openstack:7aee6091-dab3-4c39-88a1-4bbb28dcab45, portal: 172.16.0.220,3260] successful.
Nov 14 10:05:31 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 10:05:31 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7aee6091-dab3-4c39-88a1-4bbb28dcab45 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:05:31 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7aee6091-dab3-4c39-88a1-4bbb28dcab45 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:05:31 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cc9d117-8aba-4333-ad71-f46424df43a1]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:05:31 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e815009-11a2-4deb-8cd6-58327884f53c tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 10:05:31 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:05:31 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:05:31 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[fae63d5f-5444-40df-b71d-98295a66a32b]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aebc438-0289-44fe-ad84-4e696468f50e (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ddb200b-47ca-4449-9973-be76424a6761 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4a6dca6-1581-494f-afe5-3aac2b4d2c15 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7aee6091-dab3-4c39-88a1-4bbb28dcab45 (non-flash)\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:05:31 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e815009-11a2-4deb-8cd6-58327884f53c tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aebc438-0289-44fe-ad84-4e696468f50e (non-flash)
Nov 14 10:05:31 user nova-compute[75229]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ddb200b-47ca-4449-9973-be76424a6761 (non-flash)
Nov 14 10:05:31 user nova-compute[75229]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4a6dca6-1581-494f-afe5-3aac2b4d2c15 (non-flash)
Nov 14 10:05:31 user nova-compute[75229]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7aee6091-dab3-4c39-88a1-4bbb28dcab45 (non-flash)
Nov 14 10:05:31 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 10:05:31 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e815009-11a2-4deb-8cd6-58327884f53c tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aebc438-0289-44fe-ad84-4e696468f50e (non-flash)
Nov 14 10:05:31 user nova-compute[75229]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ddb200b-47ca-4449-9973-be76424a6761 (non-flash)
Nov 14 10:05:31 user nova-compute[75229]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4a6dca6-1581-494f-afe5-3aac2b4d2c15 (non-flash)
Nov 14 10:05:31 user nova-compute[75229]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7aee6091-dab3-4c39-88a1-4bbb28dcab45 (non-flash)
Nov 14 10:05:31 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 10:05:31 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-2e815009-11a2-4deb-8cd6-58327884f53c tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7aee6091-dab3-4c39-88a1-4bbb28dcab45" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.282s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 10:05:31 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e815009-11a2-4deb-8cd6-58327884f53c tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Connected to 172.16.0.220:3260 {{(pid=75229) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 10:05:31 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-2e815009-11a2-4deb-8cd6-58327884f53c tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] HCTL ('35', '-', '-', 0) found on session 46 with lun 0 {{(pid=75229) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 10:05:31 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-2e815009-11a2-4deb-8cd6-58327884f53c tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75229) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 10:05:31 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:05:31 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.019s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:05:31 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bd89008-4d09-45ad-8e82-83edde5a3642]: (4, ('- - 0', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:05:31 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-2e815009-11a2-4deb-8cd6-58327884f53c tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Searching for a device in session 46 and hctl ['35', '*', '*', 0] yield: None {{(pid=75229) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 10:05:32 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-2e815009-11a2-4deb-8cd6-58327884f53c tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Searching for a device in session 46 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75229) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 10:05:32 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e815009-11a2-4deb-8cd6-58327884f53c tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:7aee6091-dab3-4c39-88a1-4bbb28dcab45', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LXKkTDrO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75229) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 10:05:32 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-2e815009-11a2-4deb-8cd6-58327884f53c tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.312s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 10:05:32 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e815009-11a2-4deb-8cd6-58327884f53c tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] <== connect_volume: return (1313ms) {'type': 'block', 'scsi_wwn': '23636626663376464', 'path': '/dev/sdd'} {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 10:05:32 user nova-compute[75229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2e815009-11a2-4deb-8cd6-58327884f53c tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] [instance: 10d6bce1-e55f-429c-816d-3bef9029560a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23636626663376464', 'path': '/dev/sdd'} {{(pid=75229) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 10:05:32 user nova-compute[75229]: DEBUG nova.virt.libvirt.vif [None req-2e815009-11a2-4deb-8cd6-58327884f53c tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T10:05:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1327308485',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1327308485',id=45,image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8babb73006da4977a1fe2bdb35e08d8f',ramdisk_id='',reservation_id='r-mj2negw8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-189750210',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T10:05:21Z,user_data=None,user_id='a8825cd49e9349f28576b704c4c4d717',uuid=10d6bce1-e55f-429c-816d-3bef9029560a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ea04ea8d-43a6-4f64-9e0b-cc2927f214f5", "address": "fa:16:3e:e7:9f:f8", "network": {"id": "6a700b61-4aa6-440b-87e6-a3525a5cb918", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-448680331-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8babb73006da4977a1fe2bdb35e08d8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea04ea8d-43", "ovs_interfaceid": "ea04ea8d-43a6-4f64-9e0b-cc2927f214f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75229) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 10:05:32 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-2e815009-11a2-4deb-8cd6-58327884f53c tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Converting VIF {"id": "ea04ea8d-43a6-4f64-9e0b-cc2927f214f5", "address": "fa:16:3e:e7:9f:f8", "network": {"id": "6a700b61-4aa6-440b-87e6-a3525a5cb918", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-448680331-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8babb73006da4977a1fe2bdb35e08d8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea04ea8d-43", "ovs_interfaceid": "ea04ea8d-43a6-4f64-9e0b-cc2927f214f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 10:05:32 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-2e815009-11a2-4deb-8cd6-58327884f53c tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e7:9f:f8,bridge_name='br-int',has_traffic_filtering=True,id=ea04ea8d-43a6-4f64-9e0b-cc2927f214f5,network=Network(6a700b61-4aa6-440b-87e6-a3525a5cb918),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea04ea8d-43') {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 10:05:32 user nova-compute[75229]: DEBUG nova.objects.instance [None req-2e815009-11a2-4deb-8cd6-58327884f53c tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Lazy-loading 'pci_devices' on Instance uuid 10d6bce1-e55f-429c-816d-3bef9029560a {{(pid=75229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 10:05:32 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-2e815009-11a2-4deb-8cd6-58327884f53c tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] [instance: 10d6bce1-e55f-429c-816d-3bef9029560a] End _get_guest_xml xml=<domain type="kvm">
Nov 14 10:05:32 user nova-compute[75229]:   <uuid>10d6bce1-e55f-429c-816d-3bef9029560a</uuid>
Nov 14 10:05:32 user nova-compute[75229]:   <name>instance-0000002d</name>
Nov 14 10:05:32 user nova-compute[75229]:   <memory>524288</memory>
Nov 14 10:05:32 user nova-compute[75229]:   <vcpu>1</vcpu>
Nov 14 10:05:32 user nova-compute[75229]:   <metadata>
Nov 14 10:05:32 user nova-compute[75229]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 10:05:32 user nova-compute[75229]:       <nova:package version="0.0.0"/>
Nov 14 10:05:32 user nova-compute[75229]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1327308485</nova:name>
Nov 14 10:05:32 user nova-compute[75229]:       <nova:creationTime>2023-11-14 10:05:31</nova:creationTime>
Nov 14 10:05:32 user nova-compute[75229]:       <nova:flavor name="m1.tiny">
Nov 14 10:05:32 user nova-compute[75229]:         <nova:memory>512</nova:memory>
Nov 14 10:05:32 user nova-compute[75229]:         <nova:disk>1</nova:disk>
Nov 14 10:05:32 user nova-compute[75229]:         <nova:swap>0</nova:swap>
Nov 14 10:05:32 user nova-compute[75229]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 10:05:32 user nova-compute[75229]:         <nova:vcpus>1</nova:vcpus>
Nov 14 10:05:32 user nova-compute[75229]:       </nova:flavor>
Nov 14 10:05:32 user nova-compute[75229]:       <nova:owner>
Nov 14 10:05:32 user nova-compute[75229]:         <nova:user uuid="a8825cd49e9349f28576b704c4c4d717">tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member</nova:user>
Nov 14 10:05:32 user nova-compute[75229]:         <nova:project uuid="8babb73006da4977a1fe2bdb35e08d8f">tempest-ServerBootFromVolumeStableRescueTest-189750210</nova:project>
Nov 14 10:05:32 user nova-compute[75229]:       </nova:owner>
Nov 14 10:05:32 user nova-compute[75229]:       <nova:root type="image" uuid="3bef8470-ecc7-40e3-95d4-9254348ea72d"/>
Nov 14 10:05:32 user nova-compute[75229]:       <nova:ports>
Nov 14 10:05:32 user nova-compute[75229]:         <nova:port uuid="ea04ea8d-43a6-4f64-9e0b-cc2927f214f5">
Nov 14 10:05:32 user nova-compute[75229]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 14 10:05:32 user nova-compute[75229]:         </nova:port>
Nov 14 10:05:32 user nova-compute[75229]:       </nova:ports>
Nov 14 10:05:32 user nova-compute[75229]:     </nova:instance>
Nov 14 10:05:32 user nova-compute[75229]:   </metadata>
Nov 14 10:05:32 user nova-compute[75229]:   <sysinfo type="smbios">
Nov 14 10:05:32 user nova-compute[75229]:     <system>
Nov 14 10:05:32 user nova-compute[75229]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 10:05:32 user nova-compute[75229]:       <entry name="product">OpenStack Nova</entry>
Nov 14 10:05:32 user nova-compute[75229]:       <entry name="version">0.0.0</entry>
Nov 14 10:05:32 user nova-compute[75229]:       <entry name="serial">10d6bce1-e55f-429c-816d-3bef9029560a</entry>
Nov 14 10:05:32 user nova-compute[75229]:       <entry name="uuid">10d6bce1-e55f-429c-816d-3bef9029560a</entry>
Nov 14 10:05:32 user nova-compute[75229]:       <entry name="family">Virtual Machine</entry>
Nov 14 10:05:32 user nova-compute[75229]:     </system>
Nov 14 10:05:32 user nova-compute[75229]:   </sysinfo>
Nov 14 10:05:32 user nova-compute[75229]:   <os>
Nov 14 10:05:32 user nova-compute[75229]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 10:05:32 user nova-compute[75229]:     <boot dev="hd"/>
Nov 14 10:05:32 user nova-compute[75229]:     <smbios mode="sysinfo"/>
Nov 14 10:05:32 user nova-compute[75229]:   </os>
Nov 14 10:05:32 user nova-compute[75229]:   <features>
Nov 14 10:05:32 user nova-compute[75229]:     <acpi/>
Nov 14 10:05:32 user nova-compute[75229]:     <apic/>
Nov 14 10:05:32 user nova-compute[75229]:     <vmcoreinfo/>
Nov 14 10:05:32 user nova-compute[75229]:   </features>
Nov 14 10:05:32 user nova-compute[75229]:   <clock offset="utc">
Nov 14 10:05:32 user nova-compute[75229]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 10:05:32 user nova-compute[75229]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 10:05:32 user nova-compute[75229]:     <timer name="hpet" present="no"/>
Nov 14 10:05:32 user nova-compute[75229]:   </clock>
Nov 14 10:05:32 user nova-compute[75229]:   <cpu mode="custom" match="exact">
Nov 14 10:05:32 user nova-compute[75229]:     <model>Nehalem</model>
Nov 14 10:05:32 user nova-compute[75229]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 10:05:32 user nova-compute[75229]:   </cpu>
Nov 14 10:05:32 user nova-compute[75229]:   <devices>
Nov 14 10:05:32 user nova-compute[75229]:     <disk type="block" device="disk">
Nov 14 10:05:32 user nova-compute[75229]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 10:05:32 user nova-compute[75229]:       <source dev="/dev/sdd"/>
Nov 14 10:05:32 user nova-compute[75229]:       <target dev="vda" bus="virtio"/>
Nov 14 10:05:32 user nova-compute[75229]:       <serial>7aee6091-dab3-4c39-88a1-4bbb28dcab45</serial>
Nov 14 10:05:32 user nova-compute[75229]:     </disk>
Nov 14 10:05:32 user nova-compute[75229]:     <interface type="ethernet">
Nov 14 10:05:32 user nova-compute[75229]:       <mac address="fa:16:3e:e7:9f:f8"/>
Nov 14 10:05:32 user nova-compute[75229]:       <model type="virtio"/>
Nov 14 10:05:32 user nova-compute[75229]:       <mtu size="1442"/>
Nov 14 10:05:32 user nova-compute[75229]:       <target dev="tapea04ea8d-43"/>
Nov 14 10:05:32 user nova-compute[75229]:     </interface>
Nov 14 10:05:32 user nova-compute[75229]:     <serial type="pty">
Nov 14 10:05:32 user nova-compute[75229]:       <log file="/opt/stack/data/nova/instances/10d6bce1-e55f-429c-816d-3bef9029560a/console.log" append="off"/>
Nov 14 10:05:32 user nova-compute[75229]:     </serial>
Nov 14 10:05:32 user nova-compute[75229]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 10:05:32 user nova-compute[75229]:     <video>
Nov 14 10:05:32 user nova-compute[75229]:       <model type="virtio"/>
Nov 14 10:05:32 user nova-compute[75229]:     </video>
Nov 14 10:05:32 user nova-compute[75229]:     <rng model="virtio">
Nov 14 10:05:32 user nova-compute[75229]:       <backend model="random">/dev/urandom</backend>
Nov 14 10:05:32 user nova-compute[75229]:     </rng>
Nov 14 10:05:32 user nova-compute[75229]:     <controller type="usb" index="0" model="none"/>
Nov 14 10:05:32 user nova-compute[75229]:     <memballoon model="virtio">
Nov 14 10:05:32 user nova-compute[75229]:       <stats period="10"/>
Nov 14 10:05:32 user nova-compute[75229]:     </memballoon>
Nov 14 10:05:32 user nova-compute[75229]:   </devices>
Nov 14 10:05:32 user nova-compute[75229]: </domain>
Nov 14 10:05:32 user nova-compute[75229]:  {{(pid=75229) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 10:05:32 user nova-compute[75229]: DEBUG nova.virt.libvirt.vif [None req-2e815009-11a2-4deb-8cd6-58327884f53c tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T10:05:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1327308485',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1327308485',id=45,image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8babb73006da4977a1fe2bdb35e08d8f',ramdisk_id='',reservation_id='r-mj2negw8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-189750210',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T10:05:21Z,user_data=None,user_id='a8825cd49e9349f28576b704c4c4d717',uuid=10d6bce1-e55f-429c-816d-3bef9029560a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ea04ea8d-43a6-4f64-9e0b-cc2927f214f5", "address": "fa:16:3e:e7:9f:f8", "network": {"id": "6a700b61-4aa6-440b-87e6-a3525a5cb918", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-448680331-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8babb73006da4977a1fe2bdb35e08d8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea04ea8d-43", "ovs_interfaceid": "ea04ea8d-43a6-4f64-9e0b-cc2927f214f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 10:05:32 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-2e815009-11a2-4deb-8cd6-58327884f53c tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Converting VIF {"id": "ea04ea8d-43a6-4f64-9e0b-cc2927f214f5", "address": "fa:16:3e:e7:9f:f8", "network": {"id": "6a700b61-4aa6-440b-87e6-a3525a5cb918", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-448680331-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8babb73006da4977a1fe2bdb35e08d8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea04ea8d-43", "ovs_interfaceid": "ea04ea8d-43a6-4f64-9e0b-cc2927f214f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 10:05:32 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-2e815009-11a2-4deb-8cd6-58327884f53c tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e7:9f:f8,bridge_name='br-int',has_traffic_filtering=True,id=ea04ea8d-43a6-4f64-9e0b-cc2927f214f5,network=Network(6a700b61-4aa6-440b-87e6-a3525a5cb918),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea04ea8d-43') {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 10:05:32 user nova-compute[75229]: DEBUG os_vif [None req-2e815009-11a2-4deb-8cd6-58327884f53c tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e7:9f:f8,bridge_name='br-int',has_traffic_filtering=True,id=ea04ea8d-43a6-4f64-9e0b-cc2927f214f5,network=Network(6a700b61-4aa6-440b-87e6-a3525a5cb918),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea04ea8d-43') {{(pid=75229) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 10:05:32 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:05:32 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 10:05:32 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 10:05:32 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:05:32 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ea76f719-2790-52c7-b538-b9f0d6743247', '_type': 'linux-noop'}}, row=False) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 10:05:32 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:05:32 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 10:05:32 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:05:32 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapea04ea8d-43, may_exist=True, interface_attrs={}) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 10:05:32 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapea04ea8d-43, col_values=(('qos', UUID('3598f0a9-72d9-4f34-8d50-8d979d9f6ddf')),), if_exists=True) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 10:05:32 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapea04ea8d-43, col_values=(('external_ids', {'iface-id': 'ea04ea8d-43a6-4f64-9e0b-cc2927f214f5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e7:9f:f8', 'vm-uuid': '10d6bce1-e55f-429c-816d-3bef9029560a'}),), if_exists=True) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 10:05:32 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:05:32 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 10:05:32 user nova-compute[75229]: INFO os_vif [None req-2e815009-11a2-4deb-8cd6-58327884f53c tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e7:9f:f8,bridge_name='br-int',has_traffic_filtering=True,id=ea04ea8d-43a6-4f64-9e0b-cc2927f214f5,network=Network(6a700b61-4aa6-440b-87e6-a3525a5cb918),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea04ea8d-43')
Nov 14 10:05:32 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-2e815009-11a2-4deb-8cd6-58327884f53c tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] No BDM found with device name vda, not building metadata. {{(pid=75229) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 10:05:32 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-2e815009-11a2-4deb-8cd6-58327884f53c tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] No VIF found with MAC fa:16:3e:e7:9f:f8, not building metadata {{(pid=75229) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 10:05:33 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:05:33 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:05:34 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:05:34 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:05:34 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:05:34 user nova-compute[75229]: DEBUG nova.compute.manager [req-1715fbae-cd85-4abe-85fe-56ab8a0eb61b req-9e33dcaa-a46e-483f-8f8d-1165d186b7e3 service nova] [instance: 10d6bce1-e55f-429c-816d-3bef9029560a] Received event network-vif-plugged-ea04ea8d-43a6-4f64-9e0b-cc2927f214f5 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 10:05:34 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-1715fbae-cd85-4abe-85fe-56ab8a0eb61b req-9e33dcaa-a46e-483f-8f8d-1165d186b7e3 service nova] Acquiring lock "10d6bce1-e55f-429c-816d-3bef9029560a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:05:34 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-1715fbae-cd85-4abe-85fe-56ab8a0eb61b req-9e33dcaa-a46e-483f-8f8d-1165d186b7e3 service nova] Lock "10d6bce1-e55f-429c-816d-3bef9029560a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:05:34 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-1715fbae-cd85-4abe-85fe-56ab8a0eb61b req-9e33dcaa-a46e-483f-8f8d-1165d186b7e3 service nova] Lock "10d6bce1-e55f-429c-816d-3bef9029560a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:05:34 user nova-compute[75229]: DEBUG nova.compute.manager [req-1715fbae-cd85-4abe-85fe-56ab8a0eb61b req-9e33dcaa-a46e-483f-8f8d-1165d186b7e3 service nova] [instance: 10d6bce1-e55f-429c-816d-3bef9029560a] No waiting events found dispatching network-vif-plugged-ea04ea8d-43a6-4f64-9e0b-cc2927f214f5 {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 10:05:34 user nova-compute[75229]: WARNING nova.compute.manager [req-1715fbae-cd85-4abe-85fe-56ab8a0eb61b req-9e33dcaa-a46e-483f-8f8d-1165d186b7e3 service nova] [instance: 10d6bce1-e55f-429c-816d-3bef9029560a] Received unexpected event network-vif-plugged-ea04ea8d-43a6-4f64-9e0b-cc2927f214f5 for instance with vm_state building and task_state spawning.
Nov 14 10:05:34 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:05:36 user nova-compute[75229]: DEBUG nova.compute.manager [None req-2e815009-11a2-4deb-8cd6-58327884f53c tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] [instance: 10d6bce1-e55f-429c-816d-3bef9029560a] Instance event wait completed in 0 seconds for  {{(pid=75229) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 10:05:36 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-2e815009-11a2-4deb-8cd6-58327884f53c tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] [instance: 10d6bce1-e55f-429c-816d-3bef9029560a] Guest created on hypervisor {{(pid=75229) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 10:05:36 user nova-compute[75229]: INFO nova.virt.libvirt.driver [-] [instance: 10d6bce1-e55f-429c-816d-3bef9029560a] Instance spawned successfully.
Nov 14 10:05:36 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-2e815009-11a2-4deb-8cd6-58327884f53c tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] [instance: 10d6bce1-e55f-429c-816d-3bef9029560a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 10:05:36 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-2e815009-11a2-4deb-8cd6-58327884f53c tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] [instance: 10d6bce1-e55f-429c-816d-3bef9029560a] Found default for hw_cdrom_bus of ide {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 10:05:36 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-2e815009-11a2-4deb-8cd6-58327884f53c tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] [instance: 10d6bce1-e55f-429c-816d-3bef9029560a] Found default for hw_disk_bus of virtio {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 10:05:36 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-2e815009-11a2-4deb-8cd6-58327884f53c tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] [instance: 10d6bce1-e55f-429c-816d-3bef9029560a] Found default for hw_input_bus of None {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 10:05:36 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-2e815009-11a2-4deb-8cd6-58327884f53c tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] [instance: 10d6bce1-e55f-429c-816d-3bef9029560a] Found default for hw_pointer_model of None {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 10:05:36 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-2e815009-11a2-4deb-8cd6-58327884f53c tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] [instance: 10d6bce1-e55f-429c-816d-3bef9029560a] Found default for hw_video_model of virtio {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 10:05:36 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-2e815009-11a2-4deb-8cd6-58327884f53c tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] [instance: 10d6bce1-e55f-429c-816d-3bef9029560a] Found default for hw_vif_model of virtio {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 10:05:36 user nova-compute[75229]: INFO nova.compute.manager [None req-2e815009-11a2-4deb-8cd6-58327884f53c tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] [instance: 10d6bce1-e55f-429c-816d-3bef9029560a] Took 5.00 seconds to spawn the instance on the hypervisor.
Nov 14 10:05:36 user nova-compute[75229]: DEBUG nova.compute.manager [None req-2e815009-11a2-4deb-8cd6-58327884f53c tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] [instance: 10d6bce1-e55f-429c-816d-3bef9029560a] Checking state {{(pid=75229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 10:05:36 user nova-compute[75229]: INFO nova.compute.manager [None req-2e815009-11a2-4deb-8cd6-58327884f53c tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] [instance: 10d6bce1-e55f-429c-816d-3bef9029560a] Took 15.76 seconds to build instance.
Nov 14 10:05:36 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-2e815009-11a2-4deb-8cd6-58327884f53c tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Lock "10d6bce1-e55f-429c-816d-3bef9029560a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.866s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:05:36 user nova-compute[75229]: DEBUG nova.compute.manager [req-52dfd46d-e747-4f64-b7a3-291e28c160ec req-f6424ef9-6f26-4cfe-b8b0-8a2ff812dc5e service nova] [instance: 10d6bce1-e55f-429c-816d-3bef9029560a] Received event network-vif-plugged-ea04ea8d-43a6-4f64-9e0b-cc2927f214f5 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 10:05:36 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-52dfd46d-e747-4f64-b7a3-291e28c160ec req-f6424ef9-6f26-4cfe-b8b0-8a2ff812dc5e service nova] Acquiring lock "10d6bce1-e55f-429c-816d-3bef9029560a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:05:36 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-52dfd46d-e747-4f64-b7a3-291e28c160ec req-f6424ef9-6f26-4cfe-b8b0-8a2ff812dc5e service nova] Lock "10d6bce1-e55f-429c-816d-3bef9029560a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:05:36 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-52dfd46d-e747-4f64-b7a3-291e28c160ec req-f6424ef9-6f26-4cfe-b8b0-8a2ff812dc5e service nova] Lock "10d6bce1-e55f-429c-816d-3bef9029560a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:05:36 user nova-compute[75229]: DEBUG nova.compute.manager [req-52dfd46d-e747-4f64-b7a3-291e28c160ec req-f6424ef9-6f26-4cfe-b8b0-8a2ff812dc5e service nova] [instance: 10d6bce1-e55f-429c-816d-3bef9029560a] No waiting events found dispatching network-vif-plugged-ea04ea8d-43a6-4f64-9e0b-cc2927f214f5 {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 10:05:36 user nova-compute[75229]: WARNING nova.compute.manager [req-52dfd46d-e747-4f64-b7a3-291e28c160ec req-f6424ef9-6f26-4cfe-b8b0-8a2ff812dc5e service nova] [instance: 10d6bce1-e55f-429c-816d-3bef9029560a] Received unexpected event network-vif-plugged-ea04ea8d-43a6-4f64-9e0b-cc2927f214f5 for instance with vm_state active and task_state None.
Nov 14 10:05:37 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:05:38 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:05:39 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:05:41 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:05:41 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-be0c771f-d80b-4593-a53a-97da22dc28b0 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Acquiring lock "4c9fe69e-3f9d-4b30-a9e4-efc3e83efa17" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:05:41 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-be0c771f-d80b-4593-a53a-97da22dc28b0 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Lock "4c9fe69e-3f9d-4b30-a9e4-efc3e83efa17" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:05:41 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-be0c771f-d80b-4593-a53a-97da22dc28b0 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Acquiring lock "4c9fe69e-3f9d-4b30-a9e4-efc3e83efa17-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:05:41 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-be0c771f-d80b-4593-a53a-97da22dc28b0 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Lock "4c9fe69e-3f9d-4b30-a9e4-efc3e83efa17-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:05:41 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-be0c771f-d80b-4593-a53a-97da22dc28b0 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Lock "4c9fe69e-3f9d-4b30-a9e4-efc3e83efa17-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:05:41 user nova-compute[75229]: INFO nova.compute.manager [None req-be0c771f-d80b-4593-a53a-97da22dc28b0 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] [instance: 4c9fe69e-3f9d-4b30-a9e4-efc3e83efa17] Terminating instance
Nov 14 10:05:41 user nova-compute[75229]: DEBUG nova.compute.manager [None req-be0c771f-d80b-4593-a53a-97da22dc28b0 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] [instance: 4c9fe69e-3f9d-4b30-a9e4-efc3e83efa17] Start destroying the instance on the hypervisor. {{(pid=75229) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 10:05:41 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:05:41 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:05:41 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:05:41 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:05:42 user nova-compute[75229]: INFO nova.virt.libvirt.driver [-] [instance: 4c9fe69e-3f9d-4b30-a9e4-efc3e83efa17] Instance destroyed successfully.
Nov 14 10:05:42 user nova-compute[75229]: DEBUG nova.objects.instance [None req-be0c771f-d80b-4593-a53a-97da22dc28b0 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Lazy-loading 'resources' on Instance uuid 4c9fe69e-3f9d-4b30-a9e4-efc3e83efa17 {{(pid=75229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 10:05:42 user nova-compute[75229]: DEBUG nova.virt.libvirt.vif [None req-be0c771f-d80b-4593-a53a-97da22dc28b0 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T09:48:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-2544538',display_name='tempest-ServerRescueNegativeTestJSON-server-2544538',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-2544538',id=18,image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-14T09:53:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='46457b27e3ed416e827c3c22449fb512',ramdisk_id='',reservation_id='r-4gsrvn1y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-557279920',owner_user_name='tempest-ServerRescueNegativeTestJSON-557279920-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T09:55:35Z,user_data=None,user_id='a3cb33a5c522499e8cd254edd5e15879',uuid=4c9fe69e-3f9d-4b30-a9e4-efc3e83efa17,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "235153d6-63c1-44d2-97cc-c083544e6790", "address": "fa:16:3e:a0:db:35", "network": {"id": "22eed29e-7148-42f9-b4c7-b97811cba8eb", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2000485731-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46457b27e3ed416e827c3c22449fb512", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap235153d6-63", "ovs_interfaceid": "235153d6-63c1-44d2-97cc-c083544e6790", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 10:05:42 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-be0c771f-d80b-4593-a53a-97da22dc28b0 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Converting VIF {"id": "235153d6-63c1-44d2-97cc-c083544e6790", "address": "fa:16:3e:a0:db:35", "network": {"id": "22eed29e-7148-42f9-b4c7-b97811cba8eb", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2000485731-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46457b27e3ed416e827c3c22449fb512", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap235153d6-63", "ovs_interfaceid": "235153d6-63c1-44d2-97cc-c083544e6790", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 10:05:42 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-be0c771f-d80b-4593-a53a-97da22dc28b0 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a0:db:35,bridge_name='br-int',has_traffic_filtering=True,id=235153d6-63c1-44d2-97cc-c083544e6790,network=Network(22eed29e-7148-42f9-b4c7-b97811cba8eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap235153d6-63') {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 10:05:42 user nova-compute[75229]: DEBUG os_vif [None req-be0c771f-d80b-4593-a53a-97da22dc28b0 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a0:db:35,bridge_name='br-int',has_traffic_filtering=True,id=235153d6-63c1-44d2-97cc-c083544e6790,network=Network(22eed29e-7148-42f9-b4c7-b97811cba8eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap235153d6-63') {{(pid=75229) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 10:05:42 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:05:42 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap235153d6-63, bridge=br-int, if_exists=True) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 10:05:42 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:05:42 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 10:05:42 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:05:42 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=fb885958-d330-43dc-b513-6ced03845c0b) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 10:05:42 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:05:42 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:05:42 user nova-compute[75229]: INFO os_vif [None req-be0c771f-d80b-4593-a53a-97da22dc28b0 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a0:db:35,bridge_name='br-int',has_traffic_filtering=True,id=235153d6-63c1-44d2-97cc-c083544e6790,network=Network(22eed29e-7148-42f9-b4c7-b97811cba8eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap235153d6-63')
Nov 14 10:05:42 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-be0c771f-d80b-4593-a53a-97da22dc28b0 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] [instance: 4c9fe69e-3f9d-4b30-a9e4-efc3e83efa17] Deleting instance files /opt/stack/data/nova/instances/4c9fe69e-3f9d-4b30-a9e4-efc3e83efa17_del
Nov 14 10:05:42 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-be0c771f-d80b-4593-a53a-97da22dc28b0 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] [instance: 4c9fe69e-3f9d-4b30-a9e4-efc3e83efa17] Deletion of /opt/stack/data/nova/instances/4c9fe69e-3f9d-4b30-a9e4-efc3e83efa17_del complete
Nov 14 10:05:42 user nova-compute[75229]: INFO nova.compute.manager [None req-be0c771f-d80b-4593-a53a-97da22dc28b0 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] [instance: 4c9fe69e-3f9d-4b30-a9e4-efc3e83efa17] Took 0.70 seconds to destroy the instance on the hypervisor.
Nov 14 10:05:42 user nova-compute[75229]: DEBUG oslo.service.loopingcall [None req-be0c771f-d80b-4593-a53a-97da22dc28b0 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75229) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 10:05:42 user nova-compute[75229]: DEBUG nova.compute.manager [-] [instance: 4c9fe69e-3f9d-4b30-a9e4-efc3e83efa17] Deallocating network for instance {{(pid=75229) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 10:05:42 user nova-compute[75229]: DEBUG nova.network.neutron [-] [instance: 4c9fe69e-3f9d-4b30-a9e4-efc3e83efa17] deallocate_for_instance() {{(pid=75229) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 10:05:42 user nova-compute[75229]: DEBUG nova.network.neutron [-] [instance: 4c9fe69e-3f9d-4b30-a9e4-efc3e83efa17] Updating instance_info_cache with network_info: [] {{(pid=75229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 10:05:42 user nova-compute[75229]: INFO nova.compute.manager [-] [instance: 4c9fe69e-3f9d-4b30-a9e4-efc3e83efa17] Took 0.52 seconds to deallocate network for instance.
Nov 14 10:05:42 user nova-compute[75229]: DEBUG nova.compute.manager [req-d2a4d359-686a-4792-8391-55858ba4ad9a req-923788c6-ff90-407c-b39e-9018790734cd service nova] [instance: 4c9fe69e-3f9d-4b30-a9e4-efc3e83efa17] Received event network-vif-deleted-235153d6-63c1-44d2-97cc-c083544e6790 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 10:05:42 user nova-compute[75229]: INFO nova.compute.manager [req-d2a4d359-686a-4792-8391-55858ba4ad9a req-923788c6-ff90-407c-b39e-9018790734cd service nova] [instance: 4c9fe69e-3f9d-4b30-a9e4-efc3e83efa17] Neutron deleted interface 235153d6-63c1-44d2-97cc-c083544e6790; detaching it from the instance and deleting it from the info cache
Nov 14 10:05:42 user nova-compute[75229]: DEBUG nova.network.neutron [req-d2a4d359-686a-4792-8391-55858ba4ad9a req-923788c6-ff90-407c-b39e-9018790734cd service nova] [instance: 4c9fe69e-3f9d-4b30-a9e4-efc3e83efa17] Updating instance_info_cache with network_info: [] {{(pid=75229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 10:05:42 user nova-compute[75229]: DEBUG nova.compute.manager [req-d2a4d359-686a-4792-8391-55858ba4ad9a req-923788c6-ff90-407c-b39e-9018790734cd service nova] [instance: 4c9fe69e-3f9d-4b30-a9e4-efc3e83efa17] Detach interface failed, port_id=235153d6-63c1-44d2-97cc-c083544e6790, reason: Instance 4c9fe69e-3f9d-4b30-a9e4-efc3e83efa17 could not be found. {{(pid=75229) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 14 10:05:42 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-be0c771f-d80b-4593-a53a-97da22dc28b0 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:05:42 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-be0c771f-d80b-4593-a53a-97da22dc28b0 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:05:43 user nova-compute[75229]: DEBUG nova.compute.provider_tree [None req-be0c771f-d80b-4593-a53a-97da22dc28b0 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Inventory has not changed in ProviderTree for provider: d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 {{(pid=75229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 10:05:43 user nova-compute[75229]: DEBUG nova.scheduler.client.report [None req-be0c771f-d80b-4593-a53a-97da22dc28b0 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Inventory has not changed for provider d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 10:05:43 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-be0c771f-d80b-4593-a53a-97da22dc28b0 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.304s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:05:43 user nova-compute[75229]: INFO nova.scheduler.client.report [None req-be0c771f-d80b-4593-a53a-97da22dc28b0 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Deleted allocations for instance 4c9fe69e-3f9d-4b30-a9e4-efc3e83efa17
Nov 14 10:05:43 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-be0c771f-d80b-4593-a53a-97da22dc28b0 tempest-ServerRescueNegativeTestJSON-557279920 tempest-ServerRescueNegativeTestJSON-557279920-project-member] Lock "4c9fe69e-3f9d-4b30-a9e4-efc3e83efa17" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.723s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:05:43 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:05:44 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:05:45 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:05:46 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:05:47 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:05:47 user nova-compute[75229]: DEBUG nova.compute.manager [req-4f3aeb0f-6df5-45c2-9b51-8efd3e812112 req-cec2e4bb-76f2-4e23-a242-7d7e6b227fc0 service nova] [instance: 3795dd8f-8a10-4939-8f2c-bacefe5f5aa1] Received event network-changed-c22c2020-a8ff-4cd5-8b78-89b1bb277e8c {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 10:05:47 user nova-compute[75229]: DEBUG nova.compute.manager [req-4f3aeb0f-6df5-45c2-9b51-8efd3e812112 req-cec2e4bb-76f2-4e23-a242-7d7e6b227fc0 service nova] [instance: 3795dd8f-8a10-4939-8f2c-bacefe5f5aa1] Refreshing instance network info cache due to event network-changed-c22c2020-a8ff-4cd5-8b78-89b1bb277e8c. {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 10:05:47 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-4f3aeb0f-6df5-45c2-9b51-8efd3e812112 req-cec2e4bb-76f2-4e23-a242-7d7e6b227fc0 service nova] Acquiring lock "refresh_cache-3795dd8f-8a10-4939-8f2c-bacefe5f5aa1" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 10:05:47 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-4f3aeb0f-6df5-45c2-9b51-8efd3e812112 req-cec2e4bb-76f2-4e23-a242-7d7e6b227fc0 service nova] Acquired lock "refresh_cache-3795dd8f-8a10-4939-8f2c-bacefe5f5aa1" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 10:05:47 user nova-compute[75229]: DEBUG nova.network.neutron [req-4f3aeb0f-6df5-45c2-9b51-8efd3e812112 req-cec2e4bb-76f2-4e23-a242-7d7e6b227fc0 service nova] [instance: 3795dd8f-8a10-4939-8f2c-bacefe5f5aa1] Refreshing network info cache for port c22c2020-a8ff-4cd5-8b78-89b1bb277e8c {{(pid=75229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 10:05:48 user nova-compute[75229]: DEBUG nova.network.neutron [req-4f3aeb0f-6df5-45c2-9b51-8efd3e812112 req-cec2e4bb-76f2-4e23-a242-7d7e6b227fc0 service nova] [instance: 3795dd8f-8a10-4939-8f2c-bacefe5f5aa1] Updated VIF entry in instance network info cache for port c22c2020-a8ff-4cd5-8b78-89b1bb277e8c. {{(pid=75229) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 10:05:48 user nova-compute[75229]: DEBUG nova.network.neutron [req-4f3aeb0f-6df5-45c2-9b51-8efd3e812112 req-cec2e4bb-76f2-4e23-a242-7d7e6b227fc0 service nova] [instance: 3795dd8f-8a10-4939-8f2c-bacefe5f5aa1] Updating instance_info_cache with network_info: [{"id": "c22c2020-a8ff-4cd5-8b78-89b1bb277e8c", "address": "fa:16:3e:a6:6b:f6", "network": {"id": "cd37c3e7-5ffe-4b5d-a25c-a2bd288cb9d2", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-156456501-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.204", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd2def4493b6471c86ad547a2e21eaf8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc22c2020-a8", "ovs_interfaceid": "c22c2020-a8ff-4cd5-8b78-89b1bb277e8c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 10:05:48 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-4f3aeb0f-6df5-45c2-9b51-8efd3e812112 req-cec2e4bb-76f2-4e23-a242-7d7e6b227fc0 service nova] Releasing lock "refresh_cache-3795dd8f-8a10-4939-8f2c-bacefe5f5aa1" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 10:05:48 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:05:49 user nova-compute[75229]: INFO nova.compute.manager [None req-73afdc65-a053-4518-9915-bb349cafa3cb tempest-ServerActionsV293TestJSON-1571447010 tempest-ServerActionsV293TestJSON-1571447010-project-member] [instance: 3795dd8f-8a10-4939-8f2c-bacefe5f5aa1] Rebuilding instance
Nov 14 10:05:49 user nova-compute[75229]: DEBUG nova.compute.manager [None req-73afdc65-a053-4518-9915-bb349cafa3cb tempest-ServerActionsV293TestJSON-1571447010 tempest-ServerActionsV293TestJSON-1571447010-project-member] [instance: 3795dd8f-8a10-4939-8f2c-bacefe5f5aa1] Checking state {{(pid=75229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 10:05:49 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:05:49 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:05:49 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:05:50 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:05:50 user nova-compute[75229]: INFO nova.virt.libvirt.driver [-] [instance: 3795dd8f-8a10-4939-8f2c-bacefe5f5aa1] Instance destroyed successfully.
Nov 14 10:05:50 user nova-compute[75229]: INFO nova.virt.libvirt.driver [-] [instance: 3795dd8f-8a10-4939-8f2c-bacefe5f5aa1] Instance destroyed successfully.
Nov 14 10:05:50 user nova-compute[75229]: DEBUG nova.virt.libvirt.vif [None req-73afdc65-a053-4518-9915-bb349cafa3cb tempest-ServerActionsV293TestJSON-1571447010 tempest-ServerActionsV293TestJSON-1571447010-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T10:03:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-397489303',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-227769429',id=44,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFUp8y3q6YJE91W5mLt9TtiRsU0SK+1Tlv+h5RVCK8xvWSBDaBLlNygtiA4MzTbH6VU4efuvwyj9xakV6WTmEsQqXHmG4tvUv4ckhtOrRf2abxMbK7PzCZvHKp/bva3DgA==',key_name='tempest-keypair-1083609012',keypairs=<?>,launch_index=0,launched_at=2023-11-14T10:04:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='dd2def4493b6471c86ad547a2e21eaf8',ramdisk_id='',reservation_id='r-3orn8wim',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1571447010',owner_user_name='tempest-ServerActionsV293TestJSON-1571447010-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T10:05:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ccb15ed1f78c4c97a06b44dd1d833693',uuid=3795dd8f-8a10-4939-8f2c-bacefe5f5aa1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c22c2020-a8ff-4cd5-8b78-89b1bb277e8c", "address": "fa:16:3e:a6:6b:f6", "network": {"id": "cd37c3e7-5ffe-4b5d-a25c-a2bd288cb9d2", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-156456501-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.204", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd2def4493b6471c86ad547a2e21eaf8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc22c2020-a8", "ovs_interfaceid": "c22c2020-a8ff-4cd5-8b78-89b1bb277e8c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 10:05:50 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-73afdc65-a053-4518-9915-bb349cafa3cb tempest-ServerActionsV293TestJSON-1571447010 tempest-ServerActionsV293TestJSON-1571447010-project-member] Converting VIF {"id": "c22c2020-a8ff-4cd5-8b78-89b1bb277e8c", "address": "fa:16:3e:a6:6b:f6", "network": {"id": "cd37c3e7-5ffe-4b5d-a25c-a2bd288cb9d2", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-156456501-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.204", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd2def4493b6471c86ad547a2e21eaf8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc22c2020-a8", "ovs_interfaceid": "c22c2020-a8ff-4cd5-8b78-89b1bb277e8c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 10:05:50 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-73afdc65-a053-4518-9915-bb349cafa3cb tempest-ServerActionsV293TestJSON-1571447010 tempest-ServerActionsV293TestJSON-1571447010-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a6:6b:f6,bridge_name='br-int',has_traffic_filtering=True,id=c22c2020-a8ff-4cd5-8b78-89b1bb277e8c,network=Network(cd37c3e7-5ffe-4b5d-a25c-a2bd288cb9d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc22c2020-a8') {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 10:05:50 user nova-compute[75229]: DEBUG os_vif [None req-73afdc65-a053-4518-9915-bb349cafa3cb tempest-ServerActionsV293TestJSON-1571447010 tempest-ServerActionsV293TestJSON-1571447010-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a6:6b:f6,bridge_name='br-int',has_traffic_filtering=True,id=c22c2020-a8ff-4cd5-8b78-89b1bb277e8c,network=Network(cd37c3e7-5ffe-4b5d-a25c-a2bd288cb9d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc22c2020-a8') {{(pid=75229) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 10:05:50 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:05:50 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc22c2020-a8, bridge=br-int, if_exists=True) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 10:05:50 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:05:50 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 10:05:50 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:05:50 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=48fe1454-cf81-44f9-8fed-2a4b0cb6a4af) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 10:05:50 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:05:50 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:05:50 user nova-compute[75229]: INFO os_vif [None req-73afdc65-a053-4518-9915-bb349cafa3cb tempest-ServerActionsV293TestJSON-1571447010 tempest-ServerActionsV293TestJSON-1571447010-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a6:6b:f6,bridge_name='br-int',has_traffic_filtering=True,id=c22c2020-a8ff-4cd5-8b78-89b1bb277e8c,network=Network(cd37c3e7-5ffe-4b5d-a25c-a2bd288cb9d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc22c2020-a8')
Nov 14 10:05:50 user nova-compute[75229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-73afdc65-a053-4518-9915-bb349cafa3cb tempest-ServerActionsV293TestJSON-1571447010 tempest-ServerActionsV293TestJSON-1571447010-project-member] [instance: 3795dd8f-8a10-4939-8f2c-bacefe5f5aa1] calling os-brick to detach iSCSI Volume {{(pid=75229) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 10:05:50 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-73afdc65-a053-4518-9915-bb349cafa3cb tempest-ServerActionsV293TestJSON-1571447010 tempest-ServerActionsV293TestJSON-1571447010-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f73f85151b0>, {'target_iqn': 'iqn.2010-10.org.openstack:4ddb200b-47ca-4449-9973-be76424a6761', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OQUwLneK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 10:05:50 user nova-compute[75229]: WARNING os_brick.initiator.connectors.base [None req-73afdc65-a053-4518-9915-bb349cafa3cb tempest-ServerActionsV293TestJSON-1571447010 tempest-ServerActionsV293TestJSON-1571447010-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 14 10:05:50 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-73afdc65-a053-4518-9915-bb349cafa3cb tempest-ServerActionsV293TestJSON-1571447010 tempest-ServerActionsV293TestJSON-1571447010-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 10:05:50 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-73afdc65-a053-4518-9915-bb349cafa3cb tempest-ServerActionsV293TestJSON-1571447010 tempest-ServerActionsV293TestJSON-1571447010-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 10:05:50 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:05:50 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:05:50 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b7d908f-15c4-4789-a98b-5f1d49df9bb3]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4ddb200b-47ca-4449-9973-be76424a6761\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7aee6091-dab3-4c39-88a1-4bbb28dcab45\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5aebc438-0289-44fe-ad84-4e696468f50e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e4a6dca6-1581-494f-afe5-3aac2b4d2c15\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:05:50 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-73afdc65-a053-4518-9915-bb349cafa3cb tempest-ServerActionsV293TestJSON-1571447010 tempest-ServerActionsV293TestJSON-1571447010-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 10:05:50 user nova-compute[75229]: No targets found.
Nov 14 10:05:50 user nova-compute[75229]: iSNS:
Nov 14 10:05:50 user nova-compute[75229]: No targets found.
Nov 14 10:05:50 user nova-compute[75229]: STATIC:
Nov 14 10:05:50 user nova-compute[75229]: Target: iqn.2010-10.org.openstack:4ddb200b-47ca-4449-9973-be76424a6761
Nov 14 10:05:50 user nova-compute[75229]:         Portal: 172.16.0.220:3260,-1
Nov 14 10:05:50 user nova-compute[75229]:                 Iface Name: default
Nov 14 10:05:50 user nova-compute[75229]: Target: iqn.2010-10.org.openstack:7aee6091-dab3-4c39-88a1-4bbb28dcab45
Nov 14 10:05:50 user nova-compute[75229]:         Portal: 172.16.0.220:3260,-1
Nov 14 10:05:50 user nova-compute[75229]:                 Iface Name: default
Nov 14 10:05:50 user nova-compute[75229]: Target: iqn.2010-10.org.openstack:5aebc438-0289-44fe-ad84-4e696468f50e
Nov 14 10:05:50 user nova-compute[75229]:         Portal: 172.16.0.220:3260,-1
Nov 14 10:05:50 user nova-compute[75229]:                 Iface Name: default
Nov 14 10:05:50 user nova-compute[75229]: Target: iqn.2010-10.org.openstack:e4a6dca6-1581-494f-afe5-3aac2b4d2c15
Nov 14 10:05:50 user nova-compute[75229]:         Portal: 172.16.0.220:3260,-1
Nov 14 10:05:50 user nova-compute[75229]:                 Iface Name: default
Nov 14 10:05:50 user nova-compute[75229]: FIRMWARE:
Nov 14 10:05:50 user nova-compute[75229]: No targets found.
Nov 14 10:05:50 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 10:05:50 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-73afdc65-a053-4518-9915-bb349cafa3cb tempest-ServerActionsV293TestJSON-1571447010 tempest-ServerActionsV293TestJSON-1571447010-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 10:05:50 user nova-compute[75229]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 10:05:50 user nova-compute[75229]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75229) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 10:05:50 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-73afdc65-a053-4518-9915-bb349cafa3cb tempest-ServerActionsV293TestJSON-1571447010 tempest-ServerActionsV293TestJSON-1571447010-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4ddb200b-47ca-4449-9973-be76424a6761', 0)] {{(pid=75229) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 10:05:50 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:05:50 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:05:50 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[b99dd73f-47f7-4558-9181-819fdb5c1cae]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4ddb200b-47ca-4449-9973-be76424a6761\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5aebc438-0289-44fe-ad84-4e696468f50e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7aee6091-dab3-4c39-88a1-4bbb28dcab45\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e4a6dca6-1581-494f-afe5-3aac2b4d2c15\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:05:50 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:05:50 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:05:50 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b2e9ab2-4d55-411b-be87-43ded6d0a1d9]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aebc438-0289-44fe-ad84-4e696468f50e (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ddb200b-47ca-4449-9973-be76424a6761 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4a6dca6-1581-494f-afe5-3aac2b4d2c15 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7aee6091-dab3-4c39-88a1-4bbb28dcab45 (non-flash)\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:05:50 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-73afdc65-a053-4518-9915-bb349cafa3cb tempest-ServerActionsV293TestJSON-1571447010 tempest-ServerActionsV293TestJSON-1571447010-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aebc438-0289-44fe-ad84-4e696468f50e (non-flash)
Nov 14 10:05:50 user nova-compute[75229]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ddb200b-47ca-4449-9973-be76424a6761 (non-flash)
Nov 14 10:05:50 user nova-compute[75229]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4a6dca6-1581-494f-afe5-3aac2b4d2c15 (non-flash)
Nov 14 10:05:50 user nova-compute[75229]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7aee6091-dab3-4c39-88a1-4bbb28dcab45 (non-flash)
Nov 14 10:05:50 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 10:05:50 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-73afdc65-a053-4518-9915-bb349cafa3cb tempest-ServerActionsV293TestJSON-1571447010 tempest-ServerActionsV293TestJSON-1571447010-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aebc438-0289-44fe-ad84-4e696468f50e (non-flash)
Nov 14 10:05:50 user nova-compute[75229]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ddb200b-47ca-4449-9973-be76424a6761 (non-flash)
Nov 14 10:05:50 user nova-compute[75229]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4a6dca6-1581-494f-afe5-3aac2b4d2c15 (non-flash)
Nov 14 10:05:50 user nova-compute[75229]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7aee6091-dab3-4c39-88a1-4bbb28dcab45 (non-flash)
Nov 14 10:05:50 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 10:05:50 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-73afdc65-a053-4518-9915-bb349cafa3cb tempest-ServerActionsV293TestJSON-1571447010 tempest-ServerActionsV293TestJSON-1571447010-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f73d4ccfb50>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4ddb200b-47ca-4449-9973-be76424a6761'): ({'sdf'}, set())}) {{(pid=75229) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 10:05:50 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-73afdc65-a053-4518-9915-bb349cafa3cb tempest-ServerActionsV293TestJSON-1571447010 tempest-ServerActionsV293TestJSON-1571447010-project-member] Removing single pathed devices sdf {{(pid=75229) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 10:05:50 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:05:50 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:05:50 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d438f9b-ded1-4a0c-bad4-aa0f62b1416c]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:05:50 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:05:50 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.019s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:05:50 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e655d0a-871e-457e-81ee-fa3a07d24caa]: (4, ('ok\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:05:50 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-73afdc65-a053-4518-9915-bb349cafa3cb tempest-ServerActionsV293TestJSON-1571447010 tempest-ServerActionsV293TestJSON-1571447010-project-member] Flushing IO for device /dev/sdf {{(pid=75229) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 10:05:50 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:05:50 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.014s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:05:50 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[1367d6fb-8d19-4716-8e55-793183ccad13]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:05:50 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-73afdc65-a053-4518-9915-bb349cafa3cb tempest-ServerActionsV293TestJSON-1571447010 tempest-ServerActionsV293TestJSON-1571447010-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75229) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 10:05:50 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:05:50 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.054s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:05:50 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[f162b76e-5541-4cc5-ae77-454caa639a46]: (4, ('1', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:05:50 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-73afdc65-a053-4518-9915-bb349cafa3cb tempest-ServerActionsV293TestJSON-1571447010 tempest-ServerActionsV293TestJSON-1571447010-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75229) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 10:05:50 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-73afdc65-a053-4518-9915-bb349cafa3cb tempest-ServerActionsV293TestJSON-1571447010 tempest-ServerActionsV293TestJSON-1571447010-project-member] SCSI volumes sdf have been removed. {{(pid=75229) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 10:05:50 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-73afdc65-a053-4518-9915-bb349cafa3cb tempest-ServerActionsV293TestJSON-1571447010 tempest-ServerActionsV293TestJSON-1571447010-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4ddb200b-47ca-4449-9973-be76424a6761')] {{(pid=75229) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 10:05:50 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ddb200b-47ca-4449-9973-be76424a6761 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:05:50 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ddb200b-47ca-4449-9973-be76424a6761 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:05:50 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[713c8046-65f3-4097-b9f3-76dfea8e4133]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:05:50 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-73afdc65-a053-4518-9915-bb349cafa3cb tempest-ServerActionsV293TestJSON-1571447010 tempest-ServerActionsV293TestJSON-1571447010-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 10:05:50 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ddb200b-47ca-4449-9973-be76424a6761 -p 172.16.0.220:3260 --logout {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:05:50 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ddb200b-47ca-4449-9973-be76424a6761 -p 172.16.0.220:3260 --logout" returned: 0 in 0.082s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:05:50 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[5812361e-025a-4902-b67f-a70236381369]: (4, ('Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:4ddb200b-47ca-4449-9973-be76424a6761, portal: 172.16.0.220,3260]\nLogout of [sid: 44, target: iqn.2010-10.org.openstack:4ddb200b-47ca-4449-9973-be76424a6761, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:05:50 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-73afdc65-a053-4518-9915-bb349cafa3cb tempest-ServerActionsV293TestJSON-1571447010 tempest-ServerActionsV293TestJSON-1571447010-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:4ddb200b-47ca-4449-9973-be76424a6761, portal: 172.16.0.220,3260]
Nov 14 10:05:50 user nova-compute[75229]: Logout of [sid: 44, target: iqn.2010-10.org.openstack:4ddb200b-47ca-4449-9973-be76424a6761, portal: 172.16.0.220,3260] successful.
Nov 14 10:05:50 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 10:05:50 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ddb200b-47ca-4449-9973-be76424a6761 -p 172.16.0.220:3260 --op delete {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:05:50 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ddb200b-47ca-4449-9973-be76424a6761 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:05:50 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[da3a7c98-7167-4fbb-b545-4a64ef8dbfbd]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:05:50 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-73afdc65-a053-4518-9915-bb349cafa3cb tempest-ServerActionsV293TestJSON-1571447010 tempest-ServerActionsV293TestJSON-1571447010-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 10:05:50 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-73afdc65-a053-4518-9915-bb349cafa3cb tempest-ServerActionsV293TestJSON-1571447010 tempest-ServerActionsV293TestJSON-1571447010-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.353s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 10:05:50 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-73afdc65-a053-4518-9915-bb349cafa3cb tempest-ServerActionsV293TestJSON-1571447010 tempest-ServerActionsV293TestJSON-1571447010-project-member] <== disconnect_volume: return (354ms) None {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 10:05:50 user nova-compute[75229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-73afdc65-a053-4518-9915-bb349cafa3cb tempest-ServerActionsV293TestJSON-1571447010 tempest-ServerActionsV293TestJSON-1571447010-project-member] [instance: 3795dd8f-8a10-4939-8f2c-bacefe5f5aa1] Disconnected iSCSI Volume {{(pid=75229) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 10:05:50 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-73afdc65-a053-4518-9915-bb349cafa3cb tempest-ServerActionsV293TestJSON-1571447010 tempest-ServerActionsV293TestJSON-1571447010-project-member] [instance: 3795dd8f-8a10-4939-8f2c-bacefe5f5aa1] Deleting instance files /opt/stack/data/nova/instances/3795dd8f-8a10-4939-8f2c-bacefe5f5aa1_del
Nov 14 10:05:50 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-73afdc65-a053-4518-9915-bb349cafa3cb tempest-ServerActionsV293TestJSON-1571447010 tempest-ServerActionsV293TestJSON-1571447010-project-member] [instance: 3795dd8f-8a10-4939-8f2c-bacefe5f5aa1] Deletion of /opt/stack/data/nova/instances/3795dd8f-8a10-4939-8f2c-bacefe5f5aa1_del complete
Nov 14 10:05:51 user nova-compute[75229]: WARNING nova.virt.libvirt.driver [None req-73afdc65-a053-4518-9915-bb349cafa3cb tempest-ServerActionsV293TestJSON-1571447010 tempest-ServerActionsV293TestJSON-1571447010-project-member] [instance: 3795dd8f-8a10-4939-8f2c-bacefe5f5aa1] During detach_volume, instance disappeared.: nova.exception.InstanceNotFound: Instance 3795dd8f-8a10-4939-8f2c-bacefe5f5aa1 could not be found.
Nov 14 10:05:51 user nova-compute[75229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-73afdc65-a053-4518-9915-bb349cafa3cb tempest-ServerActionsV293TestJSON-1571447010 tempest-ServerActionsV293TestJSON-1571447010-project-member] [instance: 3795dd8f-8a10-4939-8f2c-bacefe5f5aa1] calling os-brick to detach iSCSI Volume {{(pid=75229) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 10:05:51 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-73afdc65-a053-4518-9915-bb349cafa3cb tempest-ServerActionsV293TestJSON-1571447010 tempest-ServerActionsV293TestJSON-1571447010-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f73f85151b0>, {'target_iqn': 'iqn.2010-10.org.openstack:4ddb200b-47ca-4449-9973-be76424a6761', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OQUwLneK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 10:05:51 user nova-compute[75229]: WARNING os_brick.initiator.connectors.base [None req-73afdc65-a053-4518-9915-bb349cafa3cb tempest-ServerActionsV293TestJSON-1571447010 tempest-ServerActionsV293TestJSON-1571447010-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 14 10:05:51 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-73afdc65-a053-4518-9915-bb349cafa3cb tempest-ServerActionsV293TestJSON-1571447010 tempest-ServerActionsV293TestJSON-1571447010-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 10:05:51 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-73afdc65-a053-4518-9915-bb349cafa3cb tempest-ServerActionsV293TestJSON-1571447010 tempest-ServerActionsV293TestJSON-1571447010-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 10:05:51 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:05:51 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:05:51 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbbfe6cd-32d0-4cbf-a9d9-d5a3f003ebc0]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:7aee6091-dab3-4c39-88a1-4bbb28dcab45\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5aebc438-0289-44fe-ad84-4e696468f50e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e4a6dca6-1581-494f-afe5-3aac2b4d2c15\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:05:51 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-73afdc65-a053-4518-9915-bb349cafa3cb tempest-ServerActionsV293TestJSON-1571447010 tempest-ServerActionsV293TestJSON-1571447010-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 10:05:51 user nova-compute[75229]: No targets found.
Nov 14 10:05:51 user nova-compute[75229]: iSNS:
Nov 14 10:05:51 user nova-compute[75229]: No targets found.
Nov 14 10:05:51 user nova-compute[75229]: STATIC:
Nov 14 10:05:51 user nova-compute[75229]: Target: iqn.2010-10.org.openstack:7aee6091-dab3-4c39-88a1-4bbb28dcab45
Nov 14 10:05:51 user nova-compute[75229]:         Portal: 172.16.0.220:3260,-1
Nov 14 10:05:51 user nova-compute[75229]:                 Iface Name: default
Nov 14 10:05:51 user nova-compute[75229]: Target: iqn.2010-10.org.openstack:5aebc438-0289-44fe-ad84-4e696468f50e
Nov 14 10:05:51 user nova-compute[75229]:         Portal: 172.16.0.220:3260,-1
Nov 14 10:05:51 user nova-compute[75229]:                 Iface Name: default
Nov 14 10:05:51 user nova-compute[75229]: Target: iqn.2010-10.org.openstack:e4a6dca6-1581-494f-afe5-3aac2b4d2c15
Nov 14 10:05:51 user nova-compute[75229]:         Portal: 172.16.0.220:3260,-1
Nov 14 10:05:51 user nova-compute[75229]:                 Iface Name: default
Nov 14 10:05:51 user nova-compute[75229]: FIRMWARE:
Nov 14 10:05:51 user nova-compute[75229]: No targets found.
Nov 14 10:05:51 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 10:05:51 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-73afdc65-a053-4518-9915-bb349cafa3cb tempest-ServerActionsV293TestJSON-1571447010 tempest-ServerActionsV293TestJSON-1571447010-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 10:05:51 user nova-compute[75229]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 10:05:51 user nova-compute[75229]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75229) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 10:05:51 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-73afdc65-a053-4518-9915-bb349cafa3cb tempest-ServerActionsV293TestJSON-1571447010 tempest-ServerActionsV293TestJSON-1571447010-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4ddb200b-47ca-4449-9973-be76424a6761', 0)] {{(pid=75229) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 10:05:51 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:05:51 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:05:51 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[234c7457-2b8a-427d-a446-9ee076476448]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5aebc438-0289-44fe-ad84-4e696468f50e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7aee6091-dab3-4c39-88a1-4bbb28dcab45\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e4a6dca6-1581-494f-afe5-3aac2b4d2c15\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:05:51 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:05:51 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:05:51 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[52a12e5b-2580-4672-b297-145b4da0b42e]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aebc438-0289-44fe-ad84-4e696468f50e (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4a6dca6-1581-494f-afe5-3aac2b4d2c15 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7aee6091-dab3-4c39-88a1-4bbb28dcab45 (non-flash)\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:05:51 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-73afdc65-a053-4518-9915-bb349cafa3cb tempest-ServerActionsV293TestJSON-1571447010 tempest-ServerActionsV293TestJSON-1571447010-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aebc438-0289-44fe-ad84-4e696468f50e (non-flash)
Nov 14 10:05:51 user nova-compute[75229]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4a6dca6-1581-494f-afe5-3aac2b4d2c15 (non-flash)
Nov 14 10:05:51 user nova-compute[75229]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7aee6091-dab3-4c39-88a1-4bbb28dcab45 (non-flash)
Nov 14 10:05:51 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 10:05:51 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-73afdc65-a053-4518-9915-bb349cafa3cb tempest-ServerActionsV293TestJSON-1571447010 tempest-ServerActionsV293TestJSON-1571447010-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aebc438-0289-44fe-ad84-4e696468f50e (non-flash)
Nov 14 10:05:51 user nova-compute[75229]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4a6dca6-1581-494f-afe5-3aac2b4d2c15 (non-flash)
Nov 14 10:05:51 user nova-compute[75229]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7aee6091-dab3-4c39-88a1-4bbb28dcab45 (non-flash)
Nov 14 10:05:51 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 10:05:51 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-73afdc65-a053-4518-9915-bb349cafa3cb tempest-ServerActionsV293TestJSON-1571447010 tempest-ServerActionsV293TestJSON-1571447010-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f73d4c524d0>, {}) {{(pid=75229) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 10:05:51 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-73afdc65-a053-4518-9915-bb349cafa3cb tempest-ServerActionsV293TestJSON-1571447010 tempest-ServerActionsV293TestJSON-1571447010-project-member] Disconnecting from: [] {{(pid=75229) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 10:05:51 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-73afdc65-a053-4518-9915-bb349cafa3cb tempest-ServerActionsV293TestJSON-1571447010 tempest-ServerActionsV293TestJSON-1571447010-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.076s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 10:05:51 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-73afdc65-a053-4518-9915-bb349cafa3cb tempest-ServerActionsV293TestJSON-1571447010 tempest-ServerActionsV293TestJSON-1571447010-project-member] <== disconnect_volume: return (77ms) None {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 10:05:51 user nova-compute[75229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-73afdc65-a053-4518-9915-bb349cafa3cb tempest-ServerActionsV293TestJSON-1571447010 tempest-ServerActionsV293TestJSON-1571447010-project-member] [instance: 3795dd8f-8a10-4939-8f2c-bacefe5f5aa1] Disconnected iSCSI Volume {{(pid=75229) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 10:05:51 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-82e2baff-f09f-4ae0-b468-a990d90d0da8 tempest-TestServerVolumeAttachmentScenario-1041667837 tempest-TestServerVolumeAttachmentScenario-1041667837-project-member] Acquiring lock "764de1b0-b77f-457a-8355-e5cdc1f6eab1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:05:51 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-82e2baff-f09f-4ae0-b468-a990d90d0da8 tempest-TestServerVolumeAttachmentScenario-1041667837 tempest-TestServerVolumeAttachmentScenario-1041667837-project-member] Lock "764de1b0-b77f-457a-8355-e5cdc1f6eab1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:05:51 user nova-compute[75229]: DEBUG nova.compute.manager [None req-82e2baff-f09f-4ae0-b468-a990d90d0da8 tempest-TestServerVolumeAttachmentScenario-1041667837 tempest-TestServerVolumeAttachmentScenario-1041667837-project-member] [instance: 764de1b0-b77f-457a-8355-e5cdc1f6eab1] Starting instance... {{(pid=75229) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 10:05:51 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-82e2baff-f09f-4ae0-b468-a990d90d0da8 tempest-TestServerVolumeAttachmentScenario-1041667837 tempest-TestServerVolumeAttachmentScenario-1041667837-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:05:51 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-82e2baff-f09f-4ae0-b468-a990d90d0da8 tempest-TestServerVolumeAttachmentScenario-1041667837 tempest-TestServerVolumeAttachmentScenario-1041667837-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:05:51 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-82e2baff-f09f-4ae0-b468-a990d90d0da8 tempest-TestServerVolumeAttachmentScenario-1041667837 tempest-TestServerVolumeAttachmentScenario-1041667837-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75229) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 10:05:51 user nova-compute[75229]: INFO nova.compute.claims [None req-82e2baff-f09f-4ae0-b468-a990d90d0da8 tempest-TestServerVolumeAttachmentScenario-1041667837 tempest-TestServerVolumeAttachmentScenario-1041667837-project-member] [instance: 764de1b0-b77f-457a-8355-e5cdc1f6eab1] Claim successful on node user
Nov 14 10:05:51 user nova-compute[75229]: DEBUG nova.compute.provider_tree [None req-82e2baff-f09f-4ae0-b468-a990d90d0da8 tempest-TestServerVolumeAttachmentScenario-1041667837 tempest-TestServerVolumeAttachmentScenario-1041667837-project-member] Inventory has not changed in ProviderTree for provider: d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 {{(pid=75229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 10:05:51 user nova-compute[75229]: DEBUG nova.scheduler.client.report [None req-82e2baff-f09f-4ae0-b468-a990d90d0da8 tempest-TestServerVolumeAttachmentScenario-1041667837 tempest-TestServerVolumeAttachmentScenario-1041667837-project-member] Inventory has not changed for provider d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 10:05:51 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-82e2baff-f09f-4ae0-b468-a990d90d0da8 tempest-TestServerVolumeAttachmentScenario-1041667837 tempest-TestServerVolumeAttachmentScenario-1041667837-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.319s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:05:51 user nova-compute[75229]: DEBUG nova.compute.manager [None req-82e2baff-f09f-4ae0-b468-a990d90d0da8 tempest-TestServerVolumeAttachmentScenario-1041667837 tempest-TestServerVolumeAttachmentScenario-1041667837-project-member] [instance: 764de1b0-b77f-457a-8355-e5cdc1f6eab1] Start building networks asynchronously for instance. {{(pid=75229) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 10:05:51 user nova-compute[75229]: DEBUG nova.compute.manager [None req-82e2baff-f09f-4ae0-b468-a990d90d0da8 tempest-TestServerVolumeAttachmentScenario-1041667837 tempest-TestServerVolumeAttachmentScenario-1041667837-project-member] [instance: 764de1b0-b77f-457a-8355-e5cdc1f6eab1] Allocating IP information in the background. {{(pid=75229) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 10:05:51 user nova-compute[75229]: DEBUG nova.network.neutron [None req-82e2baff-f09f-4ae0-b468-a990d90d0da8 tempest-TestServerVolumeAttachmentScenario-1041667837 tempest-TestServerVolumeAttachmentScenario-1041667837-project-member] [instance: 764de1b0-b77f-457a-8355-e5cdc1f6eab1] allocate_for_instance() {{(pid=75229) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 10:05:51 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-82e2baff-f09f-4ae0-b468-a990d90d0da8 tempest-TestServerVolumeAttachmentScenario-1041667837 tempest-TestServerVolumeAttachmentScenario-1041667837-project-member] [instance: 764de1b0-b77f-457a-8355-e5cdc1f6eab1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 10:05:51 user nova-compute[75229]: DEBUG nova.compute.manager [None req-73afdc65-a053-4518-9915-bb349cafa3cb tempest-ServerActionsV293TestJSON-1571447010 tempest-ServerActionsV293TestJSON-1571447010-project-member] [instance: 3795dd8f-8a10-4939-8f2c-bacefe5f5aa1] Preparing to wait for external event volume-reimaged-4ddb200b-47ca-4449-9973-be76424a6761 {{(pid=75229) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:283}}
Nov 14 10:05:51 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-73afdc65-a053-4518-9915-bb349cafa3cb tempest-ServerActionsV293TestJSON-1571447010 tempest-ServerActionsV293TestJSON-1571447010-project-member] Acquiring lock "3795dd8f-8a10-4939-8f2c-bacefe5f5aa1-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:05:51 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-73afdc65-a053-4518-9915-bb349cafa3cb tempest-ServerActionsV293TestJSON-1571447010 tempest-ServerActionsV293TestJSON-1571447010-project-member] Lock "3795dd8f-8a10-4939-8f2c-bacefe5f5aa1-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:05:51 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-73afdc65-a053-4518-9915-bb349cafa3cb tempest-ServerActionsV293TestJSON-1571447010 tempest-ServerActionsV293TestJSON-1571447010-project-member] Lock "3795dd8f-8a10-4939-8f2c-bacefe5f5aa1-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:05:51 user nova-compute[75229]: DEBUG nova.compute.manager [None req-82e2baff-f09f-4ae0-b468-a990d90d0da8 tempest-TestServerVolumeAttachmentScenario-1041667837 tempest-TestServerVolumeAttachmentScenario-1041667837-project-member] [instance: 764de1b0-b77f-457a-8355-e5cdc1f6eab1] Start building block device mappings for instance. {{(pid=75229) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 10:05:52 user nova-compute[75229]: DEBUG nova.compute.manager [None req-82e2baff-f09f-4ae0-b468-a990d90d0da8 tempest-TestServerVolumeAttachmentScenario-1041667837 tempest-TestServerVolumeAttachmentScenario-1041667837-project-member] [instance: 764de1b0-b77f-457a-8355-e5cdc1f6eab1] Start spawning the instance on the hypervisor. {{(pid=75229) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 10:05:52 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-82e2baff-f09f-4ae0-b468-a990d90d0da8 tempest-TestServerVolumeAttachmentScenario-1041667837 tempest-TestServerVolumeAttachmentScenario-1041667837-project-member] [instance: 764de1b0-b77f-457a-8355-e5cdc1f6eab1] Creating instance directory {{(pid=75229) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 10:05:52 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-82e2baff-f09f-4ae0-b468-a990d90d0da8 tempest-TestServerVolumeAttachmentScenario-1041667837 tempest-TestServerVolumeAttachmentScenario-1041667837-project-member] [instance: 764de1b0-b77f-457a-8355-e5cdc1f6eab1] Creating image(s)
Nov 14 10:05:52 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-82e2baff-f09f-4ae0-b468-a990d90d0da8 tempest-TestServerVolumeAttachmentScenario-1041667837 tempest-TestServerVolumeAttachmentScenario-1041667837-project-member] Acquiring lock "/opt/stack/data/nova/instances/764de1b0-b77f-457a-8355-e5cdc1f6eab1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:05:52 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-82e2baff-f09f-4ae0-b468-a990d90d0da8 tempest-TestServerVolumeAttachmentScenario-1041667837 tempest-TestServerVolumeAttachmentScenario-1041667837-project-member] Lock "/opt/stack/data/nova/instances/764de1b0-b77f-457a-8355-e5cdc1f6eab1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:05:52 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-82e2baff-f09f-4ae0-b468-a990d90d0da8 tempest-TestServerVolumeAttachmentScenario-1041667837 tempest-TestServerVolumeAttachmentScenario-1041667837-project-member] Lock "/opt/stack/data/nova/instances/764de1b0-b77f-457a-8355-e5cdc1f6eab1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:05:52 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-82e2baff-f09f-4ae0-b468-a990d90d0da8 tempest-TestServerVolumeAttachmentScenario-1041667837 tempest-TestServerVolumeAttachmentScenario-1041667837-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6 --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:05:52 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-82e2baff-f09f-4ae0-b468-a990d90d0da8 tempest-TestServerVolumeAttachmentScenario-1041667837 tempest-TestServerVolumeAttachmentScenario-1041667837-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6 --force-share --output=json" returned: 0 in 0.181s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:05:52 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-82e2baff-f09f-4ae0-b468-a990d90d0da8 tempest-TestServerVolumeAttachmentScenario-1041667837 tempest-TestServerVolumeAttachmentScenario-1041667837-project-member] Acquiring lock "4f30e3fe703d2381679612a57b1fb80a467f60b6" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:05:52 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-82e2baff-f09f-4ae0-b468-a990d90d0da8 tempest-TestServerVolumeAttachmentScenario-1041667837 tempest-TestServerVolumeAttachmentScenario-1041667837-project-member] Lock "4f30e3fe703d2381679612a57b1fb80a467f60b6" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:05:52 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-82e2baff-f09f-4ae0-b468-a990d90d0da8 tempest-TestServerVolumeAttachmentScenario-1041667837 tempest-TestServerVolumeAttachmentScenario-1041667837-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6 --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:05:52 user nova-compute[75229]: DEBUG nova.policy [None req-82e2baff-f09f-4ae0-b468-a990d90d0da8 tempest-TestServerVolumeAttachmentScenario-1041667837 tempest-TestServerVolumeAttachmentScenario-1041667837-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '02f3e8ddba2440a19e39667c631d05e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81daef5439a43b491516bf86286dedd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75229) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 10:05:52 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-82e2baff-f09f-4ae0-b468-a990d90d0da8 tempest-TestServerVolumeAttachmentScenario-1041667837 tempest-TestServerVolumeAttachmentScenario-1041667837-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6 --force-share --output=json" returned: 0 in 0.173s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:05:52 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-82e2baff-f09f-4ae0-b468-a990d90d0da8 tempest-TestServerVolumeAttachmentScenario-1041667837 tempest-TestServerVolumeAttachmentScenario-1041667837-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6,backing_fmt=raw /opt/stack/data/nova/instances/764de1b0-b77f-457a-8355-e5cdc1f6eab1/disk 1073741824 {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:05:52 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-82e2baff-f09f-4ae0-b468-a990d90d0da8 tempest-TestServerVolumeAttachmentScenario-1041667837 tempest-TestServerVolumeAttachmentScenario-1041667837-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6,backing_fmt=raw /opt/stack/data/nova/instances/764de1b0-b77f-457a-8355-e5cdc1f6eab1/disk 1073741824" returned: 0 in 0.053s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:05:52 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-82e2baff-f09f-4ae0-b468-a990d90d0da8 tempest-TestServerVolumeAttachmentScenario-1041667837 tempest-TestServerVolumeAttachmentScenario-1041667837-project-member] Lock "4f30e3fe703d2381679612a57b1fb80a467f60b6" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.230s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:05:52 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-82e2baff-f09f-4ae0-b468-a990d90d0da8 tempest-TestServerVolumeAttachmentScenario-1041667837 tempest-TestServerVolumeAttachmentScenario-1041667837-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6 --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:05:52 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-82e2baff-f09f-4ae0-b468-a990d90d0da8 tempest-TestServerVolumeAttachmentScenario-1041667837 tempest-TestServerVolumeAttachmentScenario-1041667837-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6 --force-share --output=json" returned: 0 in 0.167s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:05:52 user nova-compute[75229]: DEBUG nova.virt.disk.api [None req-82e2baff-f09f-4ae0-b468-a990d90d0da8 tempest-TestServerVolumeAttachmentScenario-1041667837 tempest-TestServerVolumeAttachmentScenario-1041667837-project-member] Checking if we can resize image /opt/stack/data/nova/instances/764de1b0-b77f-457a-8355-e5cdc1f6eab1/disk. size=1073741824 {{(pid=75229) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 10:05:52 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-82e2baff-f09f-4ae0-b468-a990d90d0da8 tempest-TestServerVolumeAttachmentScenario-1041667837 tempest-TestServerVolumeAttachmentScenario-1041667837-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/764de1b0-b77f-457a-8355-e5cdc1f6eab1/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:05:52 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-82e2baff-f09f-4ae0-b468-a990d90d0da8 tempest-TestServerVolumeAttachmentScenario-1041667837 tempest-TestServerVolumeAttachmentScenario-1041667837-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/764de1b0-b77f-457a-8355-e5cdc1f6eab1/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:05:52 user nova-compute[75229]: DEBUG nova.virt.disk.api [None req-82e2baff-f09f-4ae0-b468-a990d90d0da8 tempest-TestServerVolumeAttachmentScenario-1041667837 tempest-TestServerVolumeAttachmentScenario-1041667837-project-member] Cannot resize image /opt/stack/data/nova/instances/764de1b0-b77f-457a-8355-e5cdc1f6eab1/disk to a smaller size. {{(pid=75229) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 10:05:52 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-82e2baff-f09f-4ae0-b468-a990d90d0da8 tempest-TestServerVolumeAttachmentScenario-1041667837 tempest-TestServerVolumeAttachmentScenario-1041667837-project-member] [instance: 764de1b0-b77f-457a-8355-e5cdc1f6eab1] Created local disks {{(pid=75229) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 10:05:52 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-82e2baff-f09f-4ae0-b468-a990d90d0da8 tempest-TestServerVolumeAttachmentScenario-1041667837 tempest-TestServerVolumeAttachmentScenario-1041667837-project-member] [instance: 764de1b0-b77f-457a-8355-e5cdc1f6eab1] Ensure instance console log exists: /opt/stack/data/nova/instances/764de1b0-b77f-457a-8355-e5cdc1f6eab1/console.log {{(pid=75229) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 10:05:52 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-82e2baff-f09f-4ae0-b468-a990d90d0da8 tempest-TestServerVolumeAttachmentScenario-1041667837 tempest-TestServerVolumeAttachmentScenario-1041667837-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:05:52 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-82e2baff-f09f-4ae0-b468-a990d90d0da8 tempest-TestServerVolumeAttachmentScenario-1041667837 tempest-TestServerVolumeAttachmentScenario-1041667837-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:05:52 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-82e2baff-f09f-4ae0-b468-a990d90d0da8 tempest-TestServerVolumeAttachmentScenario-1041667837 tempest-TestServerVolumeAttachmentScenario-1041667837-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:05:53 user nova-compute[75229]: DEBUG nova.network.neutron [None req-82e2baff-f09f-4ae0-b468-a990d90d0da8 tempest-TestServerVolumeAttachmentScenario-1041667837 tempest-TestServerVolumeAttachmentScenario-1041667837-project-member] [instance: 764de1b0-b77f-457a-8355-e5cdc1f6eab1] Successfully created port: 09e96897-482d-402e-adcc-e8bf9010391d {{(pid=75229) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 10:05:53 user nova-compute[75229]: DEBUG nova.compute.manager [req-f7f33667-259b-4bd2-b72e-cc0b1365b3a9 req-de14f01f-9d2b-49d8-b849-aa328fc00752 service nova] [instance: 3795dd8f-8a10-4939-8f2c-bacefe5f5aa1] Received event network-vif-unplugged-c22c2020-a8ff-4cd5-8b78-89b1bb277e8c {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 10:05:53 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-f7f33667-259b-4bd2-b72e-cc0b1365b3a9 req-de14f01f-9d2b-49d8-b849-aa328fc00752 service nova] Acquiring lock "3795dd8f-8a10-4939-8f2c-bacefe5f5aa1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:05:53 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-f7f33667-259b-4bd2-b72e-cc0b1365b3a9 req-de14f01f-9d2b-49d8-b849-aa328fc00752 service nova] Lock "3795dd8f-8a10-4939-8f2c-bacefe5f5aa1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:05:53 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-f7f33667-259b-4bd2-b72e-cc0b1365b3a9 req-de14f01f-9d2b-49d8-b849-aa328fc00752 service nova] Lock "3795dd8f-8a10-4939-8f2c-bacefe5f5aa1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:05:53 user nova-compute[75229]: DEBUG nova.compute.manager [req-f7f33667-259b-4bd2-b72e-cc0b1365b3a9 req-de14f01f-9d2b-49d8-b849-aa328fc00752 service nova] [instance: 3795dd8f-8a10-4939-8f2c-bacefe5f5aa1] No event matching network-vif-unplugged-c22c2020-a8ff-4cd5-8b78-89b1bb277e8c in dict_keys([('volume-reimaged', '4ddb200b-47ca-4449-9973-be76424a6761')]) {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:325}}
Nov 14 10:05:53 user nova-compute[75229]: WARNING nova.compute.manager [req-f7f33667-259b-4bd2-b72e-cc0b1365b3a9 req-de14f01f-9d2b-49d8-b849-aa328fc00752 service nova] [instance: 3795dd8f-8a10-4939-8f2c-bacefe5f5aa1] Received unexpected event network-vif-unplugged-c22c2020-a8ff-4cd5-8b78-89b1bb277e8c for instance with vm_state active and task_state rebuilding.
Nov 14 10:05:53 user nova-compute[75229]: DEBUG nova.network.neutron [None req-82e2baff-f09f-4ae0-b468-a990d90d0da8 tempest-TestServerVolumeAttachmentScenario-1041667837 tempest-TestServerVolumeAttachmentScenario-1041667837-project-member] [instance: 764de1b0-b77f-457a-8355-e5cdc1f6eab1] Successfully updated port: 09e96897-482d-402e-adcc-e8bf9010391d {{(pid=75229) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 10:05:53 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-82e2baff-f09f-4ae0-b468-a990d90d0da8 tempest-TestServerVolumeAttachmentScenario-1041667837 tempest-TestServerVolumeAttachmentScenario-1041667837-project-member] Acquiring lock "refresh_cache-764de1b0-b77f-457a-8355-e5cdc1f6eab1" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 10:05:53 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-82e2baff-f09f-4ae0-b468-a990d90d0da8 tempest-TestServerVolumeAttachmentScenario-1041667837 tempest-TestServerVolumeAttachmentScenario-1041667837-project-member] Acquired lock "refresh_cache-764de1b0-b77f-457a-8355-e5cdc1f6eab1" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 10:05:53 user nova-compute[75229]: DEBUG nova.network.neutron [None req-82e2baff-f09f-4ae0-b468-a990d90d0da8 tempest-TestServerVolumeAttachmentScenario-1041667837 tempest-TestServerVolumeAttachmentScenario-1041667837-project-member] [instance: 764de1b0-b77f-457a-8355-e5cdc1f6eab1] Building network info cache for instance {{(pid=75229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 10:05:53 user nova-compute[75229]: DEBUG nova.compute.manager [req-3b50e9e5-0374-4415-88b9-7372d599edfc req-344a1d11-25b2-47e6-aac5-8e017b8c062c service nova] [instance: 764de1b0-b77f-457a-8355-e5cdc1f6eab1] Received event network-changed-09e96897-482d-402e-adcc-e8bf9010391d {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 10:05:53 user nova-compute[75229]: DEBUG nova.compute.manager [req-3b50e9e5-0374-4415-88b9-7372d599edfc req-344a1d11-25b2-47e6-aac5-8e017b8c062c service nova] [instance: 764de1b0-b77f-457a-8355-e5cdc1f6eab1] Refreshing instance network info cache due to event network-changed-09e96897-482d-402e-adcc-e8bf9010391d. {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 10:05:53 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-3b50e9e5-0374-4415-88b9-7372d599edfc req-344a1d11-25b2-47e6-aac5-8e017b8c062c service nova] Acquiring lock "refresh_cache-764de1b0-b77f-457a-8355-e5cdc1f6eab1" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 10:05:53 user nova-compute[75229]: DEBUG nova.network.neutron [None req-82e2baff-f09f-4ae0-b468-a990d90d0da8 tempest-TestServerVolumeAttachmentScenario-1041667837 tempest-TestServerVolumeAttachmentScenario-1041667837-project-member] [instance: 764de1b0-b77f-457a-8355-e5cdc1f6eab1] Instance cache missing network info. {{(pid=75229) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 10:05:53 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:05:54 user nova-compute[75229]: DEBUG nova.network.neutron [None req-82e2baff-f09f-4ae0-b468-a990d90d0da8 tempest-TestServerVolumeAttachmentScenario-1041667837 tempest-TestServerVolumeAttachmentScenario-1041667837-project-member] [instance: 764de1b0-b77f-457a-8355-e5cdc1f6eab1] Updating instance_info_cache with network_info: [{"id": "09e96897-482d-402e-adcc-e8bf9010391d", "address": "fa:16:3e:75:4a:25", "network": {"id": "84ceafdd-3b62-438f-bd6c-9a51224c1011", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1430955242-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f81daef5439a43b491516bf86286dedd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09e96897-48", "ovs_interfaceid": "09e96897-482d-402e-adcc-e8bf9010391d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 10:05:54 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-82e2baff-f09f-4ae0-b468-a990d90d0da8 tempest-TestServerVolumeAttachmentScenario-1041667837 tempest-TestServerVolumeAttachmentScenario-1041667837-project-member] Releasing lock "refresh_cache-764de1b0-b77f-457a-8355-e5cdc1f6eab1" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 10:05:54 user nova-compute[75229]: DEBUG nova.compute.manager [None req-82e2baff-f09f-4ae0-b468-a990d90d0da8 tempest-TestServerVolumeAttachmentScenario-1041667837 tempest-TestServerVolumeAttachmentScenario-1041667837-project-member] [instance: 764de1b0-b77f-457a-8355-e5cdc1f6eab1] Instance network_info: |[{"id": "09e96897-482d-402e-adcc-e8bf9010391d", "address": "fa:16:3e:75:4a:25", "network": {"id": "84ceafdd-3b62-438f-bd6c-9a51224c1011", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1430955242-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f81daef5439a43b491516bf86286dedd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09e96897-48", "ovs_interfaceid": "09e96897-482d-402e-adcc-e8bf9010391d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75229) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 10:05:54 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-3b50e9e5-0374-4415-88b9-7372d599edfc req-344a1d11-25b2-47e6-aac5-8e017b8c062c service nova] Acquired lock "refresh_cache-764de1b0-b77f-457a-8355-e5cdc1f6eab1" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 10:05:54 user nova-compute[75229]: DEBUG nova.network.neutron [req-3b50e9e5-0374-4415-88b9-7372d599edfc req-344a1d11-25b2-47e6-aac5-8e017b8c062c service nova] [instance: 764de1b0-b77f-457a-8355-e5cdc1f6eab1] Refreshing network info cache for port 09e96897-482d-402e-adcc-e8bf9010391d {{(pid=75229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 10:05:54 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-82e2baff-f09f-4ae0-b468-a990d90d0da8 tempest-TestServerVolumeAttachmentScenario-1041667837 tempest-TestServerVolumeAttachmentScenario-1041667837-project-member] [instance: 764de1b0-b77f-457a-8355-e5cdc1f6eab1] Start _get_guest_xml network_info=[{"id": "09e96897-482d-402e-adcc-e8bf9010391d", "address": "fa:16:3e:75:4a:25", "network": {"id": "84ceafdd-3b62-438f-bd6c-9a51224c1011", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1430955242-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f81daef5439a43b491516bf86286dedd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09e96897-48", "ovs_interfaceid": "09e96897-482d-402e-adcc-e8bf9010391d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T09:40:10Z,direct_url=<?>,disk_format='qcow2',id=3bef8470-ecc7-40e3-95d4-9254348ea72d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='de5a91106b6948ed937a7178ff9464c4',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T09:40:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'disk_bus': 'virtio', 'guest_format': None, 'encryption_secret_uuid': None, 'size': 0, 'device_type': 'disk', 'image_id': '3bef8470-ecc7-40e3-95d4-9254348ea72d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75229) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 10:05:54 user nova-compute[75229]: WARNING nova.virt.libvirt.driver [None req-82e2baff-f09f-4ae0-b468-a990d90d0da8 tempest-TestServerVolumeAttachmentScenario-1041667837 tempest-TestServerVolumeAttachmentScenario-1041667837-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 10:05:54 user nova-compute[75229]: WARNING nova.virt.libvirt.driver [None req-82e2baff-f09f-4ae0-b468-a990d90d0da8 tempest-TestServerVolumeAttachmentScenario-1041667837 tempest-TestServerVolumeAttachmentScenario-1041667837-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 10:05:54 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-82e2baff-f09f-4ae0-b468-a990d90d0da8 tempest-TestServerVolumeAttachmentScenario-1041667837 tempest-TestServerVolumeAttachmentScenario-1041667837-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75229) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 10:05:54 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-82e2baff-f09f-4ae0-b468-a990d90d0da8 tempest-TestServerVolumeAttachmentScenario-1041667837 tempest-TestServerVolumeAttachmentScenario-1041667837-project-member] CPU controller missing on host. {{(pid=75229) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 10:05:54 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-82e2baff-f09f-4ae0-b468-a990d90d0da8 tempest-TestServerVolumeAttachmentScenario-1041667837 tempest-TestServerVolumeAttachmentScenario-1041667837-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75229) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 10:05:54 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-82e2baff-f09f-4ae0-b468-a990d90d0da8 tempest-TestServerVolumeAttachmentScenario-1041667837 tempest-TestServerVolumeAttachmentScenario-1041667837-project-member] CPU controller found on host. {{(pid=75229) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 10:05:54 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-82e2baff-f09f-4ae0-b468-a990d90d0da8 tempest-TestServerVolumeAttachmentScenario-1041667837 tempest-TestServerVolumeAttachmentScenario-1041667837-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75229) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 10:05:54 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-82e2baff-f09f-4ae0-b468-a990d90d0da8 tempest-TestServerVolumeAttachmentScenario-1041667837 tempest-TestServerVolumeAttachmentScenario-1041667837-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T09:39:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T09:40:10Z,direct_url=<?>,disk_format='qcow2',id=3bef8470-ecc7-40e3-95d4-9254348ea72d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='de5a91106b6948ed937a7178ff9464c4',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T09:40:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 10:05:54 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-82e2baff-f09f-4ae0-b468-a990d90d0da8 tempest-TestServerVolumeAttachmentScenario-1041667837 tempest-TestServerVolumeAttachmentScenario-1041667837-project-member] Flavor limits 0:0:0 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 10:05:54 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-82e2baff-f09f-4ae0-b468-a990d90d0da8 tempest-TestServerVolumeAttachmentScenario-1041667837 tempest-TestServerVolumeAttachmentScenario-1041667837-project-member] Image limits 0:0:0 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 10:05:54 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-82e2baff-f09f-4ae0-b468-a990d90d0da8 tempest-TestServerVolumeAttachmentScenario-1041667837 tempest-TestServerVolumeAttachmentScenario-1041667837-project-member] Flavor pref 0:0:0 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 10:05:54 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-82e2baff-f09f-4ae0-b468-a990d90d0da8 tempest-TestServerVolumeAttachmentScenario-1041667837 tempest-TestServerVolumeAttachmentScenario-1041667837-project-member] Image pref 0:0:0 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 10:05:54 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-82e2baff-f09f-4ae0-b468-a990d90d0da8 tempest-TestServerVolumeAttachmentScenario-1041667837 tempest-TestServerVolumeAttachmentScenario-1041667837-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 10:05:54 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-82e2baff-f09f-4ae0-b468-a990d90d0da8 tempest-TestServerVolumeAttachmentScenario-1041667837 tempest-TestServerVolumeAttachmentScenario-1041667837-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 10:05:54 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-82e2baff-f09f-4ae0-b468-a990d90d0da8 tempest-TestServerVolumeAttachmentScenario-1041667837 tempest-TestServerVolumeAttachmentScenario-1041667837-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75229) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 10:05:54 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-82e2baff-f09f-4ae0-b468-a990d90d0da8 tempest-TestServerVolumeAttachmentScenario-1041667837 tempest-TestServerVolumeAttachmentScenario-1041667837-project-member] Got 1 possible topologies {{(pid=75229) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 10:05:54 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-82e2baff-f09f-4ae0-b468-a990d90d0da8 tempest-TestServerVolumeAttachmentScenario-1041667837 tempest-TestServerVolumeAttachmentScenario-1041667837-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 10:05:54 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-82e2baff-f09f-4ae0-b468-a990d90d0da8 tempest-TestServerVolumeAttachmentScenario-1041667837 tempest-TestServerVolumeAttachmentScenario-1041667837-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 10:05:54 user nova-compute[75229]: DEBUG nova.virt.libvirt.vif [None req-82e2baff-f09f-4ae0-b468-a990d90d0da8 tempest-TestServerVolumeAttachmentScenario-1041667837 tempest-TestServerVolumeAttachmentScenario-1041667837-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T10:05:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1685617180',display_name='tempest-TestServerVolumeAttachmentScenario-server-1685617180',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-1685617180',id=46,image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD79XoXeIgMnwTE/y9Tph2kig8sN23JlGJReIYWTL94EUr+1CcaCZFmtJksTfKMy6YewtU06l9jNgs56keZ4Fcdwo/XpWvKVOVkLl8Gkn4bSkE2q+LJNdRDti3vg7c9FEw==',key_name='tempest-keypair-2106072250',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f81daef5439a43b491516bf86286dedd',ramdisk_id='',reservation_id='r-0cld79i0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1041667837',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1041667837-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T10:05:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='02f3e8ddba2440a19e39667c631d05e6',uuid=764de1b0-b77f-457a-8355-e5cdc1f6eab1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "09e96897-482d-402e-adcc-e8bf9010391d", "address": "fa:16:3e:75:4a:25", "network": {"id": "84ceafdd-3b62-438f-bd6c-9a51224c1011", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1430955242-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f81daef5439a43b491516bf86286dedd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09e96897-48", "ovs_interfaceid": "09e96897-482d-402e-adcc-e8bf9010391d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75229) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 10:05:54 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-82e2baff-f09f-4ae0-b468-a990d90d0da8 tempest-TestServerVolumeAttachmentScenario-1041667837 tempest-TestServerVolumeAttachmentScenario-1041667837-project-member] Converting VIF {"id": "09e96897-482d-402e-adcc-e8bf9010391d", "address": "fa:16:3e:75:4a:25", "network": {"id": "84ceafdd-3b62-438f-bd6c-9a51224c1011", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1430955242-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f81daef5439a43b491516bf86286dedd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09e96897-48", "ovs_interfaceid": "09e96897-482d-402e-adcc-e8bf9010391d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 10:05:54 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-82e2baff-f09f-4ae0-b468-a990d90d0da8 tempest-TestServerVolumeAttachmentScenario-1041667837 tempest-TestServerVolumeAttachmentScenario-1041667837-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:75:4a:25,bridge_name='br-int',has_traffic_filtering=True,id=09e96897-482d-402e-adcc-e8bf9010391d,network=Network(84ceafdd-3b62-438f-bd6c-9a51224c1011),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09e96897-48') {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 10:05:54 user nova-compute[75229]: DEBUG nova.objects.instance [None req-82e2baff-f09f-4ae0-b468-a990d90d0da8 tempest-TestServerVolumeAttachmentScenario-1041667837 tempest-TestServerVolumeAttachmentScenario-1041667837-project-member] Lazy-loading 'pci_devices' on Instance uuid 764de1b0-b77f-457a-8355-e5cdc1f6eab1 {{(pid=75229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 10:05:54 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-82e2baff-f09f-4ae0-b468-a990d90d0da8 tempest-TestServerVolumeAttachmentScenario-1041667837 tempest-TestServerVolumeAttachmentScenario-1041667837-project-member] [instance: 764de1b0-b77f-457a-8355-e5cdc1f6eab1] End _get_guest_xml xml=<domain type="kvm">
Nov 14 10:05:54 user nova-compute[75229]:   <uuid>764de1b0-b77f-457a-8355-e5cdc1f6eab1</uuid>
Nov 14 10:05:54 user nova-compute[75229]:   <name>instance-0000002e</name>
Nov 14 10:05:54 user nova-compute[75229]:   <memory>524288</memory>
Nov 14 10:05:54 user nova-compute[75229]:   <vcpu>1</vcpu>
Nov 14 10:05:54 user nova-compute[75229]:   <metadata>
Nov 14 10:05:54 user nova-compute[75229]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 10:05:54 user nova-compute[75229]:       <nova:package version="0.0.0"/>
Nov 14 10:05:54 user nova-compute[75229]:       <nova:name>tempest-TestServerVolumeAttachmentScenario-server-1685617180</nova:name>
Nov 14 10:05:54 user nova-compute[75229]:       <nova:creationTime>2023-11-14 10:05:54</nova:creationTime>
Nov 14 10:05:54 user nova-compute[75229]:       <nova:flavor name="m1.tiny">
Nov 14 10:05:54 user nova-compute[75229]:         <nova:memory>512</nova:memory>
Nov 14 10:05:54 user nova-compute[75229]:         <nova:disk>1</nova:disk>
Nov 14 10:05:54 user nova-compute[75229]:         <nova:swap>0</nova:swap>
Nov 14 10:05:54 user nova-compute[75229]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 10:05:54 user nova-compute[75229]:         <nova:vcpus>1</nova:vcpus>
Nov 14 10:05:54 user nova-compute[75229]:       </nova:flavor>
Nov 14 10:05:54 user nova-compute[75229]:       <nova:owner>
Nov 14 10:05:54 user nova-compute[75229]:         <nova:user uuid="02f3e8ddba2440a19e39667c631d05e6">tempest-TestServerVolumeAttachmentScenario-1041667837-project-member</nova:user>
Nov 14 10:05:54 user nova-compute[75229]:         <nova:project uuid="f81daef5439a43b491516bf86286dedd">tempest-TestServerVolumeAttachmentScenario-1041667837</nova:project>
Nov 14 10:05:54 user nova-compute[75229]:       </nova:owner>
Nov 14 10:05:54 user nova-compute[75229]:       <nova:root type="image" uuid="3bef8470-ecc7-40e3-95d4-9254348ea72d"/>
Nov 14 10:05:54 user nova-compute[75229]:       <nova:ports>
Nov 14 10:05:54 user nova-compute[75229]:         <nova:port uuid="09e96897-482d-402e-adcc-e8bf9010391d">
Nov 14 10:05:54 user nova-compute[75229]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 14 10:05:54 user nova-compute[75229]:         </nova:port>
Nov 14 10:05:54 user nova-compute[75229]:       </nova:ports>
Nov 14 10:05:54 user nova-compute[75229]:     </nova:instance>
Nov 14 10:05:54 user nova-compute[75229]:   </metadata>
Nov 14 10:05:54 user nova-compute[75229]:   <sysinfo type="smbios">
Nov 14 10:05:54 user nova-compute[75229]:     <system>
Nov 14 10:05:54 user nova-compute[75229]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 10:05:54 user nova-compute[75229]:       <entry name="product">OpenStack Nova</entry>
Nov 14 10:05:54 user nova-compute[75229]:       <entry name="version">0.0.0</entry>
Nov 14 10:05:54 user nova-compute[75229]:       <entry name="serial">764de1b0-b77f-457a-8355-e5cdc1f6eab1</entry>
Nov 14 10:05:54 user nova-compute[75229]:       <entry name="uuid">764de1b0-b77f-457a-8355-e5cdc1f6eab1</entry>
Nov 14 10:05:54 user nova-compute[75229]:       <entry name="family">Virtual Machine</entry>
Nov 14 10:05:54 user nova-compute[75229]:     </system>
Nov 14 10:05:54 user nova-compute[75229]:   </sysinfo>
Nov 14 10:05:54 user nova-compute[75229]:   <os>
Nov 14 10:05:54 user nova-compute[75229]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 10:05:54 user nova-compute[75229]:     <boot dev="hd"/>
Nov 14 10:05:54 user nova-compute[75229]:     <smbios mode="sysinfo"/>
Nov 14 10:05:54 user nova-compute[75229]:   </os>
Nov 14 10:05:54 user nova-compute[75229]:   <features>
Nov 14 10:05:54 user nova-compute[75229]:     <acpi/>
Nov 14 10:05:54 user nova-compute[75229]:     <apic/>
Nov 14 10:05:54 user nova-compute[75229]:     <vmcoreinfo/>
Nov 14 10:05:54 user nova-compute[75229]:   </features>
Nov 14 10:05:54 user nova-compute[75229]:   <clock offset="utc">
Nov 14 10:05:54 user nova-compute[75229]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 10:05:54 user nova-compute[75229]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 10:05:54 user nova-compute[75229]:     <timer name="hpet" present="no"/>
Nov 14 10:05:54 user nova-compute[75229]:   </clock>
Nov 14 10:05:54 user nova-compute[75229]:   <cpu mode="custom" match="exact">
Nov 14 10:05:54 user nova-compute[75229]:     <model>Nehalem</model>
Nov 14 10:05:54 user nova-compute[75229]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 10:05:54 user nova-compute[75229]:   </cpu>
Nov 14 10:05:54 user nova-compute[75229]:   <devices>
Nov 14 10:05:54 user nova-compute[75229]:     <disk type="file" device="disk">
Nov 14 10:05:54 user nova-compute[75229]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 10:05:54 user nova-compute[75229]:       <source file="/opt/stack/data/nova/instances/764de1b0-b77f-457a-8355-e5cdc1f6eab1/disk"/>
Nov 14 10:05:54 user nova-compute[75229]:       <target dev="vda" bus="virtio"/>
Nov 14 10:05:54 user nova-compute[75229]:     </disk>
Nov 14 10:05:54 user nova-compute[75229]:     <interface type="ethernet">
Nov 14 10:05:54 user nova-compute[75229]:       <mac address="fa:16:3e:75:4a:25"/>
Nov 14 10:05:54 user nova-compute[75229]:       <model type="virtio"/>
Nov 14 10:05:54 user nova-compute[75229]:       <mtu size="1442"/>
Nov 14 10:05:54 user nova-compute[75229]:       <target dev="tap09e96897-48"/>
Nov 14 10:05:54 user nova-compute[75229]:     </interface>
Nov 14 10:05:54 user nova-compute[75229]:     <serial type="pty">
Nov 14 10:05:54 user nova-compute[75229]:       <log file="/opt/stack/data/nova/instances/764de1b0-b77f-457a-8355-e5cdc1f6eab1/console.log" append="off"/>
Nov 14 10:05:54 user nova-compute[75229]:     </serial>
Nov 14 10:05:54 user nova-compute[75229]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 10:05:54 user nova-compute[75229]:     <video>
Nov 14 10:05:54 user nova-compute[75229]:       <model type="virtio"/>
Nov 14 10:05:54 user nova-compute[75229]:     </video>
Nov 14 10:05:54 user nova-compute[75229]:     <rng model="virtio">
Nov 14 10:05:54 user nova-compute[75229]:       <backend model="random">/dev/urandom</backend>
Nov 14 10:05:54 user nova-compute[75229]:     </rng>
Nov 14 10:05:54 user nova-compute[75229]:     <controller type="usb" index="0" model="none"/>
Nov 14 10:05:54 user nova-compute[75229]:     <memballoon model="virtio">
Nov 14 10:05:54 user nova-compute[75229]:       <stats period="10"/>
Nov 14 10:05:54 user nova-compute[75229]:     </memballoon>
Nov 14 10:05:54 user nova-compute[75229]:   </devices>
Nov 14 10:05:54 user nova-compute[75229]: </domain>
Nov 14 10:05:54 user nova-compute[75229]:  {{(pid=75229) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 10:05:54 user nova-compute[75229]: DEBUG nova.virt.libvirt.vif [None req-82e2baff-f09f-4ae0-b468-a990d90d0da8 tempest-TestServerVolumeAttachmentScenario-1041667837 tempest-TestServerVolumeAttachmentScenario-1041667837-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T10:05:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1685617180',display_name='tempest-TestServerVolumeAttachmentScenario-server-1685617180',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-1685617180',id=46,image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD79XoXeIgMnwTE/y9Tph2kig8sN23JlGJReIYWTL94EUr+1CcaCZFmtJksTfKMy6YewtU06l9jNgs56keZ4Fcdwo/XpWvKVOVkLl8Gkn4bSkE2q+LJNdRDti3vg7c9FEw==',key_name='tempest-keypair-2106072250',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f81daef5439a43b491516bf86286dedd',ramdisk_id='',reservation_id='r-0cld79i0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1041667837',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1041667837-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T10:05:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='02f3e8ddba2440a19e39667c631d05e6',uuid=764de1b0-b77f-457a-8355-e5cdc1f6eab1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "09e96897-482d-402e-adcc-e8bf9010391d", "address": "fa:16:3e:75:4a:25", "network": {"id": "84ceafdd-3b62-438f-bd6c-9a51224c1011", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1430955242-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f81daef5439a43b491516bf86286dedd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09e96897-48", "ovs_interfaceid": "09e96897-482d-402e-adcc-e8bf9010391d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 10:05:54 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-82e2baff-f09f-4ae0-b468-a990d90d0da8 tempest-TestServerVolumeAttachmentScenario-1041667837 tempest-TestServerVolumeAttachmentScenario-1041667837-project-member] Converting VIF {"id": "09e96897-482d-402e-adcc-e8bf9010391d", "address": "fa:16:3e:75:4a:25", "network": {"id": "84ceafdd-3b62-438f-bd6c-9a51224c1011", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1430955242-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f81daef5439a43b491516bf86286dedd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09e96897-48", "ovs_interfaceid": "09e96897-482d-402e-adcc-e8bf9010391d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 10:05:54 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-82e2baff-f09f-4ae0-b468-a990d90d0da8 tempest-TestServerVolumeAttachmentScenario-1041667837 tempest-TestServerVolumeAttachmentScenario-1041667837-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:75:4a:25,bridge_name='br-int',has_traffic_filtering=True,id=09e96897-482d-402e-adcc-e8bf9010391d,network=Network(84ceafdd-3b62-438f-bd6c-9a51224c1011),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09e96897-48') {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 10:05:54 user nova-compute[75229]: DEBUG os_vif [None req-82e2baff-f09f-4ae0-b468-a990d90d0da8 tempest-TestServerVolumeAttachmentScenario-1041667837 tempest-TestServerVolumeAttachmentScenario-1041667837-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:75:4a:25,bridge_name='br-int',has_traffic_filtering=True,id=09e96897-482d-402e-adcc-e8bf9010391d,network=Network(84ceafdd-3b62-438f-bd6c-9a51224c1011),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09e96897-48') {{(pid=75229) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 10:05:54 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:05:54 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 10:05:54 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 10:05:54 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:05:54 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4e105032-8098-51a1-80ac-3c4bd4b27a6c', '_type': 'linux-noop'}}, row=False) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 10:05:54 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:05:54 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 10:05:54 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:05:54 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap09e96897-48, may_exist=True, interface_attrs={}) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 10:05:54 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap09e96897-48, col_values=(('qos', UUID('db8038e1-5bc9-4235-a06b-1647bfd1ec45')),), if_exists=True) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 10:05:54 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap09e96897-48, col_values=(('external_ids', {'iface-id': '09e96897-482d-402e-adcc-e8bf9010391d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:75:4a:25', 'vm-uuid': '764de1b0-b77f-457a-8355-e5cdc1f6eab1'}),), if_exists=True) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 10:05:54 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:05:54 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 10:05:54 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:05:54 user nova-compute[75229]: INFO os_vif [None req-82e2baff-f09f-4ae0-b468-a990d90d0da8 tempest-TestServerVolumeAttachmentScenario-1041667837 tempest-TestServerVolumeAttachmentScenario-1041667837-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:75:4a:25,bridge_name='br-int',has_traffic_filtering=True,id=09e96897-482d-402e-adcc-e8bf9010391d,network=Network(84ceafdd-3b62-438f-bd6c-9a51224c1011),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09e96897-48')
Nov 14 10:05:54 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-82e2baff-f09f-4ae0-b468-a990d90d0da8 tempest-TestServerVolumeAttachmentScenario-1041667837 tempest-TestServerVolumeAttachmentScenario-1041667837-project-member] No BDM found with device name vda, not building metadata. {{(pid=75229) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 10:05:54 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-82e2baff-f09f-4ae0-b468-a990d90d0da8 tempest-TestServerVolumeAttachmentScenario-1041667837 tempest-TestServerVolumeAttachmentScenario-1041667837-project-member] No VIF found with MAC fa:16:3e:75:4a:25, not building metadata {{(pid=75229) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 10:05:54 user nova-compute[75229]: DEBUG nova.network.neutron [req-3b50e9e5-0374-4415-88b9-7372d599edfc req-344a1d11-25b2-47e6-aac5-8e017b8c062c service nova] [instance: 764de1b0-b77f-457a-8355-e5cdc1f6eab1] Updated VIF entry in instance network info cache for port 09e96897-482d-402e-adcc-e8bf9010391d. {{(pid=75229) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 10:05:54 user nova-compute[75229]: DEBUG nova.network.neutron [req-3b50e9e5-0374-4415-88b9-7372d599edfc req-344a1d11-25b2-47e6-aac5-8e017b8c062c service nova] [instance: 764de1b0-b77f-457a-8355-e5cdc1f6eab1] Updating instance_info_cache with network_info: [{"id": "09e96897-482d-402e-adcc-e8bf9010391d", "address": "fa:16:3e:75:4a:25", "network": {"id": "84ceafdd-3b62-438f-bd6c-9a51224c1011", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1430955242-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f81daef5439a43b491516bf86286dedd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09e96897-48", "ovs_interfaceid": "09e96897-482d-402e-adcc-e8bf9010391d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 10:05:54 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-3b50e9e5-0374-4415-88b9-7372d599edfc req-344a1d11-25b2-47e6-aac5-8e017b8c062c service nova] Releasing lock "refresh_cache-764de1b0-b77f-457a-8355-e5cdc1f6eab1" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 10:05:55 user nova-compute[75229]: DEBUG nova.compute.manager [req-f426cb59-c4cb-4cfc-8b95-f4457aedc7a5 req-d6ad645f-d489-4bce-8fcd-d84788dcf3ac service nova] [instance: 3795dd8f-8a10-4939-8f2c-bacefe5f5aa1] Received event network-vif-plugged-c22c2020-a8ff-4cd5-8b78-89b1bb277e8c {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 10:05:55 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-f426cb59-c4cb-4cfc-8b95-f4457aedc7a5 req-d6ad645f-d489-4bce-8fcd-d84788dcf3ac service nova] Acquiring lock "3795dd8f-8a10-4939-8f2c-bacefe5f5aa1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:05:55 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-f426cb59-c4cb-4cfc-8b95-f4457aedc7a5 req-d6ad645f-d489-4bce-8fcd-d84788dcf3ac service nova] Lock "3795dd8f-8a10-4939-8f2c-bacefe5f5aa1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:05:55 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-f426cb59-c4cb-4cfc-8b95-f4457aedc7a5 req-d6ad645f-d489-4bce-8fcd-d84788dcf3ac service nova] Lock "3795dd8f-8a10-4939-8f2c-bacefe5f5aa1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:05:55 user nova-compute[75229]: DEBUG nova.compute.manager [req-f426cb59-c4cb-4cfc-8b95-f4457aedc7a5 req-d6ad645f-d489-4bce-8fcd-d84788dcf3ac service nova] [instance: 3795dd8f-8a10-4939-8f2c-bacefe5f5aa1] No event matching network-vif-plugged-c22c2020-a8ff-4cd5-8b78-89b1bb277e8c in dict_keys([('volume-reimaged', '4ddb200b-47ca-4449-9973-be76424a6761')]) {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:325}}
Nov 14 10:05:55 user nova-compute[75229]: WARNING nova.compute.manager [req-f426cb59-c4cb-4cfc-8b95-f4457aedc7a5 req-d6ad645f-d489-4bce-8fcd-d84788dcf3ac service nova] [instance: 3795dd8f-8a10-4939-8f2c-bacefe5f5aa1] Received unexpected event network-vif-plugged-c22c2020-a8ff-4cd5-8b78-89b1bb277e8c for instance with vm_state active and task_state rebuilding.
Nov 14 10:05:55 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:05:55 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:05:55 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:05:55 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:05:55 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:05:56 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:05:56 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:05:56 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:05:57 user nova-compute[75229]: DEBUG nova.compute.manager [req-11ec3a08-8f62-44b6-a373-8f56eaee3533 req-121dcd75-5bb9-493c-bb59-8a57f8164bdd service nova] [instance: 764de1b0-b77f-457a-8355-e5cdc1f6eab1] Received event network-vif-plugged-09e96897-482d-402e-adcc-e8bf9010391d {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 10:05:57 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-11ec3a08-8f62-44b6-a373-8f56eaee3533 req-121dcd75-5bb9-493c-bb59-8a57f8164bdd service nova] Acquiring lock "764de1b0-b77f-457a-8355-e5cdc1f6eab1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:05:57 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-11ec3a08-8f62-44b6-a373-8f56eaee3533 req-121dcd75-5bb9-493c-bb59-8a57f8164bdd service nova] Lock "764de1b0-b77f-457a-8355-e5cdc1f6eab1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:05:57 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-11ec3a08-8f62-44b6-a373-8f56eaee3533 req-121dcd75-5bb9-493c-bb59-8a57f8164bdd service nova] Lock "764de1b0-b77f-457a-8355-e5cdc1f6eab1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:05:57 user nova-compute[75229]: DEBUG nova.compute.manager [req-11ec3a08-8f62-44b6-a373-8f56eaee3533 req-121dcd75-5bb9-493c-bb59-8a57f8164bdd service nova] [instance: 764de1b0-b77f-457a-8355-e5cdc1f6eab1] No waiting events found dispatching network-vif-plugged-09e96897-482d-402e-adcc-e8bf9010391d {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 10:05:57 user nova-compute[75229]: WARNING nova.compute.manager [req-11ec3a08-8f62-44b6-a373-8f56eaee3533 req-121dcd75-5bb9-493c-bb59-8a57f8164bdd service nova] [instance: 764de1b0-b77f-457a-8355-e5cdc1f6eab1] Received unexpected event network-vif-plugged-09e96897-482d-402e-adcc-e8bf9010391d for instance with vm_state building and task_state spawning.
Nov 14 10:05:57 user nova-compute[75229]: DEBUG nova.compute.manager [req-11ec3a08-8f62-44b6-a373-8f56eaee3533 req-121dcd75-5bb9-493c-bb59-8a57f8164bdd service nova] [instance: 764de1b0-b77f-457a-8355-e5cdc1f6eab1] Received event network-vif-plugged-09e96897-482d-402e-adcc-e8bf9010391d {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 10:05:57 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-11ec3a08-8f62-44b6-a373-8f56eaee3533 req-121dcd75-5bb9-493c-bb59-8a57f8164bdd service nova] Acquiring lock "764de1b0-b77f-457a-8355-e5cdc1f6eab1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:05:57 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-11ec3a08-8f62-44b6-a373-8f56eaee3533 req-121dcd75-5bb9-493c-bb59-8a57f8164bdd service nova] Lock "764de1b0-b77f-457a-8355-e5cdc1f6eab1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:05:57 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-11ec3a08-8f62-44b6-a373-8f56eaee3533 req-121dcd75-5bb9-493c-bb59-8a57f8164bdd service nova] Lock "764de1b0-b77f-457a-8355-e5cdc1f6eab1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:05:57 user nova-compute[75229]: DEBUG nova.compute.manager [req-11ec3a08-8f62-44b6-a373-8f56eaee3533 req-121dcd75-5bb9-493c-bb59-8a57f8164bdd service nova] [instance: 764de1b0-b77f-457a-8355-e5cdc1f6eab1] No waiting events found dispatching network-vif-plugged-09e96897-482d-402e-adcc-e8bf9010391d {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 10:05:57 user nova-compute[75229]: WARNING nova.compute.manager [req-11ec3a08-8f62-44b6-a373-8f56eaee3533 req-121dcd75-5bb9-493c-bb59-8a57f8164bdd service nova] [instance: 764de1b0-b77f-457a-8355-e5cdc1f6eab1] Received unexpected event network-vif-plugged-09e96897-482d-402e-adcc-e8bf9010391d for instance with vm_state building and task_state spawning.
Nov 14 10:05:57 user nova-compute[75229]: DEBUG nova.compute.manager [None req-82e2baff-f09f-4ae0-b468-a990d90d0da8 tempest-TestServerVolumeAttachmentScenario-1041667837 tempest-TestServerVolumeAttachmentScenario-1041667837-project-member] [instance: 764de1b0-b77f-457a-8355-e5cdc1f6eab1] Instance event wait completed in 0 seconds for  {{(pid=75229) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 10:05:57 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-82e2baff-f09f-4ae0-b468-a990d90d0da8 tempest-TestServerVolumeAttachmentScenario-1041667837 tempest-TestServerVolumeAttachmentScenario-1041667837-project-member] [instance: 764de1b0-b77f-457a-8355-e5cdc1f6eab1] Guest created on hypervisor {{(pid=75229) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 10:05:57 user nova-compute[75229]: INFO nova.virt.libvirt.driver [-] [instance: 764de1b0-b77f-457a-8355-e5cdc1f6eab1] Instance spawned successfully.
Nov 14 10:05:57 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-82e2baff-f09f-4ae0-b468-a990d90d0da8 tempest-TestServerVolumeAttachmentScenario-1041667837 tempest-TestServerVolumeAttachmentScenario-1041667837-project-member] [instance: 764de1b0-b77f-457a-8355-e5cdc1f6eab1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 10:05:57 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-82e2baff-f09f-4ae0-b468-a990d90d0da8 tempest-TestServerVolumeAttachmentScenario-1041667837 tempest-TestServerVolumeAttachmentScenario-1041667837-project-member] [instance: 764de1b0-b77f-457a-8355-e5cdc1f6eab1] Found default for hw_cdrom_bus of ide {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 10:05:57 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-82e2baff-f09f-4ae0-b468-a990d90d0da8 tempest-TestServerVolumeAttachmentScenario-1041667837 tempest-TestServerVolumeAttachmentScenario-1041667837-project-member] [instance: 764de1b0-b77f-457a-8355-e5cdc1f6eab1] Found default for hw_disk_bus of virtio {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 10:05:57 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-82e2baff-f09f-4ae0-b468-a990d90d0da8 tempest-TestServerVolumeAttachmentScenario-1041667837 tempest-TestServerVolumeAttachmentScenario-1041667837-project-member] [instance: 764de1b0-b77f-457a-8355-e5cdc1f6eab1] Found default for hw_input_bus of None {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 10:05:57 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-82e2baff-f09f-4ae0-b468-a990d90d0da8 tempest-TestServerVolumeAttachmentScenario-1041667837 tempest-TestServerVolumeAttachmentScenario-1041667837-project-member] [instance: 764de1b0-b77f-457a-8355-e5cdc1f6eab1] Found default for hw_pointer_model of None {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 10:05:57 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-82e2baff-f09f-4ae0-b468-a990d90d0da8 tempest-TestServerVolumeAttachmentScenario-1041667837 tempest-TestServerVolumeAttachmentScenario-1041667837-project-member] [instance: 764de1b0-b77f-457a-8355-e5cdc1f6eab1] Found default for hw_video_model of virtio {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 10:05:57 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-82e2baff-f09f-4ae0-b468-a990d90d0da8 tempest-TestServerVolumeAttachmentScenario-1041667837 tempest-TestServerVolumeAttachmentScenario-1041667837-project-member] [instance: 764de1b0-b77f-457a-8355-e5cdc1f6eab1] Found default for hw_vif_model of virtio {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 10:05:57 user nova-compute[75229]: INFO nova.compute.manager [None req-82e2baff-f09f-4ae0-b468-a990d90d0da8 tempest-TestServerVolumeAttachmentScenario-1041667837 tempest-TestServerVolumeAttachmentScenario-1041667837-project-member] [instance: 764de1b0-b77f-457a-8355-e5cdc1f6eab1] Took 5.87 seconds to spawn the instance on the hypervisor.
Nov 14 10:05:57 user nova-compute[75229]: DEBUG nova.compute.manager [None req-82e2baff-f09f-4ae0-b468-a990d90d0da8 tempest-TestServerVolumeAttachmentScenario-1041667837 tempest-TestServerVolumeAttachmentScenario-1041667837-project-member] [instance: 764de1b0-b77f-457a-8355-e5cdc1f6eab1] Checking state {{(pid=75229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 10:05:58 user nova-compute[75229]: INFO nova.compute.manager [None req-82e2baff-f09f-4ae0-b468-a990d90d0da8 tempest-TestServerVolumeAttachmentScenario-1041667837 tempest-TestServerVolumeAttachmentScenario-1041667837-project-member] [instance: 764de1b0-b77f-457a-8355-e5cdc1f6eab1] Took 6.51 seconds to build instance.
Nov 14 10:05:58 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-82e2baff-f09f-4ae0-b468-a990d90d0da8 tempest-TestServerVolumeAttachmentScenario-1041667837 tempest-TestServerVolumeAttachmentScenario-1041667837-project-member] Lock "764de1b0-b77f-457a-8355-e5cdc1f6eab1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.605s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:05:58 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:05:58 user nova-compute[75229]: DEBUG nova.compute.manager [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Starting heal instance info cache {{(pid=75229) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 10:05:58 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Acquiring lock "refresh_cache-cda8c5ad-e70c-4021-bace-d55831c4bc78" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 10:05:58 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Acquired lock "refresh_cache-cda8c5ad-e70c-4021-bace-d55831c4bc78" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 10:05:58 user nova-compute[75229]: DEBUG nova.network.neutron [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] [instance: cda8c5ad-e70c-4021-bace-d55831c4bc78] Forcefully refreshing network info cache for instance {{(pid=75229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 10:05:58 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:05:59 user nova-compute[75229]: DEBUG nova.network.neutron [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] [instance: cda8c5ad-e70c-4021-bace-d55831c4bc78] Updating instance_info_cache with network_info: [{"id": "c88498e8-25f8-4546-b007-b1dc853b3ccb", "address": "fa:16:3e:c4:17:f3", "network": {"id": "6a700b61-4aa6-440b-87e6-a3525a5cb918", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-448680331-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8babb73006da4977a1fe2bdb35e08d8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc88498e8-25", "ovs_interfaceid": "c88498e8-25f8-4546-b007-b1dc853b3ccb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 10:05:59 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:05:59 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Releasing lock "refresh_cache-cda8c5ad-e70c-4021-bace-d55831c4bc78" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 10:05:59 user nova-compute[75229]: DEBUG nova.compute.manager [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] [instance: cda8c5ad-e70c-4021-bace-d55831c4bc78] Updated the network info_cache for instance {{(pid=75229) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 10:06:02 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:06:03 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:06:04 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:06:04 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:06:06 user nova-compute[75229]: DEBUG nova.compute.manager [req-73afdc65-a053-4518-9915-bb349cafa3cb req-141be744-b8ac-4986-8f3f-10b6b5f8afce service nova] [instance: 3795dd8f-8a10-4939-8f2c-bacefe5f5aa1] Received event volume-reimaged-4ddb200b-47ca-4449-9973-be76424a6761 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 10:06:06 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-73afdc65-a053-4518-9915-bb349cafa3cb req-141be744-b8ac-4986-8f3f-10b6b5f8afce service nova] Acquiring lock "3795dd8f-8a10-4939-8f2c-bacefe5f5aa1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:06:06 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-73afdc65-a053-4518-9915-bb349cafa3cb req-141be744-b8ac-4986-8f3f-10b6b5f8afce service nova] Lock "3795dd8f-8a10-4939-8f2c-bacefe5f5aa1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:06:06 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-73afdc65-a053-4518-9915-bb349cafa3cb req-141be744-b8ac-4986-8f3f-10b6b5f8afce service nova] Lock "3795dd8f-8a10-4939-8f2c-bacefe5f5aa1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:06:06 user nova-compute[75229]: DEBUG nova.compute.manager [req-73afdc65-a053-4518-9915-bb349cafa3cb req-141be744-b8ac-4986-8f3f-10b6b5f8afce service nova] [instance: 3795dd8f-8a10-4939-8f2c-bacefe5f5aa1] Processing event volume-reimaged-4ddb200b-47ca-4449-9973-be76424a6761 {{(pid=75229) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10872}}
Nov 14 10:06:06 user nova-compute[75229]: DEBUG nova.compute.manager [None req-73afdc65-a053-4518-9915-bb349cafa3cb tempest-ServerActionsV293TestJSON-1571447010 tempest-ServerActionsV293TestJSON-1571447010-project-member] [instance: 3795dd8f-8a10-4939-8f2c-bacefe5f5aa1] Instance event wait completed in 14 seconds for volume-reimaged {{(pid=75229) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 10:06:06 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:06:06 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:06:06 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:06:06 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:06:06 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:06:06 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Auditing locally available compute resources for user (node: user) {{(pid=75229) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 10:06:06 user nova-compute[75229]: INFO nova.virt.block_device [None req-73afdc65-a053-4518-9915-bb349cafa3cb tempest-ServerActionsV293TestJSON-1571447010 tempest-ServerActionsV293TestJSON-1571447010-project-member] [instance: 3795dd8f-8a10-4939-8f2c-bacefe5f5aa1] Booting with volume 4ddb200b-47ca-4449-9973-be76424a6761 at /dev/vda
Nov 14 10:06:06 user nova-compute[75229]: DEBUG os_brick.utils [None req-73afdc65-a053-4518-9915-bb349cafa3cb tempest-ServerActionsV293TestJSON-1571447010 tempest-ServerActionsV293TestJSON-1571447010-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 10:06:06 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:06:06 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75229) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 10:06:06 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cda8c5ad-e70c-4021-bace-d55831c4bc78/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:06:06 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:06:06 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[683b5bd2-0a6c-4181-83b0-62c9563936f7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f1154031c835\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:06:06 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:06:06 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:06:06 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[0aaf1ead-3a5a-4965-89f0-96d522980b5f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:06:06 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:06:06 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:06:06 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e4c28bd-26ae-49aa-9885-8d192792fd20]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:06:06 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7ce2ac1-95ce-457f-ba4d-cc8b51d8d3af]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:06:06 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-73afdc65-a053-4518-9915-bb349cafa3cb tempest-ServerActionsV293TestJSON-1571447010 tempest-ServerActionsV293TestJSON-1571447010-project-member] Running cmd (subprocess): nvme version {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:06:07 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-73afdc65-a053-4518-9915-bb349cafa3cb tempest-ServerActionsV293TestJSON-1571447010 tempest-ServerActionsV293TestJSON-1571447010-project-member] 'nvme version' failed. Not Retrying. {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 10:06:07 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.nvmeof [None req-73afdc65-a053-4518-9915-bb349cafa3cb tempest-ServerActionsV293TestJSON-1571447010 tempest-ServerActionsV293TestJSON-1571447010-project-member] nvme not present on system {{(pid=75229) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 10:06:07 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:06:07 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 10:06:07 user nova-compute[75229]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 10:06:07 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[0912192d-7aa1-48c9-868b-20433232c3a8]: (4, '') {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:06:07 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.lightos [None req-73afdc65-a053-4518-9915-bb349cafa3cb tempest-ServerActionsV293TestJSON-1571447010 tempest-ServerActionsV293TestJSON-1571447010-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75229) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 10:06:07 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.lightos [None req-73afdc65-a053-4518-9915-bb349cafa3cb tempest-ServerActionsV293TestJSON-1571447010 tempest-ServerActionsV293TestJSON-1571447010-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75229) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 10:06:07 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.lightos [None req-73afdc65-a053-4518-9915-bb349cafa3cb tempest-ServerActionsV293TestJSON-1571447010 tempest-ServerActionsV293TestJSON-1571447010-project-member] LIGHTOS: no hostnqn found. {{(pid=75229) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 10:06:07 user nova-compute[75229]: DEBUG os_brick.utils [None req-73afdc65-a053-4518-9915-bb349cafa3cb tempest-ServerActionsV293TestJSON-1571447010 tempest-ServerActionsV293TestJSON-1571447010-project-member] <== get_connector_properties: return (168ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f1154031c835', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 10:06:07 user nova-compute[75229]: DEBUG nova.virt.block_device [None req-73afdc65-a053-4518-9915-bb349cafa3cb tempest-ServerActionsV293TestJSON-1571447010 tempest-ServerActionsV293TestJSON-1571447010-project-member] [instance: 3795dd8f-8a10-4939-8f2c-bacefe5f5aa1] Updating existing volume attachment record: 92acd5cc-a86d-4ad2-80ed-18bcd26e50e6 {{(pid=75229) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 10:06:07 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cda8c5ad-e70c-4021-bace-d55831c4bc78/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:06:07 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cda8c5ad-e70c-4021-bace-d55831c4bc78/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:06:07 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cda8c5ad-e70c-4021-bace-d55831c4bc78/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:06:07 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/764de1b0-b77f-457a-8355-e5cdc1f6eab1/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:06:07 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/764de1b0-b77f-457a-8355-e5cdc1f6eab1/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:06:07 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/764de1b0-b77f-457a-8355-e5cdc1f6eab1/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:06:07 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/764de1b0-b77f-457a-8355-e5cdc1f6eab1/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:06:07 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1679275-ebb1-4f15-80a4-b8fd614fc34b/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:06:07 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1679275-ebb1-4f15-80a4-b8fd614fc34b/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:06:07 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1679275-ebb1-4f15-80a4-b8fd614fc34b/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:06:08 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1679275-ebb1-4f15-80a4-b8fd614fc34b/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:06:08 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75229) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 10:06:08 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75229) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 10:06:08 user nova-compute[75229]: WARNING nova.virt.libvirt.driver [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 10:06:08 user nova-compute[75229]: WARNING nova.virt.libvirt.driver [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 10:06:08 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Hypervisor/Node resource view: name=user free_ram=8179MB free_disk=25.105968475341797GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75229) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 10:06:08 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:06:08 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:06:08 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Instance cda8c5ad-e70c-4021-bace-d55831c4bc78 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 10:06:08 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Instance 30ae1f73-e0f3-4e26-987e-a684471a160d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 10:06:08 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Instance c1679275-ebb1-4f15-80a4-b8fd614fc34b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 10:06:08 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Instance 3795dd8f-8a10-4939-8f2c-bacefe5f5aa1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 10:06:08 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Instance abe7e145-d3bc-49a1-83be-793488de828b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 10:06:08 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Instance 10d6bce1-e55f-429c-816d-3bef9029560a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 10:06:08 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Instance 764de1b0-b77f-457a-8355-e5cdc1f6eab1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 10:06:08 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=75229) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 10:06:08 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=75229) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 10:06:08 user nova-compute[75229]: DEBUG nova.compute.provider_tree [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Inventory has not changed in ProviderTree for provider: d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 {{(pid=75229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 10:06:08 user nova-compute[75229]: DEBUG nova.scheduler.client.report [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Inventory has not changed for provider d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 10:06:08 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Compute_service record updated for user:user {{(pid=75229) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 10:06:08 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.482s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:06:08 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:06:09 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:06:09 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:06:09 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:06:09 user nova-compute[75229]: DEBUG nova.compute.manager [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75229) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 10:06:12 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-73afdc65-a053-4518-9915-bb349cafa3cb tempest-ServerActionsV293TestJSON-1571447010 tempest-ServerActionsV293TestJSON-1571447010-project-member] [instance: 3795dd8f-8a10-4939-8f2c-bacefe5f5aa1] Creating instance directory {{(pid=75229) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 10:06:12 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-73afdc65-a053-4518-9915-bb349cafa3cb tempest-ServerActionsV293TestJSON-1571447010 tempest-ServerActionsV293TestJSON-1571447010-project-member] [instance: 3795dd8f-8a10-4939-8f2c-bacefe5f5aa1] Creating image(s)
Nov 14 10:06:12 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-73afdc65-a053-4518-9915-bb349cafa3cb tempest-ServerActionsV293TestJSON-1571447010 tempest-ServerActionsV293TestJSON-1571447010-project-member] [instance: 3795dd8f-8a10-4939-8f2c-bacefe5f5aa1] Did not create local disks {{(pid=75229) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 14 10:06:12 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-73afdc65-a053-4518-9915-bb349cafa3cb tempest-ServerActionsV293TestJSON-1571447010 tempest-ServerActionsV293TestJSON-1571447010-project-member] [instance: 3795dd8f-8a10-4939-8f2c-bacefe5f5aa1] Ensure instance console log exists: /opt/stack/data/nova/instances/3795dd8f-8a10-4939-8f2c-bacefe5f5aa1/console.log {{(pid=75229) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 10:06:12 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-73afdc65-a053-4518-9915-bb349cafa3cb tempest-ServerActionsV293TestJSON-1571447010 tempest-ServerActionsV293TestJSON-1571447010-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:06:12 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-73afdc65-a053-4518-9915-bb349cafa3cb tempest-ServerActionsV293TestJSON-1571447010 tempest-ServerActionsV293TestJSON-1571447010-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:06:12 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-73afdc65-a053-4518-9915-bb349cafa3cb tempest-ServerActionsV293TestJSON-1571447010 tempest-ServerActionsV293TestJSON-1571447010-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:06:12 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-73afdc65-a053-4518-9915-bb349cafa3cb tempest-ServerActionsV293TestJSON-1571447010 tempest-ServerActionsV293TestJSON-1571447010-project-member] [instance: 3795dd8f-8a10-4939-8f2c-bacefe5f5aa1] Start _get_guest_xml network_info=[{"id": "c22c2020-a8ff-4cd5-8b78-89b1bb277e8c", "address": "fa:16:3e:a6:6b:f6", "network": {"id": "cd37c3e7-5ffe-4b5d-a25c-a2bd288cb9d2", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-156456501-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.204", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd2def4493b6471c86ad547a2e21eaf8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc22c2020-a8", "ovs_interfaceid": "c22c2020-a8ff-4cd5-8b78-89b1bb277e8c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T09:40:10Z,direct_url=<?>,disk_format='qcow2',id=3bef8470-ecc7-40e3-95d4-9254348ea72d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='de5a91106b6948ed937a7178ff9464c4',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T09:40:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:4ddb200b-47ca-4449-9973-be76424a6761', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OQUwLneK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '3795dd8f-8a10-4939-8f2c-bacefe5f5aa1', 'attached_at': '', 'detached_at': '', 'volume_id': '4ddb200b-47ca-4449-9973-be76424a6761', 'serial': '4ddb200b-47ca-4449-9973-be76424a6761'}, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'attachment_id': '92acd5cc-a86d-4ad2-80ed-18bcd26e50e6', 'guest_format': None, 'device_type': 'disk', 'volume_type': None} {{(pid=75229) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 10:06:12 user nova-compute[75229]: WARNING nova.virt.libvirt.driver [None req-73afdc65-a053-4518-9915-bb349cafa3cb tempest-ServerActionsV293TestJSON-1571447010 tempest-ServerActionsV293TestJSON-1571447010-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 14 10:06:12 user nova-compute[75229]: WARNING nova.virt.libvirt.driver [None req-73afdc65-a053-4518-9915-bb349cafa3cb tempest-ServerActionsV293TestJSON-1571447010 tempest-ServerActionsV293TestJSON-1571447010-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 14 10:06:12 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-73afdc65-a053-4518-9915-bb349cafa3cb tempest-ServerActionsV293TestJSON-1571447010 tempest-ServerActionsV293TestJSON-1571447010-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75229) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 10:06:12 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-73afdc65-a053-4518-9915-bb349cafa3cb tempest-ServerActionsV293TestJSON-1571447010 tempest-ServerActionsV293TestJSON-1571447010-project-member] CPU controller missing on host. {{(pid=75229) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 10:06:12 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-73afdc65-a053-4518-9915-bb349cafa3cb tempest-ServerActionsV293TestJSON-1571447010 tempest-ServerActionsV293TestJSON-1571447010-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75229) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 10:06:12 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-73afdc65-a053-4518-9915-bb349cafa3cb tempest-ServerActionsV293TestJSON-1571447010 tempest-ServerActionsV293TestJSON-1571447010-project-member] CPU controller found on host. {{(pid=75229) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 10:06:12 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-73afdc65-a053-4518-9915-bb349cafa3cb tempest-ServerActionsV293TestJSON-1571447010 tempest-ServerActionsV293TestJSON-1571447010-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75229) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 10:06:12 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-73afdc65-a053-4518-9915-bb349cafa3cb tempest-ServerActionsV293TestJSON-1571447010 tempest-ServerActionsV293TestJSON-1571447010-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T09:39:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T09:40:10Z,direct_url=<?>,disk_format='qcow2',id=3bef8470-ecc7-40e3-95d4-9254348ea72d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='de5a91106b6948ed937a7178ff9464c4',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T09:40:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 10:06:12 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-73afdc65-a053-4518-9915-bb349cafa3cb tempest-ServerActionsV293TestJSON-1571447010 tempest-ServerActionsV293TestJSON-1571447010-project-member] Flavor limits 0:0:0 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 10:06:12 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-73afdc65-a053-4518-9915-bb349cafa3cb tempest-ServerActionsV293TestJSON-1571447010 tempest-ServerActionsV293TestJSON-1571447010-project-member] Image limits 0:0:0 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 10:06:12 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-73afdc65-a053-4518-9915-bb349cafa3cb tempest-ServerActionsV293TestJSON-1571447010 tempest-ServerActionsV293TestJSON-1571447010-project-member] Flavor pref 0:0:0 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 10:06:12 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-73afdc65-a053-4518-9915-bb349cafa3cb tempest-ServerActionsV293TestJSON-1571447010 tempest-ServerActionsV293TestJSON-1571447010-project-member] Image pref 0:0:0 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 10:06:12 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-73afdc65-a053-4518-9915-bb349cafa3cb tempest-ServerActionsV293TestJSON-1571447010 tempest-ServerActionsV293TestJSON-1571447010-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 10:06:12 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-73afdc65-a053-4518-9915-bb349cafa3cb tempest-ServerActionsV293TestJSON-1571447010 tempest-ServerActionsV293TestJSON-1571447010-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 10:06:12 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-73afdc65-a053-4518-9915-bb349cafa3cb tempest-ServerActionsV293TestJSON-1571447010 tempest-ServerActionsV293TestJSON-1571447010-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75229) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 10:06:12 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-73afdc65-a053-4518-9915-bb349cafa3cb tempest-ServerActionsV293TestJSON-1571447010 tempest-ServerActionsV293TestJSON-1571447010-project-member] Got 1 possible topologies {{(pid=75229) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 10:06:12 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-73afdc65-a053-4518-9915-bb349cafa3cb tempest-ServerActionsV293TestJSON-1571447010 tempest-ServerActionsV293TestJSON-1571447010-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 10:06:12 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-73afdc65-a053-4518-9915-bb349cafa3cb tempest-ServerActionsV293TestJSON-1571447010 tempest-ServerActionsV293TestJSON-1571447010-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 10:06:12 user nova-compute[75229]: DEBUG nova.objects.instance [None req-73afdc65-a053-4518-9915-bb349cafa3cb tempest-ServerActionsV293TestJSON-1571447010 tempest-ServerActionsV293TestJSON-1571447010-project-member] Lazy-loading 'vcpu_model' on Instance uuid 3795dd8f-8a10-4939-8f2c-bacefe5f5aa1 {{(pid=75229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 10:06:12 user nova-compute[75229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-73afdc65-a053-4518-9915-bb349cafa3cb tempest-ServerActionsV293TestJSON-1571447010 tempest-ServerActionsV293TestJSON-1571447010-project-member] [instance: 3795dd8f-8a10-4939-8f2c-bacefe5f5aa1] Calling os-brick to attach iSCSI Volume {{(pid=75229) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 10:06:12 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-73afdc65-a053-4518-9915-bb349cafa3cb tempest-ServerActionsV293TestJSON-1571447010 tempest-ServerActionsV293TestJSON-1571447010-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f73f85151b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4ddb200b-47ca-4449-9973-be76424a6761', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OQUwLneK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 10:06:12 user nova-compute[75229]: WARNING os_brick.initiator.connectors.base [None req-73afdc65-a053-4518-9915-bb349cafa3cb tempest-ServerActionsV293TestJSON-1571447010 tempest-ServerActionsV293TestJSON-1571447010-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 14 10:06:12 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-73afdc65-a053-4518-9915-bb349cafa3cb tempest-ServerActionsV293TestJSON-1571447010 tempest-ServerActionsV293TestJSON-1571447010-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 10:06:12 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-73afdc65-a053-4518-9915-bb349cafa3cb tempest-ServerActionsV293TestJSON-1571447010 tempest-ServerActionsV293TestJSON-1571447010-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 10:06:12 user nova-compute[75229]: WARNING os_brick.initiator.connectors.base [None req-73afdc65-a053-4518-9915-bb349cafa3cb tempest-ServerActionsV293TestJSON-1571447010 tempest-ServerActionsV293TestJSON-1571447010-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 14 10:06:12 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-73afdc65-a053-4518-9915-bb349cafa3cb tempest-ServerActionsV293TestJSON-1571447010 tempest-ServerActionsV293TestJSON-1571447010-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4ddb200b-47ca-4449-9973-be76424a6761" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 10:06:12 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-73afdc65-a053-4518-9915-bb349cafa3cb tempest-ServerActionsV293TestJSON-1571447010 tempest-ServerActionsV293TestJSON-1571447010-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4ddb200b-47ca-4449-9973-be76424a6761" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 10:06:12 user nova-compute[75229]: INFO os_brick.initiator.connectors.iscsi [None req-73afdc65-a053-4518-9915-bb349cafa3cb tempest-ServerActionsV293TestJSON-1571447010 tempest-ServerActionsV293TestJSON-1571447010-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 10:06:12 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ddb200b-47ca-4449-9973-be76424a6761 -p 172.16.0.220:3260 {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:06:12 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ddb200b-47ca-4449-9973-be76424a6761 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:06:12 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd0b0bca-8bd0-4d09-8f12-9ff32173c424]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:06:12 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-73afdc65-a053-4518-9915-bb349cafa3cb tempest-ServerActionsV293TestJSON-1571447010 tempest-ServerActionsV293TestJSON-1571447010-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 10:06:12 user nova-compute[75229]:  {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 10:06:12 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ddb200b-47ca-4449-9973-be76424a6761 -p 172.16.0.220:3260 --interface default --op new {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:06:12 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ddb200b-47ca-4449-9973-be76424a6761 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:06:12 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f886329-cae6-4ee2-a81d-ace7f7bd3898]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4ddb200b-47ca-4449-9973-be76424a6761] added\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:06:12 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-73afdc65-a053-4518-9915-bb349cafa3cb tempest-ServerActionsV293TestJSON-1571447010 tempest-ServerActionsV293TestJSON-1571447010-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4ddb200b-47ca-4449-9973-be76424a6761] added
Nov 14 10:06:12 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 10:06:12 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ddb200b-47ca-4449-9973-be76424a6761 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:06:12 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ddb200b-47ca-4449-9973-be76424a6761 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:06:12 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0fd2337-4ce4-4eaf-9265-e6375f5e8221]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:06:12 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-73afdc65-a053-4518-9915-bb349cafa3cb tempest-ServerActionsV293TestJSON-1571447010 tempest-ServerActionsV293TestJSON-1571447010-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 10:06:12 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ddb200b-47ca-4449-9973-be76424a6761 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:06:12 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ddb200b-47ca-4449-9973-be76424a6761 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:06:12 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[218c1250-1fad-4a0e-9583-644d8ac669a6]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:06:12 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-73afdc65-a053-4518-9915-bb349cafa3cb tempest-ServerActionsV293TestJSON-1571447010 tempest-ServerActionsV293TestJSON-1571447010-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 10:06:12 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ddb200b-47ca-4449-9973-be76424a6761 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OQUwLneK {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:06:12 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ddb200b-47ca-4449-9973-be76424a6761 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OQUwLneK" returned: 0 in 0.020s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:06:12 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[aad3e562-1dc8-40ce-8f16-a40b11bf8619]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:06:12 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-73afdc65-a053-4518-9915-bb349cafa3cb tempest-ServerActionsV293TestJSON-1571447010 tempest-ServerActionsV293TestJSON-1571447010-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'OQUwLneK'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 10:06:12 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ddb200b-47ca-4449-9973-be76424a6761 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:06:12 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ddb200b-47ca-4449-9973-be76424a6761 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:06:12 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[0143813f-939d-425a-a8f7-72fd85a33bb9]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:06:12 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-73afdc65-a053-4518-9915-bb349cafa3cb tempest-ServerActionsV293TestJSON-1571447010 tempest-ServerActionsV293TestJSON-1571447010-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 10:06:12 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:06:12 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:06:12 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[abb6c47a-763a-4a8e-8183-5f9368403cf3]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aebc438-0289-44fe-ad84-4e696468f50e (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4a6dca6-1581-494f-afe5-3aac2b4d2c15 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7aee6091-dab3-4c39-88a1-4bbb28dcab45 (non-flash)\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:06:12 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-73afdc65-a053-4518-9915-bb349cafa3cb tempest-ServerActionsV293TestJSON-1571447010 tempest-ServerActionsV293TestJSON-1571447010-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aebc438-0289-44fe-ad84-4e696468f50e (non-flash)
Nov 14 10:06:12 user nova-compute[75229]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4a6dca6-1581-494f-afe5-3aac2b4d2c15 (non-flash)
Nov 14 10:06:12 user nova-compute[75229]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7aee6091-dab3-4c39-88a1-4bbb28dcab45 (non-flash)
Nov 14 10:06:12 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 10:06:12 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-73afdc65-a053-4518-9915-bb349cafa3cb tempest-ServerActionsV293TestJSON-1571447010 tempest-ServerActionsV293TestJSON-1571447010-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aebc438-0289-44fe-ad84-4e696468f50e (non-flash)
Nov 14 10:06:12 user nova-compute[75229]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4a6dca6-1581-494f-afe5-3aac2b4d2c15 (non-flash)
Nov 14 10:06:12 user nova-compute[75229]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7aee6091-dab3-4c39-88a1-4bbb28dcab45 (non-flash)
Nov 14 10:06:12 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 10:06:12 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ddb200b-47ca-4449-9973-be76424a6761 -p 172.16.0.220:3260 --login {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:06:12 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ddb200b-47ca-4449-9973-be76424a6761 -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:06:12 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ce4d8c4-4971-4144-b092-9ba3b6b7cb2f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4ddb200b-47ca-4449-9973-be76424a6761, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4ddb200b-47ca-4449-9973-be76424a6761, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:06:12 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-73afdc65-a053-4518-9915-bb349cafa3cb tempest-ServerActionsV293TestJSON-1571447010 tempest-ServerActionsV293TestJSON-1571447010-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4ddb200b-47ca-4449-9973-be76424a6761, portal: 172.16.0.220,3260]
Nov 14 10:06:12 user nova-compute[75229]: Login to [iface: default, target: iqn.2010-10.org.openstack:4ddb200b-47ca-4449-9973-be76424a6761, portal: 172.16.0.220,3260] successful.
Nov 14 10:06:12 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 10:06:12 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ddb200b-47ca-4449-9973-be76424a6761 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:06:12 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ddb200b-47ca-4449-9973-be76424a6761 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:06:12 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e38ce9e-0315-4fef-bc2d-38af876b884d]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:06:12 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-73afdc65-a053-4518-9915-bb349cafa3cb tempest-ServerActionsV293TestJSON-1571447010 tempest-ServerActionsV293TestJSON-1571447010-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 10:06:12 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:06:12 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:06:12 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[5add3a8e-f793-4a40-bfa0-9858a461863d]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aebc438-0289-44fe-ad84-4e696468f50e (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4a6dca6-1581-494f-afe5-3aac2b4d2c15 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7aee6091-dab3-4c39-88a1-4bbb28dcab45 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ddb200b-47ca-4449-9973-be76424a6761 (non-flash)\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:06:12 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-73afdc65-a053-4518-9915-bb349cafa3cb tempest-ServerActionsV293TestJSON-1571447010 tempest-ServerActionsV293TestJSON-1571447010-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aebc438-0289-44fe-ad84-4e696468f50e (non-flash)
Nov 14 10:06:12 user nova-compute[75229]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4a6dca6-1581-494f-afe5-3aac2b4d2c15 (non-flash)
Nov 14 10:06:12 user nova-compute[75229]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7aee6091-dab3-4c39-88a1-4bbb28dcab45 (non-flash)
Nov 14 10:06:12 user nova-compute[75229]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ddb200b-47ca-4449-9973-be76424a6761 (non-flash)
Nov 14 10:06:12 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 10:06:12 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-73afdc65-a053-4518-9915-bb349cafa3cb tempest-ServerActionsV293TestJSON-1571447010 tempest-ServerActionsV293TestJSON-1571447010-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aebc438-0289-44fe-ad84-4e696468f50e (non-flash)
Nov 14 10:06:12 user nova-compute[75229]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4a6dca6-1581-494f-afe5-3aac2b4d2c15 (non-flash)
Nov 14 10:06:12 user nova-compute[75229]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7aee6091-dab3-4c39-88a1-4bbb28dcab45 (non-flash)
Nov 14 10:06:12 user nova-compute[75229]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ddb200b-47ca-4449-9973-be76424a6761 (non-flash)
Nov 14 10:06:12 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 10:06:12 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-73afdc65-a053-4518-9915-bb349cafa3cb tempest-ServerActionsV293TestJSON-1571447010 tempest-ServerActionsV293TestJSON-1571447010-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4ddb200b-47ca-4449-9973-be76424a6761" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.305s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 10:06:12 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-73afdc65-a053-4518-9915-bb349cafa3cb tempest-ServerActionsV293TestJSON-1571447010 tempest-ServerActionsV293TestJSON-1571447010-project-member] Connected to 172.16.0.220:3260 {{(pid=75229) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 10:06:12 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-73afdc65-a053-4518-9915-bb349cafa3cb tempest-ServerActionsV293TestJSON-1571447010 tempest-ServerActionsV293TestJSON-1571447010-project-member] HCTL ('36', '-', '-', 0) found on session 48 with lun 0 {{(pid=75229) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 10:06:12 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-73afdc65-a053-4518-9915-bb349cafa3cb tempest-ServerActionsV293TestJSON-1571447010 tempest-ServerActionsV293TestJSON-1571447010-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75229) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 10:06:12 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:06:12 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.018s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:06:12 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[e78824df-c20e-4d4b-9796-640e9e4f537d]: (4, ('- - 0', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:06:12 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-73afdc65-a053-4518-9915-bb349cafa3cb tempest-ServerActionsV293TestJSON-1571447010 tempest-ServerActionsV293TestJSON-1571447010-project-member] Searching for a device in session 48 and hctl ['36', '*', '*', 0] yield: None {{(pid=75229) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 10:06:12 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:06:12 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-956e64d7-357c-423b-86b3-6bc65b6b0701 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Acquiring lock "752995bf-8e0a-4832-94d8-280ab786b997" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:06:12 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-956e64d7-357c-423b-86b3-6bc65b6b0701 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Lock "752995bf-8e0a-4832-94d8-280ab786b997" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:06:12 user nova-compute[75229]: DEBUG nova.compute.manager [None req-956e64d7-357c-423b-86b3-6bc65b6b0701 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] [instance: 752995bf-8e0a-4832-94d8-280ab786b997] Starting instance... {{(pid=75229) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 10:06:13 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-956e64d7-357c-423b-86b3-6bc65b6b0701 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:06:13 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-956e64d7-357c-423b-86b3-6bc65b6b0701 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:06:13 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-956e64d7-357c-423b-86b3-6bc65b6b0701 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75229) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 10:06:13 user nova-compute[75229]: INFO nova.compute.claims [None req-956e64d7-357c-423b-86b3-6bc65b6b0701 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] [instance: 752995bf-8e0a-4832-94d8-280ab786b997] Claim successful on node user
Nov 14 10:06:13 user nova-compute[75229]: DEBUG nova.compute.provider_tree [None req-956e64d7-357c-423b-86b3-6bc65b6b0701 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Inventory has not changed in ProviderTree for provider: d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 {{(pid=75229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 10:06:13 user nova-compute[75229]: DEBUG nova.scheduler.client.report [None req-956e64d7-357c-423b-86b3-6bc65b6b0701 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Inventory has not changed for provider d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 10:06:13 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-73afdc65-a053-4518-9915-bb349cafa3cb tempest-ServerActionsV293TestJSON-1571447010 tempest-ServerActionsV293TestJSON-1571447010-project-member] Searching for a device in session 48 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75229) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 10:06:13 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-73afdc65-a053-4518-9915-bb349cafa3cb tempest-ServerActionsV293TestJSON-1571447010 tempest-ServerActionsV293TestJSON-1571447010-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:4ddb200b-47ca-4449-9973-be76424a6761', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OQUwLneK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75229) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 10:06:13 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-73afdc65-a053-4518-9915-bb349cafa3cb tempest-ServerActionsV293TestJSON-1571447010 tempest-ServerActionsV293TestJSON-1571447010-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.524s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 10:06:13 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-73afdc65-a053-4518-9915-bb349cafa3cb tempest-ServerActionsV293TestJSON-1571447010 tempest-ServerActionsV293TestJSON-1571447010-project-member] <== connect_volume: return (1525ms) {'type': 'block', 'scsi_wwn': '23163333931393131', 'path': '/dev/sde'} {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 10:06:13 user nova-compute[75229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-73afdc65-a053-4518-9915-bb349cafa3cb tempest-ServerActionsV293TestJSON-1571447010 tempest-ServerActionsV293TestJSON-1571447010-project-member] [instance: 3795dd8f-8a10-4939-8f2c-bacefe5f5aa1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23163333931393131', 'path': '/dev/sde'} {{(pid=75229) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 10:06:13 user nova-compute[75229]: DEBUG nova.virt.libvirt.vif [None req-73afdc65-a053-4518-9915-bb349cafa3cb tempest-ServerActionsV293TestJSON-1571447010 tempest-ServerActionsV293TestJSON-1571447010-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-14T10:03:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-397489303',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-227769429',id=44,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFUp8y3q6YJE91W5mLt9TtiRsU0SK+1Tlv+h5RVCK8xvWSBDaBLlNygtiA4MzTbH6VU4efuvwyj9xakV6WTmEsQqXHmG4tvUv4ckhtOrRf2abxMbK7PzCZvHKp/bva3DgA==',key_name='tempest-keypair-1083609012',keypairs=<?>,launch_index=0,launched_at=2023-11-14T10:04:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='dd2def4493b6471c86ad547a2e21eaf8',ramdisk_id='',reservation_id='r-3orn8wim',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1571447010',owner_user_name='tempest-ServerActionsV293TestJSON-1571447010-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T10:06:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ccb15ed1f78c4c97a06b44dd1d833693',uuid=3795dd8f-8a10-4939-8f2c-bacefe5f5aa1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c22c2020-a8ff-4cd5-8b78-89b1bb277e8c", "address": "fa:16:3e:a6:6b:f6", "network": {"id": "cd37c3e7-5ffe-4b5d-a25c-a2bd288cb9d2", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-156456501-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.204", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd2def4493b6471c86ad547a2e21eaf8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc22c2020-a8", "ovs_interfaceid": "c22c2020-a8ff-4cd5-8b78-89b1bb277e8c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75229) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 10:06:13 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-73afdc65-a053-4518-9915-bb349cafa3cb tempest-ServerActionsV293TestJSON-1571447010 tempest-ServerActionsV293TestJSON-1571447010-project-member] Converting VIF {"id": "c22c2020-a8ff-4cd5-8b78-89b1bb277e8c", "address": "fa:16:3e:a6:6b:f6", "network": {"id": "cd37c3e7-5ffe-4b5d-a25c-a2bd288cb9d2", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-156456501-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.204", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd2def4493b6471c86ad547a2e21eaf8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc22c2020-a8", "ovs_interfaceid": "c22c2020-a8ff-4cd5-8b78-89b1bb277e8c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 10:06:13 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-73afdc65-a053-4518-9915-bb349cafa3cb tempest-ServerActionsV293TestJSON-1571447010 tempest-ServerActionsV293TestJSON-1571447010-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a6:6b:f6,bridge_name='br-int',has_traffic_filtering=True,id=c22c2020-a8ff-4cd5-8b78-89b1bb277e8c,network=Network(cd37c3e7-5ffe-4b5d-a25c-a2bd288cb9d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc22c2020-a8') {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 10:06:13 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-73afdc65-a053-4518-9915-bb349cafa3cb tempest-ServerActionsV293TestJSON-1571447010 tempest-ServerActionsV293TestJSON-1571447010-project-member] [instance: 3795dd8f-8a10-4939-8f2c-bacefe5f5aa1] End _get_guest_xml xml=<domain type="kvm">
Nov 14 10:06:13 user nova-compute[75229]:   <uuid>3795dd8f-8a10-4939-8f2c-bacefe5f5aa1</uuid>
Nov 14 10:06:13 user nova-compute[75229]:   <name>instance-0000002c</name>
Nov 14 10:06:13 user nova-compute[75229]:   <memory>524288</memory>
Nov 14 10:06:13 user nova-compute[75229]:   <vcpu>1</vcpu>
Nov 14 10:06:13 user nova-compute[75229]:   <metadata>
Nov 14 10:06:13 user nova-compute[75229]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 10:06:13 user nova-compute[75229]:       <nova:package version="0.0.0"/>
Nov 14 10:06:13 user nova-compute[75229]:       <nova:name>tempest-ServerActionsV293TestJSON-server-397489303</nova:name>
Nov 14 10:06:13 user nova-compute[75229]:       <nova:creationTime>2023-11-14 10:06:12</nova:creationTime>
Nov 14 10:06:13 user nova-compute[75229]:       <nova:flavor name="m1.tiny">
Nov 14 10:06:13 user nova-compute[75229]:         <nova:memory>512</nova:memory>
Nov 14 10:06:13 user nova-compute[75229]:         <nova:disk>1</nova:disk>
Nov 14 10:06:13 user nova-compute[75229]:         <nova:swap>0</nova:swap>
Nov 14 10:06:13 user nova-compute[75229]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 10:06:13 user nova-compute[75229]:         <nova:vcpus>1</nova:vcpus>
Nov 14 10:06:13 user nova-compute[75229]:       </nova:flavor>
Nov 14 10:06:13 user nova-compute[75229]:       <nova:owner>
Nov 14 10:06:13 user nova-compute[75229]:         <nova:user uuid="ccb15ed1f78c4c97a06b44dd1d833693">tempest-ServerActionsV293TestJSON-1571447010-project-member</nova:user>
Nov 14 10:06:13 user nova-compute[75229]:         <nova:project uuid="dd2def4493b6471c86ad547a2e21eaf8">tempest-ServerActionsV293TestJSON-1571447010</nova:project>
Nov 14 10:06:13 user nova-compute[75229]:       </nova:owner>
Nov 14 10:06:13 user nova-compute[75229]:       <nova:ports>
Nov 14 10:06:13 user nova-compute[75229]:         <nova:port uuid="c22c2020-a8ff-4cd5-8b78-89b1bb277e8c">
Nov 14 10:06:13 user nova-compute[75229]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 14 10:06:13 user nova-compute[75229]:         </nova:port>
Nov 14 10:06:13 user nova-compute[75229]:       </nova:ports>
Nov 14 10:06:13 user nova-compute[75229]:     </nova:instance>
Nov 14 10:06:13 user nova-compute[75229]:   </metadata>
Nov 14 10:06:13 user nova-compute[75229]:   <sysinfo type="smbios">
Nov 14 10:06:13 user nova-compute[75229]:     <system>
Nov 14 10:06:13 user nova-compute[75229]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 10:06:13 user nova-compute[75229]:       <entry name="product">OpenStack Nova</entry>
Nov 14 10:06:13 user nova-compute[75229]:       <entry name="version">0.0.0</entry>
Nov 14 10:06:13 user nova-compute[75229]:       <entry name="serial">3795dd8f-8a10-4939-8f2c-bacefe5f5aa1</entry>
Nov 14 10:06:13 user nova-compute[75229]:       <entry name="uuid">3795dd8f-8a10-4939-8f2c-bacefe5f5aa1</entry>
Nov 14 10:06:13 user nova-compute[75229]:       <entry name="family">Virtual Machine</entry>
Nov 14 10:06:13 user nova-compute[75229]:     </system>
Nov 14 10:06:13 user nova-compute[75229]:   </sysinfo>
Nov 14 10:06:13 user nova-compute[75229]:   <os>
Nov 14 10:06:13 user nova-compute[75229]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 10:06:13 user nova-compute[75229]:     <boot dev="hd"/>
Nov 14 10:06:13 user nova-compute[75229]:     <smbios mode="sysinfo"/>
Nov 14 10:06:13 user nova-compute[75229]:   </os>
Nov 14 10:06:13 user nova-compute[75229]:   <features>
Nov 14 10:06:13 user nova-compute[75229]:     <acpi/>
Nov 14 10:06:13 user nova-compute[75229]:     <apic/>
Nov 14 10:06:13 user nova-compute[75229]:     <vmcoreinfo/>
Nov 14 10:06:13 user nova-compute[75229]:   </features>
Nov 14 10:06:13 user nova-compute[75229]:   <clock offset="utc">
Nov 14 10:06:13 user nova-compute[75229]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 10:06:13 user nova-compute[75229]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 10:06:13 user nova-compute[75229]:     <timer name="hpet" present="no"/>
Nov 14 10:06:13 user nova-compute[75229]:   </clock>
Nov 14 10:06:13 user nova-compute[75229]:   <cpu mode="custom" match="exact">
Nov 14 10:06:13 user nova-compute[75229]:     <model>Nehalem</model>
Nov 14 10:06:13 user nova-compute[75229]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 10:06:13 user nova-compute[75229]:   </cpu>
Nov 14 10:06:13 user nova-compute[75229]:   <devices>
Nov 14 10:06:13 user nova-compute[75229]:     <disk type="block" device="disk">
Nov 14 10:06:13 user nova-compute[75229]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 10:06:13 user nova-compute[75229]:       <source dev="/dev/sde"/>
Nov 14 10:06:13 user nova-compute[75229]:       <target dev="vda" bus="virtio"/>
Nov 14 10:06:13 user nova-compute[75229]:       <serial>4ddb200b-47ca-4449-9973-be76424a6761</serial>
Nov 14 10:06:13 user nova-compute[75229]:     </disk>
Nov 14 10:06:13 user nova-compute[75229]:     <interface type="ethernet">
Nov 14 10:06:13 user nova-compute[75229]:       <mac address="fa:16:3e:a6:6b:f6"/>
Nov 14 10:06:13 user nova-compute[75229]:       <model type="virtio"/>
Nov 14 10:06:13 user nova-compute[75229]:       <mtu size="1442"/>
Nov 14 10:06:13 user nova-compute[75229]:       <target dev="tapc22c2020-a8"/>
Nov 14 10:06:13 user nova-compute[75229]:     </interface>
Nov 14 10:06:13 user nova-compute[75229]:     <serial type="pty">
Nov 14 10:06:13 user nova-compute[75229]:       <log file="/opt/stack/data/nova/instances/3795dd8f-8a10-4939-8f2c-bacefe5f5aa1/console.log" append="off"/>
Nov 14 10:06:13 user nova-compute[75229]:     </serial>
Nov 14 10:06:13 user nova-compute[75229]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 10:06:13 user nova-compute[75229]:     <video>
Nov 14 10:06:13 user nova-compute[75229]:       <model type="virtio"/>
Nov 14 10:06:13 user nova-compute[75229]:     </video>
Nov 14 10:06:13 user nova-compute[75229]:     <rng model="virtio">
Nov 14 10:06:13 user nova-compute[75229]:       <backend model="random">/dev/urandom</backend>
Nov 14 10:06:13 user nova-compute[75229]:     </rng>
Nov 14 10:06:13 user nova-compute[75229]:     <controller type="usb" index="0" model="none"/>
Nov 14 10:06:13 user nova-compute[75229]:     <memballoon model="virtio">
Nov 14 10:06:13 user nova-compute[75229]:       <stats period="10"/>
Nov 14 10:06:13 user nova-compute[75229]:     </memballoon>
Nov 14 10:06:13 user nova-compute[75229]:   </devices>
Nov 14 10:06:13 user nova-compute[75229]: </domain>
Nov 14 10:06:13 user nova-compute[75229]:  {{(pid=75229) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 10:06:13 user nova-compute[75229]: DEBUG nova.virt.libvirt.vif [None req-73afdc65-a053-4518-9915-bb349cafa3cb tempest-ServerActionsV293TestJSON-1571447010 tempest-ServerActionsV293TestJSON-1571447010-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-14T10:03:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-397489303',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-227769429',id=44,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFUp8y3q6YJE91W5mLt9TtiRsU0SK+1Tlv+h5RVCK8xvWSBDaBLlNygtiA4MzTbH6VU4efuvwyj9xakV6WTmEsQqXHmG4tvUv4ckhtOrRf2abxMbK7PzCZvHKp/bva3DgA==',key_name='tempest-keypair-1083609012',keypairs=<?>,launch_index=0,launched_at=2023-11-14T10:04:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='dd2def4493b6471c86ad547a2e21eaf8',ramdisk_id='',reservation_id='r-3orn8wim',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1571447010',owner_user_name='tempest-ServerActionsV293TestJSON-1571447010-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T10:06:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ccb15ed1f78c4c97a06b44dd1d833693',uuid=3795dd8f-8a10-4939-8f2c-bacefe5f5aa1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c22c2020-a8ff-4cd5-8b78-89b1bb277e8c", "address": "fa:16:3e:a6:6b:f6", "network": {"id": "cd37c3e7-5ffe-4b5d-a25c-a2bd288cb9d2", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-156456501-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.204", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd2def4493b6471c86ad547a2e21eaf8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc22c2020-a8", "ovs_interfaceid": "c22c2020-a8ff-4cd5-8b78-89b1bb277e8c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 10:06:13 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-73afdc65-a053-4518-9915-bb349cafa3cb tempest-ServerActionsV293TestJSON-1571447010 tempest-ServerActionsV293TestJSON-1571447010-project-member] Converting VIF {"id": "c22c2020-a8ff-4cd5-8b78-89b1bb277e8c", "address": "fa:16:3e:a6:6b:f6", "network": {"id": "cd37c3e7-5ffe-4b5d-a25c-a2bd288cb9d2", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-156456501-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.204", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd2def4493b6471c86ad547a2e21eaf8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc22c2020-a8", "ovs_interfaceid": "c22c2020-a8ff-4cd5-8b78-89b1bb277e8c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 10:06:13 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-73afdc65-a053-4518-9915-bb349cafa3cb tempest-ServerActionsV293TestJSON-1571447010 tempest-ServerActionsV293TestJSON-1571447010-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a6:6b:f6,bridge_name='br-int',has_traffic_filtering=True,id=c22c2020-a8ff-4cd5-8b78-89b1bb277e8c,network=Network(cd37c3e7-5ffe-4b5d-a25c-a2bd288cb9d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc22c2020-a8') {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 10:06:13 user nova-compute[75229]: DEBUG os_vif [None req-73afdc65-a053-4518-9915-bb349cafa3cb tempest-ServerActionsV293TestJSON-1571447010 tempest-ServerActionsV293TestJSON-1571447010-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a6:6b:f6,bridge_name='br-int',has_traffic_filtering=True,id=c22c2020-a8ff-4cd5-8b78-89b1bb277e8c,network=Network(cd37c3e7-5ffe-4b5d-a25c-a2bd288cb9d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc22c2020-a8') {{(pid=75229) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 10:06:13 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-956e64d7-357c-423b-86b3-6bc65b6b0701 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.670s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:06:13 user nova-compute[75229]: DEBUG nova.compute.manager [None req-956e64d7-357c-423b-86b3-6bc65b6b0701 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] [instance: 752995bf-8e0a-4832-94d8-280ab786b997] Start building networks asynchronously for instance. {{(pid=75229) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 10:06:13 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:06:13 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 10:06:13 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 10:06:13 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:06:13 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd0b8dff5-970e-538b-84d7-36a9c935053c', '_type': 'linux-noop'}}, row=False) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 10:06:13 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:06:13 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:06:13 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:06:13 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc22c2020-a8, may_exist=True, interface_attrs={}) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 10:06:13 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc22c2020-a8, col_values=(('qos', UUID('c80a5196-5138-4643-bb28-2a0a1c08a92c')),), if_exists=True) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 10:06:13 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc22c2020-a8, col_values=(('external_ids', {'iface-id': 'c22c2020-a8ff-4cd5-8b78-89b1bb277e8c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a6:6b:f6', 'vm-uuid': '3795dd8f-8a10-4939-8f2c-bacefe5f5aa1'}),), if_exists=True) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 10:06:13 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:06:13 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 10:06:13 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:06:13 user nova-compute[75229]: INFO os_vif [None req-73afdc65-a053-4518-9915-bb349cafa3cb tempest-ServerActionsV293TestJSON-1571447010 tempest-ServerActionsV293TestJSON-1571447010-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a6:6b:f6,bridge_name='br-int',has_traffic_filtering=True,id=c22c2020-a8ff-4cd5-8b78-89b1bb277e8c,network=Network(cd37c3e7-5ffe-4b5d-a25c-a2bd288cb9d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc22c2020-a8')
Nov 14 10:06:13 user nova-compute[75229]: DEBUG nova.compute.manager [None req-956e64d7-357c-423b-86b3-6bc65b6b0701 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] [instance: 752995bf-8e0a-4832-94d8-280ab786b997] Allocating IP information in the background. {{(pid=75229) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 10:06:13 user nova-compute[75229]: DEBUG nova.network.neutron [None req-956e64d7-357c-423b-86b3-6bc65b6b0701 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] [instance: 752995bf-8e0a-4832-94d8-280ab786b997] allocate_for_instance() {{(pid=75229) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 10:06:13 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-956e64d7-357c-423b-86b3-6bc65b6b0701 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] [instance: 752995bf-8e0a-4832-94d8-280ab786b997] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 10:06:13 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-73afdc65-a053-4518-9915-bb349cafa3cb tempest-ServerActionsV293TestJSON-1571447010 tempest-ServerActionsV293TestJSON-1571447010-project-member] No BDM found with device name vda, not building metadata. {{(pid=75229) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 10:06:13 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-73afdc65-a053-4518-9915-bb349cafa3cb tempest-ServerActionsV293TestJSON-1571447010 tempest-ServerActionsV293TestJSON-1571447010-project-member] No VIF found with MAC fa:16:3e:a6:6b:f6, not building metadata {{(pid=75229) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 10:06:13 user nova-compute[75229]: DEBUG nova.compute.manager [None req-956e64d7-357c-423b-86b3-6bc65b6b0701 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] [instance: 752995bf-8e0a-4832-94d8-280ab786b997] Start building block device mappings for instance. {{(pid=75229) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 10:06:13 user nova-compute[75229]: DEBUG nova.policy [None req-956e64d7-357c-423b-86b3-6bc65b6b0701 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c26f33e4cdf14ba796445959953f8685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46620ac128944703899f22fe5439ba26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75229) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 10:06:13 user nova-compute[75229]: INFO nova.virt.block_device [None req-956e64d7-357c-423b-86b3-6bc65b6b0701 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] [instance: 752995bf-8e0a-4832-94d8-280ab786b997] Booting with volume c8892c7d-49e8-4f65-b88c-1e14fba8f50a at /dev/vda
Nov 14 10:06:13 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:06:14 user nova-compute[75229]: DEBUG os_brick.utils [None req-956e64d7-357c-423b-86b3-6bc65b6b0701 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 10:06:14 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:06:14 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:06:14 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[f825d2d2-b7bd-47c8-8fa6-cb93b6f106c0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f1154031c835\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:06:14 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:06:14 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:06:14 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea0e682a-746e-40d3-9598-fb244986b9b7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:06:14 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:06:14 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:06:14 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[21661f30-ad63-48a6-bd55-01c56828bf17]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:06:14 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[584dd12b-a80e-4cd4-94bc-e9ff25e06571]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:06:14 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-956e64d7-357c-423b-86b3-6bc65b6b0701 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Running cmd (subprocess): nvme version {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:06:14 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-956e64d7-357c-423b-86b3-6bc65b6b0701 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] 'nvme version' failed. Not Retrying. {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 10:06:14 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.nvmeof [None req-956e64d7-357c-423b-86b3-6bc65b6b0701 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] nvme not present on system {{(pid=75229) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 10:06:14 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:06:14 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 10:06:14 user nova-compute[75229]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 10:06:14 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[78f717c8-e5c5-4a5d-b867-d3fc9ab5a6c3]: (4, '') {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:06:14 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.lightos [None req-956e64d7-357c-423b-86b3-6bc65b6b0701 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75229) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 10:06:14 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.lightos [None req-956e64d7-357c-423b-86b3-6bc65b6b0701 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75229) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 10:06:14 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.lightos [None req-956e64d7-357c-423b-86b3-6bc65b6b0701 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] LIGHTOS: no hostnqn found. {{(pid=75229) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 10:06:14 user nova-compute[75229]: DEBUG os_brick.utils [None req-956e64d7-357c-423b-86b3-6bc65b6b0701 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f1154031c835', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 10:06:14 user nova-compute[75229]: DEBUG nova.virt.block_device [None req-956e64d7-357c-423b-86b3-6bc65b6b0701 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] [instance: 752995bf-8e0a-4832-94d8-280ab786b997] Updating existing volume attachment record: e24b62db-2820-4303-9ebb-40fb63bc7878 {{(pid=75229) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 10:06:14 user nova-compute[75229]: DEBUG nova.network.neutron [None req-956e64d7-357c-423b-86b3-6bc65b6b0701 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] [instance: 752995bf-8e0a-4832-94d8-280ab786b997] Successfully created port: 55228da7-a50c-4f39-ae39-83aeec11a818 {{(pid=75229) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 10:06:15 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:06:15 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:06:15 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:06:15 user nova-compute[75229]: DEBUG nova.network.neutron [None req-956e64d7-357c-423b-86b3-6bc65b6b0701 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] [instance: 752995bf-8e0a-4832-94d8-280ab786b997] Successfully updated port: 55228da7-a50c-4f39-ae39-83aeec11a818 {{(pid=75229) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 10:06:15 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-956e64d7-357c-423b-86b3-6bc65b6b0701 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Acquiring lock "refresh_cache-752995bf-8e0a-4832-94d8-280ab786b997" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 10:06:15 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-956e64d7-357c-423b-86b3-6bc65b6b0701 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Acquired lock "refresh_cache-752995bf-8e0a-4832-94d8-280ab786b997" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 10:06:15 user nova-compute[75229]: DEBUG nova.network.neutron [None req-956e64d7-357c-423b-86b3-6bc65b6b0701 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] [instance: 752995bf-8e0a-4832-94d8-280ab786b997] Building network info cache for instance {{(pid=75229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 10:06:15 user nova-compute[75229]: DEBUG nova.compute.manager [req-e64b6246-42ec-4e45-b541-0f2489611319 req-dcfb5565-caa7-43ab-b571-52ab8e6663f5 service nova] [instance: 752995bf-8e0a-4832-94d8-280ab786b997] Received event network-changed-55228da7-a50c-4f39-ae39-83aeec11a818 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 10:06:15 user nova-compute[75229]: DEBUG nova.compute.manager [req-e64b6246-42ec-4e45-b541-0f2489611319 req-dcfb5565-caa7-43ab-b571-52ab8e6663f5 service nova] [instance: 752995bf-8e0a-4832-94d8-280ab786b997] Refreshing instance network info cache due to event network-changed-55228da7-a50c-4f39-ae39-83aeec11a818. {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 10:06:15 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-e64b6246-42ec-4e45-b541-0f2489611319 req-dcfb5565-caa7-43ab-b571-52ab8e6663f5 service nova] Acquiring lock "refresh_cache-752995bf-8e0a-4832-94d8-280ab786b997" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 10:06:15 user nova-compute[75229]: DEBUG nova.compute.manager [req-553b676a-bdb4-4435-bb7b-ee758af4c426 req-6a2ad482-f875-4cc4-948e-43e7c0f63a44 service nova] [instance: 3795dd8f-8a10-4939-8f2c-bacefe5f5aa1] Received event network-vif-plugged-c22c2020-a8ff-4cd5-8b78-89b1bb277e8c {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 10:06:15 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-553b676a-bdb4-4435-bb7b-ee758af4c426 req-6a2ad482-f875-4cc4-948e-43e7c0f63a44 service nova] Acquiring lock "3795dd8f-8a10-4939-8f2c-bacefe5f5aa1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:06:15 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-553b676a-bdb4-4435-bb7b-ee758af4c426 req-6a2ad482-f875-4cc4-948e-43e7c0f63a44 service nova] Lock "3795dd8f-8a10-4939-8f2c-bacefe5f5aa1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:06:15 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-553b676a-bdb4-4435-bb7b-ee758af4c426 req-6a2ad482-f875-4cc4-948e-43e7c0f63a44 service nova] Lock "3795dd8f-8a10-4939-8f2c-bacefe5f5aa1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:06:15 user nova-compute[75229]: DEBUG nova.compute.manager [req-553b676a-bdb4-4435-bb7b-ee758af4c426 req-6a2ad482-f875-4cc4-948e-43e7c0f63a44 service nova] [instance: 3795dd8f-8a10-4939-8f2c-bacefe5f5aa1] No waiting events found dispatching network-vif-plugged-c22c2020-a8ff-4cd5-8b78-89b1bb277e8c {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 10:06:15 user nova-compute[75229]: WARNING nova.compute.manager [req-553b676a-bdb4-4435-bb7b-ee758af4c426 req-6a2ad482-f875-4cc4-948e-43e7c0f63a44 service nova] [instance: 3795dd8f-8a10-4939-8f2c-bacefe5f5aa1] Received unexpected event network-vif-plugged-c22c2020-a8ff-4cd5-8b78-89b1bb277e8c for instance with vm_state active and task_state rebuild_spawning.
Nov 14 10:06:15 user nova-compute[75229]: DEBUG nova.network.neutron [None req-956e64d7-357c-423b-86b3-6bc65b6b0701 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] [instance: 752995bf-8e0a-4832-94d8-280ab786b997] Instance cache missing network info. {{(pid=75229) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 10:06:15 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:06:15 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:06:15 user nova-compute[75229]: DEBUG nova.network.neutron [None req-956e64d7-357c-423b-86b3-6bc65b6b0701 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] [instance: 752995bf-8e0a-4832-94d8-280ab786b997] Updating instance_info_cache with network_info: [{"id": "55228da7-a50c-4f39-ae39-83aeec11a818", "address": "fa:16:3e:c4:53:33", "network": {"id": "118ea7c1-77c0-4660-b7b7-f311f6b0ec8a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1907578504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46620ac128944703899f22fe5439ba26", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55228da7-a5", "ovs_interfaceid": "55228da7-a50c-4f39-ae39-83aeec11a818", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 10:06:15 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-956e64d7-357c-423b-86b3-6bc65b6b0701 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Releasing lock "refresh_cache-752995bf-8e0a-4832-94d8-280ab786b997" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 10:06:15 user nova-compute[75229]: DEBUG nova.compute.manager [None req-956e64d7-357c-423b-86b3-6bc65b6b0701 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] [instance: 752995bf-8e0a-4832-94d8-280ab786b997] Instance network_info: |[{"id": "55228da7-a50c-4f39-ae39-83aeec11a818", "address": "fa:16:3e:c4:53:33", "network": {"id": "118ea7c1-77c0-4660-b7b7-f311f6b0ec8a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1907578504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46620ac128944703899f22fe5439ba26", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55228da7-a5", "ovs_interfaceid": "55228da7-a50c-4f39-ae39-83aeec11a818", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75229) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 10:06:15 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-e64b6246-42ec-4e45-b541-0f2489611319 req-dcfb5565-caa7-43ab-b571-52ab8e6663f5 service nova] Acquired lock "refresh_cache-752995bf-8e0a-4832-94d8-280ab786b997" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 10:06:15 user nova-compute[75229]: DEBUG nova.network.neutron [req-e64b6246-42ec-4e45-b541-0f2489611319 req-dcfb5565-caa7-43ab-b571-52ab8e6663f5 service nova] [instance: 752995bf-8e0a-4832-94d8-280ab786b997] Refreshing network info cache for port 55228da7-a50c-4f39-ae39-83aeec11a818 {{(pid=75229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 10:06:16 user nova-compute[75229]: DEBUG nova.network.neutron [req-e64b6246-42ec-4e45-b541-0f2489611319 req-dcfb5565-caa7-43ab-b571-52ab8e6663f5 service nova] [instance: 752995bf-8e0a-4832-94d8-280ab786b997] Updated VIF entry in instance network info cache for port 55228da7-a50c-4f39-ae39-83aeec11a818. {{(pid=75229) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 10:06:16 user nova-compute[75229]: DEBUG nova.network.neutron [req-e64b6246-42ec-4e45-b541-0f2489611319 req-dcfb5565-caa7-43ab-b571-52ab8e6663f5 service nova] [instance: 752995bf-8e0a-4832-94d8-280ab786b997] Updating instance_info_cache with network_info: [{"id": "55228da7-a50c-4f39-ae39-83aeec11a818", "address": "fa:16:3e:c4:53:33", "network": {"id": "118ea7c1-77c0-4660-b7b7-f311f6b0ec8a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1907578504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46620ac128944703899f22fe5439ba26", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55228da7-a5", "ovs_interfaceid": "55228da7-a50c-4f39-ae39-83aeec11a818", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 10:06:16 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-e64b6246-42ec-4e45-b541-0f2489611319 req-dcfb5565-caa7-43ab-b571-52ab8e6663f5 service nova] Releasing lock "refresh_cache-752995bf-8e0a-4832-94d8-280ab786b997" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 10:06:17 user nova-compute[75229]: DEBUG nova.compute.manager [None req-73afdc65-a053-4518-9915-bb349cafa3cb tempest-ServerActionsV293TestJSON-1571447010 tempest-ServerActionsV293TestJSON-1571447010-project-member] [instance: 3795dd8f-8a10-4939-8f2c-bacefe5f5aa1] Instance event wait completed in 0 seconds for  {{(pid=75229) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 10:06:17 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-73afdc65-a053-4518-9915-bb349cafa3cb tempest-ServerActionsV293TestJSON-1571447010 tempest-ServerActionsV293TestJSON-1571447010-project-member] [instance: 3795dd8f-8a10-4939-8f2c-bacefe5f5aa1] Guest created on hypervisor {{(pid=75229) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 10:06:17 user nova-compute[75229]: INFO nova.virt.libvirt.driver [-] [instance: 3795dd8f-8a10-4939-8f2c-bacefe5f5aa1] Instance spawned successfully.
Nov 14 10:06:17 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-73afdc65-a053-4518-9915-bb349cafa3cb tempest-ServerActionsV293TestJSON-1571447010 tempest-ServerActionsV293TestJSON-1571447010-project-member] [instance: 3795dd8f-8a10-4939-8f2c-bacefe5f5aa1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 10:06:17 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-73afdc65-a053-4518-9915-bb349cafa3cb tempest-ServerActionsV293TestJSON-1571447010 tempest-ServerActionsV293TestJSON-1571447010-project-member] [instance: 3795dd8f-8a10-4939-8f2c-bacefe5f5aa1] Found default for hw_cdrom_bus of ide {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 10:06:17 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-73afdc65-a053-4518-9915-bb349cafa3cb tempest-ServerActionsV293TestJSON-1571447010 tempest-ServerActionsV293TestJSON-1571447010-project-member] [instance: 3795dd8f-8a10-4939-8f2c-bacefe5f5aa1] Found default for hw_disk_bus of virtio {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 10:06:17 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-73afdc65-a053-4518-9915-bb349cafa3cb tempest-ServerActionsV293TestJSON-1571447010 tempest-ServerActionsV293TestJSON-1571447010-project-member] [instance: 3795dd8f-8a10-4939-8f2c-bacefe5f5aa1] Found default for hw_input_bus of None {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 10:06:17 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-73afdc65-a053-4518-9915-bb349cafa3cb tempest-ServerActionsV293TestJSON-1571447010 tempest-ServerActionsV293TestJSON-1571447010-project-member] [instance: 3795dd8f-8a10-4939-8f2c-bacefe5f5aa1] Found default for hw_pointer_model of None {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 10:06:17 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-73afdc65-a053-4518-9915-bb349cafa3cb tempest-ServerActionsV293TestJSON-1571447010 tempest-ServerActionsV293TestJSON-1571447010-project-member] [instance: 3795dd8f-8a10-4939-8f2c-bacefe5f5aa1] Found default for hw_video_model of virtio {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 10:06:17 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-73afdc65-a053-4518-9915-bb349cafa3cb tempest-ServerActionsV293TestJSON-1571447010 tempest-ServerActionsV293TestJSON-1571447010-project-member] [instance: 3795dd8f-8a10-4939-8f2c-bacefe5f5aa1] Found default for hw_vif_model of virtio {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 10:06:17 user nova-compute[75229]: DEBUG nova.compute.manager [None req-73afdc65-a053-4518-9915-bb349cafa3cb tempest-ServerActionsV293TestJSON-1571447010 tempest-ServerActionsV293TestJSON-1571447010-project-member] [instance: 3795dd8f-8a10-4939-8f2c-bacefe5f5aa1] Checking state {{(pid=75229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 10:06:17 user nova-compute[75229]: DEBUG nova.compute.manager [req-9cf14974-ab96-4502-bd84-efbfa58f0a75 req-1ddb81c2-9262-495e-9a29-7636a25d9be7 service nova] [instance: 3795dd8f-8a10-4939-8f2c-bacefe5f5aa1] Received event network-vif-plugged-c22c2020-a8ff-4cd5-8b78-89b1bb277e8c {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 10:06:17 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-9cf14974-ab96-4502-bd84-efbfa58f0a75 req-1ddb81c2-9262-495e-9a29-7636a25d9be7 service nova] Acquiring lock "3795dd8f-8a10-4939-8f2c-bacefe5f5aa1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:06:17 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-9cf14974-ab96-4502-bd84-efbfa58f0a75 req-1ddb81c2-9262-495e-9a29-7636a25d9be7 service nova] Lock "3795dd8f-8a10-4939-8f2c-bacefe5f5aa1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:06:17 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-9cf14974-ab96-4502-bd84-efbfa58f0a75 req-1ddb81c2-9262-495e-9a29-7636a25d9be7 service nova] Lock "3795dd8f-8a10-4939-8f2c-bacefe5f5aa1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:06:17 user nova-compute[75229]: DEBUG nova.compute.manager [req-9cf14974-ab96-4502-bd84-efbfa58f0a75 req-1ddb81c2-9262-495e-9a29-7636a25d9be7 service nova] [instance: 3795dd8f-8a10-4939-8f2c-bacefe5f5aa1] No waiting events found dispatching network-vif-plugged-c22c2020-a8ff-4cd5-8b78-89b1bb277e8c {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 10:06:17 user nova-compute[75229]: WARNING nova.compute.manager [req-9cf14974-ab96-4502-bd84-efbfa58f0a75 req-1ddb81c2-9262-495e-9a29-7636a25d9be7 service nova] [instance: 3795dd8f-8a10-4939-8f2c-bacefe5f5aa1] Received unexpected event network-vif-plugged-c22c2020-a8ff-4cd5-8b78-89b1bb277e8c for instance with vm_state active and task_state rebuild_spawning.
Nov 14 10:06:17 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-73afdc65-a053-4518-9915-bb349cafa3cb tempest-ServerActionsV293TestJSON-1571447010 tempest-ServerActionsV293TestJSON-1571447010-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:06:17 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-73afdc65-a053-4518-9915-bb349cafa3cb tempest-ServerActionsV293TestJSON-1571447010 tempest-ServerActionsV293TestJSON-1571447010-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:06:17 user nova-compute[75229]: DEBUG nova.objects.instance [None req-73afdc65-a053-4518-9915-bb349cafa3cb tempest-ServerActionsV293TestJSON-1571447010 tempest-ServerActionsV293TestJSON-1571447010-project-member] [instance: 3795dd8f-8a10-4939-8f2c-bacefe5f5aa1] Trying to apply a migration context that does not seem to be set for this instance {{(pid=75229) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Nov 14 10:06:17 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-73afdc65-a053-4518-9915-bb349cafa3cb tempest-ServerActionsV293TestJSON-1571447010 tempest-ServerActionsV293TestJSON-1571447010-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.073s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:06:18 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:06:18 user nova-compute[75229]: DEBUG nova.compute.manager [None req-956e64d7-357c-423b-86b3-6bc65b6b0701 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] [instance: 752995bf-8e0a-4832-94d8-280ab786b997] Start spawning the instance on the hypervisor. {{(pid=75229) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 10:06:18 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-956e64d7-357c-423b-86b3-6bc65b6b0701 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] [instance: 752995bf-8e0a-4832-94d8-280ab786b997] Creating instance directory {{(pid=75229) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 10:06:18 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-956e64d7-357c-423b-86b3-6bc65b6b0701 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] [instance: 752995bf-8e0a-4832-94d8-280ab786b997] Creating image(s)
Nov 14 10:06:18 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-956e64d7-357c-423b-86b3-6bc65b6b0701 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] [instance: 752995bf-8e0a-4832-94d8-280ab786b997] Did not create local disks {{(pid=75229) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 14 10:06:18 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-956e64d7-357c-423b-86b3-6bc65b6b0701 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] [instance: 752995bf-8e0a-4832-94d8-280ab786b997] Ensure instance console log exists: /opt/stack/data/nova/instances/752995bf-8e0a-4832-94d8-280ab786b997/console.log {{(pid=75229) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 10:06:18 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-956e64d7-357c-423b-86b3-6bc65b6b0701 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:06:18 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-956e64d7-357c-423b-86b3-6bc65b6b0701 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:06:18 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-956e64d7-357c-423b-86b3-6bc65b6b0701 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:06:18 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-956e64d7-357c-423b-86b3-6bc65b6b0701 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] [instance: 752995bf-8e0a-4832-94d8-280ab786b997] Start _get_guest_xml network_info=[{"id": "55228da7-a50c-4f39-ae39-83aeec11a818", "address": "fa:16:3e:c4:53:33", "network": {"id": "118ea7c1-77c0-4660-b7b7-f311f6b0ec8a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1907578504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46620ac128944703899f22fe5439ba26", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55228da7-a5", "ovs_interfaceid": "55228da7-a50c-4f39-ae39-83aeec11a818", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:c8892c7d-49e8-4f65-b88c-1e14fba8f50a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pSzmIUvP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '752995bf-8e0a-4832-94d8-280ab786b997', 'attached_at': '', 'detached_at': '', 'volume_id': 'c8892c7d-49e8-4f65-b88c-1e14fba8f50a', 'serial': 'c8892c7d-49e8-4f65-b88c-1e14fba8f50a'}, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'attachment_id': 'e24b62db-2820-4303-9ebb-40fb63bc7878', 'guest_format': None, 'device_type': 'disk', 'volume_type': None} {{(pid=75229) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 10:06:18 user nova-compute[75229]: WARNING nova.virt.libvirt.driver [None req-956e64d7-357c-423b-86b3-6bc65b6b0701 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 10:06:18 user nova-compute[75229]: WARNING nova.virt.libvirt.driver [None req-956e64d7-357c-423b-86b3-6bc65b6b0701 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 10:06:18 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-956e64d7-357c-423b-86b3-6bc65b6b0701 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75229) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 10:06:18 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-956e64d7-357c-423b-86b3-6bc65b6b0701 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] CPU controller missing on host. {{(pid=75229) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 10:06:18 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-956e64d7-357c-423b-86b3-6bc65b6b0701 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75229) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 10:06:18 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-956e64d7-357c-423b-86b3-6bc65b6b0701 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] CPU controller found on host. {{(pid=75229) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 10:06:18 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-956e64d7-357c-423b-86b3-6bc65b6b0701 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75229) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 10:06:18 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-956e64d7-357c-423b-86b3-6bc65b6b0701 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T09:39:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 10:06:18 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-956e64d7-357c-423b-86b3-6bc65b6b0701 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Flavor limits 0:0:0 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 10:06:18 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-956e64d7-357c-423b-86b3-6bc65b6b0701 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Image limits 0:0:0 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 10:06:18 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-956e64d7-357c-423b-86b3-6bc65b6b0701 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Flavor pref 0:0:0 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 10:06:18 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-956e64d7-357c-423b-86b3-6bc65b6b0701 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Image pref 0:0:0 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 10:06:18 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-956e64d7-357c-423b-86b3-6bc65b6b0701 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 10:06:18 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-956e64d7-357c-423b-86b3-6bc65b6b0701 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 10:06:18 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-956e64d7-357c-423b-86b3-6bc65b6b0701 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75229) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 10:06:18 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-956e64d7-357c-423b-86b3-6bc65b6b0701 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Got 1 possible topologies {{(pid=75229) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 10:06:18 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-956e64d7-357c-423b-86b3-6bc65b6b0701 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 10:06:18 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-956e64d7-357c-423b-86b3-6bc65b6b0701 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 10:06:18 user nova-compute[75229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-956e64d7-357c-423b-86b3-6bc65b6b0701 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] [instance: 752995bf-8e0a-4832-94d8-280ab786b997] Calling os-brick to attach iSCSI Volume {{(pid=75229) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 10:06:18 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-956e64d7-357c-423b-86b3-6bc65b6b0701 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f73f85151b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c8892c7d-49e8-4f65-b88c-1e14fba8f50a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pSzmIUvP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 10:06:18 user nova-compute[75229]: WARNING os_brick.initiator.connectors.base [None req-956e64d7-357c-423b-86b3-6bc65b6b0701 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 10:06:18 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-956e64d7-357c-423b-86b3-6bc65b6b0701 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 10:06:18 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-956e64d7-357c-423b-86b3-6bc65b6b0701 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 10:06:18 user nova-compute[75229]: WARNING os_brick.initiator.connectors.base [None req-956e64d7-357c-423b-86b3-6bc65b6b0701 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 10:06:18 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-956e64d7-357c-423b-86b3-6bc65b6b0701 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c8892c7d-49e8-4f65-b88c-1e14fba8f50a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 10:06:18 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-956e64d7-357c-423b-86b3-6bc65b6b0701 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c8892c7d-49e8-4f65-b88c-1e14fba8f50a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 10:06:18 user nova-compute[75229]: INFO os_brick.initiator.connectors.iscsi [None req-956e64d7-357c-423b-86b3-6bc65b6b0701 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 10:06:18 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c8892c7d-49e8-4f65-b88c-1e14fba8f50a -p 172.16.0.220:3260 {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:06:18 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:06:18 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c8892c7d-49e8-4f65-b88c-1e14fba8f50a -p 172.16.0.220:3260" returned: 21 in 0.027s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:06:18 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0b7e9e5-b550-4716-bbad-b41ded3c1ac7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:06:18 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-956e64d7-357c-423b-86b3-6bc65b6b0701 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 10:06:18 user nova-compute[75229]:  {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 10:06:18 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c8892c7d-49e8-4f65-b88c-1e14fba8f50a -p 172.16.0.220:3260 --interface default --op new {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:06:18 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c8892c7d-49e8-4f65-b88c-1e14fba8f50a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:06:18 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[4526ed89-c545-443f-8af6-d1718dae613c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c8892c7d-49e8-4f65-b88c-1e14fba8f50a] added\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:06:18 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-956e64d7-357c-423b-86b3-6bc65b6b0701 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c8892c7d-49e8-4f65-b88c-1e14fba8f50a] added
Nov 14 10:06:18 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 10:06:18 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c8892c7d-49e8-4f65-b88c-1e14fba8f50a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:06:18 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c8892c7d-49e8-4f65-b88c-1e14fba8f50a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:06:18 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[165eb34d-54f8-4c6b-864a-a5768aa45412]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:06:18 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-956e64d7-357c-423b-86b3-6bc65b6b0701 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 10:06:19 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c8892c7d-49e8-4f65-b88c-1e14fba8f50a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:06:19 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c8892c7d-49e8-4f65-b88c-1e14fba8f50a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:06:19 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[62962f94-12c6-4886-bc5c-a1a10f6e9715]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:06:19 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-956e64d7-357c-423b-86b3-6bc65b6b0701 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 10:06:19 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c8892c7d-49e8-4f65-b88c-1e14fba8f50a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pSzmIUvP {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:06:19 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c8892c7d-49e8-4f65-b88c-1e14fba8f50a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pSzmIUvP" returned: 0 in 0.020s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:06:19 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[1602de95-aeea-481b-aa11-2a7a8e3cd4df]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:06:19 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-956e64d7-357c-423b-86b3-6bc65b6b0701 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'pSzmIUvP'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 10:06:19 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c8892c7d-49e8-4f65-b88c-1e14fba8f50a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:06:19 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c8892c7d-49e8-4f65-b88c-1e14fba8f50a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:06:19 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9dc0722-0948-43bd-831c-b0f2c8c4e0f3]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:06:19 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-956e64d7-357c-423b-86b3-6bc65b6b0701 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 10:06:19 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:06:19 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:06:19 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b5b83b2-e043-46d9-adfd-f59735e0f469]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aebc438-0289-44fe-ad84-4e696468f50e (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4a6dca6-1581-494f-afe5-3aac2b4d2c15 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7aee6091-dab3-4c39-88a1-4bbb28dcab45 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ddb200b-47ca-4449-9973-be76424a6761 (non-flash)\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:06:19 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-956e64d7-357c-423b-86b3-6bc65b6b0701 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aebc438-0289-44fe-ad84-4e696468f50e (non-flash)
Nov 14 10:06:19 user nova-compute[75229]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4a6dca6-1581-494f-afe5-3aac2b4d2c15 (non-flash)
Nov 14 10:06:19 user nova-compute[75229]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7aee6091-dab3-4c39-88a1-4bbb28dcab45 (non-flash)
Nov 14 10:06:19 user nova-compute[75229]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ddb200b-47ca-4449-9973-be76424a6761 (non-flash)
Nov 14 10:06:19 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 10:06:19 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-956e64d7-357c-423b-86b3-6bc65b6b0701 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aebc438-0289-44fe-ad84-4e696468f50e (non-flash)
Nov 14 10:06:19 user nova-compute[75229]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4a6dca6-1581-494f-afe5-3aac2b4d2c15 (non-flash)
Nov 14 10:06:19 user nova-compute[75229]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7aee6091-dab3-4c39-88a1-4bbb28dcab45 (non-flash)
Nov 14 10:06:19 user nova-compute[75229]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ddb200b-47ca-4449-9973-be76424a6761 (non-flash)
Nov 14 10:06:19 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 10:06:19 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c8892c7d-49e8-4f65-b88c-1e14fba8f50a -p 172.16.0.220:3260 --login {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:06:19 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c8892c7d-49e8-4f65-b88c-1e14fba8f50a -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:06:19 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e75f44b-c045-436c-ba34-c9d093695e82]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c8892c7d-49e8-4f65-b88c-1e14fba8f50a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c8892c7d-49e8-4f65-b88c-1e14fba8f50a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:06:19 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-956e64d7-357c-423b-86b3-6bc65b6b0701 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c8892c7d-49e8-4f65-b88c-1e14fba8f50a, portal: 172.16.0.220,3260]
Nov 14 10:06:19 user nova-compute[75229]: Login to [iface: default, target: iqn.2010-10.org.openstack:c8892c7d-49e8-4f65-b88c-1e14fba8f50a, portal: 172.16.0.220,3260] successful.
Nov 14 10:06:19 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 10:06:19 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c8892c7d-49e8-4f65-b88c-1e14fba8f50a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:06:19 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c8892c7d-49e8-4f65-b88c-1e14fba8f50a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:06:19 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8951760-4aad-4f6f-bc0b-667f470aafda]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:06:19 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-956e64d7-357c-423b-86b3-6bc65b6b0701 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 10:06:19 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:06:19 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:06:19 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[576e1129-549b-4860-b2ff-2319eda1d6a3]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aebc438-0289-44fe-ad84-4e696468f50e (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4a6dca6-1581-494f-afe5-3aac2b4d2c15 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7aee6091-dab3-4c39-88a1-4bbb28dcab45 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ddb200b-47ca-4449-9973-be76424a6761 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8892c7d-49e8-4f65-b88c-1e14fba8f50a (non-flash)\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:06:19 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-956e64d7-357c-423b-86b3-6bc65b6b0701 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aebc438-0289-44fe-ad84-4e696468f50e (non-flash)
Nov 14 10:06:19 user nova-compute[75229]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4a6dca6-1581-494f-afe5-3aac2b4d2c15 (non-flash)
Nov 14 10:06:19 user nova-compute[75229]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7aee6091-dab3-4c39-88a1-4bbb28dcab45 (non-flash)
Nov 14 10:06:19 user nova-compute[75229]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ddb200b-47ca-4449-9973-be76424a6761 (non-flash)
Nov 14 10:06:19 user nova-compute[75229]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8892c7d-49e8-4f65-b88c-1e14fba8f50a (non-flash)
Nov 14 10:06:19 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 10:06:19 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-956e64d7-357c-423b-86b3-6bc65b6b0701 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aebc438-0289-44fe-ad84-4e696468f50e (non-flash)
Nov 14 10:06:19 user nova-compute[75229]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4a6dca6-1581-494f-afe5-3aac2b4d2c15 (non-flash)
Nov 14 10:06:19 user nova-compute[75229]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7aee6091-dab3-4c39-88a1-4bbb28dcab45 (non-flash)
Nov 14 10:06:19 user nova-compute[75229]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ddb200b-47ca-4449-9973-be76424a6761 (non-flash)
Nov 14 10:06:19 user nova-compute[75229]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8892c7d-49e8-4f65-b88c-1e14fba8f50a (non-flash)
Nov 14 10:06:19 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 10:06:19 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-956e64d7-357c-423b-86b3-6bc65b6b0701 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c8892c7d-49e8-4f65-b88c-1e14fba8f50a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.358s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 10:06:19 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-956e64d7-357c-423b-86b3-6bc65b6b0701 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Connected to 172.16.0.220:3260 {{(pid=75229) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 10:06:19 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-956e64d7-357c-423b-86b3-6bc65b6b0701 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] HCTL ('37', '-', '-', 0) found on session 49 with lun 0 {{(pid=75229) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 10:06:19 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-956e64d7-357c-423b-86b3-6bc65b6b0701 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75229) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 10:06:19 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:06:19 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.018s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:06:19 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[20228f06-f617-4df4-bb22-411d68deceaa]: (4, ('- - 0', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:06:19 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-956e64d7-357c-423b-86b3-6bc65b6b0701 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Searching for a device in session 49 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75229) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 10:06:19 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-956e64d7-357c-423b-86b3-6bc65b6b0701 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:c8892c7d-49e8-4f65-b88c-1e14fba8f50a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pSzmIUvP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75229) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 10:06:20 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-956e64d7-357c-423b-86b3-6bc65b6b0701 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.399s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 10:06:20 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-956e64d7-357c-423b-86b3-6bc65b6b0701 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] <== connect_volume: return (1401ms) {'type': 'block', 'scsi_wwn': '23534373037373930', 'path': '/dev/sdf'} {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 10:06:20 user nova-compute[75229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-956e64d7-357c-423b-86b3-6bc65b6b0701 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] [instance: 752995bf-8e0a-4832-94d8-280ab786b997] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23534373037373930', 'path': '/dev/sdf'} {{(pid=75229) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 10:06:20 user nova-compute[75229]: DEBUG nova.virt.libvirt.vif [None req-956e64d7-357c-423b-86b3-6bc65b6b0701 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T10:06:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-2147229783',display_name='tempest-TestVolumeBootPattern-server-2147229783',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-2147229783',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB5A5mLvKIp6dvI0hO7rO3NlF4G2D20sY7gWEAC+0V/AEyka0aVsvCwYcGQ5KpPpLYwOEY7teK2+b3AO8avbXCe5MdbQ1NPGUWXRV3gtRowACc3Uq7kyXeekLcjWCRcSng==',key_name='tempest-TestVolumeBootPattern-2092695190',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='46620ac128944703899f22fe5439ba26',ramdisk_id='',reservation_id='r-1mncmoyg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2064993142',owner_user_name='tempest-TestVolumeBootPattern-2064993142-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T10:06:14Z,user_data=None,user_id='c26f33e4cdf14ba796445959953f8685',uuid=752995bf-8e0a-4832-94d8-280ab786b997,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "55228da7-a50c-4f39-ae39-83aeec11a818", "address": "fa:16:3e:c4:53:33", "network": {"id": "118ea7c1-77c0-4660-b7b7-f311f6b0ec8a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1907578504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46620ac128944703899f22fe5439ba26", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55228da7-a5", "ovs_interfaceid": "55228da7-a50c-4f39-ae39-83aeec11a818", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75229) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 10:06:20 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-956e64d7-357c-423b-86b3-6bc65b6b0701 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Converting VIF {"id": "55228da7-a50c-4f39-ae39-83aeec11a818", "address": "fa:16:3e:c4:53:33", "network": {"id": "118ea7c1-77c0-4660-b7b7-f311f6b0ec8a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1907578504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46620ac128944703899f22fe5439ba26", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55228da7-a5", "ovs_interfaceid": "55228da7-a50c-4f39-ae39-83aeec11a818", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 10:06:20 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-956e64d7-357c-423b-86b3-6bc65b6b0701 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c4:53:33,bridge_name='br-int',has_traffic_filtering=True,id=55228da7-a50c-4f39-ae39-83aeec11a818,network=Network(118ea7c1-77c0-4660-b7b7-f311f6b0ec8a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap55228da7-a5') {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 10:06:20 user nova-compute[75229]: DEBUG nova.objects.instance [None req-956e64d7-357c-423b-86b3-6bc65b6b0701 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Lazy-loading 'pci_devices' on Instance uuid 752995bf-8e0a-4832-94d8-280ab786b997 {{(pid=75229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 10:06:20 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-956e64d7-357c-423b-86b3-6bc65b6b0701 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] [instance: 752995bf-8e0a-4832-94d8-280ab786b997] End _get_guest_xml xml=<domain type="kvm">
Nov 14 10:06:20 user nova-compute[75229]:   <uuid>752995bf-8e0a-4832-94d8-280ab786b997</uuid>
Nov 14 10:06:20 user nova-compute[75229]:   <name>instance-0000002f</name>
Nov 14 10:06:20 user nova-compute[75229]:   <memory>524288</memory>
Nov 14 10:06:20 user nova-compute[75229]:   <vcpu>1</vcpu>
Nov 14 10:06:20 user nova-compute[75229]:   <metadata>
Nov 14 10:06:20 user nova-compute[75229]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 10:06:20 user nova-compute[75229]:       <nova:package version="0.0.0"/>
Nov 14 10:06:20 user nova-compute[75229]:       <nova:name>tempest-TestVolumeBootPattern-server-2147229783</nova:name>
Nov 14 10:06:20 user nova-compute[75229]:       <nova:creationTime>2023-11-14 10:06:18</nova:creationTime>
Nov 14 10:06:20 user nova-compute[75229]:       <nova:flavor name="m1.tiny">
Nov 14 10:06:20 user nova-compute[75229]:         <nova:memory>512</nova:memory>
Nov 14 10:06:20 user nova-compute[75229]:         <nova:disk>1</nova:disk>
Nov 14 10:06:20 user nova-compute[75229]:         <nova:swap>0</nova:swap>
Nov 14 10:06:20 user nova-compute[75229]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 10:06:20 user nova-compute[75229]:         <nova:vcpus>1</nova:vcpus>
Nov 14 10:06:20 user nova-compute[75229]:       </nova:flavor>
Nov 14 10:06:20 user nova-compute[75229]:       <nova:owner>
Nov 14 10:06:20 user nova-compute[75229]:         <nova:user uuid="c26f33e4cdf14ba796445959953f8685">tempest-TestVolumeBootPattern-2064993142-project-member</nova:user>
Nov 14 10:06:20 user nova-compute[75229]:         <nova:project uuid="46620ac128944703899f22fe5439ba26">tempest-TestVolumeBootPattern-2064993142</nova:project>
Nov 14 10:06:20 user nova-compute[75229]:       </nova:owner>
Nov 14 10:06:20 user nova-compute[75229]:       <nova:ports>
Nov 14 10:06:20 user nova-compute[75229]:         <nova:port uuid="55228da7-a50c-4f39-ae39-83aeec11a818">
Nov 14 10:06:20 user nova-compute[75229]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 14 10:06:20 user nova-compute[75229]:         </nova:port>
Nov 14 10:06:20 user nova-compute[75229]:       </nova:ports>
Nov 14 10:06:20 user nova-compute[75229]:     </nova:instance>
Nov 14 10:06:20 user nova-compute[75229]:   </metadata>
Nov 14 10:06:20 user nova-compute[75229]:   <sysinfo type="smbios">
Nov 14 10:06:20 user nova-compute[75229]:     <system>
Nov 14 10:06:20 user nova-compute[75229]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 10:06:20 user nova-compute[75229]:       <entry name="product">OpenStack Nova</entry>
Nov 14 10:06:20 user nova-compute[75229]:       <entry name="version">0.0.0</entry>
Nov 14 10:06:20 user nova-compute[75229]:       <entry name="serial">752995bf-8e0a-4832-94d8-280ab786b997</entry>
Nov 14 10:06:20 user nova-compute[75229]:       <entry name="uuid">752995bf-8e0a-4832-94d8-280ab786b997</entry>
Nov 14 10:06:20 user nova-compute[75229]:       <entry name="family">Virtual Machine</entry>
Nov 14 10:06:20 user nova-compute[75229]:     </system>
Nov 14 10:06:20 user nova-compute[75229]:   </sysinfo>
Nov 14 10:06:20 user nova-compute[75229]:   <os>
Nov 14 10:06:20 user nova-compute[75229]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 10:06:20 user nova-compute[75229]:     <boot dev="hd"/>
Nov 14 10:06:20 user nova-compute[75229]:     <smbios mode="sysinfo"/>
Nov 14 10:06:20 user nova-compute[75229]:   </os>
Nov 14 10:06:20 user nova-compute[75229]:   <features>
Nov 14 10:06:20 user nova-compute[75229]:     <acpi/>
Nov 14 10:06:20 user nova-compute[75229]:     <apic/>
Nov 14 10:06:20 user nova-compute[75229]:     <vmcoreinfo/>
Nov 14 10:06:20 user nova-compute[75229]:   </features>
Nov 14 10:06:20 user nova-compute[75229]:   <clock offset="utc">
Nov 14 10:06:20 user nova-compute[75229]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 10:06:20 user nova-compute[75229]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 10:06:20 user nova-compute[75229]:     <timer name="hpet" present="no"/>
Nov 14 10:06:20 user nova-compute[75229]:   </clock>
Nov 14 10:06:20 user nova-compute[75229]:   <cpu mode="custom" match="exact">
Nov 14 10:06:20 user nova-compute[75229]:     <model>Nehalem</model>
Nov 14 10:06:20 user nova-compute[75229]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 10:06:20 user nova-compute[75229]:   </cpu>
Nov 14 10:06:20 user nova-compute[75229]:   <devices>
Nov 14 10:06:20 user nova-compute[75229]:     <disk type="block" device="disk">
Nov 14 10:06:20 user nova-compute[75229]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 10:06:20 user nova-compute[75229]:       <source dev="/dev/sdf"/>
Nov 14 10:06:20 user nova-compute[75229]:       <target dev="vda" bus="virtio"/>
Nov 14 10:06:20 user nova-compute[75229]:       <serial>c8892c7d-49e8-4f65-b88c-1e14fba8f50a</serial>
Nov 14 10:06:20 user nova-compute[75229]:     </disk>
Nov 14 10:06:20 user nova-compute[75229]:     <interface type="ethernet">
Nov 14 10:06:20 user nova-compute[75229]:       <mac address="fa:16:3e:c4:53:33"/>
Nov 14 10:06:20 user nova-compute[75229]:       <model type="virtio"/>
Nov 14 10:06:20 user nova-compute[75229]:       <mtu size="1442"/>
Nov 14 10:06:20 user nova-compute[75229]:       <target dev="tap55228da7-a5"/>
Nov 14 10:06:20 user nova-compute[75229]:     </interface>
Nov 14 10:06:20 user nova-compute[75229]:     <serial type="pty">
Nov 14 10:06:20 user nova-compute[75229]:       <log file="/opt/stack/data/nova/instances/752995bf-8e0a-4832-94d8-280ab786b997/console.log" append="off"/>
Nov 14 10:06:20 user nova-compute[75229]:     </serial>
Nov 14 10:06:20 user nova-compute[75229]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 10:06:20 user nova-compute[75229]:     <video>
Nov 14 10:06:20 user nova-compute[75229]:       <model type="virtio"/>
Nov 14 10:06:20 user nova-compute[75229]:     </video>
Nov 14 10:06:20 user nova-compute[75229]:     <rng model="virtio">
Nov 14 10:06:20 user nova-compute[75229]:       <backend model="random">/dev/urandom</backend>
Nov 14 10:06:20 user nova-compute[75229]:     </rng>
Nov 14 10:06:20 user nova-compute[75229]:     <controller type="usb" index="0" model="none"/>
Nov 14 10:06:20 user nova-compute[75229]:     <memballoon model="virtio">
Nov 14 10:06:20 user nova-compute[75229]:       <stats period="10"/>
Nov 14 10:06:20 user nova-compute[75229]:     </memballoon>
Nov 14 10:06:20 user nova-compute[75229]:   </devices>
Nov 14 10:06:20 user nova-compute[75229]: </domain>
Nov 14 10:06:20 user nova-compute[75229]:  {{(pid=75229) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 10:06:20 user nova-compute[75229]: DEBUG nova.virt.libvirt.vif [None req-956e64d7-357c-423b-86b3-6bc65b6b0701 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T10:06:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-2147229783',display_name='tempest-TestVolumeBootPattern-server-2147229783',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-2147229783',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB5A5mLvKIp6dvI0hO7rO3NlF4G2D20sY7gWEAC+0V/AEyka0aVsvCwYcGQ5KpPpLYwOEY7teK2+b3AO8avbXCe5MdbQ1NPGUWXRV3gtRowACc3Uq7kyXeekLcjWCRcSng==',key_name='tempest-TestVolumeBootPattern-2092695190',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='46620ac128944703899f22fe5439ba26',ramdisk_id='',reservation_id='r-1mncmoyg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2064993142',owner_user_name='tempest-TestVolumeBootPattern-2064993142-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T10:06:14Z,user_data=None,user_id='c26f33e4cdf14ba796445959953f8685',uuid=752995bf-8e0a-4832-94d8-280ab786b997,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "55228da7-a50c-4f39-ae39-83aeec11a818", "address": "fa:16:3e:c4:53:33", "network": {"id": "118ea7c1-77c0-4660-b7b7-f311f6b0ec8a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1907578504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46620ac128944703899f22fe5439ba26", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55228da7-a5", "ovs_interfaceid": "55228da7-a50c-4f39-ae39-83aeec11a818", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 10:06:20 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-956e64d7-357c-423b-86b3-6bc65b6b0701 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Converting VIF {"id": "55228da7-a50c-4f39-ae39-83aeec11a818", "address": "fa:16:3e:c4:53:33", "network": {"id": "118ea7c1-77c0-4660-b7b7-f311f6b0ec8a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1907578504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46620ac128944703899f22fe5439ba26", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55228da7-a5", "ovs_interfaceid": "55228da7-a50c-4f39-ae39-83aeec11a818", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 10:06:20 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-956e64d7-357c-423b-86b3-6bc65b6b0701 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c4:53:33,bridge_name='br-int',has_traffic_filtering=True,id=55228da7-a50c-4f39-ae39-83aeec11a818,network=Network(118ea7c1-77c0-4660-b7b7-f311f6b0ec8a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap55228da7-a5') {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 10:06:20 user nova-compute[75229]: DEBUG os_vif [None req-956e64d7-357c-423b-86b3-6bc65b6b0701 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c4:53:33,bridge_name='br-int',has_traffic_filtering=True,id=55228da7-a50c-4f39-ae39-83aeec11a818,network=Network(118ea7c1-77c0-4660-b7b7-f311f6b0ec8a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap55228da7-a5') {{(pid=75229) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 10:06:20 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:06:20 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 10:06:20 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 10:06:20 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:06:20 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ef7307fc-3747-55cf-9103-123609c1a8b0', '_type': 'linux-noop'}}, row=False) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 10:06:20 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:06:20 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 10:06:20 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:06:20 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap55228da7-a5, may_exist=True, interface_attrs={}) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 10:06:20 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap55228da7-a5, col_values=(('qos', UUID('bff292b1-e3cc-4927-8401-9af04bb7ab52')),), if_exists=True) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 10:06:20 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap55228da7-a5, col_values=(('external_ids', {'iface-id': '55228da7-a50c-4f39-ae39-83aeec11a818', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c4:53:33', 'vm-uuid': '752995bf-8e0a-4832-94d8-280ab786b997'}),), if_exists=True) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 10:06:20 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:06:20 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 10:06:20 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:06:20 user nova-compute[75229]: INFO os_vif [None req-956e64d7-357c-423b-86b3-6bc65b6b0701 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c4:53:33,bridge_name='br-int',has_traffic_filtering=True,id=55228da7-a50c-4f39-ae39-83aeec11a818,network=Network(118ea7c1-77c0-4660-b7b7-f311f6b0ec8a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap55228da7-a5')
Nov 14 10:06:20 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-956e64d7-357c-423b-86b3-6bc65b6b0701 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] No BDM found with device name vda, not building metadata. {{(pid=75229) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 10:06:20 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-956e64d7-357c-423b-86b3-6bc65b6b0701 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] No VIF found with MAC fa:16:3e:c4:53:33, not building metadata {{(pid=75229) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 10:06:21 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:06:21 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:06:21 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:06:21 user nova-compute[75229]: DEBUG nova.compute.manager [req-986cca71-1842-4fc4-ac9f-6ddc2be3f4a4 req-2b3b33b8-b2e0-44ce-92ef-ab3599b8e06e service nova] [instance: 752995bf-8e0a-4832-94d8-280ab786b997] Received event network-vif-plugged-55228da7-a50c-4f39-ae39-83aeec11a818 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 10:06:21 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-986cca71-1842-4fc4-ac9f-6ddc2be3f4a4 req-2b3b33b8-b2e0-44ce-92ef-ab3599b8e06e service nova] Acquiring lock "752995bf-8e0a-4832-94d8-280ab786b997-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:06:21 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-986cca71-1842-4fc4-ac9f-6ddc2be3f4a4 req-2b3b33b8-b2e0-44ce-92ef-ab3599b8e06e service nova] Lock "752995bf-8e0a-4832-94d8-280ab786b997-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:06:21 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-986cca71-1842-4fc4-ac9f-6ddc2be3f4a4 req-2b3b33b8-b2e0-44ce-92ef-ab3599b8e06e service nova] Lock "752995bf-8e0a-4832-94d8-280ab786b997-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:06:21 user nova-compute[75229]: DEBUG nova.compute.manager [req-986cca71-1842-4fc4-ac9f-6ddc2be3f4a4 req-2b3b33b8-b2e0-44ce-92ef-ab3599b8e06e service nova] [instance: 752995bf-8e0a-4832-94d8-280ab786b997] No waiting events found dispatching network-vif-plugged-55228da7-a50c-4f39-ae39-83aeec11a818 {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 10:06:21 user nova-compute[75229]: WARNING nova.compute.manager [req-986cca71-1842-4fc4-ac9f-6ddc2be3f4a4 req-2b3b33b8-b2e0-44ce-92ef-ab3599b8e06e service nova] [instance: 752995bf-8e0a-4832-94d8-280ab786b997] Received unexpected event network-vif-plugged-55228da7-a50c-4f39-ae39-83aeec11a818 for instance with vm_state building and task_state spawning.
Nov 14 10:06:22 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:06:22 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:06:23 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:06:23 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:06:24 user nova-compute[75229]: DEBUG nova.compute.manager [req-16c5a62c-332d-43f5-8ea7-1ad340e8ffb1 req-3d48a129-fa0b-4244-813a-677c149f82ef service nova] [instance: 752995bf-8e0a-4832-94d8-280ab786b997] Received event network-vif-plugged-55228da7-a50c-4f39-ae39-83aeec11a818 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 10:06:24 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-16c5a62c-332d-43f5-8ea7-1ad340e8ffb1 req-3d48a129-fa0b-4244-813a-677c149f82ef service nova] Acquiring lock "752995bf-8e0a-4832-94d8-280ab786b997-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:06:24 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-16c5a62c-332d-43f5-8ea7-1ad340e8ffb1 req-3d48a129-fa0b-4244-813a-677c149f82ef service nova] Lock "752995bf-8e0a-4832-94d8-280ab786b997-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:06:24 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-16c5a62c-332d-43f5-8ea7-1ad340e8ffb1 req-3d48a129-fa0b-4244-813a-677c149f82ef service nova] Lock "752995bf-8e0a-4832-94d8-280ab786b997-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:06:24 user nova-compute[75229]: DEBUG nova.compute.manager [req-16c5a62c-332d-43f5-8ea7-1ad340e8ffb1 req-3d48a129-fa0b-4244-813a-677c149f82ef service nova] [instance: 752995bf-8e0a-4832-94d8-280ab786b997] No waiting events found dispatching network-vif-plugged-55228da7-a50c-4f39-ae39-83aeec11a818 {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 10:06:24 user nova-compute[75229]: WARNING nova.compute.manager [req-16c5a62c-332d-43f5-8ea7-1ad340e8ffb1 req-3d48a129-fa0b-4244-813a-677c149f82ef service nova] [instance: 752995bf-8e0a-4832-94d8-280ab786b997] Received unexpected event network-vif-plugged-55228da7-a50c-4f39-ae39-83aeec11a818 for instance with vm_state building and task_state spawning.
Nov 14 10:06:24 user nova-compute[75229]: DEBUG nova.compute.manager [None req-956e64d7-357c-423b-86b3-6bc65b6b0701 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] [instance: 752995bf-8e0a-4832-94d8-280ab786b997] Instance event wait completed in 0 seconds for  {{(pid=75229) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 10:06:24 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-956e64d7-357c-423b-86b3-6bc65b6b0701 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] [instance: 752995bf-8e0a-4832-94d8-280ab786b997] Guest created on hypervisor {{(pid=75229) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 10:06:24 user nova-compute[75229]: INFO nova.virt.libvirt.driver [-] [instance: 752995bf-8e0a-4832-94d8-280ab786b997] Instance spawned successfully.
Nov 14 10:06:24 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-956e64d7-357c-423b-86b3-6bc65b6b0701 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] [instance: 752995bf-8e0a-4832-94d8-280ab786b997] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 10:06:24 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-956e64d7-357c-423b-86b3-6bc65b6b0701 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] [instance: 752995bf-8e0a-4832-94d8-280ab786b997] Found default for hw_cdrom_bus of ide {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 10:06:24 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-956e64d7-357c-423b-86b3-6bc65b6b0701 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] [instance: 752995bf-8e0a-4832-94d8-280ab786b997] Found default for hw_disk_bus of virtio {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 10:06:24 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-956e64d7-357c-423b-86b3-6bc65b6b0701 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] [instance: 752995bf-8e0a-4832-94d8-280ab786b997] Found default for hw_input_bus of None {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 10:06:24 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-956e64d7-357c-423b-86b3-6bc65b6b0701 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] [instance: 752995bf-8e0a-4832-94d8-280ab786b997] Found default for hw_pointer_model of None {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 10:06:24 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-956e64d7-357c-423b-86b3-6bc65b6b0701 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] [instance: 752995bf-8e0a-4832-94d8-280ab786b997] Found default for hw_video_model of virtio {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 10:06:24 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-956e64d7-357c-423b-86b3-6bc65b6b0701 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] [instance: 752995bf-8e0a-4832-94d8-280ab786b997] Found default for hw_vif_model of virtio {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 10:06:24 user nova-compute[75229]: INFO nova.compute.manager [None req-956e64d7-357c-423b-86b3-6bc65b6b0701 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] [instance: 752995bf-8e0a-4832-94d8-280ab786b997] Took 5.62 seconds to spawn the instance on the hypervisor.
Nov 14 10:06:24 user nova-compute[75229]: DEBUG nova.compute.manager [None req-956e64d7-357c-423b-86b3-6bc65b6b0701 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] [instance: 752995bf-8e0a-4832-94d8-280ab786b997] Checking state {{(pid=75229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 10:06:24 user nova-compute[75229]: INFO nova.compute.manager [None req-956e64d7-357c-423b-86b3-6bc65b6b0701 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] [instance: 752995bf-8e0a-4832-94d8-280ab786b997] Took 11.48 seconds to build instance.
Nov 14 10:06:24 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-956e64d7-357c-423b-86b3-6bc65b6b0701 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Lock "752995bf-8e0a-4832-94d8-280ab786b997" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.708s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:06:25 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:06:28 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:06:30 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:06:32 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:06:33 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:06:34 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:06:35 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:06:38 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:06:40 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:06:43 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:06:45 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:06:48 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:06:50 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:06:51 user nova-compute[75229]: DEBUG nova.compute.manager [req-69d0f023-95f0-40af-8ceb-e437c880cc65 req-d4fb0560-813e-47f4-8498-3eb1d0b85bbd service nova] [instance: abe7e145-d3bc-49a1-83be-793488de828b] Received event network-changed-fe62c72a-f69b-4109-bfa3-e4a51fa43d0e {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 10:06:51 user nova-compute[75229]: DEBUG nova.compute.manager [req-69d0f023-95f0-40af-8ceb-e437c880cc65 req-d4fb0560-813e-47f4-8498-3eb1d0b85bbd service nova] [instance: abe7e145-d3bc-49a1-83be-793488de828b] Refreshing instance network info cache due to event network-changed-fe62c72a-f69b-4109-bfa3-e4a51fa43d0e. {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 10:06:51 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-69d0f023-95f0-40af-8ceb-e437c880cc65 req-d4fb0560-813e-47f4-8498-3eb1d0b85bbd service nova] Acquiring lock "refresh_cache-abe7e145-d3bc-49a1-83be-793488de828b" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 10:06:51 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-69d0f023-95f0-40af-8ceb-e437c880cc65 req-d4fb0560-813e-47f4-8498-3eb1d0b85bbd service nova] Acquired lock "refresh_cache-abe7e145-d3bc-49a1-83be-793488de828b" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 10:06:51 user nova-compute[75229]: DEBUG nova.network.neutron [req-69d0f023-95f0-40af-8ceb-e437c880cc65 req-d4fb0560-813e-47f4-8498-3eb1d0b85bbd service nova] [instance: abe7e145-d3bc-49a1-83be-793488de828b] Refreshing network info cache for port fe62c72a-f69b-4109-bfa3-e4a51fa43d0e {{(pid=75229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 10:06:51 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-e34e1ae2-5c31-4a26-aad9-2f4eb39f616f tempest-TestShelveInstance-1161595377 tempest-TestShelveInstance-1161595377-project-member] Acquiring lock "abe7e145-d3bc-49a1-83be-793488de828b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:06:51 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-e34e1ae2-5c31-4a26-aad9-2f4eb39f616f tempest-TestShelveInstance-1161595377 tempest-TestShelveInstance-1161595377-project-member] Lock "abe7e145-d3bc-49a1-83be-793488de828b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:06:51 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-e34e1ae2-5c31-4a26-aad9-2f4eb39f616f tempest-TestShelveInstance-1161595377 tempest-TestShelveInstance-1161595377-project-member] Acquiring lock "abe7e145-d3bc-49a1-83be-793488de828b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:06:51 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-e34e1ae2-5c31-4a26-aad9-2f4eb39f616f tempest-TestShelveInstance-1161595377 tempest-TestShelveInstance-1161595377-project-member] Lock "abe7e145-d3bc-49a1-83be-793488de828b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:06:51 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-e34e1ae2-5c31-4a26-aad9-2f4eb39f616f tempest-TestShelveInstance-1161595377 tempest-TestShelveInstance-1161595377-project-member] Lock "abe7e145-d3bc-49a1-83be-793488de828b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:06:51 user nova-compute[75229]: INFO nova.compute.manager [None req-e34e1ae2-5c31-4a26-aad9-2f4eb39f616f tempest-TestShelveInstance-1161595377 tempest-TestShelveInstance-1161595377-project-member] [instance: abe7e145-d3bc-49a1-83be-793488de828b] Terminating instance
Nov 14 10:06:51 user nova-compute[75229]: DEBUG nova.compute.manager [None req-e34e1ae2-5c31-4a26-aad9-2f4eb39f616f tempest-TestShelveInstance-1161595377 tempest-TestShelveInstance-1161595377-project-member] [instance: abe7e145-d3bc-49a1-83be-793488de828b] Start destroying the instance on the hypervisor. {{(pid=75229) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 10:06:51 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:06:51 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:06:51 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:06:51 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:06:51 user nova-compute[75229]: DEBUG nova.compute.manager [req-d9a22a86-1bdf-4d96-9ee7-4f328d815041 req-d175b82b-e8ab-499c-9fd8-faf2db344c67 service nova] [instance: abe7e145-d3bc-49a1-83be-793488de828b] Received event network-vif-unplugged-fe62c72a-f69b-4109-bfa3-e4a51fa43d0e {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 10:06:51 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-d9a22a86-1bdf-4d96-9ee7-4f328d815041 req-d175b82b-e8ab-499c-9fd8-faf2db344c67 service nova] Acquiring lock "abe7e145-d3bc-49a1-83be-793488de828b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:06:51 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-d9a22a86-1bdf-4d96-9ee7-4f328d815041 req-d175b82b-e8ab-499c-9fd8-faf2db344c67 service nova] Lock "abe7e145-d3bc-49a1-83be-793488de828b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:06:51 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-d9a22a86-1bdf-4d96-9ee7-4f328d815041 req-d175b82b-e8ab-499c-9fd8-faf2db344c67 service nova] Lock "abe7e145-d3bc-49a1-83be-793488de828b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:06:51 user nova-compute[75229]: DEBUG nova.compute.manager [req-d9a22a86-1bdf-4d96-9ee7-4f328d815041 req-d175b82b-e8ab-499c-9fd8-faf2db344c67 service nova] [instance: abe7e145-d3bc-49a1-83be-793488de828b] No waiting events found dispatching network-vif-unplugged-fe62c72a-f69b-4109-bfa3-e4a51fa43d0e {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 10:06:51 user nova-compute[75229]: DEBUG nova.compute.manager [req-d9a22a86-1bdf-4d96-9ee7-4f328d815041 req-d175b82b-e8ab-499c-9fd8-faf2db344c67 service nova] [instance: abe7e145-d3bc-49a1-83be-793488de828b] Received event network-vif-unplugged-fe62c72a-f69b-4109-bfa3-e4a51fa43d0e for instance with task_state deleting. {{(pid=75229) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 10:06:51 user nova-compute[75229]: DEBUG nova.network.neutron [req-69d0f023-95f0-40af-8ceb-e437c880cc65 req-d4fb0560-813e-47f4-8498-3eb1d0b85bbd service nova] [instance: abe7e145-d3bc-49a1-83be-793488de828b] Updated VIF entry in instance network info cache for port fe62c72a-f69b-4109-bfa3-e4a51fa43d0e. {{(pid=75229) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 10:06:51 user nova-compute[75229]: DEBUG nova.network.neutron [req-69d0f023-95f0-40af-8ceb-e437c880cc65 req-d4fb0560-813e-47f4-8498-3eb1d0b85bbd service nova] [instance: abe7e145-d3bc-49a1-83be-793488de828b] Updating instance_info_cache with network_info: [{"id": "fe62c72a-f69b-4109-bfa3-e4a51fa43d0e", "address": "fa:16:3e:f8:a3:e5", "network": {"id": "f0c67d05-ffe2-4866-baa3-fa4acaeadaa1", "bridge": "br-int", "label": "tempest-TestShelveInstance-1922554351-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d1aa0aeea4145b69bf310c4d9b649d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe62c72a-f6", "ovs_interfaceid": "fe62c72a-f69b-4109-bfa3-e4a51fa43d0e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 10:06:51 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-69d0f023-95f0-40af-8ceb-e437c880cc65 req-d4fb0560-813e-47f4-8498-3eb1d0b85bbd service nova] Releasing lock "refresh_cache-abe7e145-d3bc-49a1-83be-793488de828b" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 10:06:52 user nova-compute[75229]: INFO nova.virt.libvirt.driver [-] [instance: abe7e145-d3bc-49a1-83be-793488de828b] Instance destroyed successfully.
Nov 14 10:06:52 user nova-compute[75229]: DEBUG nova.objects.instance [None req-e34e1ae2-5c31-4a26-aad9-2f4eb39f616f tempest-TestShelveInstance-1161595377 tempest-TestShelveInstance-1161595377-project-member] Lazy-loading 'resources' on Instance uuid abe7e145-d3bc-49a1-83be-793488de828b {{(pid=75229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 10:06:52 user nova-compute[75229]: DEBUG nova.virt.libvirt.vif [None req-e34e1ae2-5c31-4a26-aad9-2f4eb39f616f tempest-TestShelveInstance-1161595377 tempest-TestShelveInstance-1161595377-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-14T10:01:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1956352286',display_name='tempest-TestShelveInstance-server-1956352286',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1956352286',id=39,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLok8uDDoJEyioPdIocdaZ5mZahqhblgQ0EaVI+XqvZ5awYdli0p5VbxXjHgh+7IXxcRUPZZKXYprbMW6OXihRZCCr8OWYnUiMmEy0FQ5s4gHpX4TAp2yBSEZomFcAdpKw==',key_name='tempest-TestShelveInstance-743585374',keypairs=<?>,launch_index=0,launched_at=2023-11-14T10:05:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0d1aa0aeea4145b69bf310c4d9b649d0',ramdisk_id='',reservation_id='r-ysbldy6n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1161595377',owner_user_name='tempest-TestShelveInstance-1161595377-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T10:05:11Z,user_data=None,user_id='cd2c5b18ddd44bf18089cf001e012ebb',uuid=abe7e145-d3bc-49a1-83be-793488de828b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fe62c72a-f69b-4109-bfa3-e4a51fa43d0e", "address": "fa:16:3e:f8:a3:e5", "network": {"id": "f0c67d05-ffe2-4866-baa3-fa4acaeadaa1", "bridge": "br-int", "label": "tempest-TestShelveInstance-1922554351-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.5", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d1aa0aeea4145b69bf310c4d9b649d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe62c72a-f6", "ovs_interfaceid": "fe62c72a-f69b-4109-bfa3-e4a51fa43d0e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 10:06:52 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-e34e1ae2-5c31-4a26-aad9-2f4eb39f616f tempest-TestShelveInstance-1161595377 tempest-TestShelveInstance-1161595377-project-member] Converting VIF {"id": "fe62c72a-f69b-4109-bfa3-e4a51fa43d0e", "address": "fa:16:3e:f8:a3:e5", "network": {"id": "f0c67d05-ffe2-4866-baa3-fa4acaeadaa1", "bridge": "br-int", "label": "tempest-TestShelveInstance-1922554351-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.5", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d1aa0aeea4145b69bf310c4d9b649d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe62c72a-f6", "ovs_interfaceid": "fe62c72a-f69b-4109-bfa3-e4a51fa43d0e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 10:06:52 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-e34e1ae2-5c31-4a26-aad9-2f4eb39f616f tempest-TestShelveInstance-1161595377 tempest-TestShelveInstance-1161595377-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f8:a3:e5,bridge_name='br-int',has_traffic_filtering=True,id=fe62c72a-f69b-4109-bfa3-e4a51fa43d0e,network=Network(f0c67d05-ffe2-4866-baa3-fa4acaeadaa1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe62c72a-f6') {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 10:06:52 user nova-compute[75229]: DEBUG os_vif [None req-e34e1ae2-5c31-4a26-aad9-2f4eb39f616f tempest-TestShelveInstance-1161595377 tempest-TestShelveInstance-1161595377-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f8:a3:e5,bridge_name='br-int',has_traffic_filtering=True,id=fe62c72a-f69b-4109-bfa3-e4a51fa43d0e,network=Network(f0c67d05-ffe2-4866-baa3-fa4acaeadaa1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe62c72a-f6') {{(pid=75229) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 10:06:52 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:06:52 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfe62c72a-f6, bridge=br-int, if_exists=True) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 10:06:52 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:06:52 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:06:52 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:06:52 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f5924cf6-5b2f-4f83-ae6b-f296c2ba221d) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 10:06:52 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:06:52 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:06:52 user nova-compute[75229]: INFO os_vif [None req-e34e1ae2-5c31-4a26-aad9-2f4eb39f616f tempest-TestShelveInstance-1161595377 tempest-TestShelveInstance-1161595377-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f8:a3:e5,bridge_name='br-int',has_traffic_filtering=True,id=fe62c72a-f69b-4109-bfa3-e4a51fa43d0e,network=Network(f0c67d05-ffe2-4866-baa3-fa4acaeadaa1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe62c72a-f6')
Nov 14 10:06:52 user nova-compute[75229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e34e1ae2-5c31-4a26-aad9-2f4eb39f616f tempest-TestShelveInstance-1161595377 tempest-TestShelveInstance-1161595377-project-member] [instance: abe7e145-d3bc-49a1-83be-793488de828b] calling os-brick to detach iSCSI Volume {{(pid=75229) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 10:06:52 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-e34e1ae2-5c31-4a26-aad9-2f4eb39f616f tempest-TestShelveInstance-1161595377 tempest-TestShelveInstance-1161595377-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f73f85151b0>, {'target_iqn': 'iqn.2010-10.org.openstack:e4a6dca6-1581-494f-afe5-3aac2b4d2c15', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VCFjOGhf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 10:06:52 user nova-compute[75229]: WARNING os_brick.initiator.connectors.base [None req-e34e1ae2-5c31-4a26-aad9-2f4eb39f616f tempest-TestShelveInstance-1161595377 tempest-TestShelveInstance-1161595377-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 10:06:52 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-e34e1ae2-5c31-4a26-aad9-2f4eb39f616f tempest-TestShelveInstance-1161595377 tempest-TestShelveInstance-1161595377-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 10:06:52 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-e34e1ae2-5c31-4a26-aad9-2f4eb39f616f tempest-TestShelveInstance-1161595377 tempest-TestShelveInstance-1161595377-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 10:06:52 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:06:52 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:06:52 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5291386-3255-4d91-a401-6ba578373a09]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4ddb200b-47ca-4449-9973-be76424a6761\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7aee6091-dab3-4c39-88a1-4bbb28dcab45\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c8892c7d-49e8-4f65-b88c-1e14fba8f50a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5aebc438-0289-44fe-ad84-4e696468f50e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e4a6dca6-1581-494f-afe5-3aac2b4d2c15\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:06:52 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-e34e1ae2-5c31-4a26-aad9-2f4eb39f616f tempest-TestShelveInstance-1161595377 tempest-TestShelveInstance-1161595377-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 10:06:52 user nova-compute[75229]: No targets found.
Nov 14 10:06:52 user nova-compute[75229]: iSNS:
Nov 14 10:06:52 user nova-compute[75229]: No targets found.
Nov 14 10:06:52 user nova-compute[75229]: STATIC:
Nov 14 10:06:52 user nova-compute[75229]: Target: iqn.2010-10.org.openstack:4ddb200b-47ca-4449-9973-be76424a6761
Nov 14 10:06:52 user nova-compute[75229]:         Portal: 172.16.0.220:3260,-1
Nov 14 10:06:52 user nova-compute[75229]:                 Iface Name: default
Nov 14 10:06:52 user nova-compute[75229]: Target: iqn.2010-10.org.openstack:7aee6091-dab3-4c39-88a1-4bbb28dcab45
Nov 14 10:06:52 user nova-compute[75229]:         Portal: 172.16.0.220:3260,-1
Nov 14 10:06:52 user nova-compute[75229]:                 Iface Name: default
Nov 14 10:06:52 user nova-compute[75229]: Target: iqn.2010-10.org.openstack:c8892c7d-49e8-4f65-b88c-1e14fba8f50a
Nov 14 10:06:52 user nova-compute[75229]:         Portal: 172.16.0.220:3260,-1
Nov 14 10:06:52 user nova-compute[75229]:                 Iface Name: default
Nov 14 10:06:52 user nova-compute[75229]: Target: iqn.2010-10.org.openstack:5aebc438-0289-44fe-ad84-4e696468f50e
Nov 14 10:06:52 user nova-compute[75229]:         Portal: 172.16.0.220:3260,-1
Nov 14 10:06:52 user nova-compute[75229]:                 Iface Name: default
Nov 14 10:06:52 user nova-compute[75229]: Target: iqn.2010-10.org.openstack:e4a6dca6-1581-494f-afe5-3aac2b4d2c15
Nov 14 10:06:52 user nova-compute[75229]:         Portal: 172.16.0.220:3260,-1
Nov 14 10:06:52 user nova-compute[75229]:                 Iface Name: default
Nov 14 10:06:52 user nova-compute[75229]: FIRMWARE:
Nov 14 10:06:52 user nova-compute[75229]: No targets found.
Nov 14 10:06:52 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 10:06:52 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-e34e1ae2-5c31-4a26-aad9-2f4eb39f616f tempest-TestShelveInstance-1161595377 tempest-TestShelveInstance-1161595377-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 10:06:52 user nova-compute[75229]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 10:06:52 user nova-compute[75229]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75229) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 10:06:52 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-e34e1ae2-5c31-4a26-aad9-2f4eb39f616f tempest-TestShelveInstance-1161595377 tempest-TestShelveInstance-1161595377-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e4a6dca6-1581-494f-afe5-3aac2b4d2c15', 0)] {{(pid=75229) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 10:06:52 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:06:52 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:06:52 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[19e24c05-b0e0-4f2f-b221-62c991333127]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4ddb200b-47ca-4449-9973-be76424a6761\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5aebc438-0289-44fe-ad84-4e696468f50e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7aee6091-dab3-4c39-88a1-4bbb28dcab45\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c8892c7d-49e8-4f65-b88c-1e14fba8f50a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e4a6dca6-1581-494f-afe5-3aac2b4d2c15\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:06:52 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:06:52 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:06:52 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[db15f360-6300-4909-a3c1-d3e26b4b70ba]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aebc438-0289-44fe-ad84-4e696468f50e (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4a6dca6-1581-494f-afe5-3aac2b4d2c15 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7aee6091-dab3-4c39-88a1-4bbb28dcab45 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ddb200b-47ca-4449-9973-be76424a6761 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8892c7d-49e8-4f65-b88c-1e14fba8f50a (non-flash)\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:06:52 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-e34e1ae2-5c31-4a26-aad9-2f4eb39f616f tempest-TestShelveInstance-1161595377 tempest-TestShelveInstance-1161595377-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aebc438-0289-44fe-ad84-4e696468f50e (non-flash)
Nov 14 10:06:52 user nova-compute[75229]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4a6dca6-1581-494f-afe5-3aac2b4d2c15 (non-flash)
Nov 14 10:06:52 user nova-compute[75229]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7aee6091-dab3-4c39-88a1-4bbb28dcab45 (non-flash)
Nov 14 10:06:52 user nova-compute[75229]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ddb200b-47ca-4449-9973-be76424a6761 (non-flash)
Nov 14 10:06:52 user nova-compute[75229]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8892c7d-49e8-4f65-b88c-1e14fba8f50a (non-flash)
Nov 14 10:06:52 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 10:06:52 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-e34e1ae2-5c31-4a26-aad9-2f4eb39f616f tempest-TestShelveInstance-1161595377 tempest-TestShelveInstance-1161595377-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aebc438-0289-44fe-ad84-4e696468f50e (non-flash)
Nov 14 10:06:52 user nova-compute[75229]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4a6dca6-1581-494f-afe5-3aac2b4d2c15 (non-flash)
Nov 14 10:06:52 user nova-compute[75229]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7aee6091-dab3-4c39-88a1-4bbb28dcab45 (non-flash)
Nov 14 10:06:52 user nova-compute[75229]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ddb200b-47ca-4449-9973-be76424a6761 (non-flash)
Nov 14 10:06:52 user nova-compute[75229]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8892c7d-49e8-4f65-b88c-1e14fba8f50a (non-flash)
Nov 14 10:06:52 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 10:06:52 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-e34e1ae2-5c31-4a26-aad9-2f4eb39f616f tempest-TestShelveInstance-1161595377 tempest-TestShelveInstance-1161595377-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f73d4e99870>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e4a6dca6-1581-494f-afe5-3aac2b4d2c15'): ({'sdb'}, set())}) {{(pid=75229) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 10:06:52 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-e34e1ae2-5c31-4a26-aad9-2f4eb39f616f tempest-TestShelveInstance-1161595377 tempest-TestShelveInstance-1161595377-project-member] Removing single pathed devices sdb {{(pid=75229) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 10:06:52 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:06:52 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:06:52 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[606a3225-cba2-41e9-9c51-97fec919b935]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:06:52 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:06:52 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:06:52 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[6834b680-f604-439a-aca9-20de89dcea78]: (4, ('ok\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:06:52 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-e34e1ae2-5c31-4a26-aad9-2f4eb39f616f tempest-TestShelveInstance-1161595377 tempest-TestShelveInstance-1161595377-project-member] Flushing IO for device /dev/sdb {{(pid=75229) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 10:06:52 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:06:52 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.018s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:06:52 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[360bf9a8-3ab3-41f7-97c3-1dcfa6c561b4]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:06:52 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-e34e1ae2-5c31-4a26-aad9-2f4eb39f616f tempest-TestShelveInstance-1161595377 tempest-TestShelveInstance-1161595377-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75229) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 10:06:52 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:06:52 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.051s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:06:52 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[30eabb60-e51b-4969-a941-a003bad06d5c]: (4, ('1', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:06:52 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-e34e1ae2-5c31-4a26-aad9-2f4eb39f616f tempest-TestShelveInstance-1161595377 tempest-TestShelveInstance-1161595377-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75229) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 10:06:52 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-e34e1ae2-5c31-4a26-aad9-2f4eb39f616f tempest-TestShelveInstance-1161595377 tempest-TestShelveInstance-1161595377-project-member] SCSI volumes sdb have been removed. {{(pid=75229) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 10:06:52 user nova-compute[75229]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_6f31db6b',) {{(pid=86458) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 14 10:06:52 user nova-compute[75229]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-SSCST_BIO_Storage_6f31db6b
Nov 14 10:06:52 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b1e4d53-2051-4fc7-b1a6-623fedf0b5ed]: (4, None) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:06:52 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-e34e1ae2-5c31-4a26-aad9-2f4eb39f616f tempest-TestShelveInstance-1161595377 tempest-TestShelveInstance-1161595377-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e4a6dca6-1581-494f-afe5-3aac2b4d2c15')] {{(pid=75229) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 10:06:52 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4a6dca6-1581-494f-afe5-3aac2b4d2c15 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:06:52 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4a6dca6-1581-494f-afe5-3aac2b4d2c15 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:06:52 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef3dc54b-5571-4a51-ae38-d6b5b5d409e6]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:06:52 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-e34e1ae2-5c31-4a26-aad9-2f4eb39f616f tempest-TestShelveInstance-1161595377 tempest-TestShelveInstance-1161595377-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 10:06:52 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4a6dca6-1581-494f-afe5-3aac2b4d2c15 -p 172.16.0.220:3260 --logout {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:06:52 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4a6dca6-1581-494f-afe5-3aac2b4d2c15 -p 172.16.0.220:3260 --logout" returned: 0 in 0.048s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:06:52 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e887451-ce58-48e1-a2d0-3f47aaa6f222]: (4, ('Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:e4a6dca6-1581-494f-afe5-3aac2b4d2c15, portal: 172.16.0.220,3260]\nLogout of [sid: 45, target: iqn.2010-10.org.openstack:e4a6dca6-1581-494f-afe5-3aac2b4d2c15, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:06:52 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-e34e1ae2-5c31-4a26-aad9-2f4eb39f616f tempest-TestShelveInstance-1161595377 tempest-TestShelveInstance-1161595377-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:e4a6dca6-1581-494f-afe5-3aac2b4d2c15, portal: 172.16.0.220,3260]
Nov 14 10:06:52 user nova-compute[75229]: Logout of [sid: 45, target: iqn.2010-10.org.openstack:e4a6dca6-1581-494f-afe5-3aac2b4d2c15, portal: 172.16.0.220,3260] successful.
Nov 14 10:06:52 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 10:06:52 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4a6dca6-1581-494f-afe5-3aac2b4d2c15 -p 172.16.0.220:3260 --op delete {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:06:52 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4a6dca6-1581-494f-afe5-3aac2b4d2c15 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:06:52 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebc105d7-52d0-414b-afdb-b217b3ecfa63]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:06:52 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-e34e1ae2-5c31-4a26-aad9-2f4eb39f616f tempest-TestShelveInstance-1161595377 tempest-TestShelveInstance-1161595377-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 10:06:52 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-e34e1ae2-5c31-4a26-aad9-2f4eb39f616f tempest-TestShelveInstance-1161595377 tempest-TestShelveInstance-1161595377-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.317s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 10:06:52 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-e34e1ae2-5c31-4a26-aad9-2f4eb39f616f tempest-TestShelveInstance-1161595377 tempest-TestShelveInstance-1161595377-project-member] <== disconnect_volume: return (318ms) None {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 10:06:52 user nova-compute[75229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e34e1ae2-5c31-4a26-aad9-2f4eb39f616f tempest-TestShelveInstance-1161595377 tempest-TestShelveInstance-1161595377-project-member] [instance: abe7e145-d3bc-49a1-83be-793488de828b] Disconnected iSCSI Volume {{(pid=75229) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 10:06:52 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-e34e1ae2-5c31-4a26-aad9-2f4eb39f616f tempest-TestShelveInstance-1161595377 tempest-TestShelveInstance-1161595377-project-member] [instance: abe7e145-d3bc-49a1-83be-793488de828b] Deleting instance files /opt/stack/data/nova/instances/abe7e145-d3bc-49a1-83be-793488de828b_del
Nov 14 10:06:52 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-e34e1ae2-5c31-4a26-aad9-2f4eb39f616f tempest-TestShelveInstance-1161595377 tempest-TestShelveInstance-1161595377-project-member] [instance: abe7e145-d3bc-49a1-83be-793488de828b] Deletion of /opt/stack/data/nova/instances/abe7e145-d3bc-49a1-83be-793488de828b_del complete
Nov 14 10:06:52 user nova-compute[75229]: INFO nova.compute.manager [None req-e34e1ae2-5c31-4a26-aad9-2f4eb39f616f tempest-TestShelveInstance-1161595377 tempest-TestShelveInstance-1161595377-project-member] [instance: abe7e145-d3bc-49a1-83be-793488de828b] Took 1.15 seconds to destroy the instance on the hypervisor.
Nov 14 10:06:52 user nova-compute[75229]: DEBUG oslo.service.loopingcall [None req-e34e1ae2-5c31-4a26-aad9-2f4eb39f616f tempest-TestShelveInstance-1161595377 tempest-TestShelveInstance-1161595377-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75229) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 10:06:52 user nova-compute[75229]: DEBUG nova.compute.manager [-] [instance: abe7e145-d3bc-49a1-83be-793488de828b] Deallocating network for instance {{(pid=75229) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 10:06:52 user nova-compute[75229]: DEBUG nova.network.neutron [-] [instance: abe7e145-d3bc-49a1-83be-793488de828b] deallocate_for_instance() {{(pid=75229) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 10:06:53 user nova-compute[75229]: DEBUG nova.network.neutron [-] [instance: abe7e145-d3bc-49a1-83be-793488de828b] Updating instance_info_cache with network_info: [] {{(pid=75229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 10:06:53 user nova-compute[75229]: INFO nova.compute.manager [-] [instance: abe7e145-d3bc-49a1-83be-793488de828b] Took 0.75 seconds to deallocate network for instance.
Nov 14 10:06:53 user nova-compute[75229]: DEBUG nova.compute.manager [req-703ac98d-446a-4c25-a0f9-412a47793515 req-5824609b-f33f-4434-bbec-314843ce08f5 service nova] [instance: abe7e145-d3bc-49a1-83be-793488de828b] Received event network-vif-plugged-fe62c72a-f69b-4109-bfa3-e4a51fa43d0e {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 10:06:53 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-703ac98d-446a-4c25-a0f9-412a47793515 req-5824609b-f33f-4434-bbec-314843ce08f5 service nova] Acquiring lock "abe7e145-d3bc-49a1-83be-793488de828b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:06:53 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-703ac98d-446a-4c25-a0f9-412a47793515 req-5824609b-f33f-4434-bbec-314843ce08f5 service nova] Lock "abe7e145-d3bc-49a1-83be-793488de828b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:06:53 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-703ac98d-446a-4c25-a0f9-412a47793515 req-5824609b-f33f-4434-bbec-314843ce08f5 service nova] Lock "abe7e145-d3bc-49a1-83be-793488de828b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:06:53 user nova-compute[75229]: DEBUG nova.compute.manager [req-703ac98d-446a-4c25-a0f9-412a47793515 req-5824609b-f33f-4434-bbec-314843ce08f5 service nova] [instance: abe7e145-d3bc-49a1-83be-793488de828b] No waiting events found dispatching network-vif-plugged-fe62c72a-f69b-4109-bfa3-e4a51fa43d0e {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 10:06:53 user nova-compute[75229]: WARNING nova.compute.manager [req-703ac98d-446a-4c25-a0f9-412a47793515 req-5824609b-f33f-4434-bbec-314843ce08f5 service nova] [instance: abe7e145-d3bc-49a1-83be-793488de828b] Received unexpected event network-vif-plugged-fe62c72a-f69b-4109-bfa3-e4a51fa43d0e for instance with vm_state active and task_state deleting.
Nov 14 10:06:53 user nova-compute[75229]: DEBUG nova.compute.manager [req-703ac98d-446a-4c25-a0f9-412a47793515 req-5824609b-f33f-4434-bbec-314843ce08f5 service nova] [instance: abe7e145-d3bc-49a1-83be-793488de828b] Received event network-vif-deleted-fe62c72a-f69b-4109-bfa3-e4a51fa43d0e {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 10:06:53 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:06:54 user nova-compute[75229]: INFO nova.compute.manager [None req-e34e1ae2-5c31-4a26-aad9-2f4eb39f616f tempest-TestShelveInstance-1161595377 tempest-TestShelveInstance-1161595377-project-member] [instance: abe7e145-d3bc-49a1-83be-793488de828b] Took 0.75 seconds to detach 1 volumes for instance.
Nov 14 10:06:54 user nova-compute[75229]: DEBUG nova.compute.manager [None req-e34e1ae2-5c31-4a26-aad9-2f4eb39f616f tempest-TestShelveInstance-1161595377 tempest-TestShelveInstance-1161595377-project-member] [instance: abe7e145-d3bc-49a1-83be-793488de828b] Deleting volume: e4a6dca6-1581-494f-afe5-3aac2b4d2c15 {{(pid=75229) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 14 10:06:54 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-e34e1ae2-5c31-4a26-aad9-2f4eb39f616f tempest-TestShelveInstance-1161595377 tempest-TestShelveInstance-1161595377-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:06:54 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-e34e1ae2-5c31-4a26-aad9-2f4eb39f616f tempest-TestShelveInstance-1161595377 tempest-TestShelveInstance-1161595377-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:06:54 user nova-compute[75229]: DEBUG nova.compute.provider_tree [None req-e34e1ae2-5c31-4a26-aad9-2f4eb39f616f tempest-TestShelveInstance-1161595377 tempest-TestShelveInstance-1161595377-project-member] Inventory has not changed in ProviderTree for provider: d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 {{(pid=75229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 10:06:54 user nova-compute[75229]: DEBUG nova.scheduler.client.report [None req-e34e1ae2-5c31-4a26-aad9-2f4eb39f616f tempest-TestShelveInstance-1161595377 tempest-TestShelveInstance-1161595377-project-member] Inventory has not changed for provider d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 10:06:54 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-e34e1ae2-5c31-4a26-aad9-2f4eb39f616f tempest-TestShelveInstance-1161595377 tempest-TestShelveInstance-1161595377-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.311s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:06:54 user nova-compute[75229]: INFO nova.scheduler.client.report [None req-e34e1ae2-5c31-4a26-aad9-2f4eb39f616f tempest-TestShelveInstance-1161595377 tempest-TestShelveInstance-1161595377-project-member] Deleted allocations for instance abe7e145-d3bc-49a1-83be-793488de828b
Nov 14 10:06:54 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-e34e1ae2-5c31-4a26-aad9-2f4eb39f616f tempest-TestShelveInstance-1161595377 tempest-TestShelveInstance-1161595377-project-member] Lock "abe7e145-d3bc-49a1-83be-793488de828b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.265s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:06:55 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:06:57 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:06:58 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:07:00 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:07:00 user nova-compute[75229]: DEBUG nova.compute.manager [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Starting heal instance info cache {{(pid=75229) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 10:07:00 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Acquiring lock "refresh_cache-30ae1f73-e0f3-4e26-987e-a684471a160d" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 10:07:00 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Acquired lock "refresh_cache-30ae1f73-e0f3-4e26-987e-a684471a160d" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 10:07:00 user nova-compute[75229]: DEBUG nova.network.neutron [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] [instance: 30ae1f73-e0f3-4e26-987e-a684471a160d] Forcefully refreshing network info cache for instance {{(pid=75229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 10:07:01 user nova-compute[75229]: DEBUG nova.network.neutron [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] [instance: 30ae1f73-e0f3-4e26-987e-a684471a160d] Updating instance_info_cache with network_info: [{"id": "c087c657-8eee-4e8e-bef1-4281129597ae", "address": "fa:16:3e:aa:d3:e3", "network": {"id": "6a700b61-4aa6-440b-87e6-a3525a5cb918", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-448680331-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8babb73006da4977a1fe2bdb35e08d8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc087c657-8e", "ovs_interfaceid": "c087c657-8eee-4e8e-bef1-4281129597ae", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 10:07:01 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Releasing lock "refresh_cache-30ae1f73-e0f3-4e26-987e-a684471a160d" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 10:07:01 user nova-compute[75229]: DEBUG nova.compute.manager [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] [instance: 30ae1f73-e0f3-4e26-987e-a684471a160d] Updated the network info_cache for instance {{(pid=75229) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 10:07:02 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:07:04 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:07:06 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:07:07 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 10:07:07 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:07:07 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:07:07 user nova-compute[75229]: DEBUG nova.compute.manager [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75229) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 10:07:07 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:07:07 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:07:07 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:07:07 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:07:07 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Auditing locally available compute resources for user (node: user) {{(pid=75229) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 10:07:07 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cda8c5ad-e70c-4021-bace-d55831c4bc78/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:07:08 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cda8c5ad-e70c-4021-bace-d55831c4bc78/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:07:08 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cda8c5ad-e70c-4021-bace-d55831c4bc78/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:07:08 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cda8c5ad-e70c-4021-bace-d55831c4bc78/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:07:08 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/764de1b0-b77f-457a-8355-e5cdc1f6eab1/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:07:08 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/764de1b0-b77f-457a-8355-e5cdc1f6eab1/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:07:08 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/764de1b0-b77f-457a-8355-e5cdc1f6eab1/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:07:08 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/764de1b0-b77f-457a-8355-e5cdc1f6eab1/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:07:08 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1679275-ebb1-4f15-80a4-b8fd614fc34b/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:07:08 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1679275-ebb1-4f15-80a4-b8fd614fc34b/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:07:08 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1679275-ebb1-4f15-80a4-b8fd614fc34b/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:07:09 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1679275-ebb1-4f15-80a4-b8fd614fc34b/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:07:09 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=75229) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 10:07:09 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75229) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 10:07:09 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75229) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 10:07:09 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75229) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 10:07:09 user nova-compute[75229]: WARNING nova.virt.libvirt.driver [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 10:07:09 user nova-compute[75229]: WARNING nova.virt.libvirt.driver [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 10:07:09 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Hypervisor/Node resource view: name=user free_ram=8067MB free_disk=25.06499481201172GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75229) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 10:07:09 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:07:09 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:07:09 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Instance cda8c5ad-e70c-4021-bace-d55831c4bc78 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 10:07:09 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Instance 30ae1f73-e0f3-4e26-987e-a684471a160d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 10:07:09 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Instance c1679275-ebb1-4f15-80a4-b8fd614fc34b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 10:07:09 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Instance 3795dd8f-8a10-4939-8f2c-bacefe5f5aa1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 10:07:09 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Instance 10d6bce1-e55f-429c-816d-3bef9029560a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 10:07:09 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Instance 764de1b0-b77f-457a-8355-e5cdc1f6eab1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 10:07:09 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Instance 752995bf-8e0a-4832-94d8-280ab786b997 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 10:07:09 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=75229) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 10:07:09 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=75229) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 10:07:09 user nova-compute[75229]: DEBUG nova.compute.provider_tree [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Inventory has not changed in ProviderTree for provider: d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 {{(pid=75229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 10:07:09 user nova-compute[75229]: DEBUG nova.scheduler.client.report [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Inventory has not changed for provider d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 10:07:09 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Compute_service record updated for user:user {{(pid=75229) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 10:07:09 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.382s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:07:10 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:07:11 user nova-compute[75229]: INFO nova.compute.manager [None req-12974009-4d12-43c6-b355-bd432dc0197a tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] [instance: 10d6bce1-e55f-429c-816d-3bef9029560a] Rescuing
Nov 14 10:07:11 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-12974009-4d12-43c6-b355-bd432dc0197a tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Acquiring lock "refresh_cache-10d6bce1-e55f-429c-816d-3bef9029560a" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 10:07:11 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-12974009-4d12-43c6-b355-bd432dc0197a tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Acquired lock "refresh_cache-10d6bce1-e55f-429c-816d-3bef9029560a" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 10:07:11 user nova-compute[75229]: DEBUG nova.network.neutron [None req-12974009-4d12-43c6-b355-bd432dc0197a tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] [instance: 10d6bce1-e55f-429c-816d-3bef9029560a] Building network info cache for instance {{(pid=75229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 10:07:12 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 10:07:12 user nova-compute[75229]: DEBUG nova.network.neutron [None req-12974009-4d12-43c6-b355-bd432dc0197a tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] [instance: 10d6bce1-e55f-429c-816d-3bef9029560a] Updating instance_info_cache with network_info: [{"id": "ea04ea8d-43a6-4f64-9e0b-cc2927f214f5", "address": "fa:16:3e:e7:9f:f8", "network": {"id": "6a700b61-4aa6-440b-87e6-a3525a5cb918", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-448680331-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8babb73006da4977a1fe2bdb35e08d8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea04ea8d-43", "ovs_interfaceid": "ea04ea8d-43a6-4f64-9e0b-cc2927f214f5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 10:07:12 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-12974009-4d12-43c6-b355-bd432dc0197a tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Releasing lock "refresh_cache-10d6bce1-e55f-429c-816d-3bef9029560a" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 10:07:12 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:07:12 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:07:12 user nova-compute[75229]: DEBUG nova.compute.manager [req-7134eb51-5f97-4ec7-a699-a9a3090d28a2 req-0be3bb4e-62ec-454c-b858-f97a57416841 service nova] [instance: 10d6bce1-e55f-429c-816d-3bef9029560a] Received event network-vif-unplugged-ea04ea8d-43a6-4f64-9e0b-cc2927f214f5 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 10:07:12 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-7134eb51-5f97-4ec7-a699-a9a3090d28a2 req-0be3bb4e-62ec-454c-b858-f97a57416841 service nova] Acquiring lock "10d6bce1-e55f-429c-816d-3bef9029560a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:07:12 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-7134eb51-5f97-4ec7-a699-a9a3090d28a2 req-0be3bb4e-62ec-454c-b858-f97a57416841 service nova] Lock "10d6bce1-e55f-429c-816d-3bef9029560a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:07:12 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-7134eb51-5f97-4ec7-a699-a9a3090d28a2 req-0be3bb4e-62ec-454c-b858-f97a57416841 service nova] Lock "10d6bce1-e55f-429c-816d-3bef9029560a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:07:12 user nova-compute[75229]: DEBUG nova.compute.manager [req-7134eb51-5f97-4ec7-a699-a9a3090d28a2 req-0be3bb4e-62ec-454c-b858-f97a57416841 service nova] [instance: 10d6bce1-e55f-429c-816d-3bef9029560a] No waiting events found dispatching network-vif-unplugged-ea04ea8d-43a6-4f64-9e0b-cc2927f214f5 {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 10:07:12 user nova-compute[75229]: WARNING nova.compute.manager [req-7134eb51-5f97-4ec7-a699-a9a3090d28a2 req-0be3bb4e-62ec-454c-b858-f97a57416841 service nova] [instance: 10d6bce1-e55f-429c-816d-3bef9029560a] Received unexpected event network-vif-unplugged-ea04ea8d-43a6-4f64-9e0b-cc2927f214f5 for instance with vm_state active and task_state rescuing.
Nov 14 10:07:12 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:07:12 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:07:13 user nova-compute[75229]: INFO nova.virt.libvirt.driver [-] [instance: 10d6bce1-e55f-429c-816d-3bef9029560a] Instance destroyed successfully.
Nov 14 10:07:13 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-12974009-4d12-43c6-b355-bd432dc0197a tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] [instance: 10d6bce1-e55f-429c-816d-3bef9029560a] Attempting a stable device rescue
Nov 14 10:07:13 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-12974009-4d12-43c6-b355-bd432dc0197a tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75229) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 14 10:07:13 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-12974009-4d12-43c6-b355-bd432dc0197a tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] [instance: 10d6bce1-e55f-429c-816d-3bef9029560a] Instance directory exists: not creating {{(pid=75229) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 14 10:07:13 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-12974009-4d12-43c6-b355-bd432dc0197a tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] [instance: 10d6bce1-e55f-429c-816d-3bef9029560a] Creating image(s)
Nov 14 10:07:13 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-12974009-4d12-43c6-b355-bd432dc0197a tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Acquiring lock "/opt/stack/data/nova/instances/10d6bce1-e55f-429c-816d-3bef9029560a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:07:13 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-12974009-4d12-43c6-b355-bd432dc0197a tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Lock "/opt/stack/data/nova/instances/10d6bce1-e55f-429c-816d-3bef9029560a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:07:13 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-12974009-4d12-43c6-b355-bd432dc0197a tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Lock "/opt/stack/data/nova/instances/10d6bce1-e55f-429c-816d-3bef9029560a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:07:13 user nova-compute[75229]: DEBUG nova.objects.instance [None req-12974009-4d12-43c6-b355-bd432dc0197a tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Lazy-loading 'trusted_certs' on Instance uuid 10d6bce1-e55f-429c-816d-3bef9029560a {{(pid=75229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 10:07:13 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-12974009-4d12-43c6-b355-bd432dc0197a tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Acquiring lock "d94fe0cc9db796e88f461fae9d064442d41fccdf" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:07:13 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-12974009-4d12-43c6-b355-bd432dc0197a tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Lock "d94fe0cc9db796e88f461fae9d064442d41fccdf" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:07:14 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-12974009-4d12-43c6-b355-bd432dc0197a tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d94fe0cc9db796e88f461fae9d064442d41fccdf.part --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:07:14 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:07:14 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-12974009-4d12-43c6-b355-bd432dc0197a tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d94fe0cc9db796e88f461fae9d064442d41fccdf.part --force-share --output=json" returned: 0 in 0.180s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:07:14 user nova-compute[75229]: DEBUG nova.virt.images [None req-12974009-4d12-43c6-b355-bd432dc0197a tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] 5056ee46-89ca-44fa-ac39-2196c18e713e was qcow2, converting to raw {{(pid=75229) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 14 10:07:14 user nova-compute[75229]: DEBUG nova.privsep.utils [None req-12974009-4d12-43c6-b355-bd432dc0197a tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75229) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 14 10:07:14 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-12974009-4d12-43c6-b355-bd432dc0197a tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/d94fe0cc9db796e88f461fae9d064442d41fccdf.part /opt/stack/data/nova/instances/_base/d94fe0cc9db796e88f461fae9d064442d41fccdf.converted {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:07:14 user nova-compute[75229]: DEBUG nova.compute.manager [req-4be3addc-0aae-42b2-ad81-3cdf6c2b5aac req-7fb7bb6e-9144-45bf-ab29-5b568044994e service nova] [instance: 10d6bce1-e55f-429c-816d-3bef9029560a] Received event network-vif-plugged-ea04ea8d-43a6-4f64-9e0b-cc2927f214f5 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 10:07:14 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-4be3addc-0aae-42b2-ad81-3cdf6c2b5aac req-7fb7bb6e-9144-45bf-ab29-5b568044994e service nova] Acquiring lock "10d6bce1-e55f-429c-816d-3bef9029560a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:07:14 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-4be3addc-0aae-42b2-ad81-3cdf6c2b5aac req-7fb7bb6e-9144-45bf-ab29-5b568044994e service nova] Lock "10d6bce1-e55f-429c-816d-3bef9029560a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:07:14 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-4be3addc-0aae-42b2-ad81-3cdf6c2b5aac req-7fb7bb6e-9144-45bf-ab29-5b568044994e service nova] Lock "10d6bce1-e55f-429c-816d-3bef9029560a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:07:14 user nova-compute[75229]: DEBUG nova.compute.manager [req-4be3addc-0aae-42b2-ad81-3cdf6c2b5aac req-7fb7bb6e-9144-45bf-ab29-5b568044994e service nova] [instance: 10d6bce1-e55f-429c-816d-3bef9029560a] No waiting events found dispatching network-vif-plugged-ea04ea8d-43a6-4f64-9e0b-cc2927f214f5 {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 10:07:14 user nova-compute[75229]: WARNING nova.compute.manager [req-4be3addc-0aae-42b2-ad81-3cdf6c2b5aac req-7fb7bb6e-9144-45bf-ab29-5b568044994e service nova] [instance: 10d6bce1-e55f-429c-816d-3bef9029560a] Received unexpected event network-vif-plugged-ea04ea8d-43a6-4f64-9e0b-cc2927f214f5 for instance with vm_state active and task_state rescuing.
Nov 14 10:07:14 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-12974009-4d12-43c6-b355-bd432dc0197a tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/d94fe0cc9db796e88f461fae9d064442d41fccdf.part /opt/stack/data/nova/instances/_base/d94fe0cc9db796e88f461fae9d064442d41fccdf.converted" returned: 0 in 0.427s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:07:14 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-12974009-4d12-43c6-b355-bd432dc0197a tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d94fe0cc9db796e88f461fae9d064442d41fccdf.converted --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:07:14 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-12974009-4d12-43c6-b355-bd432dc0197a tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d94fe0cc9db796e88f461fae9d064442d41fccdf.converted --force-share --output=json" returned: 0 in 0.206s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:07:14 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-12974009-4d12-43c6-b355-bd432dc0197a tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Lock "d94fe0cc9db796e88f461fae9d064442d41fccdf" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.786s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:07:14 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-12974009-4d12-43c6-b355-bd432dc0197a tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Acquiring lock "d94fe0cc9db796e88f461fae9d064442d41fccdf" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:07:14 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-12974009-4d12-43c6-b355-bd432dc0197a tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Lock "d94fe0cc9db796e88f461fae9d064442d41fccdf" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:07:14 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-12974009-4d12-43c6-b355-bd432dc0197a tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d94fe0cc9db796e88f461fae9d064442d41fccdf --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:07:15 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-12974009-4d12-43c6-b355-bd432dc0197a tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d94fe0cc9db796e88f461fae9d064442d41fccdf --force-share --output=json" returned: 0 in 0.172s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:07:15 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-12974009-4d12-43c6-b355-bd432dc0197a tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d94fe0cc9db796e88f461fae9d064442d41fccdf,backing_fmt=raw /opt/stack/data/nova/instances/10d6bce1-e55f-429c-816d-3bef9029560a/disk.rescue {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:07:15 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-12974009-4d12-43c6-b355-bd432dc0197a tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d94fe0cc9db796e88f461fae9d064442d41fccdf,backing_fmt=raw /opt/stack/data/nova/instances/10d6bce1-e55f-429c-816d-3bef9029560a/disk.rescue" returned: 0 in 0.305s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:07:15 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-12974009-4d12-43c6-b355-bd432dc0197a tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Lock "d94fe0cc9db796e88f461fae9d064442d41fccdf" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.483s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:07:15 user nova-compute[75229]: DEBUG nova.objects.instance [None req-12974009-4d12-43c6-b355-bd432dc0197a tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Lazy-loading 'migration_context' on Instance uuid 10d6bce1-e55f-429c-816d-3bef9029560a {{(pid=75229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 10:07:15 user nova-compute[75229]: DEBUG nova.objects.base [None req-12974009-4d12-43c6-b355-bd432dc0197a tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Object Instance<10d6bce1-e55f-429c-816d-3bef9029560a> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75229) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 10:07:15 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-12974009-4d12-43c6-b355-bd432dc0197a tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] [instance: 10d6bce1-e55f-429c-816d-3bef9029560a] Created local disks {{(pid=75229) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 10:07:15 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-12974009-4d12-43c6-b355-bd432dc0197a tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] [instance: 10d6bce1-e55f-429c-816d-3bef9029560a] Start _get_guest_xml network_info=[{"id": "ea04ea8d-43a6-4f64-9e0b-cc2927f214f5", "address": "fa:16:3e:e7:9f:f8", "network": {"id": "6a700b61-4aa6-440b-87e6-a3525a5cb918", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-448680331-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-448680331-network", "vif_mac": "fa:16:3e:e7:9f:f8"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8babb73006da4977a1fe2bdb35e08d8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea04ea8d-43", "ovs_interfaceid": "ea04ea8d-43a6-4f64-9e0b-cc2927f214f5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T09:40:10Z,direct_url=<?>,disk_format='qcow2',id=3bef8470-ecc7-40e3-95d4-9254348ea72d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='de5a91106b6948ed937a7178ff9464c4',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T09:40:12Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '5056ee46-89ca-44fa-ac39-2196c18e713e', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:7aee6091-dab3-4c39-88a1-4bbb28dcab45', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LXKkTDrO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, 'status': 'reserved', 'instance': '10d6bce1-e55f-429c-816d-3bef9029560a', 'attached_at': '', 'detached_at': '', 'volume_id': '7aee6091-dab3-4c39-88a1-4bbb28dcab45', 'serial': '7aee6091-dab3-4c39-88a1-4bbb28dcab45'}, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'attachment_id': 'f2d4d89c-94d4-48df-af88-25f6e6896ef0', 'guest_format': None, 'device_type': 'disk', 'volume_type': None} {{(pid=75229) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 10:07:15 user nova-compute[75229]: DEBUG nova.objects.instance [None req-12974009-4d12-43c6-b355-bd432dc0197a tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Lazy-loading 'resources' on Instance uuid 10d6bce1-e55f-429c-816d-3bef9029560a {{(pid=75229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 10:07:15 user nova-compute[75229]: DEBUG nova.objects.base [None req-12974009-4d12-43c6-b355-bd432dc0197a tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Object Instance<10d6bce1-e55f-429c-816d-3bef9029560a> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75229) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 10:07:15 user nova-compute[75229]: DEBUG nova.objects.instance [None req-12974009-4d12-43c6-b355-bd432dc0197a tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Lazy-loading 'numa_topology' on Instance uuid 10d6bce1-e55f-429c-816d-3bef9029560a {{(pid=75229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 10:07:15 user nova-compute[75229]: DEBUG nova.objects.base [None req-12974009-4d12-43c6-b355-bd432dc0197a tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Object Instance<10d6bce1-e55f-429c-816d-3bef9029560a> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75229) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 10:07:15 user nova-compute[75229]: WARNING nova.virt.libvirt.driver [None req-12974009-4d12-43c6-b355-bd432dc0197a tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 10:07:15 user nova-compute[75229]: WARNING nova.virt.libvirt.driver [None req-12974009-4d12-43c6-b355-bd432dc0197a tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 10:07:15 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-12974009-4d12-43c6-b355-bd432dc0197a tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75229) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 10:07:15 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-12974009-4d12-43c6-b355-bd432dc0197a tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] CPU controller missing on host. {{(pid=75229) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 10:07:15 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-12974009-4d12-43c6-b355-bd432dc0197a tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75229) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 10:07:15 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-12974009-4d12-43c6-b355-bd432dc0197a tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] CPU controller found on host. {{(pid=75229) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 10:07:15 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-12974009-4d12-43c6-b355-bd432dc0197a tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75229) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 10:07:15 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-12974009-4d12-43c6-b355-bd432dc0197a tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T09:39:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T09:40:10Z,direct_url=<?>,disk_format='qcow2',id=3bef8470-ecc7-40e3-95d4-9254348ea72d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='de5a91106b6948ed937a7178ff9464c4',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T09:40:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 10:07:15 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-12974009-4d12-43c6-b355-bd432dc0197a tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Flavor limits 0:0:0 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 10:07:15 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-12974009-4d12-43c6-b355-bd432dc0197a tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Image limits 0:0:0 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 10:07:15 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-12974009-4d12-43c6-b355-bd432dc0197a tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Flavor pref 0:0:0 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 10:07:15 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-12974009-4d12-43c6-b355-bd432dc0197a tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Image pref 0:0:0 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 10:07:15 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-12974009-4d12-43c6-b355-bd432dc0197a tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 10:07:15 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-12974009-4d12-43c6-b355-bd432dc0197a tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 10:07:15 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-12974009-4d12-43c6-b355-bd432dc0197a tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75229) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 10:07:15 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-12974009-4d12-43c6-b355-bd432dc0197a tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Got 1 possible topologies {{(pid=75229) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 10:07:15 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-12974009-4d12-43c6-b355-bd432dc0197a tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 10:07:15 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-12974009-4d12-43c6-b355-bd432dc0197a tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 10:07:15 user nova-compute[75229]: DEBUG nova.objects.instance [None req-12974009-4d12-43c6-b355-bd432dc0197a tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Lazy-loading 'vcpu_model' on Instance uuid 10d6bce1-e55f-429c-816d-3bef9029560a {{(pid=75229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 10:07:15 user nova-compute[75229]: DEBUG nova.objects.base [None req-12974009-4d12-43c6-b355-bd432dc0197a tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Object Instance<10d6bce1-e55f-429c-816d-3bef9029560a> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75229) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 10:07:15 user nova-compute[75229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-12974009-4d12-43c6-b355-bd432dc0197a tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] [instance: 10d6bce1-e55f-429c-816d-3bef9029560a] Calling os-brick to attach iSCSI Volume {{(pid=75229) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 10:07:15 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-12974009-4d12-43c6-b355-bd432dc0197a tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f73f85151b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7aee6091-dab3-4c39-88a1-4bbb28dcab45', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LXKkTDrO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 10:07:15 user nova-compute[75229]: WARNING os_brick.initiator.connectors.base [None req-12974009-4d12-43c6-b355-bd432dc0197a tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 10:07:15 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-12974009-4d12-43c6-b355-bd432dc0197a tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 10:07:15 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-12974009-4d12-43c6-b355-bd432dc0197a tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 10:07:15 user nova-compute[75229]: WARNING os_brick.initiator.connectors.base [None req-12974009-4d12-43c6-b355-bd432dc0197a tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 10:07:15 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-12974009-4d12-43c6-b355-bd432dc0197a tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7aee6091-dab3-4c39-88a1-4bbb28dcab45" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 10:07:15 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-12974009-4d12-43c6-b355-bd432dc0197a tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7aee6091-dab3-4c39-88a1-4bbb28dcab45" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 10:07:15 user nova-compute[75229]: INFO os_brick.initiator.connectors.iscsi [None req-12974009-4d12-43c6-b355-bd432dc0197a tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 10:07:15 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7aee6091-dab3-4c39-88a1-4bbb28dcab45 -p 172.16.0.220:3260 {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:07:15 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7aee6091-dab3-4c39-88a1-4bbb28dcab45 -p 172.16.0.220:3260" returned: 0 in 0.018s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:07:15 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d5c6b0b-f819-4754-b591-98a3c53b7b3b]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:7aee6091-dab3-4c39-88a1-4bbb28dcab45\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = LXKkTDrO\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:07:15 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-12974009-4d12-43c6-b355-bd432dc0197a tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 14 10:07:15 user nova-compute[75229]: node.name = iqn.2010-10.org.openstack:7aee6091-dab3-4c39-88a1-4bbb28dcab45
Nov 14 10:07:15 user nova-compute[75229]: node.tpgt = -1
Nov 14 10:07:15 user nova-compute[75229]: node.startup = automatic
Nov 14 10:07:15 user nova-compute[75229]: node.leading_login = No
Nov 14 10:07:15 user nova-compute[75229]: iface.iscsi_ifacename = default
Nov 14 10:07:15 user nova-compute[75229]: iface.net_ifacename = <empty>
Nov 14 10:07:15 user nova-compute[75229]: iface.ipaddress = <empty>
Nov 14 10:07:15 user nova-compute[75229]: iface.prefix_len = 0
Nov 14 10:07:15 user nova-compute[75229]: iface.hwaddress = <empty>
Nov 14 10:07:15 user nova-compute[75229]: iface.transport_name = tcp
Nov 14 10:07:15 user nova-compute[75229]: iface.initiatorname = <empty>
Nov 14 10:07:15 user nova-compute[75229]: iface.state = <empty>
Nov 14 10:07:15 user nova-compute[75229]: iface.vlan_id = 0
Nov 14 10:07:15 user nova-compute[75229]: iface.vlan_priority = 0
Nov 14 10:07:15 user nova-compute[75229]: iface.vlan_state = <empty>
Nov 14 10:07:15 user nova-compute[75229]: iface.iface_num = 0
Nov 14 10:07:15 user nova-compute[75229]: iface.mtu = 0
Nov 14 10:07:15 user nova-compute[75229]: iface.port = 0
Nov 14 10:07:15 user nova-compute[75229]: iface.bootproto = <empty>
Nov 14 10:07:15 user nova-compute[75229]: iface.subnet_mask = <empty>
Nov 14 10:07:15 user nova-compute[75229]: iface.gateway = <empty>
Nov 14 10:07:15 user nova-compute[75229]: iface.dhcp_alt_client_id_state = <empty>
Nov 14 10:07:15 user nova-compute[75229]: iface.dhcp_alt_client_id = <empty>
Nov 14 10:07:15 user nova-compute[75229]: iface.dhcp_dns = <empty>
Nov 14 10:07:15 user nova-compute[75229]: iface.dhcp_learn_iqn = <empty>
Nov 14 10:07:15 user nova-compute[75229]: iface.dhcp_req_vendor_id_state = <empty>
Nov 14 10:07:15 user nova-compute[75229]: iface.dhcp_vendor_id_state = <empty>
Nov 14 10:07:15 user nova-compute[75229]: iface.dhcp_vendor_id = <empty>
Nov 14 10:07:15 user nova-compute[75229]: iface.dhcp_slp_da = <empty>
Nov 14 10:07:15 user nova-compute[75229]: iface.fragmentation = <empty>
Nov 14 10:07:15 user nova-compute[75229]: iface.gratuitous_arp = <empty>
Nov 14 10:07:15 user nova-compute[75229]: iface.incoming_forwarding = <empty>
Nov 14 10:07:15 user nova-compute[75229]: iface.tos_state = <empty>
Nov 14 10:07:15 user nova-compute[75229]: iface.tos = 0
Nov 14 10:07:15 user nova-compute[75229]: iface.ttl = 0
Nov 14 10:07:15 user nova-compute[75229]: iface.delayed_ack = <empty>
Nov 14 10:07:15 user nova-compute[75229]: iface.tcp_nagle = <empty>
Nov 14 10:07:15 user nova-compute[75229]: iface.tcp_wsf_state = <empty>
Nov 14 10:07:15 user nova-compute[75229]: iface.tcp_wsf = 0
Nov 14 10:07:15 user nova-compute[75229]: iface.tcp_timer_scale = 0
Nov 14 10:07:15 user nova-compute[75229]: iface.tcp_timestamp = <empty>
Nov 14 10:07:15 user nova-compute[75229]: iface.redirect = <empty>
Nov 14 10:07:15 user nova-compute[75229]: iface.def_task_mgmt_timeout = 0
Nov 14 10:07:15 user nova-compute[75229]: iface.header_digest = <empty>
Nov 14 10:07:15 user nova-compute[75229]: iface.data_digest = <empty>
Nov 14 10:07:15 user nova-compute[75229]: iface.immediate_data = <empty>
Nov 14 10:07:15 user nova-compute[75229]: iface.initial_r2t = <empty>
Nov 14 10:07:15 user nova-compute[75229]: iface.data_seq_inorder = <empty>
Nov 14 10:07:15 user nova-compute[75229]: iface.data_pdu_inorder = <empty>
Nov 14 10:07:15 user nova-compute[75229]: iface.erl = 0
Nov 14 10:07:15 user nova-compute[75229]: iface.max_receive_data_len = 0
Nov 14 10:07:15 user nova-compute[75229]: iface.first_burst_len = 0
Nov 14 10:07:15 user nova-compute[75229]: iface.max_outstanding_r2t = 0
Nov 14 10:07:15 user nova-compute[75229]: iface.max_burst_len = 0
Nov 14 10:07:15 user nova-compute[75229]: iface.chap_auth = <empty>
Nov 14 10:07:15 user nova-compute[75229]: iface.bidi_chap = <empty>
Nov 14 10:07:15 user nova-compute[75229]: iface.strict_login_compliance = <empty>
Nov 14 10:07:15 user nova-compute[75229]: iface.discovery_auth = <empty>
Nov 14 10:07:15 user nova-compute[75229]: iface.discovery_logout = <empty>
Nov 14 10:07:15 user nova-compute[75229]: node.discovery_address = <empty>
Nov 14 10:07:15 user nova-compute[75229]: node.discovery_port = 0
Nov 14 10:07:15 user nova-compute[75229]: node.discovery_type = static
Nov 14 10:07:15 user nova-compute[75229]: node.session.initial_cmdsn = 0
Nov 14 10:07:15 user nova-compute[75229]: node.session.initial_login_retry_max = 8
Nov 14 10:07:15 user nova-compute[75229]: node.session.xmit_thread_priority = -20
Nov 14 10:07:15 user nova-compute[75229]: node.session.cmds_max = 128
Nov 14 10:07:15 user nova-compute[75229]: node.session.queue_depth = 32
Nov 14 10:07:15 user nova-compute[75229]: node.session.nr_sessions = 1
Nov 14 10:07:15 user nova-compute[75229]: node.session.auth.authmethod = CHAP
Nov 14 10:07:15 user nova-compute[75229]: node.session.auth.username = LXKkTDrO
Nov 14 10:07:15 user nova-compute[75229]: node.session.auth.password = ***
Nov 14 10:07:15 user nova-compute[75229]: node.session.auth.username_in = <empty>
Nov 14 10:07:15 user nova-compute[75229]: node.session.auth.password_in = <empty>
Nov 14 10:07:15 user nova-compute[75229]: node.session.auth.chap_algs = MD5
Nov 14 10:07:15 user nova-compute[75229]: node.session.timeo.replacement_timeout = 120
Nov 14 10:07:15 user nova-compute[75229]: node.session.err_timeo.abort_timeout = 15
Nov 14 10:07:15 user nova-compute[75229]: node.session.err_timeo.lu_reset_timeout = 30
Nov 14 10:07:15 user nova-compute[75229]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 14 10:07:15 user nova-compute[75229]: node.session.err_timeo.host_reset_timeout = 60
Nov 14 10:07:15 user nova-compute[75229]: node.session.iscsi.FastAbort = Yes
Nov 14 10:07:15 user nova-compute[75229]: node.session.iscsi.InitialR2T = No
Nov 14 10:07:15 user nova-compute[75229]: node.session.iscsi.ImmediateData = Yes
Nov 14 10:07:15 user nova-compute[75229]: node.session.iscsi.FirstBurstLength = 262144
Nov 14 10:07:15 user nova-compute[75229]: node.session.iscsi.MaxBurstLength = 16776192
Nov 14 10:07:15 user nova-compute[75229]: node.session.iscsi.DefaultTime2Retain = 0
Nov 14 10:07:15 user nova-compute[75229]: node.session.iscsi.DefaultTime2Wait = 2
Nov 14 10:07:15 user nova-compute[75229]: node.session.iscsi.MaxConnections = 1
Nov 14 10:07:15 user nova-compute[75229]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 14 10:07:15 user nova-compute[75229]: node.session.iscsi.ERL = 0
Nov 14 10:07:15 user nova-compute[75229]: node.session.scan = manual
Nov 14 10:07:15 user nova-compute[75229]: node.session.reopen_max = 0
Nov 14 10:07:15 user nova-compute[75229]: node.conn[0].address = 172.16.0.220
Nov 14 10:07:15 user nova-compute[75229]: node.conn[0].port = 3260
Nov 14 10:07:15 user nova-compute[75229]: node.conn[0].startup = manual
Nov 14 10:07:15 user nova-compute[75229]: node.conn[0].tcp.window_size = 524288
Nov 14 10:07:15 user nova-compute[75229]: node.conn[0].tcp.type_of_service = 0
Nov 14 10:07:15 user nova-compute[75229]: node.conn[0].timeo.logout_timeout = 15
Nov 14 10:07:15 user nova-compute[75229]: node.conn[0].timeo.login_timeout = 15
Nov 14 10:07:15 user nova-compute[75229]: node.conn[0].timeo.auth_timeout = 45
Nov 14 10:07:15 user nova-compute[75229]: node.conn[0].timeo.noop_out_interval = 5
Nov 14 10:07:15 user nova-compute[75229]: node.conn[0].timeo.noop_out_timeout = 5
Nov 14 10:07:15 user nova-compute[75229]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 14 10:07:15 user nova-compute[75229]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 14 10:07:15 user nova-compute[75229]: node.conn[0].iscsi.HeaderDigest = None
Nov 14 10:07:15 user nova-compute[75229]: node.conn[0].iscsi.DataDigest = None
Nov 14 10:07:15 user nova-compute[75229]: node.conn[0].iscsi.IFMarker = No
Nov 14 10:07:15 user nova-compute[75229]: node.conn[0].iscsi.OFMarker = No
Nov 14 10:07:15 user nova-compute[75229]: # END RECORD
Nov 14 10:07:15 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 10:07:15 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7aee6091-dab3-4c39-88a1-4bbb28dcab45 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:07:15 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7aee6091-dab3-4c39-88a1-4bbb28dcab45 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:07:15 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[696c2bec-8a20-4290-9f19-40d115e9886e]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:07:15 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-12974009-4d12-43c6-b355-bd432dc0197a tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 10:07:15 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7aee6091-dab3-4c39-88a1-4bbb28dcab45 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:07:15 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7aee6091-dab3-4c39-88a1-4bbb28dcab45 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:07:15 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e8d6b4f-d77e-44ad-84e7-dae3c8d7d00f]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:07:15 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-12974009-4d12-43c6-b355-bd432dc0197a tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 10:07:15 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7aee6091-dab3-4c39-88a1-4bbb28dcab45 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LXKkTDrO {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:07:15 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7aee6091-dab3-4c39-88a1-4bbb28dcab45 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LXKkTDrO" returned: 0 in 0.020s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:07:15 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[10ee3a2b-ea49-4b89-92b5-32359411e123]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:07:15 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-12974009-4d12-43c6-b355-bd432dc0197a tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LXKkTDrO'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 10:07:15 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7aee6091-dab3-4c39-88a1-4bbb28dcab45 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:07:15 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7aee6091-dab3-4c39-88a1-4bbb28dcab45 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:07:15 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[344c59d5-f823-409b-a42b-face533a964d]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:07:15 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-12974009-4d12-43c6-b355-bd432dc0197a tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 10:07:15 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:07:15 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:07:15 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bf5daa7-f9ad-427d-9fa0-d5f263535ba8]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aebc438-0289-44fe-ad84-4e696468f50e (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7aee6091-dab3-4c39-88a1-4bbb28dcab45 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ddb200b-47ca-4449-9973-be76424a6761 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8892c7d-49e8-4f65-b88c-1e14fba8f50a (non-flash)\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:07:15 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-12974009-4d12-43c6-b355-bd432dc0197a tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aebc438-0289-44fe-ad84-4e696468f50e (non-flash)
Nov 14 10:07:15 user nova-compute[75229]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7aee6091-dab3-4c39-88a1-4bbb28dcab45 (non-flash)
Nov 14 10:07:15 user nova-compute[75229]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ddb200b-47ca-4449-9973-be76424a6761 (non-flash)
Nov 14 10:07:15 user nova-compute[75229]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8892c7d-49e8-4f65-b88c-1e14fba8f50a (non-flash)
Nov 14 10:07:15 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 10:07:15 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-12974009-4d12-43c6-b355-bd432dc0197a tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aebc438-0289-44fe-ad84-4e696468f50e (non-flash)
Nov 14 10:07:15 user nova-compute[75229]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7aee6091-dab3-4c39-88a1-4bbb28dcab45 (non-flash)
Nov 14 10:07:15 user nova-compute[75229]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ddb200b-47ca-4449-9973-be76424a6761 (non-flash)
Nov 14 10:07:15 user nova-compute[75229]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8892c7d-49e8-4f65-b88c-1e14fba8f50a (non-flash)
Nov 14 10:07:15 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 10:07:15 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-12974009-4d12-43c6-b355-bd432dc0197a tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7aee6091-dab3-4c39-88a1-4bbb28dcab45" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.146s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 10:07:15 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-12974009-4d12-43c6-b355-bd432dc0197a tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Connected to 172.16.0.220:3260 {{(pid=75229) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 10:07:15 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-12974009-4d12-43c6-b355-bd432dc0197a tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] HCTL ('35', '0', '0', 0) found on session 46 with lun 0 {{(pid=75229) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 10:07:15 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-12974009-4d12-43c6-b355-bd432dc0197a tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Scanning host 35 c: 0, t: 0, l: 0) {{(pid=75229) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 10:07:15 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:07:15 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.013s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:07:15 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6c809b6-7e18-435d-a627-2f331a4b84ec]: (4, ('0 0 0', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:07:15 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-12974009-4d12-43c6-b355-bd432dc0197a tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Searching for a device in session 46 and hctl ('35', '0', '0', 0) yield: sdd {{(pid=75229) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 10:07:15 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-12974009-4d12-43c6-b355-bd432dc0197a tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:7aee6091-dab3-4c39-88a1-4bbb28dcab45', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LXKkTDrO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75229) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 10:07:15 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-12974009-4d12-43c6-b355-bd432dc0197a tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.169s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 10:07:15 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-12974009-4d12-43c6-b355-bd432dc0197a tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] <== connect_volume: return (171ms) {'type': 'block', 'scsi_wwn': '23636626663376464', 'path': '/dev/sdd'} {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 10:07:15 user nova-compute[75229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-12974009-4d12-43c6-b355-bd432dc0197a tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] [instance: 10d6bce1-e55f-429c-816d-3bef9029560a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23636626663376464', 'path': '/dev/sdd'} {{(pid=75229) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 10:07:15 user nova-compute[75229]: DEBUG nova.virt.libvirt.vif [None req-12974009-4d12-43c6-b355-bd432dc0197a tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T10:05:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1327308485',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1327308485',id=45,image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-14T10:05:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8babb73006da4977a1fe2bdb35e08d8f',ramdisk_id='',reservation_id='r-mj2negw8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-189750210',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T10:05:36Z,user_data=None,user_id='a8825cd49e9349f28576b704c4c4d717',uuid=10d6bce1-e55f-429c-816d-3bef9029560a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ea04ea8d-43a6-4f64-9e0b-cc2927f214f5", "address": "fa:16:3e:e7:9f:f8", "network": {"id": "6a700b61-4aa6-440b-87e6-a3525a5cb918", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-448680331-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-448680331-network", "vif_mac": "fa:16:3e:e7:9f:f8"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8babb73006da4977a1fe2bdb35e08d8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea04ea8d-43", "ovs_interfaceid": "ea04ea8d-43a6-4f64-9e0b-cc2927f214f5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75229) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 10:07:15 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-12974009-4d12-43c6-b355-bd432dc0197a tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Converting VIF {"id": "ea04ea8d-43a6-4f64-9e0b-cc2927f214f5", "address": "fa:16:3e:e7:9f:f8", "network": {"id": "6a700b61-4aa6-440b-87e6-a3525a5cb918", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-448680331-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-448680331-network", "vif_mac": "fa:16:3e:e7:9f:f8"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8babb73006da4977a1fe2bdb35e08d8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea04ea8d-43", "ovs_interfaceid": "ea04ea8d-43a6-4f64-9e0b-cc2927f214f5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 10:07:15 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-12974009-4d12-43c6-b355-bd432dc0197a tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e7:9f:f8,bridge_name='br-int',has_traffic_filtering=True,id=ea04ea8d-43a6-4f64-9e0b-cc2927f214f5,network=Network(6a700b61-4aa6-440b-87e6-a3525a5cb918),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea04ea8d-43') {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 10:07:15 user nova-compute[75229]: DEBUG nova.objects.instance [None req-12974009-4d12-43c6-b355-bd432dc0197a tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Lazy-loading 'pci_devices' on Instance uuid 10d6bce1-e55f-429c-816d-3bef9029560a {{(pid=75229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 10:07:15 user nova-compute[75229]: DEBUG nova.objects.base [None req-12974009-4d12-43c6-b355-bd432dc0197a tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Object Instance<10d6bce1-e55f-429c-816d-3bef9029560a> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75229) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 10:07:15 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-12974009-4d12-43c6-b355-bd432dc0197a tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] [instance: 10d6bce1-e55f-429c-816d-3bef9029560a] End _get_guest_xml xml=<domain type="kvm">
Nov 14 10:07:15 user nova-compute[75229]:   <uuid>10d6bce1-e55f-429c-816d-3bef9029560a</uuid>
Nov 14 10:07:15 user nova-compute[75229]:   <name>instance-0000002d</name>
Nov 14 10:07:15 user nova-compute[75229]:   <memory>524288</memory>
Nov 14 10:07:15 user nova-compute[75229]:   <vcpu>1</vcpu>
Nov 14 10:07:15 user nova-compute[75229]:   <metadata>
Nov 14 10:07:15 user nova-compute[75229]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 10:07:15 user nova-compute[75229]:       <nova:package version="0.0.0"/>
Nov 14 10:07:15 user nova-compute[75229]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1327308485</nova:name>
Nov 14 10:07:15 user nova-compute[75229]:       <nova:creationTime>2023-11-14 10:07:15</nova:creationTime>
Nov 14 10:07:15 user nova-compute[75229]:       <nova:flavor name="m1.tiny">
Nov 14 10:07:15 user nova-compute[75229]:         <nova:memory>512</nova:memory>
Nov 14 10:07:15 user nova-compute[75229]:         <nova:disk>1</nova:disk>
Nov 14 10:07:15 user nova-compute[75229]:         <nova:swap>0</nova:swap>
Nov 14 10:07:15 user nova-compute[75229]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 10:07:15 user nova-compute[75229]:         <nova:vcpus>1</nova:vcpus>
Nov 14 10:07:15 user nova-compute[75229]:       </nova:flavor>
Nov 14 10:07:15 user nova-compute[75229]:       <nova:owner>
Nov 14 10:07:15 user nova-compute[75229]:         <nova:user uuid="a8825cd49e9349f28576b704c4c4d717">tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member</nova:user>
Nov 14 10:07:15 user nova-compute[75229]:         <nova:project uuid="8babb73006da4977a1fe2bdb35e08d8f">tempest-ServerBootFromVolumeStableRescueTest-189750210</nova:project>
Nov 14 10:07:15 user nova-compute[75229]:       </nova:owner>
Nov 14 10:07:15 user nova-compute[75229]:       <nova:root type="image" uuid="3bef8470-ecc7-40e3-95d4-9254348ea72d"/>
Nov 14 10:07:15 user nova-compute[75229]:       <nova:ports>
Nov 14 10:07:15 user nova-compute[75229]:         <nova:port uuid="ea04ea8d-43a6-4f64-9e0b-cc2927f214f5">
Nov 14 10:07:15 user nova-compute[75229]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 14 10:07:15 user nova-compute[75229]:         </nova:port>
Nov 14 10:07:15 user nova-compute[75229]:       </nova:ports>
Nov 14 10:07:15 user nova-compute[75229]:     </nova:instance>
Nov 14 10:07:15 user nova-compute[75229]:   </metadata>
Nov 14 10:07:15 user nova-compute[75229]:   <sysinfo type="smbios">
Nov 14 10:07:15 user nova-compute[75229]:     <system>
Nov 14 10:07:15 user nova-compute[75229]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 10:07:15 user nova-compute[75229]:       <entry name="product">OpenStack Nova</entry>
Nov 14 10:07:15 user nova-compute[75229]:       <entry name="version">0.0.0</entry>
Nov 14 10:07:15 user nova-compute[75229]:       <entry name="serial">10d6bce1-e55f-429c-816d-3bef9029560a</entry>
Nov 14 10:07:15 user nova-compute[75229]:       <entry name="uuid">10d6bce1-e55f-429c-816d-3bef9029560a</entry>
Nov 14 10:07:15 user nova-compute[75229]:       <entry name="family">Virtual Machine</entry>
Nov 14 10:07:15 user nova-compute[75229]:     </system>
Nov 14 10:07:15 user nova-compute[75229]:   </sysinfo>
Nov 14 10:07:15 user nova-compute[75229]:   <os>
Nov 14 10:07:15 user nova-compute[75229]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 10:07:15 user nova-compute[75229]:     <smbios mode="sysinfo"/>
Nov 14 10:07:15 user nova-compute[75229]:   </os>
Nov 14 10:07:15 user nova-compute[75229]:   <features>
Nov 14 10:07:15 user nova-compute[75229]:     <acpi/>
Nov 14 10:07:15 user nova-compute[75229]:     <apic/>
Nov 14 10:07:15 user nova-compute[75229]:     <vmcoreinfo/>
Nov 14 10:07:15 user nova-compute[75229]:   </features>
Nov 14 10:07:15 user nova-compute[75229]:   <clock offset="utc">
Nov 14 10:07:15 user nova-compute[75229]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 10:07:15 user nova-compute[75229]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 10:07:15 user nova-compute[75229]:     <timer name="hpet" present="no"/>
Nov 14 10:07:15 user nova-compute[75229]:   </clock>
Nov 14 10:07:15 user nova-compute[75229]:   <cpu mode="custom" match="exact">
Nov 14 10:07:15 user nova-compute[75229]:     <model>Nehalem</model>
Nov 14 10:07:15 user nova-compute[75229]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 10:07:15 user nova-compute[75229]:   </cpu>
Nov 14 10:07:15 user nova-compute[75229]:   <devices>
Nov 14 10:07:15 user nova-compute[75229]:     <disk type="block" device="disk">
Nov 14 10:07:15 user nova-compute[75229]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 10:07:15 user nova-compute[75229]:       <source dev="/dev/sdd"/>
Nov 14 10:07:15 user nova-compute[75229]:       <target dev="vda" bus="virtio"/>
Nov 14 10:07:15 user nova-compute[75229]:       <serial>7aee6091-dab3-4c39-88a1-4bbb28dcab45</serial>
Nov 14 10:07:15 user nova-compute[75229]:     </disk>
Nov 14 10:07:15 user nova-compute[75229]:     <disk type="file" device="disk">
Nov 14 10:07:15 user nova-compute[75229]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 10:07:15 user nova-compute[75229]:       <source file="/opt/stack/data/nova/instances/10d6bce1-e55f-429c-816d-3bef9029560a/disk.rescue"/>
Nov 14 10:07:15 user nova-compute[75229]:       <target dev="vdb" bus="virtio"/>
Nov 14 10:07:15 user nova-compute[75229]:       <boot order="1"/>
Nov 14 10:07:15 user nova-compute[75229]:     </disk>
Nov 14 10:07:15 user nova-compute[75229]:     <interface type="ethernet">
Nov 14 10:07:15 user nova-compute[75229]:       <mac address="fa:16:3e:e7:9f:f8"/>
Nov 14 10:07:15 user nova-compute[75229]:       <model type="virtio"/>
Nov 14 10:07:15 user nova-compute[75229]:       <mtu size="1442"/>
Nov 14 10:07:15 user nova-compute[75229]:       <target dev="tapea04ea8d-43"/>
Nov 14 10:07:15 user nova-compute[75229]:     </interface>
Nov 14 10:07:15 user nova-compute[75229]:     <serial type="pty">
Nov 14 10:07:15 user nova-compute[75229]:       <log file="/opt/stack/data/nova/instances/10d6bce1-e55f-429c-816d-3bef9029560a/console.log" append="off"/>
Nov 14 10:07:15 user nova-compute[75229]:     </serial>
Nov 14 10:07:15 user nova-compute[75229]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 10:07:15 user nova-compute[75229]:     <video>
Nov 14 10:07:15 user nova-compute[75229]:       <model type="virtio"/>
Nov 14 10:07:15 user nova-compute[75229]:     </video>
Nov 14 10:07:15 user nova-compute[75229]:     <rng model="virtio">
Nov 14 10:07:15 user nova-compute[75229]:       <backend model="random">/dev/urandom</backend>
Nov 14 10:07:15 user nova-compute[75229]:     </rng>
Nov 14 10:07:15 user nova-compute[75229]:     <controller type="usb" index="0" model="none"/>
Nov 14 10:07:15 user nova-compute[75229]:     <memballoon model="virtio">
Nov 14 10:07:15 user nova-compute[75229]:       <stats period="10"/>
Nov 14 10:07:15 user nova-compute[75229]:     </memballoon>
Nov 14 10:07:15 user nova-compute[75229]:   </devices>
Nov 14 10:07:15 user nova-compute[75229]: </domain>
Nov 14 10:07:15 user nova-compute[75229]:  {{(pid=75229) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 10:07:15 user nova-compute[75229]: INFO nova.virt.libvirt.driver [-] [instance: 10d6bce1-e55f-429c-816d-3bef9029560a] Instance destroyed successfully.
Nov 14 10:07:15 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-12974009-4d12-43c6-b355-bd432dc0197a tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] No BDM found with device name vda, not building metadata. {{(pid=75229) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 10:07:15 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-12974009-4d12-43c6-b355-bd432dc0197a tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75229) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 10:07:15 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-12974009-4d12-43c6-b355-bd432dc0197a tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] No VIF found with MAC fa:16:3e:e7:9f:f8, not building metadata {{(pid=75229) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 10:07:17 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:07:17 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:07:17 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:07:17 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:07:17 user nova-compute[75229]: DEBUG nova.compute.manager [req-b2ddd696-5517-4e08-a6fc-ada998a446a0 req-6b80a086-1cce-4b49-8178-c23172c42727 service nova] [instance: 10d6bce1-e55f-429c-816d-3bef9029560a] Received event network-vif-plugged-ea04ea8d-43a6-4f64-9e0b-cc2927f214f5 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 10:07:17 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-b2ddd696-5517-4e08-a6fc-ada998a446a0 req-6b80a086-1cce-4b49-8178-c23172c42727 service nova] Acquiring lock "10d6bce1-e55f-429c-816d-3bef9029560a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:07:17 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-b2ddd696-5517-4e08-a6fc-ada998a446a0 req-6b80a086-1cce-4b49-8178-c23172c42727 service nova] Lock "10d6bce1-e55f-429c-816d-3bef9029560a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:07:17 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-b2ddd696-5517-4e08-a6fc-ada998a446a0 req-6b80a086-1cce-4b49-8178-c23172c42727 service nova] Lock "10d6bce1-e55f-429c-816d-3bef9029560a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:07:17 user nova-compute[75229]: DEBUG nova.compute.manager [req-b2ddd696-5517-4e08-a6fc-ada998a446a0 req-6b80a086-1cce-4b49-8178-c23172c42727 service nova] [instance: 10d6bce1-e55f-429c-816d-3bef9029560a] No waiting events found dispatching network-vif-plugged-ea04ea8d-43a6-4f64-9e0b-cc2927f214f5 {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 10:07:17 user nova-compute[75229]: WARNING nova.compute.manager [req-b2ddd696-5517-4e08-a6fc-ada998a446a0 req-6b80a086-1cce-4b49-8178-c23172c42727 service nova] [instance: 10d6bce1-e55f-429c-816d-3bef9029560a] Received unexpected event network-vif-plugged-ea04ea8d-43a6-4f64-9e0b-cc2927f214f5 for instance with vm_state active and task_state rescuing.
Nov 14 10:07:17 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:07:17 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:07:18 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:07:19 user nova-compute[75229]: DEBUG nova.compute.manager [req-c5d224d7-44a7-4dc4-aad9-ffc3f33157b0 req-4c849b09-b44e-424e-a266-dbd065aa78df service nova] [instance: 10d6bce1-e55f-429c-816d-3bef9029560a] Received event network-vif-plugged-ea04ea8d-43a6-4f64-9e0b-cc2927f214f5 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 10:07:19 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-c5d224d7-44a7-4dc4-aad9-ffc3f33157b0 req-4c849b09-b44e-424e-a266-dbd065aa78df service nova] Acquiring lock "10d6bce1-e55f-429c-816d-3bef9029560a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:07:19 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-c5d224d7-44a7-4dc4-aad9-ffc3f33157b0 req-4c849b09-b44e-424e-a266-dbd065aa78df service nova] Lock "10d6bce1-e55f-429c-816d-3bef9029560a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:07:19 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-c5d224d7-44a7-4dc4-aad9-ffc3f33157b0 req-4c849b09-b44e-424e-a266-dbd065aa78df service nova] Lock "10d6bce1-e55f-429c-816d-3bef9029560a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:07:19 user nova-compute[75229]: DEBUG nova.compute.manager [req-c5d224d7-44a7-4dc4-aad9-ffc3f33157b0 req-4c849b09-b44e-424e-a266-dbd065aa78df service nova] [instance: 10d6bce1-e55f-429c-816d-3bef9029560a] No waiting events found dispatching network-vif-plugged-ea04ea8d-43a6-4f64-9e0b-cc2927f214f5 {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 10:07:19 user nova-compute[75229]: WARNING nova.compute.manager [req-c5d224d7-44a7-4dc4-aad9-ffc3f33157b0 req-4c849b09-b44e-424e-a266-dbd065aa78df service nova] [instance: 10d6bce1-e55f-429c-816d-3bef9029560a] Received unexpected event network-vif-plugged-ea04ea8d-43a6-4f64-9e0b-cc2927f214f5 for instance with vm_state active and task_state rescuing.
Nov 14 10:07:19 user nova-compute[75229]: DEBUG nova.compute.manager [None req-12974009-4d12-43c6-b355-bd432dc0197a tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] [instance: 10d6bce1-e55f-429c-816d-3bef9029560a] Checking state {{(pid=75229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 10:07:22 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:07:27 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 10:07:32 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:07:33 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:07:37 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:07:38 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:07:41 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-05bc051f-cf28-49fe-9455-436894e003f7 tempest-ServerActionsV293TestJSON-1571447010 tempest-ServerActionsV293TestJSON-1571447010-project-member] Acquiring lock "3795dd8f-8a10-4939-8f2c-bacefe5f5aa1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:07:41 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-05bc051f-cf28-49fe-9455-436894e003f7 tempest-ServerActionsV293TestJSON-1571447010 tempest-ServerActionsV293TestJSON-1571447010-project-member] Lock "3795dd8f-8a10-4939-8f2c-bacefe5f5aa1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:07:41 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-05bc051f-cf28-49fe-9455-436894e003f7 tempest-ServerActionsV293TestJSON-1571447010 tempest-ServerActionsV293TestJSON-1571447010-project-member] Acquiring lock "3795dd8f-8a10-4939-8f2c-bacefe5f5aa1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:07:41 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-05bc051f-cf28-49fe-9455-436894e003f7 tempest-ServerActionsV293TestJSON-1571447010 tempest-ServerActionsV293TestJSON-1571447010-project-member] Lock "3795dd8f-8a10-4939-8f2c-bacefe5f5aa1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:07:41 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-05bc051f-cf28-49fe-9455-436894e003f7 tempest-ServerActionsV293TestJSON-1571447010 tempest-ServerActionsV293TestJSON-1571447010-project-member] Lock "3795dd8f-8a10-4939-8f2c-bacefe5f5aa1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:07:41 user nova-compute[75229]: INFO nova.compute.manager [None req-05bc051f-cf28-49fe-9455-436894e003f7 tempest-ServerActionsV293TestJSON-1571447010 tempest-ServerActionsV293TestJSON-1571447010-project-member] [instance: 3795dd8f-8a10-4939-8f2c-bacefe5f5aa1] Terminating instance
Nov 14 10:07:41 user nova-compute[75229]: DEBUG nova.compute.manager [None req-05bc051f-cf28-49fe-9455-436894e003f7 tempest-ServerActionsV293TestJSON-1571447010 tempest-ServerActionsV293TestJSON-1571447010-project-member] [instance: 3795dd8f-8a10-4939-8f2c-bacefe5f5aa1] Start destroying the instance on the hypervisor. {{(pid=75229) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 10:07:41 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:07:41 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:07:41 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:07:41 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:07:41 user nova-compute[75229]: DEBUG nova.compute.manager [req-72511c4c-9006-4428-8f9f-b2d691b5dbc9 req-451a2abe-9263-4f0b-96d5-03b0ea95cd67 service nova] [instance: 3795dd8f-8a10-4939-8f2c-bacefe5f5aa1] Received event network-vif-unplugged-c22c2020-a8ff-4cd5-8b78-89b1bb277e8c {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 10:07:41 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-72511c4c-9006-4428-8f9f-b2d691b5dbc9 req-451a2abe-9263-4f0b-96d5-03b0ea95cd67 service nova] Acquiring lock "3795dd8f-8a10-4939-8f2c-bacefe5f5aa1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:07:41 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-72511c4c-9006-4428-8f9f-b2d691b5dbc9 req-451a2abe-9263-4f0b-96d5-03b0ea95cd67 service nova] Lock "3795dd8f-8a10-4939-8f2c-bacefe5f5aa1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:07:41 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-72511c4c-9006-4428-8f9f-b2d691b5dbc9 req-451a2abe-9263-4f0b-96d5-03b0ea95cd67 service nova] Lock "3795dd8f-8a10-4939-8f2c-bacefe5f5aa1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:07:41 user nova-compute[75229]: DEBUG nova.compute.manager [req-72511c4c-9006-4428-8f9f-b2d691b5dbc9 req-451a2abe-9263-4f0b-96d5-03b0ea95cd67 service nova] [instance: 3795dd8f-8a10-4939-8f2c-bacefe5f5aa1] No waiting events found dispatching network-vif-unplugged-c22c2020-a8ff-4cd5-8b78-89b1bb277e8c {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 10:07:41 user nova-compute[75229]: DEBUG nova.compute.manager [req-72511c4c-9006-4428-8f9f-b2d691b5dbc9 req-451a2abe-9263-4f0b-96d5-03b0ea95cd67 service nova] [instance: 3795dd8f-8a10-4939-8f2c-bacefe5f5aa1] Received event network-vif-unplugged-c22c2020-a8ff-4cd5-8b78-89b1bb277e8c for instance with task_state deleting. {{(pid=75229) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 10:07:42 user nova-compute[75229]: INFO nova.virt.libvirt.driver [-] [instance: 3795dd8f-8a10-4939-8f2c-bacefe5f5aa1] Instance destroyed successfully.
Nov 14 10:07:42 user nova-compute[75229]: DEBUG nova.objects.instance [None req-05bc051f-cf28-49fe-9455-436894e003f7 tempest-ServerActionsV293TestJSON-1571447010 tempest-ServerActionsV293TestJSON-1571447010-project-member] Lazy-loading 'resources' on Instance uuid 3795dd8f-8a10-4939-8f2c-bacefe5f5aa1 {{(pid=75229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 10:07:42 user nova-compute[75229]: DEBUG nova.virt.libvirt.vif [None req-05bc051f-cf28-49fe-9455-436894e003f7 tempest-ServerActionsV293TestJSON-1571447010 tempest-ServerActionsV293TestJSON-1571447010-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-14T10:03:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-397489303',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-227769429',id=44,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFUp8y3q6YJE91W5mLt9TtiRsU0SK+1Tlv+h5RVCK8xvWSBDaBLlNygtiA4MzTbH6VU4efuvwyj9xakV6WTmEsQqXHmG4tvUv4ckhtOrRf2abxMbK7PzCZvHKp/bva3DgA==',key_name='tempest-keypair-1083609012',keypairs=<?>,launch_index=0,launched_at=2023-11-14T10:06:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='dd2def4493b6471c86ad547a2e21eaf8',ramdisk_id='',reservation_id='r-3orn8wim',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1571447010',owner_user_name='tempest-ServerActionsV293TestJSON-1571447010-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T10:06:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ccb15ed1f78c4c97a06b44dd1d833693',uuid=3795dd8f-8a10-4939-8f2c-bacefe5f5aa1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c22c2020-a8ff-4cd5-8b78-89b1bb277e8c", "address": "fa:16:3e:a6:6b:f6", "network": {"id": "cd37c3e7-5ffe-4b5d-a25c-a2bd288cb9d2", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-156456501-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.204", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd2def4493b6471c86ad547a2e21eaf8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc22c2020-a8", "ovs_interfaceid": "c22c2020-a8ff-4cd5-8b78-89b1bb277e8c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 10:07:42 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-05bc051f-cf28-49fe-9455-436894e003f7 tempest-ServerActionsV293TestJSON-1571447010 tempest-ServerActionsV293TestJSON-1571447010-project-member] Converting VIF {"id": "c22c2020-a8ff-4cd5-8b78-89b1bb277e8c", "address": "fa:16:3e:a6:6b:f6", "network": {"id": "cd37c3e7-5ffe-4b5d-a25c-a2bd288cb9d2", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-156456501-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.204", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd2def4493b6471c86ad547a2e21eaf8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc22c2020-a8", "ovs_interfaceid": "c22c2020-a8ff-4cd5-8b78-89b1bb277e8c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 10:07:42 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-05bc051f-cf28-49fe-9455-436894e003f7 tempest-ServerActionsV293TestJSON-1571447010 tempest-ServerActionsV293TestJSON-1571447010-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a6:6b:f6,bridge_name='br-int',has_traffic_filtering=True,id=c22c2020-a8ff-4cd5-8b78-89b1bb277e8c,network=Network(cd37c3e7-5ffe-4b5d-a25c-a2bd288cb9d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc22c2020-a8') {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 10:07:42 user nova-compute[75229]: DEBUG os_vif [None req-05bc051f-cf28-49fe-9455-436894e003f7 tempest-ServerActionsV293TestJSON-1571447010 tempest-ServerActionsV293TestJSON-1571447010-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a6:6b:f6,bridge_name='br-int',has_traffic_filtering=True,id=c22c2020-a8ff-4cd5-8b78-89b1bb277e8c,network=Network(cd37c3e7-5ffe-4b5d-a25c-a2bd288cb9d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc22c2020-a8') {{(pid=75229) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 10:07:42 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:07:42 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc22c2020-a8, bridge=br-int, if_exists=True) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 10:07:42 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:07:42 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 10:07:42 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:07:42 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c80a5196-5138-4643-bb28-2a0a1c08a92c) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 10:07:42 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:07:42 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 10:07:42 user nova-compute[75229]: INFO os_vif [None req-05bc051f-cf28-49fe-9455-436894e003f7 tempest-ServerActionsV293TestJSON-1571447010 tempest-ServerActionsV293TestJSON-1571447010-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a6:6b:f6,bridge_name='br-int',has_traffic_filtering=True,id=c22c2020-a8ff-4cd5-8b78-89b1bb277e8c,network=Network(cd37c3e7-5ffe-4b5d-a25c-a2bd288cb9d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc22c2020-a8')
Nov 14 10:07:42 user nova-compute[75229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-05bc051f-cf28-49fe-9455-436894e003f7 tempest-ServerActionsV293TestJSON-1571447010 tempest-ServerActionsV293TestJSON-1571447010-project-member] [instance: 3795dd8f-8a10-4939-8f2c-bacefe5f5aa1] calling os-brick to detach iSCSI Volume {{(pid=75229) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 10:07:42 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-05bc051f-cf28-49fe-9455-436894e003f7 tempest-ServerActionsV293TestJSON-1571447010 tempest-ServerActionsV293TestJSON-1571447010-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f73f85151b0>, {'target_iqn': 'iqn.2010-10.org.openstack:4ddb200b-47ca-4449-9973-be76424a6761', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OQUwLneK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 10:07:42 user nova-compute[75229]: WARNING os_brick.initiator.connectors.base [None req-05bc051f-cf28-49fe-9455-436894e003f7 tempest-ServerActionsV293TestJSON-1571447010 tempest-ServerActionsV293TestJSON-1571447010-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 10:07:42 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-05bc051f-cf28-49fe-9455-436894e003f7 tempest-ServerActionsV293TestJSON-1571447010 tempest-ServerActionsV293TestJSON-1571447010-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 10:07:42 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-05bc051f-cf28-49fe-9455-436894e003f7 tempest-ServerActionsV293TestJSON-1571447010 tempest-ServerActionsV293TestJSON-1571447010-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 10:07:42 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:07:42 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:07:42 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[f62a97dd-b9a0-4149-9927-2198849010e0]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4ddb200b-47ca-4449-9973-be76424a6761\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7aee6091-dab3-4c39-88a1-4bbb28dcab45\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c8892c7d-49e8-4f65-b88c-1e14fba8f50a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5aebc438-0289-44fe-ad84-4e696468f50e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:07:42 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-05bc051f-cf28-49fe-9455-436894e003f7 tempest-ServerActionsV293TestJSON-1571447010 tempest-ServerActionsV293TestJSON-1571447010-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 10:07:42 user nova-compute[75229]: No targets found.
Nov 14 10:07:42 user nova-compute[75229]: iSNS:
Nov 14 10:07:42 user nova-compute[75229]: No targets found.
Nov 14 10:07:42 user nova-compute[75229]: STATIC:
Nov 14 10:07:42 user nova-compute[75229]: Target: iqn.2010-10.org.openstack:4ddb200b-47ca-4449-9973-be76424a6761
Nov 14 10:07:42 user nova-compute[75229]:         Portal: 172.16.0.220:3260,-1
Nov 14 10:07:42 user nova-compute[75229]:                 Iface Name: default
Nov 14 10:07:42 user nova-compute[75229]: Target: iqn.2010-10.org.openstack:7aee6091-dab3-4c39-88a1-4bbb28dcab45
Nov 14 10:07:42 user nova-compute[75229]:         Portal: 172.16.0.220:3260,-1
Nov 14 10:07:42 user nova-compute[75229]:                 Iface Name: default
Nov 14 10:07:42 user nova-compute[75229]: Target: iqn.2010-10.org.openstack:c8892c7d-49e8-4f65-b88c-1e14fba8f50a
Nov 14 10:07:42 user nova-compute[75229]:         Portal: 172.16.0.220:3260,-1
Nov 14 10:07:42 user nova-compute[75229]:                 Iface Name: default
Nov 14 10:07:42 user nova-compute[75229]: Target: iqn.2010-10.org.openstack:5aebc438-0289-44fe-ad84-4e696468f50e
Nov 14 10:07:42 user nova-compute[75229]:         Portal: 172.16.0.220:3260,-1
Nov 14 10:07:42 user nova-compute[75229]:                 Iface Name: default
Nov 14 10:07:42 user nova-compute[75229]: FIRMWARE:
Nov 14 10:07:42 user nova-compute[75229]: No targets found.
Nov 14 10:07:42 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 10:07:42 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-05bc051f-cf28-49fe-9455-436894e003f7 tempest-ServerActionsV293TestJSON-1571447010 tempest-ServerActionsV293TestJSON-1571447010-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 10:07:42 user nova-compute[75229]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 10:07:42 user nova-compute[75229]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75229) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 10:07:42 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-05bc051f-cf28-49fe-9455-436894e003f7 tempest-ServerActionsV293TestJSON-1571447010 tempest-ServerActionsV293TestJSON-1571447010-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4ddb200b-47ca-4449-9973-be76424a6761', 0)] {{(pid=75229) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 10:07:42 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:07:42 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.026s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:07:42 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[caf9a7bc-c2c6-4e52-9293-71d70beaa14e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4ddb200b-47ca-4449-9973-be76424a6761\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5aebc438-0289-44fe-ad84-4e696468f50e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7aee6091-dab3-4c39-88a1-4bbb28dcab45\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c8892c7d-49e8-4f65-b88c-1e14fba8f50a\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:07:42 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:07:42 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:07:42 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b073e91-a06c-4821-8343-3e0cc5b01062]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aebc438-0289-44fe-ad84-4e696468f50e (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7aee6091-dab3-4c39-88a1-4bbb28dcab45 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ddb200b-47ca-4449-9973-be76424a6761 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8892c7d-49e8-4f65-b88c-1e14fba8f50a (non-flash)\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:07:42 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-05bc051f-cf28-49fe-9455-436894e003f7 tempest-ServerActionsV293TestJSON-1571447010 tempest-ServerActionsV293TestJSON-1571447010-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aebc438-0289-44fe-ad84-4e696468f50e (non-flash)
Nov 14 10:07:42 user nova-compute[75229]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7aee6091-dab3-4c39-88a1-4bbb28dcab45 (non-flash)
Nov 14 10:07:42 user nova-compute[75229]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ddb200b-47ca-4449-9973-be76424a6761 (non-flash)
Nov 14 10:07:42 user nova-compute[75229]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8892c7d-49e8-4f65-b88c-1e14fba8f50a (non-flash)
Nov 14 10:07:42 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 10:07:42 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-05bc051f-cf28-49fe-9455-436894e003f7 tempest-ServerActionsV293TestJSON-1571447010 tempest-ServerActionsV293TestJSON-1571447010-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aebc438-0289-44fe-ad84-4e696468f50e (non-flash)
Nov 14 10:07:42 user nova-compute[75229]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7aee6091-dab3-4c39-88a1-4bbb28dcab45 (non-flash)
Nov 14 10:07:42 user nova-compute[75229]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ddb200b-47ca-4449-9973-be76424a6761 (non-flash)
Nov 14 10:07:42 user nova-compute[75229]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8892c7d-49e8-4f65-b88c-1e14fba8f50a (non-flash)
Nov 14 10:07:42 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 10:07:42 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-05bc051f-cf28-49fe-9455-436894e003f7 tempest-ServerActionsV293TestJSON-1571447010 tempest-ServerActionsV293TestJSON-1571447010-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f73f8259d80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4ddb200b-47ca-4449-9973-be76424a6761'): ({'sde'}, set())}) {{(pid=75229) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 10:07:42 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-05bc051f-cf28-49fe-9455-436894e003f7 tempest-ServerActionsV293TestJSON-1571447010 tempest-ServerActionsV293TestJSON-1571447010-project-member] Removing single pathed devices sde {{(pid=75229) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 10:07:42 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:07:42 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:07:42 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[b14d835f-c1a4-4ada-8701-4e6258b5768b]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:07:42 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:07:42 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.023s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:07:42 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6a3d25c-1dba-4f2b-b411-d47655363925]: (4, ('ok\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:07:42 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-05bc051f-cf28-49fe-9455-436894e003f7 tempest-ServerActionsV293TestJSON-1571447010 tempest-ServerActionsV293TestJSON-1571447010-project-member] Flushing IO for device /dev/sde {{(pid=75229) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 10:07:42 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:07:42 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.017s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:07:42 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[80a1ba0a-aca7-4516-ba5e-532c3a1973a4]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:07:42 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-05bc051f-cf28-49fe-9455-436894e003f7 tempest-ServerActionsV293TestJSON-1571447010 tempest-ServerActionsV293TestJSON-1571447010-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75229) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 10:07:42 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:07:42 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.052s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:07:42 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8fd46a0-aa41-466e-88dd-34a8af8db104]: (4, ('1', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:07:42 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-05bc051f-cf28-49fe-9455-436894e003f7 tempest-ServerActionsV293TestJSON-1571447010 tempest-ServerActionsV293TestJSON-1571447010-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75229) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 10:07:42 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-05bc051f-cf28-49fe-9455-436894e003f7 tempest-ServerActionsV293TestJSON-1571447010 tempest-ServerActionsV293TestJSON-1571447010-project-member] SCSI volumes sde have been removed. {{(pid=75229) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 10:07:42 user nova-compute[75229]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_f7241e69', '/dev/disk/by-id/scsi-23163333931393131', '/dev/disk/by-id/scsi-1SCST_BIOf7241e69-1c391911b2f7553f') {{(pid=86458) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 14 10:07:42 user nova-compute[75229]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-SSCST_BIO_Storage_f7241e69
Nov 14 10:07:42 user nova-compute[75229]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-23163333931393131
Nov 14 10:07:42 user nova-compute[75229]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-1SCST_BIOf7241e69-1c391911b2f7553f
Nov 14 10:07:42 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[c24d0691-d13b-427a-866a-dbacc8cf1cb6]: (4, None) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:07:42 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-05bc051f-cf28-49fe-9455-436894e003f7 tempest-ServerActionsV293TestJSON-1571447010 tempest-ServerActionsV293TestJSON-1571447010-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4ddb200b-47ca-4449-9973-be76424a6761')] {{(pid=75229) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 10:07:42 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ddb200b-47ca-4449-9973-be76424a6761 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:07:42 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ddb200b-47ca-4449-9973-be76424a6761 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:07:42 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[86545984-be94-4cd1-bba9-b685624137dd]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:07:42 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-05bc051f-cf28-49fe-9455-436894e003f7 tempest-ServerActionsV293TestJSON-1571447010 tempest-ServerActionsV293TestJSON-1571447010-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 10:07:42 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ddb200b-47ca-4449-9973-be76424a6761 -p 172.16.0.220:3260 --logout {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:07:42 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ddb200b-47ca-4449-9973-be76424a6761 -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:07:42 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[03775194-23b8-4429-9c45-a3be4f4a4e22]: (4, ('Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:4ddb200b-47ca-4449-9973-be76424a6761, portal: 172.16.0.220,3260]\nLogout of [sid: 48, target: iqn.2010-10.org.openstack:4ddb200b-47ca-4449-9973-be76424a6761, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:07:42 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-05bc051f-cf28-49fe-9455-436894e003f7 tempest-ServerActionsV293TestJSON-1571447010 tempest-ServerActionsV293TestJSON-1571447010-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:4ddb200b-47ca-4449-9973-be76424a6761, portal: 172.16.0.220,3260]
Nov 14 10:07:42 user nova-compute[75229]: Logout of [sid: 48, target: iqn.2010-10.org.openstack:4ddb200b-47ca-4449-9973-be76424a6761, portal: 172.16.0.220,3260] successful.
Nov 14 10:07:42 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 10:07:42 user nova-compute[75229]: DEBUG nova.compute.manager [req-2a481f8a-311b-4c38-b626-ebb71d8e2e2a req-e9ac2529-e06b-4a73-b6de-ce0763aba12a service nova] [instance: 764de1b0-b77f-457a-8355-e5cdc1f6eab1] Received event network-changed-09e96897-482d-402e-adcc-e8bf9010391d {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 10:07:42 user nova-compute[75229]: DEBUG nova.compute.manager [req-2a481f8a-311b-4c38-b626-ebb71d8e2e2a req-e9ac2529-e06b-4a73-b6de-ce0763aba12a service nova] [instance: 764de1b0-b77f-457a-8355-e5cdc1f6eab1] Refreshing instance network info cache due to event network-changed-09e96897-482d-402e-adcc-e8bf9010391d. {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 10:07:42 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-2a481f8a-311b-4c38-b626-ebb71d8e2e2a req-e9ac2529-e06b-4a73-b6de-ce0763aba12a service nova] Acquiring lock "refresh_cache-764de1b0-b77f-457a-8355-e5cdc1f6eab1" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 10:07:42 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-2a481f8a-311b-4c38-b626-ebb71d8e2e2a req-e9ac2529-e06b-4a73-b6de-ce0763aba12a service nova] Acquired lock "refresh_cache-764de1b0-b77f-457a-8355-e5cdc1f6eab1" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 10:07:42 user nova-compute[75229]: DEBUG nova.network.neutron [req-2a481f8a-311b-4c38-b626-ebb71d8e2e2a req-e9ac2529-e06b-4a73-b6de-ce0763aba12a service nova] [instance: 764de1b0-b77f-457a-8355-e5cdc1f6eab1] Refreshing network info cache for port 09e96897-482d-402e-adcc-e8bf9010391d {{(pid=75229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 10:07:42 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ddb200b-47ca-4449-9973-be76424a6761 -p 172.16.0.220:3260 --op delete {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:07:42 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ddb200b-47ca-4449-9973-be76424a6761 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:07:42 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fe0fd9f-4c79-4f76-8118-b12bd01bf4e4]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:07:42 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-05bc051f-cf28-49fe-9455-436894e003f7 tempest-ServerActionsV293TestJSON-1571447010 tempest-ServerActionsV293TestJSON-1571447010-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 10:07:42 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-05bc051f-cf28-49fe-9455-436894e003f7 tempest-ServerActionsV293TestJSON-1571447010 tempest-ServerActionsV293TestJSON-1571447010-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.376s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 10:07:42 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-05bc051f-cf28-49fe-9455-436894e003f7 tempest-ServerActionsV293TestJSON-1571447010 tempest-ServerActionsV293TestJSON-1571447010-project-member] <== disconnect_volume: return (377ms) None {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 10:07:42 user nova-compute[75229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-05bc051f-cf28-49fe-9455-436894e003f7 tempest-ServerActionsV293TestJSON-1571447010 tempest-ServerActionsV293TestJSON-1571447010-project-member] [instance: 3795dd8f-8a10-4939-8f2c-bacefe5f5aa1] Disconnected iSCSI Volume {{(pid=75229) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 10:07:42 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-05bc051f-cf28-49fe-9455-436894e003f7 tempest-ServerActionsV293TestJSON-1571447010 tempest-ServerActionsV293TestJSON-1571447010-project-member] [instance: 3795dd8f-8a10-4939-8f2c-bacefe5f5aa1] Deleting instance files /opt/stack/data/nova/instances/3795dd8f-8a10-4939-8f2c-bacefe5f5aa1_del
Nov 14 10:07:42 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-05bc051f-cf28-49fe-9455-436894e003f7 tempest-ServerActionsV293TestJSON-1571447010 tempest-ServerActionsV293TestJSON-1571447010-project-member] [instance: 3795dd8f-8a10-4939-8f2c-bacefe5f5aa1] Deletion of /opt/stack/data/nova/instances/3795dd8f-8a10-4939-8f2c-bacefe5f5aa1_del complete
Nov 14 10:07:42 user nova-compute[75229]: INFO nova.compute.manager [None req-05bc051f-cf28-49fe-9455-436894e003f7 tempest-ServerActionsV293TestJSON-1571447010 tempest-ServerActionsV293TestJSON-1571447010-project-member] [instance: 3795dd8f-8a10-4939-8f2c-bacefe5f5aa1] Took 1.29 seconds to destroy the instance on the hypervisor.
Nov 14 10:07:42 user nova-compute[75229]: DEBUG oslo.service.loopingcall [None req-05bc051f-cf28-49fe-9455-436894e003f7 tempest-ServerActionsV293TestJSON-1571447010 tempest-ServerActionsV293TestJSON-1571447010-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75229) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 10:07:42 user nova-compute[75229]: DEBUG nova.compute.manager [-] [instance: 3795dd8f-8a10-4939-8f2c-bacefe5f5aa1] Deallocating network for instance {{(pid=75229) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 10:07:42 user nova-compute[75229]: DEBUG nova.network.neutron [-] [instance: 3795dd8f-8a10-4939-8f2c-bacefe5f5aa1] deallocate_for_instance() {{(pid=75229) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 10:07:43 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-1fe47858-26c1-4c9e-93f6-bfb6122694ae tempest-TestServerVolumeAttachmentScenario-1041667837 tempest-TestServerVolumeAttachmentScenario-1041667837-project-member] Acquiring lock "764de1b0-b77f-457a-8355-e5cdc1f6eab1" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:07:43 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-1fe47858-26c1-4c9e-93f6-bfb6122694ae tempest-TestServerVolumeAttachmentScenario-1041667837 tempest-TestServerVolumeAttachmentScenario-1041667837-project-member] Lock "764de1b0-b77f-457a-8355-e5cdc1f6eab1" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:07:43 user nova-compute[75229]: DEBUG nova.objects.instance [None req-1fe47858-26c1-4c9e-93f6-bfb6122694ae tempest-TestServerVolumeAttachmentScenario-1041667837 tempest-TestServerVolumeAttachmentScenario-1041667837-project-member] Lazy-loading 'flavor' on Instance uuid 764de1b0-b77f-457a-8355-e5cdc1f6eab1 {{(pid=75229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 10:07:43 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-1fe47858-26c1-4c9e-93f6-bfb6122694ae tempest-TestServerVolumeAttachmentScenario-1041667837 tempest-TestServerVolumeAttachmentScenario-1041667837-project-member] Lock "764de1b0-b77f-457a-8355-e5cdc1f6eab1" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.106s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:07:43 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:07:43 user nova-compute[75229]: DEBUG nova.network.neutron [-] [instance: 3795dd8f-8a10-4939-8f2c-bacefe5f5aa1] Updating instance_info_cache with network_info: [] {{(pid=75229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 10:07:43 user nova-compute[75229]: INFO nova.compute.manager [-] [instance: 3795dd8f-8a10-4939-8f2c-bacefe5f5aa1] Took 0.87 seconds to deallocate network for instance.
Nov 14 10:07:43 user nova-compute[75229]: DEBUG nova.network.neutron [req-2a481f8a-311b-4c38-b626-ebb71d8e2e2a req-e9ac2529-e06b-4a73-b6de-ce0763aba12a service nova] [instance: 764de1b0-b77f-457a-8355-e5cdc1f6eab1] Updated VIF entry in instance network info cache for port 09e96897-482d-402e-adcc-e8bf9010391d. {{(pid=75229) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 10:07:43 user nova-compute[75229]: DEBUG nova.network.neutron [req-2a481f8a-311b-4c38-b626-ebb71d8e2e2a req-e9ac2529-e06b-4a73-b6de-ce0763aba12a service nova] [instance: 764de1b0-b77f-457a-8355-e5cdc1f6eab1] Updating instance_info_cache with network_info: [{"id": "09e96897-482d-402e-adcc-e8bf9010391d", "address": "fa:16:3e:75:4a:25", "network": {"id": "84ceafdd-3b62-438f-bd6c-9a51224c1011", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1430955242-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.242", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f81daef5439a43b491516bf86286dedd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09e96897-48", "ovs_interfaceid": "09e96897-482d-402e-adcc-e8bf9010391d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 10:07:43 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-2a481f8a-311b-4c38-b626-ebb71d8e2e2a req-e9ac2529-e06b-4a73-b6de-ce0763aba12a service nova] Releasing lock "refresh_cache-764de1b0-b77f-457a-8355-e5cdc1f6eab1" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 10:07:43 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-1fe47858-26c1-4c9e-93f6-bfb6122694ae tempest-TestServerVolumeAttachmentScenario-1041667837 tempest-TestServerVolumeAttachmentScenario-1041667837-project-member] Acquiring lock "764de1b0-b77f-457a-8355-e5cdc1f6eab1" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:07:43 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-1fe47858-26c1-4c9e-93f6-bfb6122694ae tempest-TestServerVolumeAttachmentScenario-1041667837 tempest-TestServerVolumeAttachmentScenario-1041667837-project-member] Lock "764de1b0-b77f-457a-8355-e5cdc1f6eab1" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:07:43 user nova-compute[75229]: INFO nova.compute.manager [None req-1fe47858-26c1-4c9e-93f6-bfb6122694ae tempest-TestServerVolumeAttachmentScenario-1041667837 tempest-TestServerVolumeAttachmentScenario-1041667837-project-member] [instance: 764de1b0-b77f-457a-8355-e5cdc1f6eab1] Attaching volume a8186f4e-9d39-4451-8fb5-1cee648efe1a to /dev/vdb
Nov 14 10:07:43 user nova-compute[75229]: DEBUG os_brick.utils [None req-1fe47858-26c1-4c9e-93f6-bfb6122694ae tempest-TestServerVolumeAttachmentScenario-1041667837 tempest-TestServerVolumeAttachmentScenario-1041667837-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 10:07:43 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:07:43 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:07:43 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa68b7f4-3f87-4271-86fd-aad5a82a3861]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f1154031c835\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:07:43 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:07:43 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.021s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:07:43 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec3b5f67-ce67-41e1-8cc9-6db671d5e757]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:07:43 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:07:43 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:07:43 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9b56d5d-132b-4656-886a-e2b3a19b480e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:07:43 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[330b72db-5782-4309-914b-fffc6d65538e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:07:43 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-1fe47858-26c1-4c9e-93f6-bfb6122694ae tempest-TestServerVolumeAttachmentScenario-1041667837 tempest-TestServerVolumeAttachmentScenario-1041667837-project-member] Running cmd (subprocess): nvme version {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:07:43 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-1fe47858-26c1-4c9e-93f6-bfb6122694ae tempest-TestServerVolumeAttachmentScenario-1041667837 tempest-TestServerVolumeAttachmentScenario-1041667837-project-member] 'nvme version' failed. Not Retrying. {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 10:07:43 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1fe47858-26c1-4c9e-93f6-bfb6122694ae tempest-TestServerVolumeAttachmentScenario-1041667837 tempest-TestServerVolumeAttachmentScenario-1041667837-project-member] nvme not present on system {{(pid=75229) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 10:07:43 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:07:43 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 10:07:43 user nova-compute[75229]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 10:07:43 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2df402b-b2ef-4450-9c29-e6062b9ed21e]: (4, '') {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:07:43 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.lightos [None req-1fe47858-26c1-4c9e-93f6-bfb6122694ae tempest-TestServerVolumeAttachmentScenario-1041667837 tempest-TestServerVolumeAttachmentScenario-1041667837-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75229) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 10:07:43 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.lightos [None req-1fe47858-26c1-4c9e-93f6-bfb6122694ae tempest-TestServerVolumeAttachmentScenario-1041667837 tempest-TestServerVolumeAttachmentScenario-1041667837-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75229) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 10:07:43 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.lightos [None req-1fe47858-26c1-4c9e-93f6-bfb6122694ae tempest-TestServerVolumeAttachmentScenario-1041667837 tempest-TestServerVolumeAttachmentScenario-1041667837-project-member] LIGHTOS: no hostnqn found. {{(pid=75229) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 10:07:43 user nova-compute[75229]: DEBUG os_brick.utils [None req-1fe47858-26c1-4c9e-93f6-bfb6122694ae tempest-TestServerVolumeAttachmentScenario-1041667837 tempest-TestServerVolumeAttachmentScenario-1041667837-project-member] <== get_connector_properties: return (139ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f1154031c835', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 10:07:43 user nova-compute[75229]: DEBUG nova.virt.block_device [None req-1fe47858-26c1-4c9e-93f6-bfb6122694ae tempest-TestServerVolumeAttachmentScenario-1041667837 tempest-TestServerVolumeAttachmentScenario-1041667837-project-member] [instance: 764de1b0-b77f-457a-8355-e5cdc1f6eab1] Updating existing volume attachment record: 0dc50e1c-f567-4245-ae46-52c16c91c933 {{(pid=75229) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 10:07:43 user nova-compute[75229]: DEBUG nova.compute.manager [req-7a52c25f-697a-4840-9141-5bd1a9ee1834 req-bef3d159-3db9-4cac-b200-68ec7b5ac41b service nova] [instance: 3795dd8f-8a10-4939-8f2c-bacefe5f5aa1] Received event network-vif-plugged-c22c2020-a8ff-4cd5-8b78-89b1bb277e8c {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 10:07:43 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-7a52c25f-697a-4840-9141-5bd1a9ee1834 req-bef3d159-3db9-4cac-b200-68ec7b5ac41b service nova] Acquiring lock "3795dd8f-8a10-4939-8f2c-bacefe5f5aa1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:07:43 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-7a52c25f-697a-4840-9141-5bd1a9ee1834 req-bef3d159-3db9-4cac-b200-68ec7b5ac41b service nova] Lock "3795dd8f-8a10-4939-8f2c-bacefe5f5aa1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:07:43 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-7a52c25f-697a-4840-9141-5bd1a9ee1834 req-bef3d159-3db9-4cac-b200-68ec7b5ac41b service nova] Lock "3795dd8f-8a10-4939-8f2c-bacefe5f5aa1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:07:43 user nova-compute[75229]: DEBUG nova.compute.manager [req-7a52c25f-697a-4840-9141-5bd1a9ee1834 req-bef3d159-3db9-4cac-b200-68ec7b5ac41b service nova] [instance: 3795dd8f-8a10-4939-8f2c-bacefe5f5aa1] No waiting events found dispatching network-vif-plugged-c22c2020-a8ff-4cd5-8b78-89b1bb277e8c {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 10:07:43 user nova-compute[75229]: WARNING nova.compute.manager [req-7a52c25f-697a-4840-9141-5bd1a9ee1834 req-bef3d159-3db9-4cac-b200-68ec7b5ac41b service nova] [instance: 3795dd8f-8a10-4939-8f2c-bacefe5f5aa1] Received unexpected event network-vif-plugged-c22c2020-a8ff-4cd5-8b78-89b1bb277e8c for instance with vm_state active and task_state deleting.
Nov 14 10:07:43 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:07:44 user nova-compute[75229]: INFO nova.compute.manager [None req-05bc051f-cf28-49fe-9455-436894e003f7 tempest-ServerActionsV293TestJSON-1571447010 tempest-ServerActionsV293TestJSON-1571447010-project-member] [instance: 3795dd8f-8a10-4939-8f2c-bacefe5f5aa1] Took 0.78 seconds to detach 1 volumes for instance.
Nov 14 10:07:44 user nova-compute[75229]: DEBUG nova.compute.manager [None req-05bc051f-cf28-49fe-9455-436894e003f7 tempest-ServerActionsV293TestJSON-1571447010 tempest-ServerActionsV293TestJSON-1571447010-project-member] [instance: 3795dd8f-8a10-4939-8f2c-bacefe5f5aa1] Deleting volume: 4ddb200b-47ca-4449-9973-be76424a6761 {{(pid=75229) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 14 10:07:44 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-05bc051f-cf28-49fe-9455-436894e003f7 tempest-ServerActionsV293TestJSON-1571447010 tempest-ServerActionsV293TestJSON-1571447010-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:07:44 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-05bc051f-cf28-49fe-9455-436894e003f7 tempest-ServerActionsV293TestJSON-1571447010 tempest-ServerActionsV293TestJSON-1571447010-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:07:44 user nova-compute[75229]: DEBUG nova.compute.manager [req-d8951698-b78a-4cd9-8ec9-1d36f2c23095 req-c7620166-854f-49cc-b903-3595693611b6 service nova] [instance: 3795dd8f-8a10-4939-8f2c-bacefe5f5aa1] Received event network-vif-deleted-c22c2020-a8ff-4cd5-8b78-89b1bb277e8c {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 10:07:44 user nova-compute[75229]: DEBUG nova.compute.provider_tree [None req-05bc051f-cf28-49fe-9455-436894e003f7 tempest-ServerActionsV293TestJSON-1571447010 tempest-ServerActionsV293TestJSON-1571447010-project-member] Inventory has not changed in ProviderTree for provider: d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 {{(pid=75229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 10:07:44 user nova-compute[75229]: DEBUG nova.scheduler.client.report [None req-05bc051f-cf28-49fe-9455-436894e003f7 tempest-ServerActionsV293TestJSON-1571447010 tempest-ServerActionsV293TestJSON-1571447010-project-member] Inventory has not changed for provider d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 10:07:44 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-05bc051f-cf28-49fe-9455-436894e003f7 tempest-ServerActionsV293TestJSON-1571447010 tempest-ServerActionsV293TestJSON-1571447010-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.284s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:07:44 user nova-compute[75229]: INFO nova.scheduler.client.report [None req-05bc051f-cf28-49fe-9455-436894e003f7 tempest-ServerActionsV293TestJSON-1571447010 tempest-ServerActionsV293TestJSON-1571447010-project-member] Deleted allocations for instance 3795dd8f-8a10-4939-8f2c-bacefe5f5aa1
Nov 14 10:07:44 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-05bc051f-cf28-49fe-9455-436894e003f7 tempest-ServerActionsV293TestJSON-1571447010 tempest-ServerActionsV293TestJSON-1571447010-project-member] Lock "3795dd8f-8a10-4939-8f2c-bacefe5f5aa1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.489s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:07:45 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:07:47 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:07:48 user nova-compute[75229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1fe47858-26c1-4c9e-93f6-bfb6122694ae tempest-TestServerVolumeAttachmentScenario-1041667837 tempest-TestServerVolumeAttachmentScenario-1041667837-project-member] [instance: 764de1b0-b77f-457a-8355-e5cdc1f6eab1] Calling os-brick to attach iSCSI Volume {{(pid=75229) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 10:07:48 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fe47858-26c1-4c9e-93f6-bfb6122694ae tempest-TestServerVolumeAttachmentScenario-1041667837 tempest-TestServerVolumeAttachmentScenario-1041667837-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f73f85151b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a8186f4e-9d39-4451-8fb5-1cee648efe1a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UYzrvaCH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 10:07:48 user nova-compute[75229]: WARNING os_brick.initiator.connectors.base [None req-1fe47858-26c1-4c9e-93f6-bfb6122694ae tempest-TestServerVolumeAttachmentScenario-1041667837 tempest-TestServerVolumeAttachmentScenario-1041667837-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 10:07:48 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-1fe47858-26c1-4c9e-93f6-bfb6122694ae tempest-TestServerVolumeAttachmentScenario-1041667837 tempest-TestServerVolumeAttachmentScenario-1041667837-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 10:07:48 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-1fe47858-26c1-4c9e-93f6-bfb6122694ae tempest-TestServerVolumeAttachmentScenario-1041667837 tempest-TestServerVolumeAttachmentScenario-1041667837-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 10:07:48 user nova-compute[75229]: WARNING os_brick.initiator.connectors.base [None req-1fe47858-26c1-4c9e-93f6-bfb6122694ae tempest-TestServerVolumeAttachmentScenario-1041667837 tempest-TestServerVolumeAttachmentScenario-1041667837-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 10:07:48 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-1fe47858-26c1-4c9e-93f6-bfb6122694ae tempest-TestServerVolumeAttachmentScenario-1041667837 tempest-TestServerVolumeAttachmentScenario-1041667837-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a8186f4e-9d39-4451-8fb5-1cee648efe1a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 10:07:48 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-1fe47858-26c1-4c9e-93f6-bfb6122694ae tempest-TestServerVolumeAttachmentScenario-1041667837 tempest-TestServerVolumeAttachmentScenario-1041667837-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a8186f4e-9d39-4451-8fb5-1cee648efe1a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 10:07:48 user nova-compute[75229]: INFO os_brick.initiator.connectors.iscsi [None req-1fe47858-26c1-4c9e-93f6-bfb6122694ae tempest-TestServerVolumeAttachmentScenario-1041667837 tempest-TestServerVolumeAttachmentScenario-1041667837-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 10:07:48 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8186f4e-9d39-4451-8fb5-1cee648efe1a -p 172.16.0.220:3260 {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:07:48 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8186f4e-9d39-4451-8fb5-1cee648efe1a -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:07:48 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[59f346d3-6cfb-4c5a-8a6b-db0caff16321]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:07:48 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fe47858-26c1-4c9e-93f6-bfb6122694ae tempest-TestServerVolumeAttachmentScenario-1041667837 tempest-TestServerVolumeAttachmentScenario-1041667837-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 10:07:48 user nova-compute[75229]:  {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 10:07:48 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8186f4e-9d39-4451-8fb5-1cee648efe1a -p 172.16.0.220:3260 --interface default --op new {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:07:48 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8186f4e-9d39-4451-8fb5-1cee648efe1a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:07:48 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[23ae4a68-d31f-4a21-bc91-979ce94e8bc6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a8186f4e-9d39-4451-8fb5-1cee648efe1a] added\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:07:48 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fe47858-26c1-4c9e-93f6-bfb6122694ae tempest-TestServerVolumeAttachmentScenario-1041667837 tempest-TestServerVolumeAttachmentScenario-1041667837-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a8186f4e-9d39-4451-8fb5-1cee648efe1a] added
Nov 14 10:07:48 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 10:07:48 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8186f4e-9d39-4451-8fb5-1cee648efe1a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:07:48 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8186f4e-9d39-4451-8fb5-1cee648efe1a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:07:48 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca202ab1-a579-47a6-b6ec-7de267f109a0]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:07:48 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fe47858-26c1-4c9e-93f6-bfb6122694ae tempest-TestServerVolumeAttachmentScenario-1041667837 tempest-TestServerVolumeAttachmentScenario-1041667837-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 10:07:48 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8186f4e-9d39-4451-8fb5-1cee648efe1a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:07:48 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8186f4e-9d39-4451-8fb5-1cee648efe1a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:07:48 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ae20ba7-30a2-49aa-94d1-d4e6a2962d51]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:07:48 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fe47858-26c1-4c9e-93f6-bfb6122694ae tempest-TestServerVolumeAttachmentScenario-1041667837 tempest-TestServerVolumeAttachmentScenario-1041667837-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 10:07:48 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8186f4e-9d39-4451-8fb5-1cee648efe1a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UYzrvaCH {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:07:48 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8186f4e-9d39-4451-8fb5-1cee648efe1a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UYzrvaCH" returned: 0 in 0.019s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:07:48 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c51347a-1dc5-4770-82a0-2aee1b268d64]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:07:48 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fe47858-26c1-4c9e-93f6-bfb6122694ae tempest-TestServerVolumeAttachmentScenario-1041667837 tempest-TestServerVolumeAttachmentScenario-1041667837-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UYzrvaCH'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 10:07:48 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8186f4e-9d39-4451-8fb5-1cee648efe1a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:07:48 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8186f4e-9d39-4451-8fb5-1cee648efe1a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:07:48 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[12473ec4-6e4b-44d5-a8aa-ccd58bec0401]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:07:48 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fe47858-26c1-4c9e-93f6-bfb6122694ae tempest-TestServerVolumeAttachmentScenario-1041667837 tempest-TestServerVolumeAttachmentScenario-1041667837-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 10:07:48 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:07:48 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:07:48 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[588d9317-6069-411e-9433-e9142a94cacd]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aebc438-0289-44fe-ad84-4e696468f50e (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7aee6091-dab3-4c39-88a1-4bbb28dcab45 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8892c7d-49e8-4f65-b88c-1e14fba8f50a (non-flash)\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:07:48 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fe47858-26c1-4c9e-93f6-bfb6122694ae tempest-TestServerVolumeAttachmentScenario-1041667837 tempest-TestServerVolumeAttachmentScenario-1041667837-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aebc438-0289-44fe-ad84-4e696468f50e (non-flash)
Nov 14 10:07:48 user nova-compute[75229]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7aee6091-dab3-4c39-88a1-4bbb28dcab45 (non-flash)
Nov 14 10:07:48 user nova-compute[75229]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8892c7d-49e8-4f65-b88c-1e14fba8f50a (non-flash)
Nov 14 10:07:48 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 10:07:48 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fe47858-26c1-4c9e-93f6-bfb6122694ae tempest-TestServerVolumeAttachmentScenario-1041667837 tempest-TestServerVolumeAttachmentScenario-1041667837-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aebc438-0289-44fe-ad84-4e696468f50e (non-flash)
Nov 14 10:07:48 user nova-compute[75229]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7aee6091-dab3-4c39-88a1-4bbb28dcab45 (non-flash)
Nov 14 10:07:48 user nova-compute[75229]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8892c7d-49e8-4f65-b88c-1e14fba8f50a (non-flash)
Nov 14 10:07:48 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 10:07:48 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8186f4e-9d39-4451-8fb5-1cee648efe1a -p 172.16.0.220:3260 --login {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:07:48 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8186f4e-9d39-4451-8fb5-1cee648efe1a -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:07:48 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[21a2b7f5-c456-48d7-9437-642be2b125a1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a8186f4e-9d39-4451-8fb5-1cee648efe1a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a8186f4e-9d39-4451-8fb5-1cee648efe1a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:07:48 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fe47858-26c1-4c9e-93f6-bfb6122694ae tempest-TestServerVolumeAttachmentScenario-1041667837 tempest-TestServerVolumeAttachmentScenario-1041667837-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a8186f4e-9d39-4451-8fb5-1cee648efe1a, portal: 172.16.0.220,3260]
Nov 14 10:07:48 user nova-compute[75229]: Login to [iface: default, target: iqn.2010-10.org.openstack:a8186f4e-9d39-4451-8fb5-1cee648efe1a, portal: 172.16.0.220,3260] successful.
Nov 14 10:07:48 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 10:07:48 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8186f4e-9d39-4451-8fb5-1cee648efe1a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:07:48 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8186f4e-9d39-4451-8fb5-1cee648efe1a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:07:48 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[73554d36-8bb1-43b8-b5b4-e29e648d3a6c]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:07:48 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fe47858-26c1-4c9e-93f6-bfb6122694ae tempest-TestServerVolumeAttachmentScenario-1041667837 tempest-TestServerVolumeAttachmentScenario-1041667837-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 10:07:48 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:07:48 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:07:48 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dee9a8a-ac30-49ff-bdaf-2f878137ae2a]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aebc438-0289-44fe-ad84-4e696468f50e (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7aee6091-dab3-4c39-88a1-4bbb28dcab45 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8892c7d-49e8-4f65-b88c-1e14fba8f50a (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8186f4e-9d39-4451-8fb5-1cee648efe1a (non-flash)\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:07:48 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fe47858-26c1-4c9e-93f6-bfb6122694ae tempest-TestServerVolumeAttachmentScenario-1041667837 tempest-TestServerVolumeAttachmentScenario-1041667837-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aebc438-0289-44fe-ad84-4e696468f50e (non-flash)
Nov 14 10:07:48 user nova-compute[75229]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7aee6091-dab3-4c39-88a1-4bbb28dcab45 (non-flash)
Nov 14 10:07:48 user nova-compute[75229]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8892c7d-49e8-4f65-b88c-1e14fba8f50a (non-flash)
Nov 14 10:07:48 user nova-compute[75229]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8186f4e-9d39-4451-8fb5-1cee648efe1a (non-flash)
Nov 14 10:07:48 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 10:07:48 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fe47858-26c1-4c9e-93f6-bfb6122694ae tempest-TestServerVolumeAttachmentScenario-1041667837 tempest-TestServerVolumeAttachmentScenario-1041667837-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aebc438-0289-44fe-ad84-4e696468f50e (non-flash)
Nov 14 10:07:48 user nova-compute[75229]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7aee6091-dab3-4c39-88a1-4bbb28dcab45 (non-flash)
Nov 14 10:07:48 user nova-compute[75229]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8892c7d-49e8-4f65-b88c-1e14fba8f50a (non-flash)
Nov 14 10:07:48 user nova-compute[75229]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8186f4e-9d39-4451-8fb5-1cee648efe1a (non-flash)
Nov 14 10:07:48 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 10:07:48 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-1fe47858-26c1-4c9e-93f6-bfb6122694ae tempest-TestServerVolumeAttachmentScenario-1041667837 tempest-TestServerVolumeAttachmentScenario-1041667837-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a8186f4e-9d39-4451-8fb5-1cee648efe1a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.276s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 10:07:48 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fe47858-26c1-4c9e-93f6-bfb6122694ae tempest-TestServerVolumeAttachmentScenario-1041667837 tempest-TestServerVolumeAttachmentScenario-1041667837-project-member] Connected to 172.16.0.220:3260 {{(pid=75229) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 10:07:48 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-1fe47858-26c1-4c9e-93f6-bfb6122694ae tempest-TestServerVolumeAttachmentScenario-1041667837 tempest-TestServerVolumeAttachmentScenario-1041667837-project-member] HCTL ('33', '-', '-', 0) found on session 50 with lun 0 {{(pid=75229) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 10:07:48 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-1fe47858-26c1-4c9e-93f6-bfb6122694ae tempest-TestServerVolumeAttachmentScenario-1041667837 tempest-TestServerVolumeAttachmentScenario-1041667837-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75229) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 10:07:48 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:07:48 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:07:48 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[b358851d-5d56-4fd7-976f-5045cd0dbd73]: (4, ('- - 0', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:07:48 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-1fe47858-26c1-4c9e-93f6-bfb6122694ae tempest-TestServerVolumeAttachmentScenario-1041667837 tempest-TestServerVolumeAttachmentScenario-1041667837-project-member] Searching for a device in session 50 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75229) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 10:07:48 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fe47858-26c1-4c9e-93f6-bfb6122694ae tempest-TestServerVolumeAttachmentScenario-1041667837 tempest-TestServerVolumeAttachmentScenario-1041667837-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:a8186f4e-9d39-4451-8fb5-1cee648efe1a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UYzrvaCH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75229) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 10:07:48 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:07:48 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:07:49 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-1fe47858-26c1-4c9e-93f6-bfb6122694ae tempest-TestServerVolumeAttachmentScenario-1041667837 tempest-TestServerVolumeAttachmentScenario-1041667837-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.311s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 10:07:49 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fe47858-26c1-4c9e-93f6-bfb6122694ae tempest-TestServerVolumeAttachmentScenario-1041667837 tempest-TestServerVolumeAttachmentScenario-1041667837-project-member] <== connect_volume: return (1314ms) {'type': 'block', 'scsi_wwn': '23063376562343866', 'path': '/dev/sdb'} {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 10:07:49 user nova-compute[75229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1fe47858-26c1-4c9e-93f6-bfb6122694ae tempest-TestServerVolumeAttachmentScenario-1041667837 tempest-TestServerVolumeAttachmentScenario-1041667837-project-member] [instance: 764de1b0-b77f-457a-8355-e5cdc1f6eab1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23063376562343866', 'path': '/dev/sdb'} {{(pid=75229) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 10:07:49 user nova-compute[75229]: DEBUG nova.objects.instance [None req-1fe47858-26c1-4c9e-93f6-bfb6122694ae tempest-TestServerVolumeAttachmentScenario-1041667837 tempest-TestServerVolumeAttachmentScenario-1041667837-project-member] Lazy-loading 'flavor' on Instance uuid 764de1b0-b77f-457a-8355-e5cdc1f6eab1 {{(pid=75229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 10:07:49 user nova-compute[75229]: DEBUG nova.virt.libvirt.guest [None req-1fe47858-26c1-4c9e-93f6-bfb6122694ae tempest-TestServerVolumeAttachmentScenario-1041667837 tempest-TestServerVolumeAttachmentScenario-1041667837-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 10:07:49 user nova-compute[75229]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 10:07:49 user nova-compute[75229]:   <source dev="/dev/sdb"/>
Nov 14 10:07:49 user nova-compute[75229]:   <target dev="vdb" bus="virtio"/>
Nov 14 10:07:49 user nova-compute[75229]:   <serial>a8186f4e-9d39-4451-8fb5-1cee648efe1a</serial>
Nov 14 10:07:49 user nova-compute[75229]: </disk>
Nov 14 10:07:49 user nova-compute[75229]:  {{(pid=75229) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 10:07:49 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-1fe47858-26c1-4c9e-93f6-bfb6122694ae tempest-TestServerVolumeAttachmentScenario-1041667837 tempest-TestServerVolumeAttachmentScenario-1041667837-project-member] No BDM found with device name vda, not building metadata. {{(pid=75229) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 10:07:49 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-1fe47858-26c1-4c9e-93f6-bfb6122694ae tempest-TestServerVolumeAttachmentScenario-1041667837 tempest-TestServerVolumeAttachmentScenario-1041667837-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75229) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 10:07:49 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-1fe47858-26c1-4c9e-93f6-bfb6122694ae tempest-TestServerVolumeAttachmentScenario-1041667837 tempest-TestServerVolumeAttachmentScenario-1041667837-project-member] No VIF found with MAC fa:16:3e:75:4a:25, not building metadata {{(pid=75229) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 10:07:49 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-1fe47858-26c1-4c9e-93f6-bfb6122694ae tempest-TestServerVolumeAttachmentScenario-1041667837 tempest-TestServerVolumeAttachmentScenario-1041667837-project-member] Lock "764de1b0-b77f-457a-8355-e5cdc1f6eab1" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.498s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:07:52 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:07:53 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-b9846d10-8398-404a-ae2b-d29190e49263 tempest-TestServerVolumeAttachmentScenario-1041667837 tempest-TestServerVolumeAttachmentScenario-1041667837-project-member] Acquiring lock "764de1b0-b77f-457a-8355-e5cdc1f6eab1" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:07:53 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-b9846d10-8398-404a-ae2b-d29190e49263 tempest-TestServerVolumeAttachmentScenario-1041667837 tempest-TestServerVolumeAttachmentScenario-1041667837-project-member] Lock "764de1b0-b77f-457a-8355-e5cdc1f6eab1" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:07:53 user nova-compute[75229]: DEBUG nova.objects.instance [None req-b9846d10-8398-404a-ae2b-d29190e49263 tempest-TestServerVolumeAttachmentScenario-1041667837 tempest-TestServerVolumeAttachmentScenario-1041667837-project-member] Lazy-loading 'flavor' on Instance uuid 764de1b0-b77f-457a-8355-e5cdc1f6eab1 {{(pid=75229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 10:07:53 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-b9846d10-8398-404a-ae2b-d29190e49263 tempest-TestServerVolumeAttachmentScenario-1041667837 tempest-TestServerVolumeAttachmentScenario-1041667837-project-member] Lock "764de1b0-b77f-457a-8355-e5cdc1f6eab1" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:07:53 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-b9846d10-8398-404a-ae2b-d29190e49263 tempest-TestServerVolumeAttachmentScenario-1041667837 tempest-TestServerVolumeAttachmentScenario-1041667837-project-member] Acquiring lock "764de1b0-b77f-457a-8355-e5cdc1f6eab1" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:07:53 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-b9846d10-8398-404a-ae2b-d29190e49263 tempest-TestServerVolumeAttachmentScenario-1041667837 tempest-TestServerVolumeAttachmentScenario-1041667837-project-member] Lock "764de1b0-b77f-457a-8355-e5cdc1f6eab1" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:07:53 user nova-compute[75229]: INFO nova.compute.manager [None req-b9846d10-8398-404a-ae2b-d29190e49263 tempest-TestServerVolumeAttachmentScenario-1041667837 tempest-TestServerVolumeAttachmentScenario-1041667837-project-member] [instance: 764de1b0-b77f-457a-8355-e5cdc1f6eab1] Attaching volume 4758060c-13b4-4aad-b2e4-19aadfa39dd1 to /dev/vdc
Nov 14 10:07:53 user nova-compute[75229]: DEBUG os_brick.utils [None req-b9846d10-8398-404a-ae2b-d29190e49263 tempest-TestServerVolumeAttachmentScenario-1041667837 tempest-TestServerVolumeAttachmentScenario-1041667837-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 10:07:53 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:07:53 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:07:53 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2876c64-81da-4f69-b8c8-3cc4bdeab0bc]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f1154031c835\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:07:53 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:07:53 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:07:53 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[773e473d-18a1-4c91-9ca8-ea0c652e100b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:07:53 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:07:53 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:07:53 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[93e33b0b-1584-4cd4-b9b1-86c9f4ed59d6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:07:53 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[629425e9-695f-4dd8-b381-7c7158b313d2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:07:53 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-b9846d10-8398-404a-ae2b-d29190e49263 tempest-TestServerVolumeAttachmentScenario-1041667837 tempest-TestServerVolumeAttachmentScenario-1041667837-project-member] Running cmd (subprocess): nvme version {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:07:53 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-b9846d10-8398-404a-ae2b-d29190e49263 tempest-TestServerVolumeAttachmentScenario-1041667837 tempest-TestServerVolumeAttachmentScenario-1041667837-project-member] 'nvme version' failed. Not Retrying. {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 10:07:53 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b9846d10-8398-404a-ae2b-d29190e49263 tempest-TestServerVolumeAttachmentScenario-1041667837 tempest-TestServerVolumeAttachmentScenario-1041667837-project-member] nvme not present on system {{(pid=75229) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 10:07:53 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:07:53 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 10:07:53 user nova-compute[75229]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 10:07:53 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[39696d98-ae50-4305-afc1-1e4c4e03df27]: (4, '') {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:07:53 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.lightos [None req-b9846d10-8398-404a-ae2b-d29190e49263 tempest-TestServerVolumeAttachmentScenario-1041667837 tempest-TestServerVolumeAttachmentScenario-1041667837-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75229) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 10:07:53 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.lightos [None req-b9846d10-8398-404a-ae2b-d29190e49263 tempest-TestServerVolumeAttachmentScenario-1041667837 tempest-TestServerVolumeAttachmentScenario-1041667837-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75229) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 10:07:53 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.lightos [None req-b9846d10-8398-404a-ae2b-d29190e49263 tempest-TestServerVolumeAttachmentScenario-1041667837 tempest-TestServerVolumeAttachmentScenario-1041667837-project-member] LIGHTOS: no hostnqn found. {{(pid=75229) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 10:07:53 user nova-compute[75229]: DEBUG os_brick.utils [None req-b9846d10-8398-404a-ae2b-d29190e49263 tempest-TestServerVolumeAttachmentScenario-1041667837 tempest-TestServerVolumeAttachmentScenario-1041667837-project-member] <== get_connector_properties: return (113ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f1154031c835', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 10:07:53 user nova-compute[75229]: DEBUG nova.virt.block_device [None req-b9846d10-8398-404a-ae2b-d29190e49263 tempest-TestServerVolumeAttachmentScenario-1041667837 tempest-TestServerVolumeAttachmentScenario-1041667837-project-member] [instance: 764de1b0-b77f-457a-8355-e5cdc1f6eab1] Updating existing volume attachment record: 8402d5cf-6cf1-447f-a01c-a09952fbebd2 {{(pid=75229) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 10:07:53 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:07:57 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:07:57 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:07:58 user nova-compute[75229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b9846d10-8398-404a-ae2b-d29190e49263 tempest-TestServerVolumeAttachmentScenario-1041667837 tempest-TestServerVolumeAttachmentScenario-1041667837-project-member] [instance: 764de1b0-b77f-457a-8355-e5cdc1f6eab1] Calling os-brick to attach iSCSI Volume {{(pid=75229) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 10:07:58 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9846d10-8398-404a-ae2b-d29190e49263 tempest-TestServerVolumeAttachmentScenario-1041667837 tempest-TestServerVolumeAttachmentScenario-1041667837-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f73f85151b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4758060c-13b4-4aad-b2e4-19aadfa39dd1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CxhGfTEo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 10:07:58 user nova-compute[75229]: WARNING os_brick.initiator.connectors.base [None req-b9846d10-8398-404a-ae2b-d29190e49263 tempest-TestServerVolumeAttachmentScenario-1041667837 tempest-TestServerVolumeAttachmentScenario-1041667837-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 10:07:58 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-b9846d10-8398-404a-ae2b-d29190e49263 tempest-TestServerVolumeAttachmentScenario-1041667837 tempest-TestServerVolumeAttachmentScenario-1041667837-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 10:07:58 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-b9846d10-8398-404a-ae2b-d29190e49263 tempest-TestServerVolumeAttachmentScenario-1041667837 tempest-TestServerVolumeAttachmentScenario-1041667837-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 10:07:58 user nova-compute[75229]: WARNING os_brick.initiator.connectors.base [None req-b9846d10-8398-404a-ae2b-d29190e49263 tempest-TestServerVolumeAttachmentScenario-1041667837 tempest-TestServerVolumeAttachmentScenario-1041667837-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 10:07:58 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-b9846d10-8398-404a-ae2b-d29190e49263 tempest-TestServerVolumeAttachmentScenario-1041667837 tempest-TestServerVolumeAttachmentScenario-1041667837-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4758060c-13b4-4aad-b2e4-19aadfa39dd1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 10:07:58 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-b9846d10-8398-404a-ae2b-d29190e49263 tempest-TestServerVolumeAttachmentScenario-1041667837 tempest-TestServerVolumeAttachmentScenario-1041667837-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4758060c-13b4-4aad-b2e4-19aadfa39dd1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 10:07:58 user nova-compute[75229]: INFO os_brick.initiator.connectors.iscsi [None req-b9846d10-8398-404a-ae2b-d29190e49263 tempest-TestServerVolumeAttachmentScenario-1041667837 tempest-TestServerVolumeAttachmentScenario-1041667837-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 10:07:58 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4758060c-13b4-4aad-b2e4-19aadfa39dd1 -p 172.16.0.220:3260 {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:07:58 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4758060c-13b4-4aad-b2e4-19aadfa39dd1 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:07:58 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[fef815d1-5f30-4fff-92d0-c2a56fcdfc07]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:07:58 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9846d10-8398-404a-ae2b-d29190e49263 tempest-TestServerVolumeAttachmentScenario-1041667837 tempest-TestServerVolumeAttachmentScenario-1041667837-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 10:07:58 user nova-compute[75229]:  {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 10:07:58 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4758060c-13b4-4aad-b2e4-19aadfa39dd1 -p 172.16.0.220:3260 --interface default --op new {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:07:58 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4758060c-13b4-4aad-b2e4-19aadfa39dd1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:07:58 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[32e650cf-269f-45a5-8674-b25d5587db42]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4758060c-13b4-4aad-b2e4-19aadfa39dd1] added\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:07:58 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9846d10-8398-404a-ae2b-d29190e49263 tempest-TestServerVolumeAttachmentScenario-1041667837 tempest-TestServerVolumeAttachmentScenario-1041667837-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4758060c-13b4-4aad-b2e4-19aadfa39dd1] added
Nov 14 10:07:58 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 10:07:58 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4758060c-13b4-4aad-b2e4-19aadfa39dd1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:07:58 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4758060c-13b4-4aad-b2e4-19aadfa39dd1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:07:58 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[287f2155-eb23-45cd-9fca-234dbbf6f563]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:07:58 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9846d10-8398-404a-ae2b-d29190e49263 tempest-TestServerVolumeAttachmentScenario-1041667837 tempest-TestServerVolumeAttachmentScenario-1041667837-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 10:07:58 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4758060c-13b4-4aad-b2e4-19aadfa39dd1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:07:58 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4758060c-13b4-4aad-b2e4-19aadfa39dd1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:07:58 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[a21ad8b9-38ae-4b62-af9a-3170300a993d]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:07:58 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9846d10-8398-404a-ae2b-d29190e49263 tempest-TestServerVolumeAttachmentScenario-1041667837 tempest-TestServerVolumeAttachmentScenario-1041667837-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 10:07:58 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4758060c-13b4-4aad-b2e4-19aadfa39dd1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CxhGfTEo {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:07:58 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4758060c-13b4-4aad-b2e4-19aadfa39dd1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CxhGfTEo" returned: 0 in 0.021s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:07:58 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[2baa8326-0cce-4ba4-9216-b979c2ddbac3]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:07:58 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9846d10-8398-404a-ae2b-d29190e49263 tempest-TestServerVolumeAttachmentScenario-1041667837 tempest-TestServerVolumeAttachmentScenario-1041667837-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'CxhGfTEo'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 10:07:58 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4758060c-13b4-4aad-b2e4-19aadfa39dd1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:07:58 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4758060c-13b4-4aad-b2e4-19aadfa39dd1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:07:58 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[a174fe1a-df2b-4a74-b960-9351241eda77]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:07:58 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9846d10-8398-404a-ae2b-d29190e49263 tempest-TestServerVolumeAttachmentScenario-1041667837 tempest-TestServerVolumeAttachmentScenario-1041667837-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 10:07:58 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:07:58 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:07:58 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ae2d525-0eae-4927-aba0-766f06a8d248]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aebc438-0289-44fe-ad84-4e696468f50e (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7aee6091-dab3-4c39-88a1-4bbb28dcab45 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8892c7d-49e8-4f65-b88c-1e14fba8f50a (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8186f4e-9d39-4451-8fb5-1cee648efe1a (non-flash)\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:07:58 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9846d10-8398-404a-ae2b-d29190e49263 tempest-TestServerVolumeAttachmentScenario-1041667837 tempest-TestServerVolumeAttachmentScenario-1041667837-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aebc438-0289-44fe-ad84-4e696468f50e (non-flash)
Nov 14 10:07:58 user nova-compute[75229]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7aee6091-dab3-4c39-88a1-4bbb28dcab45 (non-flash)
Nov 14 10:07:58 user nova-compute[75229]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8892c7d-49e8-4f65-b88c-1e14fba8f50a (non-flash)
Nov 14 10:07:58 user nova-compute[75229]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8186f4e-9d39-4451-8fb5-1cee648efe1a (non-flash)
Nov 14 10:07:58 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 10:07:58 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9846d10-8398-404a-ae2b-d29190e49263 tempest-TestServerVolumeAttachmentScenario-1041667837 tempest-TestServerVolumeAttachmentScenario-1041667837-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aebc438-0289-44fe-ad84-4e696468f50e (non-flash)
Nov 14 10:07:58 user nova-compute[75229]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7aee6091-dab3-4c39-88a1-4bbb28dcab45 (non-flash)
Nov 14 10:07:58 user nova-compute[75229]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8892c7d-49e8-4f65-b88c-1e14fba8f50a (non-flash)
Nov 14 10:07:58 user nova-compute[75229]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8186f4e-9d39-4451-8fb5-1cee648efe1a (non-flash)
Nov 14 10:07:58 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 10:07:58 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4758060c-13b4-4aad-b2e4-19aadfa39dd1 -p 172.16.0.220:3260 --login {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:07:58 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4758060c-13b4-4aad-b2e4-19aadfa39dd1 -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:07:58 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[773f6e85-2527-4cb8-89d4-be5529b6cc59]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4758060c-13b4-4aad-b2e4-19aadfa39dd1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4758060c-13b4-4aad-b2e4-19aadfa39dd1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:07:58 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9846d10-8398-404a-ae2b-d29190e49263 tempest-TestServerVolumeAttachmentScenario-1041667837 tempest-TestServerVolumeAttachmentScenario-1041667837-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4758060c-13b4-4aad-b2e4-19aadfa39dd1, portal: 172.16.0.220,3260]
Nov 14 10:07:58 user nova-compute[75229]: Login to [iface: default, target: iqn.2010-10.org.openstack:4758060c-13b4-4aad-b2e4-19aadfa39dd1, portal: 172.16.0.220,3260] successful.
Nov 14 10:07:58 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 10:07:58 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4758060c-13b4-4aad-b2e4-19aadfa39dd1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:07:58 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4758060c-13b4-4aad-b2e4-19aadfa39dd1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:07:58 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab59d613-9c55-4b85-82d2-60eb3f64a941]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:07:58 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9846d10-8398-404a-ae2b-d29190e49263 tempest-TestServerVolumeAttachmentScenario-1041667837 tempest-TestServerVolumeAttachmentScenario-1041667837-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 10:07:58 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:07:58 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:07:58 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8601917-eb50-42b6-aadf-ac42e2cd4fba]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aebc438-0289-44fe-ad84-4e696468f50e (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7aee6091-dab3-4c39-88a1-4bbb28dcab45 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8892c7d-49e8-4f65-b88c-1e14fba8f50a (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8186f4e-9d39-4451-8fb5-1cee648efe1a (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4758060c-13b4-4aad-b2e4-19aadfa39dd1 (non-flash)\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:07:58 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9846d10-8398-404a-ae2b-d29190e49263 tempest-TestServerVolumeAttachmentScenario-1041667837 tempest-TestServerVolumeAttachmentScenario-1041667837-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aebc438-0289-44fe-ad84-4e696468f50e (non-flash)
Nov 14 10:07:58 user nova-compute[75229]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7aee6091-dab3-4c39-88a1-4bbb28dcab45 (non-flash)
Nov 14 10:07:58 user nova-compute[75229]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8892c7d-49e8-4f65-b88c-1e14fba8f50a (non-flash)
Nov 14 10:07:58 user nova-compute[75229]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8186f4e-9d39-4451-8fb5-1cee648efe1a (non-flash)
Nov 14 10:07:58 user nova-compute[75229]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4758060c-13b4-4aad-b2e4-19aadfa39dd1 (non-flash)
Nov 14 10:07:58 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 10:07:58 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9846d10-8398-404a-ae2b-d29190e49263 tempest-TestServerVolumeAttachmentScenario-1041667837 tempest-TestServerVolumeAttachmentScenario-1041667837-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aebc438-0289-44fe-ad84-4e696468f50e (non-flash)
Nov 14 10:07:58 user nova-compute[75229]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7aee6091-dab3-4c39-88a1-4bbb28dcab45 (non-flash)
Nov 14 10:07:58 user nova-compute[75229]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8892c7d-49e8-4f65-b88c-1e14fba8f50a (non-flash)
Nov 14 10:07:58 user nova-compute[75229]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8186f4e-9d39-4451-8fb5-1cee648efe1a (non-flash)
Nov 14 10:07:58 user nova-compute[75229]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4758060c-13b4-4aad-b2e4-19aadfa39dd1 (non-flash)
Nov 14 10:07:58 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 10:07:58 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-b9846d10-8398-404a-ae2b-d29190e49263 tempest-TestServerVolumeAttachmentScenario-1041667837 tempest-TestServerVolumeAttachmentScenario-1041667837-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4758060c-13b4-4aad-b2e4-19aadfa39dd1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.286s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 10:07:58 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9846d10-8398-404a-ae2b-d29190e49263 tempest-TestServerVolumeAttachmentScenario-1041667837 tempest-TestServerVolumeAttachmentScenario-1041667837-project-member] Connected to 172.16.0.220:3260 {{(pid=75229) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 10:07:58 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-b9846d10-8398-404a-ae2b-d29190e49263 tempest-TestServerVolumeAttachmentScenario-1041667837 tempest-TestServerVolumeAttachmentScenario-1041667837-project-member] HCTL ('36', '-', '-', 0) found on session 51 with lun 0 {{(pid=75229) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 10:07:58 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-b9846d10-8398-404a-ae2b-d29190e49263 tempest-TestServerVolumeAttachmentScenario-1041667837 tempest-TestServerVolumeAttachmentScenario-1041667837-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75229) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 10:07:58 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:07:58 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.020s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:07:58 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[99ad43ac-a874-4cef-bfd5-c2c4276285f1]: (4, ('- - 0', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:07:58 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-b9846d10-8398-404a-ae2b-d29190e49263 tempest-TestServerVolumeAttachmentScenario-1041667837 tempest-TestServerVolumeAttachmentScenario-1041667837-project-member] Searching for a device in session 51 and hctl ['36', '*', '*', 0] yield: None {{(pid=75229) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 10:07:58 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:07:59 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-b9846d10-8398-404a-ae2b-d29190e49263 tempest-TestServerVolumeAttachmentScenario-1041667837 tempest-TestServerVolumeAttachmentScenario-1041667837-project-member] Searching for a device in session 51 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75229) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 10:07:59 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9846d10-8398-404a-ae2b-d29190e49263 tempest-TestServerVolumeAttachmentScenario-1041667837 tempest-TestServerVolumeAttachmentScenario-1041667837-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:4758060c-13b4-4aad-b2e4-19aadfa39dd1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CxhGfTEo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75229) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 10:07:59 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-b9846d10-8398-404a-ae2b-d29190e49263 tempest-TestServerVolumeAttachmentScenario-1041667837 tempest-TestServerVolumeAttachmentScenario-1041667837-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.320s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 10:07:59 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9846d10-8398-404a-ae2b-d29190e49263 tempest-TestServerVolumeAttachmentScenario-1041667837 tempest-TestServerVolumeAttachmentScenario-1041667837-project-member] <== connect_volume: return (1321ms) {'type': 'block', 'scsi_wwn': '23063663130383365', 'path': '/dev/sde'} {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 10:07:59 user nova-compute[75229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b9846d10-8398-404a-ae2b-d29190e49263 tempest-TestServerVolumeAttachmentScenario-1041667837 tempest-TestServerVolumeAttachmentScenario-1041667837-project-member] [instance: 764de1b0-b77f-457a-8355-e5cdc1f6eab1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23063663130383365', 'path': '/dev/sde'} {{(pid=75229) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 10:07:59 user nova-compute[75229]: DEBUG nova.objects.instance [None req-b9846d10-8398-404a-ae2b-d29190e49263 tempest-TestServerVolumeAttachmentScenario-1041667837 tempest-TestServerVolumeAttachmentScenario-1041667837-project-member] Lazy-loading 'flavor' on Instance uuid 764de1b0-b77f-457a-8355-e5cdc1f6eab1 {{(pid=75229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 10:07:59 user nova-compute[75229]: DEBUG nova.virt.libvirt.guest [None req-b9846d10-8398-404a-ae2b-d29190e49263 tempest-TestServerVolumeAttachmentScenario-1041667837 tempest-TestServerVolumeAttachmentScenario-1041667837-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 10:07:59 user nova-compute[75229]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 10:07:59 user nova-compute[75229]:   <source dev="/dev/sde"/>
Nov 14 10:07:59 user nova-compute[75229]:   <target dev="vdc" bus="virtio"/>
Nov 14 10:07:59 user nova-compute[75229]:   <serial>4758060c-13b4-4aad-b2e4-19aadfa39dd1</serial>
Nov 14 10:07:59 user nova-compute[75229]: </disk>
Nov 14 10:07:59 user nova-compute[75229]:  {{(pid=75229) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 10:07:59 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-b9846d10-8398-404a-ae2b-d29190e49263 tempest-TestServerVolumeAttachmentScenario-1041667837 tempest-TestServerVolumeAttachmentScenario-1041667837-project-member] No BDM found with device name vda, not building metadata. {{(pid=75229) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 10:07:59 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-b9846d10-8398-404a-ae2b-d29190e49263 tempest-TestServerVolumeAttachmentScenario-1041667837 tempest-TestServerVolumeAttachmentScenario-1041667837-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75229) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 10:07:59 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-b9846d10-8398-404a-ae2b-d29190e49263 tempest-TestServerVolumeAttachmentScenario-1041667837 tempest-TestServerVolumeAttachmentScenario-1041667837-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75229) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 10:07:59 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-b9846d10-8398-404a-ae2b-d29190e49263 tempest-TestServerVolumeAttachmentScenario-1041667837 tempest-TestServerVolumeAttachmentScenario-1041667837-project-member] No VIF found with MAC fa:16:3e:75:4a:25, not building metadata {{(pid=75229) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 10:07:59 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-b9846d10-8398-404a-ae2b-d29190e49263 tempest-TestServerVolumeAttachmentScenario-1041667837 tempest-TestServerVolumeAttachmentScenario-1041667837-project-member] Lock "764de1b0-b77f-457a-8355-e5cdc1f6eab1" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.350s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:08:00 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-48b4c5aa-fd48-469e-94f8-741e75e74750 tempest-TestServerVolumeAttachmentScenario-1041667837 tempest-TestServerVolumeAttachmentScenario-1041667837-project-member] Acquiring lock "764de1b0-b77f-457a-8355-e5cdc1f6eab1" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:08:00 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-48b4c5aa-fd48-469e-94f8-741e75e74750 tempest-TestServerVolumeAttachmentScenario-1041667837 tempest-TestServerVolumeAttachmentScenario-1041667837-project-member] Lock "764de1b0-b77f-457a-8355-e5cdc1f6eab1" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:08:00 user nova-compute[75229]: INFO nova.compute.manager [None req-48b4c5aa-fd48-469e-94f8-741e75e74750 tempest-TestServerVolumeAttachmentScenario-1041667837 tempest-TestServerVolumeAttachmentScenario-1041667837-project-member] [instance: 764de1b0-b77f-457a-8355-e5cdc1f6eab1] Detaching volume 4758060c-13b4-4aad-b2e4-19aadfa39dd1
Nov 14 10:08:00 user nova-compute[75229]: INFO nova.virt.block_device [None req-48b4c5aa-fd48-469e-94f8-741e75e74750 tempest-TestServerVolumeAttachmentScenario-1041667837 tempest-TestServerVolumeAttachmentScenario-1041667837-project-member] [instance: 764de1b0-b77f-457a-8355-e5cdc1f6eab1] Attempting to driver detach volume 4758060c-13b4-4aad-b2e4-19aadfa39dd1 from mountpoint /dev/vdc
Nov 14 10:08:00 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-48b4c5aa-fd48-469e-94f8-741e75e74750 tempest-TestServerVolumeAttachmentScenario-1041667837 tempest-TestServerVolumeAttachmentScenario-1041667837-project-member] Attempting to detach device vdc from instance 764de1b0-b77f-457a-8355-e5cdc1f6eab1 from the persistent domain config. {{(pid=75229) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 10:08:00 user nova-compute[75229]: DEBUG nova.virt.libvirt.guest [None req-48b4c5aa-fd48-469e-94f8-741e75e74750 tempest-TestServerVolumeAttachmentScenario-1041667837 tempest-TestServerVolumeAttachmentScenario-1041667837-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 10:08:00 user nova-compute[75229]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 10:08:00 user nova-compute[75229]:   <source dev="/dev/sde"/>
Nov 14 10:08:00 user nova-compute[75229]:   <target dev="vdc" bus="virtio"/>
Nov 14 10:08:00 user nova-compute[75229]:   <serial>4758060c-13b4-4aad-b2e4-19aadfa39dd1</serial>
Nov 14 10:08:00 user nova-compute[75229]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 14 10:08:00 user nova-compute[75229]: </disk>
Nov 14 10:08:00 user nova-compute[75229]:  {{(pid=75229) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 10:08:00 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-48b4c5aa-fd48-469e-94f8-741e75e74750 tempest-TestServerVolumeAttachmentScenario-1041667837 tempest-TestServerVolumeAttachmentScenario-1041667837-project-member] Successfully detached device vdc from instance 764de1b0-b77f-457a-8355-e5cdc1f6eab1 from the persistent domain config.
Nov 14 10:08:00 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-48b4c5aa-fd48-469e-94f8-741e75e74750 tempest-TestServerVolumeAttachmentScenario-1041667837 tempest-TestServerVolumeAttachmentScenario-1041667837-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 764de1b0-b77f-457a-8355-e5cdc1f6eab1 from the live domain config. {{(pid=75229) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 10:08:00 user nova-compute[75229]: DEBUG nova.virt.libvirt.guest [None req-48b4c5aa-fd48-469e-94f8-741e75e74750 tempest-TestServerVolumeAttachmentScenario-1041667837 tempest-TestServerVolumeAttachmentScenario-1041667837-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 10:08:00 user nova-compute[75229]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 10:08:00 user nova-compute[75229]:   <source dev="/dev/sde"/>
Nov 14 10:08:00 user nova-compute[75229]:   <target dev="vdc" bus="virtio"/>
Nov 14 10:08:00 user nova-compute[75229]:   <serial>4758060c-13b4-4aad-b2e4-19aadfa39dd1</serial>
Nov 14 10:08:00 user nova-compute[75229]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 14 10:08:00 user nova-compute[75229]: </disk>
Nov 14 10:08:00 user nova-compute[75229]:  {{(pid=75229) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 10:08:00 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-48b4c5aa-fd48-469e-94f8-741e75e74750 tempest-TestServerVolumeAttachmentScenario-1041667837 tempest-TestServerVolumeAttachmentScenario-1041667837-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 764de1b0-b77f-457a-8355-e5cdc1f6eab1 {{(pid=75229) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 10:08:01 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:08:01 user nova-compute[75229]: DEBUG nova.compute.manager [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Starting heal instance info cache {{(pid=75229) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 10:08:01 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Acquiring lock "refresh_cache-c1679275-ebb1-4f15-80a4-b8fd614fc34b" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 10:08:01 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Acquired lock "refresh_cache-c1679275-ebb1-4f15-80a4-b8fd614fc34b" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 10:08:01 user nova-compute[75229]: DEBUG nova.network.neutron [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] [instance: c1679275-ebb1-4f15-80a4-b8fd614fc34b] Forcefully refreshing network info cache for instance {{(pid=75229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 10:08:02 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:08:02 user nova-compute[75229]: DEBUG nova.network.neutron [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] [instance: c1679275-ebb1-4f15-80a4-b8fd614fc34b] Updating instance_info_cache with network_info: [{"id": "2a5dfb7a-fd65-41fc-9997-8c2d25ea44a7", "address": "fa:16:3e:1f:d7:f3", "network": {"id": "6a700b61-4aa6-440b-87e6-a3525a5cb918", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-448680331-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8babb73006da4977a1fe2bdb35e08d8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a5dfb7a-fd", "ovs_interfaceid": "2a5dfb7a-fd65-41fc-9997-8c2d25ea44a7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 10:08:02 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Releasing lock "refresh_cache-c1679275-ebb1-4f15-80a4-b8fd614fc34b" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 10:08:02 user nova-compute[75229]: DEBUG nova.compute.manager [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] [instance: c1679275-ebb1-4f15-80a4-b8fd614fc34b] Updated the network info_cache for instance {{(pid=75229) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 10:08:04 user nova-compute[75229]: DEBUG nova.compute.manager [req-cb25c470-95b0-43c2-af9e-2fc2c27871f3 req-0442c226-f073-4782-810d-6ff14c6db67a service nova] [instance: 752995bf-8e0a-4832-94d8-280ab786b997] Received event network-changed-55228da7-a50c-4f39-ae39-83aeec11a818 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 10:08:04 user nova-compute[75229]: DEBUG nova.compute.manager [req-cb25c470-95b0-43c2-af9e-2fc2c27871f3 req-0442c226-f073-4782-810d-6ff14c6db67a service nova] [instance: 752995bf-8e0a-4832-94d8-280ab786b997] Refreshing instance network info cache due to event network-changed-55228da7-a50c-4f39-ae39-83aeec11a818. {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 10:08:04 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-cb25c470-95b0-43c2-af9e-2fc2c27871f3 req-0442c226-f073-4782-810d-6ff14c6db67a service nova] Acquiring lock "refresh_cache-752995bf-8e0a-4832-94d8-280ab786b997" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 10:08:04 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-cb25c470-95b0-43c2-af9e-2fc2c27871f3 req-0442c226-f073-4782-810d-6ff14c6db67a service nova] Acquired lock "refresh_cache-752995bf-8e0a-4832-94d8-280ab786b997" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 10:08:04 user nova-compute[75229]: DEBUG nova.network.neutron [req-cb25c470-95b0-43c2-af9e-2fc2c27871f3 req-0442c226-f073-4782-810d-6ff14c6db67a service nova] [instance: 752995bf-8e0a-4832-94d8-280ab786b997] Refreshing network info cache for port 55228da7-a50c-4f39-ae39-83aeec11a818 {{(pid=75229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 10:08:05 user nova-compute[75229]: DEBUG nova.network.neutron [req-cb25c470-95b0-43c2-af9e-2fc2c27871f3 req-0442c226-f073-4782-810d-6ff14c6db67a service nova] [instance: 752995bf-8e0a-4832-94d8-280ab786b997] Updated VIF entry in instance network info cache for port 55228da7-a50c-4f39-ae39-83aeec11a818. {{(pid=75229) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 10:08:05 user nova-compute[75229]: DEBUG nova.network.neutron [req-cb25c470-95b0-43c2-af9e-2fc2c27871f3 req-0442c226-f073-4782-810d-6ff14c6db67a service nova] [instance: 752995bf-8e0a-4832-94d8-280ab786b997] Updating instance_info_cache with network_info: [{"id": "55228da7-a50c-4f39-ae39-83aeec11a818", "address": "fa:16:3e:c4:53:33", "network": {"id": "118ea7c1-77c0-4660-b7b7-f311f6b0ec8a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1907578504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.77", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46620ac128944703899f22fe5439ba26", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55228da7-a5", "ovs_interfaceid": "55228da7-a50c-4f39-ae39-83aeec11a818", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 10:08:05 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-cb25c470-95b0-43c2-af9e-2fc2c27871f3 req-0442c226-f073-4782-810d-6ff14c6db67a service nova] Releasing lock "refresh_cache-752995bf-8e0a-4832-94d8-280ab786b997" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 10:08:05 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-be370f11-3c98-4a60-bca5-bc4646376d03 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Acquiring lock "752995bf-8e0a-4832-94d8-280ab786b997" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:08:05 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-be370f11-3c98-4a60-bca5-bc4646376d03 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Lock "752995bf-8e0a-4832-94d8-280ab786b997" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:08:05 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-be370f11-3c98-4a60-bca5-bc4646376d03 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Acquiring lock "752995bf-8e0a-4832-94d8-280ab786b997-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:08:05 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-be370f11-3c98-4a60-bca5-bc4646376d03 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Lock "752995bf-8e0a-4832-94d8-280ab786b997-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:08:05 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-be370f11-3c98-4a60-bca5-bc4646376d03 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Lock "752995bf-8e0a-4832-94d8-280ab786b997-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:08:05 user nova-compute[75229]: INFO nova.compute.manager [None req-be370f11-3c98-4a60-bca5-bc4646376d03 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] [instance: 752995bf-8e0a-4832-94d8-280ab786b997] Terminating instance
Nov 14 10:08:05 user nova-compute[75229]: DEBUG nova.compute.manager [None req-be370f11-3c98-4a60-bca5-bc4646376d03 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] [instance: 752995bf-8e0a-4832-94d8-280ab786b997] Start destroying the instance on the hypervisor. {{(pid=75229) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 10:08:05 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:08:05 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:08:05 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:08:05 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:08:05 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:08:05 user nova-compute[75229]: DEBUG nova.compute.manager [req-d77cedb5-42e2-455e-95a4-362dabdfa2e4 req-b68c2ab5-db1e-4f0d-9b83-7d89dae60835 service nova] [instance: 752995bf-8e0a-4832-94d8-280ab786b997] Received event network-vif-unplugged-55228da7-a50c-4f39-ae39-83aeec11a818 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 10:08:05 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-d77cedb5-42e2-455e-95a4-362dabdfa2e4 req-b68c2ab5-db1e-4f0d-9b83-7d89dae60835 service nova] Acquiring lock "752995bf-8e0a-4832-94d8-280ab786b997-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:08:05 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-d77cedb5-42e2-455e-95a4-362dabdfa2e4 req-b68c2ab5-db1e-4f0d-9b83-7d89dae60835 service nova] Lock "752995bf-8e0a-4832-94d8-280ab786b997-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:08:05 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-d77cedb5-42e2-455e-95a4-362dabdfa2e4 req-b68c2ab5-db1e-4f0d-9b83-7d89dae60835 service nova] Lock "752995bf-8e0a-4832-94d8-280ab786b997-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:08:05 user nova-compute[75229]: DEBUG nova.compute.manager [req-d77cedb5-42e2-455e-95a4-362dabdfa2e4 req-b68c2ab5-db1e-4f0d-9b83-7d89dae60835 service nova] [instance: 752995bf-8e0a-4832-94d8-280ab786b997] No waiting events found dispatching network-vif-unplugged-55228da7-a50c-4f39-ae39-83aeec11a818 {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 10:08:05 user nova-compute[75229]: DEBUG nova.compute.manager [req-d77cedb5-42e2-455e-95a4-362dabdfa2e4 req-b68c2ab5-db1e-4f0d-9b83-7d89dae60835 service nova] [instance: 752995bf-8e0a-4832-94d8-280ab786b997] Received event network-vif-unplugged-55228da7-a50c-4f39-ae39-83aeec11a818 for instance with task_state deleting. {{(pid=75229) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 10:08:06 user nova-compute[75229]: INFO nova.virt.libvirt.driver [-] [instance: 752995bf-8e0a-4832-94d8-280ab786b997] Instance destroyed successfully.
Nov 14 10:08:06 user nova-compute[75229]: DEBUG nova.objects.instance [None req-be370f11-3c98-4a60-bca5-bc4646376d03 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Lazy-loading 'resources' on Instance uuid 752995bf-8e0a-4832-94d8-280ab786b997 {{(pid=75229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 10:08:06 user nova-compute[75229]: DEBUG nova.virt.libvirt.vif [None req-be370f11-3c98-4a60-bca5-bc4646376d03 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T10:06:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-2147229783',display_name='tempest-TestVolumeBootPattern-server-2147229783',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-2147229783',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB5A5mLvKIp6dvI0hO7rO3NlF4G2D20sY7gWEAC+0V/AEyka0aVsvCwYcGQ5KpPpLYwOEY7teK2+b3AO8avbXCe5MdbQ1NPGUWXRV3gtRowACc3Uq7kyXeekLcjWCRcSng==',key_name='tempest-TestVolumeBootPattern-2092695190',keypairs=<?>,launch_index=0,launched_at=2023-11-14T10:06:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='46620ac128944703899f22fe5439ba26',ramdisk_id='',reservation_id='r-1mncmoyg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-2064993142',owner_user_name='tempest-TestVolumeBootPattern-2064993142-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T10:06:24Z,user_data=None,user_id='c26f33e4cdf14ba796445959953f8685',uuid=752995bf-8e0a-4832-94d8-280ab786b997,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "55228da7-a50c-4f39-ae39-83aeec11a818", "address": "fa:16:3e:c4:53:33", "network": {"id": "118ea7c1-77c0-4660-b7b7-f311f6b0ec8a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1907578504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.77", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46620ac128944703899f22fe5439ba26", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55228da7-a5", "ovs_interfaceid": "55228da7-a50c-4f39-ae39-83aeec11a818", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 10:08:06 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-be370f11-3c98-4a60-bca5-bc4646376d03 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Converting VIF {"id": "55228da7-a50c-4f39-ae39-83aeec11a818", "address": "fa:16:3e:c4:53:33", "network": {"id": "118ea7c1-77c0-4660-b7b7-f311f6b0ec8a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1907578504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.77", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46620ac128944703899f22fe5439ba26", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55228da7-a5", "ovs_interfaceid": "55228da7-a50c-4f39-ae39-83aeec11a818", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 10:08:06 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-be370f11-3c98-4a60-bca5-bc4646376d03 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c4:53:33,bridge_name='br-int',has_traffic_filtering=True,id=55228da7-a50c-4f39-ae39-83aeec11a818,network=Network(118ea7c1-77c0-4660-b7b7-f311f6b0ec8a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap55228da7-a5') {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 10:08:06 user nova-compute[75229]: DEBUG os_vif [None req-be370f11-3c98-4a60-bca5-bc4646376d03 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c4:53:33,bridge_name='br-int',has_traffic_filtering=True,id=55228da7-a50c-4f39-ae39-83aeec11a818,network=Network(118ea7c1-77c0-4660-b7b7-f311f6b0ec8a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap55228da7-a5') {{(pid=75229) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 10:08:06 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:08:06 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap55228da7-a5, bridge=br-int, if_exists=True) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 10:08:06 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:08:06 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 10:08:06 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:08:06 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=bff292b1-e3cc-4927-8401-9af04bb7ab52) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 10:08:06 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:08:06 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 10:08:06 user nova-compute[75229]: INFO os_vif [None req-be370f11-3c98-4a60-bca5-bc4646376d03 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c4:53:33,bridge_name='br-int',has_traffic_filtering=True,id=55228da7-a50c-4f39-ae39-83aeec11a818,network=Network(118ea7c1-77c0-4660-b7b7-f311f6b0ec8a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap55228da7-a5')
Nov 14 10:08:06 user nova-compute[75229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-be370f11-3c98-4a60-bca5-bc4646376d03 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] [instance: 752995bf-8e0a-4832-94d8-280ab786b997] calling os-brick to detach iSCSI Volume {{(pid=75229) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 10:08:06 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-be370f11-3c98-4a60-bca5-bc4646376d03 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f73f85151b0>, {'target_iqn': 'iqn.2010-10.org.openstack:c8892c7d-49e8-4f65-b88c-1e14fba8f50a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pSzmIUvP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 10:08:06 user nova-compute[75229]: WARNING os_brick.initiator.connectors.base [None req-be370f11-3c98-4a60-bca5-bc4646376d03 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 10:08:06 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-be370f11-3c98-4a60-bca5-bc4646376d03 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 10:08:06 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-be370f11-3c98-4a60-bca5-bc4646376d03 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 10:08:06 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:08:06 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:08:06 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc12f807-5852-4e34-84ee-cac116769e85]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a8186f4e-9d39-4451-8fb5-1cee648efe1a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4758060c-13b4-4aad-b2e4-19aadfa39dd1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7aee6091-dab3-4c39-88a1-4bbb28dcab45\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c8892c7d-49e8-4f65-b88c-1e14fba8f50a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5aebc438-0289-44fe-ad84-4e696468f50e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:08:06 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-be370f11-3c98-4a60-bca5-bc4646376d03 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 10:08:06 user nova-compute[75229]: No targets found.
Nov 14 10:08:06 user nova-compute[75229]: iSNS:
Nov 14 10:08:06 user nova-compute[75229]: No targets found.
Nov 14 10:08:06 user nova-compute[75229]: STATIC:
Nov 14 10:08:06 user nova-compute[75229]: Target: iqn.2010-10.org.openstack:a8186f4e-9d39-4451-8fb5-1cee648efe1a
Nov 14 10:08:06 user nova-compute[75229]:         Portal: 172.16.0.220:3260,-1
Nov 14 10:08:06 user nova-compute[75229]:                 Iface Name: default
Nov 14 10:08:06 user nova-compute[75229]: Target: iqn.2010-10.org.openstack:4758060c-13b4-4aad-b2e4-19aadfa39dd1
Nov 14 10:08:06 user nova-compute[75229]:         Portal: 172.16.0.220:3260,-1
Nov 14 10:08:06 user nova-compute[75229]:                 Iface Name: default
Nov 14 10:08:06 user nova-compute[75229]: Target: iqn.2010-10.org.openstack:7aee6091-dab3-4c39-88a1-4bbb28dcab45
Nov 14 10:08:06 user nova-compute[75229]:         Portal: 172.16.0.220:3260,-1
Nov 14 10:08:06 user nova-compute[75229]:                 Iface Name: default
Nov 14 10:08:06 user nova-compute[75229]: Target: iqn.2010-10.org.openstack:c8892c7d-49e8-4f65-b88c-1e14fba8f50a
Nov 14 10:08:06 user nova-compute[75229]:         Portal: 172.16.0.220:3260,-1
Nov 14 10:08:06 user nova-compute[75229]:                 Iface Name: default
Nov 14 10:08:06 user nova-compute[75229]: Target: iqn.2010-10.org.openstack:5aebc438-0289-44fe-ad84-4e696468f50e
Nov 14 10:08:06 user nova-compute[75229]:         Portal: 172.16.0.220:3260,-1
Nov 14 10:08:06 user nova-compute[75229]:                 Iface Name: default
Nov 14 10:08:06 user nova-compute[75229]: FIRMWARE:
Nov 14 10:08:06 user nova-compute[75229]: No targets found.
Nov 14 10:08:06 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 10:08:06 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-be370f11-3c98-4a60-bca5-bc4646376d03 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 10:08:06 user nova-compute[75229]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 10:08:06 user nova-compute[75229]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75229) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 10:08:06 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-be370f11-3c98-4a60-bca5-bc4646376d03 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c8892c7d-49e8-4f65-b88c-1e14fba8f50a', 0)] {{(pid=75229) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 10:08:06 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:08:06 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:08:06 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cb95998-14de-41f6-9648-0ed9cc979d48]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4758060c-13b4-4aad-b2e4-19aadfa39dd1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5aebc438-0289-44fe-ad84-4e696468f50e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7aee6091-dab3-4c39-88a1-4bbb28dcab45\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a8186f4e-9d39-4451-8fb5-1cee648efe1a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c8892c7d-49e8-4f65-b88c-1e14fba8f50a\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:08:06 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:08:06 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:08:06 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b34a58f-3f4c-4ceb-9739-aa9cb86d9988]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aebc438-0289-44fe-ad84-4e696468f50e (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7aee6091-dab3-4c39-88a1-4bbb28dcab45 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8892c7d-49e8-4f65-b88c-1e14fba8f50a (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8186f4e-9d39-4451-8fb5-1cee648efe1a (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4758060c-13b4-4aad-b2e4-19aadfa39dd1 (non-flash)\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:08:06 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-be370f11-3c98-4a60-bca5-bc4646376d03 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aebc438-0289-44fe-ad84-4e696468f50e (non-flash)
Nov 14 10:08:06 user nova-compute[75229]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7aee6091-dab3-4c39-88a1-4bbb28dcab45 (non-flash)
Nov 14 10:08:06 user nova-compute[75229]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8892c7d-49e8-4f65-b88c-1e14fba8f50a (non-flash)
Nov 14 10:08:06 user nova-compute[75229]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8186f4e-9d39-4451-8fb5-1cee648efe1a (non-flash)
Nov 14 10:08:06 user nova-compute[75229]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4758060c-13b4-4aad-b2e4-19aadfa39dd1 (non-flash)
Nov 14 10:08:06 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 10:08:06 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-be370f11-3c98-4a60-bca5-bc4646376d03 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aebc438-0289-44fe-ad84-4e696468f50e (non-flash)
Nov 14 10:08:06 user nova-compute[75229]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7aee6091-dab3-4c39-88a1-4bbb28dcab45 (non-flash)
Nov 14 10:08:06 user nova-compute[75229]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8892c7d-49e8-4f65-b88c-1e14fba8f50a (non-flash)
Nov 14 10:08:06 user nova-compute[75229]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8186f4e-9d39-4451-8fb5-1cee648efe1a (non-flash)
Nov 14 10:08:06 user nova-compute[75229]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4758060c-13b4-4aad-b2e4-19aadfa39dd1 (non-flash)
Nov 14 10:08:06 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 10:08:06 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-be370f11-3c98-4a60-bca5-bc4646376d03 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7418198160>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c8892c7d-49e8-4f65-b88c-1e14fba8f50a'): ({'sdf'}, set())}) {{(pid=75229) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 10:08:06 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-be370f11-3c98-4a60-bca5-bc4646376d03 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Removing single pathed devices sdf {{(pid=75229) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 10:08:06 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:08:06 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:08:06 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[915b7b9c-ceb2-4b70-9603-238ef6c0e0c0]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:08:06 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:08:06 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.025s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:08:06 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9201d22-51b1-4b33-9266-5b6df70945a0]: (4, ('ok\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:08:06 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-be370f11-3c98-4a60-bca5-bc4646376d03 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Flushing IO for device /dev/sdf {{(pid=75229) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 10:08:06 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:08:06 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.012s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:08:06 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[facf83a1-059c-48bc-9d0c-5e49e1a6c972]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:08:06 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-be370f11-3c98-4a60-bca5-bc4646376d03 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75229) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 10:08:06 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:08:06 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.046s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:08:06 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[04fd17f2-f26b-4e14-84e5-072329992803]: (4, ('1', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:08:06 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-be370f11-3c98-4a60-bca5-bc4646376d03 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75229) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 10:08:06 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-be370f11-3c98-4a60-bca5-bc4646376d03 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] SCSI volumes sdf have been removed. {{(pid=75229) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 10:08:06 user nova-compute[75229]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23534373037373930', '/dev/disk/by-id/scsi-1SCST_BIO7cfcb0a5-54707790c24e763d', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_7cfcb0a5') {{(pid=86458) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 14 10:08:06 user nova-compute[75229]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-23534373037373930
Nov 14 10:08:06 user nova-compute[75229]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-1SCST_BIO7cfcb0a5-54707790c24e763d
Nov 14 10:08:06 user nova-compute[75229]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-SSCST_BIO_Storage_7cfcb0a5
Nov 14 10:08:06 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[866de1a4-a050-4ae5-bc3e-56af28767a5c]: (4, None) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:08:06 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-be370f11-3c98-4a60-bca5-bc4646376d03 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c8892c7d-49e8-4f65-b88c-1e14fba8f50a')] {{(pid=75229) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 10:08:06 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c8892c7d-49e8-4f65-b88c-1e14fba8f50a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:08:06 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c8892c7d-49e8-4f65-b88c-1e14fba8f50a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:08:06 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[40767299-8256-4049-ada7-5c9cf06babe2]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:08:06 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-be370f11-3c98-4a60-bca5-bc4646376d03 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 10:08:06 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c8892c7d-49e8-4f65-b88c-1e14fba8f50a -p 172.16.0.220:3260 --logout {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:08:06 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c8892c7d-49e8-4f65-b88c-1e14fba8f50a -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:08:06 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[42de1efe-7c9e-4229-af13-65cd3bd6ace2]: (4, ('Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:c8892c7d-49e8-4f65-b88c-1e14fba8f50a, portal: 172.16.0.220,3260]\nLogout of [sid: 49, target: iqn.2010-10.org.openstack:c8892c7d-49e8-4f65-b88c-1e14fba8f50a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:08:06 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-be370f11-3c98-4a60-bca5-bc4646376d03 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:c8892c7d-49e8-4f65-b88c-1e14fba8f50a, portal: 172.16.0.220,3260]
Nov 14 10:08:06 user nova-compute[75229]: Logout of [sid: 49, target: iqn.2010-10.org.openstack:c8892c7d-49e8-4f65-b88c-1e14fba8f50a, portal: 172.16.0.220,3260] successful.
Nov 14 10:08:06 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 10:08:06 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c8892c7d-49e8-4f65-b88c-1e14fba8f50a -p 172.16.0.220:3260 --op delete {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:08:06 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c8892c7d-49e8-4f65-b88c-1e14fba8f50a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:08:06 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[fed6b850-4eb6-4612-b058-dd057711b1f6]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:08:06 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-be370f11-3c98-4a60-bca5-bc4646376d03 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 10:08:06 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-be370f11-3c98-4a60-bca5-bc4646376d03 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.324s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 10:08:06 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-be370f11-3c98-4a60-bca5-bc4646376d03 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] <== disconnect_volume: return (325ms) None {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 10:08:06 user nova-compute[75229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-be370f11-3c98-4a60-bca5-bc4646376d03 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] [instance: 752995bf-8e0a-4832-94d8-280ab786b997] Disconnected iSCSI Volume {{(pid=75229) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 10:08:06 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-be370f11-3c98-4a60-bca5-bc4646376d03 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] [instance: 752995bf-8e0a-4832-94d8-280ab786b997] Deleting instance files /opt/stack/data/nova/instances/752995bf-8e0a-4832-94d8-280ab786b997_del
Nov 14 10:08:06 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-be370f11-3c98-4a60-bca5-bc4646376d03 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] [instance: 752995bf-8e0a-4832-94d8-280ab786b997] Deletion of /opt/stack/data/nova/instances/752995bf-8e0a-4832-94d8-280ab786b997_del complete
Nov 14 10:08:06 user nova-compute[75229]: INFO nova.compute.manager [None req-be370f11-3c98-4a60-bca5-bc4646376d03 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] [instance: 752995bf-8e0a-4832-94d8-280ab786b997] Took 1.17 seconds to destroy the instance on the hypervisor.
Nov 14 10:08:06 user nova-compute[75229]: DEBUG oslo.service.loopingcall [None req-be370f11-3c98-4a60-bca5-bc4646376d03 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75229) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 10:08:06 user nova-compute[75229]: DEBUG nova.compute.manager [-] [instance: 752995bf-8e0a-4832-94d8-280ab786b997] Deallocating network for instance {{(pid=75229) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 10:08:06 user nova-compute[75229]: DEBUG nova.network.neutron [-] [instance: 752995bf-8e0a-4832-94d8-280ab786b997] deallocate_for_instance() {{(pid=75229) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 10:08:06 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:08:06 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:08:07 user nova-compute[75229]: DEBUG nova.network.neutron [-] [instance: 752995bf-8e0a-4832-94d8-280ab786b997] Updating instance_info_cache with network_info: [] {{(pid=75229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 10:08:07 user nova-compute[75229]: INFO nova.compute.manager [-] [instance: 752995bf-8e0a-4832-94d8-280ab786b997] Took 0.93 seconds to deallocate network for instance.
Nov 14 10:08:07 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:08:07 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:08:07 user nova-compute[75229]: DEBUG nova.compute.manager [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75229) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 10:08:07 user nova-compute[75229]: DEBUG nova.compute.manager [req-f51bbd49-7427-4100-9119-1713d9d43876 req-a36e6622-1061-41be-883d-1b861b8fd226 service nova] [instance: 752995bf-8e0a-4832-94d8-280ab786b997] Received event network-vif-plugged-55228da7-a50c-4f39-ae39-83aeec11a818 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 10:08:07 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-f51bbd49-7427-4100-9119-1713d9d43876 req-a36e6622-1061-41be-883d-1b861b8fd226 service nova] Acquiring lock "752995bf-8e0a-4832-94d8-280ab786b997-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:08:07 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-f51bbd49-7427-4100-9119-1713d9d43876 req-a36e6622-1061-41be-883d-1b861b8fd226 service nova] Lock "752995bf-8e0a-4832-94d8-280ab786b997-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:08:07 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-f51bbd49-7427-4100-9119-1713d9d43876 req-a36e6622-1061-41be-883d-1b861b8fd226 service nova] Lock "752995bf-8e0a-4832-94d8-280ab786b997-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:08:07 user nova-compute[75229]: DEBUG nova.compute.manager [req-f51bbd49-7427-4100-9119-1713d9d43876 req-a36e6622-1061-41be-883d-1b861b8fd226 service nova] [instance: 752995bf-8e0a-4832-94d8-280ab786b997] No waiting events found dispatching network-vif-plugged-55228da7-a50c-4f39-ae39-83aeec11a818 {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 10:08:07 user nova-compute[75229]: WARNING nova.compute.manager [req-f51bbd49-7427-4100-9119-1713d9d43876 req-a36e6622-1061-41be-883d-1b861b8fd226 service nova] [instance: 752995bf-8e0a-4832-94d8-280ab786b997] Received unexpected event network-vif-plugged-55228da7-a50c-4f39-ae39-83aeec11a818 for instance with vm_state active and task_state deleting.
Nov 14 10:08:07 user nova-compute[75229]: DEBUG nova.compute.manager [req-f51bbd49-7427-4100-9119-1713d9d43876 req-a36e6622-1061-41be-883d-1b861b8fd226 service nova] [instance: 752995bf-8e0a-4832-94d8-280ab786b997] Received event network-vif-deleted-55228da7-a50c-4f39-ae39-83aeec11a818 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 10:08:08 user nova-compute[75229]: INFO nova.compute.manager [None req-be370f11-3c98-4a60-bca5-bc4646376d03 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] [instance: 752995bf-8e0a-4832-94d8-280ab786b997] Took 0.69 seconds to detach 1 volumes for instance.
Nov 14 10:08:08 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-be370f11-3c98-4a60-bca5-bc4646376d03 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:08:08 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-be370f11-3c98-4a60-bca5-bc4646376d03 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:08:08 user nova-compute[75229]: DEBUG nova.compute.provider_tree [None req-be370f11-3c98-4a60-bca5-bc4646376d03 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Inventory has not changed in ProviderTree for provider: d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 {{(pid=75229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 10:08:08 user nova-compute[75229]: DEBUG nova.scheduler.client.report [None req-be370f11-3c98-4a60-bca5-bc4646376d03 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Inventory has not changed for provider d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 10:08:08 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-be370f11-3c98-4a60-bca5-bc4646376d03 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.212s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:08:08 user nova-compute[75229]: INFO nova.scheduler.client.report [None req-be370f11-3c98-4a60-bca5-bc4646376d03 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Deleted allocations for instance 752995bf-8e0a-4832-94d8-280ab786b997
Nov 14 10:08:08 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:08:08 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:08:08 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:08:08 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:08:08 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Auditing locally available compute resources for user (node: user) {{(pid=75229) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 10:08:08 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-be370f11-3c98-4a60-bca5-bc4646376d03 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Lock "752995bf-8e0a-4832-94d8-280ab786b997" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.364s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:08:08 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cda8c5ad-e70c-4021-bace-d55831c4bc78/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:08:08 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:08:09 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cda8c5ad-e70c-4021-bace-d55831c4bc78/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:08:09 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cda8c5ad-e70c-4021-bace-d55831c4bc78/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:08:09 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cda8c5ad-e70c-4021-bace-d55831c4bc78/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:08:09 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/764de1b0-b77f-457a-8355-e5cdc1f6eab1/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:08:09 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/764de1b0-b77f-457a-8355-e5cdc1f6eab1/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:08:09 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/764de1b0-b77f-457a-8355-e5cdc1f6eab1/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:08:09 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/764de1b0-b77f-457a-8355-e5cdc1f6eab1/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:08:09 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75229) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 10:08:09 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1679275-ebb1-4f15-80a4-b8fd614fc34b/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:08:09 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1679275-ebb1-4f15-80a4-b8fd614fc34b/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:08:09 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1679275-ebb1-4f15-80a4-b8fd614fc34b/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:08:09 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1679275-ebb1-4f15-80a4-b8fd614fc34b/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:08:09 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75229) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 10:08:09 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75229) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 10:08:09 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10d6bce1-e55f-429c-816d-3bef9029560a/disk.rescue --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:08:10 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10d6bce1-e55f-429c-816d-3bef9029560a/disk.rescue --force-share --output=json" returned: 0 in 0.170s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:08:10 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10d6bce1-e55f-429c-816d-3bef9029560a/disk.rescue --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:08:10 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10d6bce1-e55f-429c-816d-3bef9029560a/disk.rescue --force-share --output=json" returned: 0 in 0.182s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:08:10 user nova-compute[75229]: WARNING nova.virt.libvirt.driver [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 10:08:10 user nova-compute[75229]: WARNING nova.virt.libvirt.driver [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 10:08:10 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Hypervisor/Node resource view: name=user free_ram=8577MB free_disk=24.948795318603516GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75229) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 10:08:10 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:08:10 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:08:10 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Instance cda8c5ad-e70c-4021-bace-d55831c4bc78 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 10:08:10 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Instance 30ae1f73-e0f3-4e26-987e-a684471a160d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 10:08:10 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Instance c1679275-ebb1-4f15-80a4-b8fd614fc34b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 10:08:10 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Instance 10d6bce1-e55f-429c-816d-3bef9029560a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 10:08:10 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Instance 764de1b0-b77f-457a-8355-e5cdc1f6eab1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 10:08:10 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=75229) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 10:08:10 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=75229) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 10:08:10 user nova-compute[75229]: DEBUG nova.compute.provider_tree [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Inventory has not changed in ProviderTree for provider: d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 {{(pid=75229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 10:08:11 user nova-compute[75229]: DEBUG nova.scheduler.client.report [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Inventory has not changed for provider d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 10:08:11 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Compute_service record updated for user:user {{(pid=75229) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 10:08:11 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.306s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:08:11 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:08:12 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:08:13 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:08:14 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:08:16 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:08:20 user nova-compute[75229]: WARNING nova.virt.libvirt.driver [None req-48b4c5aa-fd48-469e-94f8-741e75e74750 tempest-TestServerVolumeAttachmentScenario-1041667837 tempest-TestServerVolumeAttachmentScenario-1041667837-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance 764de1b0-b77f-457a-8355-e5cdc1f6eab1 is timed out.
Nov 14 10:08:20 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-48b4c5aa-fd48-469e-94f8-741e75e74750 tempest-TestServerVolumeAttachmentScenario-1041667837 tempest-TestServerVolumeAttachmentScenario-1041667837-project-member] Successfully detached device vdc from instance 764de1b0-b77f-457a-8355-e5cdc1f6eab1 from the live domain config.
Nov 14 10:08:20 user nova-compute[75229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-48b4c5aa-fd48-469e-94f8-741e75e74750 tempest-TestServerVolumeAttachmentScenario-1041667837 tempest-TestServerVolumeAttachmentScenario-1041667837-project-member] [instance: 764de1b0-b77f-457a-8355-e5cdc1f6eab1] calling os-brick to detach iSCSI Volume {{(pid=75229) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 10:08:20 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-48b4c5aa-fd48-469e-94f8-741e75e74750 tempest-TestServerVolumeAttachmentScenario-1041667837 tempest-TestServerVolumeAttachmentScenario-1041667837-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f73f85151b0>, {'target_iqn': 'iqn.2010-10.org.openstack:4758060c-13b4-4aad-b2e4-19aadfa39dd1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CxhGfTEo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 10:08:20 user nova-compute[75229]: WARNING os_brick.initiator.connectors.base [None req-48b4c5aa-fd48-469e-94f8-741e75e74750 tempest-TestServerVolumeAttachmentScenario-1041667837 tempest-TestServerVolumeAttachmentScenario-1041667837-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 10:08:20 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-48b4c5aa-fd48-469e-94f8-741e75e74750 tempest-TestServerVolumeAttachmentScenario-1041667837 tempest-TestServerVolumeAttachmentScenario-1041667837-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 10:08:20 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-48b4c5aa-fd48-469e-94f8-741e75e74750 tempest-TestServerVolumeAttachmentScenario-1041667837 tempest-TestServerVolumeAttachmentScenario-1041667837-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 10:08:20 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:08:20 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:08:20 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0d05672-236d-4518-ada0-cb83c24f9f7d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a8186f4e-9d39-4451-8fb5-1cee648efe1a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4758060c-13b4-4aad-b2e4-19aadfa39dd1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7aee6091-dab3-4c39-88a1-4bbb28dcab45\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5aebc438-0289-44fe-ad84-4e696468f50e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:08:20 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-48b4c5aa-fd48-469e-94f8-741e75e74750 tempest-TestServerVolumeAttachmentScenario-1041667837 tempest-TestServerVolumeAttachmentScenario-1041667837-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 10:08:20 user nova-compute[75229]: No targets found.
Nov 14 10:08:20 user nova-compute[75229]: iSNS:
Nov 14 10:08:20 user nova-compute[75229]: No targets found.
Nov 14 10:08:20 user nova-compute[75229]: STATIC:
Nov 14 10:08:20 user nova-compute[75229]: Target: iqn.2010-10.org.openstack:a8186f4e-9d39-4451-8fb5-1cee648efe1a
Nov 14 10:08:20 user nova-compute[75229]:         Portal: 172.16.0.220:3260,-1
Nov 14 10:08:20 user nova-compute[75229]:                 Iface Name: default
Nov 14 10:08:20 user nova-compute[75229]: Target: iqn.2010-10.org.openstack:4758060c-13b4-4aad-b2e4-19aadfa39dd1
Nov 14 10:08:20 user nova-compute[75229]:         Portal: 172.16.0.220:3260,-1
Nov 14 10:08:20 user nova-compute[75229]:                 Iface Name: default
Nov 14 10:08:20 user nova-compute[75229]: Target: iqn.2010-10.org.openstack:7aee6091-dab3-4c39-88a1-4bbb28dcab45
Nov 14 10:08:20 user nova-compute[75229]:         Portal: 172.16.0.220:3260,-1
Nov 14 10:08:20 user nova-compute[75229]:                 Iface Name: default
Nov 14 10:08:20 user nova-compute[75229]: Target: iqn.2010-10.org.openstack:5aebc438-0289-44fe-ad84-4e696468f50e
Nov 14 10:08:20 user nova-compute[75229]:         Portal: 172.16.0.220:3260,-1
Nov 14 10:08:20 user nova-compute[75229]:                 Iface Name: default
Nov 14 10:08:20 user nova-compute[75229]: FIRMWARE:
Nov 14 10:08:20 user nova-compute[75229]: No targets found.
Nov 14 10:08:20 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 10:08:20 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-48b4c5aa-fd48-469e-94f8-741e75e74750 tempest-TestServerVolumeAttachmentScenario-1041667837 tempest-TestServerVolumeAttachmentScenario-1041667837-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 10:08:20 user nova-compute[75229]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 10:08:20 user nova-compute[75229]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75229) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 10:08:20 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-48b4c5aa-fd48-469e-94f8-741e75e74750 tempest-TestServerVolumeAttachmentScenario-1041667837 tempest-TestServerVolumeAttachmentScenario-1041667837-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4758060c-13b4-4aad-b2e4-19aadfa39dd1', 0)] {{(pid=75229) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 10:08:20 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:08:20 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:08:20 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[743b32e4-6872-4176-8807-b4629eaafb88]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4758060c-13b4-4aad-b2e4-19aadfa39dd1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5aebc438-0289-44fe-ad84-4e696468f50e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7aee6091-dab3-4c39-88a1-4bbb28dcab45\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a8186f4e-9d39-4451-8fb5-1cee648efe1a\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:08:20 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:08:20 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:08:20 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ba9a7ef-0be0-4cbf-89a8-1b250b15cca6]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aebc438-0289-44fe-ad84-4e696468f50e (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7aee6091-dab3-4c39-88a1-4bbb28dcab45 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8186f4e-9d39-4451-8fb5-1cee648efe1a (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4758060c-13b4-4aad-b2e4-19aadfa39dd1 (non-flash)\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:08:20 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-48b4c5aa-fd48-469e-94f8-741e75e74750 tempest-TestServerVolumeAttachmentScenario-1041667837 tempest-TestServerVolumeAttachmentScenario-1041667837-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aebc438-0289-44fe-ad84-4e696468f50e (non-flash)
Nov 14 10:08:20 user nova-compute[75229]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7aee6091-dab3-4c39-88a1-4bbb28dcab45 (non-flash)
Nov 14 10:08:20 user nova-compute[75229]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8186f4e-9d39-4451-8fb5-1cee648efe1a (non-flash)
Nov 14 10:08:20 user nova-compute[75229]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4758060c-13b4-4aad-b2e4-19aadfa39dd1 (non-flash)
Nov 14 10:08:20 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 10:08:20 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-48b4c5aa-fd48-469e-94f8-741e75e74750 tempest-TestServerVolumeAttachmentScenario-1041667837 tempest-TestServerVolumeAttachmentScenario-1041667837-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aebc438-0289-44fe-ad84-4e696468f50e (non-flash)
Nov 14 10:08:20 user nova-compute[75229]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7aee6091-dab3-4c39-88a1-4bbb28dcab45 (non-flash)
Nov 14 10:08:20 user nova-compute[75229]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8186f4e-9d39-4451-8fb5-1cee648efe1a (non-flash)
Nov 14 10:08:20 user nova-compute[75229]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4758060c-13b4-4aad-b2e4-19aadfa39dd1 (non-flash)
Nov 14 10:08:20 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 10:08:20 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-48b4c5aa-fd48-469e-94f8-741e75e74750 tempest-TestServerVolumeAttachmentScenario-1041667837 tempest-TestServerVolumeAttachmentScenario-1041667837-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f73d4ec9cf0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4758060c-13b4-4aad-b2e4-19aadfa39dd1'): ({'sde'}, set())}) {{(pid=75229) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 10:08:20 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-48b4c5aa-fd48-469e-94f8-741e75e74750 tempest-TestServerVolumeAttachmentScenario-1041667837 tempest-TestServerVolumeAttachmentScenario-1041667837-project-member] Removing single pathed devices sde {{(pid=75229) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 10:08:20 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:08:20 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:08:20 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5b35f28-a717-4c3a-8ea2-843a9a59f842]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:08:20 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:08:20 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:08:20 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[64f60496-2962-4199-b0ed-9df023aa6593]: (4, ('ok\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:08:20 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-48b4c5aa-fd48-469e-94f8-741e75e74750 tempest-TestServerVolumeAttachmentScenario-1041667837 tempest-TestServerVolumeAttachmentScenario-1041667837-project-member] Flushing IO for device /dev/sde {{(pid=75229) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 10:08:20 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:08:20 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.012s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:08:20 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[13159b93-d8e1-4c3b-a811-90449918ebf8]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:08:20 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-48b4c5aa-fd48-469e-94f8-741e75e74750 tempest-TestServerVolumeAttachmentScenario-1041667837 tempest-TestServerVolumeAttachmentScenario-1041667837-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75229) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 10:08:20 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:08:20 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.037s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:08:20 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[8709c786-9f2a-4f2c-9e8e-03da5372c188]: (4, ('1', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:08:20 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-48b4c5aa-fd48-469e-94f8-741e75e74750 tempest-TestServerVolumeAttachmentScenario-1041667837 tempest-TestServerVolumeAttachmentScenario-1041667837-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75229) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 10:08:20 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-48b4c5aa-fd48-469e-94f8-741e75e74750 tempest-TestServerVolumeAttachmentScenario-1041667837 tempest-TestServerVolumeAttachmentScenario-1041667837-project-member] SCSI volumes sde have been removed. {{(pid=75229) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 10:08:20 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-48b4c5aa-fd48-469e-94f8-741e75e74750 tempest-TestServerVolumeAttachmentScenario-1041667837 tempest-TestServerVolumeAttachmentScenario-1041667837-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4758060c-13b4-4aad-b2e4-19aadfa39dd1')] {{(pid=75229) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 10:08:20 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4758060c-13b4-4aad-b2e4-19aadfa39dd1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:08:21 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4758060c-13b4-4aad-b2e4-19aadfa39dd1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:08:21 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[e92ebff5-ea9f-4fe8-b09e-ba6a8399900a]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:08:21 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-48b4c5aa-fd48-469e-94f8-741e75e74750 tempest-TestServerVolumeAttachmentScenario-1041667837 tempest-TestServerVolumeAttachmentScenario-1041667837-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 10:08:21 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4758060c-13b4-4aad-b2e4-19aadfa39dd1 -p 172.16.0.220:3260 --logout {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:08:21 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4758060c-13b4-4aad-b2e4-19aadfa39dd1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:08:21 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d4605cb-432b-44f6-844f-2aea447f5a61]: (4, ('Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:4758060c-13b4-4aad-b2e4-19aadfa39dd1, portal: 172.16.0.220,3260]\nLogout of [sid: 51, target: iqn.2010-10.org.openstack:4758060c-13b4-4aad-b2e4-19aadfa39dd1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:08:21 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-48b4c5aa-fd48-469e-94f8-741e75e74750 tempest-TestServerVolumeAttachmentScenario-1041667837 tempest-TestServerVolumeAttachmentScenario-1041667837-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:4758060c-13b4-4aad-b2e4-19aadfa39dd1, portal: 172.16.0.220,3260]
Nov 14 10:08:21 user nova-compute[75229]: Logout of [sid: 51, target: iqn.2010-10.org.openstack:4758060c-13b4-4aad-b2e4-19aadfa39dd1, portal: 172.16.0.220,3260] successful.
Nov 14 10:08:21 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 10:08:21 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4758060c-13b4-4aad-b2e4-19aadfa39dd1 -p 172.16.0.220:3260 --op delete {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:08:21 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4758060c-13b4-4aad-b2e4-19aadfa39dd1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:08:21 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[11a316df-144a-4600-90e3-2e2cccb304e7]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:08:21 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-48b4c5aa-fd48-469e-94f8-741e75e74750 tempest-TestServerVolumeAttachmentScenario-1041667837 tempest-TestServerVolumeAttachmentScenario-1041667837-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 10:08:21 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-48b4c5aa-fd48-469e-94f8-741e75e74750 tempest-TestServerVolumeAttachmentScenario-1041667837 tempest-TestServerVolumeAttachmentScenario-1041667837-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.278s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 10:08:21 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-48b4c5aa-fd48-469e-94f8-741e75e74750 tempest-TestServerVolumeAttachmentScenario-1041667837 tempest-TestServerVolumeAttachmentScenario-1041667837-project-member] <== disconnect_volume: return (280ms) None {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 10:08:21 user nova-compute[75229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-48b4c5aa-fd48-469e-94f8-741e75e74750 tempest-TestServerVolumeAttachmentScenario-1041667837 tempest-TestServerVolumeAttachmentScenario-1041667837-project-member] [instance: 764de1b0-b77f-457a-8355-e5cdc1f6eab1] Disconnected iSCSI Volume {{(pid=75229) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 10:08:21 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 10:08:21 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:08:21 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75229) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 10:08:21 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75229) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 10:08:21 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75229) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 10:08:21 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:08:21 user nova-compute[75229]: DEBUG nova.objects.instance [None req-48b4c5aa-fd48-469e-94f8-741e75e74750 tempest-TestServerVolumeAttachmentScenario-1041667837 tempest-TestServerVolumeAttachmentScenario-1041667837-project-member] Lazy-loading 'flavor' on Instance uuid 764de1b0-b77f-457a-8355-e5cdc1f6eab1 {{(pid=75229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 10:08:21 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-48b4c5aa-fd48-469e-94f8-741e75e74750 tempest-TestServerVolumeAttachmentScenario-1041667837 tempest-TestServerVolumeAttachmentScenario-1041667837-project-member] Lock "764de1b0-b77f-457a-8355-e5cdc1f6eab1" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.579s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:08:24 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:08:26 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:08:31 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:08:34 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:08:36 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:08:39 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:08:41 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:08:42 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:08:43 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:08:44 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:08:45 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-213c20c3-c6c9-47cd-8717-fe99d793943f tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Acquiring lock "68d9de39-cbd2-44b2-bda8-015c8482c240" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:08:45 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-213c20c3-c6c9-47cd-8717-fe99d793943f tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Lock "68d9de39-cbd2-44b2-bda8-015c8482c240" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:08:45 user nova-compute[75229]: DEBUG nova.compute.manager [None req-213c20c3-c6c9-47cd-8717-fe99d793943f tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] [instance: 68d9de39-cbd2-44b2-bda8-015c8482c240] Starting instance... {{(pid=75229) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 10:08:45 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-213c20c3-c6c9-47cd-8717-fe99d793943f tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:08:45 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-213c20c3-c6c9-47cd-8717-fe99d793943f tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:08:45 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-213c20c3-c6c9-47cd-8717-fe99d793943f tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75229) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 10:08:45 user nova-compute[75229]: INFO nova.compute.claims [None req-213c20c3-c6c9-47cd-8717-fe99d793943f tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] [instance: 68d9de39-cbd2-44b2-bda8-015c8482c240] Claim successful on node user
Nov 14 10:08:45 user nova-compute[75229]: DEBUG nova.compute.provider_tree [None req-213c20c3-c6c9-47cd-8717-fe99d793943f tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Inventory has not changed in ProviderTree for provider: d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 {{(pid=75229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 10:08:45 user nova-compute[75229]: DEBUG nova.scheduler.client.report [None req-213c20c3-c6c9-47cd-8717-fe99d793943f tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Inventory has not changed for provider d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 10:08:45 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-213c20c3-c6c9-47cd-8717-fe99d793943f tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.322s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:08:45 user nova-compute[75229]: DEBUG nova.compute.manager [None req-213c20c3-c6c9-47cd-8717-fe99d793943f tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] [instance: 68d9de39-cbd2-44b2-bda8-015c8482c240] Start building networks asynchronously for instance. {{(pid=75229) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 10:08:45 user nova-compute[75229]: DEBUG nova.compute.manager [None req-213c20c3-c6c9-47cd-8717-fe99d793943f tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] [instance: 68d9de39-cbd2-44b2-bda8-015c8482c240] Allocating IP information in the background. {{(pid=75229) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 10:08:45 user nova-compute[75229]: DEBUG nova.network.neutron [None req-213c20c3-c6c9-47cd-8717-fe99d793943f tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] [instance: 68d9de39-cbd2-44b2-bda8-015c8482c240] allocate_for_instance() {{(pid=75229) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 10:08:45 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-213c20c3-c6c9-47cd-8717-fe99d793943f tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] [instance: 68d9de39-cbd2-44b2-bda8-015c8482c240] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 10:08:45 user nova-compute[75229]: DEBUG nova.compute.manager [None req-213c20c3-c6c9-47cd-8717-fe99d793943f tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] [instance: 68d9de39-cbd2-44b2-bda8-015c8482c240] Start building block device mappings for instance. {{(pid=75229) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 10:08:45 user nova-compute[75229]: DEBUG nova.policy [None req-213c20c3-c6c9-47cd-8717-fe99d793943f tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '707c03b04f664aab82260a037074de21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be7eb95aea3e4897acbc9fe03aadb8e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75229) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 10:08:45 user nova-compute[75229]: DEBUG nova.compute.manager [None req-213c20c3-c6c9-47cd-8717-fe99d793943f tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] [instance: 68d9de39-cbd2-44b2-bda8-015c8482c240] Start spawning the instance on the hypervisor. {{(pid=75229) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 10:08:45 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-213c20c3-c6c9-47cd-8717-fe99d793943f tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] [instance: 68d9de39-cbd2-44b2-bda8-015c8482c240] Creating instance directory {{(pid=75229) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 10:08:45 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-213c20c3-c6c9-47cd-8717-fe99d793943f tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] [instance: 68d9de39-cbd2-44b2-bda8-015c8482c240] Creating image(s)
Nov 14 10:08:45 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-213c20c3-c6c9-47cd-8717-fe99d793943f tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Acquiring lock "/opt/stack/data/nova/instances/68d9de39-cbd2-44b2-bda8-015c8482c240/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:08:45 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-213c20c3-c6c9-47cd-8717-fe99d793943f tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Lock "/opt/stack/data/nova/instances/68d9de39-cbd2-44b2-bda8-015c8482c240/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:08:45 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-213c20c3-c6c9-47cd-8717-fe99d793943f tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Lock "/opt/stack/data/nova/instances/68d9de39-cbd2-44b2-bda8-015c8482c240/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:08:45 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-213c20c3-c6c9-47cd-8717-fe99d793943f tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6 --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:08:45 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-213c20c3-c6c9-47cd-8717-fe99d793943f tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6 --force-share --output=json" returned: 0 in 0.190s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:08:45 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-213c20c3-c6c9-47cd-8717-fe99d793943f tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Acquiring lock "4f30e3fe703d2381679612a57b1fb80a467f60b6" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:08:45 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-213c20c3-c6c9-47cd-8717-fe99d793943f tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Lock "4f30e3fe703d2381679612a57b1fb80a467f60b6" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:08:45 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-213c20c3-c6c9-47cd-8717-fe99d793943f tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6 --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:08:46 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-213c20c3-c6c9-47cd-8717-fe99d793943f tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6 --force-share --output=json" returned: 0 in 0.169s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:08:46 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-213c20c3-c6c9-47cd-8717-fe99d793943f tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6,backing_fmt=raw /opt/stack/data/nova/instances/68d9de39-cbd2-44b2-bda8-015c8482c240/disk 1073741824 {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:08:46 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-213c20c3-c6c9-47cd-8717-fe99d793943f tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6,backing_fmt=raw /opt/stack/data/nova/instances/68d9de39-cbd2-44b2-bda8-015c8482c240/disk 1073741824" returned: 0 in 0.046s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:08:46 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-213c20c3-c6c9-47cd-8717-fe99d793943f tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Lock "4f30e3fe703d2381679612a57b1fb80a467f60b6" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.221s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:08:46 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-213c20c3-c6c9-47cd-8717-fe99d793943f tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6 --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:08:46 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:08:46 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-213c20c3-c6c9-47cd-8717-fe99d793943f tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6 --force-share --output=json" returned: 0 in 0.174s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:08:46 user nova-compute[75229]: DEBUG nova.virt.disk.api [None req-213c20c3-c6c9-47cd-8717-fe99d793943f tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Checking if we can resize image /opt/stack/data/nova/instances/68d9de39-cbd2-44b2-bda8-015c8482c240/disk. size=1073741824 {{(pid=75229) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 10:08:46 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-213c20c3-c6c9-47cd-8717-fe99d793943f tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68d9de39-cbd2-44b2-bda8-015c8482c240/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:08:46 user nova-compute[75229]: DEBUG nova.network.neutron [None req-213c20c3-c6c9-47cd-8717-fe99d793943f tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] [instance: 68d9de39-cbd2-44b2-bda8-015c8482c240] Successfully created port: e62b2a49-c9cc-4568-b887-1c7884830ac2 {{(pid=75229) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 10:08:46 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-213c20c3-c6c9-47cd-8717-fe99d793943f tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68d9de39-cbd2-44b2-bda8-015c8482c240/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:08:46 user nova-compute[75229]: DEBUG nova.virt.disk.api [None req-213c20c3-c6c9-47cd-8717-fe99d793943f tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Cannot resize image /opt/stack/data/nova/instances/68d9de39-cbd2-44b2-bda8-015c8482c240/disk to a smaller size. {{(pid=75229) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 10:08:46 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-213c20c3-c6c9-47cd-8717-fe99d793943f tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] [instance: 68d9de39-cbd2-44b2-bda8-015c8482c240] Created local disks {{(pid=75229) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 10:08:46 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-213c20c3-c6c9-47cd-8717-fe99d793943f tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] [instance: 68d9de39-cbd2-44b2-bda8-015c8482c240] Ensure instance console log exists: /opt/stack/data/nova/instances/68d9de39-cbd2-44b2-bda8-015c8482c240/console.log {{(pid=75229) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 10:08:46 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-213c20c3-c6c9-47cd-8717-fe99d793943f tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:08:46 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-213c20c3-c6c9-47cd-8717-fe99d793943f tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:08:46 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-213c20c3-c6c9-47cd-8717-fe99d793943f tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:08:47 user nova-compute[75229]: DEBUG nova.network.neutron [None req-213c20c3-c6c9-47cd-8717-fe99d793943f tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] [instance: 68d9de39-cbd2-44b2-bda8-015c8482c240] Successfully updated port: e62b2a49-c9cc-4568-b887-1c7884830ac2 {{(pid=75229) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 10:08:47 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-213c20c3-c6c9-47cd-8717-fe99d793943f tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Acquiring lock "refresh_cache-68d9de39-cbd2-44b2-bda8-015c8482c240" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 10:08:47 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-213c20c3-c6c9-47cd-8717-fe99d793943f tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Acquired lock "refresh_cache-68d9de39-cbd2-44b2-bda8-015c8482c240" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 10:08:47 user nova-compute[75229]: DEBUG nova.network.neutron [None req-213c20c3-c6c9-47cd-8717-fe99d793943f tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] [instance: 68d9de39-cbd2-44b2-bda8-015c8482c240] Building network info cache for instance {{(pid=75229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 10:08:47 user nova-compute[75229]: DEBUG nova.compute.manager [req-8b041f9a-06ac-47d7-8ed0-c5980d57b92d req-ce0b3138-0fff-47ab-ba40-c78b4492335f service nova] [instance: 68d9de39-cbd2-44b2-bda8-015c8482c240] Received event network-changed-e62b2a49-c9cc-4568-b887-1c7884830ac2 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 10:08:47 user nova-compute[75229]: DEBUG nova.compute.manager [req-8b041f9a-06ac-47d7-8ed0-c5980d57b92d req-ce0b3138-0fff-47ab-ba40-c78b4492335f service nova] [instance: 68d9de39-cbd2-44b2-bda8-015c8482c240] Refreshing instance network info cache due to event network-changed-e62b2a49-c9cc-4568-b887-1c7884830ac2. {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 10:08:47 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-8b041f9a-06ac-47d7-8ed0-c5980d57b92d req-ce0b3138-0fff-47ab-ba40-c78b4492335f service nova] Acquiring lock "refresh_cache-68d9de39-cbd2-44b2-bda8-015c8482c240" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 10:08:47 user nova-compute[75229]: DEBUG nova.network.neutron [None req-213c20c3-c6c9-47cd-8717-fe99d793943f tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] [instance: 68d9de39-cbd2-44b2-bda8-015c8482c240] Instance cache missing network info. {{(pid=75229) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 10:08:47 user nova-compute[75229]: DEBUG nova.network.neutron [None req-213c20c3-c6c9-47cd-8717-fe99d793943f tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] [instance: 68d9de39-cbd2-44b2-bda8-015c8482c240] Updating instance_info_cache with network_info: [{"id": "e62b2a49-c9cc-4568-b887-1c7884830ac2", "address": "fa:16:3e:f6:c6:5e", "network": {"id": "13b12b7e-2548-4256-8fb8-fccc67b1e18b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-698342503-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be7eb95aea3e4897acbc9fe03aadb8e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape62b2a49-c9", "ovs_interfaceid": "e62b2a49-c9cc-4568-b887-1c7884830ac2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 10:08:47 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-213c20c3-c6c9-47cd-8717-fe99d793943f tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Releasing lock "refresh_cache-68d9de39-cbd2-44b2-bda8-015c8482c240" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 10:08:47 user nova-compute[75229]: DEBUG nova.compute.manager [None req-213c20c3-c6c9-47cd-8717-fe99d793943f tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] [instance: 68d9de39-cbd2-44b2-bda8-015c8482c240] Instance network_info: |[{"id": "e62b2a49-c9cc-4568-b887-1c7884830ac2", "address": "fa:16:3e:f6:c6:5e", "network": {"id": "13b12b7e-2548-4256-8fb8-fccc67b1e18b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-698342503-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be7eb95aea3e4897acbc9fe03aadb8e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape62b2a49-c9", "ovs_interfaceid": "e62b2a49-c9cc-4568-b887-1c7884830ac2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75229) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 10:08:47 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-8b041f9a-06ac-47d7-8ed0-c5980d57b92d req-ce0b3138-0fff-47ab-ba40-c78b4492335f service nova] Acquired lock "refresh_cache-68d9de39-cbd2-44b2-bda8-015c8482c240" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 10:08:47 user nova-compute[75229]: DEBUG nova.network.neutron [req-8b041f9a-06ac-47d7-8ed0-c5980d57b92d req-ce0b3138-0fff-47ab-ba40-c78b4492335f service nova] [instance: 68d9de39-cbd2-44b2-bda8-015c8482c240] Refreshing network info cache for port e62b2a49-c9cc-4568-b887-1c7884830ac2 {{(pid=75229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 10:08:47 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-213c20c3-c6c9-47cd-8717-fe99d793943f tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] [instance: 68d9de39-cbd2-44b2-bda8-015c8482c240] Start _get_guest_xml network_info=[{"id": "e62b2a49-c9cc-4568-b887-1c7884830ac2", "address": "fa:16:3e:f6:c6:5e", "network": {"id": "13b12b7e-2548-4256-8fb8-fccc67b1e18b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-698342503-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be7eb95aea3e4897acbc9fe03aadb8e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape62b2a49-c9", "ovs_interfaceid": "e62b2a49-c9cc-4568-b887-1c7884830ac2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T09:40:10Z,direct_url=<?>,disk_format='qcow2',id=3bef8470-ecc7-40e3-95d4-9254348ea72d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='de5a91106b6948ed937a7178ff9464c4',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T09:40:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'disk_bus': 'virtio', 'guest_format': None, 'encryption_secret_uuid': None, 'size': 0, 'device_type': 'disk', 'image_id': '3bef8470-ecc7-40e3-95d4-9254348ea72d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75229) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 10:08:47 user nova-compute[75229]: WARNING nova.virt.libvirt.driver [None req-213c20c3-c6c9-47cd-8717-fe99d793943f tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 10:08:47 user nova-compute[75229]: WARNING nova.virt.libvirt.driver [None req-213c20c3-c6c9-47cd-8717-fe99d793943f tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 10:08:47 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-213c20c3-c6c9-47cd-8717-fe99d793943f tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75229) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 10:08:47 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-213c20c3-c6c9-47cd-8717-fe99d793943f tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] CPU controller missing on host. {{(pid=75229) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 10:08:47 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-213c20c3-c6c9-47cd-8717-fe99d793943f tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75229) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 10:08:47 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-213c20c3-c6c9-47cd-8717-fe99d793943f tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] CPU controller found on host. {{(pid=75229) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 10:08:47 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-213c20c3-c6c9-47cd-8717-fe99d793943f tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75229) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 10:08:47 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-213c20c3-c6c9-47cd-8717-fe99d793943f tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T09:39:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T09:40:10Z,direct_url=<?>,disk_format='qcow2',id=3bef8470-ecc7-40e3-95d4-9254348ea72d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='de5a91106b6948ed937a7178ff9464c4',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T09:40:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 10:08:47 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-213c20c3-c6c9-47cd-8717-fe99d793943f tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Flavor limits 0:0:0 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 10:08:47 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-213c20c3-c6c9-47cd-8717-fe99d793943f tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Image limits 0:0:0 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 10:08:47 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-213c20c3-c6c9-47cd-8717-fe99d793943f tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Flavor pref 0:0:0 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 10:08:47 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-213c20c3-c6c9-47cd-8717-fe99d793943f tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Image pref 0:0:0 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 10:08:47 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-213c20c3-c6c9-47cd-8717-fe99d793943f tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 10:08:47 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-213c20c3-c6c9-47cd-8717-fe99d793943f tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 10:08:47 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-213c20c3-c6c9-47cd-8717-fe99d793943f tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75229) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 10:08:47 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-213c20c3-c6c9-47cd-8717-fe99d793943f tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Got 1 possible topologies {{(pid=75229) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 10:08:47 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-213c20c3-c6c9-47cd-8717-fe99d793943f tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 10:08:47 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-213c20c3-c6c9-47cd-8717-fe99d793943f tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 10:08:47 user nova-compute[75229]: DEBUG nova.virt.libvirt.vif [None req-213c20c3-c6c9-47cd-8717-fe99d793943f tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T10:08:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-83963923',display_name='tempest-AttachVolumeTestJSON-server-83963923',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-83963923',id=48,image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJXzPsBd7qGYyaZb6FflRdQkGeKTe15VJYOOicBN62pWfFwNeM5MDUu06fTurq1Q3swlWbSacoNNYmELLNWG6cLojtLhJVSsbh2TFSo9QcykLrjuhusRznBqFctWAQ+d2w==',key_name='tempest-keypair-580650650',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='be7eb95aea3e4897acbc9fe03aadb8e7',ramdisk_id='',reservation_id='r-mo2dg0yb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-775906619',owner_user_name='tempest-AttachVolumeTestJSON-775906619-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T10:08:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='707c03b04f664aab82260a037074de21',uuid=68d9de39-cbd2-44b2-bda8-015c8482c240,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e62b2a49-c9cc-4568-b887-1c7884830ac2", "address": "fa:16:3e:f6:c6:5e", "network": {"id": "13b12b7e-2548-4256-8fb8-fccc67b1e18b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-698342503-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be7eb95aea3e4897acbc9fe03aadb8e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape62b2a49-c9", "ovs_interfaceid": "e62b2a49-c9cc-4568-b887-1c7884830ac2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75229) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 10:08:47 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-213c20c3-c6c9-47cd-8717-fe99d793943f tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Converting VIF {"id": "e62b2a49-c9cc-4568-b887-1c7884830ac2", "address": "fa:16:3e:f6:c6:5e", "network": {"id": "13b12b7e-2548-4256-8fb8-fccc67b1e18b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-698342503-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be7eb95aea3e4897acbc9fe03aadb8e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape62b2a49-c9", "ovs_interfaceid": "e62b2a49-c9cc-4568-b887-1c7884830ac2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 10:08:47 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-213c20c3-c6c9-47cd-8717-fe99d793943f tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f6:c6:5e,bridge_name='br-int',has_traffic_filtering=True,id=e62b2a49-c9cc-4568-b887-1c7884830ac2,network=Network(13b12b7e-2548-4256-8fb8-fccc67b1e18b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape62b2a49-c9') {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 10:08:47 user nova-compute[75229]: DEBUG nova.objects.instance [None req-213c20c3-c6c9-47cd-8717-fe99d793943f tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Lazy-loading 'pci_devices' on Instance uuid 68d9de39-cbd2-44b2-bda8-015c8482c240 {{(pid=75229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 10:08:47 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-213c20c3-c6c9-47cd-8717-fe99d793943f tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] [instance: 68d9de39-cbd2-44b2-bda8-015c8482c240] End _get_guest_xml xml=<domain type="kvm">
Nov 14 10:08:47 user nova-compute[75229]:   <uuid>68d9de39-cbd2-44b2-bda8-015c8482c240</uuid>
Nov 14 10:08:47 user nova-compute[75229]:   <name>instance-00000030</name>
Nov 14 10:08:47 user nova-compute[75229]:   <memory>524288</memory>
Nov 14 10:08:47 user nova-compute[75229]:   <vcpu>1</vcpu>
Nov 14 10:08:47 user nova-compute[75229]:   <metadata>
Nov 14 10:08:47 user nova-compute[75229]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 10:08:47 user nova-compute[75229]:       <nova:package version="0.0.0"/>
Nov 14 10:08:47 user nova-compute[75229]:       <nova:name>tempest-AttachVolumeTestJSON-server-83963923</nova:name>
Nov 14 10:08:47 user nova-compute[75229]:       <nova:creationTime>2023-11-14 10:08:47</nova:creationTime>
Nov 14 10:08:47 user nova-compute[75229]:       <nova:flavor name="m1.tiny">
Nov 14 10:08:47 user nova-compute[75229]:         <nova:memory>512</nova:memory>
Nov 14 10:08:47 user nova-compute[75229]:         <nova:disk>1</nova:disk>
Nov 14 10:08:47 user nova-compute[75229]:         <nova:swap>0</nova:swap>
Nov 14 10:08:47 user nova-compute[75229]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 10:08:47 user nova-compute[75229]:         <nova:vcpus>1</nova:vcpus>
Nov 14 10:08:47 user nova-compute[75229]:       </nova:flavor>
Nov 14 10:08:47 user nova-compute[75229]:       <nova:owner>
Nov 14 10:08:47 user nova-compute[75229]:         <nova:user uuid="707c03b04f664aab82260a037074de21">tempest-AttachVolumeTestJSON-775906619-project-member</nova:user>
Nov 14 10:08:47 user nova-compute[75229]:         <nova:project uuid="be7eb95aea3e4897acbc9fe03aadb8e7">tempest-AttachVolumeTestJSON-775906619</nova:project>
Nov 14 10:08:47 user nova-compute[75229]:       </nova:owner>
Nov 14 10:08:47 user nova-compute[75229]:       <nova:root type="image" uuid="3bef8470-ecc7-40e3-95d4-9254348ea72d"/>
Nov 14 10:08:47 user nova-compute[75229]:       <nova:ports>
Nov 14 10:08:47 user nova-compute[75229]:         <nova:port uuid="e62b2a49-c9cc-4568-b887-1c7884830ac2">
Nov 14 10:08:47 user nova-compute[75229]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 14 10:08:47 user nova-compute[75229]:         </nova:port>
Nov 14 10:08:47 user nova-compute[75229]:       </nova:ports>
Nov 14 10:08:47 user nova-compute[75229]:     </nova:instance>
Nov 14 10:08:47 user nova-compute[75229]:   </metadata>
Nov 14 10:08:47 user nova-compute[75229]:   <sysinfo type="smbios">
Nov 14 10:08:47 user nova-compute[75229]:     <system>
Nov 14 10:08:47 user nova-compute[75229]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 10:08:47 user nova-compute[75229]:       <entry name="product">OpenStack Nova</entry>
Nov 14 10:08:47 user nova-compute[75229]:       <entry name="version">0.0.0</entry>
Nov 14 10:08:47 user nova-compute[75229]:       <entry name="serial">68d9de39-cbd2-44b2-bda8-015c8482c240</entry>
Nov 14 10:08:47 user nova-compute[75229]:       <entry name="uuid">68d9de39-cbd2-44b2-bda8-015c8482c240</entry>
Nov 14 10:08:47 user nova-compute[75229]:       <entry name="family">Virtual Machine</entry>
Nov 14 10:08:47 user nova-compute[75229]:     </system>
Nov 14 10:08:47 user nova-compute[75229]:   </sysinfo>
Nov 14 10:08:47 user nova-compute[75229]:   <os>
Nov 14 10:08:47 user nova-compute[75229]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 10:08:47 user nova-compute[75229]:     <boot dev="hd"/>
Nov 14 10:08:47 user nova-compute[75229]:     <smbios mode="sysinfo"/>
Nov 14 10:08:47 user nova-compute[75229]:   </os>
Nov 14 10:08:47 user nova-compute[75229]:   <features>
Nov 14 10:08:47 user nova-compute[75229]:     <acpi/>
Nov 14 10:08:47 user nova-compute[75229]:     <apic/>
Nov 14 10:08:47 user nova-compute[75229]:     <vmcoreinfo/>
Nov 14 10:08:47 user nova-compute[75229]:   </features>
Nov 14 10:08:47 user nova-compute[75229]:   <clock offset="utc">
Nov 14 10:08:47 user nova-compute[75229]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 10:08:47 user nova-compute[75229]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 10:08:47 user nova-compute[75229]:     <timer name="hpet" present="no"/>
Nov 14 10:08:47 user nova-compute[75229]:   </clock>
Nov 14 10:08:47 user nova-compute[75229]:   <cpu mode="custom" match="exact">
Nov 14 10:08:47 user nova-compute[75229]:     <model>Nehalem</model>
Nov 14 10:08:47 user nova-compute[75229]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 10:08:47 user nova-compute[75229]:   </cpu>
Nov 14 10:08:47 user nova-compute[75229]:   <devices>
Nov 14 10:08:47 user nova-compute[75229]:     <disk type="file" device="disk">
Nov 14 10:08:47 user nova-compute[75229]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 10:08:47 user nova-compute[75229]:       <source file="/opt/stack/data/nova/instances/68d9de39-cbd2-44b2-bda8-015c8482c240/disk"/>
Nov 14 10:08:47 user nova-compute[75229]:       <target dev="vda" bus="virtio"/>
Nov 14 10:08:47 user nova-compute[75229]:     </disk>
Nov 14 10:08:47 user nova-compute[75229]:     <interface type="ethernet">
Nov 14 10:08:47 user nova-compute[75229]:       <mac address="fa:16:3e:f6:c6:5e"/>
Nov 14 10:08:47 user nova-compute[75229]:       <model type="virtio"/>
Nov 14 10:08:47 user nova-compute[75229]:       <mtu size="1442"/>
Nov 14 10:08:47 user nova-compute[75229]:       <target dev="tape62b2a49-c9"/>
Nov 14 10:08:47 user nova-compute[75229]:     </interface>
Nov 14 10:08:47 user nova-compute[75229]:     <serial type="pty">
Nov 14 10:08:47 user nova-compute[75229]:       <log file="/opt/stack/data/nova/instances/68d9de39-cbd2-44b2-bda8-015c8482c240/console.log" append="off"/>
Nov 14 10:08:47 user nova-compute[75229]:     </serial>
Nov 14 10:08:47 user nova-compute[75229]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 10:08:47 user nova-compute[75229]:     <video>
Nov 14 10:08:47 user nova-compute[75229]:       <model type="virtio"/>
Nov 14 10:08:47 user nova-compute[75229]:     </video>
Nov 14 10:08:47 user nova-compute[75229]:     <rng model="virtio">
Nov 14 10:08:47 user nova-compute[75229]:       <backend model="random">/dev/urandom</backend>
Nov 14 10:08:47 user nova-compute[75229]:     </rng>
Nov 14 10:08:47 user nova-compute[75229]:     <controller type="usb" index="0" model="none"/>
Nov 14 10:08:47 user nova-compute[75229]:     <memballoon model="virtio">
Nov 14 10:08:47 user nova-compute[75229]:       <stats period="10"/>
Nov 14 10:08:47 user nova-compute[75229]:     </memballoon>
Nov 14 10:08:47 user nova-compute[75229]:   </devices>
Nov 14 10:08:47 user nova-compute[75229]: </domain>
Nov 14 10:08:47 user nova-compute[75229]:  {{(pid=75229) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 10:08:47 user nova-compute[75229]: DEBUG nova.virt.libvirt.vif [None req-213c20c3-c6c9-47cd-8717-fe99d793943f tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T10:08:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-83963923',display_name='tempest-AttachVolumeTestJSON-server-83963923',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-83963923',id=48,image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJXzPsBd7qGYyaZb6FflRdQkGeKTe15VJYOOicBN62pWfFwNeM5MDUu06fTurq1Q3swlWbSacoNNYmELLNWG6cLojtLhJVSsbh2TFSo9QcykLrjuhusRznBqFctWAQ+d2w==',key_name='tempest-keypair-580650650',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='be7eb95aea3e4897acbc9fe03aadb8e7',ramdisk_id='',reservation_id='r-mo2dg0yb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-775906619',owner_user_name='tempest-AttachVolumeTestJSON-775906619-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T10:08:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='707c03b04f664aab82260a037074de21',uuid=68d9de39-cbd2-44b2-bda8-015c8482c240,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e62b2a49-c9cc-4568-b887-1c7884830ac2", "address": "fa:16:3e:f6:c6:5e", "network": {"id": "13b12b7e-2548-4256-8fb8-fccc67b1e18b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-698342503-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be7eb95aea3e4897acbc9fe03aadb8e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape62b2a49-c9", "ovs_interfaceid": "e62b2a49-c9cc-4568-b887-1c7884830ac2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 10:08:47 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-213c20c3-c6c9-47cd-8717-fe99d793943f tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Converting VIF {"id": "e62b2a49-c9cc-4568-b887-1c7884830ac2", "address": "fa:16:3e:f6:c6:5e", "network": {"id": "13b12b7e-2548-4256-8fb8-fccc67b1e18b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-698342503-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be7eb95aea3e4897acbc9fe03aadb8e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape62b2a49-c9", "ovs_interfaceid": "e62b2a49-c9cc-4568-b887-1c7884830ac2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 10:08:47 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-213c20c3-c6c9-47cd-8717-fe99d793943f tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f6:c6:5e,bridge_name='br-int',has_traffic_filtering=True,id=e62b2a49-c9cc-4568-b887-1c7884830ac2,network=Network(13b12b7e-2548-4256-8fb8-fccc67b1e18b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape62b2a49-c9') {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 10:08:47 user nova-compute[75229]: DEBUG os_vif [None req-213c20c3-c6c9-47cd-8717-fe99d793943f tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f6:c6:5e,bridge_name='br-int',has_traffic_filtering=True,id=e62b2a49-c9cc-4568-b887-1c7884830ac2,network=Network(13b12b7e-2548-4256-8fb8-fccc67b1e18b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape62b2a49-c9') {{(pid=75229) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 10:08:47 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:08:47 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 10:08:47 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 10:08:47 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:08:47 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1c7e9000-3b26-5871-98a1-cf71fdce72fe', '_type': 'linux-noop'}}, row=False) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 10:08:47 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:08:47 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 10:08:47 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:08:47 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape62b2a49-c9, may_exist=True, interface_attrs={}) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 10:08:47 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape62b2a49-c9, col_values=(('qos', UUID('6d214618-49b3-4478-befc-b3511a18bf2a')),), if_exists=True) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 10:08:47 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape62b2a49-c9, col_values=(('external_ids', {'iface-id': 'e62b2a49-c9cc-4568-b887-1c7884830ac2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f6:c6:5e', 'vm-uuid': '68d9de39-cbd2-44b2-bda8-015c8482c240'}),), if_exists=True) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 10:08:47 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:08:47 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 10:08:47 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:08:47 user nova-compute[75229]: INFO os_vif [None req-213c20c3-c6c9-47cd-8717-fe99d793943f tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f6:c6:5e,bridge_name='br-int',has_traffic_filtering=True,id=e62b2a49-c9cc-4568-b887-1c7884830ac2,network=Network(13b12b7e-2548-4256-8fb8-fccc67b1e18b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape62b2a49-c9')
Nov 14 10:08:47 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-213c20c3-c6c9-47cd-8717-fe99d793943f tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] No BDM found with device name vda, not building metadata. {{(pid=75229) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 10:08:47 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-213c20c3-c6c9-47cd-8717-fe99d793943f tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] No VIF found with MAC fa:16:3e:f6:c6:5e, not building metadata {{(pid=75229) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 10:08:47 user nova-compute[75229]: DEBUG nova.network.neutron [req-8b041f9a-06ac-47d7-8ed0-c5980d57b92d req-ce0b3138-0fff-47ab-ba40-c78b4492335f service nova] [instance: 68d9de39-cbd2-44b2-bda8-015c8482c240] Updated VIF entry in instance network info cache for port e62b2a49-c9cc-4568-b887-1c7884830ac2. {{(pid=75229) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 10:08:47 user nova-compute[75229]: DEBUG nova.network.neutron [req-8b041f9a-06ac-47d7-8ed0-c5980d57b92d req-ce0b3138-0fff-47ab-ba40-c78b4492335f service nova] [instance: 68d9de39-cbd2-44b2-bda8-015c8482c240] Updating instance_info_cache with network_info: [{"id": "e62b2a49-c9cc-4568-b887-1c7884830ac2", "address": "fa:16:3e:f6:c6:5e", "network": {"id": "13b12b7e-2548-4256-8fb8-fccc67b1e18b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-698342503-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be7eb95aea3e4897acbc9fe03aadb8e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape62b2a49-c9", "ovs_interfaceid": "e62b2a49-c9cc-4568-b887-1c7884830ac2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 10:08:47 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-8b041f9a-06ac-47d7-8ed0-c5980d57b92d req-ce0b3138-0fff-47ab-ba40-c78b4492335f service nova] Releasing lock "refresh_cache-68d9de39-cbd2-44b2-bda8-015c8482c240" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 10:08:48 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:08:48 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:08:48 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:08:48 user nova-compute[75229]: DEBUG nova.compute.manager [req-04a5658a-e46e-422e-ad07-26b972a00308 req-b91da952-b704-4927-a5b1-994daaae41e0 service nova] [instance: 68d9de39-cbd2-44b2-bda8-015c8482c240] Received event network-vif-plugged-e62b2a49-c9cc-4568-b887-1c7884830ac2 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 10:08:48 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-04a5658a-e46e-422e-ad07-26b972a00308 req-b91da952-b704-4927-a5b1-994daaae41e0 service nova] Acquiring lock "68d9de39-cbd2-44b2-bda8-015c8482c240-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:08:48 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-04a5658a-e46e-422e-ad07-26b972a00308 req-b91da952-b704-4927-a5b1-994daaae41e0 service nova] Lock "68d9de39-cbd2-44b2-bda8-015c8482c240-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:08:48 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-04a5658a-e46e-422e-ad07-26b972a00308 req-b91da952-b704-4927-a5b1-994daaae41e0 service nova] Lock "68d9de39-cbd2-44b2-bda8-015c8482c240-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:08:48 user nova-compute[75229]: DEBUG nova.compute.manager [req-04a5658a-e46e-422e-ad07-26b972a00308 req-b91da952-b704-4927-a5b1-994daaae41e0 service nova] [instance: 68d9de39-cbd2-44b2-bda8-015c8482c240] No waiting events found dispatching network-vif-plugged-e62b2a49-c9cc-4568-b887-1c7884830ac2 {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 10:08:48 user nova-compute[75229]: WARNING nova.compute.manager [req-04a5658a-e46e-422e-ad07-26b972a00308 req-b91da952-b704-4927-a5b1-994daaae41e0 service nova] [instance: 68d9de39-cbd2-44b2-bda8-015c8482c240] Received unexpected event network-vif-plugged-e62b2a49-c9cc-4568-b887-1c7884830ac2 for instance with vm_state building and task_state spawning.
Nov 14 10:08:49 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:08:49 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:08:49 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:08:49 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:08:49 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:08:49 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:08:50 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-5a36c873-5248-4d57-8bd2-a06608c698b9 tempest-TestServerVolumeAttachmentScenario-1041667837 tempest-TestServerVolumeAttachmentScenario-1041667837-project-member] Acquiring lock "764de1b0-b77f-457a-8355-e5cdc1f6eab1" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:08:50 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-5a36c873-5248-4d57-8bd2-a06608c698b9 tempest-TestServerVolumeAttachmentScenario-1041667837 tempest-TestServerVolumeAttachmentScenario-1041667837-project-member] Lock "764de1b0-b77f-457a-8355-e5cdc1f6eab1" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:08:50 user nova-compute[75229]: INFO nova.compute.manager [None req-5a36c873-5248-4d57-8bd2-a06608c698b9 tempest-TestServerVolumeAttachmentScenario-1041667837 tempest-TestServerVolumeAttachmentScenario-1041667837-project-member] [instance: 764de1b0-b77f-457a-8355-e5cdc1f6eab1] Detaching volume a8186f4e-9d39-4451-8fb5-1cee648efe1a
Nov 14 10:08:50 user nova-compute[75229]: INFO nova.virt.block_device [None req-5a36c873-5248-4d57-8bd2-a06608c698b9 tempest-TestServerVolumeAttachmentScenario-1041667837 tempest-TestServerVolumeAttachmentScenario-1041667837-project-member] [instance: 764de1b0-b77f-457a-8355-e5cdc1f6eab1] Attempting to driver detach volume a8186f4e-9d39-4451-8fb5-1cee648efe1a from mountpoint /dev/vdb
Nov 14 10:08:50 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-5a36c873-5248-4d57-8bd2-a06608c698b9 tempest-TestServerVolumeAttachmentScenario-1041667837 tempest-TestServerVolumeAttachmentScenario-1041667837-project-member] Attempting to detach device vdb from instance 764de1b0-b77f-457a-8355-e5cdc1f6eab1 from the persistent domain config. {{(pid=75229) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 10:08:50 user nova-compute[75229]: DEBUG nova.virt.libvirt.guest [None req-5a36c873-5248-4d57-8bd2-a06608c698b9 tempest-TestServerVolumeAttachmentScenario-1041667837 tempest-TestServerVolumeAttachmentScenario-1041667837-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 10:08:50 user nova-compute[75229]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 10:08:50 user nova-compute[75229]:   <source dev="/dev/sdb"/>
Nov 14 10:08:50 user nova-compute[75229]:   <target dev="vdb" bus="virtio"/>
Nov 14 10:08:50 user nova-compute[75229]:   <serial>a8186f4e-9d39-4451-8fb5-1cee648efe1a</serial>
Nov 14 10:08:50 user nova-compute[75229]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 10:08:50 user nova-compute[75229]: </disk>
Nov 14 10:08:50 user nova-compute[75229]:  {{(pid=75229) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 10:08:50 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-5a36c873-5248-4d57-8bd2-a06608c698b9 tempest-TestServerVolumeAttachmentScenario-1041667837 tempest-TestServerVolumeAttachmentScenario-1041667837-project-member] Successfully detached device vdb from instance 764de1b0-b77f-457a-8355-e5cdc1f6eab1 from the persistent domain config.
Nov 14 10:08:50 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-5a36c873-5248-4d57-8bd2-a06608c698b9 tempest-TestServerVolumeAttachmentScenario-1041667837 tempest-TestServerVolumeAttachmentScenario-1041667837-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 764de1b0-b77f-457a-8355-e5cdc1f6eab1 from the live domain config. {{(pid=75229) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 10:08:50 user nova-compute[75229]: DEBUG nova.virt.libvirt.guest [None req-5a36c873-5248-4d57-8bd2-a06608c698b9 tempest-TestServerVolumeAttachmentScenario-1041667837 tempest-TestServerVolumeAttachmentScenario-1041667837-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 10:08:50 user nova-compute[75229]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 10:08:50 user nova-compute[75229]:   <source dev="/dev/sdb"/>
Nov 14 10:08:50 user nova-compute[75229]:   <target dev="vdb" bus="virtio"/>
Nov 14 10:08:50 user nova-compute[75229]:   <serial>a8186f4e-9d39-4451-8fb5-1cee648efe1a</serial>
Nov 14 10:08:50 user nova-compute[75229]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 10:08:50 user nova-compute[75229]: </disk>
Nov 14 10:08:50 user nova-compute[75229]:  {{(pid=75229) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 10:08:50 user nova-compute[75229]: DEBUG nova.compute.manager [None req-213c20c3-c6c9-47cd-8717-fe99d793943f tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] [instance: 68d9de39-cbd2-44b2-bda8-015c8482c240] Instance event wait completed in 0 seconds for  {{(pid=75229) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 10:08:50 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-213c20c3-c6c9-47cd-8717-fe99d793943f tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] [instance: 68d9de39-cbd2-44b2-bda8-015c8482c240] Guest created on hypervisor {{(pid=75229) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 10:08:50 user nova-compute[75229]: INFO nova.virt.libvirt.driver [-] [instance: 68d9de39-cbd2-44b2-bda8-015c8482c240] Instance spawned successfully.
Nov 14 10:08:50 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-213c20c3-c6c9-47cd-8717-fe99d793943f tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] [instance: 68d9de39-cbd2-44b2-bda8-015c8482c240] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 10:08:50 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-213c20c3-c6c9-47cd-8717-fe99d793943f tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] [instance: 68d9de39-cbd2-44b2-bda8-015c8482c240] Found default for hw_cdrom_bus of ide {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 10:08:50 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-213c20c3-c6c9-47cd-8717-fe99d793943f tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] [instance: 68d9de39-cbd2-44b2-bda8-015c8482c240] Found default for hw_disk_bus of virtio {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 10:08:50 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-213c20c3-c6c9-47cd-8717-fe99d793943f tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] [instance: 68d9de39-cbd2-44b2-bda8-015c8482c240] Found default for hw_input_bus of None {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 10:08:50 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-213c20c3-c6c9-47cd-8717-fe99d793943f tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] [instance: 68d9de39-cbd2-44b2-bda8-015c8482c240] Found default for hw_pointer_model of None {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 10:08:50 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-213c20c3-c6c9-47cd-8717-fe99d793943f tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] [instance: 68d9de39-cbd2-44b2-bda8-015c8482c240] Found default for hw_video_model of virtio {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 10:08:50 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-213c20c3-c6c9-47cd-8717-fe99d793943f tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] [instance: 68d9de39-cbd2-44b2-bda8-015c8482c240] Found default for hw_vif_model of virtio {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 10:08:51 user nova-compute[75229]: DEBUG nova.compute.manager [req-0e46245c-c4e3-4211-a902-e51fb19455ee req-e47e7e6d-adef-4e54-b699-d07ab944aa7c service nova] [instance: 68d9de39-cbd2-44b2-bda8-015c8482c240] Received event network-vif-plugged-e62b2a49-c9cc-4568-b887-1c7884830ac2 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 10:08:51 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-0e46245c-c4e3-4211-a902-e51fb19455ee req-e47e7e6d-adef-4e54-b699-d07ab944aa7c service nova] Acquiring lock "68d9de39-cbd2-44b2-bda8-015c8482c240-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:08:51 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-0e46245c-c4e3-4211-a902-e51fb19455ee req-e47e7e6d-adef-4e54-b699-d07ab944aa7c service nova] Lock "68d9de39-cbd2-44b2-bda8-015c8482c240-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:08:51 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-0e46245c-c4e3-4211-a902-e51fb19455ee req-e47e7e6d-adef-4e54-b699-d07ab944aa7c service nova] Lock "68d9de39-cbd2-44b2-bda8-015c8482c240-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:08:51 user nova-compute[75229]: DEBUG nova.compute.manager [req-0e46245c-c4e3-4211-a902-e51fb19455ee req-e47e7e6d-adef-4e54-b699-d07ab944aa7c service nova] [instance: 68d9de39-cbd2-44b2-bda8-015c8482c240] No waiting events found dispatching network-vif-plugged-e62b2a49-c9cc-4568-b887-1c7884830ac2 {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 10:08:51 user nova-compute[75229]: WARNING nova.compute.manager [req-0e46245c-c4e3-4211-a902-e51fb19455ee req-e47e7e6d-adef-4e54-b699-d07ab944aa7c service nova] [instance: 68d9de39-cbd2-44b2-bda8-015c8482c240] Received unexpected event network-vif-plugged-e62b2a49-c9cc-4568-b887-1c7884830ac2 for instance with vm_state building and task_state spawning.
Nov 14 10:08:51 user nova-compute[75229]: INFO nova.compute.manager [None req-213c20c3-c6c9-47cd-8717-fe99d793943f tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] [instance: 68d9de39-cbd2-44b2-bda8-015c8482c240] Took 5.33 seconds to spawn the instance on the hypervisor.
Nov 14 10:08:51 user nova-compute[75229]: DEBUG nova.compute.manager [None req-213c20c3-c6c9-47cd-8717-fe99d793943f tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] [instance: 68d9de39-cbd2-44b2-bda8-015c8482c240] Checking state {{(pid=75229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 10:08:51 user nova-compute[75229]: INFO nova.compute.manager [None req-213c20c3-c6c9-47cd-8717-fe99d793943f tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] [instance: 68d9de39-cbd2-44b2-bda8-015c8482c240] Took 5.97 seconds to build instance.
Nov 14 10:08:51 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-213c20c3-c6c9-47cd-8717-fe99d793943f tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Lock "68d9de39-cbd2-44b2-bda8-015c8482c240" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.058s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:08:51 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-5a36c873-5248-4d57-8bd2-a06608c698b9 tempest-TestServerVolumeAttachmentScenario-1041667837 tempest-TestServerVolumeAttachmentScenario-1041667837-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 764de1b0-b77f-457a-8355-e5cdc1f6eab1 {{(pid=75229) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 10:08:52 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:08:54 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:08:57 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-f639eb23-28ee-4367-bdb7-03d15f8e7987 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Acquiring lock "4a81b779-af09-4026-8387-07d44dad6ef7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:08:57 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-f639eb23-28ee-4367-bdb7-03d15f8e7987 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Lock "4a81b779-af09-4026-8387-07d44dad6ef7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:08:57 user nova-compute[75229]: DEBUG nova.compute.manager [None req-f639eb23-28ee-4367-bdb7-03d15f8e7987 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] [instance: 4a81b779-af09-4026-8387-07d44dad6ef7] Starting instance... {{(pid=75229) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 10:08:57 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-f639eb23-28ee-4367-bdb7-03d15f8e7987 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:08:57 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-f639eb23-28ee-4367-bdb7-03d15f8e7987 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:08:57 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-f639eb23-28ee-4367-bdb7-03d15f8e7987 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75229) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 10:08:57 user nova-compute[75229]: INFO nova.compute.claims [None req-f639eb23-28ee-4367-bdb7-03d15f8e7987 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] [instance: 4a81b779-af09-4026-8387-07d44dad6ef7] Claim successful on node user
Nov 14 10:08:57 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:08:57 user nova-compute[75229]: DEBUG nova.compute.provider_tree [None req-f639eb23-28ee-4367-bdb7-03d15f8e7987 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Inventory has not changed in ProviderTree for provider: d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 {{(pid=75229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 10:08:57 user nova-compute[75229]: DEBUG nova.scheduler.client.report [None req-f639eb23-28ee-4367-bdb7-03d15f8e7987 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Inventory has not changed for provider d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 10:08:57 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-f639eb23-28ee-4367-bdb7-03d15f8e7987 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.302s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:08:57 user nova-compute[75229]: DEBUG nova.compute.manager [None req-f639eb23-28ee-4367-bdb7-03d15f8e7987 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] [instance: 4a81b779-af09-4026-8387-07d44dad6ef7] Start building networks asynchronously for instance. {{(pid=75229) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 10:08:57 user nova-compute[75229]: DEBUG nova.compute.manager [None req-f639eb23-28ee-4367-bdb7-03d15f8e7987 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] [instance: 4a81b779-af09-4026-8387-07d44dad6ef7] Allocating IP information in the background. {{(pid=75229) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 10:08:57 user nova-compute[75229]: DEBUG nova.network.neutron [None req-f639eb23-28ee-4367-bdb7-03d15f8e7987 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] [instance: 4a81b779-af09-4026-8387-07d44dad6ef7] allocate_for_instance() {{(pid=75229) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 10:08:57 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-f639eb23-28ee-4367-bdb7-03d15f8e7987 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] [instance: 4a81b779-af09-4026-8387-07d44dad6ef7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 10:08:57 user nova-compute[75229]: DEBUG nova.compute.manager [None req-f639eb23-28ee-4367-bdb7-03d15f8e7987 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] [instance: 4a81b779-af09-4026-8387-07d44dad6ef7] Start building block device mappings for instance. {{(pid=75229) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 10:08:57 user nova-compute[75229]: INFO nova.virt.block_device [None req-f639eb23-28ee-4367-bdb7-03d15f8e7987 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] [instance: 4a81b779-af09-4026-8387-07d44dad6ef7] Booting with volume c8892c7d-49e8-4f65-b88c-1e14fba8f50a at /dev/vda
Nov 14 10:08:57 user nova-compute[75229]: DEBUG nova.policy [None req-f639eb23-28ee-4367-bdb7-03d15f8e7987 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c26f33e4cdf14ba796445959953f8685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46620ac128944703899f22fe5439ba26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75229) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 10:08:57 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:08:57 user nova-compute[75229]: DEBUG os_brick.utils [None req-f639eb23-28ee-4367-bdb7-03d15f8e7987 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 10:08:57 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:08:57 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:08:57 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[179c128a-581e-495e-ad05-76c7b0b020a9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f1154031c835\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:08:57 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:08:57 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:08:57 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[037bdcc8-693b-4a8c-bff5-367910062712]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:08:57 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:08:57 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:08:57 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[78d9c676-1f25-43e9-8cd1-0200596a552b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:08:57 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1b2c6e6-8e36-4775-91ea-49024e4fa311]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:08:57 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-f639eb23-28ee-4367-bdb7-03d15f8e7987 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Running cmd (subprocess): nvme version {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:08:57 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-f639eb23-28ee-4367-bdb7-03d15f8e7987 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] 'nvme version' failed. Not Retrying. {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 10:08:57 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f639eb23-28ee-4367-bdb7-03d15f8e7987 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] nvme not present on system {{(pid=75229) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 10:08:57 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:08:57 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 10:08:57 user nova-compute[75229]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 10:08:57 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[9db2c7d6-f3bd-4388-a577-4c6cbee7b292]: (4, '') {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:08:57 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.lightos [None req-f639eb23-28ee-4367-bdb7-03d15f8e7987 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75229) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 10:08:57 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.lightos [None req-f639eb23-28ee-4367-bdb7-03d15f8e7987 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75229) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 10:08:57 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.lightos [None req-f639eb23-28ee-4367-bdb7-03d15f8e7987 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] LIGHTOS: no hostnqn found. {{(pid=75229) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 10:08:57 user nova-compute[75229]: DEBUG os_brick.utils [None req-f639eb23-28ee-4367-bdb7-03d15f8e7987 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] <== get_connector_properties: return (137ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f1154031c835', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 10:08:57 user nova-compute[75229]: DEBUG nova.virt.block_device [None req-f639eb23-28ee-4367-bdb7-03d15f8e7987 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] [instance: 4a81b779-af09-4026-8387-07d44dad6ef7] Updating existing volume attachment record: 3fec596f-2e0d-416a-b23d-e784c0233527 {{(pid=75229) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 10:08:58 user nova-compute[75229]: DEBUG nova.network.neutron [None req-f639eb23-28ee-4367-bdb7-03d15f8e7987 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] [instance: 4a81b779-af09-4026-8387-07d44dad6ef7] Successfully created port: ca86bdcf-6fe2-4ceb-8e9c-6ff88e9efb71 {{(pid=75229) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 10:08:59 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:08:59 user nova-compute[75229]: DEBUG nova.network.neutron [None req-f639eb23-28ee-4367-bdb7-03d15f8e7987 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] [instance: 4a81b779-af09-4026-8387-07d44dad6ef7] Successfully updated port: ca86bdcf-6fe2-4ceb-8e9c-6ff88e9efb71 {{(pid=75229) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 10:08:59 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-f639eb23-28ee-4367-bdb7-03d15f8e7987 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Acquiring lock "refresh_cache-4a81b779-af09-4026-8387-07d44dad6ef7" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 10:08:59 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-f639eb23-28ee-4367-bdb7-03d15f8e7987 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Acquired lock "refresh_cache-4a81b779-af09-4026-8387-07d44dad6ef7" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 10:08:59 user nova-compute[75229]: DEBUG nova.network.neutron [None req-f639eb23-28ee-4367-bdb7-03d15f8e7987 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] [instance: 4a81b779-af09-4026-8387-07d44dad6ef7] Building network info cache for instance {{(pid=75229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 10:08:59 user nova-compute[75229]: DEBUG nova.compute.manager [req-92f8acf3-a348-45fd-821c-2a8d9143811b req-9c8248e9-440d-4876-812e-3600e93de518 service nova] [instance: 4a81b779-af09-4026-8387-07d44dad6ef7] Received event network-changed-ca86bdcf-6fe2-4ceb-8e9c-6ff88e9efb71 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 10:08:59 user nova-compute[75229]: DEBUG nova.compute.manager [req-92f8acf3-a348-45fd-821c-2a8d9143811b req-9c8248e9-440d-4876-812e-3600e93de518 service nova] [instance: 4a81b779-af09-4026-8387-07d44dad6ef7] Refreshing instance network info cache due to event network-changed-ca86bdcf-6fe2-4ceb-8e9c-6ff88e9efb71. {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 10:08:59 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-92f8acf3-a348-45fd-821c-2a8d9143811b req-9c8248e9-440d-4876-812e-3600e93de518 service nova] Acquiring lock "refresh_cache-4a81b779-af09-4026-8387-07d44dad6ef7" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 10:08:59 user nova-compute[75229]: DEBUG nova.network.neutron [None req-f639eb23-28ee-4367-bdb7-03d15f8e7987 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] [instance: 4a81b779-af09-4026-8387-07d44dad6ef7] Instance cache missing network info. {{(pid=75229) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 10:08:59 user nova-compute[75229]: DEBUG nova.network.neutron [None req-f639eb23-28ee-4367-bdb7-03d15f8e7987 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] [instance: 4a81b779-af09-4026-8387-07d44dad6ef7] Updating instance_info_cache with network_info: [{"id": "ca86bdcf-6fe2-4ceb-8e9c-6ff88e9efb71", "address": "fa:16:3e:35:44:4b", "network": {"id": "118ea7c1-77c0-4660-b7b7-f311f6b0ec8a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1907578504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46620ac128944703899f22fe5439ba26", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca86bdcf-6f", "ovs_interfaceid": "ca86bdcf-6fe2-4ceb-8e9c-6ff88e9efb71", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 10:08:59 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-f639eb23-28ee-4367-bdb7-03d15f8e7987 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Releasing lock "refresh_cache-4a81b779-af09-4026-8387-07d44dad6ef7" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 10:08:59 user nova-compute[75229]: DEBUG nova.compute.manager [None req-f639eb23-28ee-4367-bdb7-03d15f8e7987 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] [instance: 4a81b779-af09-4026-8387-07d44dad6ef7] Instance network_info: |[{"id": "ca86bdcf-6fe2-4ceb-8e9c-6ff88e9efb71", "address": "fa:16:3e:35:44:4b", "network": {"id": "118ea7c1-77c0-4660-b7b7-f311f6b0ec8a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1907578504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46620ac128944703899f22fe5439ba26", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca86bdcf-6f", "ovs_interfaceid": "ca86bdcf-6fe2-4ceb-8e9c-6ff88e9efb71", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75229) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 10:08:59 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-92f8acf3-a348-45fd-821c-2a8d9143811b req-9c8248e9-440d-4876-812e-3600e93de518 service nova] Acquired lock "refresh_cache-4a81b779-af09-4026-8387-07d44dad6ef7" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 10:08:59 user nova-compute[75229]: DEBUG nova.network.neutron [req-92f8acf3-a348-45fd-821c-2a8d9143811b req-9c8248e9-440d-4876-812e-3600e93de518 service nova] [instance: 4a81b779-af09-4026-8387-07d44dad6ef7] Refreshing network info cache for port ca86bdcf-6fe2-4ceb-8e9c-6ff88e9efb71 {{(pid=75229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 10:09:00 user nova-compute[75229]: DEBUG nova.network.neutron [req-92f8acf3-a348-45fd-821c-2a8d9143811b req-9c8248e9-440d-4876-812e-3600e93de518 service nova] [instance: 4a81b779-af09-4026-8387-07d44dad6ef7] Updated VIF entry in instance network info cache for port ca86bdcf-6fe2-4ceb-8e9c-6ff88e9efb71. {{(pid=75229) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 10:09:00 user nova-compute[75229]: DEBUG nova.network.neutron [req-92f8acf3-a348-45fd-821c-2a8d9143811b req-9c8248e9-440d-4876-812e-3600e93de518 service nova] [instance: 4a81b779-af09-4026-8387-07d44dad6ef7] Updating instance_info_cache with network_info: [{"id": "ca86bdcf-6fe2-4ceb-8e9c-6ff88e9efb71", "address": "fa:16:3e:35:44:4b", "network": {"id": "118ea7c1-77c0-4660-b7b7-f311f6b0ec8a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1907578504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46620ac128944703899f22fe5439ba26", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca86bdcf-6f", "ovs_interfaceid": "ca86bdcf-6fe2-4ceb-8e9c-6ff88e9efb71", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 10:09:00 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-92f8acf3-a348-45fd-821c-2a8d9143811b req-9c8248e9-440d-4876-812e-3600e93de518 service nova] Releasing lock "refresh_cache-4a81b779-af09-4026-8387-07d44dad6ef7" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 10:09:02 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:09:02 user nova-compute[75229]: INFO nova.compute.manager [None req-a30ff51b-e58a-4400-8334-05de63c3fd34 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] [instance: 10d6bce1-e55f-429c-816d-3bef9029560a] Unrescuing
Nov 14 10:09:02 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-a30ff51b-e58a-4400-8334-05de63c3fd34 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Acquiring lock "refresh_cache-10d6bce1-e55f-429c-816d-3bef9029560a" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 10:09:02 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-a30ff51b-e58a-4400-8334-05de63c3fd34 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Acquired lock "refresh_cache-10d6bce1-e55f-429c-816d-3bef9029560a" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 10:09:02 user nova-compute[75229]: DEBUG nova.network.neutron [None req-a30ff51b-e58a-4400-8334-05de63c3fd34 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] [instance: 10d6bce1-e55f-429c-816d-3bef9029560a] Building network info cache for instance {{(pid=75229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 10:09:02 user nova-compute[75229]: DEBUG nova.compute.manager [None req-f639eb23-28ee-4367-bdb7-03d15f8e7987 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] [instance: 4a81b779-af09-4026-8387-07d44dad6ef7] Start spawning the instance on the hypervisor. {{(pid=75229) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 10:09:02 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-f639eb23-28ee-4367-bdb7-03d15f8e7987 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] [instance: 4a81b779-af09-4026-8387-07d44dad6ef7] Creating instance directory {{(pid=75229) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 10:09:02 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-f639eb23-28ee-4367-bdb7-03d15f8e7987 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] [instance: 4a81b779-af09-4026-8387-07d44dad6ef7] Creating image(s)
Nov 14 10:09:02 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-f639eb23-28ee-4367-bdb7-03d15f8e7987 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] [instance: 4a81b779-af09-4026-8387-07d44dad6ef7] Did not create local disks {{(pid=75229) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 14 10:09:02 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-f639eb23-28ee-4367-bdb7-03d15f8e7987 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] [instance: 4a81b779-af09-4026-8387-07d44dad6ef7] Ensure instance console log exists: /opt/stack/data/nova/instances/4a81b779-af09-4026-8387-07d44dad6ef7/console.log {{(pid=75229) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 10:09:02 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-f639eb23-28ee-4367-bdb7-03d15f8e7987 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:09:02 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-f639eb23-28ee-4367-bdb7-03d15f8e7987 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:09:02 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-f639eb23-28ee-4367-bdb7-03d15f8e7987 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:09:02 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-f639eb23-28ee-4367-bdb7-03d15f8e7987 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] [instance: 4a81b779-af09-4026-8387-07d44dad6ef7] Start _get_guest_xml network_info=[{"id": "ca86bdcf-6fe2-4ceb-8e9c-6ff88e9efb71", "address": "fa:16:3e:35:44:4b", "network": {"id": "118ea7c1-77c0-4660-b7b7-f311f6b0ec8a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1907578504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46620ac128944703899f22fe5439ba26", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca86bdcf-6f", "ovs_interfaceid": "ca86bdcf-6fe2-4ceb-8e9c-6ff88e9efb71", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:c8892c7d-49e8-4f65-b88c-1e14fba8f50a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pSzmIUvP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '4a81b779-af09-4026-8387-07d44dad6ef7', 'attached_at': '', 'detached_at': '', 'volume_id': 'c8892c7d-49e8-4f65-b88c-1e14fba8f50a', 'serial': 'c8892c7d-49e8-4f65-b88c-1e14fba8f50a'}, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'attachment_id': '3fec596f-2e0d-416a-b23d-e784c0233527', 'guest_format': None, 'device_type': 'disk', 'volume_type': None} {{(pid=75229) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 10:09:02 user nova-compute[75229]: WARNING nova.virt.libvirt.driver [None req-f639eb23-28ee-4367-bdb7-03d15f8e7987 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 10:09:02 user nova-compute[75229]: WARNING nova.virt.libvirt.driver [None req-f639eb23-28ee-4367-bdb7-03d15f8e7987 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 10:09:02 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-f639eb23-28ee-4367-bdb7-03d15f8e7987 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75229) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 10:09:02 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-f639eb23-28ee-4367-bdb7-03d15f8e7987 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] CPU controller missing on host. {{(pid=75229) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 10:09:02 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-f639eb23-28ee-4367-bdb7-03d15f8e7987 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75229) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 10:09:02 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-f639eb23-28ee-4367-bdb7-03d15f8e7987 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] CPU controller found on host. {{(pid=75229) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 10:09:02 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-f639eb23-28ee-4367-bdb7-03d15f8e7987 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75229) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 10:09:02 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-f639eb23-28ee-4367-bdb7-03d15f8e7987 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T09:39:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 10:09:02 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-f639eb23-28ee-4367-bdb7-03d15f8e7987 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Flavor limits 0:0:0 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 10:09:02 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-f639eb23-28ee-4367-bdb7-03d15f8e7987 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Image limits 0:0:0 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 10:09:02 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-f639eb23-28ee-4367-bdb7-03d15f8e7987 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Flavor pref 0:0:0 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 10:09:02 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-f639eb23-28ee-4367-bdb7-03d15f8e7987 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Image pref 0:0:0 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 10:09:02 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-f639eb23-28ee-4367-bdb7-03d15f8e7987 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 10:09:02 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-f639eb23-28ee-4367-bdb7-03d15f8e7987 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 10:09:02 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-f639eb23-28ee-4367-bdb7-03d15f8e7987 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75229) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 10:09:02 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-f639eb23-28ee-4367-bdb7-03d15f8e7987 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Got 1 possible topologies {{(pid=75229) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 10:09:02 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-f639eb23-28ee-4367-bdb7-03d15f8e7987 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 10:09:02 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-f639eb23-28ee-4367-bdb7-03d15f8e7987 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 10:09:02 user nova-compute[75229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f639eb23-28ee-4367-bdb7-03d15f8e7987 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] [instance: 4a81b779-af09-4026-8387-07d44dad6ef7] Calling os-brick to attach iSCSI Volume {{(pid=75229) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 10:09:02 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-f639eb23-28ee-4367-bdb7-03d15f8e7987 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f73f85151b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c8892c7d-49e8-4f65-b88c-1e14fba8f50a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pSzmIUvP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 10:09:02 user nova-compute[75229]: WARNING os_brick.initiator.connectors.base [None req-f639eb23-28ee-4367-bdb7-03d15f8e7987 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 10:09:02 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-f639eb23-28ee-4367-bdb7-03d15f8e7987 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 10:09:02 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-f639eb23-28ee-4367-bdb7-03d15f8e7987 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 10:09:02 user nova-compute[75229]: WARNING os_brick.initiator.connectors.base [None req-f639eb23-28ee-4367-bdb7-03d15f8e7987 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 10:09:02 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-f639eb23-28ee-4367-bdb7-03d15f8e7987 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c8892c7d-49e8-4f65-b88c-1e14fba8f50a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 10:09:02 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-f639eb23-28ee-4367-bdb7-03d15f8e7987 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c8892c7d-49e8-4f65-b88c-1e14fba8f50a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 10:09:02 user nova-compute[75229]: INFO os_brick.initiator.connectors.iscsi [None req-f639eb23-28ee-4367-bdb7-03d15f8e7987 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 10:09:02 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c8892c7d-49e8-4f65-b88c-1e14fba8f50a -p 172.16.0.220:3260 {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:09:02 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c8892c7d-49e8-4f65-b88c-1e14fba8f50a -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:09:02 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1f6bb9f-b602-4d1b-8cc3-eb586e48a12f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:09:02 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-f639eb23-28ee-4367-bdb7-03d15f8e7987 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 10:09:02 user nova-compute[75229]:  {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 10:09:02 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c8892c7d-49e8-4f65-b88c-1e14fba8f50a -p 172.16.0.220:3260 --interface default --op new {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:09:02 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c8892c7d-49e8-4f65-b88c-1e14fba8f50a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:09:02 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[aef750aa-15e4-4ea1-9859-2be857c8c863]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c8892c7d-49e8-4f65-b88c-1e14fba8f50a] added\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:09:02 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-f639eb23-28ee-4367-bdb7-03d15f8e7987 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c8892c7d-49e8-4f65-b88c-1e14fba8f50a] added
Nov 14 10:09:02 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 10:09:02 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c8892c7d-49e8-4f65-b88c-1e14fba8f50a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:09:02 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c8892c7d-49e8-4f65-b88c-1e14fba8f50a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:09:02 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[8aae5b6a-c968-467b-a5b3-ee1c8ea1ecf4]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:09:02 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-f639eb23-28ee-4367-bdb7-03d15f8e7987 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 10:09:02 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c8892c7d-49e8-4f65-b88c-1e14fba8f50a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:09:02 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c8892c7d-49e8-4f65-b88c-1e14fba8f50a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:09:02 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[b12e1554-70d3-45f8-b329-d88b9de18852]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:09:02 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-f639eb23-28ee-4367-bdb7-03d15f8e7987 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 10:09:02 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c8892c7d-49e8-4f65-b88c-1e14fba8f50a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pSzmIUvP {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:09:02 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c8892c7d-49e8-4f65-b88c-1e14fba8f50a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pSzmIUvP" returned: 0 in 0.018s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:09:02 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[25f29cb4-7e11-464a-90ca-fa5e8fb45a37]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:09:02 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-f639eb23-28ee-4367-bdb7-03d15f8e7987 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'pSzmIUvP'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 10:09:02 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c8892c7d-49e8-4f65-b88c-1e14fba8f50a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:09:02 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c8892c7d-49e8-4f65-b88c-1e14fba8f50a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:09:02 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[33e6a81e-e28c-4327-8465-6cd88ad0eeb3]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:09:02 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-f639eb23-28ee-4367-bdb7-03d15f8e7987 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 10:09:02 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:09:02 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:09:02 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[84907090-aa87-4477-b01d-47b4eceefc5e]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aebc438-0289-44fe-ad84-4e696468f50e (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7aee6091-dab3-4c39-88a1-4bbb28dcab45 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8186f4e-9d39-4451-8fb5-1cee648efe1a (non-flash)\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:09:02 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-f639eb23-28ee-4367-bdb7-03d15f8e7987 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aebc438-0289-44fe-ad84-4e696468f50e (non-flash)
Nov 14 10:09:02 user nova-compute[75229]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7aee6091-dab3-4c39-88a1-4bbb28dcab45 (non-flash)
Nov 14 10:09:02 user nova-compute[75229]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8186f4e-9d39-4451-8fb5-1cee648efe1a (non-flash)
Nov 14 10:09:02 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 10:09:02 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-f639eb23-28ee-4367-bdb7-03d15f8e7987 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aebc438-0289-44fe-ad84-4e696468f50e (non-flash)
Nov 14 10:09:02 user nova-compute[75229]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7aee6091-dab3-4c39-88a1-4bbb28dcab45 (non-flash)
Nov 14 10:09:02 user nova-compute[75229]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8186f4e-9d39-4451-8fb5-1cee648efe1a (non-flash)
Nov 14 10:09:02 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 10:09:02 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c8892c7d-49e8-4f65-b88c-1e14fba8f50a -p 172.16.0.220:3260 --login {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:09:02 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c8892c7d-49e8-4f65-b88c-1e14fba8f50a -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:09:02 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad5a851e-42fc-4a77-b665-b3f97681d61c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c8892c7d-49e8-4f65-b88c-1e14fba8f50a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c8892c7d-49e8-4f65-b88c-1e14fba8f50a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:09:02 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-f639eb23-28ee-4367-bdb7-03d15f8e7987 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c8892c7d-49e8-4f65-b88c-1e14fba8f50a, portal: 172.16.0.220,3260]
Nov 14 10:09:02 user nova-compute[75229]: Login to [iface: default, target: iqn.2010-10.org.openstack:c8892c7d-49e8-4f65-b88c-1e14fba8f50a, portal: 172.16.0.220,3260] successful.
Nov 14 10:09:02 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 10:09:02 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c8892c7d-49e8-4f65-b88c-1e14fba8f50a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:09:02 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c8892c7d-49e8-4f65-b88c-1e14fba8f50a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:09:02 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[41267cad-a387-4845-8cf2-525e4405749a]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:09:02 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-f639eb23-28ee-4367-bdb7-03d15f8e7987 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 10:09:02 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:09:02 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:09:02 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[89cd65c5-73a8-4d00-857c-5e81c3d0ea58]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aebc438-0289-44fe-ad84-4e696468f50e (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7aee6091-dab3-4c39-88a1-4bbb28dcab45 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8186f4e-9d39-4451-8fb5-1cee648efe1a (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8892c7d-49e8-4f65-b88c-1e14fba8f50a (non-flash)\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:09:02 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-f639eb23-28ee-4367-bdb7-03d15f8e7987 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aebc438-0289-44fe-ad84-4e696468f50e (non-flash)
Nov 14 10:09:02 user nova-compute[75229]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7aee6091-dab3-4c39-88a1-4bbb28dcab45 (non-flash)
Nov 14 10:09:02 user nova-compute[75229]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8186f4e-9d39-4451-8fb5-1cee648efe1a (non-flash)
Nov 14 10:09:02 user nova-compute[75229]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8892c7d-49e8-4f65-b88c-1e14fba8f50a (non-flash)
Nov 14 10:09:02 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 10:09:02 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-f639eb23-28ee-4367-bdb7-03d15f8e7987 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aebc438-0289-44fe-ad84-4e696468f50e (non-flash)
Nov 14 10:09:02 user nova-compute[75229]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7aee6091-dab3-4c39-88a1-4bbb28dcab45 (non-flash)
Nov 14 10:09:02 user nova-compute[75229]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8186f4e-9d39-4451-8fb5-1cee648efe1a (non-flash)
Nov 14 10:09:02 user nova-compute[75229]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8892c7d-49e8-4f65-b88c-1e14fba8f50a (non-flash)
Nov 14 10:09:02 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 10:09:02 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-f639eb23-28ee-4367-bdb7-03d15f8e7987 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c8892c7d-49e8-4f65-b88c-1e14fba8f50a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.286s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 10:09:02 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-f639eb23-28ee-4367-bdb7-03d15f8e7987 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Connected to 172.16.0.220:3260 {{(pid=75229) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 10:09:02 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-f639eb23-28ee-4367-bdb7-03d15f8e7987 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] HCTL ('36', '-', '-', 0) found on session 52 with lun 0 {{(pid=75229) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 10:09:02 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-f639eb23-28ee-4367-bdb7-03d15f8e7987 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75229) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 10:09:02 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:09:02 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.015s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:09:02 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[2091fc6f-b3a0-433e-ab6b-69a19eb78549]: (4, ('- - 0', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:09:02 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-f639eb23-28ee-4367-bdb7-03d15f8e7987 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Searching for a device in session 52 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75229) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 10:09:02 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-f639eb23-28ee-4367-bdb7-03d15f8e7987 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:c8892c7d-49e8-4f65-b88c-1e14fba8f50a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pSzmIUvP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75229) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 10:09:03 user nova-compute[75229]: DEBUG nova.network.neutron [None req-a30ff51b-e58a-4400-8334-05de63c3fd34 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] [instance: 10d6bce1-e55f-429c-816d-3bef9029560a] Updating instance_info_cache with network_info: [{"id": "ea04ea8d-43a6-4f64-9e0b-cc2927f214f5", "address": "fa:16:3e:e7:9f:f8", "network": {"id": "6a700b61-4aa6-440b-87e6-a3525a5cb918", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-448680331-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8babb73006da4977a1fe2bdb35e08d8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea04ea8d-43", "ovs_interfaceid": "ea04ea8d-43a6-4f64-9e0b-cc2927f214f5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 10:09:03 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-a30ff51b-e58a-4400-8334-05de63c3fd34 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Releasing lock "refresh_cache-10d6bce1-e55f-429c-816d-3bef9029560a" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 10:09:03 user nova-compute[75229]: DEBUG nova.objects.instance [None req-a30ff51b-e58a-4400-8334-05de63c3fd34 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Lazy-loading 'flavor' on Instance uuid 10d6bce1-e55f-429c-816d-3bef9029560a {{(pid=75229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 10:09:03 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:09:03 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:09:03 user nova-compute[75229]: DEBUG nova.compute.manager [req-bcfe5a47-92da-405c-9e52-c2ba1bbcd091 req-54cefd2b-4026-4ad8-9bd7-43276e0964f7 service nova] [instance: 10d6bce1-e55f-429c-816d-3bef9029560a] Received event network-vif-unplugged-ea04ea8d-43a6-4f64-9e0b-cc2927f214f5 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 10:09:03 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-bcfe5a47-92da-405c-9e52-c2ba1bbcd091 req-54cefd2b-4026-4ad8-9bd7-43276e0964f7 service nova] Acquiring lock "10d6bce1-e55f-429c-816d-3bef9029560a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:09:03 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-bcfe5a47-92da-405c-9e52-c2ba1bbcd091 req-54cefd2b-4026-4ad8-9bd7-43276e0964f7 service nova] Lock "10d6bce1-e55f-429c-816d-3bef9029560a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:09:03 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-bcfe5a47-92da-405c-9e52-c2ba1bbcd091 req-54cefd2b-4026-4ad8-9bd7-43276e0964f7 service nova] Lock "10d6bce1-e55f-429c-816d-3bef9029560a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:09:03 user nova-compute[75229]: DEBUG nova.compute.manager [req-bcfe5a47-92da-405c-9e52-c2ba1bbcd091 req-54cefd2b-4026-4ad8-9bd7-43276e0964f7 service nova] [instance: 10d6bce1-e55f-429c-816d-3bef9029560a] No waiting events found dispatching network-vif-unplugged-ea04ea8d-43a6-4f64-9e0b-cc2927f214f5 {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 10:09:03 user nova-compute[75229]: WARNING nova.compute.manager [req-bcfe5a47-92da-405c-9e52-c2ba1bbcd091 req-54cefd2b-4026-4ad8-9bd7-43276e0964f7 service nova] [instance: 10d6bce1-e55f-429c-816d-3bef9029560a] Received unexpected event network-vif-unplugged-ea04ea8d-43a6-4f64-9e0b-cc2927f214f5 for instance with vm_state rescued and task_state unrescuing.
Nov 14 10:09:03 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:09:03 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:09:03 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:09:03 user nova-compute[75229]: DEBUG nova.compute.manager [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Starting heal instance info cache {{(pid=75229) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 10:09:03 user nova-compute[75229]: DEBUG nova.compute.manager [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Didn't find any instances for network info cache update. {{(pid=75229) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 14 10:09:04 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-f639eb23-28ee-4367-bdb7-03d15f8e7987 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.321s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 10:09:04 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-f639eb23-28ee-4367-bdb7-03d15f8e7987 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] <== connect_volume: return (1324ms) {'type': 'block', 'scsi_wwn': '23534373037373930', 'path': '/dev/sde'} {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 10:09:04 user nova-compute[75229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f639eb23-28ee-4367-bdb7-03d15f8e7987 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] [instance: 4a81b779-af09-4026-8387-07d44dad6ef7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23534373037373930', 'path': '/dev/sde'} {{(pid=75229) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 10:09:04 user nova-compute[75229]: DEBUG nova.virt.libvirt.vif [None req-f639eb23-28ee-4367-bdb7-03d15f8e7987 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T10:08:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-531012990',display_name='tempest-TestVolumeBootPattern-server-531012990',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-531012990',id=49,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB5A5mLvKIp6dvI0hO7rO3NlF4G2D20sY7gWEAC+0V/AEyka0aVsvCwYcGQ5KpPpLYwOEY7teK2+b3AO8avbXCe5MdbQ1NPGUWXRV3gtRowACc3Uq7kyXeekLcjWCRcSng==',key_name='tempest-TestVolumeBootPattern-2092695190',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='46620ac128944703899f22fe5439ba26',ramdisk_id='',reservation_id='r-4ncvyj02',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2064993142',owner_user_name='tempest-TestVolumeBootPattern-2064993142-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T10:08:58Z,user_data=None,user_id='c26f33e4cdf14ba796445959953f8685',uuid=4a81b779-af09-4026-8387-07d44dad6ef7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ca86bdcf-6fe2-4ceb-8e9c-6ff88e9efb71", "address": "fa:16:3e:35:44:4b", "network": {"id": "118ea7c1-77c0-4660-b7b7-f311f6b0ec8a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1907578504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46620ac128944703899f22fe5439ba26", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca86bdcf-6f", "ovs_interfaceid": "ca86bdcf-6fe2-4ceb-8e9c-6ff88e9efb71", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75229) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 10:09:04 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-f639eb23-28ee-4367-bdb7-03d15f8e7987 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Converting VIF {"id": "ca86bdcf-6fe2-4ceb-8e9c-6ff88e9efb71", "address": "fa:16:3e:35:44:4b", "network": {"id": "118ea7c1-77c0-4660-b7b7-f311f6b0ec8a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1907578504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46620ac128944703899f22fe5439ba26", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca86bdcf-6f", "ovs_interfaceid": "ca86bdcf-6fe2-4ceb-8e9c-6ff88e9efb71", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 10:09:04 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-f639eb23-28ee-4367-bdb7-03d15f8e7987 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:35:44:4b,bridge_name='br-int',has_traffic_filtering=True,id=ca86bdcf-6fe2-4ceb-8e9c-6ff88e9efb71,network=Network(118ea7c1-77c0-4660-b7b7-f311f6b0ec8a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapca86bdcf-6f') {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 10:09:04 user nova-compute[75229]: DEBUG nova.objects.instance [None req-f639eb23-28ee-4367-bdb7-03d15f8e7987 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Lazy-loading 'pci_devices' on Instance uuid 4a81b779-af09-4026-8387-07d44dad6ef7 {{(pid=75229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 10:09:04 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-f639eb23-28ee-4367-bdb7-03d15f8e7987 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] [instance: 4a81b779-af09-4026-8387-07d44dad6ef7] End _get_guest_xml xml=<domain type="kvm">
Nov 14 10:09:04 user nova-compute[75229]:   <uuid>4a81b779-af09-4026-8387-07d44dad6ef7</uuid>
Nov 14 10:09:04 user nova-compute[75229]:   <name>instance-00000031</name>
Nov 14 10:09:04 user nova-compute[75229]:   <memory>524288</memory>
Nov 14 10:09:04 user nova-compute[75229]:   <vcpu>1</vcpu>
Nov 14 10:09:04 user nova-compute[75229]:   <metadata>
Nov 14 10:09:04 user nova-compute[75229]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 10:09:04 user nova-compute[75229]:       <nova:package version="0.0.0"/>
Nov 14 10:09:04 user nova-compute[75229]:       <nova:name>tempest-TestVolumeBootPattern-server-531012990</nova:name>
Nov 14 10:09:04 user nova-compute[75229]:       <nova:creationTime>2023-11-14 10:09:02</nova:creationTime>
Nov 14 10:09:04 user nova-compute[75229]:       <nova:flavor name="m1.tiny">
Nov 14 10:09:04 user nova-compute[75229]:         <nova:memory>512</nova:memory>
Nov 14 10:09:04 user nova-compute[75229]:         <nova:disk>1</nova:disk>
Nov 14 10:09:04 user nova-compute[75229]:         <nova:swap>0</nova:swap>
Nov 14 10:09:04 user nova-compute[75229]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 10:09:04 user nova-compute[75229]:         <nova:vcpus>1</nova:vcpus>
Nov 14 10:09:04 user nova-compute[75229]:       </nova:flavor>
Nov 14 10:09:04 user nova-compute[75229]:       <nova:owner>
Nov 14 10:09:04 user nova-compute[75229]:         <nova:user uuid="c26f33e4cdf14ba796445959953f8685">tempest-TestVolumeBootPattern-2064993142-project-member</nova:user>
Nov 14 10:09:04 user nova-compute[75229]:         <nova:project uuid="46620ac128944703899f22fe5439ba26">tempest-TestVolumeBootPattern-2064993142</nova:project>
Nov 14 10:09:04 user nova-compute[75229]:       </nova:owner>
Nov 14 10:09:04 user nova-compute[75229]:       <nova:ports>
Nov 14 10:09:04 user nova-compute[75229]:         <nova:port uuid="ca86bdcf-6fe2-4ceb-8e9c-6ff88e9efb71">
Nov 14 10:09:04 user nova-compute[75229]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 14 10:09:04 user nova-compute[75229]:         </nova:port>
Nov 14 10:09:04 user nova-compute[75229]:       </nova:ports>
Nov 14 10:09:04 user nova-compute[75229]:     </nova:instance>
Nov 14 10:09:04 user nova-compute[75229]:   </metadata>
Nov 14 10:09:04 user nova-compute[75229]:   <sysinfo type="smbios">
Nov 14 10:09:04 user nova-compute[75229]:     <system>
Nov 14 10:09:04 user nova-compute[75229]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 10:09:04 user nova-compute[75229]:       <entry name="product">OpenStack Nova</entry>
Nov 14 10:09:04 user nova-compute[75229]:       <entry name="version">0.0.0</entry>
Nov 14 10:09:04 user nova-compute[75229]:       <entry name="serial">4a81b779-af09-4026-8387-07d44dad6ef7</entry>
Nov 14 10:09:04 user nova-compute[75229]:       <entry name="uuid">4a81b779-af09-4026-8387-07d44dad6ef7</entry>
Nov 14 10:09:04 user nova-compute[75229]:       <entry name="family">Virtual Machine</entry>
Nov 14 10:09:04 user nova-compute[75229]:     </system>
Nov 14 10:09:04 user nova-compute[75229]:   </sysinfo>
Nov 14 10:09:04 user nova-compute[75229]:   <os>
Nov 14 10:09:04 user nova-compute[75229]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 10:09:04 user nova-compute[75229]:     <boot dev="hd"/>
Nov 14 10:09:04 user nova-compute[75229]:     <smbios mode="sysinfo"/>
Nov 14 10:09:04 user nova-compute[75229]:   </os>
Nov 14 10:09:04 user nova-compute[75229]:   <features>
Nov 14 10:09:04 user nova-compute[75229]:     <acpi/>
Nov 14 10:09:04 user nova-compute[75229]:     <apic/>
Nov 14 10:09:04 user nova-compute[75229]:     <vmcoreinfo/>
Nov 14 10:09:04 user nova-compute[75229]:   </features>
Nov 14 10:09:04 user nova-compute[75229]:   <clock offset="utc">
Nov 14 10:09:04 user nova-compute[75229]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 10:09:04 user nova-compute[75229]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 10:09:04 user nova-compute[75229]:     <timer name="hpet" present="no"/>
Nov 14 10:09:04 user nova-compute[75229]:   </clock>
Nov 14 10:09:04 user nova-compute[75229]:   <cpu mode="custom" match="exact">
Nov 14 10:09:04 user nova-compute[75229]:     <model>Nehalem</model>
Nov 14 10:09:04 user nova-compute[75229]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 10:09:04 user nova-compute[75229]:   </cpu>
Nov 14 10:09:04 user nova-compute[75229]:   <devices>
Nov 14 10:09:04 user nova-compute[75229]:     <disk type="block" device="disk">
Nov 14 10:09:04 user nova-compute[75229]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 10:09:04 user nova-compute[75229]:       <source dev="/dev/sde"/>
Nov 14 10:09:04 user nova-compute[75229]:       <target dev="vda" bus="virtio"/>
Nov 14 10:09:04 user nova-compute[75229]:       <serial>c8892c7d-49e8-4f65-b88c-1e14fba8f50a</serial>
Nov 14 10:09:04 user nova-compute[75229]:     </disk>
Nov 14 10:09:04 user nova-compute[75229]:     <interface type="ethernet">
Nov 14 10:09:04 user nova-compute[75229]:       <mac address="fa:16:3e:35:44:4b"/>
Nov 14 10:09:04 user nova-compute[75229]:       <model type="virtio"/>
Nov 14 10:09:04 user nova-compute[75229]:       <mtu size="1442"/>
Nov 14 10:09:04 user nova-compute[75229]:       <target dev="tapca86bdcf-6f"/>
Nov 14 10:09:04 user nova-compute[75229]:     </interface>
Nov 14 10:09:04 user nova-compute[75229]:     <serial type="pty">
Nov 14 10:09:04 user nova-compute[75229]:       <log file="/opt/stack/data/nova/instances/4a81b779-af09-4026-8387-07d44dad6ef7/console.log" append="off"/>
Nov 14 10:09:04 user nova-compute[75229]:     </serial>
Nov 14 10:09:04 user nova-compute[75229]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 10:09:04 user nova-compute[75229]:     <video>
Nov 14 10:09:04 user nova-compute[75229]:       <model type="virtio"/>
Nov 14 10:09:04 user nova-compute[75229]:     </video>
Nov 14 10:09:04 user nova-compute[75229]:     <rng model="virtio">
Nov 14 10:09:04 user nova-compute[75229]:       <backend model="random">/dev/urandom</backend>
Nov 14 10:09:04 user nova-compute[75229]:     </rng>
Nov 14 10:09:04 user nova-compute[75229]:     <controller type="usb" index="0" model="none"/>
Nov 14 10:09:04 user nova-compute[75229]:     <memballoon model="virtio">
Nov 14 10:09:04 user nova-compute[75229]:       <stats period="10"/>
Nov 14 10:09:04 user nova-compute[75229]:     </memballoon>
Nov 14 10:09:04 user nova-compute[75229]:   </devices>
Nov 14 10:09:04 user nova-compute[75229]: </domain>
Nov 14 10:09:04 user nova-compute[75229]:  {{(pid=75229) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 10:09:04 user nova-compute[75229]: DEBUG nova.virt.libvirt.vif [None req-f639eb23-28ee-4367-bdb7-03d15f8e7987 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T10:08:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-531012990',display_name='tempest-TestVolumeBootPattern-server-531012990',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-531012990',id=49,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB5A5mLvKIp6dvI0hO7rO3NlF4G2D20sY7gWEAC+0V/AEyka0aVsvCwYcGQ5KpPpLYwOEY7teK2+b3AO8avbXCe5MdbQ1NPGUWXRV3gtRowACc3Uq7kyXeekLcjWCRcSng==',key_name='tempest-TestVolumeBootPattern-2092695190',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='46620ac128944703899f22fe5439ba26',ramdisk_id='',reservation_id='r-4ncvyj02',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2064993142',owner_user_name='tempest-TestVolumeBootPattern-2064993142-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T10:08:58Z,user_data=None,user_id='c26f33e4cdf14ba796445959953f8685',uuid=4a81b779-af09-4026-8387-07d44dad6ef7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ca86bdcf-6fe2-4ceb-8e9c-6ff88e9efb71", "address": "fa:16:3e:35:44:4b", "network": {"id": "118ea7c1-77c0-4660-b7b7-f311f6b0ec8a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1907578504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46620ac128944703899f22fe5439ba26", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca86bdcf-6f", "ovs_interfaceid": "ca86bdcf-6fe2-4ceb-8e9c-6ff88e9efb71", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 10:09:04 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-f639eb23-28ee-4367-bdb7-03d15f8e7987 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Converting VIF {"id": "ca86bdcf-6fe2-4ceb-8e9c-6ff88e9efb71", "address": "fa:16:3e:35:44:4b", "network": {"id": "118ea7c1-77c0-4660-b7b7-f311f6b0ec8a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1907578504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46620ac128944703899f22fe5439ba26", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca86bdcf-6f", "ovs_interfaceid": "ca86bdcf-6fe2-4ceb-8e9c-6ff88e9efb71", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 10:09:04 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-f639eb23-28ee-4367-bdb7-03d15f8e7987 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:35:44:4b,bridge_name='br-int',has_traffic_filtering=True,id=ca86bdcf-6fe2-4ceb-8e9c-6ff88e9efb71,network=Network(118ea7c1-77c0-4660-b7b7-f311f6b0ec8a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapca86bdcf-6f') {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 10:09:04 user nova-compute[75229]: DEBUG os_vif [None req-f639eb23-28ee-4367-bdb7-03d15f8e7987 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:35:44:4b,bridge_name='br-int',has_traffic_filtering=True,id=ca86bdcf-6fe2-4ceb-8e9c-6ff88e9efb71,network=Network(118ea7c1-77c0-4660-b7b7-f311f6b0ec8a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapca86bdcf-6f') {{(pid=75229) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 10:09:04 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:09:04 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 10:09:04 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 10:09:04 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:09:04 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '31527205-6afb-5696-9b3e-36120b08adf3', '_type': 'linux-noop'}}, row=False) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 10:09:04 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:09:04 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 10:09:04 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:09:04 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:09:04 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapca86bdcf-6f, may_exist=True, interface_attrs={}) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 10:09:04 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapca86bdcf-6f, col_values=(('qos', UUID('6e878e7d-55c2-442b-8cc9-0a2682031b99')),), if_exists=True) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 10:09:04 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapca86bdcf-6f, col_values=(('external_ids', {'iface-id': 'ca86bdcf-6fe2-4ceb-8e9c-6ff88e9efb71', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:35:44:4b', 'vm-uuid': '4a81b779-af09-4026-8387-07d44dad6ef7'}),), if_exists=True) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 10:09:04 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:09:04 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 10:09:04 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:09:04 user nova-compute[75229]: INFO os_vif [None req-f639eb23-28ee-4367-bdb7-03d15f8e7987 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:35:44:4b,bridge_name='br-int',has_traffic_filtering=True,id=ca86bdcf-6fe2-4ceb-8e9c-6ff88e9efb71,network=Network(118ea7c1-77c0-4660-b7b7-f311f6b0ec8a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapca86bdcf-6f')
Nov 14 10:09:04 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-f639eb23-28ee-4367-bdb7-03d15f8e7987 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] No BDM found with device name vda, not building metadata. {{(pid=75229) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 10:09:04 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-f639eb23-28ee-4367-bdb7-03d15f8e7987 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] No VIF found with MAC fa:16:3e:35:44:4b, not building metadata {{(pid=75229) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 10:09:04 user nova-compute[75229]: INFO nova.virt.libvirt.driver [-] [instance: 10d6bce1-e55f-429c-816d-3bef9029560a] Instance destroyed successfully.
Nov 14 10:09:05 user nova-compute[75229]: DEBUG nova.compute.manager [req-a3799e56-8270-4adc-8563-372b71e483ac req-ad5029f9-e177-4c3a-a912-33c916f42398 service nova] [instance: 10d6bce1-e55f-429c-816d-3bef9029560a] Received event network-vif-plugged-ea04ea8d-43a6-4f64-9e0b-cc2927f214f5 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 10:09:05 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-a3799e56-8270-4adc-8563-372b71e483ac req-ad5029f9-e177-4c3a-a912-33c916f42398 service nova] Acquiring lock "10d6bce1-e55f-429c-816d-3bef9029560a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:09:05 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-a3799e56-8270-4adc-8563-372b71e483ac req-ad5029f9-e177-4c3a-a912-33c916f42398 service nova] Lock "10d6bce1-e55f-429c-816d-3bef9029560a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:09:05 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-a3799e56-8270-4adc-8563-372b71e483ac req-ad5029f9-e177-4c3a-a912-33c916f42398 service nova] Lock "10d6bce1-e55f-429c-816d-3bef9029560a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:09:05 user nova-compute[75229]: DEBUG nova.compute.manager [req-a3799e56-8270-4adc-8563-372b71e483ac req-ad5029f9-e177-4c3a-a912-33c916f42398 service nova] [instance: 10d6bce1-e55f-429c-816d-3bef9029560a] No waiting events found dispatching network-vif-plugged-ea04ea8d-43a6-4f64-9e0b-cc2927f214f5 {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 10:09:05 user nova-compute[75229]: WARNING nova.compute.manager [req-a3799e56-8270-4adc-8563-372b71e483ac req-ad5029f9-e177-4c3a-a912-33c916f42398 service nova] [instance: 10d6bce1-e55f-429c-816d-3bef9029560a] Received unexpected event network-vif-plugged-ea04ea8d-43a6-4f64-9e0b-cc2927f214f5 for instance with vm_state rescued and task_state unrescuing.
Nov 14 10:09:06 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:09:06 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:09:06 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:09:06 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:09:06 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:09:06 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:09:06 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:09:06 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:09:06 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:09:06 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:09:06 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:09:07 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:09:07 user nova-compute[75229]: DEBUG nova.compute.manager [req-05cdc64f-e168-43c1-8c1b-35c07dffdf8e req-f415e19c-9523-4a4e-bcd4-d7756641d8b8 service nova] [instance: 4a81b779-af09-4026-8387-07d44dad6ef7] Received event network-vif-plugged-ca86bdcf-6fe2-4ceb-8e9c-6ff88e9efb71 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 10:09:07 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-05cdc64f-e168-43c1-8c1b-35c07dffdf8e req-f415e19c-9523-4a4e-bcd4-d7756641d8b8 service nova] Acquiring lock "4a81b779-af09-4026-8387-07d44dad6ef7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:09:07 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-05cdc64f-e168-43c1-8c1b-35c07dffdf8e req-f415e19c-9523-4a4e-bcd4-d7756641d8b8 service nova] Lock "4a81b779-af09-4026-8387-07d44dad6ef7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:09:07 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-05cdc64f-e168-43c1-8c1b-35c07dffdf8e req-f415e19c-9523-4a4e-bcd4-d7756641d8b8 service nova] Lock "4a81b779-af09-4026-8387-07d44dad6ef7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:09:07 user nova-compute[75229]: DEBUG nova.compute.manager [req-05cdc64f-e168-43c1-8c1b-35c07dffdf8e req-f415e19c-9523-4a4e-bcd4-d7756641d8b8 service nova] [instance: 4a81b779-af09-4026-8387-07d44dad6ef7] No waiting events found dispatching network-vif-plugged-ca86bdcf-6fe2-4ceb-8e9c-6ff88e9efb71 {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 10:09:07 user nova-compute[75229]: WARNING nova.compute.manager [req-05cdc64f-e168-43c1-8c1b-35c07dffdf8e req-f415e19c-9523-4a4e-bcd4-d7756641d8b8 service nova] [instance: 4a81b779-af09-4026-8387-07d44dad6ef7] Received unexpected event network-vif-plugged-ca86bdcf-6fe2-4ceb-8e9c-6ff88e9efb71 for instance with vm_state building and task_state spawning.
Nov 14 10:09:07 user nova-compute[75229]: DEBUG nova.compute.manager [req-05cdc64f-e168-43c1-8c1b-35c07dffdf8e req-f415e19c-9523-4a4e-bcd4-d7756641d8b8 service nova] [instance: 4a81b779-af09-4026-8387-07d44dad6ef7] Received event network-vif-plugged-ca86bdcf-6fe2-4ceb-8e9c-6ff88e9efb71 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 10:09:07 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-05cdc64f-e168-43c1-8c1b-35c07dffdf8e req-f415e19c-9523-4a4e-bcd4-d7756641d8b8 service nova] Acquiring lock "4a81b779-af09-4026-8387-07d44dad6ef7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:09:07 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-05cdc64f-e168-43c1-8c1b-35c07dffdf8e req-f415e19c-9523-4a4e-bcd4-d7756641d8b8 service nova] Lock "4a81b779-af09-4026-8387-07d44dad6ef7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:09:07 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-05cdc64f-e168-43c1-8c1b-35c07dffdf8e req-f415e19c-9523-4a4e-bcd4-d7756641d8b8 service nova] Lock "4a81b779-af09-4026-8387-07d44dad6ef7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:09:07 user nova-compute[75229]: DEBUG nova.compute.manager [req-05cdc64f-e168-43c1-8c1b-35c07dffdf8e req-f415e19c-9523-4a4e-bcd4-d7756641d8b8 service nova] [instance: 4a81b779-af09-4026-8387-07d44dad6ef7] No waiting events found dispatching network-vif-plugged-ca86bdcf-6fe2-4ceb-8e9c-6ff88e9efb71 {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 10:09:07 user nova-compute[75229]: WARNING nova.compute.manager [req-05cdc64f-e168-43c1-8c1b-35c07dffdf8e req-f415e19c-9523-4a4e-bcd4-d7756641d8b8 service nova] [instance: 4a81b779-af09-4026-8387-07d44dad6ef7] Received unexpected event network-vif-plugged-ca86bdcf-6fe2-4ceb-8e9c-6ff88e9efb71 for instance with vm_state building and task_state spawning.
Nov 14 10:09:07 user nova-compute[75229]: DEBUG nova.compute.manager [req-05cdc64f-e168-43c1-8c1b-35c07dffdf8e req-f415e19c-9523-4a4e-bcd4-d7756641d8b8 service nova] [instance: 10d6bce1-e55f-429c-816d-3bef9029560a] Received event network-vif-plugged-ea04ea8d-43a6-4f64-9e0b-cc2927f214f5 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 10:09:07 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-05cdc64f-e168-43c1-8c1b-35c07dffdf8e req-f415e19c-9523-4a4e-bcd4-d7756641d8b8 service nova] Acquiring lock "10d6bce1-e55f-429c-816d-3bef9029560a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:09:07 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-05cdc64f-e168-43c1-8c1b-35c07dffdf8e req-f415e19c-9523-4a4e-bcd4-d7756641d8b8 service nova] Lock "10d6bce1-e55f-429c-816d-3bef9029560a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:09:07 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-05cdc64f-e168-43c1-8c1b-35c07dffdf8e req-f415e19c-9523-4a4e-bcd4-d7756641d8b8 service nova] Lock "10d6bce1-e55f-429c-816d-3bef9029560a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:09:07 user nova-compute[75229]: DEBUG nova.compute.manager [req-05cdc64f-e168-43c1-8c1b-35c07dffdf8e req-f415e19c-9523-4a4e-bcd4-d7756641d8b8 service nova] [instance: 10d6bce1-e55f-429c-816d-3bef9029560a] No waiting events found dispatching network-vif-plugged-ea04ea8d-43a6-4f64-9e0b-cc2927f214f5 {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 10:09:07 user nova-compute[75229]: WARNING nova.compute.manager [req-05cdc64f-e168-43c1-8c1b-35c07dffdf8e req-f415e19c-9523-4a4e-bcd4-d7756641d8b8 service nova] [instance: 10d6bce1-e55f-429c-816d-3bef9029560a] Received unexpected event network-vif-plugged-ea04ea8d-43a6-4f64-9e0b-cc2927f214f5 for instance with vm_state rescued and task_state unrescuing.
Nov 14 10:09:07 user nova-compute[75229]: DEBUG nova.compute.manager [req-05cdc64f-e168-43c1-8c1b-35c07dffdf8e req-f415e19c-9523-4a4e-bcd4-d7756641d8b8 service nova] [instance: 10d6bce1-e55f-429c-816d-3bef9029560a] Received event network-vif-plugged-ea04ea8d-43a6-4f64-9e0b-cc2927f214f5 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 10:09:07 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-05cdc64f-e168-43c1-8c1b-35c07dffdf8e req-f415e19c-9523-4a4e-bcd4-d7756641d8b8 service nova] Acquiring lock "10d6bce1-e55f-429c-816d-3bef9029560a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:09:07 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-05cdc64f-e168-43c1-8c1b-35c07dffdf8e req-f415e19c-9523-4a4e-bcd4-d7756641d8b8 service nova] Lock "10d6bce1-e55f-429c-816d-3bef9029560a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:09:07 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-05cdc64f-e168-43c1-8c1b-35c07dffdf8e req-f415e19c-9523-4a4e-bcd4-d7756641d8b8 service nova] Lock "10d6bce1-e55f-429c-816d-3bef9029560a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:09:07 user nova-compute[75229]: DEBUG nova.compute.manager [req-05cdc64f-e168-43c1-8c1b-35c07dffdf8e req-f415e19c-9523-4a4e-bcd4-d7756641d8b8 service nova] [instance: 10d6bce1-e55f-429c-816d-3bef9029560a] No waiting events found dispatching network-vif-plugged-ea04ea8d-43a6-4f64-9e0b-cc2927f214f5 {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 10:09:07 user nova-compute[75229]: WARNING nova.compute.manager [req-05cdc64f-e168-43c1-8c1b-35c07dffdf8e req-f415e19c-9523-4a4e-bcd4-d7756641d8b8 service nova] [instance: 10d6bce1-e55f-429c-816d-3bef9029560a] Received unexpected event network-vif-plugged-ea04ea8d-43a6-4f64-9e0b-cc2927f214f5 for instance with vm_state rescued and task_state unrescuing.
Nov 14 10:09:08 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:09:08 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:09:08 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:09:08 user nova-compute[75229]: DEBUG nova.compute.manager [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75229) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 10:09:08 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:09:08 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:09:08 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:09:08 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:09:08 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Auditing locally available compute resources for user (node: user) {{(pid=75229) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 10:09:08 user nova-compute[75229]: DEBUG nova.compute.manager [None req-f639eb23-28ee-4367-bdb7-03d15f8e7987 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] [instance: 4a81b779-af09-4026-8387-07d44dad6ef7] Instance event wait completed in 0 seconds for  {{(pid=75229) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 10:09:08 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-f639eb23-28ee-4367-bdb7-03d15f8e7987 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] [instance: 4a81b779-af09-4026-8387-07d44dad6ef7] Guest created on hypervisor {{(pid=75229) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 10:09:08 user nova-compute[75229]: INFO nova.virt.libvirt.driver [-] [instance: 4a81b779-af09-4026-8387-07d44dad6ef7] Instance spawned successfully.
Nov 14 10:09:08 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-f639eb23-28ee-4367-bdb7-03d15f8e7987 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] [instance: 4a81b779-af09-4026-8387-07d44dad6ef7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 10:09:08 user nova-compute[75229]: DEBUG nova.compute.manager [None req-a30ff51b-e58a-4400-8334-05de63c3fd34 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] [instance: 10d6bce1-e55f-429c-816d-3bef9029560a] Checking state {{(pid=75229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 10:09:08 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-f639eb23-28ee-4367-bdb7-03d15f8e7987 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] [instance: 4a81b779-af09-4026-8387-07d44dad6ef7] Found default for hw_cdrom_bus of ide {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 10:09:08 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-f639eb23-28ee-4367-bdb7-03d15f8e7987 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] [instance: 4a81b779-af09-4026-8387-07d44dad6ef7] Found default for hw_disk_bus of virtio {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 10:09:08 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-f639eb23-28ee-4367-bdb7-03d15f8e7987 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] [instance: 4a81b779-af09-4026-8387-07d44dad6ef7] Found default for hw_input_bus of None {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 10:09:08 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-f639eb23-28ee-4367-bdb7-03d15f8e7987 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] [instance: 4a81b779-af09-4026-8387-07d44dad6ef7] Found default for hw_pointer_model of None {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 10:09:08 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-f639eb23-28ee-4367-bdb7-03d15f8e7987 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] [instance: 4a81b779-af09-4026-8387-07d44dad6ef7] Found default for hw_video_model of virtio {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 10:09:08 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-f639eb23-28ee-4367-bdb7-03d15f8e7987 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] [instance: 4a81b779-af09-4026-8387-07d44dad6ef7] Found default for hw_vif_model of virtio {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 10:09:08 user nova-compute[75229]: INFO nova.compute.manager [None req-f639eb23-28ee-4367-bdb7-03d15f8e7987 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] [instance: 4a81b779-af09-4026-8387-07d44dad6ef7] Took 6.35 seconds to spawn the instance on the hypervisor.
Nov 14 10:09:08 user nova-compute[75229]: DEBUG nova.compute.manager [None req-f639eb23-28ee-4367-bdb7-03d15f8e7987 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] [instance: 4a81b779-af09-4026-8387-07d44dad6ef7] Checking state {{(pid=75229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 10:09:08 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cda8c5ad-e70c-4021-bace-d55831c4bc78/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:09:09 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:09:09 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:09:09 user nova-compute[75229]: INFO nova.compute.manager [None req-f639eb23-28ee-4367-bdb7-03d15f8e7987 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] [instance: 4a81b779-af09-4026-8387-07d44dad6ef7] Took 11.89 seconds to build instance.
Nov 14 10:09:09 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-f639eb23-28ee-4367-bdb7-03d15f8e7987 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Lock "4a81b779-af09-4026-8387-07d44dad6ef7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.979s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:09:09 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cda8c5ad-e70c-4021-bace-d55831c4bc78/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:09:09 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cda8c5ad-e70c-4021-bace-d55831c4bc78/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:09:09 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cda8c5ad-e70c-4021-bace-d55831c4bc78/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:09:09 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/764de1b0-b77f-457a-8355-e5cdc1f6eab1/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:09:09 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/764de1b0-b77f-457a-8355-e5cdc1f6eab1/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:09:09 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/764de1b0-b77f-457a-8355-e5cdc1f6eab1/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:09:09 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/764de1b0-b77f-457a-8355-e5cdc1f6eab1/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:09:09 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1679275-ebb1-4f15-80a4-b8fd614fc34b/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:09:09 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1679275-ebb1-4f15-80a4-b8fd614fc34b/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:09:09 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1679275-ebb1-4f15-80a4-b8fd614fc34b/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:09:10 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1679275-ebb1-4f15-80a4-b8fd614fc34b/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:09:10 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75229) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 10:09:10 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75229) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 10:09:10 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75229) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 10:09:10 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68d9de39-cbd2-44b2-bda8-015c8482c240/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:09:10 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68d9de39-cbd2-44b2-bda8-015c8482c240/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:09:10 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68d9de39-cbd2-44b2-bda8-015c8482c240/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:09:10 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68d9de39-cbd2-44b2-bda8-015c8482c240/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:09:10 user nova-compute[75229]: WARNING nova.virt.libvirt.driver [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 10:09:10 user nova-compute[75229]: WARNING nova.virt.libvirt.driver [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 10:09:10 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Hypervisor/Node resource view: name=user free_ram=8381MB free_disk=24.910629272460938GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75229) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 10:09:10 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:09:10 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:09:11 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Instance cda8c5ad-e70c-4021-bace-d55831c4bc78 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 10:09:11 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Instance 30ae1f73-e0f3-4e26-987e-a684471a160d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 10:09:11 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Instance c1679275-ebb1-4f15-80a4-b8fd614fc34b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 10:09:11 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Instance 10d6bce1-e55f-429c-816d-3bef9029560a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 10:09:11 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Instance 764de1b0-b77f-457a-8355-e5cdc1f6eab1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 10:09:11 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Instance 68d9de39-cbd2-44b2-bda8-015c8482c240 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 10:09:11 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Instance 4a81b779-af09-4026-8387-07d44dad6ef7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 10:09:11 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=75229) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 10:09:11 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=75229) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 10:09:11 user nova-compute[75229]: WARNING nova.virt.libvirt.driver [None req-5a36c873-5248-4d57-8bd2-a06608c698b9 tempest-TestServerVolumeAttachmentScenario-1041667837 tempest-TestServerVolumeAttachmentScenario-1041667837-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 764de1b0-b77f-457a-8355-e5cdc1f6eab1 is timed out.
Nov 14 10:09:11 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-5a36c873-5248-4d57-8bd2-a06608c698b9 tempest-TestServerVolumeAttachmentScenario-1041667837 tempest-TestServerVolumeAttachmentScenario-1041667837-project-member] Successfully detached device vdb from instance 764de1b0-b77f-457a-8355-e5cdc1f6eab1 from the live domain config.
Nov 14 10:09:11 user nova-compute[75229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5a36c873-5248-4d57-8bd2-a06608c698b9 tempest-TestServerVolumeAttachmentScenario-1041667837 tempest-TestServerVolumeAttachmentScenario-1041667837-project-member] [instance: 764de1b0-b77f-457a-8355-e5cdc1f6eab1] calling os-brick to detach iSCSI Volume {{(pid=75229) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 10:09:11 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a36c873-5248-4d57-8bd2-a06608c698b9 tempest-TestServerVolumeAttachmentScenario-1041667837 tempest-TestServerVolumeAttachmentScenario-1041667837-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f73f85151b0>, {'target_iqn': 'iqn.2010-10.org.openstack:a8186f4e-9d39-4451-8fb5-1cee648efe1a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UYzrvaCH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 10:09:11 user nova-compute[75229]: WARNING os_brick.initiator.connectors.base [None req-5a36c873-5248-4d57-8bd2-a06608c698b9 tempest-TestServerVolumeAttachmentScenario-1041667837 tempest-TestServerVolumeAttachmentScenario-1041667837-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 10:09:11 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-5a36c873-5248-4d57-8bd2-a06608c698b9 tempest-TestServerVolumeAttachmentScenario-1041667837 tempest-TestServerVolumeAttachmentScenario-1041667837-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 10:09:11 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-5a36c873-5248-4d57-8bd2-a06608c698b9 tempest-TestServerVolumeAttachmentScenario-1041667837 tempest-TestServerVolumeAttachmentScenario-1041667837-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 10:09:11 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:09:11 user nova-compute[75229]: DEBUG nova.compute.provider_tree [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Inventory has not changed in ProviderTree for provider: d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 {{(pid=75229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 10:09:11 user nova-compute[75229]: DEBUG nova.scheduler.client.report [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Inventory has not changed for provider d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 10:09:11 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:09:11 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[acd3bf12-c2a0-4ac9-8c3a-07e967f3f33a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a8186f4e-9d39-4451-8fb5-1cee648efe1a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7aee6091-dab3-4c39-88a1-4bbb28dcab45\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c8892c7d-49e8-4f65-b88c-1e14fba8f50a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5aebc438-0289-44fe-ad84-4e696468f50e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:09:11 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a36c873-5248-4d57-8bd2-a06608c698b9 tempest-TestServerVolumeAttachmentScenario-1041667837 tempest-TestServerVolumeAttachmentScenario-1041667837-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 10:09:11 user nova-compute[75229]: No targets found.
Nov 14 10:09:11 user nova-compute[75229]: iSNS:
Nov 14 10:09:11 user nova-compute[75229]: No targets found.
Nov 14 10:09:11 user nova-compute[75229]: STATIC:
Nov 14 10:09:11 user nova-compute[75229]: Target: iqn.2010-10.org.openstack:a8186f4e-9d39-4451-8fb5-1cee648efe1a
Nov 14 10:09:11 user nova-compute[75229]:         Portal: 172.16.0.220:3260,-1
Nov 14 10:09:11 user nova-compute[75229]:                 Iface Name: default
Nov 14 10:09:11 user nova-compute[75229]: Target: iqn.2010-10.org.openstack:7aee6091-dab3-4c39-88a1-4bbb28dcab45
Nov 14 10:09:11 user nova-compute[75229]:         Portal: 172.16.0.220:3260,-1
Nov 14 10:09:11 user nova-compute[75229]:                 Iface Name: default
Nov 14 10:09:11 user nova-compute[75229]: Target: iqn.2010-10.org.openstack:c8892c7d-49e8-4f65-b88c-1e14fba8f50a
Nov 14 10:09:11 user nova-compute[75229]:         Portal: 172.16.0.220:3260,-1
Nov 14 10:09:11 user nova-compute[75229]:                 Iface Name: default
Nov 14 10:09:11 user nova-compute[75229]: Target: iqn.2010-10.org.openstack:5aebc438-0289-44fe-ad84-4e696468f50e
Nov 14 10:09:11 user nova-compute[75229]:         Portal: 172.16.0.220:3260,-1
Nov 14 10:09:11 user nova-compute[75229]:                 Iface Name: default
Nov 14 10:09:11 user nova-compute[75229]: FIRMWARE:
Nov 14 10:09:11 user nova-compute[75229]: No targets found.
Nov 14 10:09:11 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 10:09:11 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a36c873-5248-4d57-8bd2-a06608c698b9 tempest-TestServerVolumeAttachmentScenario-1041667837 tempest-TestServerVolumeAttachmentScenario-1041667837-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 10:09:11 user nova-compute[75229]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 10:09:11 user nova-compute[75229]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75229) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 10:09:11 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a36c873-5248-4d57-8bd2-a06608c698b9 tempest-TestServerVolumeAttachmentScenario-1041667837 tempest-TestServerVolumeAttachmentScenario-1041667837-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a8186f4e-9d39-4451-8fb5-1cee648efe1a', 0)] {{(pid=75229) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 10:09:11 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:09:11 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:09:11 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[882d8fd6-012f-4fa3-9fda-cfc37376d80f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5aebc438-0289-44fe-ad84-4e696468f50e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7aee6091-dab3-4c39-88a1-4bbb28dcab45\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a8186f4e-9d39-4451-8fb5-1cee648efe1a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c8892c7d-49e8-4f65-b88c-1e14fba8f50a\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:09:11 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:09:11 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Compute_service record updated for user:user {{(pid=75229) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 10:09:11 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.422s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:09:11 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:09:11 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[06ff150e-ab14-4ee7-92a1-749c85cb49e5]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aebc438-0289-44fe-ad84-4e696468f50e (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7aee6091-dab3-4c39-88a1-4bbb28dcab45 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8186f4e-9d39-4451-8fb5-1cee648efe1a (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8892c7d-49e8-4f65-b88c-1e14fba8f50a (non-flash)\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:09:11 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a36c873-5248-4d57-8bd2-a06608c698b9 tempest-TestServerVolumeAttachmentScenario-1041667837 tempest-TestServerVolumeAttachmentScenario-1041667837-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aebc438-0289-44fe-ad84-4e696468f50e (non-flash)
Nov 14 10:09:11 user nova-compute[75229]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7aee6091-dab3-4c39-88a1-4bbb28dcab45 (non-flash)
Nov 14 10:09:11 user nova-compute[75229]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8186f4e-9d39-4451-8fb5-1cee648efe1a (non-flash)
Nov 14 10:09:11 user nova-compute[75229]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8892c7d-49e8-4f65-b88c-1e14fba8f50a (non-flash)
Nov 14 10:09:11 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 10:09:11 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a36c873-5248-4d57-8bd2-a06608c698b9 tempest-TestServerVolumeAttachmentScenario-1041667837 tempest-TestServerVolumeAttachmentScenario-1041667837-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aebc438-0289-44fe-ad84-4e696468f50e (non-flash)
Nov 14 10:09:11 user nova-compute[75229]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7aee6091-dab3-4c39-88a1-4bbb28dcab45 (non-flash)
Nov 14 10:09:11 user nova-compute[75229]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8186f4e-9d39-4451-8fb5-1cee648efe1a (non-flash)
Nov 14 10:09:11 user nova-compute[75229]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8892c7d-49e8-4f65-b88c-1e14fba8f50a (non-flash)
Nov 14 10:09:11 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 10:09:11 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a36c873-5248-4d57-8bd2-a06608c698b9 tempest-TestServerVolumeAttachmentScenario-1041667837 tempest-TestServerVolumeAttachmentScenario-1041667837-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f73d4c51bd0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a8186f4e-9d39-4451-8fb5-1cee648efe1a'): ({'sdb'}, set())}) {{(pid=75229) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 10:09:11 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-5a36c873-5248-4d57-8bd2-a06608c698b9 tempest-TestServerVolumeAttachmentScenario-1041667837 tempest-TestServerVolumeAttachmentScenario-1041667837-project-member] Removing single pathed devices sdb {{(pid=75229) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 10:09:11 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:09:11 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:09:11 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b026b7d-b83b-4411-9e82-31c909aefc29]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:09:11 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:09:11 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:09:11 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e7bd6c6-4c27-4afa-9e55-7d0fd61ce0d7]: (4, ('ok\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:09:11 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-5a36c873-5248-4d57-8bd2-a06608c698b9 tempest-TestServerVolumeAttachmentScenario-1041667837 tempest-TestServerVolumeAttachmentScenario-1041667837-project-member] Flushing IO for device /dev/sdb {{(pid=75229) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 10:09:11 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:09:11 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:09:11 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f778ca8-f971-434a-8bbf-3ba6f3428fb2]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:09:11 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-5a36c873-5248-4d57-8bd2-a06608c698b9 tempest-TestServerVolumeAttachmentScenario-1041667837 tempest-TestServerVolumeAttachmentScenario-1041667837-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75229) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 10:09:11 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:09:11 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.044s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:09:11 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ea004cf-ef28-4d5c-8527-7f2e1baeb763]: (4, ('1', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:09:11 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-5a36c873-5248-4d57-8bd2-a06608c698b9 tempest-TestServerVolumeAttachmentScenario-1041667837 tempest-TestServerVolumeAttachmentScenario-1041667837-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75229) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 10:09:11 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-5a36c873-5248-4d57-8bd2-a06608c698b9 tempest-TestServerVolumeAttachmentScenario-1041667837 tempest-TestServerVolumeAttachmentScenario-1041667837-project-member] SCSI volumes sdb have been removed. {{(pid=75229) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 10:09:11 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a36c873-5248-4d57-8bd2-a06608c698b9 tempest-TestServerVolumeAttachmentScenario-1041667837 tempest-TestServerVolumeAttachmentScenario-1041667837-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a8186f4e-9d39-4451-8fb5-1cee648efe1a')] {{(pid=75229) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 10:09:11 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8186f4e-9d39-4451-8fb5-1cee648efe1a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:09:11 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8186f4e-9d39-4451-8fb5-1cee648efe1a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:09:11 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[d24fb256-d995-4c82-bc7f-5a7a578601cf]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:09:11 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a36c873-5248-4d57-8bd2-a06608c698b9 tempest-TestServerVolumeAttachmentScenario-1041667837 tempest-TestServerVolumeAttachmentScenario-1041667837-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 10:09:11 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8186f4e-9d39-4451-8fb5-1cee648efe1a -p 172.16.0.220:3260 --logout {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:09:11 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8186f4e-9d39-4451-8fb5-1cee648efe1a -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:09:11 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3afde3a-e865-4728-850b-0fd458839729]: (4, ('Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:a8186f4e-9d39-4451-8fb5-1cee648efe1a, portal: 172.16.0.220,3260]\nLogout of [sid: 50, target: iqn.2010-10.org.openstack:a8186f4e-9d39-4451-8fb5-1cee648efe1a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:09:11 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a36c873-5248-4d57-8bd2-a06608c698b9 tempest-TestServerVolumeAttachmentScenario-1041667837 tempest-TestServerVolumeAttachmentScenario-1041667837-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:a8186f4e-9d39-4451-8fb5-1cee648efe1a, portal: 172.16.0.220,3260]
Nov 14 10:09:11 user nova-compute[75229]: Logout of [sid: 50, target: iqn.2010-10.org.openstack:a8186f4e-9d39-4451-8fb5-1cee648efe1a, portal: 172.16.0.220,3260] successful.
Nov 14 10:09:11 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 10:09:11 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8186f4e-9d39-4451-8fb5-1cee648efe1a -p 172.16.0.220:3260 --op delete {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:09:11 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8186f4e-9d39-4451-8fb5-1cee648efe1a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:09:11 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[8072c3f1-4145-411b-9a89-fe16e7818629]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:09:11 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a36c873-5248-4d57-8bd2-a06608c698b9 tempest-TestServerVolumeAttachmentScenario-1041667837 tempest-TestServerVolumeAttachmentScenario-1041667837-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 10:09:11 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-5a36c873-5248-4d57-8bd2-a06608c698b9 tempest-TestServerVolumeAttachmentScenario-1041667837 tempest-TestServerVolumeAttachmentScenario-1041667837-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.326s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 10:09:11 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a36c873-5248-4d57-8bd2-a06608c698b9 tempest-TestServerVolumeAttachmentScenario-1041667837 tempest-TestServerVolumeAttachmentScenario-1041667837-project-member] <== disconnect_volume: return (328ms) None {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 10:09:11 user nova-compute[75229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5a36c873-5248-4d57-8bd2-a06608c698b9 tempest-TestServerVolumeAttachmentScenario-1041667837 tempest-TestServerVolumeAttachmentScenario-1041667837-project-member] [instance: 764de1b0-b77f-457a-8355-e5cdc1f6eab1] Disconnected iSCSI Volume {{(pid=75229) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 10:09:12 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:09:12 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:09:12 user nova-compute[75229]: DEBUG nova.objects.instance [None req-5a36c873-5248-4d57-8bd2-a06608c698b9 tempest-TestServerVolumeAttachmentScenario-1041667837 tempest-TestServerVolumeAttachmentScenario-1041667837-project-member] Lazy-loading 'flavor' on Instance uuid 764de1b0-b77f-457a-8355-e5cdc1f6eab1 {{(pid=75229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 10:09:12 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-5a36c873-5248-4d57-8bd2-a06608c698b9 tempest-TestServerVolumeAttachmentScenario-1041667837 tempest-TestServerVolumeAttachmentScenario-1041667837-project-member] Lock "764de1b0-b77f-457a-8355-e5cdc1f6eab1" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.668s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:09:14 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:09:14 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:09:16 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:09:19 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:09:19 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:09:24 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:09:24 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:09:29 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:09:29 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:09:34 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:09:34 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:09:39 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:09:39 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:09:41 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-12ca3043-cd1b-45de-be2a-bf4a07f91bea tempest-TestServerVolumeAttachmentScenario-1041667837 tempest-TestServerVolumeAttachmentScenario-1041667837-project-member] Acquiring lock "764de1b0-b77f-457a-8355-e5cdc1f6eab1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:09:41 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-12ca3043-cd1b-45de-be2a-bf4a07f91bea tempest-TestServerVolumeAttachmentScenario-1041667837 tempest-TestServerVolumeAttachmentScenario-1041667837-project-member] Lock "764de1b0-b77f-457a-8355-e5cdc1f6eab1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:09:41 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-12ca3043-cd1b-45de-be2a-bf4a07f91bea tempest-TestServerVolumeAttachmentScenario-1041667837 tempest-TestServerVolumeAttachmentScenario-1041667837-project-member] Acquiring lock "764de1b0-b77f-457a-8355-e5cdc1f6eab1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:09:41 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-12ca3043-cd1b-45de-be2a-bf4a07f91bea tempest-TestServerVolumeAttachmentScenario-1041667837 tempest-TestServerVolumeAttachmentScenario-1041667837-project-member] Lock "764de1b0-b77f-457a-8355-e5cdc1f6eab1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:09:41 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-12ca3043-cd1b-45de-be2a-bf4a07f91bea tempest-TestServerVolumeAttachmentScenario-1041667837 tempest-TestServerVolumeAttachmentScenario-1041667837-project-member] Lock "764de1b0-b77f-457a-8355-e5cdc1f6eab1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:09:41 user nova-compute[75229]: INFO nova.compute.manager [None req-12ca3043-cd1b-45de-be2a-bf4a07f91bea tempest-TestServerVolumeAttachmentScenario-1041667837 tempest-TestServerVolumeAttachmentScenario-1041667837-project-member] [instance: 764de1b0-b77f-457a-8355-e5cdc1f6eab1] Terminating instance
Nov 14 10:09:41 user nova-compute[75229]: DEBUG nova.compute.manager [None req-12ca3043-cd1b-45de-be2a-bf4a07f91bea tempest-TestServerVolumeAttachmentScenario-1041667837 tempest-TestServerVolumeAttachmentScenario-1041667837-project-member] [instance: 764de1b0-b77f-457a-8355-e5cdc1f6eab1] Start destroying the instance on the hypervisor. {{(pid=75229) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 10:09:41 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:09:41 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:09:41 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:09:41 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:09:41 user nova-compute[75229]: DEBUG nova.compute.manager [req-d4ddad43-db4b-4622-943b-385891c60565 req-6dd019be-b031-4950-87ad-af416942c841 service nova] [instance: 764de1b0-b77f-457a-8355-e5cdc1f6eab1] Received event network-vif-unplugged-09e96897-482d-402e-adcc-e8bf9010391d {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 10:09:41 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-d4ddad43-db4b-4622-943b-385891c60565 req-6dd019be-b031-4950-87ad-af416942c841 service nova] Acquiring lock "764de1b0-b77f-457a-8355-e5cdc1f6eab1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:09:41 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-d4ddad43-db4b-4622-943b-385891c60565 req-6dd019be-b031-4950-87ad-af416942c841 service nova] Lock "764de1b0-b77f-457a-8355-e5cdc1f6eab1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:09:41 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-d4ddad43-db4b-4622-943b-385891c60565 req-6dd019be-b031-4950-87ad-af416942c841 service nova] Lock "764de1b0-b77f-457a-8355-e5cdc1f6eab1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:09:41 user nova-compute[75229]: DEBUG nova.compute.manager [req-d4ddad43-db4b-4622-943b-385891c60565 req-6dd019be-b031-4950-87ad-af416942c841 service nova] [instance: 764de1b0-b77f-457a-8355-e5cdc1f6eab1] No waiting events found dispatching network-vif-unplugged-09e96897-482d-402e-adcc-e8bf9010391d {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 10:09:41 user nova-compute[75229]: DEBUG nova.compute.manager [req-d4ddad43-db4b-4622-943b-385891c60565 req-6dd019be-b031-4950-87ad-af416942c841 service nova] [instance: 764de1b0-b77f-457a-8355-e5cdc1f6eab1] Received event network-vif-unplugged-09e96897-482d-402e-adcc-e8bf9010391d for instance with task_state deleting. {{(pid=75229) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 10:09:42 user nova-compute[75229]: INFO nova.virt.libvirt.driver [-] [instance: 764de1b0-b77f-457a-8355-e5cdc1f6eab1] Instance destroyed successfully.
Nov 14 10:09:42 user nova-compute[75229]: DEBUG nova.objects.instance [None req-12ca3043-cd1b-45de-be2a-bf4a07f91bea tempest-TestServerVolumeAttachmentScenario-1041667837 tempest-TestServerVolumeAttachmentScenario-1041667837-project-member] Lazy-loading 'resources' on Instance uuid 764de1b0-b77f-457a-8355-e5cdc1f6eab1 {{(pid=75229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 10:09:42 user nova-compute[75229]: DEBUG nova.virt.libvirt.vif [None req-12ca3043-cd1b-45de-be2a-bf4a07f91bea tempest-TestServerVolumeAttachmentScenario-1041667837 tempest-TestServerVolumeAttachmentScenario-1041667837-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T10:05:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1685617180',display_name='tempest-TestServerVolumeAttachmentScenario-server-1685617180',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-1685617180',id=46,image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD79XoXeIgMnwTE/y9Tph2kig8sN23JlGJReIYWTL94EUr+1CcaCZFmtJksTfKMy6YewtU06l9jNgs56keZ4Fcdwo/XpWvKVOVkLl8Gkn4bSkE2q+LJNdRDti3vg7c9FEw==',key_name='tempest-keypair-2106072250',keypairs=<?>,launch_index=0,launched_at=2023-11-14T10:05:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f81daef5439a43b491516bf86286dedd',ramdisk_id='',reservation_id='r-0cld79i0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1041667837',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1041667837-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T10:05:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='02f3e8ddba2440a19e39667c631d05e6',uuid=764de1b0-b77f-457a-8355-e5cdc1f6eab1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "09e96897-482d-402e-adcc-e8bf9010391d", "address": "fa:16:3e:75:4a:25", "network": {"id": "84ceafdd-3b62-438f-bd6c-9a51224c1011", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1430955242-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.242", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f81daef5439a43b491516bf86286dedd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09e96897-48", "ovs_interfaceid": "09e96897-482d-402e-adcc-e8bf9010391d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 10:09:42 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-12ca3043-cd1b-45de-be2a-bf4a07f91bea tempest-TestServerVolumeAttachmentScenario-1041667837 tempest-TestServerVolumeAttachmentScenario-1041667837-project-member] Converting VIF {"id": "09e96897-482d-402e-adcc-e8bf9010391d", "address": "fa:16:3e:75:4a:25", "network": {"id": "84ceafdd-3b62-438f-bd6c-9a51224c1011", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1430955242-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.242", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f81daef5439a43b491516bf86286dedd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09e96897-48", "ovs_interfaceid": "09e96897-482d-402e-adcc-e8bf9010391d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 10:09:42 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-12ca3043-cd1b-45de-be2a-bf4a07f91bea tempest-TestServerVolumeAttachmentScenario-1041667837 tempest-TestServerVolumeAttachmentScenario-1041667837-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:75:4a:25,bridge_name='br-int',has_traffic_filtering=True,id=09e96897-482d-402e-adcc-e8bf9010391d,network=Network(84ceafdd-3b62-438f-bd6c-9a51224c1011),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09e96897-48') {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 10:09:42 user nova-compute[75229]: DEBUG os_vif [None req-12ca3043-cd1b-45de-be2a-bf4a07f91bea tempest-TestServerVolumeAttachmentScenario-1041667837 tempest-TestServerVolumeAttachmentScenario-1041667837-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:75:4a:25,bridge_name='br-int',has_traffic_filtering=True,id=09e96897-482d-402e-adcc-e8bf9010391d,network=Network(84ceafdd-3b62-438f-bd6c-9a51224c1011),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09e96897-48') {{(pid=75229) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 10:09:42 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:09:42 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap09e96897-48, bridge=br-int, if_exists=True) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 10:09:42 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:09:42 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 10:09:42 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:09:42 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=db8038e1-5bc9-4235-a06b-1647bfd1ec45) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 10:09:42 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:09:42 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:09:42 user nova-compute[75229]: INFO os_vif [None req-12ca3043-cd1b-45de-be2a-bf4a07f91bea tempest-TestServerVolumeAttachmentScenario-1041667837 tempest-TestServerVolumeAttachmentScenario-1041667837-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:75:4a:25,bridge_name='br-int',has_traffic_filtering=True,id=09e96897-482d-402e-adcc-e8bf9010391d,network=Network(84ceafdd-3b62-438f-bd6c-9a51224c1011),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09e96897-48')
Nov 14 10:09:42 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-12ca3043-cd1b-45de-be2a-bf4a07f91bea tempest-TestServerVolumeAttachmentScenario-1041667837 tempest-TestServerVolumeAttachmentScenario-1041667837-project-member] [instance: 764de1b0-b77f-457a-8355-e5cdc1f6eab1] Deleting instance files /opt/stack/data/nova/instances/764de1b0-b77f-457a-8355-e5cdc1f6eab1_del
Nov 14 10:09:42 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-12ca3043-cd1b-45de-be2a-bf4a07f91bea tempest-TestServerVolumeAttachmentScenario-1041667837 tempest-TestServerVolumeAttachmentScenario-1041667837-project-member] [instance: 764de1b0-b77f-457a-8355-e5cdc1f6eab1] Deletion of /opt/stack/data/nova/instances/764de1b0-b77f-457a-8355-e5cdc1f6eab1_del complete
Nov 14 10:09:42 user nova-compute[75229]: INFO nova.compute.manager [None req-12ca3043-cd1b-45de-be2a-bf4a07f91bea tempest-TestServerVolumeAttachmentScenario-1041667837 tempest-TestServerVolumeAttachmentScenario-1041667837-project-member] [instance: 764de1b0-b77f-457a-8355-e5cdc1f6eab1] Took 0.84 seconds to destroy the instance on the hypervisor.
Nov 14 10:09:42 user nova-compute[75229]: DEBUG oslo.service.loopingcall [None req-12ca3043-cd1b-45de-be2a-bf4a07f91bea tempest-TestServerVolumeAttachmentScenario-1041667837 tempest-TestServerVolumeAttachmentScenario-1041667837-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75229) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 10:09:42 user nova-compute[75229]: DEBUG nova.compute.manager [-] [instance: 764de1b0-b77f-457a-8355-e5cdc1f6eab1] Deallocating network for instance {{(pid=75229) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 10:09:42 user nova-compute[75229]: DEBUG nova.network.neutron [-] [instance: 764de1b0-b77f-457a-8355-e5cdc1f6eab1] deallocate_for_instance() {{(pid=75229) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 10:09:43 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:09:43 user nova-compute[75229]: DEBUG nova.network.neutron [-] [instance: 764de1b0-b77f-457a-8355-e5cdc1f6eab1] Updating instance_info_cache with network_info: [] {{(pid=75229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 10:09:43 user nova-compute[75229]: INFO nova.compute.manager [-] [instance: 764de1b0-b77f-457a-8355-e5cdc1f6eab1] Took 0.88 seconds to deallocate network for instance.
Nov 14 10:09:43 user nova-compute[75229]: DEBUG nova.compute.manager [req-a229ec9e-c5ba-4071-b674-4479a3a742eb req-85831c40-655c-4ba8-8c7b-d2c7a1bde118 service nova] [instance: 764de1b0-b77f-457a-8355-e5cdc1f6eab1] Received event network-vif-deleted-09e96897-482d-402e-adcc-e8bf9010391d {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 10:09:43 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-12ca3043-cd1b-45de-be2a-bf4a07f91bea tempest-TestServerVolumeAttachmentScenario-1041667837 tempest-TestServerVolumeAttachmentScenario-1041667837-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:09:43 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-12ca3043-cd1b-45de-be2a-bf4a07f91bea tempest-TestServerVolumeAttachmentScenario-1041667837 tempest-TestServerVolumeAttachmentScenario-1041667837-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:09:43 user nova-compute[75229]: DEBUG nova.compute.provider_tree [None req-12ca3043-cd1b-45de-be2a-bf4a07f91bea tempest-TestServerVolumeAttachmentScenario-1041667837 tempest-TestServerVolumeAttachmentScenario-1041667837-project-member] Inventory has not changed in ProviderTree for provider: d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 {{(pid=75229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 10:09:43 user nova-compute[75229]: DEBUG nova.scheduler.client.report [None req-12ca3043-cd1b-45de-be2a-bf4a07f91bea tempest-TestServerVolumeAttachmentScenario-1041667837 tempest-TestServerVolumeAttachmentScenario-1041667837-project-member] Inventory has not changed for provider d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 10:09:43 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-12ca3043-cd1b-45de-be2a-bf4a07f91bea tempest-TestServerVolumeAttachmentScenario-1041667837 tempest-TestServerVolumeAttachmentScenario-1041667837-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.236s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:09:43 user nova-compute[75229]: INFO nova.scheduler.client.report [None req-12ca3043-cd1b-45de-be2a-bf4a07f91bea tempest-TestServerVolumeAttachmentScenario-1041667837 tempest-TestServerVolumeAttachmentScenario-1041667837-project-member] Deleted allocations for instance 764de1b0-b77f-457a-8355-e5cdc1f6eab1
Nov 14 10:09:43 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-12ca3043-cd1b-45de-be2a-bf4a07f91bea tempest-TestServerVolumeAttachmentScenario-1041667837 tempest-TestServerVolumeAttachmentScenario-1041667837-project-member] Lock "764de1b0-b77f-457a-8355-e5cdc1f6eab1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.131s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:09:43 user nova-compute[75229]: DEBUG nova.compute.manager [req-65a0162d-d9f2-4590-ac5c-2c41fb9766ea req-c343766f-b214-411d-8205-5ad310a42324 service nova] [instance: 764de1b0-b77f-457a-8355-e5cdc1f6eab1] Received event network-vif-plugged-09e96897-482d-402e-adcc-e8bf9010391d {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 10:09:43 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-65a0162d-d9f2-4590-ac5c-2c41fb9766ea req-c343766f-b214-411d-8205-5ad310a42324 service nova] Acquiring lock "764de1b0-b77f-457a-8355-e5cdc1f6eab1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:09:43 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-65a0162d-d9f2-4590-ac5c-2c41fb9766ea req-c343766f-b214-411d-8205-5ad310a42324 service nova] Lock "764de1b0-b77f-457a-8355-e5cdc1f6eab1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:09:43 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-65a0162d-d9f2-4590-ac5c-2c41fb9766ea req-c343766f-b214-411d-8205-5ad310a42324 service nova] Lock "764de1b0-b77f-457a-8355-e5cdc1f6eab1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:09:43 user nova-compute[75229]: DEBUG nova.compute.manager [req-65a0162d-d9f2-4590-ac5c-2c41fb9766ea req-c343766f-b214-411d-8205-5ad310a42324 service nova] [instance: 764de1b0-b77f-457a-8355-e5cdc1f6eab1] No waiting events found dispatching network-vif-plugged-09e96897-482d-402e-adcc-e8bf9010391d {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 10:09:43 user nova-compute[75229]: WARNING nova.compute.manager [req-65a0162d-d9f2-4590-ac5c-2c41fb9766ea req-c343766f-b214-411d-8205-5ad310a42324 service nova] [instance: 764de1b0-b77f-457a-8355-e5cdc1f6eab1] Received unexpected event network-vif-plugged-09e96897-482d-402e-adcc-e8bf9010391d for instance with vm_state deleted and task_state None.
Nov 14 10:09:47 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:09:52 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 10:09:52 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:09:52 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75229) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 10:09:52 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75229) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 10:09:52 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75229) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 10:09:52 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:09:57 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:09:59 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:10:02 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 10:10:04 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:10:04 user nova-compute[75229]: DEBUG nova.compute.manager [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Starting heal instance info cache {{(pid=75229) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 10:10:04 user nova-compute[75229]: DEBUG nova.compute.manager [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Rebuilding the list of instances to heal {{(pid=75229) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 10:10:04 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Acquiring lock "refresh_cache-cda8c5ad-e70c-4021-bace-d55831c4bc78" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 10:10:04 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Acquired lock "refresh_cache-cda8c5ad-e70c-4021-bace-d55831c4bc78" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 10:10:04 user nova-compute[75229]: DEBUG nova.network.neutron [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] [instance: cda8c5ad-e70c-4021-bace-d55831c4bc78] Forcefully refreshing network info cache for instance {{(pid=75229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 10:10:04 user nova-compute[75229]: DEBUG nova.objects.instance [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Lazy-loading 'info_cache' on Instance uuid cda8c5ad-e70c-4021-bace-d55831c4bc78 {{(pid=75229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 10:10:05 user nova-compute[75229]: DEBUG nova.network.neutron [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] [instance: cda8c5ad-e70c-4021-bace-d55831c4bc78] Updating instance_info_cache with network_info: [{"id": "c88498e8-25f8-4546-b007-b1dc853b3ccb", "address": "fa:16:3e:c4:17:f3", "network": {"id": "6a700b61-4aa6-440b-87e6-a3525a5cb918", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-448680331-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8babb73006da4977a1fe2bdb35e08d8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc88498e8-25", "ovs_interfaceid": "c88498e8-25f8-4546-b007-b1dc853b3ccb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 10:10:05 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Releasing lock "refresh_cache-cda8c5ad-e70c-4021-bace-d55831c4bc78" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 10:10:05 user nova-compute[75229]: DEBUG nova.compute.manager [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] [instance: cda8c5ad-e70c-4021-bace-d55831c4bc78] Updated the network info_cache for instance {{(pid=75229) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 10:10:06 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:10:06 user nova-compute[75229]: DEBUG nova.compute.manager [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Cleaning up deleted instances {{(pid=75229) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 14 10:10:06 user nova-compute[75229]: DEBUG nova.compute.manager [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] There are 0 instances to clean {{(pid=75229) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 14 10:10:07 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 10:10:08 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:10:08 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:10:09 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:10:09 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:10:09 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:10:09 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:10:09 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Auditing locally available compute resources for user (node: user) {{(pid=75229) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 10:10:09 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cda8c5ad-e70c-4021-bace-d55831c4bc78/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:10:10 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cda8c5ad-e70c-4021-bace-d55831c4bc78/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:10:10 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cda8c5ad-e70c-4021-bace-d55831c4bc78/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:10:10 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cda8c5ad-e70c-4021-bace-d55831c4bc78/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:10:10 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1679275-ebb1-4f15-80a4-b8fd614fc34b/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:10:10 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1679275-ebb1-4f15-80a4-b8fd614fc34b/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:10:10 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1679275-ebb1-4f15-80a4-b8fd614fc34b/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:10:10 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1679275-ebb1-4f15-80a4-b8fd614fc34b/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:10:10 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75229) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 10:10:10 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75229) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 10:10:10 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75229) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 10:10:10 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68d9de39-cbd2-44b2-bda8-015c8482c240/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:10:10 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68d9de39-cbd2-44b2-bda8-015c8482c240/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:10:10 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68d9de39-cbd2-44b2-bda8-015c8482c240/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:10:11 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68d9de39-cbd2-44b2-bda8-015c8482c240/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:10:11 user nova-compute[75229]: WARNING nova.virt.libvirt.driver [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 10:10:11 user nova-compute[75229]: WARNING nova.virt.libvirt.driver [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 10:10:11 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Hypervisor/Node resource view: name=user free_ram=8393MB free_disk=24.937095642089844GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75229) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 10:10:11 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:10:11 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:10:11 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Instance cda8c5ad-e70c-4021-bace-d55831c4bc78 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 10:10:11 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Instance 30ae1f73-e0f3-4e26-987e-a684471a160d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 10:10:11 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Instance c1679275-ebb1-4f15-80a4-b8fd614fc34b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 10:10:11 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Instance 10d6bce1-e55f-429c-816d-3bef9029560a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 10:10:11 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Instance 68d9de39-cbd2-44b2-bda8-015c8482c240 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 10:10:11 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Instance 4a81b779-af09-4026-8387-07d44dad6ef7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 10:10:11 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=75229) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 10:10:11 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=75229) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 10:10:11 user nova-compute[75229]: DEBUG nova.scheduler.client.report [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Refreshing inventories for resource provider d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 {{(pid=75229) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 14 10:10:11 user nova-compute[75229]: DEBUG nova.scheduler.client.report [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Updating ProviderTree inventory for provider d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75229) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 14 10:10:11 user nova-compute[75229]: DEBUG nova.compute.provider_tree [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Updating inventory in ProviderTree for provider d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 14 10:10:11 user nova-compute[75229]: DEBUG nova.scheduler.client.report [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Refreshing aggregate associations for resource provider d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3, aggregates: None {{(pid=75229) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 14 10:10:11 user nova-compute[75229]: DEBUG nova.scheduler.client.report [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Refreshing trait associations for resource provider d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3, traits: COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_MMX,HW_CPU_X86_SSE42,HW_CPU_X86_SSSE3,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_TRUSTED_CERTS,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSE,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_USB,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_RESCUE_BFV {{(pid=75229) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 14 10:10:11 user nova-compute[75229]: DEBUG nova.compute.provider_tree [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Inventory has not changed in ProviderTree for provider: d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 {{(pid=75229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 10:10:11 user nova-compute[75229]: DEBUG nova.scheduler.client.report [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Inventory has not changed for provider d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 10:10:12 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Compute_service record updated for user:user {{(pid=75229) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 10:10:12 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.661s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:10:12 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:10:12 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 10:10:13 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:10:13 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:10:13 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:10:13 user nova-compute[75229]: DEBUG nova.compute.manager [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75229) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 10:10:16 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:10:17 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 10:10:21 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:10:21 user nova-compute[75229]: DEBUG nova.compute.manager [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75229) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 14 10:10:22 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:10:24 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:10:25 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:10:27 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 10:10:31 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:10:32 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:10:36 user nova-compute[75229]: DEBUG nova.compute.manager [req-5ca604bb-a32a-4385-9b14-0c2c94a6fd05 req-dc98ee5e-5a5b-42fd-9a1d-3a0e483c62bf service nova] [instance: 68d9de39-cbd2-44b2-bda8-015c8482c240] Received event network-changed-e62b2a49-c9cc-4568-b887-1c7884830ac2 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 10:10:36 user nova-compute[75229]: DEBUG nova.compute.manager [req-5ca604bb-a32a-4385-9b14-0c2c94a6fd05 req-dc98ee5e-5a5b-42fd-9a1d-3a0e483c62bf service nova] [instance: 68d9de39-cbd2-44b2-bda8-015c8482c240] Refreshing instance network info cache due to event network-changed-e62b2a49-c9cc-4568-b887-1c7884830ac2. {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 10:10:36 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-5ca604bb-a32a-4385-9b14-0c2c94a6fd05 req-dc98ee5e-5a5b-42fd-9a1d-3a0e483c62bf service nova] Acquiring lock "refresh_cache-68d9de39-cbd2-44b2-bda8-015c8482c240" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 10:10:36 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-5ca604bb-a32a-4385-9b14-0c2c94a6fd05 req-dc98ee5e-5a5b-42fd-9a1d-3a0e483c62bf service nova] Acquired lock "refresh_cache-68d9de39-cbd2-44b2-bda8-015c8482c240" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 10:10:36 user nova-compute[75229]: DEBUG nova.network.neutron [req-5ca604bb-a32a-4385-9b14-0c2c94a6fd05 req-dc98ee5e-5a5b-42fd-9a1d-3a0e483c62bf service nova] [instance: 68d9de39-cbd2-44b2-bda8-015c8482c240] Refreshing network info cache for port e62b2a49-c9cc-4568-b887-1c7884830ac2 {{(pid=75229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 10:10:36 user nova-compute[75229]: DEBUG nova.network.neutron [req-5ca604bb-a32a-4385-9b14-0c2c94a6fd05 req-dc98ee5e-5a5b-42fd-9a1d-3a0e483c62bf service nova] [instance: 68d9de39-cbd2-44b2-bda8-015c8482c240] Updated VIF entry in instance network info cache for port e62b2a49-c9cc-4568-b887-1c7884830ac2. {{(pid=75229) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 10:10:36 user nova-compute[75229]: DEBUG nova.network.neutron [req-5ca604bb-a32a-4385-9b14-0c2c94a6fd05 req-dc98ee5e-5a5b-42fd-9a1d-3a0e483c62bf service nova] [instance: 68d9de39-cbd2-44b2-bda8-015c8482c240] Updating instance_info_cache with network_info: [{"id": "e62b2a49-c9cc-4568-b887-1c7884830ac2", "address": "fa:16:3e:f6:c6:5e", "network": {"id": "13b12b7e-2548-4256-8fb8-fccc67b1e18b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-698342503-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.41", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be7eb95aea3e4897acbc9fe03aadb8e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape62b2a49-c9", "ovs_interfaceid": "e62b2a49-c9cc-4568-b887-1c7884830ac2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 10:10:36 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-5ca604bb-a32a-4385-9b14-0c2c94a6fd05 req-dc98ee5e-5a5b-42fd-9a1d-3a0e483c62bf service nova] Releasing lock "refresh_cache-68d9de39-cbd2-44b2-bda8-015c8482c240" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 10:10:37 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 10:10:38 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-93d120ed-92ee-42c6-9de4-5363d290ae77 tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Acquiring lock "68d9de39-cbd2-44b2-bda8-015c8482c240" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:10:38 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-93d120ed-92ee-42c6-9de4-5363d290ae77 tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Lock "68d9de39-cbd2-44b2-bda8-015c8482c240" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:10:38 user nova-compute[75229]: DEBUG nova.objects.instance [None req-93d120ed-92ee-42c6-9de4-5363d290ae77 tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Lazy-loading 'flavor' on Instance uuid 68d9de39-cbd2-44b2-bda8-015c8482c240 {{(pid=75229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 10:10:38 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-93d120ed-92ee-42c6-9de4-5363d290ae77 tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Lock "68d9de39-cbd2-44b2-bda8-015c8482c240" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:10:38 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-93d120ed-92ee-42c6-9de4-5363d290ae77 tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Acquiring lock "68d9de39-cbd2-44b2-bda8-015c8482c240" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:10:38 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-93d120ed-92ee-42c6-9de4-5363d290ae77 tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Lock "68d9de39-cbd2-44b2-bda8-015c8482c240" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:10:38 user nova-compute[75229]: INFO nova.compute.manager [None req-93d120ed-92ee-42c6-9de4-5363d290ae77 tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] [instance: 68d9de39-cbd2-44b2-bda8-015c8482c240] Attaching volume cf6ced86-b04f-4335-b976-fde67102c8e3 to /dev/vdb
Nov 14 10:10:38 user nova-compute[75229]: DEBUG os_brick.utils [None req-93d120ed-92ee-42c6-9de4-5363d290ae77 tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 10:10:38 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:10:38 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:10:38 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[49b61f8d-bda3-4bae-abf8-f762fb184b4e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f1154031c835\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:10:38 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:10:38 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:10:38 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[39ca5a80-63c0-4a2c-8e3a-a84bb01e295e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:10:38 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:10:38 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:10:38 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[1394f977-49d4-4a6d-b632-2706734e9a46]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:10:38 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[4164e5a7-1519-4b26-be9d-af954251f000]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:10:38 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-93d120ed-92ee-42c6-9de4-5363d290ae77 tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Running cmd (subprocess): nvme version {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:10:38 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-93d120ed-92ee-42c6-9de4-5363d290ae77 tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] 'nvme version' failed. Not Retrying. {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 10:10:38 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.nvmeof [None req-93d120ed-92ee-42c6-9de4-5363d290ae77 tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] nvme not present on system {{(pid=75229) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 10:10:38 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:10:38 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 10:10:38 user nova-compute[75229]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 10:10:38 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[27517276-551f-4702-9635-4cdbbf3799ad]: (4, '') {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:10:38 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.lightos [None req-93d120ed-92ee-42c6-9de4-5363d290ae77 tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75229) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 10:10:38 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.lightos [None req-93d120ed-92ee-42c6-9de4-5363d290ae77 tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75229) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 10:10:38 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.lightos [None req-93d120ed-92ee-42c6-9de4-5363d290ae77 tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] LIGHTOS: no hostnqn found. {{(pid=75229) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 10:10:38 user nova-compute[75229]: DEBUG os_brick.utils [None req-93d120ed-92ee-42c6-9de4-5363d290ae77 tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f1154031c835', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 10:10:38 user nova-compute[75229]: DEBUG nova.virt.block_device [None req-93d120ed-92ee-42c6-9de4-5363d290ae77 tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] [instance: 68d9de39-cbd2-44b2-bda8-015c8482c240] Updating existing volume attachment record: 5f0b12c2-24ca-42c8-a3ff-59eb24c97886 {{(pid=75229) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 10:10:39 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:10:39 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:10:42 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:10:42 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:10:42 user nova-compute[75229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-93d120ed-92ee-42c6-9de4-5363d290ae77 tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] [instance: 68d9de39-cbd2-44b2-bda8-015c8482c240] Calling os-brick to attach iSCSI Volume {{(pid=75229) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 10:10:42 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-93d120ed-92ee-42c6-9de4-5363d290ae77 tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f73f85151b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:cf6ced86-b04f-4335-b976-fde67102c8e3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ELsaSRyt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 10:10:42 user nova-compute[75229]: WARNING os_brick.initiator.connectors.base [None req-93d120ed-92ee-42c6-9de4-5363d290ae77 tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 10:10:42 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-93d120ed-92ee-42c6-9de4-5363d290ae77 tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 10:10:42 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-93d120ed-92ee-42c6-9de4-5363d290ae77 tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 10:10:42 user nova-compute[75229]: WARNING os_brick.initiator.connectors.base [None req-93d120ed-92ee-42c6-9de4-5363d290ae77 tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 10:10:42 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-93d120ed-92ee-42c6-9de4-5363d290ae77 tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cf6ced86-b04f-4335-b976-fde67102c8e3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 10:10:42 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-93d120ed-92ee-42c6-9de4-5363d290ae77 tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cf6ced86-b04f-4335-b976-fde67102c8e3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 10:10:42 user nova-compute[75229]: INFO os_brick.initiator.connectors.iscsi [None req-93d120ed-92ee-42c6-9de4-5363d290ae77 tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 10:10:42 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf6ced86-b04f-4335-b976-fde67102c8e3 -p 172.16.0.220:3260 {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:10:42 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf6ced86-b04f-4335-b976-fde67102c8e3 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:10:42 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb62d822-928e-4791-b271-6d97b4ce9ff7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:10:42 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-93d120ed-92ee-42c6-9de4-5363d290ae77 tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 10:10:42 user nova-compute[75229]:  {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 10:10:42 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf6ced86-b04f-4335-b976-fde67102c8e3 -p 172.16.0.220:3260 --interface default --op new {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:10:42 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf6ced86-b04f-4335-b976-fde67102c8e3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:10:42 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0f0f7d6-b1aa-4e3d-b01d-7382a9aade0d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cf6ced86-b04f-4335-b976-fde67102c8e3] added\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:10:42 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-93d120ed-92ee-42c6-9de4-5363d290ae77 tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cf6ced86-b04f-4335-b976-fde67102c8e3] added
Nov 14 10:10:42 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 10:10:42 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf6ced86-b04f-4335-b976-fde67102c8e3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:10:42 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf6ced86-b04f-4335-b976-fde67102c8e3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:10:42 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b09366b-384f-487f-8f0a-a87fb6933c60]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:10:42 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-93d120ed-92ee-42c6-9de4-5363d290ae77 tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 10:10:42 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf6ced86-b04f-4335-b976-fde67102c8e3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:10:43 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf6ced86-b04f-4335-b976-fde67102c8e3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:10:43 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6c699fe-9856-47e7-84eb-7c28d4592bbb]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:10:43 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-93d120ed-92ee-42c6-9de4-5363d290ae77 tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 10:10:43 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf6ced86-b04f-4335-b976-fde67102c8e3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ELsaSRyt {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:10:43 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf6ced86-b04f-4335-b976-fde67102c8e3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ELsaSRyt" returned: 0 in 0.018s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:10:43 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[eef2f865-22d7-4a22-b5a3-4fbb692fb7cc]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:10:43 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-93d120ed-92ee-42c6-9de4-5363d290ae77 tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ELsaSRyt'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 10:10:43 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf6ced86-b04f-4335-b976-fde67102c8e3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:10:43 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf6ced86-b04f-4335-b976-fde67102c8e3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:10:43 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[91ae0655-5801-47f8-9f8a-3779317de33f]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:10:43 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-93d120ed-92ee-42c6-9de4-5363d290ae77 tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 10:10:43 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:10:43 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:10:43 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[19bb8b8d-50d1-4c25-995b-967b87814ded]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aebc438-0289-44fe-ad84-4e696468f50e (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7aee6091-dab3-4c39-88a1-4bbb28dcab45 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8892c7d-49e8-4f65-b88c-1e14fba8f50a (non-flash)\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:10:43 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-93d120ed-92ee-42c6-9de4-5363d290ae77 tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aebc438-0289-44fe-ad84-4e696468f50e (non-flash)
Nov 14 10:10:43 user nova-compute[75229]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7aee6091-dab3-4c39-88a1-4bbb28dcab45 (non-flash)
Nov 14 10:10:43 user nova-compute[75229]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8892c7d-49e8-4f65-b88c-1e14fba8f50a (non-flash)
Nov 14 10:10:43 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 10:10:43 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-93d120ed-92ee-42c6-9de4-5363d290ae77 tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aebc438-0289-44fe-ad84-4e696468f50e (non-flash)
Nov 14 10:10:43 user nova-compute[75229]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7aee6091-dab3-4c39-88a1-4bbb28dcab45 (non-flash)
Nov 14 10:10:43 user nova-compute[75229]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8892c7d-49e8-4f65-b88c-1e14fba8f50a (non-flash)
Nov 14 10:10:43 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 10:10:43 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf6ced86-b04f-4335-b976-fde67102c8e3 -p 172.16.0.220:3260 --login {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:10:43 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf6ced86-b04f-4335-b976-fde67102c8e3 -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:10:43 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[8aeb7c8e-31d1-46c5-b79c-354bf37f326a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:cf6ced86-b04f-4335-b976-fde67102c8e3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:cf6ced86-b04f-4335-b976-fde67102c8e3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:10:43 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-93d120ed-92ee-42c6-9de4-5363d290ae77 tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:cf6ced86-b04f-4335-b976-fde67102c8e3, portal: 172.16.0.220,3260]
Nov 14 10:10:43 user nova-compute[75229]: Login to [iface: default, target: iqn.2010-10.org.openstack:cf6ced86-b04f-4335-b976-fde67102c8e3, portal: 172.16.0.220,3260] successful.
Nov 14 10:10:43 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 10:10:43 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf6ced86-b04f-4335-b976-fde67102c8e3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:10:43 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf6ced86-b04f-4335-b976-fde67102c8e3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:10:43 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b5999d9-ec90-426d-817f-0d713b681932]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:10:43 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-93d120ed-92ee-42c6-9de4-5363d290ae77 tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 10:10:43 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:10:43 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:10:43 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[42f2237f-5c65-4dca-9f82-c40c66caaef8]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aebc438-0289-44fe-ad84-4e696468f50e (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7aee6091-dab3-4c39-88a1-4bbb28dcab45 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8892c7d-49e8-4f65-b88c-1e14fba8f50a (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf6ced86-b04f-4335-b976-fde67102c8e3 (non-flash)\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:10:43 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-93d120ed-92ee-42c6-9de4-5363d290ae77 tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aebc438-0289-44fe-ad84-4e696468f50e (non-flash)
Nov 14 10:10:43 user nova-compute[75229]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7aee6091-dab3-4c39-88a1-4bbb28dcab45 (non-flash)
Nov 14 10:10:43 user nova-compute[75229]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8892c7d-49e8-4f65-b88c-1e14fba8f50a (non-flash)
Nov 14 10:10:43 user nova-compute[75229]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf6ced86-b04f-4335-b976-fde67102c8e3 (non-flash)
Nov 14 10:10:43 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 10:10:43 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-93d120ed-92ee-42c6-9de4-5363d290ae77 tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aebc438-0289-44fe-ad84-4e696468f50e (non-flash)
Nov 14 10:10:43 user nova-compute[75229]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7aee6091-dab3-4c39-88a1-4bbb28dcab45 (non-flash)
Nov 14 10:10:43 user nova-compute[75229]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8892c7d-49e8-4f65-b88c-1e14fba8f50a (non-flash)
Nov 14 10:10:43 user nova-compute[75229]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf6ced86-b04f-4335-b976-fde67102c8e3 (non-flash)
Nov 14 10:10:43 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 10:10:43 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-93d120ed-92ee-42c6-9de4-5363d290ae77 tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cf6ced86-b04f-4335-b976-fde67102c8e3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.276s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 10:10:43 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-93d120ed-92ee-42c6-9de4-5363d290ae77 tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Connected to 172.16.0.220:3260 {{(pid=75229) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 10:10:43 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-93d120ed-92ee-42c6-9de4-5363d290ae77 tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] HCTL ('33', '-', '-', 0) found on session 53 with lun 0 {{(pid=75229) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 10:10:43 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-93d120ed-92ee-42c6-9de4-5363d290ae77 tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75229) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 10:10:43 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:10:43 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:10:43 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a93673b-aba7-4e81-9e1c-3e53a9ea232e]: (4, ('- - 0', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:10:43 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-93d120ed-92ee-42c6-9de4-5363d290ae77 tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Searching for a device in session 53 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75229) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 10:10:43 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-93d120ed-92ee-42c6-9de4-5363d290ae77 tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:cf6ced86-b04f-4335-b976-fde67102c8e3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ELsaSRyt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75229) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 10:10:44 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:10:44 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-93d120ed-92ee-42c6-9de4-5363d290ae77 tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.310s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 10:10:44 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-93d120ed-92ee-42c6-9de4-5363d290ae77 tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] <== connect_volume: return (1312ms) {'type': 'block', 'scsi_wwn': '23433323265353361', 'path': '/dev/sdb'} {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 10:10:44 user nova-compute[75229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-93d120ed-92ee-42c6-9de4-5363d290ae77 tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] [instance: 68d9de39-cbd2-44b2-bda8-015c8482c240] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23433323265353361', 'path': '/dev/sdb'} {{(pid=75229) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 10:10:44 user nova-compute[75229]: DEBUG nova.objects.instance [None req-93d120ed-92ee-42c6-9de4-5363d290ae77 tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Lazy-loading 'flavor' on Instance uuid 68d9de39-cbd2-44b2-bda8-015c8482c240 {{(pid=75229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 10:10:44 user nova-compute[75229]: DEBUG nova.virt.libvirt.guest [None req-93d120ed-92ee-42c6-9de4-5363d290ae77 tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 10:10:44 user nova-compute[75229]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 10:10:44 user nova-compute[75229]:   <source dev="/dev/sdb"/>
Nov 14 10:10:44 user nova-compute[75229]:   <target dev="vdb" bus="virtio"/>
Nov 14 10:10:44 user nova-compute[75229]:   <serial>cf6ced86-b04f-4335-b976-fde67102c8e3</serial>
Nov 14 10:10:44 user nova-compute[75229]: </disk>
Nov 14 10:10:44 user nova-compute[75229]:  {{(pid=75229) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 10:10:44 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-93d120ed-92ee-42c6-9de4-5363d290ae77 tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] No BDM found with device name vda, not building metadata. {{(pid=75229) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 10:10:44 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-93d120ed-92ee-42c6-9de4-5363d290ae77 tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75229) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 10:10:44 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-93d120ed-92ee-42c6-9de4-5363d290ae77 tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] No VIF found with MAC fa:16:3e:f6:c6:5e, not building metadata {{(pid=75229) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 10:10:44 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-93d120ed-92ee-42c6-9de4-5363d290ae77 tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Lock "68d9de39-cbd2-44b2-bda8-015c8482c240" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.438s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:10:46 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-ee975998-8967-491f-9b37-51c63e9f3685 tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Acquiring lock "68d9de39-cbd2-44b2-bda8-015c8482c240" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:10:46 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-ee975998-8967-491f-9b37-51c63e9f3685 tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Lock "68d9de39-cbd2-44b2-bda8-015c8482c240" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:10:46 user nova-compute[75229]: DEBUG nova.compute.manager [None req-ee975998-8967-491f-9b37-51c63e9f3685 tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] [instance: 68d9de39-cbd2-44b2-bda8-015c8482c240] Checking state {{(pid=75229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 10:10:46 user nova-compute[75229]: DEBUG nova.compute.manager [None req-ee975998-8967-491f-9b37-51c63e9f3685 tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] [instance: 68d9de39-cbd2-44b2-bda8-015c8482c240] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=75229) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3358}}
Nov 14 10:10:46 user nova-compute[75229]: DEBUG nova.objects.instance [None req-ee975998-8967-491f-9b37-51c63e9f3685 tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Lazy-loading 'flavor' on Instance uuid 68d9de39-cbd2-44b2-bda8-015c8482c240 {{(pid=75229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 10:10:46 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:10:46 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:10:46 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:10:46 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:10:46 user nova-compute[75229]: DEBUG nova.compute.manager [req-9d8c8e31-851e-4682-863d-af35b52b08f7 req-f5760854-f99a-481f-8d90-226cdfd1f69a service nova] [instance: 68d9de39-cbd2-44b2-bda8-015c8482c240] Received event network-vif-unplugged-e62b2a49-c9cc-4568-b887-1c7884830ac2 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 10:10:46 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-9d8c8e31-851e-4682-863d-af35b52b08f7 req-f5760854-f99a-481f-8d90-226cdfd1f69a service nova] Acquiring lock "68d9de39-cbd2-44b2-bda8-015c8482c240-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:10:46 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-9d8c8e31-851e-4682-863d-af35b52b08f7 req-f5760854-f99a-481f-8d90-226cdfd1f69a service nova] Lock "68d9de39-cbd2-44b2-bda8-015c8482c240-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:10:46 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-9d8c8e31-851e-4682-863d-af35b52b08f7 req-f5760854-f99a-481f-8d90-226cdfd1f69a service nova] Lock "68d9de39-cbd2-44b2-bda8-015c8482c240-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:10:46 user nova-compute[75229]: DEBUG nova.compute.manager [req-9d8c8e31-851e-4682-863d-af35b52b08f7 req-f5760854-f99a-481f-8d90-226cdfd1f69a service nova] [instance: 68d9de39-cbd2-44b2-bda8-015c8482c240] No waiting events found dispatching network-vif-unplugged-e62b2a49-c9cc-4568-b887-1c7884830ac2 {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 10:10:46 user nova-compute[75229]: WARNING nova.compute.manager [req-9d8c8e31-851e-4682-863d-af35b52b08f7 req-f5760854-f99a-481f-8d90-226cdfd1f69a service nova] [instance: 68d9de39-cbd2-44b2-bda8-015c8482c240] Received unexpected event network-vif-unplugged-e62b2a49-c9cc-4568-b887-1c7884830ac2 for instance with vm_state active and task_state powering-off.
Nov 14 10:10:46 user nova-compute[75229]: INFO nova.virt.libvirt.driver [-] [instance: 68d9de39-cbd2-44b2-bda8-015c8482c240] Instance destroyed successfully.
Nov 14 10:10:46 user nova-compute[75229]: DEBUG nova.compute.manager [None req-ee975998-8967-491f-9b37-51c63e9f3685 tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] [instance: 68d9de39-cbd2-44b2-bda8-015c8482c240] Checking state {{(pid=75229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 10:10:46 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-ee975998-8967-491f-9b37-51c63e9f3685 tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Lock "68d9de39-cbd2-44b2-bda8-015c8482c240" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.860s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:10:47 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:10:48 user nova-compute[75229]: DEBUG nova.compute.manager [req-2468137f-a52b-40dc-a248-a0b2a38b0621 req-014e9112-b210-4513-9b3e-82b70c6d1036 service nova] [instance: 68d9de39-cbd2-44b2-bda8-015c8482c240] Received event network-vif-plugged-e62b2a49-c9cc-4568-b887-1c7884830ac2 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 10:10:48 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-2468137f-a52b-40dc-a248-a0b2a38b0621 req-014e9112-b210-4513-9b3e-82b70c6d1036 service nova] Acquiring lock "68d9de39-cbd2-44b2-bda8-015c8482c240-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:10:48 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-2468137f-a52b-40dc-a248-a0b2a38b0621 req-014e9112-b210-4513-9b3e-82b70c6d1036 service nova] Lock "68d9de39-cbd2-44b2-bda8-015c8482c240-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:10:48 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-2468137f-a52b-40dc-a248-a0b2a38b0621 req-014e9112-b210-4513-9b3e-82b70c6d1036 service nova] Lock "68d9de39-cbd2-44b2-bda8-015c8482c240-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:10:48 user nova-compute[75229]: DEBUG nova.compute.manager [req-2468137f-a52b-40dc-a248-a0b2a38b0621 req-014e9112-b210-4513-9b3e-82b70c6d1036 service nova] [instance: 68d9de39-cbd2-44b2-bda8-015c8482c240] No waiting events found dispatching network-vif-plugged-e62b2a49-c9cc-4568-b887-1c7884830ac2 {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 10:10:48 user nova-compute[75229]: WARNING nova.compute.manager [req-2468137f-a52b-40dc-a248-a0b2a38b0621 req-014e9112-b210-4513-9b3e-82b70c6d1036 service nova] [instance: 68d9de39-cbd2-44b2-bda8-015c8482c240] Received unexpected event network-vif-plugged-e62b2a49-c9cc-4568-b887-1c7884830ac2 for instance with vm_state stopped and task_state None.
Nov 14 10:10:49 user nova-compute[75229]: DEBUG nova.compute.manager [req-f54cda97-6d3d-4533-a049-02a5afb8b7e8 req-f3e9e8d3-5feb-472a-b54c-2fecfda0998d service nova] [instance: 4a81b779-af09-4026-8387-07d44dad6ef7] Received event network-changed-ca86bdcf-6fe2-4ceb-8e9c-6ff88e9efb71 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 10:10:49 user nova-compute[75229]: DEBUG nova.compute.manager [req-f54cda97-6d3d-4533-a049-02a5afb8b7e8 req-f3e9e8d3-5feb-472a-b54c-2fecfda0998d service nova] [instance: 4a81b779-af09-4026-8387-07d44dad6ef7] Refreshing instance network info cache due to event network-changed-ca86bdcf-6fe2-4ceb-8e9c-6ff88e9efb71. {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 10:10:49 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-f54cda97-6d3d-4533-a049-02a5afb8b7e8 req-f3e9e8d3-5feb-472a-b54c-2fecfda0998d service nova] Acquiring lock "refresh_cache-4a81b779-af09-4026-8387-07d44dad6ef7" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 10:10:49 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-f54cda97-6d3d-4533-a049-02a5afb8b7e8 req-f3e9e8d3-5feb-472a-b54c-2fecfda0998d service nova] Acquired lock "refresh_cache-4a81b779-af09-4026-8387-07d44dad6ef7" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 10:10:49 user nova-compute[75229]: DEBUG nova.network.neutron [req-f54cda97-6d3d-4533-a049-02a5afb8b7e8 req-f3e9e8d3-5feb-472a-b54c-2fecfda0998d service nova] [instance: 4a81b779-af09-4026-8387-07d44dad6ef7] Refreshing network info cache for port ca86bdcf-6fe2-4ceb-8e9c-6ff88e9efb71 {{(pid=75229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 10:10:49 user nova-compute[75229]: DEBUG nova.network.neutron [req-f54cda97-6d3d-4533-a049-02a5afb8b7e8 req-f3e9e8d3-5feb-472a-b54c-2fecfda0998d service nova] [instance: 4a81b779-af09-4026-8387-07d44dad6ef7] Updated VIF entry in instance network info cache for port ca86bdcf-6fe2-4ceb-8e9c-6ff88e9efb71. {{(pid=75229) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 10:10:49 user nova-compute[75229]: DEBUG nova.network.neutron [req-f54cda97-6d3d-4533-a049-02a5afb8b7e8 req-f3e9e8d3-5feb-472a-b54c-2fecfda0998d service nova] [instance: 4a81b779-af09-4026-8387-07d44dad6ef7] Updating instance_info_cache with network_info: [{"id": "ca86bdcf-6fe2-4ceb-8e9c-6ff88e9efb71", "address": "fa:16:3e:35:44:4b", "network": {"id": "118ea7c1-77c0-4660-b7b7-f311f6b0ec8a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1907578504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46620ac128944703899f22fe5439ba26", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca86bdcf-6f", "ovs_interfaceid": "ca86bdcf-6fe2-4ceb-8e9c-6ff88e9efb71", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 10:10:49 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-f54cda97-6d3d-4533-a049-02a5afb8b7e8 req-f3e9e8d3-5feb-472a-b54c-2fecfda0998d service nova] Releasing lock "refresh_cache-4a81b779-af09-4026-8387-07d44dad6ef7" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 10:10:51 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:10:51 user nova-compute[75229]: DEBUG nova.compute.manager [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Triggering sync for uuid cda8c5ad-e70c-4021-bace-d55831c4bc78 {{(pid=75229) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 10:10:51 user nova-compute[75229]: DEBUG nova.compute.manager [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Triggering sync for uuid 30ae1f73-e0f3-4e26-987e-a684471a160d {{(pid=75229) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 10:10:51 user nova-compute[75229]: DEBUG nova.compute.manager [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Triggering sync for uuid c1679275-ebb1-4f15-80a4-b8fd614fc34b {{(pid=75229) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 10:10:51 user nova-compute[75229]: DEBUG nova.compute.manager [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Triggering sync for uuid 10d6bce1-e55f-429c-816d-3bef9029560a {{(pid=75229) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 10:10:51 user nova-compute[75229]: DEBUG nova.compute.manager [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Triggering sync for uuid 68d9de39-cbd2-44b2-bda8-015c8482c240 {{(pid=75229) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 10:10:51 user nova-compute[75229]: DEBUG nova.compute.manager [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Triggering sync for uuid 4a81b779-af09-4026-8387-07d44dad6ef7 {{(pid=75229) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 10:10:51 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Acquiring lock "cda8c5ad-e70c-4021-bace-d55831c4bc78" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:10:51 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Lock "cda8c5ad-e70c-4021-bace-d55831c4bc78" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:10:51 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Acquiring lock "30ae1f73-e0f3-4e26-987e-a684471a160d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:10:51 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Lock "30ae1f73-e0f3-4e26-987e-a684471a160d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:10:51 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Acquiring lock "c1679275-ebb1-4f15-80a4-b8fd614fc34b" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:10:51 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Lock "c1679275-ebb1-4f15-80a4-b8fd614fc34b" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:10:51 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Acquiring lock "10d6bce1-e55f-429c-816d-3bef9029560a" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:10:51 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Lock "10d6bce1-e55f-429c-816d-3bef9029560a" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:10:51 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Acquiring lock "68d9de39-cbd2-44b2-bda8-015c8482c240" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:10:51 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Lock "68d9de39-cbd2-44b2-bda8-015c8482c240" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:10:51 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Acquiring lock "4a81b779-af09-4026-8387-07d44dad6ef7" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:10:51 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Lock "4a81b779-af09-4026-8387-07d44dad6ef7" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:10:51 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Lock "cda8c5ad-e70c-4021-bace-d55831c4bc78" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.040s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:10:51 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Lock "10d6bce1-e55f-429c-816d-3bef9029560a" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.044s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:10:51 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Lock "c1679275-ebb1-4f15-80a4-b8fd614fc34b" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.046s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:10:51 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Lock "30ae1f73-e0f3-4e26-987e-a684471a160d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.052s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:10:51 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Lock "68d9de39-cbd2-44b2-bda8-015c8482c240" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.052s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:10:51 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Lock "4a81b779-af09-4026-8387-07d44dad6ef7" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.052s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:10:52 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:10:53 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-8c071a8f-59c6-467c-98b5-235b8a05c476 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Acquiring lock "a79894e7-5018-4b3a-bd3b-694f1833f99f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:10:53 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-8c071a8f-59c6-467c-98b5-235b8a05c476 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Lock "a79894e7-5018-4b3a-bd3b-694f1833f99f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:10:53 user nova-compute[75229]: DEBUG nova.compute.manager [None req-8c071a8f-59c6-467c-98b5-235b8a05c476 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] [instance: a79894e7-5018-4b3a-bd3b-694f1833f99f] Starting instance... {{(pid=75229) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 10:10:53 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-8c071a8f-59c6-467c-98b5-235b8a05c476 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:10:53 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-8c071a8f-59c6-467c-98b5-235b8a05c476 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:10:53 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-8c071a8f-59c6-467c-98b5-235b8a05c476 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75229) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 10:10:53 user nova-compute[75229]: INFO nova.compute.claims [None req-8c071a8f-59c6-467c-98b5-235b8a05c476 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] [instance: a79894e7-5018-4b3a-bd3b-694f1833f99f] Claim successful on node user
Nov 14 10:10:53 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-06468a28-5eba-410f-ac2d-33cf93bc7ea7 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Acquiring lock "10d6bce1-e55f-429c-816d-3bef9029560a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:10:53 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-06468a28-5eba-410f-ac2d-33cf93bc7ea7 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Lock "10d6bce1-e55f-429c-816d-3bef9029560a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:10:53 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-06468a28-5eba-410f-ac2d-33cf93bc7ea7 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Acquiring lock "10d6bce1-e55f-429c-816d-3bef9029560a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:10:53 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-06468a28-5eba-410f-ac2d-33cf93bc7ea7 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Lock "10d6bce1-e55f-429c-816d-3bef9029560a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:10:53 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-06468a28-5eba-410f-ac2d-33cf93bc7ea7 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Lock "10d6bce1-e55f-429c-816d-3bef9029560a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:10:53 user nova-compute[75229]: INFO nova.compute.manager [None req-06468a28-5eba-410f-ac2d-33cf93bc7ea7 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] [instance: 10d6bce1-e55f-429c-816d-3bef9029560a] Terminating instance
Nov 14 10:10:53 user nova-compute[75229]: DEBUG nova.compute.manager [None req-06468a28-5eba-410f-ac2d-33cf93bc7ea7 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] [instance: 10d6bce1-e55f-429c-816d-3bef9029560a] Start destroying the instance on the hypervisor. {{(pid=75229) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 10:10:53 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:10:53 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:10:54 user nova-compute[75229]: DEBUG nova.compute.provider_tree [None req-8c071a8f-59c6-467c-98b5-235b8a05c476 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Inventory has not changed in ProviderTree for provider: d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 {{(pid=75229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 10:10:54 user nova-compute[75229]: DEBUG nova.scheduler.client.report [None req-8c071a8f-59c6-467c-98b5-235b8a05c476 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Inventory has not changed for provider d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 10:10:54 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:10:54 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:10:54 user nova-compute[75229]: DEBUG nova.compute.manager [req-b532e3f6-38ec-40ef-8d27-b9347e686de8 req-0bd24f0b-4cb7-4b6c-8683-e9e53f02cb7e service nova] [instance: 10d6bce1-e55f-429c-816d-3bef9029560a] Received event network-vif-unplugged-ea04ea8d-43a6-4f64-9e0b-cc2927f214f5 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 10:10:54 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-b532e3f6-38ec-40ef-8d27-b9347e686de8 req-0bd24f0b-4cb7-4b6c-8683-e9e53f02cb7e service nova] Acquiring lock "10d6bce1-e55f-429c-816d-3bef9029560a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:10:54 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-b532e3f6-38ec-40ef-8d27-b9347e686de8 req-0bd24f0b-4cb7-4b6c-8683-e9e53f02cb7e service nova] Lock "10d6bce1-e55f-429c-816d-3bef9029560a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:10:54 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-b532e3f6-38ec-40ef-8d27-b9347e686de8 req-0bd24f0b-4cb7-4b6c-8683-e9e53f02cb7e service nova] Lock "10d6bce1-e55f-429c-816d-3bef9029560a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:10:54 user nova-compute[75229]: DEBUG nova.compute.manager [req-b532e3f6-38ec-40ef-8d27-b9347e686de8 req-0bd24f0b-4cb7-4b6c-8683-e9e53f02cb7e service nova] [instance: 10d6bce1-e55f-429c-816d-3bef9029560a] No waiting events found dispatching network-vif-unplugged-ea04ea8d-43a6-4f64-9e0b-cc2927f214f5 {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 10:10:54 user nova-compute[75229]: DEBUG nova.compute.manager [req-b532e3f6-38ec-40ef-8d27-b9347e686de8 req-0bd24f0b-4cb7-4b6c-8683-e9e53f02cb7e service nova] [instance: 10d6bce1-e55f-429c-816d-3bef9029560a] Received event network-vif-unplugged-ea04ea8d-43a6-4f64-9e0b-cc2927f214f5 for instance with task_state deleting. {{(pid=75229) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 10:10:54 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-8c071a8f-59c6-467c-98b5-235b8a05c476 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.411s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:10:54 user nova-compute[75229]: DEBUG nova.compute.manager [None req-8c071a8f-59c6-467c-98b5-235b8a05c476 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] [instance: a79894e7-5018-4b3a-bd3b-694f1833f99f] Start building networks asynchronously for instance. {{(pid=75229) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 10:10:54 user nova-compute[75229]: DEBUG nova.compute.manager [None req-8c071a8f-59c6-467c-98b5-235b8a05c476 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] [instance: a79894e7-5018-4b3a-bd3b-694f1833f99f] Allocating IP information in the background. {{(pid=75229) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 10:10:54 user nova-compute[75229]: DEBUG nova.network.neutron [None req-8c071a8f-59c6-467c-98b5-235b8a05c476 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] [instance: a79894e7-5018-4b3a-bd3b-694f1833f99f] allocate_for_instance() {{(pid=75229) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 10:10:54 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-8c071a8f-59c6-467c-98b5-235b8a05c476 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] [instance: a79894e7-5018-4b3a-bd3b-694f1833f99f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 10:10:54 user nova-compute[75229]: DEBUG nova.compute.manager [None req-8c071a8f-59c6-467c-98b5-235b8a05c476 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] [instance: a79894e7-5018-4b3a-bd3b-694f1833f99f] Start building block device mappings for instance. {{(pid=75229) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 10:10:54 user nova-compute[75229]: DEBUG nova.policy [None req-8c071a8f-59c6-467c-98b5-235b8a05c476 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c26f33e4cdf14ba796445959953f8685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46620ac128944703899f22fe5439ba26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75229) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 10:10:54 user nova-compute[75229]: INFO nova.virt.block_device [None req-8c071a8f-59c6-467c-98b5-235b8a05c476 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] [instance: a79894e7-5018-4b3a-bd3b-694f1833f99f] Booting with volume d86c34fa-0121-4ba8-ac40-655170558568 at /dev/vda
Nov 14 10:10:54 user nova-compute[75229]: DEBUG os_brick.utils [None req-8c071a8f-59c6-467c-98b5-235b8a05c476 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 10:10:54 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:10:54 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:10:54 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[84cfb18a-1386-41e4-96fa-62a719904d8c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f1154031c835\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:10:54 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:10:54 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:10:54 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[592c8efd-ebc5-4feb-93de-941d3c29d042]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:10:54 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:10:54 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:10:54 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fee7027-9360-4654-9612-cf740481d006]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:10:54 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b7d5117-312c-41c2-888b-5a8f3bbfe385]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:10:54 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-8c071a8f-59c6-467c-98b5-235b8a05c476 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Running cmd (subprocess): nvme version {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:10:54 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-8c071a8f-59c6-467c-98b5-235b8a05c476 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] 'nvme version' failed. Not Retrying. {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 10:10:54 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8c071a8f-59c6-467c-98b5-235b8a05c476 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] nvme not present on system {{(pid=75229) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 10:10:54 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:10:54 user nova-compute[75229]: INFO nova.virt.libvirt.driver [-] [instance: 10d6bce1-e55f-429c-816d-3bef9029560a] Instance destroyed successfully.
Nov 14 10:10:54 user nova-compute[75229]: DEBUG nova.objects.instance [None req-06468a28-5eba-410f-ac2d-33cf93bc7ea7 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Lazy-loading 'resources' on Instance uuid 10d6bce1-e55f-429c-816d-3bef9029560a {{(pid=75229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 10:10:54 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 10:10:54 user nova-compute[75229]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 10:10:54 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4dc8c76-6859-4cd1-bb06-f5d95fbf3afd]: (4, '') {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:10:54 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.lightos [None req-8c071a8f-59c6-467c-98b5-235b8a05c476 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75229) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 10:10:54 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.lightos [None req-8c071a8f-59c6-467c-98b5-235b8a05c476 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75229) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 10:10:54 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.lightos [None req-8c071a8f-59c6-467c-98b5-235b8a05c476 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] LIGHTOS: no hostnqn found. {{(pid=75229) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 10:10:54 user nova-compute[75229]: DEBUG os_brick.utils [None req-8c071a8f-59c6-467c-98b5-235b8a05c476 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f1154031c835', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 10:10:54 user nova-compute[75229]: DEBUG nova.virt.block_device [None req-8c071a8f-59c6-467c-98b5-235b8a05c476 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] [instance: a79894e7-5018-4b3a-bd3b-694f1833f99f] Updating existing volume attachment record: 9f706207-e680-4e8c-b87e-2ab749910aba {{(pid=75229) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 10:10:54 user nova-compute[75229]: DEBUG nova.virt.libvirt.vif [None req-06468a28-5eba-410f-ac2d-33cf93bc7ea7 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T10:05:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1327308485',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1327308485',id=45,image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-14T10:07:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8babb73006da4977a1fe2bdb35e08d8f',ramdisk_id='',reservation_id='r-mj2negw8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-189750210',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T10:09:09Z,user_data=None,user_id='a8825cd49e9349f28576b704c4c4d717',uuid=10d6bce1-e55f-429c-816d-3bef9029560a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ea04ea8d-43a6-4f64-9e0b-cc2927f214f5", "address": "fa:16:3e:e7:9f:f8", "network": {"id": "6a700b61-4aa6-440b-87e6-a3525a5cb918", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-448680331-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8babb73006da4977a1fe2bdb35e08d8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea04ea8d-43", "ovs_interfaceid": "ea04ea8d-43a6-4f64-9e0b-cc2927f214f5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 10:10:54 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-06468a28-5eba-410f-ac2d-33cf93bc7ea7 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Converting VIF {"id": "ea04ea8d-43a6-4f64-9e0b-cc2927f214f5", "address": "fa:16:3e:e7:9f:f8", "network": {"id": "6a700b61-4aa6-440b-87e6-a3525a5cb918", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-448680331-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8babb73006da4977a1fe2bdb35e08d8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea04ea8d-43", "ovs_interfaceid": "ea04ea8d-43a6-4f64-9e0b-cc2927f214f5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 10:10:54 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-06468a28-5eba-410f-ac2d-33cf93bc7ea7 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e7:9f:f8,bridge_name='br-int',has_traffic_filtering=True,id=ea04ea8d-43a6-4f64-9e0b-cc2927f214f5,network=Network(6a700b61-4aa6-440b-87e6-a3525a5cb918),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea04ea8d-43') {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 10:10:54 user nova-compute[75229]: DEBUG os_vif [None req-06468a28-5eba-410f-ac2d-33cf93bc7ea7 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e7:9f:f8,bridge_name='br-int',has_traffic_filtering=True,id=ea04ea8d-43a6-4f64-9e0b-cc2927f214f5,network=Network(6a700b61-4aa6-440b-87e6-a3525a5cb918),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea04ea8d-43') {{(pid=75229) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 10:10:54 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:10:54 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapea04ea8d-43, bridge=br-int, if_exists=True) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 10:10:54 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:10:54 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 10:10:54 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:10:54 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:10:54 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3598f0a9-72d9-4f34-8d50-8d979d9f6ddf) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 10:10:54 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 10:10:54 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:10:54 user nova-compute[75229]: INFO os_vif [None req-06468a28-5eba-410f-ac2d-33cf93bc7ea7 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e7:9f:f8,bridge_name='br-int',has_traffic_filtering=True,id=ea04ea8d-43a6-4f64-9e0b-cc2927f214f5,network=Network(6a700b61-4aa6-440b-87e6-a3525a5cb918),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea04ea8d-43')
Nov 14 10:10:54 user nova-compute[75229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-06468a28-5eba-410f-ac2d-33cf93bc7ea7 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] [instance: 10d6bce1-e55f-429c-816d-3bef9029560a] calling os-brick to detach iSCSI Volume {{(pid=75229) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 10:10:54 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-06468a28-5eba-410f-ac2d-33cf93bc7ea7 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f73f85151b0>, {'target_iqn': 'iqn.2010-10.org.openstack:7aee6091-dab3-4c39-88a1-4bbb28dcab45', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LXKkTDrO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 10:10:54 user nova-compute[75229]: WARNING os_brick.initiator.connectors.base [None req-06468a28-5eba-410f-ac2d-33cf93bc7ea7 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 10:10:54 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-06468a28-5eba-410f-ac2d-33cf93bc7ea7 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 10:10:54 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-06468a28-5eba-410f-ac2d-33cf93bc7ea7 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 10:10:54 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:10:54 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:10:54 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[665b5452-8435-4928-92ae-b0191501da9b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:cf6ced86-b04f-4335-b976-fde67102c8e3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7aee6091-dab3-4c39-88a1-4bbb28dcab45\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c8892c7d-49e8-4f65-b88c-1e14fba8f50a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5aebc438-0289-44fe-ad84-4e696468f50e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:10:54 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-06468a28-5eba-410f-ac2d-33cf93bc7ea7 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 10:10:54 user nova-compute[75229]: No targets found.
Nov 14 10:10:54 user nova-compute[75229]: iSNS:
Nov 14 10:10:54 user nova-compute[75229]: No targets found.
Nov 14 10:10:54 user nova-compute[75229]: STATIC:
Nov 14 10:10:54 user nova-compute[75229]: Target: iqn.2010-10.org.openstack:cf6ced86-b04f-4335-b976-fde67102c8e3
Nov 14 10:10:54 user nova-compute[75229]:         Portal: 172.16.0.220:3260,-1
Nov 14 10:10:54 user nova-compute[75229]:                 Iface Name: default
Nov 14 10:10:54 user nova-compute[75229]: Target: iqn.2010-10.org.openstack:7aee6091-dab3-4c39-88a1-4bbb28dcab45
Nov 14 10:10:54 user nova-compute[75229]:         Portal: 172.16.0.220:3260,-1
Nov 14 10:10:54 user nova-compute[75229]:                 Iface Name: default
Nov 14 10:10:54 user nova-compute[75229]: Target: iqn.2010-10.org.openstack:c8892c7d-49e8-4f65-b88c-1e14fba8f50a
Nov 14 10:10:54 user nova-compute[75229]:         Portal: 172.16.0.220:3260,-1
Nov 14 10:10:54 user nova-compute[75229]:                 Iface Name: default
Nov 14 10:10:54 user nova-compute[75229]: Target: iqn.2010-10.org.openstack:5aebc438-0289-44fe-ad84-4e696468f50e
Nov 14 10:10:54 user nova-compute[75229]:         Portal: 172.16.0.220:3260,-1
Nov 14 10:10:54 user nova-compute[75229]:                 Iface Name: default
Nov 14 10:10:54 user nova-compute[75229]: FIRMWARE:
Nov 14 10:10:54 user nova-compute[75229]: No targets found.
Nov 14 10:10:54 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 10:10:54 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-06468a28-5eba-410f-ac2d-33cf93bc7ea7 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 10:10:54 user nova-compute[75229]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 10:10:54 user nova-compute[75229]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75229) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 10:10:54 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-06468a28-5eba-410f-ac2d-33cf93bc7ea7 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7aee6091-dab3-4c39-88a1-4bbb28dcab45', 0)] {{(pid=75229) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 10:10:54 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:10:54 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:10:54 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[9092b67f-4811-4fe3-b846-5559ff512033]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5aebc438-0289-44fe-ad84-4e696468f50e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7aee6091-dab3-4c39-88a1-4bbb28dcab45\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c8892c7d-49e8-4f65-b88c-1e14fba8f50a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cf6ced86-b04f-4335-b976-fde67102c8e3\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:10:54 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:10:54 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:10:54 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[72823077-d2bc-4045-bab2-f7a3a5aabd2c]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aebc438-0289-44fe-ad84-4e696468f50e (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7aee6091-dab3-4c39-88a1-4bbb28dcab45 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8892c7d-49e8-4f65-b88c-1e14fba8f50a (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf6ced86-b04f-4335-b976-fde67102c8e3 (non-flash)\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:10:54 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-06468a28-5eba-410f-ac2d-33cf93bc7ea7 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aebc438-0289-44fe-ad84-4e696468f50e (non-flash)
Nov 14 10:10:54 user nova-compute[75229]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7aee6091-dab3-4c39-88a1-4bbb28dcab45 (non-flash)
Nov 14 10:10:54 user nova-compute[75229]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8892c7d-49e8-4f65-b88c-1e14fba8f50a (non-flash)
Nov 14 10:10:54 user nova-compute[75229]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf6ced86-b04f-4335-b976-fde67102c8e3 (non-flash)
Nov 14 10:10:54 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 10:10:54 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-06468a28-5eba-410f-ac2d-33cf93bc7ea7 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aebc438-0289-44fe-ad84-4e696468f50e (non-flash)
Nov 14 10:10:54 user nova-compute[75229]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7aee6091-dab3-4c39-88a1-4bbb28dcab45 (non-flash)
Nov 14 10:10:54 user nova-compute[75229]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8892c7d-49e8-4f65-b88c-1e14fba8f50a (non-flash)
Nov 14 10:10:54 user nova-compute[75229]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf6ced86-b04f-4335-b976-fde67102c8e3 (non-flash)
Nov 14 10:10:54 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 10:10:54 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-06468a28-5eba-410f-ac2d-33cf93bc7ea7 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f73f84fe7a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7aee6091-dab3-4c39-88a1-4bbb28dcab45'): ({'sdd'}, set())}) {{(pid=75229) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 10:10:54 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-06468a28-5eba-410f-ac2d-33cf93bc7ea7 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Removing single pathed devices sdd {{(pid=75229) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 10:10:54 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:10:54 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:10:54 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[23f70f40-cc5e-4274-a89e-889e7316bb29]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:10:54 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:10:54 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:10:54 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[e86204c2-b3a1-4e5b-9ccc-882293c52fd2]: (4, ('ok\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:10:54 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-06468a28-5eba-410f-ac2d-33cf93bc7ea7 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Flushing IO for device /dev/sdd {{(pid=75229) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 10:10:54 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:10:54 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.020s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:10:54 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d121d4e-fbd8-4682-961d-cdd091362af7]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:10:54 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-06468a28-5eba-410f-ac2d-33cf93bc7ea7 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75229) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 10:10:54 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:10:54 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.043s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:10:54 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6e23848-c580-4a85-8f60-0da855f5f40d]: (4, ('1', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:10:54 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-06468a28-5eba-410f-ac2d-33cf93bc7ea7 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75229) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 10:10:54 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-06468a28-5eba-410f-ac2d-33cf93bc7ea7 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] SCSI volumes sdd have been removed. {{(pid=75229) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 10:10:54 user nova-compute[75229]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO8aff208-66bfc7ddcb96864c', '/dev/disk/by-id/scsi-23636626663376464', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_8aff208') {{(pid=86458) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 14 10:10:54 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[28d471e5-ff3a-4ac9-ae8d-53024e06e0d1]: (4, None) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:10:54 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-06468a28-5eba-410f-ac2d-33cf93bc7ea7 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7aee6091-dab3-4c39-88a1-4bbb28dcab45')] {{(pid=75229) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 10:10:54 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7aee6091-dab3-4c39-88a1-4bbb28dcab45 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:10:54 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7aee6091-dab3-4c39-88a1-4bbb28dcab45 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:10:54 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cf951f5-d836-49ff-8977-8d2cd9b5268a]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:10:54 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-06468a28-5eba-410f-ac2d-33cf93bc7ea7 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 10:10:54 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7aee6091-dab3-4c39-88a1-4bbb28dcab45 -p 172.16.0.220:3260 --logout {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:10:54 user nova-compute[75229]: DEBUG nova.network.neutron [None req-8c071a8f-59c6-467c-98b5-235b8a05c476 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] [instance: a79894e7-5018-4b3a-bd3b-694f1833f99f] Successfully created port: 54a9142a-bf94-4861-ae9e-c48faf5556e4 {{(pid=75229) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 10:10:54 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7aee6091-dab3-4c39-88a1-4bbb28dcab45 -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:10:54 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[a226aaac-7b02-49f9-b829-cc17df55d79a]: (4, ('Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:7aee6091-dab3-4c39-88a1-4bbb28dcab45, portal: 172.16.0.220,3260]\nLogout of [sid: 46, target: iqn.2010-10.org.openstack:7aee6091-dab3-4c39-88a1-4bbb28dcab45, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:10:54 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-06468a28-5eba-410f-ac2d-33cf93bc7ea7 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:7aee6091-dab3-4c39-88a1-4bbb28dcab45, portal: 172.16.0.220,3260]
Nov 14 10:10:54 user nova-compute[75229]: Logout of [sid: 46, target: iqn.2010-10.org.openstack:7aee6091-dab3-4c39-88a1-4bbb28dcab45, portal: 172.16.0.220,3260] successful.
Nov 14 10:10:54 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 10:10:54 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7aee6091-dab3-4c39-88a1-4bbb28dcab45 -p 172.16.0.220:3260 --op delete {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:10:54 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7aee6091-dab3-4c39-88a1-4bbb28dcab45 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.112s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:10:54 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[8000d6db-e63d-425a-8fb4-e3ade4cd1c01]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:10:54 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-06468a28-5eba-410f-ac2d-33cf93bc7ea7 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 10:10:54 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-06468a28-5eba-410f-ac2d-33cf93bc7ea7 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.447s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 10:10:54 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-06468a28-5eba-410f-ac2d-33cf93bc7ea7 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] <== disconnect_volume: return (449ms) None {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 10:10:54 user nova-compute[75229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-06468a28-5eba-410f-ac2d-33cf93bc7ea7 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] [instance: 10d6bce1-e55f-429c-816d-3bef9029560a] Disconnected iSCSI Volume {{(pid=75229) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 10:10:54 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-06468a28-5eba-410f-ac2d-33cf93bc7ea7 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] [instance: 10d6bce1-e55f-429c-816d-3bef9029560a] Deleting instance files /opt/stack/data/nova/instances/10d6bce1-e55f-429c-816d-3bef9029560a_del
Nov 14 10:10:54 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-06468a28-5eba-410f-ac2d-33cf93bc7ea7 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] [instance: 10d6bce1-e55f-429c-816d-3bef9029560a] Deletion of /opt/stack/data/nova/instances/10d6bce1-e55f-429c-816d-3bef9029560a_del complete
Nov 14 10:10:55 user nova-compute[75229]: INFO nova.compute.manager [None req-06468a28-5eba-410f-ac2d-33cf93bc7ea7 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] [instance: 10d6bce1-e55f-429c-816d-3bef9029560a] Took 1.45 seconds to destroy the instance on the hypervisor.
Nov 14 10:10:55 user nova-compute[75229]: DEBUG oslo.service.loopingcall [None req-06468a28-5eba-410f-ac2d-33cf93bc7ea7 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75229) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 10:10:55 user nova-compute[75229]: DEBUG nova.compute.manager [-] [instance: 10d6bce1-e55f-429c-816d-3bef9029560a] Deallocating network for instance {{(pid=75229) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 10:10:55 user nova-compute[75229]: DEBUG nova.network.neutron [-] [instance: 10d6bce1-e55f-429c-816d-3bef9029560a] deallocate_for_instance() {{(pid=75229) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 10:10:55 user nova-compute[75229]: DEBUG nova.network.neutron [None req-8c071a8f-59c6-467c-98b5-235b8a05c476 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] [instance: a79894e7-5018-4b3a-bd3b-694f1833f99f] Successfully updated port: 54a9142a-bf94-4861-ae9e-c48faf5556e4 {{(pid=75229) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 10:10:55 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-8c071a8f-59c6-467c-98b5-235b8a05c476 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Acquiring lock "refresh_cache-a79894e7-5018-4b3a-bd3b-694f1833f99f" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 10:10:55 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-8c071a8f-59c6-467c-98b5-235b8a05c476 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Acquired lock "refresh_cache-a79894e7-5018-4b3a-bd3b-694f1833f99f" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 10:10:55 user nova-compute[75229]: DEBUG nova.network.neutron [None req-8c071a8f-59c6-467c-98b5-235b8a05c476 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] [instance: a79894e7-5018-4b3a-bd3b-694f1833f99f] Building network info cache for instance {{(pid=75229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 10:10:55 user nova-compute[75229]: DEBUG nova.compute.manager [req-b08ba763-27ef-4934-9c99-11ee6b67c546 req-29193c88-742c-4600-af58-ce58cba83d04 service nova] [instance: a79894e7-5018-4b3a-bd3b-694f1833f99f] Received event network-changed-54a9142a-bf94-4861-ae9e-c48faf5556e4 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 10:10:55 user nova-compute[75229]: DEBUG nova.compute.manager [req-b08ba763-27ef-4934-9c99-11ee6b67c546 req-29193c88-742c-4600-af58-ce58cba83d04 service nova] [instance: a79894e7-5018-4b3a-bd3b-694f1833f99f] Refreshing instance network info cache due to event network-changed-54a9142a-bf94-4861-ae9e-c48faf5556e4. {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 10:10:55 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-b08ba763-27ef-4934-9c99-11ee6b67c546 req-29193c88-742c-4600-af58-ce58cba83d04 service nova] Acquiring lock "refresh_cache-a79894e7-5018-4b3a-bd3b-694f1833f99f" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 10:10:55 user nova-compute[75229]: DEBUG nova.network.neutron [-] [instance: 10d6bce1-e55f-429c-816d-3bef9029560a] Updating instance_info_cache with network_info: [] {{(pid=75229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 10:10:55 user nova-compute[75229]: DEBUG nova.network.neutron [None req-8c071a8f-59c6-467c-98b5-235b8a05c476 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] [instance: a79894e7-5018-4b3a-bd3b-694f1833f99f] Instance cache missing network info. {{(pid=75229) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 10:10:55 user nova-compute[75229]: INFO nova.compute.manager [-] [instance: 10d6bce1-e55f-429c-816d-3bef9029560a] Took 0.49 seconds to deallocate network for instance.
Nov 14 10:10:55 user nova-compute[75229]: DEBUG nova.compute.manager [req-668bde75-4142-4eb5-9984-6c78d40179a1 req-4e4b2e86-e9bb-49b4-9746-346690e1bb93 service nova] [instance: 10d6bce1-e55f-429c-816d-3bef9029560a] Received event network-vif-deleted-ea04ea8d-43a6-4f64-9e0b-cc2927f214f5 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 10:10:55 user nova-compute[75229]: DEBUG nova.network.neutron [None req-8c071a8f-59c6-467c-98b5-235b8a05c476 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] [instance: a79894e7-5018-4b3a-bd3b-694f1833f99f] Updating instance_info_cache with network_info: [{"id": "54a9142a-bf94-4861-ae9e-c48faf5556e4", "address": "fa:16:3e:e3:a3:84", "network": {"id": "118ea7c1-77c0-4660-b7b7-f311f6b0ec8a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1907578504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46620ac128944703899f22fe5439ba26", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54a9142a-bf", "ovs_interfaceid": "54a9142a-bf94-4861-ae9e-c48faf5556e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 10:10:55 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-8c071a8f-59c6-467c-98b5-235b8a05c476 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Releasing lock "refresh_cache-a79894e7-5018-4b3a-bd3b-694f1833f99f" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 10:10:55 user nova-compute[75229]: DEBUG nova.compute.manager [None req-8c071a8f-59c6-467c-98b5-235b8a05c476 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] [instance: a79894e7-5018-4b3a-bd3b-694f1833f99f] Instance network_info: |[{"id": "54a9142a-bf94-4861-ae9e-c48faf5556e4", "address": "fa:16:3e:e3:a3:84", "network": {"id": "118ea7c1-77c0-4660-b7b7-f311f6b0ec8a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1907578504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46620ac128944703899f22fe5439ba26", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54a9142a-bf", "ovs_interfaceid": "54a9142a-bf94-4861-ae9e-c48faf5556e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75229) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 10:10:55 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-b08ba763-27ef-4934-9c99-11ee6b67c546 req-29193c88-742c-4600-af58-ce58cba83d04 service nova] Acquired lock "refresh_cache-a79894e7-5018-4b3a-bd3b-694f1833f99f" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 10:10:55 user nova-compute[75229]: DEBUG nova.network.neutron [req-b08ba763-27ef-4934-9c99-11ee6b67c546 req-29193c88-742c-4600-af58-ce58cba83d04 service nova] [instance: a79894e7-5018-4b3a-bd3b-694f1833f99f] Refreshing network info cache for port 54a9142a-bf94-4861-ae9e-c48faf5556e4 {{(pid=75229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 10:10:56 user nova-compute[75229]: DEBUG nova.compute.manager [req-6e12484f-780c-4133-be2c-49bbb8d834d8 req-f90a080d-8b76-40cb-956f-8106c20e070b service nova] [instance: 10d6bce1-e55f-429c-816d-3bef9029560a] Received event network-vif-plugged-ea04ea8d-43a6-4f64-9e0b-cc2927f214f5 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 10:10:56 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-6e12484f-780c-4133-be2c-49bbb8d834d8 req-f90a080d-8b76-40cb-956f-8106c20e070b service nova] Acquiring lock "10d6bce1-e55f-429c-816d-3bef9029560a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:10:56 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-6e12484f-780c-4133-be2c-49bbb8d834d8 req-f90a080d-8b76-40cb-956f-8106c20e070b service nova] Lock "10d6bce1-e55f-429c-816d-3bef9029560a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:10:56 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-6e12484f-780c-4133-be2c-49bbb8d834d8 req-f90a080d-8b76-40cb-956f-8106c20e070b service nova] Lock "10d6bce1-e55f-429c-816d-3bef9029560a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:10:56 user nova-compute[75229]: DEBUG nova.compute.manager [req-6e12484f-780c-4133-be2c-49bbb8d834d8 req-f90a080d-8b76-40cb-956f-8106c20e070b service nova] [instance: 10d6bce1-e55f-429c-816d-3bef9029560a] No waiting events found dispatching network-vif-plugged-ea04ea8d-43a6-4f64-9e0b-cc2927f214f5 {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 10:10:56 user nova-compute[75229]: WARNING nova.compute.manager [req-6e12484f-780c-4133-be2c-49bbb8d834d8 req-f90a080d-8b76-40cb-956f-8106c20e070b service nova] [instance: 10d6bce1-e55f-429c-816d-3bef9029560a] Received unexpected event network-vif-plugged-ea04ea8d-43a6-4f64-9e0b-cc2927f214f5 for instance with vm_state active and task_state deleting.
Nov 14 10:10:56 user nova-compute[75229]: DEBUG nova.network.neutron [req-b08ba763-27ef-4934-9c99-11ee6b67c546 req-29193c88-742c-4600-af58-ce58cba83d04 service nova] [instance: a79894e7-5018-4b3a-bd3b-694f1833f99f] Updated VIF entry in instance network info cache for port 54a9142a-bf94-4861-ae9e-c48faf5556e4. {{(pid=75229) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 10:10:56 user nova-compute[75229]: DEBUG nova.network.neutron [req-b08ba763-27ef-4934-9c99-11ee6b67c546 req-29193c88-742c-4600-af58-ce58cba83d04 service nova] [instance: a79894e7-5018-4b3a-bd3b-694f1833f99f] Updating instance_info_cache with network_info: [{"id": "54a9142a-bf94-4861-ae9e-c48faf5556e4", "address": "fa:16:3e:e3:a3:84", "network": {"id": "118ea7c1-77c0-4660-b7b7-f311f6b0ec8a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1907578504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46620ac128944703899f22fe5439ba26", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54a9142a-bf", "ovs_interfaceid": "54a9142a-bf94-4861-ae9e-c48faf5556e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 10:10:56 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-b08ba763-27ef-4934-9c99-11ee6b67c546 req-29193c88-742c-4600-af58-ce58cba83d04 service nova] Releasing lock "refresh_cache-a79894e7-5018-4b3a-bd3b-694f1833f99f" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 10:10:56 user nova-compute[75229]: INFO nova.compute.manager [None req-06468a28-5eba-410f-ac2d-33cf93bc7ea7 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] [instance: 10d6bce1-e55f-429c-816d-3bef9029560a] Took 0.76 seconds to detach 1 volumes for instance.
Nov 14 10:10:56 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-06468a28-5eba-410f-ac2d-33cf93bc7ea7 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:10:56 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-06468a28-5eba-410f-ac2d-33cf93bc7ea7 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:10:56 user nova-compute[75229]: DEBUG nova.compute.provider_tree [None req-06468a28-5eba-410f-ac2d-33cf93bc7ea7 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Inventory has not changed in ProviderTree for provider: d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 {{(pid=75229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 10:10:56 user nova-compute[75229]: DEBUG nova.scheduler.client.report [None req-06468a28-5eba-410f-ac2d-33cf93bc7ea7 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Inventory has not changed for provider d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 10:10:56 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-06468a28-5eba-410f-ac2d-33cf93bc7ea7 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.251s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:10:56 user nova-compute[75229]: INFO nova.scheduler.client.report [None req-06468a28-5eba-410f-ac2d-33cf93bc7ea7 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Deleted allocations for instance 10d6bce1-e55f-429c-816d-3bef9029560a
Nov 14 10:10:56 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-06468a28-5eba-410f-ac2d-33cf93bc7ea7 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Lock "10d6bce1-e55f-429c-816d-3bef9029560a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.136s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:10:59 user nova-compute[75229]: DEBUG nova.compute.manager [None req-8c071a8f-59c6-467c-98b5-235b8a05c476 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] [instance: a79894e7-5018-4b3a-bd3b-694f1833f99f] Start spawning the instance on the hypervisor. {{(pid=75229) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 10:10:59 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-8c071a8f-59c6-467c-98b5-235b8a05c476 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] [instance: a79894e7-5018-4b3a-bd3b-694f1833f99f] Creating instance directory {{(pid=75229) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 10:10:59 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-8c071a8f-59c6-467c-98b5-235b8a05c476 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] [instance: a79894e7-5018-4b3a-bd3b-694f1833f99f] Creating image(s)
Nov 14 10:10:59 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-8c071a8f-59c6-467c-98b5-235b8a05c476 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] [instance: a79894e7-5018-4b3a-bd3b-694f1833f99f] Did not create local disks {{(pid=75229) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 14 10:10:59 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-8c071a8f-59c6-467c-98b5-235b8a05c476 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] [instance: a79894e7-5018-4b3a-bd3b-694f1833f99f] Ensure instance console log exists: /opt/stack/data/nova/instances/a79894e7-5018-4b3a-bd3b-694f1833f99f/console.log {{(pid=75229) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 10:10:59 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-8c071a8f-59c6-467c-98b5-235b8a05c476 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:10:59 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-8c071a8f-59c6-467c-98b5-235b8a05c476 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:10:59 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-8c071a8f-59c6-467c-98b5-235b8a05c476 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:10:59 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-8c071a8f-59c6-467c-98b5-235b8a05c476 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] [instance: a79894e7-5018-4b3a-bd3b-694f1833f99f] Start _get_guest_xml network_info=[{"id": "54a9142a-bf94-4861-ae9e-c48faf5556e4", "address": "fa:16:3e:e3:a3:84", "network": {"id": "118ea7c1-77c0-4660-b7b7-f311f6b0ec8a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1907578504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46620ac128944703899f22fe5439ba26", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54a9142a-bf", "ovs_interfaceid": "54a9142a-bf94-4861-ae9e-c48faf5556e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:d86c34fa-0121-4ba8-ac40-655170558568', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IGRUkZXD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'a79894e7-5018-4b3a-bd3b-694f1833f99f', 'attached_at': '', 'detached_at': '', 'volume_id': 'd86c34fa-0121-4ba8-ac40-655170558568', 'serial': 'd86c34fa-0121-4ba8-ac40-655170558568'}, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'attachment_id': '9f706207-e680-4e8c-b87e-2ab749910aba', 'guest_format': None, 'device_type': 'disk', 'volume_type': None} {{(pid=75229) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 10:10:59 user nova-compute[75229]: WARNING nova.virt.libvirt.driver [None req-8c071a8f-59c6-467c-98b5-235b8a05c476 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 10:10:59 user nova-compute[75229]: WARNING nova.virt.libvirt.driver [None req-8c071a8f-59c6-467c-98b5-235b8a05c476 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 10:10:59 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-8c071a8f-59c6-467c-98b5-235b8a05c476 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75229) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 10:10:59 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-8c071a8f-59c6-467c-98b5-235b8a05c476 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] CPU controller missing on host. {{(pid=75229) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 10:10:59 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-8c071a8f-59c6-467c-98b5-235b8a05c476 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75229) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 10:10:59 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-8c071a8f-59c6-467c-98b5-235b8a05c476 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] CPU controller found on host. {{(pid=75229) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 10:10:59 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-8c071a8f-59c6-467c-98b5-235b8a05c476 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75229) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 10:10:59 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-8c071a8f-59c6-467c-98b5-235b8a05c476 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T09:39:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 10:10:59 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-8c071a8f-59c6-467c-98b5-235b8a05c476 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Flavor limits 0:0:0 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 10:10:59 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-8c071a8f-59c6-467c-98b5-235b8a05c476 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Image limits 0:0:0 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 10:10:59 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-8c071a8f-59c6-467c-98b5-235b8a05c476 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Flavor pref 0:0:0 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 10:10:59 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-8c071a8f-59c6-467c-98b5-235b8a05c476 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Image pref 0:0:0 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 10:10:59 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-8c071a8f-59c6-467c-98b5-235b8a05c476 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 10:10:59 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-8c071a8f-59c6-467c-98b5-235b8a05c476 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 10:10:59 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-8c071a8f-59c6-467c-98b5-235b8a05c476 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75229) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 10:10:59 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-8c071a8f-59c6-467c-98b5-235b8a05c476 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Got 1 possible topologies {{(pid=75229) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 10:10:59 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-8c071a8f-59c6-467c-98b5-235b8a05c476 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 10:10:59 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-8c071a8f-59c6-467c-98b5-235b8a05c476 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 10:10:59 user nova-compute[75229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8c071a8f-59c6-467c-98b5-235b8a05c476 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] [instance: a79894e7-5018-4b3a-bd3b-694f1833f99f] Calling os-brick to attach iSCSI Volume {{(pid=75229) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 10:10:59 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c071a8f-59c6-467c-98b5-235b8a05c476 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f73f85151b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d86c34fa-0121-4ba8-ac40-655170558568', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IGRUkZXD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 10:10:59 user nova-compute[75229]: WARNING os_brick.initiator.connectors.base [None req-8c071a8f-59c6-467c-98b5-235b8a05c476 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 10:10:59 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-8c071a8f-59c6-467c-98b5-235b8a05c476 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 10:10:59 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-8c071a8f-59c6-467c-98b5-235b8a05c476 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 10:10:59 user nova-compute[75229]: WARNING os_brick.initiator.connectors.base [None req-8c071a8f-59c6-467c-98b5-235b8a05c476 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 10:10:59 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-8c071a8f-59c6-467c-98b5-235b8a05c476 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d86c34fa-0121-4ba8-ac40-655170558568" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 10:10:59 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-8c071a8f-59c6-467c-98b5-235b8a05c476 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d86c34fa-0121-4ba8-ac40-655170558568" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 10:10:59 user nova-compute[75229]: INFO os_brick.initiator.connectors.iscsi [None req-8c071a8f-59c6-467c-98b5-235b8a05c476 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 10:10:59 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:10:59 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d86c34fa-0121-4ba8-ac40-655170558568 -p 172.16.0.220:3260 {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:10:59 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d86c34fa-0121-4ba8-ac40-655170558568 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:10:59 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b42d239-9d9c-46c9-ac7e-d2dc4b624783]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:10:59 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c071a8f-59c6-467c-98b5-235b8a05c476 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 10:10:59 user nova-compute[75229]:  {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 10:10:59 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d86c34fa-0121-4ba8-ac40-655170558568 -p 172.16.0.220:3260 --interface default --op new {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:10:59 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d86c34fa-0121-4ba8-ac40-655170558568 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:10:59 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[38cf7ba4-0f7d-4637-801e-fc83921996ed]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d86c34fa-0121-4ba8-ac40-655170558568] added\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:10:59 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c071a8f-59c6-467c-98b5-235b8a05c476 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d86c34fa-0121-4ba8-ac40-655170558568] added
Nov 14 10:10:59 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 10:10:59 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d86c34fa-0121-4ba8-ac40-655170558568 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:10:59 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d86c34fa-0121-4ba8-ac40-655170558568 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:10:59 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[76164524-13c1-4f07-bbc4-97a491e6ed7d]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:10:59 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c071a8f-59c6-467c-98b5-235b8a05c476 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 10:10:59 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d86c34fa-0121-4ba8-ac40-655170558568 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:10:59 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d86c34fa-0121-4ba8-ac40-655170558568 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:10:59 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ced4718-1c99-4f9f-8d35-f4e504a58832]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:10:59 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c071a8f-59c6-467c-98b5-235b8a05c476 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 10:10:59 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d86c34fa-0121-4ba8-ac40-655170558568 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IGRUkZXD {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:10:59 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d86c34fa-0121-4ba8-ac40-655170558568 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IGRUkZXD" returned: 0 in 0.024s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:10:59 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[734607ae-c152-4c4c-818d-658201721a97]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:10:59 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c071a8f-59c6-467c-98b5-235b8a05c476 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'IGRUkZXD'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 10:10:59 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d86c34fa-0121-4ba8-ac40-655170558568 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:10:59 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d86c34fa-0121-4ba8-ac40-655170558568 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:10:59 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8e208d7-35cf-409f-81e3-b2a8985e1902]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:10:59 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c071a8f-59c6-467c-98b5-235b8a05c476 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 10:10:59 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:10:59 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:10:59 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[317c131c-fe22-4f33-99b1-23b13ed94c46]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aebc438-0289-44fe-ad84-4e696468f50e (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8892c7d-49e8-4f65-b88c-1e14fba8f50a (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf6ced86-b04f-4335-b976-fde67102c8e3 (non-flash)\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:10:59 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c071a8f-59c6-467c-98b5-235b8a05c476 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aebc438-0289-44fe-ad84-4e696468f50e (non-flash)
Nov 14 10:10:59 user nova-compute[75229]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8892c7d-49e8-4f65-b88c-1e14fba8f50a (non-flash)
Nov 14 10:10:59 user nova-compute[75229]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf6ced86-b04f-4335-b976-fde67102c8e3 (non-flash)
Nov 14 10:10:59 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 10:10:59 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c071a8f-59c6-467c-98b5-235b8a05c476 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aebc438-0289-44fe-ad84-4e696468f50e (non-flash)
Nov 14 10:10:59 user nova-compute[75229]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8892c7d-49e8-4f65-b88c-1e14fba8f50a (non-flash)
Nov 14 10:10:59 user nova-compute[75229]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf6ced86-b04f-4335-b976-fde67102c8e3 (non-flash)
Nov 14 10:10:59 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 10:10:59 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d86c34fa-0121-4ba8-ac40-655170558568 -p 172.16.0.220:3260 --login {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:10:59 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d86c34fa-0121-4ba8-ac40-655170558568 -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:10:59 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c3e5c74-b4bb-44fc-8a7d-2d22d131d7f1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d86c34fa-0121-4ba8-ac40-655170558568, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d86c34fa-0121-4ba8-ac40-655170558568, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:10:59 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c071a8f-59c6-467c-98b5-235b8a05c476 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d86c34fa-0121-4ba8-ac40-655170558568, portal: 172.16.0.220,3260]
Nov 14 10:10:59 user nova-compute[75229]: Login to [iface: default, target: iqn.2010-10.org.openstack:d86c34fa-0121-4ba8-ac40-655170558568, portal: 172.16.0.220,3260] successful.
Nov 14 10:10:59 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 10:10:59 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d86c34fa-0121-4ba8-ac40-655170558568 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:10:59 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d86c34fa-0121-4ba8-ac40-655170558568 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:10:59 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d473dc7-8cda-494a-8e9f-9115422b1bbb]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:10:59 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c071a8f-59c6-467c-98b5-235b8a05c476 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 10:10:59 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:10:59 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:10:59 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9ebb81c-03f1-4e45-90f2-9ab92ef24cb1]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aebc438-0289-44fe-ad84-4e696468f50e (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8892c7d-49e8-4f65-b88c-1e14fba8f50a (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf6ced86-b04f-4335-b976-fde67102c8e3 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d86c34fa-0121-4ba8-ac40-655170558568 (non-flash)\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:10:59 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c071a8f-59c6-467c-98b5-235b8a05c476 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aebc438-0289-44fe-ad84-4e696468f50e (non-flash)
Nov 14 10:10:59 user nova-compute[75229]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8892c7d-49e8-4f65-b88c-1e14fba8f50a (non-flash)
Nov 14 10:10:59 user nova-compute[75229]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf6ced86-b04f-4335-b976-fde67102c8e3 (non-flash)
Nov 14 10:10:59 user nova-compute[75229]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d86c34fa-0121-4ba8-ac40-655170558568 (non-flash)
Nov 14 10:10:59 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 10:10:59 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c071a8f-59c6-467c-98b5-235b8a05c476 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aebc438-0289-44fe-ad84-4e696468f50e (non-flash)
Nov 14 10:10:59 user nova-compute[75229]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8892c7d-49e8-4f65-b88c-1e14fba8f50a (non-flash)
Nov 14 10:10:59 user nova-compute[75229]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf6ced86-b04f-4335-b976-fde67102c8e3 (non-flash)
Nov 14 10:10:59 user nova-compute[75229]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d86c34fa-0121-4ba8-ac40-655170558568 (non-flash)
Nov 14 10:10:59 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 10:10:59 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-8c071a8f-59c6-467c-98b5-235b8a05c476 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d86c34fa-0121-4ba8-ac40-655170558568" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.279s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 10:10:59 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c071a8f-59c6-467c-98b5-235b8a05c476 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Connected to 172.16.0.220:3260 {{(pid=75229) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 10:10:59 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-8c071a8f-59c6-467c-98b5-235b8a05c476 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] HCTL ('35', '-', '-', 0) found on session 54 with lun 0 {{(pid=75229) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 10:10:59 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-8c071a8f-59c6-467c-98b5-235b8a05c476 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75229) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 10:10:59 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:10:59 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:10:59 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fa91954-c586-4ad8-b8d8-0118b5fa4ca8]: (4, ('- - 0', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:10:59 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-8c071a8f-59c6-467c-98b5-235b8a05c476 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Searching for a device in session 54 and hctl ['35', '*', '*', 0] yield: None {{(pid=75229) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 10:10:59 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:11:00 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-8c071a8f-59c6-467c-98b5-235b8a05c476 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Searching for a device in session 54 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75229) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 10:11:00 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c071a8f-59c6-467c-98b5-235b8a05c476 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:d86c34fa-0121-4ba8-ac40-655170558568', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IGRUkZXD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75229) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 10:11:00 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-8c071a8f-59c6-467c-98b5-235b8a05c476 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.309s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 10:11:00 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c071a8f-59c6-467c-98b5-235b8a05c476 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] <== connect_volume: return (1310ms) {'type': 'block', 'scsi_wwn': '26639353061623034', 'path': '/dev/sdd'} {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 10:11:00 user nova-compute[75229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8c071a8f-59c6-467c-98b5-235b8a05c476 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] [instance: a79894e7-5018-4b3a-bd3b-694f1833f99f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26639353061623034', 'path': '/dev/sdd'} {{(pid=75229) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 10:11:00 user nova-compute[75229]: DEBUG nova.virt.libvirt.vif [None req-8c071a8f-59c6-467c-98b5-235b8a05c476 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T10:10:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-179798678',display_name='tempest-TestVolumeBootPattern-server-179798678',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-179798678',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB5A5mLvKIp6dvI0hO7rO3NlF4G2D20sY7gWEAC+0V/AEyka0aVsvCwYcGQ5KpPpLYwOEY7teK2+b3AO8avbXCe5MdbQ1NPGUWXRV3gtRowACc3Uq7kyXeekLcjWCRcSng==',key_name='tempest-TestVolumeBootPattern-2092695190',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='46620ac128944703899f22fe5439ba26',ramdisk_id='',reservation_id='r-l2k800g0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2064993142',owner_user_name='tempest-TestVolumeBootPattern-2064993142-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T10:10:54Z,user_data=None,user_id='c26f33e4cdf14ba796445959953f8685',uuid=a79894e7-5018-4b3a-bd3b-694f1833f99f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "54a9142a-bf94-4861-ae9e-c48faf5556e4", "address": "fa:16:3e:e3:a3:84", "network": {"id": "118ea7c1-77c0-4660-b7b7-f311f6b0ec8a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1907578504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46620ac128944703899f22fe5439ba26", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54a9142a-bf", "ovs_interfaceid": "54a9142a-bf94-4861-ae9e-c48faf5556e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75229) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 10:11:00 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-8c071a8f-59c6-467c-98b5-235b8a05c476 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Converting VIF {"id": "54a9142a-bf94-4861-ae9e-c48faf5556e4", "address": "fa:16:3e:e3:a3:84", "network": {"id": "118ea7c1-77c0-4660-b7b7-f311f6b0ec8a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1907578504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46620ac128944703899f22fe5439ba26", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54a9142a-bf", "ovs_interfaceid": "54a9142a-bf94-4861-ae9e-c48faf5556e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 10:11:00 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-8c071a8f-59c6-467c-98b5-235b8a05c476 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e3:a3:84,bridge_name='br-int',has_traffic_filtering=True,id=54a9142a-bf94-4861-ae9e-c48faf5556e4,network=Network(118ea7c1-77c0-4660-b7b7-f311f6b0ec8a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap54a9142a-bf') {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 10:11:00 user nova-compute[75229]: DEBUG nova.objects.instance [None req-8c071a8f-59c6-467c-98b5-235b8a05c476 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Lazy-loading 'pci_devices' on Instance uuid a79894e7-5018-4b3a-bd3b-694f1833f99f {{(pid=75229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 10:11:00 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-8c071a8f-59c6-467c-98b5-235b8a05c476 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] [instance: a79894e7-5018-4b3a-bd3b-694f1833f99f] End _get_guest_xml xml=<domain type="kvm">
Nov 14 10:11:00 user nova-compute[75229]:   <uuid>a79894e7-5018-4b3a-bd3b-694f1833f99f</uuid>
Nov 14 10:11:00 user nova-compute[75229]:   <name>instance-00000032</name>
Nov 14 10:11:00 user nova-compute[75229]:   <memory>524288</memory>
Nov 14 10:11:00 user nova-compute[75229]:   <vcpu>1</vcpu>
Nov 14 10:11:00 user nova-compute[75229]:   <metadata>
Nov 14 10:11:00 user nova-compute[75229]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 10:11:00 user nova-compute[75229]:       <nova:package version="0.0.0"/>
Nov 14 10:11:00 user nova-compute[75229]:       <nova:name>tempest-TestVolumeBootPattern-server-179798678</nova:name>
Nov 14 10:11:00 user nova-compute[75229]:       <nova:creationTime>2023-11-14 10:10:59</nova:creationTime>
Nov 14 10:11:00 user nova-compute[75229]:       <nova:flavor name="m1.tiny">
Nov 14 10:11:00 user nova-compute[75229]:         <nova:memory>512</nova:memory>
Nov 14 10:11:00 user nova-compute[75229]:         <nova:disk>1</nova:disk>
Nov 14 10:11:00 user nova-compute[75229]:         <nova:swap>0</nova:swap>
Nov 14 10:11:00 user nova-compute[75229]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 10:11:00 user nova-compute[75229]:         <nova:vcpus>1</nova:vcpus>
Nov 14 10:11:00 user nova-compute[75229]:       </nova:flavor>
Nov 14 10:11:00 user nova-compute[75229]:       <nova:owner>
Nov 14 10:11:00 user nova-compute[75229]:         <nova:user uuid="c26f33e4cdf14ba796445959953f8685">tempest-TestVolumeBootPattern-2064993142-project-member</nova:user>
Nov 14 10:11:00 user nova-compute[75229]:         <nova:project uuid="46620ac128944703899f22fe5439ba26">tempest-TestVolumeBootPattern-2064993142</nova:project>
Nov 14 10:11:00 user nova-compute[75229]:       </nova:owner>
Nov 14 10:11:00 user nova-compute[75229]:       <nova:ports>
Nov 14 10:11:00 user nova-compute[75229]:         <nova:port uuid="54a9142a-bf94-4861-ae9e-c48faf5556e4">
Nov 14 10:11:00 user nova-compute[75229]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 14 10:11:00 user nova-compute[75229]:         </nova:port>
Nov 14 10:11:00 user nova-compute[75229]:       </nova:ports>
Nov 14 10:11:00 user nova-compute[75229]:     </nova:instance>
Nov 14 10:11:00 user nova-compute[75229]:   </metadata>
Nov 14 10:11:00 user nova-compute[75229]:   <sysinfo type="smbios">
Nov 14 10:11:00 user nova-compute[75229]:     <system>
Nov 14 10:11:00 user nova-compute[75229]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 10:11:00 user nova-compute[75229]:       <entry name="product">OpenStack Nova</entry>
Nov 14 10:11:00 user nova-compute[75229]:       <entry name="version">0.0.0</entry>
Nov 14 10:11:00 user nova-compute[75229]:       <entry name="serial">a79894e7-5018-4b3a-bd3b-694f1833f99f</entry>
Nov 14 10:11:00 user nova-compute[75229]:       <entry name="uuid">a79894e7-5018-4b3a-bd3b-694f1833f99f</entry>
Nov 14 10:11:00 user nova-compute[75229]:       <entry name="family">Virtual Machine</entry>
Nov 14 10:11:00 user nova-compute[75229]:     </system>
Nov 14 10:11:00 user nova-compute[75229]:   </sysinfo>
Nov 14 10:11:00 user nova-compute[75229]:   <os>
Nov 14 10:11:00 user nova-compute[75229]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 10:11:00 user nova-compute[75229]:     <boot dev="hd"/>
Nov 14 10:11:00 user nova-compute[75229]:     <smbios mode="sysinfo"/>
Nov 14 10:11:00 user nova-compute[75229]:   </os>
Nov 14 10:11:00 user nova-compute[75229]:   <features>
Nov 14 10:11:00 user nova-compute[75229]:     <acpi/>
Nov 14 10:11:00 user nova-compute[75229]:     <apic/>
Nov 14 10:11:00 user nova-compute[75229]:     <vmcoreinfo/>
Nov 14 10:11:00 user nova-compute[75229]:   </features>
Nov 14 10:11:00 user nova-compute[75229]:   <clock offset="utc">
Nov 14 10:11:00 user nova-compute[75229]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 10:11:00 user nova-compute[75229]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 10:11:00 user nova-compute[75229]:     <timer name="hpet" present="no"/>
Nov 14 10:11:00 user nova-compute[75229]:   </clock>
Nov 14 10:11:00 user nova-compute[75229]:   <cpu mode="custom" match="exact">
Nov 14 10:11:00 user nova-compute[75229]:     <model>Nehalem</model>
Nov 14 10:11:00 user nova-compute[75229]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 10:11:00 user nova-compute[75229]:   </cpu>
Nov 14 10:11:00 user nova-compute[75229]:   <devices>
Nov 14 10:11:00 user nova-compute[75229]:     <disk type="block" device="disk">
Nov 14 10:11:00 user nova-compute[75229]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 10:11:00 user nova-compute[75229]:       <source dev="/dev/sdd"/>
Nov 14 10:11:00 user nova-compute[75229]:       <target dev="vda" bus="virtio"/>
Nov 14 10:11:00 user nova-compute[75229]:       <serial>d86c34fa-0121-4ba8-ac40-655170558568</serial>
Nov 14 10:11:00 user nova-compute[75229]:     </disk>
Nov 14 10:11:00 user nova-compute[75229]:     <interface type="ethernet">
Nov 14 10:11:00 user nova-compute[75229]:       <mac address="fa:16:3e:e3:a3:84"/>
Nov 14 10:11:00 user nova-compute[75229]:       <model type="virtio"/>
Nov 14 10:11:00 user nova-compute[75229]:       <mtu size="1442"/>
Nov 14 10:11:00 user nova-compute[75229]:       <target dev="tap54a9142a-bf"/>
Nov 14 10:11:00 user nova-compute[75229]:     </interface>
Nov 14 10:11:00 user nova-compute[75229]:     <serial type="pty">
Nov 14 10:11:00 user nova-compute[75229]:       <log file="/opt/stack/data/nova/instances/a79894e7-5018-4b3a-bd3b-694f1833f99f/console.log" append="off"/>
Nov 14 10:11:00 user nova-compute[75229]:     </serial>
Nov 14 10:11:00 user nova-compute[75229]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 10:11:00 user nova-compute[75229]:     <video>
Nov 14 10:11:00 user nova-compute[75229]:       <model type="virtio"/>
Nov 14 10:11:00 user nova-compute[75229]:     </video>
Nov 14 10:11:00 user nova-compute[75229]:     <rng model="virtio">
Nov 14 10:11:00 user nova-compute[75229]:       <backend model="random">/dev/urandom</backend>
Nov 14 10:11:00 user nova-compute[75229]:     </rng>
Nov 14 10:11:00 user nova-compute[75229]:     <controller type="usb" index="0" model="none"/>
Nov 14 10:11:00 user nova-compute[75229]:     <memballoon model="virtio">
Nov 14 10:11:00 user nova-compute[75229]:       <stats period="10"/>
Nov 14 10:11:00 user nova-compute[75229]:     </memballoon>
Nov 14 10:11:00 user nova-compute[75229]:   </devices>
Nov 14 10:11:00 user nova-compute[75229]: </domain>
Nov 14 10:11:00 user nova-compute[75229]:  {{(pid=75229) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 10:11:00 user nova-compute[75229]: DEBUG nova.virt.libvirt.vif [None req-8c071a8f-59c6-467c-98b5-235b8a05c476 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T10:10:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-179798678',display_name='tempest-TestVolumeBootPattern-server-179798678',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-179798678',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB5A5mLvKIp6dvI0hO7rO3NlF4G2D20sY7gWEAC+0V/AEyka0aVsvCwYcGQ5KpPpLYwOEY7teK2+b3AO8avbXCe5MdbQ1NPGUWXRV3gtRowACc3Uq7kyXeekLcjWCRcSng==',key_name='tempest-TestVolumeBootPattern-2092695190',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='46620ac128944703899f22fe5439ba26',ramdisk_id='',reservation_id='r-l2k800g0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2064993142',owner_user_name='tempest-TestVolumeBootPattern-2064993142-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T10:10:54Z,user_data=None,user_id='c26f33e4cdf14ba796445959953f8685',uuid=a79894e7-5018-4b3a-bd3b-694f1833f99f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "54a9142a-bf94-4861-ae9e-c48faf5556e4", "address": "fa:16:3e:e3:a3:84", "network": {"id": "118ea7c1-77c0-4660-b7b7-f311f6b0ec8a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1907578504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46620ac128944703899f22fe5439ba26", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54a9142a-bf", "ovs_interfaceid": "54a9142a-bf94-4861-ae9e-c48faf5556e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 10:11:00 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-8c071a8f-59c6-467c-98b5-235b8a05c476 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Converting VIF {"id": "54a9142a-bf94-4861-ae9e-c48faf5556e4", "address": "fa:16:3e:e3:a3:84", "network": {"id": "118ea7c1-77c0-4660-b7b7-f311f6b0ec8a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1907578504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46620ac128944703899f22fe5439ba26", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54a9142a-bf", "ovs_interfaceid": "54a9142a-bf94-4861-ae9e-c48faf5556e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 10:11:00 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-8c071a8f-59c6-467c-98b5-235b8a05c476 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e3:a3:84,bridge_name='br-int',has_traffic_filtering=True,id=54a9142a-bf94-4861-ae9e-c48faf5556e4,network=Network(118ea7c1-77c0-4660-b7b7-f311f6b0ec8a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap54a9142a-bf') {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 10:11:00 user nova-compute[75229]: DEBUG os_vif [None req-8c071a8f-59c6-467c-98b5-235b8a05c476 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e3:a3:84,bridge_name='br-int',has_traffic_filtering=True,id=54a9142a-bf94-4861-ae9e-c48faf5556e4,network=Network(118ea7c1-77c0-4660-b7b7-f311f6b0ec8a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap54a9142a-bf') {{(pid=75229) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 10:11:00 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:11:00 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 10:11:00 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 10:11:00 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:11:00 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5b7c2b51-9778-543c-88a0-ca55762709f5', '_type': 'linux-noop'}}, row=False) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 10:11:00 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:11:00 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 10:11:00 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:11:00 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:11:00 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap54a9142a-bf, may_exist=True, interface_attrs={}) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 10:11:00 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap54a9142a-bf, col_values=(('qos', UUID('d3ea0702-4e36-4ec3-83cb-22141c6b33b0')),), if_exists=True) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 10:11:00 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap54a9142a-bf, col_values=(('external_ids', {'iface-id': '54a9142a-bf94-4861-ae9e-c48faf5556e4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e3:a3:84', 'vm-uuid': 'a79894e7-5018-4b3a-bd3b-694f1833f99f'}),), if_exists=True) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 10:11:00 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:11:00 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 10:11:00 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:11:00 user nova-compute[75229]: INFO os_vif [None req-8c071a8f-59c6-467c-98b5-235b8a05c476 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e3:a3:84,bridge_name='br-int',has_traffic_filtering=True,id=54a9142a-bf94-4861-ae9e-c48faf5556e4,network=Network(118ea7c1-77c0-4660-b7b7-f311f6b0ec8a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap54a9142a-bf')
Nov 14 10:11:00 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-8c071a8f-59c6-467c-98b5-235b8a05c476 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] No BDM found with device name vda, not building metadata. {{(pid=75229) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 10:11:00 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-8c071a8f-59c6-467c-98b5-235b8a05c476 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] No VIF found with MAC fa:16:3e:e3:a3:84, not building metadata {{(pid=75229) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 10:11:00 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:11:01 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:11:01 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:11:01 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:11:01 user nova-compute[75229]: DEBUG nova.compute.manager [req-f062b160-8c5b-4607-9837-b8f1a3ccae87 req-2808f358-d368-4f84-81aa-3caeb5276293 service nova] [instance: a79894e7-5018-4b3a-bd3b-694f1833f99f] Received event network-vif-plugged-54a9142a-bf94-4861-ae9e-c48faf5556e4 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 10:11:01 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-f062b160-8c5b-4607-9837-b8f1a3ccae87 req-2808f358-d368-4f84-81aa-3caeb5276293 service nova] Acquiring lock "a79894e7-5018-4b3a-bd3b-694f1833f99f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:11:01 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-f062b160-8c5b-4607-9837-b8f1a3ccae87 req-2808f358-d368-4f84-81aa-3caeb5276293 service nova] Lock "a79894e7-5018-4b3a-bd3b-694f1833f99f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:11:01 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-f062b160-8c5b-4607-9837-b8f1a3ccae87 req-2808f358-d368-4f84-81aa-3caeb5276293 service nova] Lock "a79894e7-5018-4b3a-bd3b-694f1833f99f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:11:01 user nova-compute[75229]: DEBUG nova.compute.manager [req-f062b160-8c5b-4607-9837-b8f1a3ccae87 req-2808f358-d368-4f84-81aa-3caeb5276293 service nova] [instance: a79894e7-5018-4b3a-bd3b-694f1833f99f] No waiting events found dispatching network-vif-plugged-54a9142a-bf94-4861-ae9e-c48faf5556e4 {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 10:11:01 user nova-compute[75229]: WARNING nova.compute.manager [req-f062b160-8c5b-4607-9837-b8f1a3ccae87 req-2808f358-d368-4f84-81aa-3caeb5276293 service nova] [instance: a79894e7-5018-4b3a-bd3b-694f1833f99f] Received unexpected event network-vif-plugged-54a9142a-bf94-4861-ae9e-c48faf5556e4 for instance with vm_state building and task_state spawning.
Nov 14 10:11:01 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:11:01 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:11:03 user nova-compute[75229]: DEBUG nova.compute.manager [None req-8c071a8f-59c6-467c-98b5-235b8a05c476 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] [instance: a79894e7-5018-4b3a-bd3b-694f1833f99f] Instance event wait completed in 0 seconds for  {{(pid=75229) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 10:11:03 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-8c071a8f-59c6-467c-98b5-235b8a05c476 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] [instance: a79894e7-5018-4b3a-bd3b-694f1833f99f] Guest created on hypervisor {{(pid=75229) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 10:11:03 user nova-compute[75229]: INFO nova.virt.libvirt.driver [-] [instance: a79894e7-5018-4b3a-bd3b-694f1833f99f] Instance spawned successfully.
Nov 14 10:11:03 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-8c071a8f-59c6-467c-98b5-235b8a05c476 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] [instance: a79894e7-5018-4b3a-bd3b-694f1833f99f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 10:11:03 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-8c071a8f-59c6-467c-98b5-235b8a05c476 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] [instance: a79894e7-5018-4b3a-bd3b-694f1833f99f] Found default for hw_cdrom_bus of ide {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 10:11:03 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-8c071a8f-59c6-467c-98b5-235b8a05c476 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] [instance: a79894e7-5018-4b3a-bd3b-694f1833f99f] Found default for hw_disk_bus of virtio {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 10:11:03 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-8c071a8f-59c6-467c-98b5-235b8a05c476 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] [instance: a79894e7-5018-4b3a-bd3b-694f1833f99f] Found default for hw_input_bus of None {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 10:11:03 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-8c071a8f-59c6-467c-98b5-235b8a05c476 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] [instance: a79894e7-5018-4b3a-bd3b-694f1833f99f] Found default for hw_pointer_model of None {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 10:11:03 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-8c071a8f-59c6-467c-98b5-235b8a05c476 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] [instance: a79894e7-5018-4b3a-bd3b-694f1833f99f] Found default for hw_video_model of virtio {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 10:11:03 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-8c071a8f-59c6-467c-98b5-235b8a05c476 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] [instance: a79894e7-5018-4b3a-bd3b-694f1833f99f] Found default for hw_vif_model of virtio {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 10:11:03 user nova-compute[75229]: INFO nova.compute.manager [None req-8c071a8f-59c6-467c-98b5-235b8a05c476 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] [instance: a79894e7-5018-4b3a-bd3b-694f1833f99f] Took 4.90 seconds to spawn the instance on the hypervisor.
Nov 14 10:11:03 user nova-compute[75229]: DEBUG nova.compute.manager [None req-8c071a8f-59c6-467c-98b5-235b8a05c476 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] [instance: a79894e7-5018-4b3a-bd3b-694f1833f99f] Checking state {{(pid=75229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 10:11:03 user nova-compute[75229]: DEBUG nova.compute.manager [req-cb65fccd-f223-4748-ba6f-b5df34c57832 req-90bd0a30-7bda-47c0-99aa-8e1c3849bb76 service nova] [instance: a79894e7-5018-4b3a-bd3b-694f1833f99f] Received event network-vif-plugged-54a9142a-bf94-4861-ae9e-c48faf5556e4 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 10:11:03 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-cb65fccd-f223-4748-ba6f-b5df34c57832 req-90bd0a30-7bda-47c0-99aa-8e1c3849bb76 service nova] Acquiring lock "a79894e7-5018-4b3a-bd3b-694f1833f99f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:11:03 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-cb65fccd-f223-4748-ba6f-b5df34c57832 req-90bd0a30-7bda-47c0-99aa-8e1c3849bb76 service nova] Lock "a79894e7-5018-4b3a-bd3b-694f1833f99f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:11:03 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-cb65fccd-f223-4748-ba6f-b5df34c57832 req-90bd0a30-7bda-47c0-99aa-8e1c3849bb76 service nova] Lock "a79894e7-5018-4b3a-bd3b-694f1833f99f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:11:03 user nova-compute[75229]: DEBUG nova.compute.manager [req-cb65fccd-f223-4748-ba6f-b5df34c57832 req-90bd0a30-7bda-47c0-99aa-8e1c3849bb76 service nova] [instance: a79894e7-5018-4b3a-bd3b-694f1833f99f] No waiting events found dispatching network-vif-plugged-54a9142a-bf94-4861-ae9e-c48faf5556e4 {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 10:11:03 user nova-compute[75229]: WARNING nova.compute.manager [req-cb65fccd-f223-4748-ba6f-b5df34c57832 req-90bd0a30-7bda-47c0-99aa-8e1c3849bb76 service nova] [instance: a79894e7-5018-4b3a-bd3b-694f1833f99f] Received unexpected event network-vif-plugged-54a9142a-bf94-4861-ae9e-c48faf5556e4 for instance with vm_state building and task_state spawning.
Nov 14 10:11:04 user nova-compute[75229]: INFO nova.compute.manager [None req-8c071a8f-59c6-467c-98b5-235b8a05c476 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] [instance: a79894e7-5018-4b3a-bd3b-694f1833f99f] Took 10.37 seconds to build instance.
Nov 14 10:11:04 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-8c071a8f-59c6-467c-98b5-235b8a05c476 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Lock "a79894e7-5018-4b3a-bd3b-694f1833f99f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.458s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:11:04 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:11:04 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:11:04 user nova-compute[75229]: DEBUG nova.compute.manager [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Starting heal instance info cache {{(pid=75229) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 10:11:04 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Acquiring lock "refresh_cache-30ae1f73-e0f3-4e26-987e-a684471a160d" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 10:11:04 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Acquired lock "refresh_cache-30ae1f73-e0f3-4e26-987e-a684471a160d" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 10:11:04 user nova-compute[75229]: DEBUG nova.network.neutron [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] [instance: 30ae1f73-e0f3-4e26-987e-a684471a160d] Forcefully refreshing network info cache for instance {{(pid=75229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 10:11:05 user nova-compute[75229]: DEBUG nova.network.neutron [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] [instance: 30ae1f73-e0f3-4e26-987e-a684471a160d] Updating instance_info_cache with network_info: [{"id": "c087c657-8eee-4e8e-bef1-4281129597ae", "address": "fa:16:3e:aa:d3:e3", "network": {"id": "6a700b61-4aa6-440b-87e6-a3525a5cb918", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-448680331-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8babb73006da4977a1fe2bdb35e08d8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc087c657-8e", "ovs_interfaceid": "c087c657-8eee-4e8e-bef1-4281129597ae", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 10:11:05 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Releasing lock "refresh_cache-30ae1f73-e0f3-4e26-987e-a684471a160d" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 10:11:05 user nova-compute[75229]: DEBUG nova.compute.manager [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] [instance: 30ae1f73-e0f3-4e26-987e-a684471a160d] Updated the network info_cache for instance {{(pid=75229) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 10:11:05 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:11:09 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:11:09 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:11:10 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:11:10 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:11:10 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:11:10 user nova-compute[75229]: DEBUG nova.compute.manager [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75229) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 10:11:11 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:11:11 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:11:11 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:11:11 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:11:11 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Auditing locally available compute resources for user (node: user) {{(pid=75229) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 10:11:11 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cda8c5ad-e70c-4021-bace-d55831c4bc78/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:11:12 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cda8c5ad-e70c-4021-bace-d55831c4bc78/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:11:12 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cda8c5ad-e70c-4021-bace-d55831c4bc78/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:11:12 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cda8c5ad-e70c-4021-bace-d55831c4bc78/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:11:12 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1679275-ebb1-4f15-80a4-b8fd614fc34b/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:11:12 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1679275-ebb1-4f15-80a4-b8fd614fc34b/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:11:12 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1679275-ebb1-4f15-80a4-b8fd614fc34b/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:11:12 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1679275-ebb1-4f15-80a4-b8fd614fc34b/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:11:12 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75229) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 10:11:12 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75229) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 10:11:12 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75229) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 10:11:12 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68d9de39-cbd2-44b2-bda8-015c8482c240/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:11:12 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68d9de39-cbd2-44b2-bda8-015c8482c240/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:11:12 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68d9de39-cbd2-44b2-bda8-015c8482c240/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:11:12 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68d9de39-cbd2-44b2-bda8-015c8482c240/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:11:12 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75229) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 10:11:13 user nova-compute[75229]: WARNING nova.virt.libvirt.driver [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 10:11:13 user nova-compute[75229]: WARNING nova.virt.libvirt.driver [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 10:11:13 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Hypervisor/Node resource view: name=user free_ram=8574MB free_disk=24.92617416381836GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75229) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 10:11:13 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:11:13 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:11:13 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Instance cda8c5ad-e70c-4021-bace-d55831c4bc78 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 10:11:13 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Instance 30ae1f73-e0f3-4e26-987e-a684471a160d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 10:11:13 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Instance c1679275-ebb1-4f15-80a4-b8fd614fc34b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 10:11:13 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Instance 68d9de39-cbd2-44b2-bda8-015c8482c240 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 10:11:13 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Instance 4a81b779-af09-4026-8387-07d44dad6ef7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 10:11:13 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Instance a79894e7-5018-4b3a-bd3b-694f1833f99f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 10:11:13 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=75229) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 10:11:13 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=75229) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 10:11:13 user nova-compute[75229]: DEBUG nova.compute.provider_tree [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Inventory has not changed in ProviderTree for provider: d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 {{(pid=75229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 10:11:13 user nova-compute[75229]: DEBUG nova.scheduler.client.report [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Inventory has not changed for provider d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 10:11:13 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Compute_service record updated for user:user {{(pid=75229) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 10:11:13 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.357s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:11:14 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:11:14 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:11:15 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:11:18 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:11:19 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:11:20 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:11:24 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:11:25 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:11:29 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:11:30 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:11:34 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:11:35 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:11:40 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:11:44 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-69fc7d93-8625-46f2-ac32-e30a83cd021b tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Acquiring lock "c1679275-ebb1-4f15-80a4-b8fd614fc34b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:11:44 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-69fc7d93-8625-46f2-ac32-e30a83cd021b tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Lock "c1679275-ebb1-4f15-80a4-b8fd614fc34b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:11:44 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-69fc7d93-8625-46f2-ac32-e30a83cd021b tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Acquiring lock "c1679275-ebb1-4f15-80a4-b8fd614fc34b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:11:44 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-69fc7d93-8625-46f2-ac32-e30a83cd021b tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Lock "c1679275-ebb1-4f15-80a4-b8fd614fc34b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:11:44 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-69fc7d93-8625-46f2-ac32-e30a83cd021b tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Lock "c1679275-ebb1-4f15-80a4-b8fd614fc34b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:11:44 user nova-compute[75229]: INFO nova.compute.manager [None req-69fc7d93-8625-46f2-ac32-e30a83cd021b tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] [instance: c1679275-ebb1-4f15-80a4-b8fd614fc34b] Terminating instance
Nov 14 10:11:44 user nova-compute[75229]: DEBUG nova.compute.manager [None req-69fc7d93-8625-46f2-ac32-e30a83cd021b tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] [instance: c1679275-ebb1-4f15-80a4-b8fd614fc34b] Start destroying the instance on the hypervisor. {{(pid=75229) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 10:11:44 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:11:44 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:11:44 user nova-compute[75229]: DEBUG nova.compute.manager [req-047eb91c-f2c3-4278-ad0b-c2370998dc3e req-0f927560-a1e6-42b9-a514-80442d0ed329 service nova] [instance: c1679275-ebb1-4f15-80a4-b8fd614fc34b] Received event network-vif-unplugged-2a5dfb7a-fd65-41fc-9997-8c2d25ea44a7 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 10:11:44 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-047eb91c-f2c3-4278-ad0b-c2370998dc3e req-0f927560-a1e6-42b9-a514-80442d0ed329 service nova] Acquiring lock "c1679275-ebb1-4f15-80a4-b8fd614fc34b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:11:44 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-047eb91c-f2c3-4278-ad0b-c2370998dc3e req-0f927560-a1e6-42b9-a514-80442d0ed329 service nova] Lock "c1679275-ebb1-4f15-80a4-b8fd614fc34b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:11:44 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-047eb91c-f2c3-4278-ad0b-c2370998dc3e req-0f927560-a1e6-42b9-a514-80442d0ed329 service nova] Lock "c1679275-ebb1-4f15-80a4-b8fd614fc34b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:11:44 user nova-compute[75229]: DEBUG nova.compute.manager [req-047eb91c-f2c3-4278-ad0b-c2370998dc3e req-0f927560-a1e6-42b9-a514-80442d0ed329 service nova] [instance: c1679275-ebb1-4f15-80a4-b8fd614fc34b] No waiting events found dispatching network-vif-unplugged-2a5dfb7a-fd65-41fc-9997-8c2d25ea44a7 {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 10:11:44 user nova-compute[75229]: DEBUG nova.compute.manager [req-047eb91c-f2c3-4278-ad0b-c2370998dc3e req-0f927560-a1e6-42b9-a514-80442d0ed329 service nova] [instance: c1679275-ebb1-4f15-80a4-b8fd614fc34b] Received event network-vif-unplugged-2a5dfb7a-fd65-41fc-9997-8c2d25ea44a7 for instance with task_state deleting. {{(pid=75229) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 10:11:45 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:11:45 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:11:45 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:11:45 user nova-compute[75229]: INFO nova.virt.libvirt.driver [-] [instance: c1679275-ebb1-4f15-80a4-b8fd614fc34b] Instance destroyed successfully.
Nov 14 10:11:45 user nova-compute[75229]: DEBUG nova.objects.instance [None req-69fc7d93-8625-46f2-ac32-e30a83cd021b tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Lazy-loading 'resources' on Instance uuid c1679275-ebb1-4f15-80a4-b8fd614fc34b {{(pid=75229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 10:11:45 user nova-compute[75229]: DEBUG nova.virt.libvirt.vif [None req-69fc7d93-8625-46f2-ac32-e30a83cd021b tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T10:02:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1519406851',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1519406851',id=41,image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-14T10:02:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8babb73006da4977a1fe2bdb35e08d8f',ramdisk_id='',reservation_id='r-jphuxmn0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-189750210',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T10:04:18Z,user_data=None,user_id='a8825cd49e9349f28576b704c4c4d717',uuid=c1679275-ebb1-4f15-80a4-b8fd614fc34b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2a5dfb7a-fd65-41fc-9997-8c2d25ea44a7", "address": "fa:16:3e:1f:d7:f3", "network": {"id": "6a700b61-4aa6-440b-87e6-a3525a5cb918", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-448680331-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8babb73006da4977a1fe2bdb35e08d8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a5dfb7a-fd", "ovs_interfaceid": "2a5dfb7a-fd65-41fc-9997-8c2d25ea44a7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 10:11:45 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-69fc7d93-8625-46f2-ac32-e30a83cd021b tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Converting VIF {"id": "2a5dfb7a-fd65-41fc-9997-8c2d25ea44a7", "address": "fa:16:3e:1f:d7:f3", "network": {"id": "6a700b61-4aa6-440b-87e6-a3525a5cb918", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-448680331-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8babb73006da4977a1fe2bdb35e08d8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a5dfb7a-fd", "ovs_interfaceid": "2a5dfb7a-fd65-41fc-9997-8c2d25ea44a7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 10:11:45 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-69fc7d93-8625-46f2-ac32-e30a83cd021b tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1f:d7:f3,bridge_name='br-int',has_traffic_filtering=True,id=2a5dfb7a-fd65-41fc-9997-8c2d25ea44a7,network=Network(6a700b61-4aa6-440b-87e6-a3525a5cb918),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a5dfb7a-fd') {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 10:11:45 user nova-compute[75229]: DEBUG os_vif [None req-69fc7d93-8625-46f2-ac32-e30a83cd021b tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1f:d7:f3,bridge_name='br-int',has_traffic_filtering=True,id=2a5dfb7a-fd65-41fc-9997-8c2d25ea44a7,network=Network(6a700b61-4aa6-440b-87e6-a3525a5cb918),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a5dfb7a-fd') {{(pid=75229) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 10:11:45 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:11:45 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2a5dfb7a-fd, bridge=br-int, if_exists=True) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 10:11:45 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:11:45 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 10:11:45 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:11:45 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:11:45 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=015e6458-9d63-4ae9-9d1e-22f634a75be5) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 10:11:45 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:11:45 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 10:11:45 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:11:45 user nova-compute[75229]: INFO os_vif [None req-69fc7d93-8625-46f2-ac32-e30a83cd021b tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1f:d7:f3,bridge_name='br-int',has_traffic_filtering=True,id=2a5dfb7a-fd65-41fc-9997-8c2d25ea44a7,network=Network(6a700b61-4aa6-440b-87e6-a3525a5cb918),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a5dfb7a-fd')
Nov 14 10:11:45 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-69fc7d93-8625-46f2-ac32-e30a83cd021b tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] [instance: c1679275-ebb1-4f15-80a4-b8fd614fc34b] Deleting instance files /opt/stack/data/nova/instances/c1679275-ebb1-4f15-80a4-b8fd614fc34b_del
Nov 14 10:11:45 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-69fc7d93-8625-46f2-ac32-e30a83cd021b tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] [instance: c1679275-ebb1-4f15-80a4-b8fd614fc34b] Deletion of /opt/stack/data/nova/instances/c1679275-ebb1-4f15-80a4-b8fd614fc34b_del complete
Nov 14 10:11:45 user nova-compute[75229]: INFO nova.compute.manager [None req-69fc7d93-8625-46f2-ac32-e30a83cd021b tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] [instance: c1679275-ebb1-4f15-80a4-b8fd614fc34b] Took 0.69 seconds to destroy the instance on the hypervisor.
Nov 14 10:11:45 user nova-compute[75229]: DEBUG oslo.service.loopingcall [None req-69fc7d93-8625-46f2-ac32-e30a83cd021b tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75229) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 10:11:45 user nova-compute[75229]: DEBUG nova.compute.manager [-] [instance: c1679275-ebb1-4f15-80a4-b8fd614fc34b] Deallocating network for instance {{(pid=75229) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 10:11:45 user nova-compute[75229]: DEBUG nova.network.neutron [-] [instance: c1679275-ebb1-4f15-80a4-b8fd614fc34b] deallocate_for_instance() {{(pid=75229) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 10:11:45 user nova-compute[75229]: DEBUG nova.network.neutron [-] [instance: c1679275-ebb1-4f15-80a4-b8fd614fc34b] Updating instance_info_cache with network_info: [] {{(pid=75229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 10:11:45 user nova-compute[75229]: INFO nova.compute.manager [-] [instance: c1679275-ebb1-4f15-80a4-b8fd614fc34b] Took 0.41 seconds to deallocate network for instance.
Nov 14 10:11:45 user nova-compute[75229]: DEBUG nova.compute.manager [req-8c27e33f-8778-4703-9021-327c8e811869 req-63482c36-2b86-4076-b124-357928828ccc service nova] [instance: c1679275-ebb1-4f15-80a4-b8fd614fc34b] Received event network-vif-deleted-2a5dfb7a-fd65-41fc-9997-8c2d25ea44a7 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 10:11:45 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-69fc7d93-8625-46f2-ac32-e30a83cd021b tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:11:45 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-69fc7d93-8625-46f2-ac32-e30a83cd021b tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:11:46 user nova-compute[75229]: DEBUG nova.compute.provider_tree [None req-69fc7d93-8625-46f2-ac32-e30a83cd021b tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Inventory has not changed in ProviderTree for provider: d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 {{(pid=75229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 10:11:46 user nova-compute[75229]: DEBUG nova.scheduler.client.report [None req-69fc7d93-8625-46f2-ac32-e30a83cd021b tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Inventory has not changed for provider d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 10:11:46 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-69fc7d93-8625-46f2-ac32-e30a83cd021b tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.306s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:11:46 user nova-compute[75229]: INFO nova.scheduler.client.report [None req-69fc7d93-8625-46f2-ac32-e30a83cd021b tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Deleted allocations for instance c1679275-ebb1-4f15-80a4-b8fd614fc34b
Nov 14 10:11:46 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-69fc7d93-8625-46f2-ac32-e30a83cd021b tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Lock "c1679275-ebb1-4f15-80a4-b8fd614fc34b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.602s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:11:47 user nova-compute[75229]: DEBUG nova.compute.manager [req-87c17d4d-9a2f-4d2f-a951-343926b54f75 req-bb627479-1773-4fd4-8d1c-01801a4420e9 service nova] [instance: c1679275-ebb1-4f15-80a4-b8fd614fc34b] Received event network-vif-plugged-2a5dfb7a-fd65-41fc-9997-8c2d25ea44a7 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 10:11:47 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-87c17d4d-9a2f-4d2f-a951-343926b54f75 req-bb627479-1773-4fd4-8d1c-01801a4420e9 service nova] Acquiring lock "c1679275-ebb1-4f15-80a4-b8fd614fc34b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:11:47 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-87c17d4d-9a2f-4d2f-a951-343926b54f75 req-bb627479-1773-4fd4-8d1c-01801a4420e9 service nova] Lock "c1679275-ebb1-4f15-80a4-b8fd614fc34b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:11:47 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-87c17d4d-9a2f-4d2f-a951-343926b54f75 req-bb627479-1773-4fd4-8d1c-01801a4420e9 service nova] Lock "c1679275-ebb1-4f15-80a4-b8fd614fc34b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:11:47 user nova-compute[75229]: DEBUG nova.compute.manager [req-87c17d4d-9a2f-4d2f-a951-343926b54f75 req-bb627479-1773-4fd4-8d1c-01801a4420e9 service nova] [instance: c1679275-ebb1-4f15-80a4-b8fd614fc34b] No waiting events found dispatching network-vif-plugged-2a5dfb7a-fd65-41fc-9997-8c2d25ea44a7 {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 10:11:47 user nova-compute[75229]: WARNING nova.compute.manager [req-87c17d4d-9a2f-4d2f-a951-343926b54f75 req-bb627479-1773-4fd4-8d1c-01801a4420e9 service nova] [instance: c1679275-ebb1-4f15-80a4-b8fd614fc34b] Received unexpected event network-vif-plugged-2a5dfb7a-fd65-41fc-9997-8c2d25ea44a7 for instance with vm_state deleted and task_state None.
Nov 14 10:11:50 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:11:55 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 10:12:00 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 10:12:00 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:12:04 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:12:04 user nova-compute[75229]: DEBUG nova.compute.manager [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Starting heal instance info cache {{(pid=75229) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 10:12:04 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Acquiring lock "refresh_cache-68d9de39-cbd2-44b2-bda8-015c8482c240" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 10:12:04 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Acquired lock "refresh_cache-68d9de39-cbd2-44b2-bda8-015c8482c240" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 10:12:04 user nova-compute[75229]: DEBUG nova.network.neutron [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] [instance: 68d9de39-cbd2-44b2-bda8-015c8482c240] Forcefully refreshing network info cache for instance {{(pid=75229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 10:12:05 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 10:12:05 user nova-compute[75229]: DEBUG nova.network.neutron [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] [instance: 68d9de39-cbd2-44b2-bda8-015c8482c240] Updating instance_info_cache with network_info: [{"id": "e62b2a49-c9cc-4568-b887-1c7884830ac2", "address": "fa:16:3e:f6:c6:5e", "network": {"id": "13b12b7e-2548-4256-8fb8-fccc67b1e18b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-698342503-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.41", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be7eb95aea3e4897acbc9fe03aadb8e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape62b2a49-c9", "ovs_interfaceid": "e62b2a49-c9cc-4568-b887-1c7884830ac2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 10:12:05 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Releasing lock "refresh_cache-68d9de39-cbd2-44b2-bda8-015c8482c240" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 10:12:05 user nova-compute[75229]: DEBUG nova.compute.manager [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] [instance: 68d9de39-cbd2-44b2-bda8-015c8482c240] Updated the network info_cache for instance {{(pid=75229) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 10:12:10 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:12:11 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:12:11 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:12:11 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:12:11 user nova-compute[75229]: DEBUG nova.compute.manager [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75229) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 10:12:13 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:12:13 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:12:13 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:12:13 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:12:13 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:12:13 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Auditing locally available compute resources for user (node: user) {{(pid=75229) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 10:12:13 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cda8c5ad-e70c-4021-bace-d55831c4bc78/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:12:14 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cda8c5ad-e70c-4021-bace-d55831c4bc78/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:12:14 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cda8c5ad-e70c-4021-bace-d55831c4bc78/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:12:14 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cda8c5ad-e70c-4021-bace-d55831c4bc78/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:12:14 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75229) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 10:12:14 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75229) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 10:12:14 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75229) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 10:12:14 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68d9de39-cbd2-44b2-bda8-015c8482c240/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:12:14 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68d9de39-cbd2-44b2-bda8-015c8482c240/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:12:14 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68d9de39-cbd2-44b2-bda8-015c8482c240/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:12:14 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68d9de39-cbd2-44b2-bda8-015c8482c240/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:12:14 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75229) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 10:12:15 user nova-compute[75229]: WARNING nova.virt.libvirt.driver [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 10:12:15 user nova-compute[75229]: WARNING nova.virt.libvirt.driver [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 10:12:15 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Hypervisor/Node resource view: name=user free_ram=8733MB free_disk=25.050628662109375GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75229) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 10:12:15 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:12:15 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:12:15 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Instance cda8c5ad-e70c-4021-bace-d55831c4bc78 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 10:12:15 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Instance 30ae1f73-e0f3-4e26-987e-a684471a160d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 10:12:15 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Instance 68d9de39-cbd2-44b2-bda8-015c8482c240 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 10:12:15 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Instance 4a81b779-af09-4026-8387-07d44dad6ef7 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 10:12:15 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Instance a79894e7-5018-4b3a-bd3b-694f1833f99f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 10:12:15 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=75229) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 10:12:15 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=75229) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 10:12:15 user nova-compute[75229]: DEBUG nova.compute.provider_tree [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Inventory has not changed in ProviderTree for provider: d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 {{(pid=75229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 10:12:15 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:12:15 user nova-compute[75229]: DEBUG nova.scheduler.client.report [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Inventory has not changed for provider d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 10:12:15 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Compute_service record updated for user:user {{(pid=75229) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 10:12:15 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.302s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:12:16 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:12:18 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:12:20 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 10:12:25 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 10:12:29 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:12:30 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 10:12:35 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-b4393ab1-5f3f-4c33-8ba7-7ce22e54416f tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Acquiring lock "30ae1f73-e0f3-4e26-987e-a684471a160d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:12:35 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-b4393ab1-5f3f-4c33-8ba7-7ce22e54416f tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Lock "30ae1f73-e0f3-4e26-987e-a684471a160d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:12:35 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-b4393ab1-5f3f-4c33-8ba7-7ce22e54416f tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Acquiring lock "30ae1f73-e0f3-4e26-987e-a684471a160d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:12:35 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-b4393ab1-5f3f-4c33-8ba7-7ce22e54416f tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Lock "30ae1f73-e0f3-4e26-987e-a684471a160d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:12:35 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-b4393ab1-5f3f-4c33-8ba7-7ce22e54416f tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Lock "30ae1f73-e0f3-4e26-987e-a684471a160d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:12:35 user nova-compute[75229]: INFO nova.compute.manager [None req-b4393ab1-5f3f-4c33-8ba7-7ce22e54416f tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] [instance: 30ae1f73-e0f3-4e26-987e-a684471a160d] Terminating instance
Nov 14 10:12:35 user nova-compute[75229]: DEBUG nova.compute.manager [None req-b4393ab1-5f3f-4c33-8ba7-7ce22e54416f tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] [instance: 30ae1f73-e0f3-4e26-987e-a684471a160d] Start destroying the instance on the hypervisor. {{(pid=75229) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 10:12:35 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:12:35 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:12:35 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:12:35 user nova-compute[75229]: DEBUG nova.compute.manager [req-2f2aec5b-0cf2-4048-90f1-83e770405c9e req-d3f0ecb9-cc42-4bf9-b8da-8047fc4b1ace service nova] [instance: 30ae1f73-e0f3-4e26-987e-a684471a160d] Received event network-vif-unplugged-c087c657-8eee-4e8e-bef1-4281129597ae {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 10:12:35 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-2f2aec5b-0cf2-4048-90f1-83e770405c9e req-d3f0ecb9-cc42-4bf9-b8da-8047fc4b1ace service nova] Acquiring lock "30ae1f73-e0f3-4e26-987e-a684471a160d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:12:35 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-2f2aec5b-0cf2-4048-90f1-83e770405c9e req-d3f0ecb9-cc42-4bf9-b8da-8047fc4b1ace service nova] Lock "30ae1f73-e0f3-4e26-987e-a684471a160d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:12:35 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-2f2aec5b-0cf2-4048-90f1-83e770405c9e req-d3f0ecb9-cc42-4bf9-b8da-8047fc4b1ace service nova] Lock "30ae1f73-e0f3-4e26-987e-a684471a160d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:12:35 user nova-compute[75229]: DEBUG nova.compute.manager [req-2f2aec5b-0cf2-4048-90f1-83e770405c9e req-d3f0ecb9-cc42-4bf9-b8da-8047fc4b1ace service nova] [instance: 30ae1f73-e0f3-4e26-987e-a684471a160d] No waiting events found dispatching network-vif-unplugged-c087c657-8eee-4e8e-bef1-4281129597ae {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 10:12:35 user nova-compute[75229]: DEBUG nova.compute.manager [req-2f2aec5b-0cf2-4048-90f1-83e770405c9e req-d3f0ecb9-cc42-4bf9-b8da-8047fc4b1ace service nova] [instance: 30ae1f73-e0f3-4e26-987e-a684471a160d] Received event network-vif-unplugged-c087c657-8eee-4e8e-bef1-4281129597ae for instance with task_state deleting. {{(pid=75229) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 10:12:35 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:12:35 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:12:35 user nova-compute[75229]: INFO nova.virt.libvirt.driver [-] [instance: 30ae1f73-e0f3-4e26-987e-a684471a160d] Instance destroyed successfully.
Nov 14 10:12:35 user nova-compute[75229]: DEBUG nova.objects.instance [None req-b4393ab1-5f3f-4c33-8ba7-7ce22e54416f tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Lazy-loading 'resources' on Instance uuid 30ae1f73-e0f3-4e26-987e-a684471a160d {{(pid=75229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 10:12:35 user nova-compute[75229]: DEBUG nova.virt.libvirt.vif [None req-b4393ab1-5f3f-4c33-8ba7-7ce22e54416f tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T09:56:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1790249022',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1790249022',id=34,image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-14T09:58:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8babb73006da4977a1fe2bdb35e08d8f',ramdisk_id='',reservation_id='r-hu64t322',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-189750210',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T10:00:35Z,user_data=None,user_id='a8825cd49e9349f28576b704c4c4d717',uuid=30ae1f73-e0f3-4e26-987e-a684471a160d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c087c657-8eee-4e8e-bef1-4281129597ae", "address": "fa:16:3e:aa:d3:e3", "network": {"id": "6a700b61-4aa6-440b-87e6-a3525a5cb918", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-448680331-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8babb73006da4977a1fe2bdb35e08d8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc087c657-8e", "ovs_interfaceid": "c087c657-8eee-4e8e-bef1-4281129597ae", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 10:12:35 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-b4393ab1-5f3f-4c33-8ba7-7ce22e54416f tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Converting VIF {"id": "c087c657-8eee-4e8e-bef1-4281129597ae", "address": "fa:16:3e:aa:d3:e3", "network": {"id": "6a700b61-4aa6-440b-87e6-a3525a5cb918", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-448680331-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8babb73006da4977a1fe2bdb35e08d8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc087c657-8e", "ovs_interfaceid": "c087c657-8eee-4e8e-bef1-4281129597ae", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 10:12:35 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-b4393ab1-5f3f-4c33-8ba7-7ce22e54416f tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:aa:d3:e3,bridge_name='br-int',has_traffic_filtering=True,id=c087c657-8eee-4e8e-bef1-4281129597ae,network=Network(6a700b61-4aa6-440b-87e6-a3525a5cb918),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc087c657-8e') {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 10:12:35 user nova-compute[75229]: DEBUG os_vif [None req-b4393ab1-5f3f-4c33-8ba7-7ce22e54416f tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:aa:d3:e3,bridge_name='br-int',has_traffic_filtering=True,id=c087c657-8eee-4e8e-bef1-4281129597ae,network=Network(6a700b61-4aa6-440b-87e6-a3525a5cb918),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc087c657-8e') {{(pid=75229) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 10:12:35 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:12:35 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc087c657-8e, bridge=br-int, if_exists=True) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 10:12:35 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:12:35 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 10:12:35 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:12:35 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:12:35 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c9438e81-d498-44d5-84dc-8131e8bdc019) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 10:12:35 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:12:35 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 10:12:35 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:12:35 user nova-compute[75229]: INFO os_vif [None req-b4393ab1-5f3f-4c33-8ba7-7ce22e54416f tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:aa:d3:e3,bridge_name='br-int',has_traffic_filtering=True,id=c087c657-8eee-4e8e-bef1-4281129597ae,network=Network(6a700b61-4aa6-440b-87e6-a3525a5cb918),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc087c657-8e')
Nov 14 10:12:35 user nova-compute[75229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b4393ab1-5f3f-4c33-8ba7-7ce22e54416f tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] [instance: 30ae1f73-e0f3-4e26-987e-a684471a160d] calling os-brick to detach iSCSI Volume {{(pid=75229) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 10:12:35 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4393ab1-5f3f-4c33-8ba7-7ce22e54416f tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f73f85151b0>, {'target_iqn': 'iqn.2010-10.org.openstack:5aebc438-0289-44fe-ad84-4e696468f50e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TgiuaWRw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 10:12:35 user nova-compute[75229]: WARNING os_brick.initiator.connectors.base [None req-b4393ab1-5f3f-4c33-8ba7-7ce22e54416f tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 10:12:35 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-b4393ab1-5f3f-4c33-8ba7-7ce22e54416f tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 10:12:35 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-b4393ab1-5f3f-4c33-8ba7-7ce22e54416f tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 10:12:35 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:12:36 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:12:36 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[275c8c49-456e-4345-9ca3-1a2c6de41332]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:cf6ced86-b04f-4335-b976-fde67102c8e3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d86c34fa-0121-4ba8-ac40-655170558568\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c8892c7d-49e8-4f65-b88c-1e14fba8f50a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5aebc438-0289-44fe-ad84-4e696468f50e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:12:36 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4393ab1-5f3f-4c33-8ba7-7ce22e54416f tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 10:12:36 user nova-compute[75229]: No targets found.
Nov 14 10:12:36 user nova-compute[75229]: iSNS:
Nov 14 10:12:36 user nova-compute[75229]: No targets found.
Nov 14 10:12:36 user nova-compute[75229]: STATIC:
Nov 14 10:12:36 user nova-compute[75229]: Target: iqn.2010-10.org.openstack:cf6ced86-b04f-4335-b976-fde67102c8e3
Nov 14 10:12:36 user nova-compute[75229]:         Portal: 172.16.0.220:3260,-1
Nov 14 10:12:36 user nova-compute[75229]:                 Iface Name: default
Nov 14 10:12:36 user nova-compute[75229]: Target: iqn.2010-10.org.openstack:d86c34fa-0121-4ba8-ac40-655170558568
Nov 14 10:12:36 user nova-compute[75229]:         Portal: 172.16.0.220:3260,-1
Nov 14 10:12:36 user nova-compute[75229]:                 Iface Name: default
Nov 14 10:12:36 user nova-compute[75229]: Target: iqn.2010-10.org.openstack:c8892c7d-49e8-4f65-b88c-1e14fba8f50a
Nov 14 10:12:36 user nova-compute[75229]:         Portal: 172.16.0.220:3260,-1
Nov 14 10:12:36 user nova-compute[75229]:                 Iface Name: default
Nov 14 10:12:36 user nova-compute[75229]: Target: iqn.2010-10.org.openstack:5aebc438-0289-44fe-ad84-4e696468f50e
Nov 14 10:12:36 user nova-compute[75229]:         Portal: 172.16.0.220:3260,-1
Nov 14 10:12:36 user nova-compute[75229]:                 Iface Name: default
Nov 14 10:12:36 user nova-compute[75229]: FIRMWARE:
Nov 14 10:12:36 user nova-compute[75229]: No targets found.
Nov 14 10:12:36 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 10:12:36 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4393ab1-5f3f-4c33-8ba7-7ce22e54416f tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 10:12:36 user nova-compute[75229]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 10:12:36 user nova-compute[75229]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75229) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 10:12:36 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4393ab1-5f3f-4c33-8ba7-7ce22e54416f tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5aebc438-0289-44fe-ad84-4e696468f50e', 0)] {{(pid=75229) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 10:12:36 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:12:36 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:12:36 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[5edd02df-086e-4ece-b2ac-d55bdf6ce709]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5aebc438-0289-44fe-ad84-4e696468f50e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c8892c7d-49e8-4f65-b88c-1e14fba8f50a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cf6ced86-b04f-4335-b976-fde67102c8e3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d86c34fa-0121-4ba8-ac40-655170558568\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:12:36 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:12:36 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:12:36 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[a18c1b31-50f9-4e2d-b0f2-d354f57131f3]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aebc438-0289-44fe-ad84-4e696468f50e (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8892c7d-49e8-4f65-b88c-1e14fba8f50a (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf6ced86-b04f-4335-b976-fde67102c8e3 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d86c34fa-0121-4ba8-ac40-655170558568 (non-flash)\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:12:36 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4393ab1-5f3f-4c33-8ba7-7ce22e54416f tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aebc438-0289-44fe-ad84-4e696468f50e (non-flash)
Nov 14 10:12:36 user nova-compute[75229]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8892c7d-49e8-4f65-b88c-1e14fba8f50a (non-flash)
Nov 14 10:12:36 user nova-compute[75229]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf6ced86-b04f-4335-b976-fde67102c8e3 (non-flash)
Nov 14 10:12:36 user nova-compute[75229]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d86c34fa-0121-4ba8-ac40-655170558568 (non-flash)
Nov 14 10:12:36 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 10:12:36 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4393ab1-5f3f-4c33-8ba7-7ce22e54416f tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aebc438-0289-44fe-ad84-4e696468f50e (non-flash)
Nov 14 10:12:36 user nova-compute[75229]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8892c7d-49e8-4f65-b88c-1e14fba8f50a (non-flash)
Nov 14 10:12:36 user nova-compute[75229]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf6ced86-b04f-4335-b976-fde67102c8e3 (non-flash)
Nov 14 10:12:36 user nova-compute[75229]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d86c34fa-0121-4ba8-ac40-655170558568 (non-flash)
Nov 14 10:12:36 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 10:12:36 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4393ab1-5f3f-4c33-8ba7-7ce22e54416f tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f73d4b3b400>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5aebc438-0289-44fe-ad84-4e696468f50e'): ({'sdc'}, set())}) {{(pid=75229) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 10:12:36 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-b4393ab1-5f3f-4c33-8ba7-7ce22e54416f tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Removing single pathed devices sdc {{(pid=75229) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 10:12:36 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:12:36 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:12:36 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf6486b8-cc8c-4119-ae8a-d54ba9fc423f]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:12:36 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:12:36 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:12:36 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[46099beb-103b-4cd6-a685-b063602c5808]: (4, ('ok\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:12:36 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-b4393ab1-5f3f-4c33-8ba7-7ce22e54416f tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Flushing IO for device /dev/sdc {{(pid=75229) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 10:12:36 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:12:36 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:12:36 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[374fbd8c-5920-4bda-bce4-25f0b9046e13]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:12:36 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-b4393ab1-5f3f-4c33-8ba7-7ce22e54416f tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75229) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 10:12:36 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:12:36 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.046s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:12:36 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[de3925f2-f0d9-43d4-a67e-886f11f5c6b3]: (4, ('1', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:12:36 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-b4393ab1-5f3f-4c33-8ba7-7ce22e54416f tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75229) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 10:12:36 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-b4393ab1-5f3f-4c33-8ba7-7ce22e54416f tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] SCSI volumes sdc have been removed. {{(pid=75229) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 10:12:36 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4393ab1-5f3f-4c33-8ba7-7ce22e54416f tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5aebc438-0289-44fe-ad84-4e696468f50e')] {{(pid=75229) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 10:12:36 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5aebc438-0289-44fe-ad84-4e696468f50e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:12:36 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5aebc438-0289-44fe-ad84-4e696468f50e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:12:36 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[10a05a93-da4d-4b12-8b20-7510a09686ce]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:12:36 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4393ab1-5f3f-4c33-8ba7-7ce22e54416f tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 10:12:36 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5aebc438-0289-44fe-ad84-4e696468f50e -p 172.16.0.220:3260 --logout {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:12:36 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5aebc438-0289-44fe-ad84-4e696468f50e -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:12:36 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8fb31ae-5970-4de1-a4d1-6a8f81bfc156]: (4, ('Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:5aebc438-0289-44fe-ad84-4e696468f50e, portal: 172.16.0.220,3260]\nLogout of [sid: 34, target: iqn.2010-10.org.openstack:5aebc438-0289-44fe-ad84-4e696468f50e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:12:36 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4393ab1-5f3f-4c33-8ba7-7ce22e54416f tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:5aebc438-0289-44fe-ad84-4e696468f50e, portal: 172.16.0.220,3260]
Nov 14 10:12:36 user nova-compute[75229]: Logout of [sid: 34, target: iqn.2010-10.org.openstack:5aebc438-0289-44fe-ad84-4e696468f50e, portal: 172.16.0.220,3260] successful.
Nov 14 10:12:36 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 10:12:36 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5aebc438-0289-44fe-ad84-4e696468f50e -p 172.16.0.220:3260 --op delete {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:12:36 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5aebc438-0289-44fe-ad84-4e696468f50e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:12:36 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[6940b791-f5d8-42ea-8227-c3ea26c2d21c]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:12:36 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4393ab1-5f3f-4c33-8ba7-7ce22e54416f tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 10:12:36 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-b4393ab1-5f3f-4c33-8ba7-7ce22e54416f tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.323s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 10:12:36 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4393ab1-5f3f-4c33-8ba7-7ce22e54416f tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] <== disconnect_volume: return (324ms) None {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 10:12:36 user nova-compute[75229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b4393ab1-5f3f-4c33-8ba7-7ce22e54416f tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] [instance: 30ae1f73-e0f3-4e26-987e-a684471a160d] Disconnected iSCSI Volume {{(pid=75229) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 10:12:36 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-b4393ab1-5f3f-4c33-8ba7-7ce22e54416f tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] [instance: 30ae1f73-e0f3-4e26-987e-a684471a160d] Deleting instance files /opt/stack/data/nova/instances/30ae1f73-e0f3-4e26-987e-a684471a160d_del
Nov 14 10:12:36 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-b4393ab1-5f3f-4c33-8ba7-7ce22e54416f tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] [instance: 30ae1f73-e0f3-4e26-987e-a684471a160d] Deletion of /opt/stack/data/nova/instances/30ae1f73-e0f3-4e26-987e-a684471a160d_del complete
Nov 14 10:12:36 user nova-compute[75229]: INFO nova.compute.manager [None req-b4393ab1-5f3f-4c33-8ba7-7ce22e54416f tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] [instance: 30ae1f73-e0f3-4e26-987e-a684471a160d] Took 1.19 seconds to destroy the instance on the hypervisor.
Nov 14 10:12:36 user nova-compute[75229]: DEBUG oslo.service.loopingcall [None req-b4393ab1-5f3f-4c33-8ba7-7ce22e54416f tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75229) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 10:12:36 user nova-compute[75229]: DEBUG nova.compute.manager [-] [instance: 30ae1f73-e0f3-4e26-987e-a684471a160d] Deallocating network for instance {{(pid=75229) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 10:12:36 user nova-compute[75229]: DEBUG nova.network.neutron [-] [instance: 30ae1f73-e0f3-4e26-987e-a684471a160d] deallocate_for_instance() {{(pid=75229) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 10:12:36 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:12:36 user nova-compute[75229]: DEBUG nova.network.neutron [-] [instance: 30ae1f73-e0f3-4e26-987e-a684471a160d] Updating instance_info_cache with network_info: [] {{(pid=75229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 10:12:36 user nova-compute[75229]: INFO nova.compute.manager [-] [instance: 30ae1f73-e0f3-4e26-987e-a684471a160d] Took 0.43 seconds to deallocate network for instance.
Nov 14 10:12:36 user nova-compute[75229]: DEBUG nova.compute.manager [req-35581812-9c9b-4082-ab1b-b00ec31bb6f4 req-81111dcc-cfdf-4a1d-aacb-05405f2a3de5 service nova] [instance: 30ae1f73-e0f3-4e26-987e-a684471a160d] Received event network-vif-deleted-c087c657-8eee-4e8e-bef1-4281129597ae {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 10:12:36 user nova-compute[75229]: INFO nova.compute.manager [req-35581812-9c9b-4082-ab1b-b00ec31bb6f4 req-81111dcc-cfdf-4a1d-aacb-05405f2a3de5 service nova] [instance: 30ae1f73-e0f3-4e26-987e-a684471a160d] Neutron deleted interface c087c657-8eee-4e8e-bef1-4281129597ae; detaching it from the instance and deleting it from the info cache
Nov 14 10:12:36 user nova-compute[75229]: DEBUG nova.network.neutron [req-35581812-9c9b-4082-ab1b-b00ec31bb6f4 req-81111dcc-cfdf-4a1d-aacb-05405f2a3de5 service nova] [instance: 30ae1f73-e0f3-4e26-987e-a684471a160d] Updating instance_info_cache with network_info: [] {{(pid=75229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 10:12:36 user nova-compute[75229]: DEBUG nova.compute.manager [req-35581812-9c9b-4082-ab1b-b00ec31bb6f4 req-81111dcc-cfdf-4a1d-aacb-05405f2a3de5 service nova] [instance: 30ae1f73-e0f3-4e26-987e-a684471a160d] Detach interface failed, port_id=c087c657-8eee-4e8e-bef1-4281129597ae, reason: Instance 30ae1f73-e0f3-4e26-987e-a684471a160d could not be found. {{(pid=75229) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 14 10:12:37 user nova-compute[75229]: DEBUG nova.objects.instance [None req-064d5287-3005-41b6-b09d-59e4d28e1c5b tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Lazy-loading 'flavor' on Instance uuid 68d9de39-cbd2-44b2-bda8-015c8482c240 {{(pid=75229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 10:12:37 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-064d5287-3005-41b6-b09d-59e4d28e1c5b tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Acquiring lock "refresh_cache-68d9de39-cbd2-44b2-bda8-015c8482c240" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 10:12:37 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-064d5287-3005-41b6-b09d-59e4d28e1c5b tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Acquired lock "refresh_cache-68d9de39-cbd2-44b2-bda8-015c8482c240" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 10:12:37 user nova-compute[75229]: DEBUG nova.network.neutron [None req-064d5287-3005-41b6-b09d-59e4d28e1c5b tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] [instance: 68d9de39-cbd2-44b2-bda8-015c8482c240] Building network info cache for instance {{(pid=75229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 10:12:37 user nova-compute[75229]: DEBUG nova.objects.instance [None req-064d5287-3005-41b6-b09d-59e4d28e1c5b tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Lazy-loading 'info_cache' on Instance uuid 68d9de39-cbd2-44b2-bda8-015c8482c240 {{(pid=75229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 10:12:37 user nova-compute[75229]: DEBUG nova.objects.base [None req-064d5287-3005-41b6-b09d-59e4d28e1c5b tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Object Instance<68d9de39-cbd2-44b2-bda8-015c8482c240> lazy-loaded attributes: flavor,info_cache {{(pid=75229) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 10:12:37 user nova-compute[75229]: DEBUG nova.compute.manager [req-2724ee11-ff0f-4e6a-80a1-028cdc16595a req-cbb49d31-8fd8-4d62-9ac1-3a7b43c85579 service nova] [instance: 30ae1f73-e0f3-4e26-987e-a684471a160d] Received event network-vif-plugged-c087c657-8eee-4e8e-bef1-4281129597ae {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 10:12:37 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-2724ee11-ff0f-4e6a-80a1-028cdc16595a req-cbb49d31-8fd8-4d62-9ac1-3a7b43c85579 service nova] Acquiring lock "30ae1f73-e0f3-4e26-987e-a684471a160d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:12:37 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-2724ee11-ff0f-4e6a-80a1-028cdc16595a req-cbb49d31-8fd8-4d62-9ac1-3a7b43c85579 service nova] Lock "30ae1f73-e0f3-4e26-987e-a684471a160d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:12:37 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-2724ee11-ff0f-4e6a-80a1-028cdc16595a req-cbb49d31-8fd8-4d62-9ac1-3a7b43c85579 service nova] Lock "30ae1f73-e0f3-4e26-987e-a684471a160d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:12:37 user nova-compute[75229]: DEBUG nova.compute.manager [req-2724ee11-ff0f-4e6a-80a1-028cdc16595a req-cbb49d31-8fd8-4d62-9ac1-3a7b43c85579 service nova] [instance: 30ae1f73-e0f3-4e26-987e-a684471a160d] No waiting events found dispatching network-vif-plugged-c087c657-8eee-4e8e-bef1-4281129597ae {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 10:12:37 user nova-compute[75229]: WARNING nova.compute.manager [req-2724ee11-ff0f-4e6a-80a1-028cdc16595a req-cbb49d31-8fd8-4d62-9ac1-3a7b43c85579 service nova] [instance: 30ae1f73-e0f3-4e26-987e-a684471a160d] Received unexpected event network-vif-plugged-c087c657-8eee-4e8e-bef1-4281129597ae for instance with vm_state active and task_state deleting.
Nov 14 10:12:37 user nova-compute[75229]: INFO nova.compute.manager [None req-b4393ab1-5f3f-4c33-8ba7-7ce22e54416f tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] [instance: 30ae1f73-e0f3-4e26-987e-a684471a160d] Took 0.81 seconds to detach 1 volumes for instance.
Nov 14 10:12:37 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-b4393ab1-5f3f-4c33-8ba7-7ce22e54416f tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:12:37 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-b4393ab1-5f3f-4c33-8ba7-7ce22e54416f tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:12:37 user nova-compute[75229]: DEBUG nova.network.neutron [None req-064d5287-3005-41b6-b09d-59e4d28e1c5b tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] [instance: 68d9de39-cbd2-44b2-bda8-015c8482c240] Updating instance_info_cache with network_info: [{"id": "e62b2a49-c9cc-4568-b887-1c7884830ac2", "address": "fa:16:3e:f6:c6:5e", "network": {"id": "13b12b7e-2548-4256-8fb8-fccc67b1e18b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-698342503-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.41", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be7eb95aea3e4897acbc9fe03aadb8e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape62b2a49-c9", "ovs_interfaceid": "e62b2a49-c9cc-4568-b887-1c7884830ac2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 10:12:37 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-064d5287-3005-41b6-b09d-59e4d28e1c5b tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Releasing lock "refresh_cache-68d9de39-cbd2-44b2-bda8-015c8482c240" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 10:12:37 user nova-compute[75229]: INFO nova.virt.libvirt.driver [-] [instance: 68d9de39-cbd2-44b2-bda8-015c8482c240] Instance destroyed successfully.
Nov 14 10:12:37 user nova-compute[75229]: DEBUG nova.objects.instance [None req-064d5287-3005-41b6-b09d-59e4d28e1c5b tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Lazy-loading 'resources' on Instance uuid 68d9de39-cbd2-44b2-bda8-015c8482c240 {{(pid=75229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 10:12:37 user nova-compute[75229]: DEBUG nova.objects.base [None req-064d5287-3005-41b6-b09d-59e4d28e1c5b tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Object Instance<68d9de39-cbd2-44b2-bda8-015c8482c240> lazy-loaded attributes: flavor,info_cache,resources {{(pid=75229) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 10:12:37 user nova-compute[75229]: DEBUG nova.virt.libvirt.vif [None req-064d5287-3005-41b6-b09d-59e4d28e1c5b tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T10:08:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-83963923',display_name='tempest-AttachVolumeTestJSON-server-83963923',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-83963923',id=48,image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJXzPsBd7qGYyaZb6FflRdQkGeKTe15VJYOOicBN62pWfFwNeM5MDUu06fTurq1Q3swlWbSacoNNYmELLNWG6cLojtLhJVSsbh2TFSo9QcykLrjuhusRznBqFctWAQ+d2w==',key_name='tempest-keypair-580650650',keypairs=<?>,launch_index=0,launched_at=2023-11-14T10:08:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='be7eb95aea3e4897acbc9fe03aadb8e7',ramdisk_id='',reservation_id='r-mo2dg0yb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-775906619',owner_user_name='tempest-AttachVolumeTestJSON-775906619-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T10:10:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='707c03b04f664aab82260a037074de21',uuid=68d9de39-cbd2-44b2-bda8-015c8482c240,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "e62b2a49-c9cc-4568-b887-1c7884830ac2", "address": "fa:16:3e:f6:c6:5e", "network": {"id": "13b12b7e-2548-4256-8fb8-fccc67b1e18b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-698342503-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.41", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be7eb95aea3e4897acbc9fe03aadb8e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape62b2a49-c9", "ovs_interfaceid": "e62b2a49-c9cc-4568-b887-1c7884830ac2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 10:12:37 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-064d5287-3005-41b6-b09d-59e4d28e1c5b tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Converting VIF {"id": "e62b2a49-c9cc-4568-b887-1c7884830ac2", "address": "fa:16:3e:f6:c6:5e", "network": {"id": "13b12b7e-2548-4256-8fb8-fccc67b1e18b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-698342503-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.41", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be7eb95aea3e4897acbc9fe03aadb8e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape62b2a49-c9", "ovs_interfaceid": "e62b2a49-c9cc-4568-b887-1c7884830ac2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 10:12:37 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-064d5287-3005-41b6-b09d-59e4d28e1c5b tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f6:c6:5e,bridge_name='br-int',has_traffic_filtering=True,id=e62b2a49-c9cc-4568-b887-1c7884830ac2,network=Network(13b12b7e-2548-4256-8fb8-fccc67b1e18b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape62b2a49-c9') {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 10:12:37 user nova-compute[75229]: DEBUG os_vif [None req-064d5287-3005-41b6-b09d-59e4d28e1c5b tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f6:c6:5e,bridge_name='br-int',has_traffic_filtering=True,id=e62b2a49-c9cc-4568-b887-1c7884830ac2,network=Network(13b12b7e-2548-4256-8fb8-fccc67b1e18b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape62b2a49-c9') {{(pid=75229) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 10:12:37 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:12:37 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape62b2a49-c9, bridge=br-int, if_exists=True) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 10:12:37 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:12:37 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 10:12:37 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:12:37 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6d214618-49b3-4478-befc-b3511a18bf2a) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 10:12:37 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:12:37 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 10:12:37 user nova-compute[75229]: DEBUG nova.compute.provider_tree [None req-b4393ab1-5f3f-4c33-8ba7-7ce22e54416f tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Inventory has not changed in ProviderTree for provider: d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 {{(pid=75229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 10:12:37 user nova-compute[75229]: INFO os_vif [None req-064d5287-3005-41b6-b09d-59e4d28e1c5b tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f6:c6:5e,bridge_name='br-int',has_traffic_filtering=True,id=e62b2a49-c9cc-4568-b887-1c7884830ac2,network=Network(13b12b7e-2548-4256-8fb8-fccc67b1e18b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape62b2a49-c9')
Nov 14 10:12:37 user nova-compute[75229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-064d5287-3005-41b6-b09d-59e4d28e1c5b tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] [instance: 68d9de39-cbd2-44b2-bda8-015c8482c240] calling os-brick to detach iSCSI Volume {{(pid=75229) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 10:12:37 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-064d5287-3005-41b6-b09d-59e4d28e1c5b tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f73f85151b0>, {'target_iqn': 'iqn.2010-10.org.openstack:cf6ced86-b04f-4335-b976-fde67102c8e3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ELsaSRyt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 10:12:37 user nova-compute[75229]: WARNING os_brick.initiator.connectors.base [None req-064d5287-3005-41b6-b09d-59e4d28e1c5b tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 10:12:37 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-064d5287-3005-41b6-b09d-59e4d28e1c5b tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 10:12:37 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-064d5287-3005-41b6-b09d-59e4d28e1c5b tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 10:12:37 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:12:37 user nova-compute[75229]: DEBUG nova.scheduler.client.report [None req-b4393ab1-5f3f-4c33-8ba7-7ce22e54416f tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Inventory has not changed for provider d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 10:12:37 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:12:37 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8de190c-acb9-4a4d-b54d-b8ac35e24869]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:cf6ced86-b04f-4335-b976-fde67102c8e3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d86c34fa-0121-4ba8-ac40-655170558568\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c8892c7d-49e8-4f65-b88c-1e14fba8f50a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:12:37 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-064d5287-3005-41b6-b09d-59e4d28e1c5b tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 10:12:37 user nova-compute[75229]: No targets found.
Nov 14 10:12:37 user nova-compute[75229]: iSNS:
Nov 14 10:12:37 user nova-compute[75229]: No targets found.
Nov 14 10:12:37 user nova-compute[75229]: STATIC:
Nov 14 10:12:37 user nova-compute[75229]: Target: iqn.2010-10.org.openstack:cf6ced86-b04f-4335-b976-fde67102c8e3
Nov 14 10:12:37 user nova-compute[75229]:         Portal: 172.16.0.220:3260,-1
Nov 14 10:12:37 user nova-compute[75229]:                 Iface Name: default
Nov 14 10:12:37 user nova-compute[75229]: Target: iqn.2010-10.org.openstack:d86c34fa-0121-4ba8-ac40-655170558568
Nov 14 10:12:37 user nova-compute[75229]:         Portal: 172.16.0.220:3260,-1
Nov 14 10:12:37 user nova-compute[75229]:                 Iface Name: default
Nov 14 10:12:37 user nova-compute[75229]: Target: iqn.2010-10.org.openstack:c8892c7d-49e8-4f65-b88c-1e14fba8f50a
Nov 14 10:12:37 user nova-compute[75229]:         Portal: 172.16.0.220:3260,-1
Nov 14 10:12:37 user nova-compute[75229]:                 Iface Name: default
Nov 14 10:12:37 user nova-compute[75229]: FIRMWARE:
Nov 14 10:12:37 user nova-compute[75229]: No targets found.
Nov 14 10:12:37 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 10:12:37 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-064d5287-3005-41b6-b09d-59e4d28e1c5b tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 10:12:37 user nova-compute[75229]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 10:12:37 user nova-compute[75229]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75229) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 10:12:37 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-064d5287-3005-41b6-b09d-59e4d28e1c5b tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cf6ced86-b04f-4335-b976-fde67102c8e3', 0)] {{(pid=75229) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 10:12:37 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:12:37 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-b4393ab1-5f3f-4c33-8ba7-7ce22e54416f tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.236s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:12:37 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:12:37 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[11a0e3fe-083d-4f95-901c-ce9b4f5c2acd]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c8892c7d-49e8-4f65-b88c-1e14fba8f50a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cf6ced86-b04f-4335-b976-fde67102c8e3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d86c34fa-0121-4ba8-ac40-655170558568\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:12:37 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:12:37 user nova-compute[75229]: INFO nova.scheduler.client.report [None req-b4393ab1-5f3f-4c33-8ba7-7ce22e54416f tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Deleted allocations for instance 30ae1f73-e0f3-4e26-987e-a684471a160d
Nov 14 10:12:37 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:12:37 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[6338d93e-580f-465f-890f-77898f348ab7]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8892c7d-49e8-4f65-b88c-1e14fba8f50a (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf6ced86-b04f-4335-b976-fde67102c8e3 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d86c34fa-0121-4ba8-ac40-655170558568 (non-flash)\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:12:37 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-064d5287-3005-41b6-b09d-59e4d28e1c5b tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8892c7d-49e8-4f65-b88c-1e14fba8f50a (non-flash)
Nov 14 10:12:37 user nova-compute[75229]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf6ced86-b04f-4335-b976-fde67102c8e3 (non-flash)
Nov 14 10:12:37 user nova-compute[75229]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d86c34fa-0121-4ba8-ac40-655170558568 (non-flash)
Nov 14 10:12:37 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 10:12:37 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-064d5287-3005-41b6-b09d-59e4d28e1c5b tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8892c7d-49e8-4f65-b88c-1e14fba8f50a (non-flash)
Nov 14 10:12:37 user nova-compute[75229]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf6ced86-b04f-4335-b976-fde67102c8e3 (non-flash)
Nov 14 10:12:37 user nova-compute[75229]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d86c34fa-0121-4ba8-ac40-655170558568 (non-flash)
Nov 14 10:12:37 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 10:12:37 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-064d5287-3005-41b6-b09d-59e4d28e1c5b tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f73f8527d90>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cf6ced86-b04f-4335-b976-fde67102c8e3'): ({'sdb'}, set())}) {{(pid=75229) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 10:12:37 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-064d5287-3005-41b6-b09d-59e4d28e1c5b tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Removing single pathed devices sdb {{(pid=75229) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 10:12:37 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:12:37 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:12:37 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[80a7cbf3-2030-4991-92db-545b44305db3]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:12:37 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:12:37 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:12:37 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ed60361-1d93-40fd-b1d8-b61410c37193]: (4, ('ok\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:12:38 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-064d5287-3005-41b6-b09d-59e4d28e1c5b tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Flushing IO for device /dev/sdb {{(pid=75229) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 10:12:38 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:12:38 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:12:38 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[51b06f29-7ef7-435a-9885-fd1613d8a638]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:12:38 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-064d5287-3005-41b6-b09d-59e4d28e1c5b tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75229) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 10:12:38 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:12:38 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-b4393ab1-5f3f-4c33-8ba7-7ce22e54416f tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Lock "30ae1f73-e0f3-4e26-987e-a684471a160d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.860s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:12:38 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.044s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:12:38 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dea8ce3-3ced-424d-8822-495a7c893646]: (4, ('1', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:12:38 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-064d5287-3005-41b6-b09d-59e4d28e1c5b tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75229) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 10:12:38 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-064d5287-3005-41b6-b09d-59e4d28e1c5b tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] SCSI volumes sdb have been removed. {{(pid=75229) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 10:12:38 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-064d5287-3005-41b6-b09d-59e4d28e1c5b tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cf6ced86-b04f-4335-b976-fde67102c8e3')] {{(pid=75229) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 10:12:38 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf6ced86-b04f-4335-b976-fde67102c8e3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:12:38 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf6ced86-b04f-4335-b976-fde67102c8e3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:12:38 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6a63532-0647-4577-91a8-2c408fe2f54b]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:12:38 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-064d5287-3005-41b6-b09d-59e4d28e1c5b tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 10:12:38 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf6ced86-b04f-4335-b976-fde67102c8e3 -p 172.16.0.220:3260 --logout {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:12:38 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf6ced86-b04f-4335-b976-fde67102c8e3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:12:38 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[e75917d8-6ee9-45f8-a51f-63171fcb1520]: (4, ('Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:cf6ced86-b04f-4335-b976-fde67102c8e3, portal: 172.16.0.220,3260]\nLogout of [sid: 53, target: iqn.2010-10.org.openstack:cf6ced86-b04f-4335-b976-fde67102c8e3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:12:38 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-064d5287-3005-41b6-b09d-59e4d28e1c5b tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:cf6ced86-b04f-4335-b976-fde67102c8e3, portal: 172.16.0.220,3260]
Nov 14 10:12:38 user nova-compute[75229]: Logout of [sid: 53, target: iqn.2010-10.org.openstack:cf6ced86-b04f-4335-b976-fde67102c8e3, portal: 172.16.0.220,3260] successful.
Nov 14 10:12:38 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 10:12:38 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf6ced86-b04f-4335-b976-fde67102c8e3 -p 172.16.0.220:3260 --op delete {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:12:38 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf6ced86-b04f-4335-b976-fde67102c8e3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:12:38 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a330d26-2593-43df-8ff7-71d295cef28a]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:12:38 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-064d5287-3005-41b6-b09d-59e4d28e1c5b tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 10:12:38 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-064d5287-3005-41b6-b09d-59e4d28e1c5b tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.319s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 10:12:38 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-064d5287-3005-41b6-b09d-59e4d28e1c5b tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] <== disconnect_volume: return (321ms) None {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 10:12:38 user nova-compute[75229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-064d5287-3005-41b6-b09d-59e4d28e1c5b tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] [instance: 68d9de39-cbd2-44b2-bda8-015c8482c240] Disconnected iSCSI Volume {{(pid=75229) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 10:12:38 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-064d5287-3005-41b6-b09d-59e4d28e1c5b tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] [instance: 68d9de39-cbd2-44b2-bda8-015c8482c240] Start _get_guest_xml network_info=[{"id": "e62b2a49-c9cc-4568-b887-1c7884830ac2", "address": "fa:16:3e:f6:c6:5e", "network": {"id": "13b12b7e-2548-4256-8fb8-fccc67b1e18b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-698342503-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.41", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be7eb95aea3e4897acbc9fe03aadb8e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape62b2a49-c9", "ovs_interfaceid": "e62b2a49-c9cc-4568-b887-1c7884830ac2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=3bef8470-ecc7-40e3-95d4-9254348ea72d,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'disk_bus': 'virtio', 'guest_format': None, 'encryption_secret_uuid': None, 'size': 0, 'device_type': 'disk', 'image_id': '3bef8470-ecc7-40e3-95d4-9254348ea72d'}], 'ephemerals': [], 'block_device_mapping': [{'boot_index': None, 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:cf6ced86-b04f-4335-b976-fde67102c8e3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ELsaSRyt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '68d9de39-cbd2-44b2-bda8-015c8482c240', 'attached_at': '', 'detached_at': '', 'volume_id': 'cf6ced86-b04f-4335-b976-fde67102c8e3', 'serial': 'cf6ced86-b04f-4335-b976-fde67102c8e3'}, 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'attachment_id': '5f0b12c2-24ca-42c8-a3ff-59eb24c97886', 'guest_format': None, 'device_type': 'disk', 'volume_type': None} {{(pid=75229) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 10:12:38 user nova-compute[75229]: DEBUG nova.objects.instance [None req-064d5287-3005-41b6-b09d-59e4d28e1c5b tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Lazy-loading 'numa_topology' on Instance uuid 68d9de39-cbd2-44b2-bda8-015c8482c240 {{(pid=75229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 10:12:38 user nova-compute[75229]: DEBUG nova.objects.base [None req-064d5287-3005-41b6-b09d-59e4d28e1c5b tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Object Instance<68d9de39-cbd2-44b2-bda8-015c8482c240> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=75229) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 10:12:38 user nova-compute[75229]: WARNING nova.virt.libvirt.driver [None req-064d5287-3005-41b6-b09d-59e4d28e1c5b tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 10:12:38 user nova-compute[75229]: WARNING nova.virt.libvirt.driver [None req-064d5287-3005-41b6-b09d-59e4d28e1c5b tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 10:12:38 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-064d5287-3005-41b6-b09d-59e4d28e1c5b tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75229) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 10:12:38 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-064d5287-3005-41b6-b09d-59e4d28e1c5b tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] CPU controller missing on host. {{(pid=75229) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 10:12:38 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-064d5287-3005-41b6-b09d-59e4d28e1c5b tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75229) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 10:12:38 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-064d5287-3005-41b6-b09d-59e4d28e1c5b tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] CPU controller found on host. {{(pid=75229) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 10:12:38 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-064d5287-3005-41b6-b09d-59e4d28e1c5b tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75229) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 10:12:38 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-064d5287-3005-41b6-b09d-59e4d28e1c5b tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T09:39:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=3bef8470-ecc7-40e3-95d4-9254348ea72d,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 10:12:38 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-064d5287-3005-41b6-b09d-59e4d28e1c5b tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Flavor limits 0:0:0 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 10:12:38 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-064d5287-3005-41b6-b09d-59e4d28e1c5b tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Image limits 0:0:0 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 10:12:38 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-064d5287-3005-41b6-b09d-59e4d28e1c5b tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Flavor pref 0:0:0 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 10:12:38 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-064d5287-3005-41b6-b09d-59e4d28e1c5b tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Image pref 0:0:0 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 10:12:38 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-064d5287-3005-41b6-b09d-59e4d28e1c5b tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 10:12:38 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-064d5287-3005-41b6-b09d-59e4d28e1c5b tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 10:12:38 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-064d5287-3005-41b6-b09d-59e4d28e1c5b tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75229) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 10:12:38 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-064d5287-3005-41b6-b09d-59e4d28e1c5b tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Got 1 possible topologies {{(pid=75229) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 10:12:38 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-064d5287-3005-41b6-b09d-59e4d28e1c5b tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 10:12:38 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-064d5287-3005-41b6-b09d-59e4d28e1c5b tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 10:12:38 user nova-compute[75229]: DEBUG nova.objects.instance [None req-064d5287-3005-41b6-b09d-59e4d28e1c5b tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Lazy-loading 'vcpu_model' on Instance uuid 68d9de39-cbd2-44b2-bda8-015c8482c240 {{(pid=75229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 10:12:38 user nova-compute[75229]: DEBUG nova.objects.base [None req-064d5287-3005-41b6-b09d-59e4d28e1c5b tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Object Instance<68d9de39-cbd2-44b2-bda8-015c8482c240> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=75229) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 10:12:38 user nova-compute[75229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-064d5287-3005-41b6-b09d-59e4d28e1c5b tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] [instance: 68d9de39-cbd2-44b2-bda8-015c8482c240] Calling os-brick to attach iSCSI Volume {{(pid=75229) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 10:12:38 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-064d5287-3005-41b6-b09d-59e4d28e1c5b tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f73f85151b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:cf6ced86-b04f-4335-b976-fde67102c8e3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ELsaSRyt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 10:12:38 user nova-compute[75229]: WARNING os_brick.initiator.connectors.base [None req-064d5287-3005-41b6-b09d-59e4d28e1c5b tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 10:12:38 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-064d5287-3005-41b6-b09d-59e4d28e1c5b tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 10:12:38 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-064d5287-3005-41b6-b09d-59e4d28e1c5b tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 10:12:38 user nova-compute[75229]: WARNING os_brick.initiator.connectors.base [None req-064d5287-3005-41b6-b09d-59e4d28e1c5b tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 10:12:38 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-064d5287-3005-41b6-b09d-59e4d28e1c5b tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cf6ced86-b04f-4335-b976-fde67102c8e3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 10:12:38 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-064d5287-3005-41b6-b09d-59e4d28e1c5b tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cf6ced86-b04f-4335-b976-fde67102c8e3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 10:12:38 user nova-compute[75229]: INFO os_brick.initiator.connectors.iscsi [None req-064d5287-3005-41b6-b09d-59e4d28e1c5b tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 10:12:38 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf6ced86-b04f-4335-b976-fde67102c8e3 -p 172.16.0.220:3260 {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:12:38 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf6ced86-b04f-4335-b976-fde67102c8e3 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:12:38 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[458b0f5c-490b-4291-8e08-8bbd48a6d5d9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:12:38 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-064d5287-3005-41b6-b09d-59e4d28e1c5b tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 10:12:38 user nova-compute[75229]:  {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 10:12:38 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf6ced86-b04f-4335-b976-fde67102c8e3 -p 172.16.0.220:3260 --interface default --op new {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:12:38 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf6ced86-b04f-4335-b976-fde67102c8e3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:12:38 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8cf4581-93fd-408a-94d4-0c04c14cf0b2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cf6ced86-b04f-4335-b976-fde67102c8e3] added\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:12:38 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-064d5287-3005-41b6-b09d-59e4d28e1c5b tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cf6ced86-b04f-4335-b976-fde67102c8e3] added
Nov 14 10:12:38 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 10:12:38 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf6ced86-b04f-4335-b976-fde67102c8e3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:12:38 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf6ced86-b04f-4335-b976-fde67102c8e3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:12:38 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cc90e53-1ec7-4ae8-8dfc-73e777f606f4]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:12:38 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-064d5287-3005-41b6-b09d-59e4d28e1c5b tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 10:12:38 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf6ced86-b04f-4335-b976-fde67102c8e3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:12:38 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf6ced86-b04f-4335-b976-fde67102c8e3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:12:38 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[935533f4-e257-4c44-8dde-2517c4d8b2df]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:12:38 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-064d5287-3005-41b6-b09d-59e4d28e1c5b tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 10:12:38 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf6ced86-b04f-4335-b976-fde67102c8e3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ELsaSRyt {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:12:38 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf6ced86-b04f-4335-b976-fde67102c8e3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ELsaSRyt" returned: 0 in 0.017s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:12:38 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba1010a0-d2f2-491a-97a1-8d757b2db7ab]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:12:38 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-064d5287-3005-41b6-b09d-59e4d28e1c5b tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ELsaSRyt'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 10:12:38 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf6ced86-b04f-4335-b976-fde67102c8e3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:12:38 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf6ced86-b04f-4335-b976-fde67102c8e3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:12:38 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f0bff31-d6ee-4573-a03d-5fa7062196e7]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:12:38 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-064d5287-3005-41b6-b09d-59e4d28e1c5b tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 10:12:38 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:12:38 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:12:38 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[f61757e6-87cf-4adc-8d6f-76df4f8728fd]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8892c7d-49e8-4f65-b88c-1e14fba8f50a (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d86c34fa-0121-4ba8-ac40-655170558568 (non-flash)\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:12:38 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-064d5287-3005-41b6-b09d-59e4d28e1c5b tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8892c7d-49e8-4f65-b88c-1e14fba8f50a (non-flash)
Nov 14 10:12:38 user nova-compute[75229]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d86c34fa-0121-4ba8-ac40-655170558568 (non-flash)
Nov 14 10:12:38 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 10:12:38 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-064d5287-3005-41b6-b09d-59e4d28e1c5b tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8892c7d-49e8-4f65-b88c-1e14fba8f50a (non-flash)
Nov 14 10:12:38 user nova-compute[75229]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d86c34fa-0121-4ba8-ac40-655170558568 (non-flash)
Nov 14 10:12:38 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 10:12:38 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf6ced86-b04f-4335-b976-fde67102c8e3 -p 172.16.0.220:3260 --login {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:12:38 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf6ced86-b04f-4335-b976-fde67102c8e3 -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:12:38 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[317aa91b-3c45-41c5-986a-3d51c78a7b4b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:cf6ced86-b04f-4335-b976-fde67102c8e3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:cf6ced86-b04f-4335-b976-fde67102c8e3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:12:38 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-064d5287-3005-41b6-b09d-59e4d28e1c5b tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:cf6ced86-b04f-4335-b976-fde67102c8e3, portal: 172.16.0.220,3260]
Nov 14 10:12:38 user nova-compute[75229]: Login to [iface: default, target: iqn.2010-10.org.openstack:cf6ced86-b04f-4335-b976-fde67102c8e3, portal: 172.16.0.220,3260] successful.
Nov 14 10:12:38 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 10:12:38 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf6ced86-b04f-4335-b976-fde67102c8e3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:12:38 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf6ced86-b04f-4335-b976-fde67102c8e3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:12:38 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3f0897e-7112-4877-81ce-5010ac53baee]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:12:38 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-064d5287-3005-41b6-b09d-59e4d28e1c5b tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 10:12:38 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:12:38 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:12:38 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[88c08e64-1c00-4c04-b69d-29013e02f3fc]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8892c7d-49e8-4f65-b88c-1e14fba8f50a (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d86c34fa-0121-4ba8-ac40-655170558568 (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf6ced86-b04f-4335-b976-fde67102c8e3 (non-flash)\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:12:38 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-064d5287-3005-41b6-b09d-59e4d28e1c5b tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8892c7d-49e8-4f65-b88c-1e14fba8f50a (non-flash)
Nov 14 10:12:38 user nova-compute[75229]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d86c34fa-0121-4ba8-ac40-655170558568 (non-flash)
Nov 14 10:12:38 user nova-compute[75229]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf6ced86-b04f-4335-b976-fde67102c8e3 (non-flash)
Nov 14 10:12:38 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 10:12:38 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-064d5287-3005-41b6-b09d-59e4d28e1c5b tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8892c7d-49e8-4f65-b88c-1e14fba8f50a (non-flash)
Nov 14 10:12:38 user nova-compute[75229]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d86c34fa-0121-4ba8-ac40-655170558568 (non-flash)
Nov 14 10:12:38 user nova-compute[75229]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf6ced86-b04f-4335-b976-fde67102c8e3 (non-flash)
Nov 14 10:12:38 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 10:12:38 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-064d5287-3005-41b6-b09d-59e4d28e1c5b tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cf6ced86-b04f-4335-b976-fde67102c8e3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.279s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 10:12:38 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-064d5287-3005-41b6-b09d-59e4d28e1c5b tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Connected to 172.16.0.220:3260 {{(pid=75229) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 10:12:38 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-064d5287-3005-41b6-b09d-59e4d28e1c5b tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] HCTL ('33', '-', '-', 0) found on session 55 with lun 0 {{(pid=75229) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 10:12:38 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-064d5287-3005-41b6-b09d-59e4d28e1c5b tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75229) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 10:12:38 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:12:38 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:12:38 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[6639699d-f183-4ac9-8503-d85110edb070]: (4, ('- - 0', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:12:38 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-064d5287-3005-41b6-b09d-59e4d28e1c5b tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Searching for a device in session 55 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75229) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 10:12:38 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-064d5287-3005-41b6-b09d-59e4d28e1c5b tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:cf6ced86-b04f-4335-b976-fde67102c8e3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ELsaSRyt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75229) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 10:12:39 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-064d5287-3005-41b6-b09d-59e4d28e1c5b tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.310s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 10:12:39 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-064d5287-3005-41b6-b09d-59e4d28e1c5b tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] <== connect_volume: return (1312ms) {'type': 'block', 'scsi_wwn': '23433323265353361', 'path': '/dev/sdb'} {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 10:12:39 user nova-compute[75229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-064d5287-3005-41b6-b09d-59e4d28e1c5b tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] [instance: 68d9de39-cbd2-44b2-bda8-015c8482c240] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23433323265353361', 'path': '/dev/sdb'} {{(pid=75229) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 10:12:39 user nova-compute[75229]: DEBUG nova.virt.libvirt.vif [None req-064d5287-3005-41b6-b09d-59e4d28e1c5b tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T10:08:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-83963923',display_name='tempest-AttachVolumeTestJSON-server-83963923',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-83963923',id=48,image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJXzPsBd7qGYyaZb6FflRdQkGeKTe15VJYOOicBN62pWfFwNeM5MDUu06fTurq1Q3swlWbSacoNNYmELLNWG6cLojtLhJVSsbh2TFSo9QcykLrjuhusRznBqFctWAQ+d2w==',key_name='tempest-keypair-580650650',keypairs=<?>,launch_index=0,launched_at=2023-11-14T10:08:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='be7eb95aea3e4897acbc9fe03aadb8e7',ramdisk_id='',reservation_id='r-mo2dg0yb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-775906619',owner_user_name='tempest-AttachVolumeTestJSON-775906619-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T10:10:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='707c03b04f664aab82260a037074de21',uuid=68d9de39-cbd2-44b2-bda8-015c8482c240,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "e62b2a49-c9cc-4568-b887-1c7884830ac2", "address": "fa:16:3e:f6:c6:5e", "network": {"id": "13b12b7e-2548-4256-8fb8-fccc67b1e18b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-698342503-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.41", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be7eb95aea3e4897acbc9fe03aadb8e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape62b2a49-c9", "ovs_interfaceid": "e62b2a49-c9cc-4568-b887-1c7884830ac2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75229) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 10:12:39 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-064d5287-3005-41b6-b09d-59e4d28e1c5b tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Converting VIF {"id": "e62b2a49-c9cc-4568-b887-1c7884830ac2", "address": "fa:16:3e:f6:c6:5e", "network": {"id": "13b12b7e-2548-4256-8fb8-fccc67b1e18b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-698342503-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.41", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be7eb95aea3e4897acbc9fe03aadb8e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape62b2a49-c9", "ovs_interfaceid": "e62b2a49-c9cc-4568-b887-1c7884830ac2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 10:12:39 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-064d5287-3005-41b6-b09d-59e4d28e1c5b tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f6:c6:5e,bridge_name='br-int',has_traffic_filtering=True,id=e62b2a49-c9cc-4568-b887-1c7884830ac2,network=Network(13b12b7e-2548-4256-8fb8-fccc67b1e18b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape62b2a49-c9') {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 10:12:39 user nova-compute[75229]: DEBUG nova.objects.instance [None req-064d5287-3005-41b6-b09d-59e4d28e1c5b tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Lazy-loading 'pci_devices' on Instance uuid 68d9de39-cbd2-44b2-bda8-015c8482c240 {{(pid=75229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 10:12:39 user nova-compute[75229]: DEBUG nova.objects.base [None req-064d5287-3005-41b6-b09d-59e4d28e1c5b tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Object Instance<68d9de39-cbd2-44b2-bda8-015c8482c240> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=75229) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 10:12:39 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-064d5287-3005-41b6-b09d-59e4d28e1c5b tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] [instance: 68d9de39-cbd2-44b2-bda8-015c8482c240] End _get_guest_xml xml=<domain type="kvm">
Nov 14 10:12:39 user nova-compute[75229]:   <uuid>68d9de39-cbd2-44b2-bda8-015c8482c240</uuid>
Nov 14 10:12:39 user nova-compute[75229]:   <name>instance-00000030</name>
Nov 14 10:12:39 user nova-compute[75229]:   <memory>524288</memory>
Nov 14 10:12:39 user nova-compute[75229]:   <vcpu>1</vcpu>
Nov 14 10:12:39 user nova-compute[75229]:   <metadata>
Nov 14 10:12:39 user nova-compute[75229]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 10:12:39 user nova-compute[75229]:       <nova:package version="0.0.0"/>
Nov 14 10:12:39 user nova-compute[75229]:       <nova:name>tempest-AttachVolumeTestJSON-server-83963923</nova:name>
Nov 14 10:12:39 user nova-compute[75229]:       <nova:creationTime>2023-11-14 10:12:38</nova:creationTime>
Nov 14 10:12:39 user nova-compute[75229]:       <nova:flavor name="m1.tiny">
Nov 14 10:12:39 user nova-compute[75229]:         <nova:memory>512</nova:memory>
Nov 14 10:12:39 user nova-compute[75229]:         <nova:disk>1</nova:disk>
Nov 14 10:12:39 user nova-compute[75229]:         <nova:swap>0</nova:swap>
Nov 14 10:12:39 user nova-compute[75229]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 10:12:39 user nova-compute[75229]:         <nova:vcpus>1</nova:vcpus>
Nov 14 10:12:39 user nova-compute[75229]:       </nova:flavor>
Nov 14 10:12:39 user nova-compute[75229]:       <nova:owner>
Nov 14 10:12:39 user nova-compute[75229]:         <nova:user uuid="707c03b04f664aab82260a037074de21">tempest-AttachVolumeTestJSON-775906619-project-member</nova:user>
Nov 14 10:12:39 user nova-compute[75229]:         <nova:project uuid="be7eb95aea3e4897acbc9fe03aadb8e7">tempest-AttachVolumeTestJSON-775906619</nova:project>
Nov 14 10:12:39 user nova-compute[75229]:       </nova:owner>
Nov 14 10:12:39 user nova-compute[75229]:       <nova:root type="image" uuid="3bef8470-ecc7-40e3-95d4-9254348ea72d"/>
Nov 14 10:12:39 user nova-compute[75229]:       <nova:ports>
Nov 14 10:12:39 user nova-compute[75229]:         <nova:port uuid="e62b2a49-c9cc-4568-b887-1c7884830ac2">
Nov 14 10:12:39 user nova-compute[75229]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 14 10:12:39 user nova-compute[75229]:         </nova:port>
Nov 14 10:12:39 user nova-compute[75229]:       </nova:ports>
Nov 14 10:12:39 user nova-compute[75229]:     </nova:instance>
Nov 14 10:12:39 user nova-compute[75229]:   </metadata>
Nov 14 10:12:39 user nova-compute[75229]:   <sysinfo type="smbios">
Nov 14 10:12:39 user nova-compute[75229]:     <system>
Nov 14 10:12:39 user nova-compute[75229]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 10:12:39 user nova-compute[75229]:       <entry name="product">OpenStack Nova</entry>
Nov 14 10:12:39 user nova-compute[75229]:       <entry name="version">0.0.0</entry>
Nov 14 10:12:39 user nova-compute[75229]:       <entry name="serial">68d9de39-cbd2-44b2-bda8-015c8482c240</entry>
Nov 14 10:12:39 user nova-compute[75229]:       <entry name="uuid">68d9de39-cbd2-44b2-bda8-015c8482c240</entry>
Nov 14 10:12:39 user nova-compute[75229]:       <entry name="family">Virtual Machine</entry>
Nov 14 10:12:39 user nova-compute[75229]:     </system>
Nov 14 10:12:39 user nova-compute[75229]:   </sysinfo>
Nov 14 10:12:39 user nova-compute[75229]:   <os>
Nov 14 10:12:39 user nova-compute[75229]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 10:12:39 user nova-compute[75229]:     <boot dev="hd"/>
Nov 14 10:12:39 user nova-compute[75229]:     <smbios mode="sysinfo"/>
Nov 14 10:12:39 user nova-compute[75229]:   </os>
Nov 14 10:12:39 user nova-compute[75229]:   <features>
Nov 14 10:12:39 user nova-compute[75229]:     <acpi/>
Nov 14 10:12:39 user nova-compute[75229]:     <apic/>
Nov 14 10:12:39 user nova-compute[75229]:     <vmcoreinfo/>
Nov 14 10:12:39 user nova-compute[75229]:   </features>
Nov 14 10:12:39 user nova-compute[75229]:   <clock offset="utc">
Nov 14 10:12:39 user nova-compute[75229]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 10:12:39 user nova-compute[75229]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 10:12:39 user nova-compute[75229]:     <timer name="hpet" present="no"/>
Nov 14 10:12:39 user nova-compute[75229]:   </clock>
Nov 14 10:12:39 user nova-compute[75229]:   <cpu mode="custom" match="exact">
Nov 14 10:12:39 user nova-compute[75229]:     <model>Nehalem</model>
Nov 14 10:12:39 user nova-compute[75229]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 10:12:39 user nova-compute[75229]:   </cpu>
Nov 14 10:12:39 user nova-compute[75229]:   <devices>
Nov 14 10:12:39 user nova-compute[75229]:     <disk type="file" device="disk">
Nov 14 10:12:39 user nova-compute[75229]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 10:12:39 user nova-compute[75229]:       <source file="/opt/stack/data/nova/instances/68d9de39-cbd2-44b2-bda8-015c8482c240/disk"/>
Nov 14 10:12:39 user nova-compute[75229]:       <target dev="vda" bus="virtio"/>
Nov 14 10:12:39 user nova-compute[75229]:     </disk>
Nov 14 10:12:39 user nova-compute[75229]:     <disk type="block" device="disk">
Nov 14 10:12:39 user nova-compute[75229]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 10:12:39 user nova-compute[75229]:       <source dev="/dev/sdb"/>
Nov 14 10:12:39 user nova-compute[75229]:       <target dev="vdb" bus="virtio"/>
Nov 14 10:12:39 user nova-compute[75229]:       <serial>cf6ced86-b04f-4335-b976-fde67102c8e3</serial>
Nov 14 10:12:39 user nova-compute[75229]:     </disk>
Nov 14 10:12:39 user nova-compute[75229]:     <interface type="ethernet">
Nov 14 10:12:39 user nova-compute[75229]:       <mac address="fa:16:3e:f6:c6:5e"/>
Nov 14 10:12:39 user nova-compute[75229]:       <model type="virtio"/>
Nov 14 10:12:39 user nova-compute[75229]:       <mtu size="1442"/>
Nov 14 10:12:39 user nova-compute[75229]:       <target dev="tape62b2a49-c9"/>
Nov 14 10:12:39 user nova-compute[75229]:     </interface>
Nov 14 10:12:39 user nova-compute[75229]:     <serial type="pty">
Nov 14 10:12:39 user nova-compute[75229]:       <log file="/opt/stack/data/nova/instances/68d9de39-cbd2-44b2-bda8-015c8482c240/console.log" append="off"/>
Nov 14 10:12:39 user nova-compute[75229]:     </serial>
Nov 14 10:12:39 user nova-compute[75229]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 10:12:39 user nova-compute[75229]:     <video>
Nov 14 10:12:39 user nova-compute[75229]:       <model type="virtio"/>
Nov 14 10:12:39 user nova-compute[75229]:     </video>
Nov 14 10:12:39 user nova-compute[75229]:     <rng model="virtio">
Nov 14 10:12:39 user nova-compute[75229]:       <backend model="random">/dev/urandom</backend>
Nov 14 10:12:39 user nova-compute[75229]:     </rng>
Nov 14 10:12:39 user nova-compute[75229]:     <controller type="usb" index="0" model="none"/>
Nov 14 10:12:39 user nova-compute[75229]:     <memballoon model="virtio">
Nov 14 10:12:39 user nova-compute[75229]:       <stats period="10"/>
Nov 14 10:12:39 user nova-compute[75229]:     </memballoon>
Nov 14 10:12:39 user nova-compute[75229]:   </devices>
Nov 14 10:12:39 user nova-compute[75229]: </domain>
Nov 14 10:12:39 user nova-compute[75229]:  {{(pid=75229) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 10:12:39 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-064d5287-3005-41b6-b09d-59e4d28e1c5b tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68d9de39-cbd2-44b2-bda8-015c8482c240/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:12:39 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-064d5287-3005-41b6-b09d-59e4d28e1c5b tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68d9de39-cbd2-44b2-bda8-015c8482c240/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:12:39 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-064d5287-3005-41b6-b09d-59e4d28e1c5b tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68d9de39-cbd2-44b2-bda8-015c8482c240/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:12:39 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-064d5287-3005-41b6-b09d-59e4d28e1c5b tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68d9de39-cbd2-44b2-bda8-015c8482c240/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:12:39 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-064d5287-3005-41b6-b09d-59e4d28e1c5b tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75229) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 10:12:39 user nova-compute[75229]: DEBUG nova.objects.instance [None req-064d5287-3005-41b6-b09d-59e4d28e1c5b tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Lazy-loading 'trusted_certs' on Instance uuid 68d9de39-cbd2-44b2-bda8-015c8482c240 {{(pid=75229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 10:12:40 user nova-compute[75229]: DEBUG nova.objects.base [None req-064d5287-3005-41b6-b09d-59e4d28e1c5b tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Object Instance<68d9de39-cbd2-44b2-bda8-015c8482c240> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=75229) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 10:12:40 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-064d5287-3005-41b6-b09d-59e4d28e1c5b tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6 --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:12:40 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-064d5287-3005-41b6-b09d-59e4d28e1c5b tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6 --force-share --output=json" returned: 0 in 0.172s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:12:40 user nova-compute[75229]: DEBUG nova.virt.disk.api [None req-064d5287-3005-41b6-b09d-59e4d28e1c5b tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Checking if we can resize image /opt/stack/data/nova/instances/68d9de39-cbd2-44b2-bda8-015c8482c240/disk. size=1073741824 {{(pid=75229) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 10:12:40 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-064d5287-3005-41b6-b09d-59e4d28e1c5b tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68d9de39-cbd2-44b2-bda8-015c8482c240/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:12:40 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-064d5287-3005-41b6-b09d-59e4d28e1c5b tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68d9de39-cbd2-44b2-bda8-015c8482c240/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:12:40 user nova-compute[75229]: DEBUG nova.virt.disk.api [None req-064d5287-3005-41b6-b09d-59e4d28e1c5b tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Cannot resize image /opt/stack/data/nova/instances/68d9de39-cbd2-44b2-bda8-015c8482c240/disk to a smaller size. {{(pid=75229) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 10:12:40 user nova-compute[75229]: DEBUG nova.objects.instance [None req-064d5287-3005-41b6-b09d-59e4d28e1c5b tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Lazy-loading 'migration_context' on Instance uuid 68d9de39-cbd2-44b2-bda8-015c8482c240 {{(pid=75229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 10:12:40 user nova-compute[75229]: DEBUG nova.objects.base [None req-064d5287-3005-41b6-b09d-59e4d28e1c5b tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Object Instance<68d9de39-cbd2-44b2-bda8-015c8482c240> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=75229) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 10:12:40 user nova-compute[75229]: DEBUG nova.virt.libvirt.vif [None req-064d5287-3005-41b6-b09d-59e4d28e1c5b tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T10:08:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-83963923',display_name='tempest-AttachVolumeTestJSON-server-83963923',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-83963923',id=48,image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJXzPsBd7qGYyaZb6FflRdQkGeKTe15VJYOOicBN62pWfFwNeM5MDUu06fTurq1Q3swlWbSacoNNYmELLNWG6cLojtLhJVSsbh2TFSo9QcykLrjuhusRznBqFctWAQ+d2w==',key_name='tempest-keypair-580650650',keypairs=<?>,launch_index=0,launched_at=2023-11-14T10:08:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='be7eb95aea3e4897acbc9fe03aadb8e7',ramdisk_id='',reservation_id='r-mo2dg0yb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-775906619',owner_user_name='tempest-AttachVolumeTestJSON-775906619-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T10:10:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='707c03b04f664aab82260a037074de21',uuid=68d9de39-cbd2-44b2-bda8-015c8482c240,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "e62b2a49-c9cc-4568-b887-1c7884830ac2", "address": "fa:16:3e:f6:c6:5e", "network": {"id": "13b12b7e-2548-4256-8fb8-fccc67b1e18b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-698342503-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.41", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be7eb95aea3e4897acbc9fe03aadb8e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape62b2a49-c9", "ovs_interfaceid": "e62b2a49-c9cc-4568-b887-1c7884830ac2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 10:12:40 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-064d5287-3005-41b6-b09d-59e4d28e1c5b tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Converting VIF {"id": "e62b2a49-c9cc-4568-b887-1c7884830ac2", "address": "fa:16:3e:f6:c6:5e", "network": {"id": "13b12b7e-2548-4256-8fb8-fccc67b1e18b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-698342503-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.41", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be7eb95aea3e4897acbc9fe03aadb8e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape62b2a49-c9", "ovs_interfaceid": "e62b2a49-c9cc-4568-b887-1c7884830ac2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 10:12:40 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-064d5287-3005-41b6-b09d-59e4d28e1c5b tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f6:c6:5e,bridge_name='br-int',has_traffic_filtering=True,id=e62b2a49-c9cc-4568-b887-1c7884830ac2,network=Network(13b12b7e-2548-4256-8fb8-fccc67b1e18b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape62b2a49-c9') {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 10:12:40 user nova-compute[75229]: DEBUG os_vif [None req-064d5287-3005-41b6-b09d-59e4d28e1c5b tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f6:c6:5e,bridge_name='br-int',has_traffic_filtering=True,id=e62b2a49-c9cc-4568-b887-1c7884830ac2,network=Network(13b12b7e-2548-4256-8fb8-fccc67b1e18b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape62b2a49-c9') {{(pid=75229) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 10:12:40 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:12:40 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 10:12:40 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 10:12:40 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:12:40 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1c7e9000-3b26-5871-98a1-cf71fdce72fe', '_type': 'linux-noop'}}, row=False) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 10:12:40 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:12:40 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 10:12:40 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:12:40 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape62b2a49-c9, may_exist=True, interface_attrs={}) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 10:12:40 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape62b2a49-c9, col_values=(('qos', UUID('4146aaad-ef91-4d57-ace4-41cd409c7118')),), if_exists=True) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 10:12:40 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape62b2a49-c9, col_values=(('external_ids', {'iface-id': 'e62b2a49-c9cc-4568-b887-1c7884830ac2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f6:c6:5e', 'vm-uuid': '68d9de39-cbd2-44b2-bda8-015c8482c240'}),), if_exists=True) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 10:12:40 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:12:40 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 10:12:40 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:12:40 user nova-compute[75229]: INFO os_vif [None req-064d5287-3005-41b6-b09d-59e4d28e1c5b tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f6:c6:5e,bridge_name='br-int',has_traffic_filtering=True,id=e62b2a49-c9cc-4568-b887-1c7884830ac2,network=Network(13b12b7e-2548-4256-8fb8-fccc67b1e18b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape62b2a49-c9')
Nov 14 10:12:41 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:12:41 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:12:41 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:12:41 user nova-compute[75229]: DEBUG nova.compute.manager [req-89559d3e-d3b2-4a98-ae67-6a388132fc34 req-9d014ed0-fe43-4613-a749-0b9e94e08ce4 service nova] [instance: 68d9de39-cbd2-44b2-bda8-015c8482c240] Received event network-vif-plugged-e62b2a49-c9cc-4568-b887-1c7884830ac2 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 10:12:41 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-89559d3e-d3b2-4a98-ae67-6a388132fc34 req-9d014ed0-fe43-4613-a749-0b9e94e08ce4 service nova] Acquiring lock "68d9de39-cbd2-44b2-bda8-015c8482c240-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:12:41 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-89559d3e-d3b2-4a98-ae67-6a388132fc34 req-9d014ed0-fe43-4613-a749-0b9e94e08ce4 service nova] Lock "68d9de39-cbd2-44b2-bda8-015c8482c240-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.004s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:12:41 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-89559d3e-d3b2-4a98-ae67-6a388132fc34 req-9d014ed0-fe43-4613-a749-0b9e94e08ce4 service nova] Lock "68d9de39-cbd2-44b2-bda8-015c8482c240-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:12:41 user nova-compute[75229]: DEBUG nova.compute.manager [req-89559d3e-d3b2-4a98-ae67-6a388132fc34 req-9d014ed0-fe43-4613-a749-0b9e94e08ce4 service nova] [instance: 68d9de39-cbd2-44b2-bda8-015c8482c240] No waiting events found dispatching network-vif-plugged-e62b2a49-c9cc-4568-b887-1c7884830ac2 {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 10:12:41 user nova-compute[75229]: WARNING nova.compute.manager [req-89559d3e-d3b2-4a98-ae67-6a388132fc34 req-9d014ed0-fe43-4613-a749-0b9e94e08ce4 service nova] [instance: 68d9de39-cbd2-44b2-bda8-015c8482c240] Received unexpected event network-vif-plugged-e62b2a49-c9cc-4568-b887-1c7884830ac2 for instance with vm_state stopped and task_state powering-on.
Nov 14 10:12:42 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:12:42 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:12:42 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:12:43 user nova-compute[75229]: DEBUG nova.compute.manager [None req-064d5287-3005-41b6-b09d-59e4d28e1c5b tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] [instance: 68d9de39-cbd2-44b2-bda8-015c8482c240] Instance event wait completed in 0 seconds for  {{(pid=75229) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 10:12:43 user nova-compute[75229]: INFO nova.virt.libvirt.driver [-] [instance: 68d9de39-cbd2-44b2-bda8-015c8482c240] Instance rebooted successfully.
Nov 14 10:12:43 user nova-compute[75229]: DEBUG nova.compute.manager [None req-064d5287-3005-41b6-b09d-59e4d28e1c5b tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] [instance: 68d9de39-cbd2-44b2-bda8-015c8482c240] Checking state {{(pid=75229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 10:12:43 user nova-compute[75229]: DEBUG nova.compute.manager [req-af3db08b-b83c-438c-8b93-363851b382a9 req-9cc71fa3-9c30-4fb8-9928-0c3d91527ef3 service nova] [instance: 68d9de39-cbd2-44b2-bda8-015c8482c240] Received event network-vif-plugged-e62b2a49-c9cc-4568-b887-1c7884830ac2 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 10:12:43 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-af3db08b-b83c-438c-8b93-363851b382a9 req-9cc71fa3-9c30-4fb8-9928-0c3d91527ef3 service nova] Acquiring lock "68d9de39-cbd2-44b2-bda8-015c8482c240-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:12:43 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-af3db08b-b83c-438c-8b93-363851b382a9 req-9cc71fa3-9c30-4fb8-9928-0c3d91527ef3 service nova] Lock "68d9de39-cbd2-44b2-bda8-015c8482c240-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:12:43 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-af3db08b-b83c-438c-8b93-363851b382a9 req-9cc71fa3-9c30-4fb8-9928-0c3d91527ef3 service nova] Lock "68d9de39-cbd2-44b2-bda8-015c8482c240-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:12:43 user nova-compute[75229]: DEBUG nova.compute.manager [req-af3db08b-b83c-438c-8b93-363851b382a9 req-9cc71fa3-9c30-4fb8-9928-0c3d91527ef3 service nova] [instance: 68d9de39-cbd2-44b2-bda8-015c8482c240] No waiting events found dispatching network-vif-plugged-e62b2a49-c9cc-4568-b887-1c7884830ac2 {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 10:12:43 user nova-compute[75229]: WARNING nova.compute.manager [req-af3db08b-b83c-438c-8b93-363851b382a9 req-9cc71fa3-9c30-4fb8-9928-0c3d91527ef3 service nova] [instance: 68d9de39-cbd2-44b2-bda8-015c8482c240] Received unexpected event network-vif-plugged-e62b2a49-c9cc-4568-b887-1c7884830ac2 for instance with vm_state active and task_state None.
Nov 14 10:12:44 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:12:45 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:12:45 user nova-compute[75229]: DEBUG nova.compute.manager [req-25e8382f-6532-4966-a51e-311645041570 req-07d2eb84-0935-4f9c-b93a-c61f028c11c8 service nova] [instance: a79894e7-5018-4b3a-bd3b-694f1833f99f] Received event network-changed-54a9142a-bf94-4861-ae9e-c48faf5556e4 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 10:12:45 user nova-compute[75229]: DEBUG nova.compute.manager [req-25e8382f-6532-4966-a51e-311645041570 req-07d2eb84-0935-4f9c-b93a-c61f028c11c8 service nova] [instance: a79894e7-5018-4b3a-bd3b-694f1833f99f] Refreshing instance network info cache due to event network-changed-54a9142a-bf94-4861-ae9e-c48faf5556e4. {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 10:12:45 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-25e8382f-6532-4966-a51e-311645041570 req-07d2eb84-0935-4f9c-b93a-c61f028c11c8 service nova] Acquiring lock "refresh_cache-a79894e7-5018-4b3a-bd3b-694f1833f99f" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 10:12:45 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-25e8382f-6532-4966-a51e-311645041570 req-07d2eb84-0935-4f9c-b93a-c61f028c11c8 service nova] Acquired lock "refresh_cache-a79894e7-5018-4b3a-bd3b-694f1833f99f" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 10:12:45 user nova-compute[75229]: DEBUG nova.network.neutron [req-25e8382f-6532-4966-a51e-311645041570 req-07d2eb84-0935-4f9c-b93a-c61f028c11c8 service nova] [instance: a79894e7-5018-4b3a-bd3b-694f1833f99f] Refreshing network info cache for port 54a9142a-bf94-4861-ae9e-c48faf5556e4 {{(pid=75229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 10:12:46 user nova-compute[75229]: DEBUG nova.network.neutron [req-25e8382f-6532-4966-a51e-311645041570 req-07d2eb84-0935-4f9c-b93a-c61f028c11c8 service nova] [instance: a79894e7-5018-4b3a-bd3b-694f1833f99f] Updated VIF entry in instance network info cache for port 54a9142a-bf94-4861-ae9e-c48faf5556e4. {{(pid=75229) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 10:12:46 user nova-compute[75229]: DEBUG nova.network.neutron [req-25e8382f-6532-4966-a51e-311645041570 req-07d2eb84-0935-4f9c-b93a-c61f028c11c8 service nova] [instance: a79894e7-5018-4b3a-bd3b-694f1833f99f] Updating instance_info_cache with network_info: [{"id": "54a9142a-bf94-4861-ae9e-c48faf5556e4", "address": "fa:16:3e:e3:a3:84", "network": {"id": "118ea7c1-77c0-4660-b7b7-f311f6b0ec8a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1907578504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46620ac128944703899f22fe5439ba26", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54a9142a-bf", "ovs_interfaceid": "54a9142a-bf94-4861-ae9e-c48faf5556e4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 10:12:46 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-25e8382f-6532-4966-a51e-311645041570 req-07d2eb84-0935-4f9c-b93a-c61f028c11c8 service nova] Releasing lock "refresh_cache-a79894e7-5018-4b3a-bd3b-694f1833f99f" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 10:12:46 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-e6d6b7e5-9e6a-4b54-ba09-a3bf14b4780e tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Acquiring lock "a79894e7-5018-4b3a-bd3b-694f1833f99f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:12:46 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-e6d6b7e5-9e6a-4b54-ba09-a3bf14b4780e tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Lock "a79894e7-5018-4b3a-bd3b-694f1833f99f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:12:46 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-e6d6b7e5-9e6a-4b54-ba09-a3bf14b4780e tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Acquiring lock "a79894e7-5018-4b3a-bd3b-694f1833f99f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:12:46 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-e6d6b7e5-9e6a-4b54-ba09-a3bf14b4780e tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Lock "a79894e7-5018-4b3a-bd3b-694f1833f99f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:12:46 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-e6d6b7e5-9e6a-4b54-ba09-a3bf14b4780e tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Lock "a79894e7-5018-4b3a-bd3b-694f1833f99f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:12:46 user nova-compute[75229]: INFO nova.compute.manager [None req-e6d6b7e5-9e6a-4b54-ba09-a3bf14b4780e tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] [instance: a79894e7-5018-4b3a-bd3b-694f1833f99f] Terminating instance
Nov 14 10:12:46 user nova-compute[75229]: DEBUG nova.compute.manager [None req-e6d6b7e5-9e6a-4b54-ba09-a3bf14b4780e tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] [instance: a79894e7-5018-4b3a-bd3b-694f1833f99f] Start destroying the instance on the hypervisor. {{(pid=75229) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 10:12:46 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:12:46 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:12:46 user nova-compute[75229]: DEBUG nova.compute.manager [req-8f9cccd7-fdef-4385-a9bf-a8ce65a37be1 req-7931a8cf-5f84-4b90-9b53-a6be003063b1 service nova] [instance: a79894e7-5018-4b3a-bd3b-694f1833f99f] Received event network-vif-unplugged-54a9142a-bf94-4861-ae9e-c48faf5556e4 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 10:12:46 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-8f9cccd7-fdef-4385-a9bf-a8ce65a37be1 req-7931a8cf-5f84-4b90-9b53-a6be003063b1 service nova] Acquiring lock "a79894e7-5018-4b3a-bd3b-694f1833f99f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:12:46 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-8f9cccd7-fdef-4385-a9bf-a8ce65a37be1 req-7931a8cf-5f84-4b90-9b53-a6be003063b1 service nova] Lock "a79894e7-5018-4b3a-bd3b-694f1833f99f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:12:46 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-8f9cccd7-fdef-4385-a9bf-a8ce65a37be1 req-7931a8cf-5f84-4b90-9b53-a6be003063b1 service nova] Lock "a79894e7-5018-4b3a-bd3b-694f1833f99f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:12:46 user nova-compute[75229]: DEBUG nova.compute.manager [req-8f9cccd7-fdef-4385-a9bf-a8ce65a37be1 req-7931a8cf-5f84-4b90-9b53-a6be003063b1 service nova] [instance: a79894e7-5018-4b3a-bd3b-694f1833f99f] No waiting events found dispatching network-vif-unplugged-54a9142a-bf94-4861-ae9e-c48faf5556e4 {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 10:12:46 user nova-compute[75229]: DEBUG nova.compute.manager [req-8f9cccd7-fdef-4385-a9bf-a8ce65a37be1 req-7931a8cf-5f84-4b90-9b53-a6be003063b1 service nova] [instance: a79894e7-5018-4b3a-bd3b-694f1833f99f] Received event network-vif-unplugged-54a9142a-bf94-4861-ae9e-c48faf5556e4 for instance with task_state deleting. {{(pid=75229) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 10:12:46 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:12:46 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:12:47 user nova-compute[75229]: INFO nova.virt.libvirt.driver [-] [instance: a79894e7-5018-4b3a-bd3b-694f1833f99f] Instance destroyed successfully.
Nov 14 10:12:47 user nova-compute[75229]: DEBUG nova.objects.instance [None req-e6d6b7e5-9e6a-4b54-ba09-a3bf14b4780e tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Lazy-loading 'resources' on Instance uuid a79894e7-5018-4b3a-bd3b-694f1833f99f {{(pid=75229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 10:12:47 user nova-compute[75229]: DEBUG nova.virt.libvirt.vif [None req-e6d6b7e5-9e6a-4b54-ba09-a3bf14b4780e tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T10:10:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-179798678',display_name='tempest-TestVolumeBootPattern-server-179798678',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-179798678',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB5A5mLvKIp6dvI0hO7rO3NlF4G2D20sY7gWEAC+0V/AEyka0aVsvCwYcGQ5KpPpLYwOEY7teK2+b3AO8avbXCe5MdbQ1NPGUWXRV3gtRowACc3Uq7kyXeekLcjWCRcSng==',key_name='tempest-TestVolumeBootPattern-2092695190',keypairs=<?>,launch_index=0,launched_at=2023-11-14T10:11:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='46620ac128944703899f22fe5439ba26',ramdisk_id='',reservation_id='r-l2k800g0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-2064993142',owner_user_name='tempest-TestVolumeBootPattern-2064993142-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T10:11:04Z,user_data=None,user_id='c26f33e4cdf14ba796445959953f8685',uuid=a79894e7-5018-4b3a-bd3b-694f1833f99f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "54a9142a-bf94-4861-ae9e-c48faf5556e4", "address": "fa:16:3e:e3:a3:84", "network": {"id": "118ea7c1-77c0-4660-b7b7-f311f6b0ec8a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1907578504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46620ac128944703899f22fe5439ba26", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54a9142a-bf", "ovs_interfaceid": "54a9142a-bf94-4861-ae9e-c48faf5556e4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 10:12:47 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-e6d6b7e5-9e6a-4b54-ba09-a3bf14b4780e tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Converting VIF {"id": "54a9142a-bf94-4861-ae9e-c48faf5556e4", "address": "fa:16:3e:e3:a3:84", "network": {"id": "118ea7c1-77c0-4660-b7b7-f311f6b0ec8a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1907578504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46620ac128944703899f22fe5439ba26", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54a9142a-bf", "ovs_interfaceid": "54a9142a-bf94-4861-ae9e-c48faf5556e4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 10:12:47 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-e6d6b7e5-9e6a-4b54-ba09-a3bf14b4780e tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e3:a3:84,bridge_name='br-int',has_traffic_filtering=True,id=54a9142a-bf94-4861-ae9e-c48faf5556e4,network=Network(118ea7c1-77c0-4660-b7b7-f311f6b0ec8a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap54a9142a-bf') {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 10:12:47 user nova-compute[75229]: DEBUG os_vif [None req-e6d6b7e5-9e6a-4b54-ba09-a3bf14b4780e tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e3:a3:84,bridge_name='br-int',has_traffic_filtering=True,id=54a9142a-bf94-4861-ae9e-c48faf5556e4,network=Network(118ea7c1-77c0-4660-b7b7-f311f6b0ec8a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap54a9142a-bf') {{(pid=75229) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 10:12:47 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:12:47 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap54a9142a-bf, bridge=br-int, if_exists=True) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 10:12:47 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:12:47 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 10:12:47 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:12:47 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d3ea0702-4e36-4ec3-83cb-22141c6b33b0) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 10:12:47 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:12:47 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 10:12:47 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:12:47 user nova-compute[75229]: INFO os_vif [None req-e6d6b7e5-9e6a-4b54-ba09-a3bf14b4780e tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e3:a3:84,bridge_name='br-int',has_traffic_filtering=True,id=54a9142a-bf94-4861-ae9e-c48faf5556e4,network=Network(118ea7c1-77c0-4660-b7b7-f311f6b0ec8a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap54a9142a-bf')
Nov 14 10:12:47 user nova-compute[75229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e6d6b7e5-9e6a-4b54-ba09-a3bf14b4780e tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] [instance: a79894e7-5018-4b3a-bd3b-694f1833f99f] calling os-brick to detach iSCSI Volume {{(pid=75229) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 10:12:47 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6d6b7e5-9e6a-4b54-ba09-a3bf14b4780e tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f73f85151b0>, {'target_iqn': 'iqn.2010-10.org.openstack:d86c34fa-0121-4ba8-ac40-655170558568', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IGRUkZXD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 10:12:47 user nova-compute[75229]: WARNING os_brick.initiator.connectors.base [None req-e6d6b7e5-9e6a-4b54-ba09-a3bf14b4780e tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 10:12:47 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-e6d6b7e5-9e6a-4b54-ba09-a3bf14b4780e tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 10:12:47 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-e6d6b7e5-9e6a-4b54-ba09-a3bf14b4780e tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 10:12:47 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:12:47 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.031s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:12:47 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[13df8b1f-e45e-4458-b8a0-f86ee2718194]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:cf6ced86-b04f-4335-b976-fde67102c8e3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d86c34fa-0121-4ba8-ac40-655170558568\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c8892c7d-49e8-4f65-b88c-1e14fba8f50a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:12:47 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6d6b7e5-9e6a-4b54-ba09-a3bf14b4780e tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 10:12:47 user nova-compute[75229]: No targets found.
Nov 14 10:12:47 user nova-compute[75229]: iSNS:
Nov 14 10:12:47 user nova-compute[75229]: No targets found.
Nov 14 10:12:47 user nova-compute[75229]: STATIC:
Nov 14 10:12:47 user nova-compute[75229]: Target: iqn.2010-10.org.openstack:cf6ced86-b04f-4335-b976-fde67102c8e3
Nov 14 10:12:47 user nova-compute[75229]:         Portal: 172.16.0.220:3260,-1
Nov 14 10:12:47 user nova-compute[75229]:                 Iface Name: default
Nov 14 10:12:47 user nova-compute[75229]: Target: iqn.2010-10.org.openstack:d86c34fa-0121-4ba8-ac40-655170558568
Nov 14 10:12:47 user nova-compute[75229]:         Portal: 172.16.0.220:3260,-1
Nov 14 10:12:47 user nova-compute[75229]:                 Iface Name: default
Nov 14 10:12:47 user nova-compute[75229]: Target: iqn.2010-10.org.openstack:c8892c7d-49e8-4f65-b88c-1e14fba8f50a
Nov 14 10:12:47 user nova-compute[75229]:         Portal: 172.16.0.220:3260,-1
Nov 14 10:12:47 user nova-compute[75229]:                 Iface Name: default
Nov 14 10:12:47 user nova-compute[75229]: FIRMWARE:
Nov 14 10:12:47 user nova-compute[75229]: No targets found.
Nov 14 10:12:47 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 10:12:47 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6d6b7e5-9e6a-4b54-ba09-a3bf14b4780e tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 10:12:47 user nova-compute[75229]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 10:12:47 user nova-compute[75229]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75229) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 10:12:47 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6d6b7e5-9e6a-4b54-ba09-a3bf14b4780e tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d86c34fa-0121-4ba8-ac40-655170558568', 0)] {{(pid=75229) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 10:12:47 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:12:47 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:12:47 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[74daf6a0-5fbf-4f4f-b5dc-373a4220c51c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c8892c7d-49e8-4f65-b88c-1e14fba8f50a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cf6ced86-b04f-4335-b976-fde67102c8e3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d86c34fa-0121-4ba8-ac40-655170558568\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:12:47 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:12:47 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:12:47 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[50ee889b-a6b6-4a68-8ca9-2ab074395ec7]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8892c7d-49e8-4f65-b88c-1e14fba8f50a (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d86c34fa-0121-4ba8-ac40-655170558568 (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf6ced86-b04f-4335-b976-fde67102c8e3 (non-flash)\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:12:47 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6d6b7e5-9e6a-4b54-ba09-a3bf14b4780e tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8892c7d-49e8-4f65-b88c-1e14fba8f50a (non-flash)
Nov 14 10:12:47 user nova-compute[75229]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d86c34fa-0121-4ba8-ac40-655170558568 (non-flash)
Nov 14 10:12:47 user nova-compute[75229]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf6ced86-b04f-4335-b976-fde67102c8e3 (non-flash)
Nov 14 10:12:47 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 10:12:47 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6d6b7e5-9e6a-4b54-ba09-a3bf14b4780e tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8892c7d-49e8-4f65-b88c-1e14fba8f50a (non-flash)
Nov 14 10:12:47 user nova-compute[75229]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d86c34fa-0121-4ba8-ac40-655170558568 (non-flash)
Nov 14 10:12:47 user nova-compute[75229]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf6ced86-b04f-4335-b976-fde67102c8e3 (non-flash)
Nov 14 10:12:47 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 10:12:47 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6d6b7e5-9e6a-4b54-ba09-a3bf14b4780e tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f73f83d9480>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d86c34fa-0121-4ba8-ac40-655170558568'): ({'sdd'}, set())}) {{(pid=75229) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 10:12:47 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-e6d6b7e5-9e6a-4b54-ba09-a3bf14b4780e tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Removing single pathed devices sdd {{(pid=75229) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 10:12:47 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:12:47 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:12:47 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[e79190fc-dbd0-432f-8871-c2b9a72d214b]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:12:47 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:12:47 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.027s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:12:47 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[77c77521-988c-4c74-a703-dce2103a2634]: (4, ('ok\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:12:47 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-e6d6b7e5-9e6a-4b54-ba09-a3bf14b4780e tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Flushing IO for device /dev/sdd {{(pid=75229) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 10:12:47 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:12:47 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:12:47 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ebe3ef6-94e7-49ad-b1db-186acfdee2c9]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:12:47 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-e6d6b7e5-9e6a-4b54-ba09-a3bf14b4780e tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75229) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 10:12:47 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:12:47 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.041s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:12:47 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[6757fea0-10a6-475c-a514-88f3491c7a64]: (4, ('1', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:12:47 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-e6d6b7e5-9e6a-4b54-ba09-a3bf14b4780e tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75229) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 10:12:47 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-e6d6b7e5-9e6a-4b54-ba09-a3bf14b4780e tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] SCSI volumes sdd have been removed. {{(pid=75229) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 10:12:47 user nova-compute[75229]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_6851a24b', '/dev/disk/by-id/scsi-26639353061623034', '/dev/disk/by-id/scsi-1SCST_BIO6851a24b-f950ab044b9bb826') {{(pid=86458) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 14 10:12:47 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[55c1f751-67c3-4fea-bff5-9061ab73f46c]: (4, None) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:12:47 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6d6b7e5-9e6a-4b54-ba09-a3bf14b4780e tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d86c34fa-0121-4ba8-ac40-655170558568')] {{(pid=75229) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 10:12:47 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d86c34fa-0121-4ba8-ac40-655170558568 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:12:47 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d86c34fa-0121-4ba8-ac40-655170558568 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:12:47 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3b49d69-527e-4370-9a3d-f1fa785b50de]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:12:47 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6d6b7e5-9e6a-4b54-ba09-a3bf14b4780e tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 10:12:47 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d86c34fa-0121-4ba8-ac40-655170558568 -p 172.16.0.220:3260 --logout {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:12:47 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d86c34fa-0121-4ba8-ac40-655170558568 -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:12:47 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab285a3e-d940-4091-90db-09ea8114830c]: (4, ('Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:d86c34fa-0121-4ba8-ac40-655170558568, portal: 172.16.0.220,3260]\nLogout of [sid: 54, target: iqn.2010-10.org.openstack:d86c34fa-0121-4ba8-ac40-655170558568, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:12:47 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6d6b7e5-9e6a-4b54-ba09-a3bf14b4780e tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:d86c34fa-0121-4ba8-ac40-655170558568, portal: 172.16.0.220,3260]
Nov 14 10:12:47 user nova-compute[75229]: Logout of [sid: 54, target: iqn.2010-10.org.openstack:d86c34fa-0121-4ba8-ac40-655170558568, portal: 172.16.0.220,3260] successful.
Nov 14 10:12:47 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 10:12:47 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d86c34fa-0121-4ba8-ac40-655170558568 -p 172.16.0.220:3260 --op delete {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:12:47 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d86c34fa-0121-4ba8-ac40-655170558568 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:12:47 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2a2f7dd-92ba-4efd-8308-299aa2063722]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:12:47 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6d6b7e5-9e6a-4b54-ba09-a3bf14b4780e tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 10:12:47 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-e6d6b7e5-9e6a-4b54-ba09-a3bf14b4780e tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.363s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 10:12:47 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6d6b7e5-9e6a-4b54-ba09-a3bf14b4780e tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] <== disconnect_volume: return (365ms) None {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 10:12:47 user nova-compute[75229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e6d6b7e5-9e6a-4b54-ba09-a3bf14b4780e tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] [instance: a79894e7-5018-4b3a-bd3b-694f1833f99f] Disconnected iSCSI Volume {{(pid=75229) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 10:12:47 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-e6d6b7e5-9e6a-4b54-ba09-a3bf14b4780e tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] [instance: a79894e7-5018-4b3a-bd3b-694f1833f99f] Deleting instance files /opt/stack/data/nova/instances/a79894e7-5018-4b3a-bd3b-694f1833f99f_del
Nov 14 10:12:47 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-e6d6b7e5-9e6a-4b54-ba09-a3bf14b4780e tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] [instance: a79894e7-5018-4b3a-bd3b-694f1833f99f] Deletion of /opt/stack/data/nova/instances/a79894e7-5018-4b3a-bd3b-694f1833f99f_del complete
Nov 14 10:12:47 user nova-compute[75229]: INFO nova.compute.manager [None req-e6d6b7e5-9e6a-4b54-ba09-a3bf14b4780e tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] [instance: a79894e7-5018-4b3a-bd3b-694f1833f99f] Took 1.24 seconds to destroy the instance on the hypervisor.
Nov 14 10:12:47 user nova-compute[75229]: DEBUG oslo.service.loopingcall [None req-e6d6b7e5-9e6a-4b54-ba09-a3bf14b4780e tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75229) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 10:12:47 user nova-compute[75229]: DEBUG nova.compute.manager [-] [instance: a79894e7-5018-4b3a-bd3b-694f1833f99f] Deallocating network for instance {{(pid=75229) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 10:12:47 user nova-compute[75229]: DEBUG nova.network.neutron [-] [instance: a79894e7-5018-4b3a-bd3b-694f1833f99f] deallocate_for_instance() {{(pid=75229) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 10:12:48 user nova-compute[75229]: DEBUG nova.compute.manager [req-9b7f1790-0886-4142-abad-32705f86e9dc req-dfe58947-832d-464a-93f7-2ac6eae0f714 service nova] [instance: a79894e7-5018-4b3a-bd3b-694f1833f99f] Received event network-changed-54a9142a-bf94-4861-ae9e-c48faf5556e4 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 10:12:48 user nova-compute[75229]: DEBUG nova.compute.manager [req-9b7f1790-0886-4142-abad-32705f86e9dc req-dfe58947-832d-464a-93f7-2ac6eae0f714 service nova] [instance: a79894e7-5018-4b3a-bd3b-694f1833f99f] Refreshing instance network info cache due to event network-changed-54a9142a-bf94-4861-ae9e-c48faf5556e4. {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 10:12:48 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-9b7f1790-0886-4142-abad-32705f86e9dc req-dfe58947-832d-464a-93f7-2ac6eae0f714 service nova] Acquiring lock "refresh_cache-a79894e7-5018-4b3a-bd3b-694f1833f99f" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 10:12:48 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-9b7f1790-0886-4142-abad-32705f86e9dc req-dfe58947-832d-464a-93f7-2ac6eae0f714 service nova] Acquired lock "refresh_cache-a79894e7-5018-4b3a-bd3b-694f1833f99f" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 10:12:48 user nova-compute[75229]: DEBUG nova.network.neutron [req-9b7f1790-0886-4142-abad-32705f86e9dc req-dfe58947-832d-464a-93f7-2ac6eae0f714 service nova] [instance: a79894e7-5018-4b3a-bd3b-694f1833f99f] Refreshing network info cache for port 54a9142a-bf94-4861-ae9e-c48faf5556e4 {{(pid=75229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 10:12:48 user nova-compute[75229]: INFO nova.network.neutron [req-9b7f1790-0886-4142-abad-32705f86e9dc req-dfe58947-832d-464a-93f7-2ac6eae0f714 service nova] [instance: a79894e7-5018-4b3a-bd3b-694f1833f99f] Port 54a9142a-bf94-4861-ae9e-c48faf5556e4 from network info_cache is no longer associated with instance in Neutron. Removing from network info_cache.
Nov 14 10:12:48 user nova-compute[75229]: DEBUG nova.network.neutron [req-9b7f1790-0886-4142-abad-32705f86e9dc req-dfe58947-832d-464a-93f7-2ac6eae0f714 service nova] [instance: a79894e7-5018-4b3a-bd3b-694f1833f99f] Updating instance_info_cache with network_info: [] {{(pid=75229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 10:12:48 user nova-compute[75229]: DEBUG nova.network.neutron [-] [instance: a79894e7-5018-4b3a-bd3b-694f1833f99f] Updating instance_info_cache with network_info: [] {{(pid=75229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 10:12:48 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-9b7f1790-0886-4142-abad-32705f86e9dc req-dfe58947-832d-464a-93f7-2ac6eae0f714 service nova] Releasing lock "refresh_cache-a79894e7-5018-4b3a-bd3b-694f1833f99f" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 10:12:48 user nova-compute[75229]: INFO nova.compute.manager [-] [instance: a79894e7-5018-4b3a-bd3b-694f1833f99f] Took 0.44 seconds to deallocate network for instance.
Nov 14 10:12:48 user nova-compute[75229]: DEBUG nova.compute.manager [req-5ea64f8b-e520-4ab2-9842-7b6df11fc34f req-8ee08895-5b36-409c-b65e-bd868b710f1b service nova] [instance: a79894e7-5018-4b3a-bd3b-694f1833f99f] Received event network-vif-deleted-54a9142a-bf94-4861-ae9e-c48faf5556e4 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 10:12:48 user nova-compute[75229]: INFO nova.compute.manager [None req-e6d6b7e5-9e6a-4b54-ba09-a3bf14b4780e tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] [instance: a79894e7-5018-4b3a-bd3b-694f1833f99f] Took 0.78 seconds to detach 1 volumes for instance.
Nov 14 10:12:49 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-e6d6b7e5-9e6a-4b54-ba09-a3bf14b4780e tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:12:49 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-e6d6b7e5-9e6a-4b54-ba09-a3bf14b4780e tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:12:49 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:12:49 user nova-compute[75229]: DEBUG nova.compute.provider_tree [None req-e6d6b7e5-9e6a-4b54-ba09-a3bf14b4780e tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Inventory has not changed in ProviderTree for provider: d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 {{(pid=75229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 10:12:49 user nova-compute[75229]: DEBUG nova.scheduler.client.report [None req-e6d6b7e5-9e6a-4b54-ba09-a3bf14b4780e tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Inventory has not changed for provider d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 10:12:49 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-e6d6b7e5-9e6a-4b54-ba09-a3bf14b4780e tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.283s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:12:49 user nova-compute[75229]: DEBUG nova.compute.manager [req-3467546e-4ffb-40c8-9b61-63f0ea0140d6 req-0d15e937-2c28-4b15-bdf2-70605568afb8 service nova] [instance: a79894e7-5018-4b3a-bd3b-694f1833f99f] Received event network-vif-plugged-54a9142a-bf94-4861-ae9e-c48faf5556e4 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 10:12:49 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-3467546e-4ffb-40c8-9b61-63f0ea0140d6 req-0d15e937-2c28-4b15-bdf2-70605568afb8 service nova] Acquiring lock "a79894e7-5018-4b3a-bd3b-694f1833f99f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:12:49 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-3467546e-4ffb-40c8-9b61-63f0ea0140d6 req-0d15e937-2c28-4b15-bdf2-70605568afb8 service nova] Lock "a79894e7-5018-4b3a-bd3b-694f1833f99f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:12:49 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-3467546e-4ffb-40c8-9b61-63f0ea0140d6 req-0d15e937-2c28-4b15-bdf2-70605568afb8 service nova] Lock "a79894e7-5018-4b3a-bd3b-694f1833f99f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:12:49 user nova-compute[75229]: DEBUG nova.compute.manager [req-3467546e-4ffb-40c8-9b61-63f0ea0140d6 req-0d15e937-2c28-4b15-bdf2-70605568afb8 service nova] [instance: a79894e7-5018-4b3a-bd3b-694f1833f99f] No waiting events found dispatching network-vif-plugged-54a9142a-bf94-4861-ae9e-c48faf5556e4 {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 10:12:49 user nova-compute[75229]: WARNING nova.compute.manager [req-3467546e-4ffb-40c8-9b61-63f0ea0140d6 req-0d15e937-2c28-4b15-bdf2-70605568afb8 service nova] [instance: a79894e7-5018-4b3a-bd3b-694f1833f99f] Received unexpected event network-vif-plugged-54a9142a-bf94-4861-ae9e-c48faf5556e4 for instance with vm_state deleted and task_state None.
Nov 14 10:12:49 user nova-compute[75229]: INFO nova.scheduler.client.report [None req-e6d6b7e5-9e6a-4b54-ba09-a3bf14b4780e tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Deleted allocations for instance a79894e7-5018-4b3a-bd3b-694f1833f99f
Nov 14 10:12:49 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-e6d6b7e5-9e6a-4b54-ba09-a3bf14b4780e tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Lock "a79894e7-5018-4b3a-bd3b-694f1833f99f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.943s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:12:52 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:12:57 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:12:59 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:13:02 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:13:02 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:13:04 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:13:06 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:13:06 user nova-compute[75229]: DEBUG nova.compute.manager [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Starting heal instance info cache {{(pid=75229) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 10:13:06 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Acquiring lock "refresh_cache-4a81b779-af09-4026-8387-07d44dad6ef7" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 10:13:06 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Acquired lock "refresh_cache-4a81b779-af09-4026-8387-07d44dad6ef7" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 10:13:06 user nova-compute[75229]: DEBUG nova.network.neutron [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] [instance: 4a81b779-af09-4026-8387-07d44dad6ef7] Forcefully refreshing network info cache for instance {{(pid=75229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 10:13:07 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:13:07 user nova-compute[75229]: DEBUG nova.network.neutron [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] [instance: 4a81b779-af09-4026-8387-07d44dad6ef7] Updating instance_info_cache with network_info: [{"id": "ca86bdcf-6fe2-4ceb-8e9c-6ff88e9efb71", "address": "fa:16:3e:35:44:4b", "network": {"id": "118ea7c1-77c0-4660-b7b7-f311f6b0ec8a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1907578504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46620ac128944703899f22fe5439ba26", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca86bdcf-6f", "ovs_interfaceid": "ca86bdcf-6fe2-4ceb-8e9c-6ff88e9efb71", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 10:13:07 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Releasing lock "refresh_cache-4a81b779-af09-4026-8387-07d44dad6ef7" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 10:13:07 user nova-compute[75229]: DEBUG nova.compute.manager [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] [instance: 4a81b779-af09-4026-8387-07d44dad6ef7] Updated the network info_cache for instance {{(pid=75229) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 10:13:09 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:13:11 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:13:11 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:13:11 user nova-compute[75229]: DEBUG nova.compute.manager [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75229) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 10:13:12 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:13:12 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:13:14 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:13:14 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:13:15 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:13:15 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:13:15 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:13:15 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:13:15 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:13:15 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Auditing locally available compute resources for user (node: user) {{(pid=75229) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 10:13:15 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75229) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 10:13:15 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cda8c5ad-e70c-4021-bace-d55831c4bc78/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:13:16 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cda8c5ad-e70c-4021-bace-d55831c4bc78/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:13:16 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cda8c5ad-e70c-4021-bace-d55831c4bc78/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:13:16 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cda8c5ad-e70c-4021-bace-d55831c4bc78/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:13:16 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68d9de39-cbd2-44b2-bda8-015c8482c240/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:13:16 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68d9de39-cbd2-44b2-bda8-015c8482c240/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:13:16 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68d9de39-cbd2-44b2-bda8-015c8482c240/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:13:16 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68d9de39-cbd2-44b2-bda8-015c8482c240/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:13:16 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75229) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 10:13:16 user nova-compute[75229]: WARNING nova.virt.libvirt.driver [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 10:13:16 user nova-compute[75229]: WARNING nova.virt.libvirt.driver [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 10:13:16 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Hypervisor/Node resource view: name=user free_ram=8737MB free_disk=25.048603057861328GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75229) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 10:13:16 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:13:16 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:13:17 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Instance cda8c5ad-e70c-4021-bace-d55831c4bc78 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 10:13:17 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Instance 68d9de39-cbd2-44b2-bda8-015c8482c240 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 10:13:17 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Instance 4a81b779-af09-4026-8387-07d44dad6ef7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 10:13:17 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75229) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 10:13:17 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75229) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 10:13:17 user nova-compute[75229]: DEBUG nova.compute.provider_tree [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Inventory has not changed in ProviderTree for provider: d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 {{(pid=75229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 10:13:17 user nova-compute[75229]: DEBUG nova.scheduler.client.report [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Inventory has not changed for provider d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 10:13:17 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Compute_service record updated for user:user {{(pid=75229) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 10:13:17 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.269s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:13:17 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:13:22 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:13:22 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 10:13:25 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-e3b1c682-13f6-4a71-a263-ddbc5b0149b8 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Acquiring lock "cda8c5ad-e70c-4021-bace-d55831c4bc78" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:13:25 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-e3b1c682-13f6-4a71-a263-ddbc5b0149b8 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Lock "cda8c5ad-e70c-4021-bace-d55831c4bc78" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:13:25 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-e3b1c682-13f6-4a71-a263-ddbc5b0149b8 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Acquiring lock "cda8c5ad-e70c-4021-bace-d55831c4bc78-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:13:25 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-e3b1c682-13f6-4a71-a263-ddbc5b0149b8 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Lock "cda8c5ad-e70c-4021-bace-d55831c4bc78-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:13:25 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-e3b1c682-13f6-4a71-a263-ddbc5b0149b8 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Lock "cda8c5ad-e70c-4021-bace-d55831c4bc78-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:13:25 user nova-compute[75229]: INFO nova.compute.manager [None req-e3b1c682-13f6-4a71-a263-ddbc5b0149b8 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] [instance: cda8c5ad-e70c-4021-bace-d55831c4bc78] Terminating instance
Nov 14 10:13:25 user nova-compute[75229]: DEBUG nova.compute.manager [None req-e3b1c682-13f6-4a71-a263-ddbc5b0149b8 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] [instance: cda8c5ad-e70c-4021-bace-d55831c4bc78] Start destroying the instance on the hypervisor. {{(pid=75229) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 10:13:25 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:13:26 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:13:26 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:13:26 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:13:26 user nova-compute[75229]: DEBUG nova.compute.manager [req-fd527803-f374-4627-9a25-85b15ea55749 req-6c4d1a13-b21a-4b7a-acf5-70b3e1117ef0 service nova] [instance: cda8c5ad-e70c-4021-bace-d55831c4bc78] Received event network-vif-unplugged-c88498e8-25f8-4546-b007-b1dc853b3ccb {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 10:13:26 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-fd527803-f374-4627-9a25-85b15ea55749 req-6c4d1a13-b21a-4b7a-acf5-70b3e1117ef0 service nova] Acquiring lock "cda8c5ad-e70c-4021-bace-d55831c4bc78-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:13:26 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-fd527803-f374-4627-9a25-85b15ea55749 req-6c4d1a13-b21a-4b7a-acf5-70b3e1117ef0 service nova] Lock "cda8c5ad-e70c-4021-bace-d55831c4bc78-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:13:26 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-fd527803-f374-4627-9a25-85b15ea55749 req-6c4d1a13-b21a-4b7a-acf5-70b3e1117ef0 service nova] Lock "cda8c5ad-e70c-4021-bace-d55831c4bc78-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:13:26 user nova-compute[75229]: DEBUG nova.compute.manager [req-fd527803-f374-4627-9a25-85b15ea55749 req-6c4d1a13-b21a-4b7a-acf5-70b3e1117ef0 service nova] [instance: cda8c5ad-e70c-4021-bace-d55831c4bc78] No waiting events found dispatching network-vif-unplugged-c88498e8-25f8-4546-b007-b1dc853b3ccb {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 10:13:26 user nova-compute[75229]: DEBUG nova.compute.manager [req-fd527803-f374-4627-9a25-85b15ea55749 req-6c4d1a13-b21a-4b7a-acf5-70b3e1117ef0 service nova] [instance: cda8c5ad-e70c-4021-bace-d55831c4bc78] Received event network-vif-unplugged-c88498e8-25f8-4546-b007-b1dc853b3ccb for instance with task_state deleting. {{(pid=75229) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 10:13:26 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:13:26 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:13:26 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:13:26 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:13:26 user nova-compute[75229]: INFO nova.virt.libvirt.driver [-] [instance: cda8c5ad-e70c-4021-bace-d55831c4bc78] Instance destroyed successfully.
Nov 14 10:13:26 user nova-compute[75229]: DEBUG nova.objects.instance [None req-e3b1c682-13f6-4a71-a263-ddbc5b0149b8 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Lazy-loading 'resources' on Instance uuid cda8c5ad-e70c-4021-bace-d55831c4bc78 {{(pid=75229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 10:13:26 user nova-compute[75229]: DEBUG nova.virt.libvirt.vif [None req-e3b1c682-13f6-4a71-a263-ddbc5b0149b8 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T09:53:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-527422031',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-527422031',id=30,image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-14T09:53:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8babb73006da4977a1fe2bdb35e08d8f',ramdisk_id='',reservation_id='r-my61gj0x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-189750210',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T09:55:45Z,user_data=None,user_id='a8825cd49e9349f28576b704c4c4d717',uuid=cda8c5ad-e70c-4021-bace-d55831c4bc78,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c88498e8-25f8-4546-b007-b1dc853b3ccb", "address": "fa:16:3e:c4:17:f3", "network": {"id": "6a700b61-4aa6-440b-87e6-a3525a5cb918", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-448680331-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8babb73006da4977a1fe2bdb35e08d8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc88498e8-25", "ovs_interfaceid": "c88498e8-25f8-4546-b007-b1dc853b3ccb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 10:13:26 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-e3b1c682-13f6-4a71-a263-ddbc5b0149b8 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Converting VIF {"id": "c88498e8-25f8-4546-b007-b1dc853b3ccb", "address": "fa:16:3e:c4:17:f3", "network": {"id": "6a700b61-4aa6-440b-87e6-a3525a5cb918", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-448680331-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8babb73006da4977a1fe2bdb35e08d8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc88498e8-25", "ovs_interfaceid": "c88498e8-25f8-4546-b007-b1dc853b3ccb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 10:13:26 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-e3b1c682-13f6-4a71-a263-ddbc5b0149b8 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c4:17:f3,bridge_name='br-int',has_traffic_filtering=True,id=c88498e8-25f8-4546-b007-b1dc853b3ccb,network=Network(6a700b61-4aa6-440b-87e6-a3525a5cb918),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc88498e8-25') {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 10:13:26 user nova-compute[75229]: DEBUG os_vif [None req-e3b1c682-13f6-4a71-a263-ddbc5b0149b8 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c4:17:f3,bridge_name='br-int',has_traffic_filtering=True,id=c88498e8-25f8-4546-b007-b1dc853b3ccb,network=Network(6a700b61-4aa6-440b-87e6-a3525a5cb918),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc88498e8-25') {{(pid=75229) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 10:13:26 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:13:26 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc88498e8-25, bridge=br-int, if_exists=True) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 10:13:26 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:13:26 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 10:13:26 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:13:26 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0f7b7a61-5c80-47ca-9681-757431e97bbc) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 10:13:26 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:13:26 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 10:13:26 user nova-compute[75229]: INFO os_vif [None req-e3b1c682-13f6-4a71-a263-ddbc5b0149b8 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c4:17:f3,bridge_name='br-int',has_traffic_filtering=True,id=c88498e8-25f8-4546-b007-b1dc853b3ccb,network=Network(6a700b61-4aa6-440b-87e6-a3525a5cb918),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc88498e8-25')
Nov 14 10:13:26 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-e3b1c682-13f6-4a71-a263-ddbc5b0149b8 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] [instance: cda8c5ad-e70c-4021-bace-d55831c4bc78] Deleting instance files /opt/stack/data/nova/instances/cda8c5ad-e70c-4021-bace-d55831c4bc78_del
Nov 14 10:13:26 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-e3b1c682-13f6-4a71-a263-ddbc5b0149b8 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] [instance: cda8c5ad-e70c-4021-bace-d55831c4bc78] Deletion of /opt/stack/data/nova/instances/cda8c5ad-e70c-4021-bace-d55831c4bc78_del complete
Nov 14 10:13:26 user nova-compute[75229]: INFO nova.compute.manager [None req-e3b1c682-13f6-4a71-a263-ddbc5b0149b8 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] [instance: cda8c5ad-e70c-4021-bace-d55831c4bc78] Took 0.90 seconds to destroy the instance on the hypervisor.
Nov 14 10:13:26 user nova-compute[75229]: DEBUG oslo.service.loopingcall [None req-e3b1c682-13f6-4a71-a263-ddbc5b0149b8 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75229) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 10:13:26 user nova-compute[75229]: DEBUG nova.compute.manager [-] [instance: cda8c5ad-e70c-4021-bace-d55831c4bc78] Deallocating network for instance {{(pid=75229) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 10:13:26 user nova-compute[75229]: DEBUG nova.network.neutron [-] [instance: cda8c5ad-e70c-4021-bace-d55831c4bc78] deallocate_for_instance() {{(pid=75229) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 10:13:27 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:13:27 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:13:27 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:13:27 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:13:27 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:13:27 user nova-compute[75229]: DEBUG nova.network.neutron [-] [instance: cda8c5ad-e70c-4021-bace-d55831c4bc78] Updating instance_info_cache with network_info: [] {{(pid=75229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 10:13:27 user nova-compute[75229]: INFO nova.compute.manager [-] [instance: cda8c5ad-e70c-4021-bace-d55831c4bc78] Took 1.05 seconds to deallocate network for instance.
Nov 14 10:13:27 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-e3b1c682-13f6-4a71-a263-ddbc5b0149b8 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:13:27 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-e3b1c682-13f6-4a71-a263-ddbc5b0149b8 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:13:28 user nova-compute[75229]: DEBUG nova.compute.provider_tree [None req-e3b1c682-13f6-4a71-a263-ddbc5b0149b8 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Inventory has not changed in ProviderTree for provider: d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 {{(pid=75229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 10:13:28 user nova-compute[75229]: DEBUG nova.scheduler.client.report [None req-e3b1c682-13f6-4a71-a263-ddbc5b0149b8 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Inventory has not changed for provider d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 10:13:28 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-e3b1c682-13f6-4a71-a263-ddbc5b0149b8 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.181s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:13:28 user nova-compute[75229]: INFO nova.scheduler.client.report [None req-e3b1c682-13f6-4a71-a263-ddbc5b0149b8 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Deleted allocations for instance cda8c5ad-e70c-4021-bace-d55831c4bc78
Nov 14 10:13:28 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-e3b1c682-13f6-4a71-a263-ddbc5b0149b8 tempest-ServerBootFromVolumeStableRescueTest-189750210 tempest-ServerBootFromVolumeStableRescueTest-189750210-project-member] Lock "cda8c5ad-e70c-4021-bace-d55831c4bc78" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.327s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:13:28 user nova-compute[75229]: DEBUG nova.compute.manager [req-402dc816-7c69-4e26-ac3c-060656b7b35c req-a6b37d9a-80fa-4430-9b4f-0b52cfbad018 service nova] [instance: cda8c5ad-e70c-4021-bace-d55831c4bc78] Received event network-vif-plugged-c88498e8-25f8-4546-b007-b1dc853b3ccb {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 10:13:28 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-402dc816-7c69-4e26-ac3c-060656b7b35c req-a6b37d9a-80fa-4430-9b4f-0b52cfbad018 service nova] Acquiring lock "cda8c5ad-e70c-4021-bace-d55831c4bc78-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:13:28 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-402dc816-7c69-4e26-ac3c-060656b7b35c req-a6b37d9a-80fa-4430-9b4f-0b52cfbad018 service nova] Lock "cda8c5ad-e70c-4021-bace-d55831c4bc78-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:13:28 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-402dc816-7c69-4e26-ac3c-060656b7b35c req-a6b37d9a-80fa-4430-9b4f-0b52cfbad018 service nova] Lock "cda8c5ad-e70c-4021-bace-d55831c4bc78-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:13:28 user nova-compute[75229]: DEBUG nova.compute.manager [req-402dc816-7c69-4e26-ac3c-060656b7b35c req-a6b37d9a-80fa-4430-9b4f-0b52cfbad018 service nova] [instance: cda8c5ad-e70c-4021-bace-d55831c4bc78] No waiting events found dispatching network-vif-plugged-c88498e8-25f8-4546-b007-b1dc853b3ccb {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 10:13:28 user nova-compute[75229]: WARNING nova.compute.manager [req-402dc816-7c69-4e26-ac3c-060656b7b35c req-a6b37d9a-80fa-4430-9b4f-0b52cfbad018 service nova] [instance: cda8c5ad-e70c-4021-bace-d55831c4bc78] Received unexpected event network-vif-plugged-c88498e8-25f8-4546-b007-b1dc853b3ccb for instance with vm_state deleted and task_state None.
Nov 14 10:13:28 user nova-compute[75229]: DEBUG nova.compute.manager [req-402dc816-7c69-4e26-ac3c-060656b7b35c req-a6b37d9a-80fa-4430-9b4f-0b52cfbad018 service nova] [instance: cda8c5ad-e70c-4021-bace-d55831c4bc78] Received event network-vif-plugged-c88498e8-25f8-4546-b007-b1dc853b3ccb {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 10:13:28 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-402dc816-7c69-4e26-ac3c-060656b7b35c req-a6b37d9a-80fa-4430-9b4f-0b52cfbad018 service nova] Acquiring lock "cda8c5ad-e70c-4021-bace-d55831c4bc78-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:13:28 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-402dc816-7c69-4e26-ac3c-060656b7b35c req-a6b37d9a-80fa-4430-9b4f-0b52cfbad018 service nova] Lock "cda8c5ad-e70c-4021-bace-d55831c4bc78-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:13:28 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-402dc816-7c69-4e26-ac3c-060656b7b35c req-a6b37d9a-80fa-4430-9b4f-0b52cfbad018 service nova] Lock "cda8c5ad-e70c-4021-bace-d55831c4bc78-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:13:28 user nova-compute[75229]: DEBUG nova.compute.manager [req-402dc816-7c69-4e26-ac3c-060656b7b35c req-a6b37d9a-80fa-4430-9b4f-0b52cfbad018 service nova] [instance: cda8c5ad-e70c-4021-bace-d55831c4bc78] No waiting events found dispatching network-vif-plugged-c88498e8-25f8-4546-b007-b1dc853b3ccb {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 10:13:28 user nova-compute[75229]: WARNING nova.compute.manager [req-402dc816-7c69-4e26-ac3c-060656b7b35c req-a6b37d9a-80fa-4430-9b4f-0b52cfbad018 service nova] [instance: cda8c5ad-e70c-4021-bace-d55831c4bc78] Received unexpected event network-vif-plugged-c88498e8-25f8-4546-b007-b1dc853b3ccb for instance with vm_state deleted and task_state None.
Nov 14 10:13:28 user nova-compute[75229]: DEBUG nova.compute.manager [req-402dc816-7c69-4e26-ac3c-060656b7b35c req-a6b37d9a-80fa-4430-9b4f-0b52cfbad018 service nova] [instance: cda8c5ad-e70c-4021-bace-d55831c4bc78] Received event network-vif-plugged-c88498e8-25f8-4546-b007-b1dc853b3ccb {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 10:13:28 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-402dc816-7c69-4e26-ac3c-060656b7b35c req-a6b37d9a-80fa-4430-9b4f-0b52cfbad018 service nova] Acquiring lock "cda8c5ad-e70c-4021-bace-d55831c4bc78-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:13:28 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-402dc816-7c69-4e26-ac3c-060656b7b35c req-a6b37d9a-80fa-4430-9b4f-0b52cfbad018 service nova] Lock "cda8c5ad-e70c-4021-bace-d55831c4bc78-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:13:28 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-402dc816-7c69-4e26-ac3c-060656b7b35c req-a6b37d9a-80fa-4430-9b4f-0b52cfbad018 service nova] Lock "cda8c5ad-e70c-4021-bace-d55831c4bc78-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:13:28 user nova-compute[75229]: DEBUG nova.compute.manager [req-402dc816-7c69-4e26-ac3c-060656b7b35c req-a6b37d9a-80fa-4430-9b4f-0b52cfbad018 service nova] [instance: cda8c5ad-e70c-4021-bace-d55831c4bc78] No waiting events found dispatching network-vif-plugged-c88498e8-25f8-4546-b007-b1dc853b3ccb {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 10:13:28 user nova-compute[75229]: WARNING nova.compute.manager [req-402dc816-7c69-4e26-ac3c-060656b7b35c req-a6b37d9a-80fa-4430-9b4f-0b52cfbad018 service nova] [instance: cda8c5ad-e70c-4021-bace-d55831c4bc78] Received unexpected event network-vif-plugged-c88498e8-25f8-4546-b007-b1dc853b3ccb for instance with vm_state deleted and task_state None.
Nov 14 10:13:28 user nova-compute[75229]: DEBUG nova.compute.manager [req-402dc816-7c69-4e26-ac3c-060656b7b35c req-a6b37d9a-80fa-4430-9b4f-0b52cfbad018 service nova] [instance: cda8c5ad-e70c-4021-bace-d55831c4bc78] Received event network-vif-unplugged-c88498e8-25f8-4546-b007-b1dc853b3ccb {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 10:13:28 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-402dc816-7c69-4e26-ac3c-060656b7b35c req-a6b37d9a-80fa-4430-9b4f-0b52cfbad018 service nova] Acquiring lock "cda8c5ad-e70c-4021-bace-d55831c4bc78-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:13:28 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-402dc816-7c69-4e26-ac3c-060656b7b35c req-a6b37d9a-80fa-4430-9b4f-0b52cfbad018 service nova] Lock "cda8c5ad-e70c-4021-bace-d55831c4bc78-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:13:28 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-402dc816-7c69-4e26-ac3c-060656b7b35c req-a6b37d9a-80fa-4430-9b4f-0b52cfbad018 service nova] Lock "cda8c5ad-e70c-4021-bace-d55831c4bc78-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:13:28 user nova-compute[75229]: DEBUG nova.compute.manager [req-402dc816-7c69-4e26-ac3c-060656b7b35c req-a6b37d9a-80fa-4430-9b4f-0b52cfbad018 service nova] [instance: cda8c5ad-e70c-4021-bace-d55831c4bc78] No waiting events found dispatching network-vif-unplugged-c88498e8-25f8-4546-b007-b1dc853b3ccb {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 10:13:28 user nova-compute[75229]: WARNING nova.compute.manager [req-402dc816-7c69-4e26-ac3c-060656b7b35c req-a6b37d9a-80fa-4430-9b4f-0b52cfbad018 service nova] [instance: cda8c5ad-e70c-4021-bace-d55831c4bc78] Received unexpected event network-vif-unplugged-c88498e8-25f8-4546-b007-b1dc853b3ccb for instance with vm_state deleted and task_state None.
Nov 14 10:13:28 user nova-compute[75229]: DEBUG nova.compute.manager [req-402dc816-7c69-4e26-ac3c-060656b7b35c req-a6b37d9a-80fa-4430-9b4f-0b52cfbad018 service nova] [instance: cda8c5ad-e70c-4021-bace-d55831c4bc78] Received event network-vif-plugged-c88498e8-25f8-4546-b007-b1dc853b3ccb {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 10:13:28 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-402dc816-7c69-4e26-ac3c-060656b7b35c req-a6b37d9a-80fa-4430-9b4f-0b52cfbad018 service nova] Acquiring lock "cda8c5ad-e70c-4021-bace-d55831c4bc78-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:13:28 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-402dc816-7c69-4e26-ac3c-060656b7b35c req-a6b37d9a-80fa-4430-9b4f-0b52cfbad018 service nova] Lock "cda8c5ad-e70c-4021-bace-d55831c4bc78-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:13:28 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-402dc816-7c69-4e26-ac3c-060656b7b35c req-a6b37d9a-80fa-4430-9b4f-0b52cfbad018 service nova] Lock "cda8c5ad-e70c-4021-bace-d55831c4bc78-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:13:28 user nova-compute[75229]: DEBUG nova.compute.manager [req-402dc816-7c69-4e26-ac3c-060656b7b35c req-a6b37d9a-80fa-4430-9b4f-0b52cfbad018 service nova] [instance: cda8c5ad-e70c-4021-bace-d55831c4bc78] No waiting events found dispatching network-vif-plugged-c88498e8-25f8-4546-b007-b1dc853b3ccb {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 10:13:28 user nova-compute[75229]: WARNING nova.compute.manager [req-402dc816-7c69-4e26-ac3c-060656b7b35c req-a6b37d9a-80fa-4430-9b4f-0b52cfbad018 service nova] [instance: cda8c5ad-e70c-4021-bace-d55831c4bc78] Received unexpected event network-vif-plugged-c88498e8-25f8-4546-b007-b1dc853b3ccb for instance with vm_state deleted and task_state None.
Nov 14 10:13:28 user nova-compute[75229]: DEBUG nova.compute.manager [req-402dc816-7c69-4e26-ac3c-060656b7b35c req-a6b37d9a-80fa-4430-9b4f-0b52cfbad018 service nova] [instance: cda8c5ad-e70c-4021-bace-d55831c4bc78] Received event network-vif-deleted-c88498e8-25f8-4546-b007-b1dc853b3ccb {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 10:13:31 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:13:36 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 10:13:36 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 10:13:36 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75229) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 10:13:36 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75229) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 10:13:36 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75229) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 10:13:36 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:13:41 user nova-compute[75229]: DEBUG nova.compute.manager [req-db44308b-ba14-4a3f-82eb-f66c2004e23d req-f9addabd-96c3-4042-8368-5847431c91de service nova] [instance: 4a81b779-af09-4026-8387-07d44dad6ef7] Received event network-changed-ca86bdcf-6fe2-4ceb-8e9c-6ff88e9efb71 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 10:13:41 user nova-compute[75229]: DEBUG nova.compute.manager [req-db44308b-ba14-4a3f-82eb-f66c2004e23d req-f9addabd-96c3-4042-8368-5847431c91de service nova] [instance: 4a81b779-af09-4026-8387-07d44dad6ef7] Refreshing instance network info cache due to event network-changed-ca86bdcf-6fe2-4ceb-8e9c-6ff88e9efb71. {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 10:13:41 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-db44308b-ba14-4a3f-82eb-f66c2004e23d req-f9addabd-96c3-4042-8368-5847431c91de service nova] Acquiring lock "refresh_cache-4a81b779-af09-4026-8387-07d44dad6ef7" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 10:13:41 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-db44308b-ba14-4a3f-82eb-f66c2004e23d req-f9addabd-96c3-4042-8368-5847431c91de service nova] Acquired lock "refresh_cache-4a81b779-af09-4026-8387-07d44dad6ef7" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 10:13:41 user nova-compute[75229]: DEBUG nova.network.neutron [req-db44308b-ba14-4a3f-82eb-f66c2004e23d req-f9addabd-96c3-4042-8368-5847431c91de service nova] [instance: 4a81b779-af09-4026-8387-07d44dad6ef7] Refreshing network info cache for port ca86bdcf-6fe2-4ceb-8e9c-6ff88e9efb71 {{(pid=75229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 10:13:41 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-033b0344-531b-4157-8a92-03a987ae4bd9 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Acquiring lock "4a81b779-af09-4026-8387-07d44dad6ef7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:13:41 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-033b0344-531b-4157-8a92-03a987ae4bd9 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Lock "4a81b779-af09-4026-8387-07d44dad6ef7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:13:41 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-033b0344-531b-4157-8a92-03a987ae4bd9 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Acquiring lock "4a81b779-af09-4026-8387-07d44dad6ef7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:13:41 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-033b0344-531b-4157-8a92-03a987ae4bd9 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Lock "4a81b779-af09-4026-8387-07d44dad6ef7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:13:41 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-033b0344-531b-4157-8a92-03a987ae4bd9 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Lock "4a81b779-af09-4026-8387-07d44dad6ef7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:13:41 user nova-compute[75229]: INFO nova.compute.manager [None req-033b0344-531b-4157-8a92-03a987ae4bd9 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] [instance: 4a81b779-af09-4026-8387-07d44dad6ef7] Terminating instance
Nov 14 10:13:41 user nova-compute[75229]: DEBUG nova.compute.manager [None req-033b0344-531b-4157-8a92-03a987ae4bd9 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] [instance: 4a81b779-af09-4026-8387-07d44dad6ef7] Start destroying the instance on the hypervisor. {{(pid=75229) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 10:13:41 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:13:41 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:13:41 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:13:41 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:13:41 user nova-compute[75229]: DEBUG nova.network.neutron [req-db44308b-ba14-4a3f-82eb-f66c2004e23d req-f9addabd-96c3-4042-8368-5847431c91de service nova] [instance: 4a81b779-af09-4026-8387-07d44dad6ef7] Updated VIF entry in instance network info cache for port ca86bdcf-6fe2-4ceb-8e9c-6ff88e9efb71. {{(pid=75229) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 10:13:41 user nova-compute[75229]: DEBUG nova.network.neutron [req-db44308b-ba14-4a3f-82eb-f66c2004e23d req-f9addabd-96c3-4042-8368-5847431c91de service nova] [instance: 4a81b779-af09-4026-8387-07d44dad6ef7] Updating instance_info_cache with network_info: [{"id": "ca86bdcf-6fe2-4ceb-8e9c-6ff88e9efb71", "address": "fa:16:3e:35:44:4b", "network": {"id": "118ea7c1-77c0-4660-b7b7-f311f6b0ec8a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1907578504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46620ac128944703899f22fe5439ba26", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca86bdcf-6f", "ovs_interfaceid": "ca86bdcf-6fe2-4ceb-8e9c-6ff88e9efb71", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 10:13:41 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-db44308b-ba14-4a3f-82eb-f66c2004e23d req-f9addabd-96c3-4042-8368-5847431c91de service nova] Releasing lock "refresh_cache-4a81b779-af09-4026-8387-07d44dad6ef7" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 10:13:42 user nova-compute[75229]: INFO nova.virt.libvirt.driver [-] [instance: 4a81b779-af09-4026-8387-07d44dad6ef7] Instance destroyed successfully.
Nov 14 10:13:42 user nova-compute[75229]: DEBUG nova.objects.instance [None req-033b0344-531b-4157-8a92-03a987ae4bd9 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Lazy-loading 'resources' on Instance uuid 4a81b779-af09-4026-8387-07d44dad6ef7 {{(pid=75229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 10:13:42 user nova-compute[75229]: DEBUG nova.virt.libvirt.vif [None req-033b0344-531b-4157-8a92-03a987ae4bd9 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T10:08:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-531012990',display_name='tempest-TestVolumeBootPattern-server-531012990',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-531012990',id=49,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB5A5mLvKIp6dvI0hO7rO3NlF4G2D20sY7gWEAC+0V/AEyka0aVsvCwYcGQ5KpPpLYwOEY7teK2+b3AO8avbXCe5MdbQ1NPGUWXRV3gtRowACc3Uq7kyXeekLcjWCRcSng==',key_name='tempest-TestVolumeBootPattern-2092695190',keypairs=<?>,launch_index=0,launched_at=2023-11-14T10:09:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='46620ac128944703899f22fe5439ba26',ramdisk_id='',reservation_id='r-4ncvyj02',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-2064993142',owner_user_name='tempest-TestVolumeBootPattern-2064993142-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T10:09:09Z,user_data=None,user_id='c26f33e4cdf14ba796445959953f8685',uuid=4a81b779-af09-4026-8387-07d44dad6ef7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ca86bdcf-6fe2-4ceb-8e9c-6ff88e9efb71", "address": "fa:16:3e:35:44:4b", "network": {"id": "118ea7c1-77c0-4660-b7b7-f311f6b0ec8a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1907578504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46620ac128944703899f22fe5439ba26", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca86bdcf-6f", "ovs_interfaceid": "ca86bdcf-6fe2-4ceb-8e9c-6ff88e9efb71", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 10:13:42 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-033b0344-531b-4157-8a92-03a987ae4bd9 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Converting VIF {"id": "ca86bdcf-6fe2-4ceb-8e9c-6ff88e9efb71", "address": "fa:16:3e:35:44:4b", "network": {"id": "118ea7c1-77c0-4660-b7b7-f311f6b0ec8a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1907578504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46620ac128944703899f22fe5439ba26", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca86bdcf-6f", "ovs_interfaceid": "ca86bdcf-6fe2-4ceb-8e9c-6ff88e9efb71", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 10:13:42 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-033b0344-531b-4157-8a92-03a987ae4bd9 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:35:44:4b,bridge_name='br-int',has_traffic_filtering=True,id=ca86bdcf-6fe2-4ceb-8e9c-6ff88e9efb71,network=Network(118ea7c1-77c0-4660-b7b7-f311f6b0ec8a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapca86bdcf-6f') {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 10:13:42 user nova-compute[75229]: DEBUG os_vif [None req-033b0344-531b-4157-8a92-03a987ae4bd9 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:35:44:4b,bridge_name='br-int',has_traffic_filtering=True,id=ca86bdcf-6fe2-4ceb-8e9c-6ff88e9efb71,network=Network(118ea7c1-77c0-4660-b7b7-f311f6b0ec8a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapca86bdcf-6f') {{(pid=75229) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 10:13:42 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:13:42 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapca86bdcf-6f, bridge=br-int, if_exists=True) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 10:13:42 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:13:42 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 10:13:42 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:13:42 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6e878e7d-55c2-442b-8cc9-0a2682031b99) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 10:13:42 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:13:42 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:13:42 user nova-compute[75229]: INFO os_vif [None req-033b0344-531b-4157-8a92-03a987ae4bd9 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:35:44:4b,bridge_name='br-int',has_traffic_filtering=True,id=ca86bdcf-6fe2-4ceb-8e9c-6ff88e9efb71,network=Network(118ea7c1-77c0-4660-b7b7-f311f6b0ec8a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapca86bdcf-6f')
Nov 14 10:13:42 user nova-compute[75229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-033b0344-531b-4157-8a92-03a987ae4bd9 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] [instance: 4a81b779-af09-4026-8387-07d44dad6ef7] calling os-brick to detach iSCSI Volume {{(pid=75229) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 10:13:42 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-033b0344-531b-4157-8a92-03a987ae4bd9 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f73f85151b0>, {'target_iqn': 'iqn.2010-10.org.openstack:c8892c7d-49e8-4f65-b88c-1e14fba8f50a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pSzmIUvP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 10:13:42 user nova-compute[75229]: WARNING os_brick.initiator.connectors.base [None req-033b0344-531b-4157-8a92-03a987ae4bd9 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 10:13:42 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-033b0344-531b-4157-8a92-03a987ae4bd9 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 10:13:42 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-033b0344-531b-4157-8a92-03a987ae4bd9 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 10:13:42 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:13:42 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:13:42 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bce720e-be7c-4206-8679-7fa88718de48]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:cf6ced86-b04f-4335-b976-fde67102c8e3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c8892c7d-49e8-4f65-b88c-1e14fba8f50a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:13:42 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-033b0344-531b-4157-8a92-03a987ae4bd9 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 10:13:42 user nova-compute[75229]: No targets found.
Nov 14 10:13:42 user nova-compute[75229]: iSNS:
Nov 14 10:13:42 user nova-compute[75229]: No targets found.
Nov 14 10:13:42 user nova-compute[75229]: STATIC:
Nov 14 10:13:42 user nova-compute[75229]: Target: iqn.2010-10.org.openstack:cf6ced86-b04f-4335-b976-fde67102c8e3
Nov 14 10:13:42 user nova-compute[75229]:         Portal: 172.16.0.220:3260,-1
Nov 14 10:13:42 user nova-compute[75229]:                 Iface Name: default
Nov 14 10:13:42 user nova-compute[75229]: Target: iqn.2010-10.org.openstack:c8892c7d-49e8-4f65-b88c-1e14fba8f50a
Nov 14 10:13:42 user nova-compute[75229]:         Portal: 172.16.0.220:3260,-1
Nov 14 10:13:42 user nova-compute[75229]:                 Iface Name: default
Nov 14 10:13:42 user nova-compute[75229]: FIRMWARE:
Nov 14 10:13:42 user nova-compute[75229]: No targets found.
Nov 14 10:13:42 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 10:13:42 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-033b0344-531b-4157-8a92-03a987ae4bd9 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 10:13:42 user nova-compute[75229]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 10:13:42 user nova-compute[75229]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75229) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 10:13:42 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-033b0344-531b-4157-8a92-03a987ae4bd9 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c8892c7d-49e8-4f65-b88c-1e14fba8f50a', 0)] {{(pid=75229) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 10:13:42 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:13:42 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:13:42 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[07639422-3660-45ff-87d7-cf42f0d5e0a1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c8892c7d-49e8-4f65-b88c-1e14fba8f50a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cf6ced86-b04f-4335-b976-fde67102c8e3\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:13:42 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:13:42 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:13:42 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed81f5d0-743f-45da-a9d0-452a898ca6c1]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8892c7d-49e8-4f65-b88c-1e14fba8f50a (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf6ced86-b04f-4335-b976-fde67102c8e3 (non-flash)\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:13:42 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-033b0344-531b-4157-8a92-03a987ae4bd9 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8892c7d-49e8-4f65-b88c-1e14fba8f50a (non-flash)
Nov 14 10:13:42 user nova-compute[75229]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf6ced86-b04f-4335-b976-fde67102c8e3 (non-flash)
Nov 14 10:13:42 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 10:13:42 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-033b0344-531b-4157-8a92-03a987ae4bd9 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8892c7d-49e8-4f65-b88c-1e14fba8f50a (non-flash)
Nov 14 10:13:42 user nova-compute[75229]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf6ced86-b04f-4335-b976-fde67102c8e3 (non-flash)
Nov 14 10:13:42 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 10:13:42 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-033b0344-531b-4157-8a92-03a987ae4bd9 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f73d4ee2830>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c8892c7d-49e8-4f65-b88c-1e14fba8f50a'): ({'sde'}, set())}) {{(pid=75229) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 10:13:42 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-033b0344-531b-4157-8a92-03a987ae4bd9 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Removing single pathed devices sde {{(pid=75229) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 10:13:42 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:13:42 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.027s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:13:42 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[5eaff0cb-bfa2-4375-ae91-818bcdd49817]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:13:42 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:13:42 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:13:42 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[0309aa91-864d-4d21-972b-25a29dc5dc31]: (4, ('ok\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:13:42 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-033b0344-531b-4157-8a92-03a987ae4bd9 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Flushing IO for device /dev/sde {{(pid=75229) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 10:13:42 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:13:42 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:13:42 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[1190e48f-e619-408e-9b36-27adcd7580df]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:13:42 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-033b0344-531b-4157-8a92-03a987ae4bd9 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75229) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 10:13:42 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:13:42 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.051s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:13:42 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[186054d2-bb65-4637-a79a-a970f704eed6]: (4, ('1', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:13:42 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-033b0344-531b-4157-8a92-03a987ae4bd9 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75229) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 10:13:42 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-033b0344-531b-4157-8a92-03a987ae4bd9 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] SCSI volumes sde have been removed. {{(pid=75229) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 10:13:42 user nova-compute[75229]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23534373037373930', '/dev/disk/by-id/scsi-1SCST_BIO7cfcb0a5-54707790c24e763d', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_7cfcb0a5') {{(pid=86458) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 14 10:13:42 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1fef635-f498-4159-83d5-67235a1fd552]: (4, None) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:13:42 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-033b0344-531b-4157-8a92-03a987ae4bd9 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c8892c7d-49e8-4f65-b88c-1e14fba8f50a')] {{(pid=75229) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 10:13:42 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c8892c7d-49e8-4f65-b88c-1e14fba8f50a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:13:42 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c8892c7d-49e8-4f65-b88c-1e14fba8f50a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:13:42 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9f9b6e6-d1d8-42b4-98ed-ecd9d5a44a47]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:13:42 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-033b0344-531b-4157-8a92-03a987ae4bd9 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 10:13:42 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c8892c7d-49e8-4f65-b88c-1e14fba8f50a -p 172.16.0.220:3260 --logout {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:13:42 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c8892c7d-49e8-4f65-b88c-1e14fba8f50a -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:13:42 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd55af12-d366-4886-8305-e23e52da6f4d]: (4, ('Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:c8892c7d-49e8-4f65-b88c-1e14fba8f50a, portal: 172.16.0.220,3260]\nLogout of [sid: 52, target: iqn.2010-10.org.openstack:c8892c7d-49e8-4f65-b88c-1e14fba8f50a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:13:42 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-033b0344-531b-4157-8a92-03a987ae4bd9 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:c8892c7d-49e8-4f65-b88c-1e14fba8f50a, portal: 172.16.0.220,3260]
Nov 14 10:13:42 user nova-compute[75229]: Logout of [sid: 52, target: iqn.2010-10.org.openstack:c8892c7d-49e8-4f65-b88c-1e14fba8f50a, portal: 172.16.0.220,3260] successful.
Nov 14 10:13:42 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 10:13:42 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c8892c7d-49e8-4f65-b88c-1e14fba8f50a -p 172.16.0.220:3260 --op delete {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:13:42 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c8892c7d-49e8-4f65-b88c-1e14fba8f50a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:13:42 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a0be3d9-5c9c-4f3e-9e98-3b3295539573]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:13:42 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-033b0344-531b-4157-8a92-03a987ae4bd9 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 10:13:42 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-033b0344-531b-4157-8a92-03a987ae4bd9 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.317s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 10:13:42 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-033b0344-531b-4157-8a92-03a987ae4bd9 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] <== disconnect_volume: return (318ms) None {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 10:13:42 user nova-compute[75229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-033b0344-531b-4157-8a92-03a987ae4bd9 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] [instance: 4a81b779-af09-4026-8387-07d44dad6ef7] Disconnected iSCSI Volume {{(pid=75229) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 10:13:42 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-033b0344-531b-4157-8a92-03a987ae4bd9 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] [instance: 4a81b779-af09-4026-8387-07d44dad6ef7] Deleting instance files /opt/stack/data/nova/instances/4a81b779-af09-4026-8387-07d44dad6ef7_del
Nov 14 10:13:42 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-033b0344-531b-4157-8a92-03a987ae4bd9 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] [instance: 4a81b779-af09-4026-8387-07d44dad6ef7] Deletion of /opt/stack/data/nova/instances/4a81b779-af09-4026-8387-07d44dad6ef7_del complete
Nov 14 10:13:42 user nova-compute[75229]: INFO nova.compute.manager [None req-033b0344-531b-4157-8a92-03a987ae4bd9 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] [instance: 4a81b779-af09-4026-8387-07d44dad6ef7] Took 1.16 seconds to destroy the instance on the hypervisor.
Nov 14 10:13:42 user nova-compute[75229]: DEBUG oslo.service.loopingcall [None req-033b0344-531b-4157-8a92-03a987ae4bd9 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75229) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 10:13:42 user nova-compute[75229]: DEBUG nova.compute.manager [-] [instance: 4a81b779-af09-4026-8387-07d44dad6ef7] Deallocating network for instance {{(pid=75229) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 10:13:42 user nova-compute[75229]: DEBUG nova.network.neutron [-] [instance: 4a81b779-af09-4026-8387-07d44dad6ef7] deallocate_for_instance() {{(pid=75229) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 10:13:43 user nova-compute[75229]: DEBUG nova.network.neutron [-] [instance: 4a81b779-af09-4026-8387-07d44dad6ef7] Updating instance_info_cache with network_info: [] {{(pid=75229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 10:13:43 user nova-compute[75229]: INFO nova.compute.manager [-] [instance: 4a81b779-af09-4026-8387-07d44dad6ef7] Took 0.41 seconds to deallocate network for instance.
Nov 14 10:13:43 user nova-compute[75229]: DEBUG nova.compute.manager [req-7c2e4596-6590-41da-9b7b-042241103e94 req-ec6fb46f-017c-4a89-b681-087161121bf0 service nova] [instance: 4a81b779-af09-4026-8387-07d44dad6ef7] Received event network-vif-deleted-ca86bdcf-6fe2-4ceb-8e9c-6ff88e9efb71 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 10:13:43 user nova-compute[75229]: DEBUG nova.compute.manager [req-e4732518-49e0-40ab-993e-0fefa8f9e3e1 req-8d55cc05-51f5-4385-a9c5-de48ae6464d2 service nova] [instance: 4a81b779-af09-4026-8387-07d44dad6ef7] Received event network-vif-unplugged-ca86bdcf-6fe2-4ceb-8e9c-6ff88e9efb71 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 10:13:43 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-e4732518-49e0-40ab-993e-0fefa8f9e3e1 req-8d55cc05-51f5-4385-a9c5-de48ae6464d2 service nova] Acquiring lock "4a81b779-af09-4026-8387-07d44dad6ef7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:13:43 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-e4732518-49e0-40ab-993e-0fefa8f9e3e1 req-8d55cc05-51f5-4385-a9c5-de48ae6464d2 service nova] Lock "4a81b779-af09-4026-8387-07d44dad6ef7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:13:43 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-e4732518-49e0-40ab-993e-0fefa8f9e3e1 req-8d55cc05-51f5-4385-a9c5-de48ae6464d2 service nova] Lock "4a81b779-af09-4026-8387-07d44dad6ef7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:13:43 user nova-compute[75229]: DEBUG nova.compute.manager [req-e4732518-49e0-40ab-993e-0fefa8f9e3e1 req-8d55cc05-51f5-4385-a9c5-de48ae6464d2 service nova] [instance: 4a81b779-af09-4026-8387-07d44dad6ef7] No waiting events found dispatching network-vif-unplugged-ca86bdcf-6fe2-4ceb-8e9c-6ff88e9efb71 {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 10:13:43 user nova-compute[75229]: DEBUG nova.compute.manager [req-e4732518-49e0-40ab-993e-0fefa8f9e3e1 req-8d55cc05-51f5-4385-a9c5-de48ae6464d2 service nova] [instance: 4a81b779-af09-4026-8387-07d44dad6ef7] Received event network-vif-unplugged-ca86bdcf-6fe2-4ceb-8e9c-6ff88e9efb71 for instance with task_state deleting. {{(pid=75229) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 10:13:43 user nova-compute[75229]: DEBUG nova.compute.manager [req-e4732518-49e0-40ab-993e-0fefa8f9e3e1 req-8d55cc05-51f5-4385-a9c5-de48ae6464d2 service nova] [instance: 4a81b779-af09-4026-8387-07d44dad6ef7] Received event network-vif-plugged-ca86bdcf-6fe2-4ceb-8e9c-6ff88e9efb71 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 10:13:43 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-e4732518-49e0-40ab-993e-0fefa8f9e3e1 req-8d55cc05-51f5-4385-a9c5-de48ae6464d2 service nova] Acquiring lock "4a81b779-af09-4026-8387-07d44dad6ef7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:13:43 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-e4732518-49e0-40ab-993e-0fefa8f9e3e1 req-8d55cc05-51f5-4385-a9c5-de48ae6464d2 service nova] Lock "4a81b779-af09-4026-8387-07d44dad6ef7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:13:43 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-e4732518-49e0-40ab-993e-0fefa8f9e3e1 req-8d55cc05-51f5-4385-a9c5-de48ae6464d2 service nova] Lock "4a81b779-af09-4026-8387-07d44dad6ef7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:13:43 user nova-compute[75229]: DEBUG nova.compute.manager [req-e4732518-49e0-40ab-993e-0fefa8f9e3e1 req-8d55cc05-51f5-4385-a9c5-de48ae6464d2 service nova] [instance: 4a81b779-af09-4026-8387-07d44dad6ef7] No waiting events found dispatching network-vif-plugged-ca86bdcf-6fe2-4ceb-8e9c-6ff88e9efb71 {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 10:13:43 user nova-compute[75229]: WARNING nova.compute.manager [req-e4732518-49e0-40ab-993e-0fefa8f9e3e1 req-8d55cc05-51f5-4385-a9c5-de48ae6464d2 service nova] [instance: 4a81b779-af09-4026-8387-07d44dad6ef7] Received unexpected event network-vif-plugged-ca86bdcf-6fe2-4ceb-8e9c-6ff88e9efb71 for instance with vm_state active and task_state deleting.
Nov 14 10:13:43 user nova-compute[75229]: INFO nova.compute.manager [None req-033b0344-531b-4157-8a92-03a987ae4bd9 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] [instance: 4a81b779-af09-4026-8387-07d44dad6ef7] Took 0.69 seconds to detach 1 volumes for instance.
Nov 14 10:13:43 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-033b0344-531b-4157-8a92-03a987ae4bd9 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:13:43 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-033b0344-531b-4157-8a92-03a987ae4bd9 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:13:43 user nova-compute[75229]: DEBUG nova.compute.provider_tree [None req-033b0344-531b-4157-8a92-03a987ae4bd9 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Inventory has not changed in ProviderTree for provider: d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 {{(pid=75229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 10:13:43 user nova-compute[75229]: DEBUG nova.scheduler.client.report [None req-033b0344-531b-4157-8a92-03a987ae4bd9 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Inventory has not changed for provider d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 10:13:43 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-033b0344-531b-4157-8a92-03a987ae4bd9 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.130s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:13:43 user nova-compute[75229]: INFO nova.scheduler.client.report [None req-033b0344-531b-4157-8a92-03a987ae4bd9 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Deleted allocations for instance 4a81b779-af09-4026-8387-07d44dad6ef7
Nov 14 10:13:44 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-033b0344-531b-4157-8a92-03a987ae4bd9 tempest-TestVolumeBootPattern-2064993142 tempest-TestVolumeBootPattern-2064993142-project-member] Lock "4a81b779-af09-4026-8387-07d44dad6ef7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.562s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:13:47 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:13:52 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:13:57 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 10:14:02 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 10:14:03 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:14:06 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:14:06 user nova-compute[75229]: DEBUG nova.compute.manager [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Starting heal instance info cache {{(pid=75229) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 10:14:06 user nova-compute[75229]: DEBUG nova.compute.manager [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Rebuilding the list of instances to heal {{(pid=75229) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 10:14:06 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Acquiring lock "refresh_cache-68d9de39-cbd2-44b2-bda8-015c8482c240" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 10:14:06 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Acquired lock "refresh_cache-68d9de39-cbd2-44b2-bda8-015c8482c240" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 10:14:06 user nova-compute[75229]: DEBUG nova.network.neutron [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] [instance: 68d9de39-cbd2-44b2-bda8-015c8482c240] Forcefully refreshing network info cache for instance {{(pid=75229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 10:14:06 user nova-compute[75229]: DEBUG nova.objects.instance [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Lazy-loading 'info_cache' on Instance uuid 68d9de39-cbd2-44b2-bda8-015c8482c240 {{(pid=75229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 10:14:07 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:14:07 user nova-compute[75229]: DEBUG nova.network.neutron [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] [instance: 68d9de39-cbd2-44b2-bda8-015c8482c240] Updating instance_info_cache with network_info: [{"id": "e62b2a49-c9cc-4568-b887-1c7884830ac2", "address": "fa:16:3e:f6:c6:5e", "network": {"id": "13b12b7e-2548-4256-8fb8-fccc67b1e18b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-698342503-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.41", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be7eb95aea3e4897acbc9fe03aadb8e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape62b2a49-c9", "ovs_interfaceid": "e62b2a49-c9cc-4568-b887-1c7884830ac2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 10:14:07 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Releasing lock "refresh_cache-68d9de39-cbd2-44b2-bda8-015c8482c240" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 10:14:07 user nova-compute[75229]: DEBUG nova.compute.manager [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] [instance: 68d9de39-cbd2-44b2-bda8-015c8482c240] Updated the network info_cache for instance {{(pid=75229) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 10:14:12 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:14:12 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:14:13 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:14:13 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:14:13 user nova-compute[75229]: DEBUG nova.compute.manager [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75229) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 10:14:15 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:14:15 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:14:15 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:14:15 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:14:15 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:14:15 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:14:15 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Auditing locally available compute resources for user (node: user) {{(pid=75229) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 10:14:15 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68d9de39-cbd2-44b2-bda8-015c8482c240/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:14:16 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68d9de39-cbd2-44b2-bda8-015c8482c240/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:14:16 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68d9de39-cbd2-44b2-bda8-015c8482c240/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:14:16 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68d9de39-cbd2-44b2-bda8-015c8482c240/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:14:16 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75229) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 10:14:16 user nova-compute[75229]: WARNING nova.virt.libvirt.driver [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 10:14:16 user nova-compute[75229]: WARNING nova.virt.libvirt.driver [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 10:14:16 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Hypervisor/Node resource view: name=user free_ram=8944MB free_disk=25.172706604003906GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75229) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 10:14:16 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:14:16 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:14:16 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Instance 68d9de39-cbd2-44b2-bda8-015c8482c240 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 10:14:16 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75229) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 10:14:16 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75229) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 10:14:16 user nova-compute[75229]: DEBUG nova.compute.provider_tree [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Inventory has not changed in ProviderTree for provider: d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 {{(pid=75229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 10:14:16 user nova-compute[75229]: DEBUG nova.scheduler.client.report [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Inventory has not changed for provider d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 10:14:16 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Compute_service record updated for user:user {{(pid=75229) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 10:14:16 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.197s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:14:17 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:14:17 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:14:19 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:14:21 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:14:22 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:14:27 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 10:14:27 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:14:27 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75229) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 10:14:27 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75229) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 10:14:27 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75229) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 10:14:27 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:14:28 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-52bf462b-20c9-48da-bfb9-f868838ed187 tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Acquiring lock "68d9de39-cbd2-44b2-bda8-015c8482c240" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:14:28 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-52bf462b-20c9-48da-bfb9-f868838ed187 tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Lock "68d9de39-cbd2-44b2-bda8-015c8482c240" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:14:28 user nova-compute[75229]: INFO nova.compute.manager [None req-52bf462b-20c9-48da-bfb9-f868838ed187 tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] [instance: 68d9de39-cbd2-44b2-bda8-015c8482c240] Detaching volume cf6ced86-b04f-4335-b976-fde67102c8e3
Nov 14 10:14:28 user nova-compute[75229]: INFO nova.virt.block_device [None req-52bf462b-20c9-48da-bfb9-f868838ed187 tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] [instance: 68d9de39-cbd2-44b2-bda8-015c8482c240] Attempting to driver detach volume cf6ced86-b04f-4335-b976-fde67102c8e3 from mountpoint /dev/vdb
Nov 14 10:14:28 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-52bf462b-20c9-48da-bfb9-f868838ed187 tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Attempting to detach device vdb from instance 68d9de39-cbd2-44b2-bda8-015c8482c240 from the persistent domain config. {{(pid=75229) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 10:14:28 user nova-compute[75229]: DEBUG nova.virt.libvirt.guest [None req-52bf462b-20c9-48da-bfb9-f868838ed187 tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 10:14:28 user nova-compute[75229]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 10:14:28 user nova-compute[75229]:   <source dev="/dev/sdb"/>
Nov 14 10:14:28 user nova-compute[75229]:   <target dev="vdb" bus="virtio"/>
Nov 14 10:14:28 user nova-compute[75229]:   <serial>cf6ced86-b04f-4335-b976-fde67102c8e3</serial>
Nov 14 10:14:28 user nova-compute[75229]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 14 10:14:28 user nova-compute[75229]: </disk>
Nov 14 10:14:28 user nova-compute[75229]:  {{(pid=75229) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 10:14:28 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-52bf462b-20c9-48da-bfb9-f868838ed187 tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Successfully detached device vdb from instance 68d9de39-cbd2-44b2-bda8-015c8482c240 from the persistent domain config.
Nov 14 10:14:28 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-52bf462b-20c9-48da-bfb9-f868838ed187 tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 68d9de39-cbd2-44b2-bda8-015c8482c240 from the live domain config. {{(pid=75229) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 10:14:28 user nova-compute[75229]: DEBUG nova.virt.libvirt.guest [None req-52bf462b-20c9-48da-bfb9-f868838ed187 tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 10:14:28 user nova-compute[75229]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 10:14:28 user nova-compute[75229]:   <source dev="/dev/sdb"/>
Nov 14 10:14:28 user nova-compute[75229]:   <target dev="vdb" bus="virtio"/>
Nov 14 10:14:28 user nova-compute[75229]:   <serial>cf6ced86-b04f-4335-b976-fde67102c8e3</serial>
Nov 14 10:14:28 user nova-compute[75229]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 14 10:14:28 user nova-compute[75229]: </disk>
Nov 14 10:14:28 user nova-compute[75229]:  {{(pid=75229) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 10:14:29 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:14:29 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-52bf462b-20c9-48da-bfb9-f868838ed187 tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 68d9de39-cbd2-44b2-bda8-015c8482c240 {{(pid=75229) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 10:14:32 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:14:32 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:14:36 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:14:37 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:14:39 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:14:42 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:14:47 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 10:14:49 user nova-compute[75229]: WARNING nova.virt.libvirt.driver [None req-52bf462b-20c9-48da-bfb9-f868838ed187 tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 68d9de39-cbd2-44b2-bda8-015c8482c240 is timed out.
Nov 14 10:14:49 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-52bf462b-20c9-48da-bfb9-f868838ed187 tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Successfully detached device vdb from instance 68d9de39-cbd2-44b2-bda8-015c8482c240 from the live domain config.
Nov 14 10:14:49 user nova-compute[75229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-52bf462b-20c9-48da-bfb9-f868838ed187 tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] [instance: 68d9de39-cbd2-44b2-bda8-015c8482c240] calling os-brick to detach iSCSI Volume {{(pid=75229) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 10:14:49 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-52bf462b-20c9-48da-bfb9-f868838ed187 tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f73f85151b0>, {'target_iqn': 'iqn.2010-10.org.openstack:cf6ced86-b04f-4335-b976-fde67102c8e3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ELsaSRyt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 10:14:49 user nova-compute[75229]: WARNING os_brick.initiator.connectors.base [None req-52bf462b-20c9-48da-bfb9-f868838ed187 tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 10:14:49 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-52bf462b-20c9-48da-bfb9-f868838ed187 tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 10:14:49 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-52bf462b-20c9-48da-bfb9-f868838ed187 tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 10:14:49 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:14:49 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:14:49 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[6900d8be-5a23-4f1f-9bb2-44224ab88387]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:cf6ced86-b04f-4335-b976-fde67102c8e3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:14:49 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-52bf462b-20c9-48da-bfb9-f868838ed187 tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 10:14:49 user nova-compute[75229]: No targets found.
Nov 14 10:14:49 user nova-compute[75229]: iSNS:
Nov 14 10:14:49 user nova-compute[75229]: No targets found.
Nov 14 10:14:49 user nova-compute[75229]: STATIC:
Nov 14 10:14:49 user nova-compute[75229]: Target: iqn.2010-10.org.openstack:cf6ced86-b04f-4335-b976-fde67102c8e3
Nov 14 10:14:49 user nova-compute[75229]:         Portal: 172.16.0.220:3260,-1
Nov 14 10:14:49 user nova-compute[75229]:                 Iface Name: default
Nov 14 10:14:49 user nova-compute[75229]: FIRMWARE:
Nov 14 10:14:49 user nova-compute[75229]: No targets found.
Nov 14 10:14:49 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 10:14:49 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-52bf462b-20c9-48da-bfb9-f868838ed187 tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 10:14:49 user nova-compute[75229]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 10:14:49 user nova-compute[75229]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75229) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 10:14:49 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-52bf462b-20c9-48da-bfb9-f868838ed187 tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cf6ced86-b04f-4335-b976-fde67102c8e3', 0)] {{(pid=75229) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 10:14:49 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:14:49 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.030s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:14:49 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ca5a6b6-7468-4a82-8b84-79ca6551ba2c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cf6ced86-b04f-4335-b976-fde67102c8e3\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:14:49 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:14:49 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:14:49 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[c055bee3-0bd6-42d1-ba36-939439d04a6c]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf6ced86-b04f-4335-b976-fde67102c8e3 (non-flash)\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:14:49 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-52bf462b-20c9-48da-bfb9-f868838ed187 tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf6ced86-b04f-4335-b976-fde67102c8e3 (non-flash)
Nov 14 10:14:49 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 10:14:49 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-52bf462b-20c9-48da-bfb9-f868838ed187 tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf6ced86-b04f-4335-b976-fde67102c8e3 (non-flash)
Nov 14 10:14:49 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 10:14:49 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-52bf462b-20c9-48da-bfb9-f868838ed187 tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f73d4ee3250>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cf6ced86-b04f-4335-b976-fde67102c8e3'): ({'sdb'}, set())}) {{(pid=75229) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 10:14:49 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-52bf462b-20c9-48da-bfb9-f868838ed187 tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Removing single pathed devices sdb {{(pid=75229) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 10:14:49 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:14:49 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:14:49 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e12aaa8-78c4-4374-8082-ee4d1c6c9119]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:14:49 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:14:49 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:14:49 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[0addb9d3-3f59-4846-bd77-fe0febea1336]: (4, ('ok\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:14:49 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-52bf462b-20c9-48da-bfb9-f868838ed187 tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Flushing IO for device /dev/sdb {{(pid=75229) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 10:14:49 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:14:49 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:14:49 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[3176c9c7-6546-4ce1-aa06-ef7e9cfc6cf8]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:14:49 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-52bf462b-20c9-48da-bfb9-f868838ed187 tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75229) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 10:14:49 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:14:49 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.047s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:14:49 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c7c205d-cde4-4d92-9030-f5f2e84f803d]: (4, ('1', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:14:49 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-52bf462b-20c9-48da-bfb9-f868838ed187 tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75229) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 10:14:49 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-52bf462b-20c9-48da-bfb9-f868838ed187 tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] SCSI volumes sdb have been removed. {{(pid=75229) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 10:14:49 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-52bf462b-20c9-48da-bfb9-f868838ed187 tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cf6ced86-b04f-4335-b976-fde67102c8e3')] {{(pid=75229) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 10:14:49 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf6ced86-b04f-4335-b976-fde67102c8e3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:14:49 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf6ced86-b04f-4335-b976-fde67102c8e3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:14:49 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[668e1aa3-5804-4ccd-9c92-b181e700dc89]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:14:49 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-52bf462b-20c9-48da-bfb9-f868838ed187 tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 10:14:49 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf6ced86-b04f-4335-b976-fde67102c8e3 -p 172.16.0.220:3260 --logout {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:14:49 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf6ced86-b04f-4335-b976-fde67102c8e3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.047s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:14:49 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d09108d-026c-4f3f-99ed-1256f6ec0ab1]: (4, ('Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:cf6ced86-b04f-4335-b976-fde67102c8e3, portal: 172.16.0.220,3260]\nLogout of [sid: 55, target: iqn.2010-10.org.openstack:cf6ced86-b04f-4335-b976-fde67102c8e3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:14:49 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-52bf462b-20c9-48da-bfb9-f868838ed187 tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:cf6ced86-b04f-4335-b976-fde67102c8e3, portal: 172.16.0.220,3260]
Nov 14 10:14:49 user nova-compute[75229]: Logout of [sid: 55, target: iqn.2010-10.org.openstack:cf6ced86-b04f-4335-b976-fde67102c8e3, portal: 172.16.0.220,3260] successful.
Nov 14 10:14:49 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 10:14:49 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf6ced86-b04f-4335-b976-fde67102c8e3 -p 172.16.0.220:3260 --op delete {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:14:49 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf6ced86-b04f-4335-b976-fde67102c8e3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:14:49 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[a899333f-47b2-454c-9813-4d95c8a0ea92]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:14:49 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-52bf462b-20c9-48da-bfb9-f868838ed187 tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 10:14:49 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-52bf462b-20c9-48da-bfb9-f868838ed187 tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.295s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 10:14:49 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-52bf462b-20c9-48da-bfb9-f868838ed187 tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] <== disconnect_volume: return (297ms) None {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 10:14:49 user nova-compute[75229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-52bf462b-20c9-48da-bfb9-f868838ed187 tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] [instance: 68d9de39-cbd2-44b2-bda8-015c8482c240] Disconnected iSCSI Volume {{(pid=75229) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 10:14:50 user nova-compute[75229]: DEBUG nova.objects.instance [None req-52bf462b-20c9-48da-bfb9-f868838ed187 tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Lazy-loading 'flavor' on Instance uuid 68d9de39-cbd2-44b2-bda8-015c8482c240 {{(pid=75229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 10:14:50 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-52bf462b-20c9-48da-bfb9-f868838ed187 tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Lock "68d9de39-cbd2-44b2-bda8-015c8482c240" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.755s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:14:51 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-2da8020c-b5f4-432b-8dff-6a972497cb6e tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Acquiring lock "68d9de39-cbd2-44b2-bda8-015c8482c240" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:14:51 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-2da8020c-b5f4-432b-8dff-6a972497cb6e tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Lock "68d9de39-cbd2-44b2-bda8-015c8482c240" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:14:51 user nova-compute[75229]: DEBUG nova.compute.manager [None req-2da8020c-b5f4-432b-8dff-6a972497cb6e tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] [instance: 68d9de39-cbd2-44b2-bda8-015c8482c240] Checking state {{(pid=75229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 10:14:51 user nova-compute[75229]: DEBUG nova.compute.manager [None req-2da8020c-b5f4-432b-8dff-6a972497cb6e tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] [instance: 68d9de39-cbd2-44b2-bda8-015c8482c240] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=75229) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3358}}
Nov 14 10:14:51 user nova-compute[75229]: DEBUG nova.objects.instance [None req-2da8020c-b5f4-432b-8dff-6a972497cb6e tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Lazy-loading 'flavor' on Instance uuid 68d9de39-cbd2-44b2-bda8-015c8482c240 {{(pid=75229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 10:14:51 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:14:51 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:14:51 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:14:51 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:14:51 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:14:51 user nova-compute[75229]: DEBUG nova.compute.manager [req-e34c7278-6768-43a5-9b63-00303eae0ab8 req-12cfd568-69a8-415f-89f1-f6bdbf3057e1 service nova] [instance: 68d9de39-cbd2-44b2-bda8-015c8482c240] Received event network-vif-unplugged-e62b2a49-c9cc-4568-b887-1c7884830ac2 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 10:14:51 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-e34c7278-6768-43a5-9b63-00303eae0ab8 req-12cfd568-69a8-415f-89f1-f6bdbf3057e1 service nova] Acquiring lock "68d9de39-cbd2-44b2-bda8-015c8482c240-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:14:51 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-e34c7278-6768-43a5-9b63-00303eae0ab8 req-12cfd568-69a8-415f-89f1-f6bdbf3057e1 service nova] Lock "68d9de39-cbd2-44b2-bda8-015c8482c240-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:14:51 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-e34c7278-6768-43a5-9b63-00303eae0ab8 req-12cfd568-69a8-415f-89f1-f6bdbf3057e1 service nova] Lock "68d9de39-cbd2-44b2-bda8-015c8482c240-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:14:51 user nova-compute[75229]: DEBUG nova.compute.manager [req-e34c7278-6768-43a5-9b63-00303eae0ab8 req-12cfd568-69a8-415f-89f1-f6bdbf3057e1 service nova] [instance: 68d9de39-cbd2-44b2-bda8-015c8482c240] No waiting events found dispatching network-vif-unplugged-e62b2a49-c9cc-4568-b887-1c7884830ac2 {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 10:14:51 user nova-compute[75229]: WARNING nova.compute.manager [req-e34c7278-6768-43a5-9b63-00303eae0ab8 req-12cfd568-69a8-415f-89f1-f6bdbf3057e1 service nova] [instance: 68d9de39-cbd2-44b2-bda8-015c8482c240] Received unexpected event network-vif-unplugged-e62b2a49-c9cc-4568-b887-1c7884830ac2 for instance with vm_state active and task_state powering-off.
Nov 14 10:14:52 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:14:52 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:14:52 user nova-compute[75229]: INFO nova.virt.libvirt.driver [-] [instance: 68d9de39-cbd2-44b2-bda8-015c8482c240] Instance destroyed successfully.
Nov 14 10:14:52 user nova-compute[75229]: DEBUG nova.compute.manager [None req-2da8020c-b5f4-432b-8dff-6a972497cb6e tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] [instance: 68d9de39-cbd2-44b2-bda8-015c8482c240] Checking state {{(pid=75229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 10:14:52 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-2da8020c-b5f4-432b-8dff-6a972497cb6e tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Lock "68d9de39-cbd2-44b2-bda8-015c8482c240" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.857s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:14:52 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:14:53 user nova-compute[75229]: DEBUG nova.compute.manager [req-3c0be9ad-e31c-4e97-b488-b45d82d6b27b req-d80af4a0-1f60-4cc8-b4f8-66440971e6cc service nova] [instance: 68d9de39-cbd2-44b2-bda8-015c8482c240] Received event network-vif-plugged-e62b2a49-c9cc-4568-b887-1c7884830ac2 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 10:14:53 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-3c0be9ad-e31c-4e97-b488-b45d82d6b27b req-d80af4a0-1f60-4cc8-b4f8-66440971e6cc service nova] Acquiring lock "68d9de39-cbd2-44b2-bda8-015c8482c240-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:14:53 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-3c0be9ad-e31c-4e97-b488-b45d82d6b27b req-d80af4a0-1f60-4cc8-b4f8-66440971e6cc service nova] Lock "68d9de39-cbd2-44b2-bda8-015c8482c240-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:14:53 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-3c0be9ad-e31c-4e97-b488-b45d82d6b27b req-d80af4a0-1f60-4cc8-b4f8-66440971e6cc service nova] Lock "68d9de39-cbd2-44b2-bda8-015c8482c240-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:14:53 user nova-compute[75229]: DEBUG nova.compute.manager [req-3c0be9ad-e31c-4e97-b488-b45d82d6b27b req-d80af4a0-1f60-4cc8-b4f8-66440971e6cc service nova] [instance: 68d9de39-cbd2-44b2-bda8-015c8482c240] No waiting events found dispatching network-vif-plugged-e62b2a49-c9cc-4568-b887-1c7884830ac2 {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 10:14:53 user nova-compute[75229]: WARNING nova.compute.manager [req-3c0be9ad-e31c-4e97-b488-b45d82d6b27b req-d80af4a0-1f60-4cc8-b4f8-66440971e6cc service nova] [instance: 68d9de39-cbd2-44b2-bda8-015c8482c240] Received unexpected event network-vif-plugged-e62b2a49-c9cc-4568-b887-1c7884830ac2 for instance with vm_state stopped and task_state None.
Nov 14 10:14:57 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 10:14:57 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:14:57 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75229) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 10:14:57 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75229) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 10:14:57 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75229) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 10:14:57 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:15:02 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:15:05 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:15:07 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 10:15:07 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:15:07 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75229) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 10:15:07 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75229) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 10:15:07 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75229) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 10:15:07 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:15:07 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:15:07 user nova-compute[75229]: DEBUG nova.compute.manager [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Starting heal instance info cache {{(pid=75229) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 10:15:07 user nova-compute[75229]: DEBUG nova.compute.manager [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Rebuilding the list of instances to heal {{(pid=75229) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 10:15:07 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Acquiring lock "refresh_cache-68d9de39-cbd2-44b2-bda8-015c8482c240" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 10:15:07 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Acquired lock "refresh_cache-68d9de39-cbd2-44b2-bda8-015c8482c240" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 10:15:07 user nova-compute[75229]: DEBUG nova.network.neutron [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] [instance: 68d9de39-cbd2-44b2-bda8-015c8482c240] Forcefully refreshing network info cache for instance {{(pid=75229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 10:15:07 user nova-compute[75229]: DEBUG nova.objects.instance [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Lazy-loading 'info_cache' on Instance uuid 68d9de39-cbd2-44b2-bda8-015c8482c240 {{(pid=75229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 10:15:08 user nova-compute[75229]: DEBUG nova.network.neutron [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] [instance: 68d9de39-cbd2-44b2-bda8-015c8482c240] Updating instance_info_cache with network_info: [{"id": "e62b2a49-c9cc-4568-b887-1c7884830ac2", "address": "fa:16:3e:f6:c6:5e", "network": {"id": "13b12b7e-2548-4256-8fb8-fccc67b1e18b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-698342503-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.41", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be7eb95aea3e4897acbc9fe03aadb8e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape62b2a49-c9", "ovs_interfaceid": "e62b2a49-c9cc-4568-b887-1c7884830ac2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 10:15:08 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Releasing lock "refresh_cache-68d9de39-cbd2-44b2-bda8-015c8482c240" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 10:15:08 user nova-compute[75229]: DEBUG nova.compute.manager [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] [instance: 68d9de39-cbd2-44b2-bda8-015c8482c240] Updated the network info_cache for instance {{(pid=75229) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 10:15:12 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 10:15:13 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:15:14 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:15:14 user nova-compute[75229]: DEBUG nova.compute.manager [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75229) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 10:15:14 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:15:14 user nova-compute[75229]: DEBUG nova.compute.manager [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Cleaning up deleted instances {{(pid=75229) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 14 10:15:14 user nova-compute[75229]: DEBUG nova.compute.manager [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] There are 0 instances to clean {{(pid=75229) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 14 10:15:15 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:15:15 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:15:16 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:15:17 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:15:17 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:15:17 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:15:17 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:15:17 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:15:17 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Auditing locally available compute resources for user (node: user) {{(pid=75229) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 10:15:17 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68d9de39-cbd2-44b2-bda8-015c8482c240/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:15:18 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68d9de39-cbd2-44b2-bda8-015c8482c240/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:15:18 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68d9de39-cbd2-44b2-bda8-015c8482c240/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:15:18 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68d9de39-cbd2-44b2-bda8-015c8482c240/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:15:18 user nova-compute[75229]: WARNING nova.virt.libvirt.driver [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 10:15:18 user nova-compute[75229]: WARNING nova.virt.libvirt.driver [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 10:15:18 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Hypervisor/Node resource view: name=user free_ram=9122MB free_disk=25.169960021972656GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75229) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 10:15:18 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:15:18 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:15:18 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Instance 68d9de39-cbd2-44b2-bda8-015c8482c240 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 10:15:18 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75229) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 10:15:18 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75229) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 10:15:18 user nova-compute[75229]: DEBUG nova.scheduler.client.report [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Refreshing inventories for resource provider d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 {{(pid=75229) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 14 10:15:18 user nova-compute[75229]: DEBUG nova.scheduler.client.report [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Updating ProviderTree inventory for provider d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75229) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 14 10:15:18 user nova-compute[75229]: DEBUG nova.compute.provider_tree [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Updating inventory in ProviderTree for provider d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 14 10:15:18 user nova-compute[75229]: DEBUG nova.scheduler.client.report [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Refreshing aggregate associations for resource provider d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3, aggregates: None {{(pid=75229) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 14 10:15:18 user nova-compute[75229]: DEBUG nova.scheduler.client.report [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Refreshing trait associations for resource provider d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3, traits: COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_MMX,HW_CPU_X86_SSE42,HW_CPU_X86_SSSE3,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_TRUSTED_CERTS,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSE,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_USB,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_RESCUE_BFV {{(pid=75229) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 14 10:15:18 user nova-compute[75229]: DEBUG nova.compute.provider_tree [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Inventory has not changed in ProviderTree for provider: d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 {{(pid=75229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 10:15:18 user nova-compute[75229]: DEBUG nova.scheduler.client.report [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Inventory has not changed for provider d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 10:15:18 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Compute_service record updated for user:user {{(pid=75229) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 10:15:18 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.419s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:15:19 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:15:21 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:15:22 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:15:23 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:15:25 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:15:25 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:15:25 user nova-compute[75229]: DEBUG nova.compute.manager [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75229) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 14 10:15:27 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:15:28 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:15:29 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:15:31 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:15:31 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:15:32 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:15:34 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:15:35 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-a059a60e-98fc-4f61-95a7-850cb1aed800 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] Acquiring lock "075ad651-31fd-4ee0-af86-fa8bef56d614" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:15:35 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-a059a60e-98fc-4f61-95a7-850cb1aed800 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] Lock "075ad651-31fd-4ee0-af86-fa8bef56d614" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:15:35 user nova-compute[75229]: DEBUG nova.compute.manager [None req-a059a60e-98fc-4f61-95a7-850cb1aed800 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] [instance: 075ad651-31fd-4ee0-af86-fa8bef56d614] Starting instance... {{(pid=75229) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 10:15:35 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-a059a60e-98fc-4f61-95a7-850cb1aed800 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:15:35 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-a059a60e-98fc-4f61-95a7-850cb1aed800 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:15:35 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-a059a60e-98fc-4f61-95a7-850cb1aed800 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75229) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 10:15:35 user nova-compute[75229]: INFO nova.compute.claims [None req-a059a60e-98fc-4f61-95a7-850cb1aed800 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] [instance: 075ad651-31fd-4ee0-af86-fa8bef56d614] Claim successful on node user
Nov 14 10:15:35 user nova-compute[75229]: DEBUG nova.compute.provider_tree [None req-a059a60e-98fc-4f61-95a7-850cb1aed800 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] Inventory has not changed in ProviderTree for provider: d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 {{(pid=75229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 10:15:35 user nova-compute[75229]: DEBUG nova.scheduler.client.report [None req-a059a60e-98fc-4f61-95a7-850cb1aed800 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] Inventory has not changed for provider d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 10:15:35 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-a059a60e-98fc-4f61-95a7-850cb1aed800 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.210s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:15:35 user nova-compute[75229]: DEBUG nova.compute.manager [None req-a059a60e-98fc-4f61-95a7-850cb1aed800 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] [instance: 075ad651-31fd-4ee0-af86-fa8bef56d614] Start building networks asynchronously for instance. {{(pid=75229) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 10:15:36 user nova-compute[75229]: DEBUG nova.compute.manager [None req-a059a60e-98fc-4f61-95a7-850cb1aed800 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] [instance: 075ad651-31fd-4ee0-af86-fa8bef56d614] Allocating IP information in the background. {{(pid=75229) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 10:15:36 user nova-compute[75229]: DEBUG nova.network.neutron [None req-a059a60e-98fc-4f61-95a7-850cb1aed800 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] [instance: 075ad651-31fd-4ee0-af86-fa8bef56d614] allocate_for_instance() {{(pid=75229) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 10:15:36 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-a059a60e-98fc-4f61-95a7-850cb1aed800 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] [instance: 075ad651-31fd-4ee0-af86-fa8bef56d614] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 10:15:36 user nova-compute[75229]: DEBUG nova.compute.manager [None req-a059a60e-98fc-4f61-95a7-850cb1aed800 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] [instance: 075ad651-31fd-4ee0-af86-fa8bef56d614] Start building block device mappings for instance. {{(pid=75229) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 10:15:36 user nova-compute[75229]: DEBUG nova.policy [None req-a059a60e-98fc-4f61-95a7-850cb1aed800 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '98854bec259444e7ae2078565451769a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e94e4e374fb4329a0d1dd4cc8e3a2fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75229) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 10:15:36 user nova-compute[75229]: DEBUG nova.compute.manager [None req-a059a60e-98fc-4f61-95a7-850cb1aed800 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] [instance: 075ad651-31fd-4ee0-af86-fa8bef56d614] Start spawning the instance on the hypervisor. {{(pid=75229) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 10:15:36 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-a059a60e-98fc-4f61-95a7-850cb1aed800 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] [instance: 075ad651-31fd-4ee0-af86-fa8bef56d614] Creating instance directory {{(pid=75229) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 10:15:36 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-a059a60e-98fc-4f61-95a7-850cb1aed800 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] [instance: 075ad651-31fd-4ee0-af86-fa8bef56d614] Creating image(s)
Nov 14 10:15:36 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-a059a60e-98fc-4f61-95a7-850cb1aed800 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] Acquiring lock "/opt/stack/data/nova/instances/075ad651-31fd-4ee0-af86-fa8bef56d614/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:15:36 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-a059a60e-98fc-4f61-95a7-850cb1aed800 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] Lock "/opt/stack/data/nova/instances/075ad651-31fd-4ee0-af86-fa8bef56d614/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:15:36 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-a059a60e-98fc-4f61-95a7-850cb1aed800 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] Lock "/opt/stack/data/nova/instances/075ad651-31fd-4ee0-af86-fa8bef56d614/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:15:36 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-a059a60e-98fc-4f61-95a7-850cb1aed800 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6 --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:15:36 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-a059a60e-98fc-4f61-95a7-850cb1aed800 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6 --force-share --output=json" returned: 0 in 0.174s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:15:36 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-a059a60e-98fc-4f61-95a7-850cb1aed800 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] Acquiring lock "4f30e3fe703d2381679612a57b1fb80a467f60b6" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:15:36 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-a059a60e-98fc-4f61-95a7-850cb1aed800 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] Lock "4f30e3fe703d2381679612a57b1fb80a467f60b6" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:15:36 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-a059a60e-98fc-4f61-95a7-850cb1aed800 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6 --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:15:36 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-a059a60e-98fc-4f61-95a7-850cb1aed800 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6 --force-share --output=json" returned: 0 in 0.172s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:15:36 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-a059a60e-98fc-4f61-95a7-850cb1aed800 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6,backing_fmt=raw /opt/stack/data/nova/instances/075ad651-31fd-4ee0-af86-fa8bef56d614/disk 1073741824 {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:15:36 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-a059a60e-98fc-4f61-95a7-850cb1aed800 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6,backing_fmt=raw /opt/stack/data/nova/instances/075ad651-31fd-4ee0-af86-fa8bef56d614/disk 1073741824" returned: 0 in 0.049s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:15:36 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-a059a60e-98fc-4f61-95a7-850cb1aed800 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] Lock "4f30e3fe703d2381679612a57b1fb80a467f60b6" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.228s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:15:36 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-a059a60e-98fc-4f61-95a7-850cb1aed800 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6 --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:15:36 user nova-compute[75229]: DEBUG nova.network.neutron [None req-a059a60e-98fc-4f61-95a7-850cb1aed800 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] [instance: 075ad651-31fd-4ee0-af86-fa8bef56d614] Successfully created port: 3d399542-6350-495b-9b54-13b21f7a99b8 {{(pid=75229) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 10:15:36 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-a059a60e-98fc-4f61-95a7-850cb1aed800 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6 --force-share --output=json" returned: 0 in 0.177s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:15:36 user nova-compute[75229]: DEBUG nova.virt.disk.api [None req-a059a60e-98fc-4f61-95a7-850cb1aed800 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] Checking if we can resize image /opt/stack/data/nova/instances/075ad651-31fd-4ee0-af86-fa8bef56d614/disk. size=1073741824 {{(pid=75229) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 10:15:36 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-a059a60e-98fc-4f61-95a7-850cb1aed800 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/075ad651-31fd-4ee0-af86-fa8bef56d614/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:15:36 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-a059a60e-98fc-4f61-95a7-850cb1aed800 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/075ad651-31fd-4ee0-af86-fa8bef56d614/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:15:36 user nova-compute[75229]: DEBUG nova.virt.disk.api [None req-a059a60e-98fc-4f61-95a7-850cb1aed800 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] Cannot resize image /opt/stack/data/nova/instances/075ad651-31fd-4ee0-af86-fa8bef56d614/disk to a smaller size. {{(pid=75229) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 10:15:36 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-a059a60e-98fc-4f61-95a7-850cb1aed800 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] [instance: 075ad651-31fd-4ee0-af86-fa8bef56d614] Created local disks {{(pid=75229) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 10:15:36 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-a059a60e-98fc-4f61-95a7-850cb1aed800 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] [instance: 075ad651-31fd-4ee0-af86-fa8bef56d614] Ensure instance console log exists: /opt/stack/data/nova/instances/075ad651-31fd-4ee0-af86-fa8bef56d614/console.log {{(pid=75229) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 10:15:36 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-a059a60e-98fc-4f61-95a7-850cb1aed800 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:15:36 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-a059a60e-98fc-4f61-95a7-850cb1aed800 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:15:36 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-a059a60e-98fc-4f61-95a7-850cb1aed800 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:15:37 user nova-compute[75229]: DEBUG nova.network.neutron [None req-a059a60e-98fc-4f61-95a7-850cb1aed800 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] [instance: 075ad651-31fd-4ee0-af86-fa8bef56d614] Successfully updated port: 3d399542-6350-495b-9b54-13b21f7a99b8 {{(pid=75229) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 10:15:37 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-a059a60e-98fc-4f61-95a7-850cb1aed800 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] Acquiring lock "refresh_cache-075ad651-31fd-4ee0-af86-fa8bef56d614" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 10:15:37 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-a059a60e-98fc-4f61-95a7-850cb1aed800 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] Acquired lock "refresh_cache-075ad651-31fd-4ee0-af86-fa8bef56d614" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 10:15:37 user nova-compute[75229]: DEBUG nova.network.neutron [None req-a059a60e-98fc-4f61-95a7-850cb1aed800 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] [instance: 075ad651-31fd-4ee0-af86-fa8bef56d614] Building network info cache for instance {{(pid=75229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 10:15:37 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:15:37 user nova-compute[75229]: DEBUG nova.network.neutron [None req-a059a60e-98fc-4f61-95a7-850cb1aed800 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] [instance: 075ad651-31fd-4ee0-af86-fa8bef56d614] Instance cache missing network info. {{(pid=75229) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 10:15:37 user nova-compute[75229]: DEBUG nova.compute.manager [req-12bf8079-0763-4d68-9760-532926e596af req-978a127d-deea-42b6-8bb3-6f1a2779830c service nova] [instance: 075ad651-31fd-4ee0-af86-fa8bef56d614] Received event network-changed-3d399542-6350-495b-9b54-13b21f7a99b8 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 10:15:37 user nova-compute[75229]: DEBUG nova.compute.manager [req-12bf8079-0763-4d68-9760-532926e596af req-978a127d-deea-42b6-8bb3-6f1a2779830c service nova] [instance: 075ad651-31fd-4ee0-af86-fa8bef56d614] Refreshing instance network info cache due to event network-changed-3d399542-6350-495b-9b54-13b21f7a99b8. {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 10:15:37 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-12bf8079-0763-4d68-9760-532926e596af req-978a127d-deea-42b6-8bb3-6f1a2779830c service nova] Acquiring lock "refresh_cache-075ad651-31fd-4ee0-af86-fa8bef56d614" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 10:15:37 user nova-compute[75229]: DEBUG nova.network.neutron [None req-a059a60e-98fc-4f61-95a7-850cb1aed800 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] [instance: 075ad651-31fd-4ee0-af86-fa8bef56d614] Updating instance_info_cache with network_info: [{"id": "3d399542-6350-495b-9b54-13b21f7a99b8", "address": "fa:16:3e:bc:2b:a6", "network": {"id": "9fe5fa8c-b7e9-4f4f-88f1-e68567b67c3f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1670467158-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e94e4e374fb4329a0d1dd4cc8e3a2fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d399542-63", "ovs_interfaceid": "3d399542-6350-495b-9b54-13b21f7a99b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 10:15:37 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-a059a60e-98fc-4f61-95a7-850cb1aed800 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] Releasing lock "refresh_cache-075ad651-31fd-4ee0-af86-fa8bef56d614" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 10:15:37 user nova-compute[75229]: DEBUG nova.compute.manager [None req-a059a60e-98fc-4f61-95a7-850cb1aed800 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] [instance: 075ad651-31fd-4ee0-af86-fa8bef56d614] Instance network_info: |[{"id": "3d399542-6350-495b-9b54-13b21f7a99b8", "address": "fa:16:3e:bc:2b:a6", "network": {"id": "9fe5fa8c-b7e9-4f4f-88f1-e68567b67c3f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1670467158-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e94e4e374fb4329a0d1dd4cc8e3a2fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d399542-63", "ovs_interfaceid": "3d399542-6350-495b-9b54-13b21f7a99b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75229) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 10:15:37 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-12bf8079-0763-4d68-9760-532926e596af req-978a127d-deea-42b6-8bb3-6f1a2779830c service nova] Acquired lock "refresh_cache-075ad651-31fd-4ee0-af86-fa8bef56d614" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 10:15:37 user nova-compute[75229]: DEBUG nova.network.neutron [req-12bf8079-0763-4d68-9760-532926e596af req-978a127d-deea-42b6-8bb3-6f1a2779830c service nova] [instance: 075ad651-31fd-4ee0-af86-fa8bef56d614] Refreshing network info cache for port 3d399542-6350-495b-9b54-13b21f7a99b8 {{(pid=75229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 10:15:37 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-a059a60e-98fc-4f61-95a7-850cb1aed800 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] [instance: 075ad651-31fd-4ee0-af86-fa8bef56d614] Start _get_guest_xml network_info=[{"id": "3d399542-6350-495b-9b54-13b21f7a99b8", "address": "fa:16:3e:bc:2b:a6", "network": {"id": "9fe5fa8c-b7e9-4f4f-88f1-e68567b67c3f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1670467158-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e94e4e374fb4329a0d1dd4cc8e3a2fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d399542-63", "ovs_interfaceid": "3d399542-6350-495b-9b54-13b21f7a99b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T09:40:10Z,direct_url=<?>,disk_format='qcow2',id=3bef8470-ecc7-40e3-95d4-9254348ea72d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='de5a91106b6948ed937a7178ff9464c4',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T09:40:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'disk_bus': 'virtio', 'guest_format': None, 'encryption_secret_uuid': None, 'size': 0, 'device_type': 'disk', 'image_id': '3bef8470-ecc7-40e3-95d4-9254348ea72d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75229) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 10:15:37 user nova-compute[75229]: WARNING nova.virt.libvirt.driver [None req-a059a60e-98fc-4f61-95a7-850cb1aed800 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 10:15:37 user nova-compute[75229]: WARNING nova.virt.libvirt.driver [None req-a059a60e-98fc-4f61-95a7-850cb1aed800 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 10:15:37 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-a059a60e-98fc-4f61-95a7-850cb1aed800 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75229) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 10:15:37 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-a059a60e-98fc-4f61-95a7-850cb1aed800 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] CPU controller missing on host. {{(pid=75229) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 10:15:37 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-a059a60e-98fc-4f61-95a7-850cb1aed800 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75229) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 10:15:37 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-a059a60e-98fc-4f61-95a7-850cb1aed800 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] CPU controller found on host. {{(pid=75229) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 10:15:37 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-a059a60e-98fc-4f61-95a7-850cb1aed800 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75229) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 10:15:37 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-a059a60e-98fc-4f61-95a7-850cb1aed800 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T09:39:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T09:40:10Z,direct_url=<?>,disk_format='qcow2',id=3bef8470-ecc7-40e3-95d4-9254348ea72d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='de5a91106b6948ed937a7178ff9464c4',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T09:40:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 10:15:37 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-a059a60e-98fc-4f61-95a7-850cb1aed800 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] Flavor limits 0:0:0 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 10:15:37 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-a059a60e-98fc-4f61-95a7-850cb1aed800 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] Image limits 0:0:0 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 10:15:37 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-a059a60e-98fc-4f61-95a7-850cb1aed800 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] Flavor pref 0:0:0 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 10:15:37 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-a059a60e-98fc-4f61-95a7-850cb1aed800 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] Image pref 0:0:0 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 10:15:37 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-a059a60e-98fc-4f61-95a7-850cb1aed800 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 10:15:37 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-a059a60e-98fc-4f61-95a7-850cb1aed800 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 10:15:37 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-a059a60e-98fc-4f61-95a7-850cb1aed800 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75229) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 10:15:37 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-a059a60e-98fc-4f61-95a7-850cb1aed800 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] Got 1 possible topologies {{(pid=75229) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 10:15:37 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-a059a60e-98fc-4f61-95a7-850cb1aed800 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 10:15:37 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-a059a60e-98fc-4f61-95a7-850cb1aed800 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 10:15:37 user nova-compute[75229]: DEBUG nova.virt.libvirt.vif [None req-a059a60e-98fc-4f61-95a7-850cb1aed800 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T10:15:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1063792137',display_name='tempest-SnapshotDataIntegrityTests-server-1063792137',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1063792137',id=51,image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGaxqpq4Yu3mFWjxak2wgxiVreoKLRpmvy3DxUCDKSRKXXKjjOycBP0k421WDpGJowPROvGcLwE/1ivuhinb48H2BL1yi+r0PpqDMkXS/3z9g5bVptL6MQyqJv5tPCfZng==',key_name='tempest-keypair-606469431',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6e94e4e374fb4329a0d1dd4cc8e3a2fd',ramdisk_id='',reservation_id='r-l9wo42nl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-435544806',owner_user_name='tempest-SnapshotDataIntegrityTests-435544806-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T10:15:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='98854bec259444e7ae2078565451769a',uuid=075ad651-31fd-4ee0-af86-fa8bef56d614,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3d399542-6350-495b-9b54-13b21f7a99b8", "address": "fa:16:3e:bc:2b:a6", "network": {"id": "9fe5fa8c-b7e9-4f4f-88f1-e68567b67c3f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1670467158-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e94e4e374fb4329a0d1dd4cc8e3a2fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d399542-63", "ovs_interfaceid": "3d399542-6350-495b-9b54-13b21f7a99b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75229) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 10:15:37 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-a059a60e-98fc-4f61-95a7-850cb1aed800 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] Converting VIF {"id": "3d399542-6350-495b-9b54-13b21f7a99b8", "address": "fa:16:3e:bc:2b:a6", "network": {"id": "9fe5fa8c-b7e9-4f4f-88f1-e68567b67c3f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1670467158-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e94e4e374fb4329a0d1dd4cc8e3a2fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d399542-63", "ovs_interfaceid": "3d399542-6350-495b-9b54-13b21f7a99b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 10:15:37 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-a059a60e-98fc-4f61-95a7-850cb1aed800 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bc:2b:a6,bridge_name='br-int',has_traffic_filtering=True,id=3d399542-6350-495b-9b54-13b21f7a99b8,network=Network(9fe5fa8c-b7e9-4f4f-88f1-e68567b67c3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d399542-63') {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 10:15:37 user nova-compute[75229]: DEBUG nova.objects.instance [None req-a059a60e-98fc-4f61-95a7-850cb1aed800 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] Lazy-loading 'pci_devices' on Instance uuid 075ad651-31fd-4ee0-af86-fa8bef56d614 {{(pid=75229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 10:15:37 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-a059a60e-98fc-4f61-95a7-850cb1aed800 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] [instance: 075ad651-31fd-4ee0-af86-fa8bef56d614] End _get_guest_xml xml=<domain type="kvm">
Nov 14 10:15:37 user nova-compute[75229]:   <uuid>075ad651-31fd-4ee0-af86-fa8bef56d614</uuid>
Nov 14 10:15:37 user nova-compute[75229]:   <name>instance-00000033</name>
Nov 14 10:15:37 user nova-compute[75229]:   <memory>524288</memory>
Nov 14 10:15:37 user nova-compute[75229]:   <vcpu>1</vcpu>
Nov 14 10:15:37 user nova-compute[75229]:   <metadata>
Nov 14 10:15:37 user nova-compute[75229]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 10:15:37 user nova-compute[75229]:       <nova:package version="0.0.0"/>
Nov 14 10:15:37 user nova-compute[75229]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-1063792137</nova:name>
Nov 14 10:15:37 user nova-compute[75229]:       <nova:creationTime>2023-11-14 10:15:37</nova:creationTime>
Nov 14 10:15:37 user nova-compute[75229]:       <nova:flavor name="m1.tiny">
Nov 14 10:15:37 user nova-compute[75229]:         <nova:memory>512</nova:memory>
Nov 14 10:15:37 user nova-compute[75229]:         <nova:disk>1</nova:disk>
Nov 14 10:15:37 user nova-compute[75229]:         <nova:swap>0</nova:swap>
Nov 14 10:15:37 user nova-compute[75229]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 10:15:37 user nova-compute[75229]:         <nova:vcpus>1</nova:vcpus>
Nov 14 10:15:37 user nova-compute[75229]:       </nova:flavor>
Nov 14 10:15:37 user nova-compute[75229]:       <nova:owner>
Nov 14 10:15:37 user nova-compute[75229]:         <nova:user uuid="98854bec259444e7ae2078565451769a">tempest-SnapshotDataIntegrityTests-435544806-project-member</nova:user>
Nov 14 10:15:37 user nova-compute[75229]:         <nova:project uuid="6e94e4e374fb4329a0d1dd4cc8e3a2fd">tempest-SnapshotDataIntegrityTests-435544806</nova:project>
Nov 14 10:15:37 user nova-compute[75229]:       </nova:owner>
Nov 14 10:15:37 user nova-compute[75229]:       <nova:root type="image" uuid="3bef8470-ecc7-40e3-95d4-9254348ea72d"/>
Nov 14 10:15:37 user nova-compute[75229]:       <nova:ports>
Nov 14 10:15:37 user nova-compute[75229]:         <nova:port uuid="3d399542-6350-495b-9b54-13b21f7a99b8">
Nov 14 10:15:37 user nova-compute[75229]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 14 10:15:37 user nova-compute[75229]:         </nova:port>
Nov 14 10:15:37 user nova-compute[75229]:       </nova:ports>
Nov 14 10:15:37 user nova-compute[75229]:     </nova:instance>
Nov 14 10:15:37 user nova-compute[75229]:   </metadata>
Nov 14 10:15:37 user nova-compute[75229]:   <sysinfo type="smbios">
Nov 14 10:15:37 user nova-compute[75229]:     <system>
Nov 14 10:15:37 user nova-compute[75229]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 10:15:37 user nova-compute[75229]:       <entry name="product">OpenStack Nova</entry>
Nov 14 10:15:37 user nova-compute[75229]:       <entry name="version">0.0.0</entry>
Nov 14 10:15:37 user nova-compute[75229]:       <entry name="serial">075ad651-31fd-4ee0-af86-fa8bef56d614</entry>
Nov 14 10:15:37 user nova-compute[75229]:       <entry name="uuid">075ad651-31fd-4ee0-af86-fa8bef56d614</entry>
Nov 14 10:15:37 user nova-compute[75229]:       <entry name="family">Virtual Machine</entry>
Nov 14 10:15:37 user nova-compute[75229]:     </system>
Nov 14 10:15:37 user nova-compute[75229]:   </sysinfo>
Nov 14 10:15:37 user nova-compute[75229]:   <os>
Nov 14 10:15:37 user nova-compute[75229]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 10:15:37 user nova-compute[75229]:     <boot dev="hd"/>
Nov 14 10:15:37 user nova-compute[75229]:     <smbios mode="sysinfo"/>
Nov 14 10:15:37 user nova-compute[75229]:   </os>
Nov 14 10:15:37 user nova-compute[75229]:   <features>
Nov 14 10:15:37 user nova-compute[75229]:     <acpi/>
Nov 14 10:15:37 user nova-compute[75229]:     <apic/>
Nov 14 10:15:37 user nova-compute[75229]:     <vmcoreinfo/>
Nov 14 10:15:37 user nova-compute[75229]:   </features>
Nov 14 10:15:37 user nova-compute[75229]:   <clock offset="utc">
Nov 14 10:15:37 user nova-compute[75229]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 10:15:37 user nova-compute[75229]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 10:15:37 user nova-compute[75229]:     <timer name="hpet" present="no"/>
Nov 14 10:15:37 user nova-compute[75229]:   </clock>
Nov 14 10:15:37 user nova-compute[75229]:   <cpu mode="custom" match="exact">
Nov 14 10:15:37 user nova-compute[75229]:     <model>Nehalem</model>
Nov 14 10:15:37 user nova-compute[75229]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 10:15:37 user nova-compute[75229]:   </cpu>
Nov 14 10:15:37 user nova-compute[75229]:   <devices>
Nov 14 10:15:37 user nova-compute[75229]:     <disk type="file" device="disk">
Nov 14 10:15:37 user nova-compute[75229]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 10:15:37 user nova-compute[75229]:       <source file="/opt/stack/data/nova/instances/075ad651-31fd-4ee0-af86-fa8bef56d614/disk"/>
Nov 14 10:15:37 user nova-compute[75229]:       <target dev="vda" bus="virtio"/>
Nov 14 10:15:37 user nova-compute[75229]:     </disk>
Nov 14 10:15:37 user nova-compute[75229]:     <interface type="ethernet">
Nov 14 10:15:37 user nova-compute[75229]:       <mac address="fa:16:3e:bc:2b:a6"/>
Nov 14 10:15:37 user nova-compute[75229]:       <model type="virtio"/>
Nov 14 10:15:37 user nova-compute[75229]:       <mtu size="1442"/>
Nov 14 10:15:37 user nova-compute[75229]:       <target dev="tap3d399542-63"/>
Nov 14 10:15:37 user nova-compute[75229]:     </interface>
Nov 14 10:15:37 user nova-compute[75229]:     <serial type="pty">
Nov 14 10:15:37 user nova-compute[75229]:       <log file="/opt/stack/data/nova/instances/075ad651-31fd-4ee0-af86-fa8bef56d614/console.log" append="off"/>
Nov 14 10:15:37 user nova-compute[75229]:     </serial>
Nov 14 10:15:37 user nova-compute[75229]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 10:15:37 user nova-compute[75229]:     <video>
Nov 14 10:15:37 user nova-compute[75229]:       <model type="virtio"/>
Nov 14 10:15:37 user nova-compute[75229]:     </video>
Nov 14 10:15:37 user nova-compute[75229]:     <rng model="virtio">
Nov 14 10:15:37 user nova-compute[75229]:       <backend model="random">/dev/urandom</backend>
Nov 14 10:15:37 user nova-compute[75229]:     </rng>
Nov 14 10:15:37 user nova-compute[75229]:     <controller type="usb" index="0" model="none"/>
Nov 14 10:15:37 user nova-compute[75229]:     <memballoon model="virtio">
Nov 14 10:15:37 user nova-compute[75229]:       <stats period="10"/>
Nov 14 10:15:37 user nova-compute[75229]:     </memballoon>
Nov 14 10:15:37 user nova-compute[75229]:   </devices>
Nov 14 10:15:37 user nova-compute[75229]: </domain>
Nov 14 10:15:37 user nova-compute[75229]:  {{(pid=75229) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 10:15:37 user nova-compute[75229]: DEBUG nova.virt.libvirt.vif [None req-a059a60e-98fc-4f61-95a7-850cb1aed800 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T10:15:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1063792137',display_name='tempest-SnapshotDataIntegrityTests-server-1063792137',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1063792137',id=51,image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGaxqpq4Yu3mFWjxak2wgxiVreoKLRpmvy3DxUCDKSRKXXKjjOycBP0k421WDpGJowPROvGcLwE/1ivuhinb48H2BL1yi+r0PpqDMkXS/3z9g5bVptL6MQyqJv5tPCfZng==',key_name='tempest-keypair-606469431',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6e94e4e374fb4329a0d1dd4cc8e3a2fd',ramdisk_id='',reservation_id='r-l9wo42nl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-435544806',owner_user_name='tempest-SnapshotDataIntegrityTests-435544806-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T10:15:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='98854bec259444e7ae2078565451769a',uuid=075ad651-31fd-4ee0-af86-fa8bef56d614,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3d399542-6350-495b-9b54-13b21f7a99b8", "address": "fa:16:3e:bc:2b:a6", "network": {"id": "9fe5fa8c-b7e9-4f4f-88f1-e68567b67c3f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1670467158-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e94e4e374fb4329a0d1dd4cc8e3a2fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d399542-63", "ovs_interfaceid": "3d399542-6350-495b-9b54-13b21f7a99b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 10:15:37 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-a059a60e-98fc-4f61-95a7-850cb1aed800 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] Converting VIF {"id": "3d399542-6350-495b-9b54-13b21f7a99b8", "address": "fa:16:3e:bc:2b:a6", "network": {"id": "9fe5fa8c-b7e9-4f4f-88f1-e68567b67c3f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1670467158-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e94e4e374fb4329a0d1dd4cc8e3a2fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d399542-63", "ovs_interfaceid": "3d399542-6350-495b-9b54-13b21f7a99b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 10:15:37 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-a059a60e-98fc-4f61-95a7-850cb1aed800 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bc:2b:a6,bridge_name='br-int',has_traffic_filtering=True,id=3d399542-6350-495b-9b54-13b21f7a99b8,network=Network(9fe5fa8c-b7e9-4f4f-88f1-e68567b67c3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d399542-63') {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 10:15:37 user nova-compute[75229]: DEBUG os_vif [None req-a059a60e-98fc-4f61-95a7-850cb1aed800 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bc:2b:a6,bridge_name='br-int',has_traffic_filtering=True,id=3d399542-6350-495b-9b54-13b21f7a99b8,network=Network(9fe5fa8c-b7e9-4f4f-88f1-e68567b67c3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d399542-63') {{(pid=75229) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 10:15:37 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:15:37 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 10:15:37 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 10:15:37 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:15:37 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '44053aee-5006-51c7-a438-7e45f106eb96', '_type': 'linux-noop'}}, row=False) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 10:15:37 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:15:37 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 10:15:37 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:15:37 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:15:37 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3d399542-63, may_exist=True, interface_attrs={}) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 10:15:37 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3d399542-63, col_values=(('qos', UUID('f2858e29-c299-44a9-bb87-0d495de2333b')),), if_exists=True) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 10:15:37 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3d399542-63, col_values=(('external_ids', {'iface-id': '3d399542-6350-495b-9b54-13b21f7a99b8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bc:2b:a6', 'vm-uuid': '075ad651-31fd-4ee0-af86-fa8bef56d614'}),), if_exists=True) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 10:15:37 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 10:15:37 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:15:37 user nova-compute[75229]: INFO os_vif [None req-a059a60e-98fc-4f61-95a7-850cb1aed800 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bc:2b:a6,bridge_name='br-int',has_traffic_filtering=True,id=3d399542-6350-495b-9b54-13b21f7a99b8,network=Network(9fe5fa8c-b7e9-4f4f-88f1-e68567b67c3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d399542-63')
Nov 14 10:15:37 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-a059a60e-98fc-4f61-95a7-850cb1aed800 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] No BDM found with device name vda, not building metadata. {{(pid=75229) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 10:15:37 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-a059a60e-98fc-4f61-95a7-850cb1aed800 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] No VIF found with MAC fa:16:3e:bc:2b:a6, not building metadata {{(pid=75229) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 10:15:38 user nova-compute[75229]: DEBUG nova.network.neutron [req-12bf8079-0763-4d68-9760-532926e596af req-978a127d-deea-42b6-8bb3-6f1a2779830c service nova] [instance: 075ad651-31fd-4ee0-af86-fa8bef56d614] Updated VIF entry in instance network info cache for port 3d399542-6350-495b-9b54-13b21f7a99b8. {{(pid=75229) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 10:15:38 user nova-compute[75229]: DEBUG nova.network.neutron [req-12bf8079-0763-4d68-9760-532926e596af req-978a127d-deea-42b6-8bb3-6f1a2779830c service nova] [instance: 075ad651-31fd-4ee0-af86-fa8bef56d614] Updating instance_info_cache with network_info: [{"id": "3d399542-6350-495b-9b54-13b21f7a99b8", "address": "fa:16:3e:bc:2b:a6", "network": {"id": "9fe5fa8c-b7e9-4f4f-88f1-e68567b67c3f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1670467158-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e94e4e374fb4329a0d1dd4cc8e3a2fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d399542-63", "ovs_interfaceid": "3d399542-6350-495b-9b54-13b21f7a99b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 10:15:38 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-12bf8079-0763-4d68-9760-532926e596af req-978a127d-deea-42b6-8bb3-6f1a2779830c service nova] Releasing lock "refresh_cache-075ad651-31fd-4ee0-af86-fa8bef56d614" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 10:15:39 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:15:39 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:15:39 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:15:39 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:15:39 user nova-compute[75229]: DEBUG nova.compute.manager [req-994f63a6-58e8-43eb-aa8c-b8097e027e3a req-c01e9450-88c0-4c4c-8168-0105bc5c7bcb service nova] [instance: 075ad651-31fd-4ee0-af86-fa8bef56d614] Received event network-vif-plugged-3d399542-6350-495b-9b54-13b21f7a99b8 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 10:15:39 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-994f63a6-58e8-43eb-aa8c-b8097e027e3a req-c01e9450-88c0-4c4c-8168-0105bc5c7bcb service nova] Acquiring lock "075ad651-31fd-4ee0-af86-fa8bef56d614-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:15:39 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-994f63a6-58e8-43eb-aa8c-b8097e027e3a req-c01e9450-88c0-4c4c-8168-0105bc5c7bcb service nova] Lock "075ad651-31fd-4ee0-af86-fa8bef56d614-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:15:39 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-994f63a6-58e8-43eb-aa8c-b8097e027e3a req-c01e9450-88c0-4c4c-8168-0105bc5c7bcb service nova] Lock "075ad651-31fd-4ee0-af86-fa8bef56d614-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:15:39 user nova-compute[75229]: DEBUG nova.compute.manager [req-994f63a6-58e8-43eb-aa8c-b8097e027e3a req-c01e9450-88c0-4c4c-8168-0105bc5c7bcb service nova] [instance: 075ad651-31fd-4ee0-af86-fa8bef56d614] No waiting events found dispatching network-vif-plugged-3d399542-6350-495b-9b54-13b21f7a99b8 {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 10:15:39 user nova-compute[75229]: WARNING nova.compute.manager [req-994f63a6-58e8-43eb-aa8c-b8097e027e3a req-c01e9450-88c0-4c4c-8168-0105bc5c7bcb service nova] [instance: 075ad651-31fd-4ee0-af86-fa8bef56d614] Received unexpected event network-vif-plugged-3d399542-6350-495b-9b54-13b21f7a99b8 for instance with vm_state building and task_state spawning.
Nov 14 10:15:39 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:15:39 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:15:39 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:15:39 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:15:39 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:15:41 user nova-compute[75229]: DEBUG nova.compute.manager [None req-a059a60e-98fc-4f61-95a7-850cb1aed800 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] [instance: 075ad651-31fd-4ee0-af86-fa8bef56d614] Instance event wait completed in 0 seconds for  {{(pid=75229) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 10:15:41 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-a059a60e-98fc-4f61-95a7-850cb1aed800 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] [instance: 075ad651-31fd-4ee0-af86-fa8bef56d614] Guest created on hypervisor {{(pid=75229) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 10:15:41 user nova-compute[75229]: INFO nova.virt.libvirt.driver [-] [instance: 075ad651-31fd-4ee0-af86-fa8bef56d614] Instance spawned successfully.
Nov 14 10:15:41 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-a059a60e-98fc-4f61-95a7-850cb1aed800 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] [instance: 075ad651-31fd-4ee0-af86-fa8bef56d614] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 10:15:41 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-a059a60e-98fc-4f61-95a7-850cb1aed800 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] [instance: 075ad651-31fd-4ee0-af86-fa8bef56d614] Found default for hw_cdrom_bus of ide {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 10:15:41 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-a059a60e-98fc-4f61-95a7-850cb1aed800 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] [instance: 075ad651-31fd-4ee0-af86-fa8bef56d614] Found default for hw_disk_bus of virtio {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 10:15:41 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-a059a60e-98fc-4f61-95a7-850cb1aed800 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] [instance: 075ad651-31fd-4ee0-af86-fa8bef56d614] Found default for hw_input_bus of None {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 10:15:41 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-a059a60e-98fc-4f61-95a7-850cb1aed800 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] [instance: 075ad651-31fd-4ee0-af86-fa8bef56d614] Found default for hw_pointer_model of None {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 10:15:41 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-a059a60e-98fc-4f61-95a7-850cb1aed800 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] [instance: 075ad651-31fd-4ee0-af86-fa8bef56d614] Found default for hw_video_model of virtio {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 10:15:41 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-a059a60e-98fc-4f61-95a7-850cb1aed800 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] [instance: 075ad651-31fd-4ee0-af86-fa8bef56d614] Found default for hw_vif_model of virtio {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 10:15:41 user nova-compute[75229]: INFO nova.compute.manager [None req-a059a60e-98fc-4f61-95a7-850cb1aed800 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] [instance: 075ad651-31fd-4ee0-af86-fa8bef56d614] Took 5.11 seconds to spawn the instance on the hypervisor.
Nov 14 10:15:41 user nova-compute[75229]: DEBUG nova.compute.manager [None req-a059a60e-98fc-4f61-95a7-850cb1aed800 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] [instance: 075ad651-31fd-4ee0-af86-fa8bef56d614] Checking state {{(pid=75229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 10:15:41 user nova-compute[75229]: INFO nova.compute.manager [None req-a059a60e-98fc-4f61-95a7-850cb1aed800 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] [instance: 075ad651-31fd-4ee0-af86-fa8bef56d614] Took 5.63 seconds to build instance.
Nov 14 10:15:41 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-a059a60e-98fc-4f61-95a7-850cb1aed800 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] Lock "075ad651-31fd-4ee0-af86-fa8bef56d614" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.730s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:15:41 user nova-compute[75229]: DEBUG nova.compute.manager [req-233ddc4a-86aa-49f9-a474-bd11118fcf78 req-8c3955c6-26ac-4f4a-87f7-c0d100afb368 service nova] [instance: 075ad651-31fd-4ee0-af86-fa8bef56d614] Received event network-vif-plugged-3d399542-6350-495b-9b54-13b21f7a99b8 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 10:15:41 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-233ddc4a-86aa-49f9-a474-bd11118fcf78 req-8c3955c6-26ac-4f4a-87f7-c0d100afb368 service nova] Acquiring lock "075ad651-31fd-4ee0-af86-fa8bef56d614-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:15:41 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-233ddc4a-86aa-49f9-a474-bd11118fcf78 req-8c3955c6-26ac-4f4a-87f7-c0d100afb368 service nova] Lock "075ad651-31fd-4ee0-af86-fa8bef56d614-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:15:41 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-233ddc4a-86aa-49f9-a474-bd11118fcf78 req-8c3955c6-26ac-4f4a-87f7-c0d100afb368 service nova] Lock "075ad651-31fd-4ee0-af86-fa8bef56d614-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:15:41 user nova-compute[75229]: DEBUG nova.compute.manager [req-233ddc4a-86aa-49f9-a474-bd11118fcf78 req-8c3955c6-26ac-4f4a-87f7-c0d100afb368 service nova] [instance: 075ad651-31fd-4ee0-af86-fa8bef56d614] No waiting events found dispatching network-vif-plugged-3d399542-6350-495b-9b54-13b21f7a99b8 {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 10:15:41 user nova-compute[75229]: WARNING nova.compute.manager [req-233ddc4a-86aa-49f9-a474-bd11118fcf78 req-8c3955c6-26ac-4f4a-87f7-c0d100afb368 service nova] [instance: 075ad651-31fd-4ee0-af86-fa8bef56d614] Received unexpected event network-vif-plugged-3d399542-6350-495b-9b54-13b21f7a99b8 for instance with vm_state active and task_state None.
Nov 14 10:15:42 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:15:44 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:15:47 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:15:52 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:15:57 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 10:15:59 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:16:02 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:16:04 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:16:07 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:16:07 user nova-compute[75229]: DEBUG nova.compute.manager [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Starting heal instance info cache {{(pid=75229) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 10:16:07 user nova-compute[75229]: DEBUG nova.compute.manager [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Rebuilding the list of instances to heal {{(pid=75229) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 10:16:07 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:16:07 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Acquiring lock "refresh_cache-68d9de39-cbd2-44b2-bda8-015c8482c240" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 10:16:07 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Acquired lock "refresh_cache-68d9de39-cbd2-44b2-bda8-015c8482c240" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 10:16:07 user nova-compute[75229]: DEBUG nova.network.neutron [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] [instance: 68d9de39-cbd2-44b2-bda8-015c8482c240] Forcefully refreshing network info cache for instance {{(pid=75229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 10:16:07 user nova-compute[75229]: DEBUG nova.objects.instance [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Lazy-loading 'info_cache' on Instance uuid 68d9de39-cbd2-44b2-bda8-015c8482c240 {{(pid=75229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 10:16:08 user nova-compute[75229]: DEBUG nova.network.neutron [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] [instance: 68d9de39-cbd2-44b2-bda8-015c8482c240] Updating instance_info_cache with network_info: [{"id": "e62b2a49-c9cc-4568-b887-1c7884830ac2", "address": "fa:16:3e:f6:c6:5e", "network": {"id": "13b12b7e-2548-4256-8fb8-fccc67b1e18b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-698342503-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.41", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be7eb95aea3e4897acbc9fe03aadb8e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape62b2a49-c9", "ovs_interfaceid": "e62b2a49-c9cc-4568-b887-1c7884830ac2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 10:16:08 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Releasing lock "refresh_cache-68d9de39-cbd2-44b2-bda8-015c8482c240" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 10:16:08 user nova-compute[75229]: DEBUG nova.compute.manager [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] [instance: 68d9de39-cbd2-44b2-bda8-015c8482c240] Updated the network info_cache for instance {{(pid=75229) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 10:16:08 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:16:09 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:16:12 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:16:14 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:16:15 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:16:15 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:16:15 user nova-compute[75229]: DEBUG nova.compute.manager [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75229) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 10:16:16 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:16:17 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 10:16:17 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:16:17 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75229) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 10:16:17 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75229) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 10:16:17 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75229) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 10:16:17 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:16:18 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:16:19 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:16:19 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:16:19 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:16:19 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:16:19 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Auditing locally available compute resources for user (node: user) {{(pid=75229) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 10:16:19 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/075ad651-31fd-4ee0-af86-fa8bef56d614/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:16:20 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/075ad651-31fd-4ee0-af86-fa8bef56d614/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:16:20 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/075ad651-31fd-4ee0-af86-fa8bef56d614/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:16:20 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/075ad651-31fd-4ee0-af86-fa8bef56d614/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:16:20 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68d9de39-cbd2-44b2-bda8-015c8482c240/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:16:20 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68d9de39-cbd2-44b2-bda8-015c8482c240/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:16:20 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68d9de39-cbd2-44b2-bda8-015c8482c240/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:16:20 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68d9de39-cbd2-44b2-bda8-015c8482c240/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:16:20 user nova-compute[75229]: WARNING nova.virt.libvirt.driver [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 10:16:20 user nova-compute[75229]: WARNING nova.virt.libvirt.driver [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 10:16:20 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Hypervisor/Node resource view: name=user free_ram=8965MB free_disk=25.13150405883789GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75229) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 10:16:20 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:16:20 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:16:21 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Instance 68d9de39-cbd2-44b2-bda8-015c8482c240 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 10:16:21 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Instance 075ad651-31fd-4ee0-af86-fa8bef56d614 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 10:16:21 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75229) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 10:16:21 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75229) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 10:16:21 user nova-compute[75229]: DEBUG nova.compute.provider_tree [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Inventory has not changed in ProviderTree for provider: d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 {{(pid=75229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 10:16:21 user nova-compute[75229]: DEBUG nova.scheduler.client.report [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Inventory has not changed for provider d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 10:16:21 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Compute_service record updated for user:user {{(pid=75229) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 10:16:21 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.217s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:16:22 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 10:16:23 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:16:27 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 10:16:32 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:16:32 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 10:16:32 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 10:16:32 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75229) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 10:16:32 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75229) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 10:16:32 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75229) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 10:16:32 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:16:37 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:16:42 user nova-compute[75229]: DEBUG nova.objects.instance [None req-6ed8e071-0db4-45ad-8793-2e07673320fc tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Lazy-loading 'flavor' on Instance uuid 68d9de39-cbd2-44b2-bda8-015c8482c240 {{(pid=75229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 10:16:42 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-6ed8e071-0db4-45ad-8793-2e07673320fc tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Acquiring lock "refresh_cache-68d9de39-cbd2-44b2-bda8-015c8482c240" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 10:16:42 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-6ed8e071-0db4-45ad-8793-2e07673320fc tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Acquired lock "refresh_cache-68d9de39-cbd2-44b2-bda8-015c8482c240" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 10:16:42 user nova-compute[75229]: DEBUG nova.network.neutron [None req-6ed8e071-0db4-45ad-8793-2e07673320fc tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] [instance: 68d9de39-cbd2-44b2-bda8-015c8482c240] Building network info cache for instance {{(pid=75229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 10:16:42 user nova-compute[75229]: DEBUG nova.objects.instance [None req-6ed8e071-0db4-45ad-8793-2e07673320fc tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Lazy-loading 'info_cache' on Instance uuid 68d9de39-cbd2-44b2-bda8-015c8482c240 {{(pid=75229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 10:16:42 user nova-compute[75229]: DEBUG nova.objects.base [None req-6ed8e071-0db4-45ad-8793-2e07673320fc tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Object Instance<68d9de39-cbd2-44b2-bda8-015c8482c240> lazy-loaded attributes: flavor,info_cache {{(pid=75229) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 10:16:42 user nova-compute[75229]: DEBUG nova.network.neutron [None req-6ed8e071-0db4-45ad-8793-2e07673320fc tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] [instance: 68d9de39-cbd2-44b2-bda8-015c8482c240] Updating instance_info_cache with network_info: [{"id": "e62b2a49-c9cc-4568-b887-1c7884830ac2", "address": "fa:16:3e:f6:c6:5e", "network": {"id": "13b12b7e-2548-4256-8fb8-fccc67b1e18b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-698342503-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.41", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be7eb95aea3e4897acbc9fe03aadb8e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape62b2a49-c9", "ovs_interfaceid": "e62b2a49-c9cc-4568-b887-1c7884830ac2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 10:16:42 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-6ed8e071-0db4-45ad-8793-2e07673320fc tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Releasing lock "refresh_cache-68d9de39-cbd2-44b2-bda8-015c8482c240" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 10:16:42 user nova-compute[75229]: INFO nova.virt.libvirt.driver [-] [instance: 68d9de39-cbd2-44b2-bda8-015c8482c240] Instance destroyed successfully.
Nov 14 10:16:42 user nova-compute[75229]: DEBUG nova.objects.instance [None req-6ed8e071-0db4-45ad-8793-2e07673320fc tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Lazy-loading 'resources' on Instance uuid 68d9de39-cbd2-44b2-bda8-015c8482c240 {{(pid=75229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 10:16:42 user nova-compute[75229]: DEBUG nova.objects.base [None req-6ed8e071-0db4-45ad-8793-2e07673320fc tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Object Instance<68d9de39-cbd2-44b2-bda8-015c8482c240> lazy-loaded attributes: flavor,info_cache,resources {{(pid=75229) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 10:16:42 user nova-compute[75229]: DEBUG nova.virt.libvirt.vif [None req-6ed8e071-0db4-45ad-8793-2e07673320fc tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T10:08:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-83963923',display_name='tempest-AttachVolumeTestJSON-server-83963923',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-83963923',id=48,image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJXzPsBd7qGYyaZb6FflRdQkGeKTe15VJYOOicBN62pWfFwNeM5MDUu06fTurq1Q3swlWbSacoNNYmELLNWG6cLojtLhJVSsbh2TFSo9QcykLrjuhusRznBqFctWAQ+d2w==',key_name='tempest-keypair-580650650',keypairs=<?>,launch_index=0,launched_at=2023-11-14T10:08:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='be7eb95aea3e4897acbc9fe03aadb8e7',ramdisk_id='',reservation_id='r-mo2dg0yb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-775906619',owner_user_name='tempest-AttachVolumeTestJSON-775906619-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T10:14:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='707c03b04f664aab82260a037074de21',uuid=68d9de39-cbd2-44b2-bda8-015c8482c240,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "e62b2a49-c9cc-4568-b887-1c7884830ac2", "address": "fa:16:3e:f6:c6:5e", "network": {"id": "13b12b7e-2548-4256-8fb8-fccc67b1e18b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-698342503-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.41", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be7eb95aea3e4897acbc9fe03aadb8e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape62b2a49-c9", "ovs_interfaceid": "e62b2a49-c9cc-4568-b887-1c7884830ac2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 10:16:42 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-6ed8e071-0db4-45ad-8793-2e07673320fc tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Converting VIF {"id": "e62b2a49-c9cc-4568-b887-1c7884830ac2", "address": "fa:16:3e:f6:c6:5e", "network": {"id": "13b12b7e-2548-4256-8fb8-fccc67b1e18b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-698342503-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.41", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be7eb95aea3e4897acbc9fe03aadb8e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape62b2a49-c9", "ovs_interfaceid": "e62b2a49-c9cc-4568-b887-1c7884830ac2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 10:16:42 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-6ed8e071-0db4-45ad-8793-2e07673320fc tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f6:c6:5e,bridge_name='br-int',has_traffic_filtering=True,id=e62b2a49-c9cc-4568-b887-1c7884830ac2,network=Network(13b12b7e-2548-4256-8fb8-fccc67b1e18b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape62b2a49-c9') {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 10:16:42 user nova-compute[75229]: DEBUG os_vif [None req-6ed8e071-0db4-45ad-8793-2e07673320fc tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f6:c6:5e,bridge_name='br-int',has_traffic_filtering=True,id=e62b2a49-c9cc-4568-b887-1c7884830ac2,network=Network(13b12b7e-2548-4256-8fb8-fccc67b1e18b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape62b2a49-c9') {{(pid=75229) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 10:16:42 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:16:42 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape62b2a49-c9, bridge=br-int, if_exists=True) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 10:16:42 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:16:42 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 10:16:42 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:16:42 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4146aaad-ef91-4d57-ace4-41cd409c7118) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 10:16:42 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:16:42 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 10:16:42 user nova-compute[75229]: INFO os_vif [None req-6ed8e071-0db4-45ad-8793-2e07673320fc tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f6:c6:5e,bridge_name='br-int',has_traffic_filtering=True,id=e62b2a49-c9cc-4568-b887-1c7884830ac2,network=Network(13b12b7e-2548-4256-8fb8-fccc67b1e18b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape62b2a49-c9')
Nov 14 10:16:42 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-6ed8e071-0db4-45ad-8793-2e07673320fc tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] [instance: 68d9de39-cbd2-44b2-bda8-015c8482c240] Start _get_guest_xml network_info=[{"id": "e62b2a49-c9cc-4568-b887-1c7884830ac2", "address": "fa:16:3e:f6:c6:5e", "network": {"id": "13b12b7e-2548-4256-8fb8-fccc67b1e18b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-698342503-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.41", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be7eb95aea3e4897acbc9fe03aadb8e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape62b2a49-c9", "ovs_interfaceid": "e62b2a49-c9cc-4568-b887-1c7884830ac2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=3bef8470-ecc7-40e3-95d4-9254348ea72d,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'disk_bus': 'virtio', 'guest_format': None, 'encryption_secret_uuid': None, 'size': 0, 'device_type': 'disk', 'image_id': '3bef8470-ecc7-40e3-95d4-9254348ea72d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75229) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 10:16:42 user nova-compute[75229]: DEBUG nova.objects.instance [None req-6ed8e071-0db4-45ad-8793-2e07673320fc tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Lazy-loading 'numa_topology' on Instance uuid 68d9de39-cbd2-44b2-bda8-015c8482c240 {{(pid=75229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 10:16:42 user nova-compute[75229]: DEBUG nova.objects.base [None req-6ed8e071-0db4-45ad-8793-2e07673320fc tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Object Instance<68d9de39-cbd2-44b2-bda8-015c8482c240> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=75229) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 10:16:42 user nova-compute[75229]: WARNING nova.virt.libvirt.driver [None req-6ed8e071-0db4-45ad-8793-2e07673320fc tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 10:16:42 user nova-compute[75229]: WARNING nova.virt.libvirt.driver [None req-6ed8e071-0db4-45ad-8793-2e07673320fc tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 10:16:42 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-6ed8e071-0db4-45ad-8793-2e07673320fc tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75229) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 10:16:42 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-6ed8e071-0db4-45ad-8793-2e07673320fc tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] CPU controller missing on host. {{(pid=75229) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 10:16:42 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-6ed8e071-0db4-45ad-8793-2e07673320fc tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75229) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 10:16:42 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-6ed8e071-0db4-45ad-8793-2e07673320fc tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] CPU controller found on host. {{(pid=75229) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 10:16:42 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-6ed8e071-0db4-45ad-8793-2e07673320fc tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75229) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 10:16:42 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-6ed8e071-0db4-45ad-8793-2e07673320fc tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T09:39:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=3bef8470-ecc7-40e3-95d4-9254348ea72d,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 10:16:42 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-6ed8e071-0db4-45ad-8793-2e07673320fc tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Flavor limits 0:0:0 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 10:16:42 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-6ed8e071-0db4-45ad-8793-2e07673320fc tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Image limits 0:0:0 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 10:16:42 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-6ed8e071-0db4-45ad-8793-2e07673320fc tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Flavor pref 0:0:0 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 10:16:42 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-6ed8e071-0db4-45ad-8793-2e07673320fc tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Image pref 0:0:0 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 10:16:42 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-6ed8e071-0db4-45ad-8793-2e07673320fc tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 10:16:42 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-6ed8e071-0db4-45ad-8793-2e07673320fc tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 10:16:42 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-6ed8e071-0db4-45ad-8793-2e07673320fc tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75229) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 10:16:42 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-6ed8e071-0db4-45ad-8793-2e07673320fc tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Got 1 possible topologies {{(pid=75229) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 10:16:42 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-6ed8e071-0db4-45ad-8793-2e07673320fc tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 10:16:42 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-6ed8e071-0db4-45ad-8793-2e07673320fc tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 10:16:42 user nova-compute[75229]: DEBUG nova.objects.instance [None req-6ed8e071-0db4-45ad-8793-2e07673320fc tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Lazy-loading 'vcpu_model' on Instance uuid 68d9de39-cbd2-44b2-bda8-015c8482c240 {{(pid=75229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 10:16:42 user nova-compute[75229]: DEBUG nova.objects.base [None req-6ed8e071-0db4-45ad-8793-2e07673320fc tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Object Instance<68d9de39-cbd2-44b2-bda8-015c8482c240> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=75229) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 10:16:42 user nova-compute[75229]: DEBUG nova.virt.libvirt.vif [None req-6ed8e071-0db4-45ad-8793-2e07673320fc tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T10:08:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-83963923',display_name='tempest-AttachVolumeTestJSON-server-83963923',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-83963923',id=48,image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJXzPsBd7qGYyaZb6FflRdQkGeKTe15VJYOOicBN62pWfFwNeM5MDUu06fTurq1Q3swlWbSacoNNYmELLNWG6cLojtLhJVSsbh2TFSo9QcykLrjuhusRznBqFctWAQ+d2w==',key_name='tempest-keypair-580650650',keypairs=<?>,launch_index=0,launched_at=2023-11-14T10:08:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='be7eb95aea3e4897acbc9fe03aadb8e7',ramdisk_id='',reservation_id='r-mo2dg0yb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-775906619',owner_user_name='tempest-AttachVolumeTestJSON-775906619-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T10:14:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='707c03b04f664aab82260a037074de21',uuid=68d9de39-cbd2-44b2-bda8-015c8482c240,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "e62b2a49-c9cc-4568-b887-1c7884830ac2", "address": "fa:16:3e:f6:c6:5e", "network": {"id": "13b12b7e-2548-4256-8fb8-fccc67b1e18b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-698342503-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.41", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be7eb95aea3e4897acbc9fe03aadb8e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape62b2a49-c9", "ovs_interfaceid": "e62b2a49-c9cc-4568-b887-1c7884830ac2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75229) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 10:16:42 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-6ed8e071-0db4-45ad-8793-2e07673320fc tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Converting VIF {"id": "e62b2a49-c9cc-4568-b887-1c7884830ac2", "address": "fa:16:3e:f6:c6:5e", "network": {"id": "13b12b7e-2548-4256-8fb8-fccc67b1e18b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-698342503-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.41", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be7eb95aea3e4897acbc9fe03aadb8e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape62b2a49-c9", "ovs_interfaceid": "e62b2a49-c9cc-4568-b887-1c7884830ac2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 10:16:42 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-6ed8e071-0db4-45ad-8793-2e07673320fc tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f6:c6:5e,bridge_name='br-int',has_traffic_filtering=True,id=e62b2a49-c9cc-4568-b887-1c7884830ac2,network=Network(13b12b7e-2548-4256-8fb8-fccc67b1e18b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape62b2a49-c9') {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 10:16:42 user nova-compute[75229]: DEBUG nova.objects.instance [None req-6ed8e071-0db4-45ad-8793-2e07673320fc tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Lazy-loading 'pci_devices' on Instance uuid 68d9de39-cbd2-44b2-bda8-015c8482c240 {{(pid=75229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 10:16:42 user nova-compute[75229]: DEBUG nova.objects.base [None req-6ed8e071-0db4-45ad-8793-2e07673320fc tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Object Instance<68d9de39-cbd2-44b2-bda8-015c8482c240> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=75229) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 10:16:42 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-6ed8e071-0db4-45ad-8793-2e07673320fc tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] [instance: 68d9de39-cbd2-44b2-bda8-015c8482c240] End _get_guest_xml xml=<domain type="kvm">
Nov 14 10:16:42 user nova-compute[75229]:   <uuid>68d9de39-cbd2-44b2-bda8-015c8482c240</uuid>
Nov 14 10:16:42 user nova-compute[75229]:   <name>instance-00000030</name>
Nov 14 10:16:42 user nova-compute[75229]:   <memory>524288</memory>
Nov 14 10:16:42 user nova-compute[75229]:   <vcpu>1</vcpu>
Nov 14 10:16:42 user nova-compute[75229]:   <metadata>
Nov 14 10:16:42 user nova-compute[75229]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 10:16:42 user nova-compute[75229]:       <nova:package version="0.0.0"/>
Nov 14 10:16:42 user nova-compute[75229]:       <nova:name>tempest-AttachVolumeTestJSON-server-83963923</nova:name>
Nov 14 10:16:42 user nova-compute[75229]:       <nova:creationTime>2023-11-14 10:16:42</nova:creationTime>
Nov 14 10:16:42 user nova-compute[75229]:       <nova:flavor name="m1.tiny">
Nov 14 10:16:42 user nova-compute[75229]:         <nova:memory>512</nova:memory>
Nov 14 10:16:42 user nova-compute[75229]:         <nova:disk>1</nova:disk>
Nov 14 10:16:42 user nova-compute[75229]:         <nova:swap>0</nova:swap>
Nov 14 10:16:42 user nova-compute[75229]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 10:16:42 user nova-compute[75229]:         <nova:vcpus>1</nova:vcpus>
Nov 14 10:16:42 user nova-compute[75229]:       </nova:flavor>
Nov 14 10:16:42 user nova-compute[75229]:       <nova:owner>
Nov 14 10:16:42 user nova-compute[75229]:         <nova:user uuid="707c03b04f664aab82260a037074de21">tempest-AttachVolumeTestJSON-775906619-project-member</nova:user>
Nov 14 10:16:42 user nova-compute[75229]:         <nova:project uuid="be7eb95aea3e4897acbc9fe03aadb8e7">tempest-AttachVolumeTestJSON-775906619</nova:project>
Nov 14 10:16:42 user nova-compute[75229]:       </nova:owner>
Nov 14 10:16:42 user nova-compute[75229]:       <nova:root type="image" uuid="3bef8470-ecc7-40e3-95d4-9254348ea72d"/>
Nov 14 10:16:42 user nova-compute[75229]:       <nova:ports>
Nov 14 10:16:42 user nova-compute[75229]:         <nova:port uuid="e62b2a49-c9cc-4568-b887-1c7884830ac2">
Nov 14 10:16:42 user nova-compute[75229]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 14 10:16:42 user nova-compute[75229]:         </nova:port>
Nov 14 10:16:42 user nova-compute[75229]:       </nova:ports>
Nov 14 10:16:42 user nova-compute[75229]:     </nova:instance>
Nov 14 10:16:42 user nova-compute[75229]:   </metadata>
Nov 14 10:16:42 user nova-compute[75229]:   <sysinfo type="smbios">
Nov 14 10:16:42 user nova-compute[75229]:     <system>
Nov 14 10:16:42 user nova-compute[75229]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 10:16:42 user nova-compute[75229]:       <entry name="product">OpenStack Nova</entry>
Nov 14 10:16:42 user nova-compute[75229]:       <entry name="version">0.0.0</entry>
Nov 14 10:16:42 user nova-compute[75229]:       <entry name="serial">68d9de39-cbd2-44b2-bda8-015c8482c240</entry>
Nov 14 10:16:42 user nova-compute[75229]:       <entry name="uuid">68d9de39-cbd2-44b2-bda8-015c8482c240</entry>
Nov 14 10:16:42 user nova-compute[75229]:       <entry name="family">Virtual Machine</entry>
Nov 14 10:16:42 user nova-compute[75229]:     </system>
Nov 14 10:16:42 user nova-compute[75229]:   </sysinfo>
Nov 14 10:16:42 user nova-compute[75229]:   <os>
Nov 14 10:16:42 user nova-compute[75229]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 10:16:42 user nova-compute[75229]:     <boot dev="hd"/>
Nov 14 10:16:42 user nova-compute[75229]:     <smbios mode="sysinfo"/>
Nov 14 10:16:42 user nova-compute[75229]:   </os>
Nov 14 10:16:42 user nova-compute[75229]:   <features>
Nov 14 10:16:42 user nova-compute[75229]:     <acpi/>
Nov 14 10:16:42 user nova-compute[75229]:     <apic/>
Nov 14 10:16:42 user nova-compute[75229]:     <vmcoreinfo/>
Nov 14 10:16:42 user nova-compute[75229]:   </features>
Nov 14 10:16:42 user nova-compute[75229]:   <clock offset="utc">
Nov 14 10:16:42 user nova-compute[75229]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 10:16:42 user nova-compute[75229]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 10:16:42 user nova-compute[75229]:     <timer name="hpet" present="no"/>
Nov 14 10:16:42 user nova-compute[75229]:   </clock>
Nov 14 10:16:42 user nova-compute[75229]:   <cpu mode="custom" match="exact">
Nov 14 10:16:42 user nova-compute[75229]:     <model>Nehalem</model>
Nov 14 10:16:42 user nova-compute[75229]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 10:16:42 user nova-compute[75229]:   </cpu>
Nov 14 10:16:42 user nova-compute[75229]:   <devices>
Nov 14 10:16:42 user nova-compute[75229]:     <disk type="file" device="disk">
Nov 14 10:16:42 user nova-compute[75229]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 10:16:42 user nova-compute[75229]:       <source file="/opt/stack/data/nova/instances/68d9de39-cbd2-44b2-bda8-015c8482c240/disk"/>
Nov 14 10:16:42 user nova-compute[75229]:       <target dev="vda" bus="virtio"/>
Nov 14 10:16:42 user nova-compute[75229]:     </disk>
Nov 14 10:16:42 user nova-compute[75229]:     <interface type="ethernet">
Nov 14 10:16:42 user nova-compute[75229]:       <mac address="fa:16:3e:f6:c6:5e"/>
Nov 14 10:16:42 user nova-compute[75229]:       <model type="virtio"/>
Nov 14 10:16:42 user nova-compute[75229]:       <mtu size="1442"/>
Nov 14 10:16:42 user nova-compute[75229]:       <target dev="tape62b2a49-c9"/>
Nov 14 10:16:42 user nova-compute[75229]:     </interface>
Nov 14 10:16:42 user nova-compute[75229]:     <serial type="pty">
Nov 14 10:16:42 user nova-compute[75229]:       <log file="/opt/stack/data/nova/instances/68d9de39-cbd2-44b2-bda8-015c8482c240/console.log" append="off"/>
Nov 14 10:16:42 user nova-compute[75229]:     </serial>
Nov 14 10:16:42 user nova-compute[75229]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 10:16:42 user nova-compute[75229]:     <video>
Nov 14 10:16:42 user nova-compute[75229]:       <model type="virtio"/>
Nov 14 10:16:42 user nova-compute[75229]:     </video>
Nov 14 10:16:42 user nova-compute[75229]:     <rng model="virtio">
Nov 14 10:16:42 user nova-compute[75229]:       <backend model="random">/dev/urandom</backend>
Nov 14 10:16:42 user nova-compute[75229]:     </rng>
Nov 14 10:16:42 user nova-compute[75229]:     <controller type="usb" index="0" model="none"/>
Nov 14 10:16:42 user nova-compute[75229]:     <memballoon model="virtio">
Nov 14 10:16:42 user nova-compute[75229]:       <stats period="10"/>
Nov 14 10:16:42 user nova-compute[75229]:     </memballoon>
Nov 14 10:16:42 user nova-compute[75229]:   </devices>
Nov 14 10:16:42 user nova-compute[75229]: </domain>
Nov 14 10:16:42 user nova-compute[75229]:  {{(pid=75229) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 10:16:42 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-6ed8e071-0db4-45ad-8793-2e07673320fc tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68d9de39-cbd2-44b2-bda8-015c8482c240/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:16:43 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-6ed8e071-0db4-45ad-8793-2e07673320fc tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68d9de39-cbd2-44b2-bda8-015c8482c240/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:16:43 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-6ed8e071-0db4-45ad-8793-2e07673320fc tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68d9de39-cbd2-44b2-bda8-015c8482c240/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:16:43 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-6ed8e071-0db4-45ad-8793-2e07673320fc tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68d9de39-cbd2-44b2-bda8-015c8482c240/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:16:43 user nova-compute[75229]: DEBUG nova.objects.instance [None req-6ed8e071-0db4-45ad-8793-2e07673320fc tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Lazy-loading 'trusted_certs' on Instance uuid 68d9de39-cbd2-44b2-bda8-015c8482c240 {{(pid=75229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 10:16:43 user nova-compute[75229]: DEBUG nova.objects.base [None req-6ed8e071-0db4-45ad-8793-2e07673320fc tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Object Instance<68d9de39-cbd2-44b2-bda8-015c8482c240> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=75229) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 10:16:43 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-6ed8e071-0db4-45ad-8793-2e07673320fc tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6 --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:16:43 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-6ed8e071-0db4-45ad-8793-2e07673320fc tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6 --force-share --output=json" returned: 0 in 0.174s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:16:43 user nova-compute[75229]: DEBUG nova.virt.disk.api [None req-6ed8e071-0db4-45ad-8793-2e07673320fc tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Checking if we can resize image /opt/stack/data/nova/instances/68d9de39-cbd2-44b2-bda8-015c8482c240/disk. size=1073741824 {{(pid=75229) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 10:16:43 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-6ed8e071-0db4-45ad-8793-2e07673320fc tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68d9de39-cbd2-44b2-bda8-015c8482c240/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:16:43 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-6ed8e071-0db4-45ad-8793-2e07673320fc tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68d9de39-cbd2-44b2-bda8-015c8482c240/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:16:43 user nova-compute[75229]: DEBUG nova.virt.disk.api [None req-6ed8e071-0db4-45ad-8793-2e07673320fc tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Cannot resize image /opt/stack/data/nova/instances/68d9de39-cbd2-44b2-bda8-015c8482c240/disk to a smaller size. {{(pid=75229) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 10:16:43 user nova-compute[75229]: DEBUG nova.objects.instance [None req-6ed8e071-0db4-45ad-8793-2e07673320fc tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Lazy-loading 'migration_context' on Instance uuid 68d9de39-cbd2-44b2-bda8-015c8482c240 {{(pid=75229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 10:16:43 user nova-compute[75229]: DEBUG nova.objects.base [None req-6ed8e071-0db4-45ad-8793-2e07673320fc tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Object Instance<68d9de39-cbd2-44b2-bda8-015c8482c240> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=75229) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 10:16:43 user nova-compute[75229]: DEBUG nova.virt.libvirt.vif [None req-6ed8e071-0db4-45ad-8793-2e07673320fc tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T10:08:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-83963923',display_name='tempest-AttachVolumeTestJSON-server-83963923',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-83963923',id=48,image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJXzPsBd7qGYyaZb6FflRdQkGeKTe15VJYOOicBN62pWfFwNeM5MDUu06fTurq1Q3swlWbSacoNNYmELLNWG6cLojtLhJVSsbh2TFSo9QcykLrjuhusRznBqFctWAQ+d2w==',key_name='tempest-keypair-580650650',keypairs=<?>,launch_index=0,launched_at=2023-11-14T10:08:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='be7eb95aea3e4897acbc9fe03aadb8e7',ramdisk_id='',reservation_id='r-mo2dg0yb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-775906619',owner_user_name='tempest-AttachVolumeTestJSON-775906619-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T10:14:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='707c03b04f664aab82260a037074de21',uuid=68d9de39-cbd2-44b2-bda8-015c8482c240,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "e62b2a49-c9cc-4568-b887-1c7884830ac2", "address": "fa:16:3e:f6:c6:5e", "network": {"id": "13b12b7e-2548-4256-8fb8-fccc67b1e18b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-698342503-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.41", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be7eb95aea3e4897acbc9fe03aadb8e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape62b2a49-c9", "ovs_interfaceid": "e62b2a49-c9cc-4568-b887-1c7884830ac2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 10:16:43 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-6ed8e071-0db4-45ad-8793-2e07673320fc tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Converting VIF {"id": "e62b2a49-c9cc-4568-b887-1c7884830ac2", "address": "fa:16:3e:f6:c6:5e", "network": {"id": "13b12b7e-2548-4256-8fb8-fccc67b1e18b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-698342503-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.41", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be7eb95aea3e4897acbc9fe03aadb8e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape62b2a49-c9", "ovs_interfaceid": "e62b2a49-c9cc-4568-b887-1c7884830ac2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 10:16:43 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-6ed8e071-0db4-45ad-8793-2e07673320fc tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f6:c6:5e,bridge_name='br-int',has_traffic_filtering=True,id=e62b2a49-c9cc-4568-b887-1c7884830ac2,network=Network(13b12b7e-2548-4256-8fb8-fccc67b1e18b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape62b2a49-c9') {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 10:16:43 user nova-compute[75229]: DEBUG os_vif [None req-6ed8e071-0db4-45ad-8793-2e07673320fc tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f6:c6:5e,bridge_name='br-int',has_traffic_filtering=True,id=e62b2a49-c9cc-4568-b887-1c7884830ac2,network=Network(13b12b7e-2548-4256-8fb8-fccc67b1e18b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape62b2a49-c9') {{(pid=75229) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 10:16:43 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:16:43 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 10:16:43 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 10:16:43 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:16:43 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1c7e9000-3b26-5871-98a1-cf71fdce72fe', '_type': 'linux-noop'}}, row=False) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 10:16:43 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:16:43 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 10:16:43 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:16:43 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape62b2a49-c9, may_exist=True, interface_attrs={}) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 10:16:43 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape62b2a49-c9, col_values=(('qos', UUID('51129e61-6972-4b46-8ef2-333a4685a13d')),), if_exists=True) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 10:16:43 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape62b2a49-c9, col_values=(('external_ids', {'iface-id': 'e62b2a49-c9cc-4568-b887-1c7884830ac2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f6:c6:5e', 'vm-uuid': '68d9de39-cbd2-44b2-bda8-015c8482c240'}),), if_exists=True) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 10:16:43 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:16:43 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 10:16:43 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:16:43 user nova-compute[75229]: INFO os_vif [None req-6ed8e071-0db4-45ad-8793-2e07673320fc tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f6:c6:5e,bridge_name='br-int',has_traffic_filtering=True,id=e62b2a49-c9cc-4568-b887-1c7884830ac2,network=Network(13b12b7e-2548-4256-8fb8-fccc67b1e18b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape62b2a49-c9')
Nov 14 10:16:44 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:16:44 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:16:44 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:16:45 user nova-compute[75229]: DEBUG nova.compute.manager [req-2d19ddf2-019d-4867-a350-2e52e0c1716e req-3953fec3-626a-4ad0-afd1-c96d4072366f service nova] [instance: 68d9de39-cbd2-44b2-bda8-015c8482c240] Received event network-vif-plugged-e62b2a49-c9cc-4568-b887-1c7884830ac2 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 10:16:45 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-2d19ddf2-019d-4867-a350-2e52e0c1716e req-3953fec3-626a-4ad0-afd1-c96d4072366f service nova] Acquiring lock "68d9de39-cbd2-44b2-bda8-015c8482c240-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:16:45 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-2d19ddf2-019d-4867-a350-2e52e0c1716e req-3953fec3-626a-4ad0-afd1-c96d4072366f service nova] Lock "68d9de39-cbd2-44b2-bda8-015c8482c240-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:16:45 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-2d19ddf2-019d-4867-a350-2e52e0c1716e req-3953fec3-626a-4ad0-afd1-c96d4072366f service nova] Lock "68d9de39-cbd2-44b2-bda8-015c8482c240-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:16:45 user nova-compute[75229]: DEBUG nova.compute.manager [req-2d19ddf2-019d-4867-a350-2e52e0c1716e req-3953fec3-626a-4ad0-afd1-c96d4072366f service nova] [instance: 68d9de39-cbd2-44b2-bda8-015c8482c240] No waiting events found dispatching network-vif-plugged-e62b2a49-c9cc-4568-b887-1c7884830ac2 {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 10:16:45 user nova-compute[75229]: WARNING nova.compute.manager [req-2d19ddf2-019d-4867-a350-2e52e0c1716e req-3953fec3-626a-4ad0-afd1-c96d4072366f service nova] [instance: 68d9de39-cbd2-44b2-bda8-015c8482c240] Received unexpected event network-vif-plugged-e62b2a49-c9cc-4568-b887-1c7884830ac2 for instance with vm_state stopped and task_state powering-on.
Nov 14 10:16:45 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:16:45 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:16:45 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:16:45 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:16:45 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:16:46 user nova-compute[75229]: DEBUG nova.compute.manager [None req-6ed8e071-0db4-45ad-8793-2e07673320fc tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] [instance: 68d9de39-cbd2-44b2-bda8-015c8482c240] Instance event wait completed in 0 seconds for  {{(pid=75229) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 10:16:46 user nova-compute[75229]: INFO nova.virt.libvirt.driver [-] [instance: 68d9de39-cbd2-44b2-bda8-015c8482c240] Instance rebooted successfully.
Nov 14 10:16:46 user nova-compute[75229]: DEBUG nova.compute.manager [None req-6ed8e071-0db4-45ad-8793-2e07673320fc tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] [instance: 68d9de39-cbd2-44b2-bda8-015c8482c240] Checking state {{(pid=75229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 10:16:47 user nova-compute[75229]: DEBUG nova.compute.manager [req-eff0ceff-2eb3-4ad9-9035-114cf27c50d1 req-dd87ae45-19e0-4128-b678-5beed8c20f8f service nova] [instance: 68d9de39-cbd2-44b2-bda8-015c8482c240] Received event network-vif-plugged-e62b2a49-c9cc-4568-b887-1c7884830ac2 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 10:16:47 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-eff0ceff-2eb3-4ad9-9035-114cf27c50d1 req-dd87ae45-19e0-4128-b678-5beed8c20f8f service nova] Acquiring lock "68d9de39-cbd2-44b2-bda8-015c8482c240-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:16:47 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-eff0ceff-2eb3-4ad9-9035-114cf27c50d1 req-dd87ae45-19e0-4128-b678-5beed8c20f8f service nova] Lock "68d9de39-cbd2-44b2-bda8-015c8482c240-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:16:47 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-eff0ceff-2eb3-4ad9-9035-114cf27c50d1 req-dd87ae45-19e0-4128-b678-5beed8c20f8f service nova] Lock "68d9de39-cbd2-44b2-bda8-015c8482c240-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:16:47 user nova-compute[75229]: DEBUG nova.compute.manager [req-eff0ceff-2eb3-4ad9-9035-114cf27c50d1 req-dd87ae45-19e0-4128-b678-5beed8c20f8f service nova] [instance: 68d9de39-cbd2-44b2-bda8-015c8482c240] No waiting events found dispatching network-vif-plugged-e62b2a49-c9cc-4568-b887-1c7884830ac2 {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 10:16:47 user nova-compute[75229]: WARNING nova.compute.manager [req-eff0ceff-2eb3-4ad9-9035-114cf27c50d1 req-dd87ae45-19e0-4128-b678-5beed8c20f8f service nova] [instance: 68d9de39-cbd2-44b2-bda8-015c8482c240] Received unexpected event network-vif-plugged-e62b2a49-c9cc-4568-b887-1c7884830ac2 for instance with vm_state active and task_state None.
Nov 14 10:16:48 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:16:49 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:16:53 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:16:58 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:17:03 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:17:04 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:17:08 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:17:08 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:17:08 user nova-compute[75229]: DEBUG nova.compute.manager [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Starting heal instance info cache {{(pid=75229) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 10:17:08 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Acquiring lock "refresh_cache-075ad651-31fd-4ee0-af86-fa8bef56d614" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 10:17:08 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Acquired lock "refresh_cache-075ad651-31fd-4ee0-af86-fa8bef56d614" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 10:17:08 user nova-compute[75229]: DEBUG nova.network.neutron [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] [instance: 075ad651-31fd-4ee0-af86-fa8bef56d614] Forcefully refreshing network info cache for instance {{(pid=75229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 10:17:09 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:17:09 user nova-compute[75229]: DEBUG nova.network.neutron [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] [instance: 075ad651-31fd-4ee0-af86-fa8bef56d614] Updating instance_info_cache with network_info: [{"id": "3d399542-6350-495b-9b54-13b21f7a99b8", "address": "fa:16:3e:bc:2b:a6", "network": {"id": "9fe5fa8c-b7e9-4f4f-88f1-e68567b67c3f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1670467158-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e94e4e374fb4329a0d1dd4cc8e3a2fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d399542-63", "ovs_interfaceid": "3d399542-6350-495b-9b54-13b21f7a99b8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 10:17:09 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Releasing lock "refresh_cache-075ad651-31fd-4ee0-af86-fa8bef56d614" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 10:17:09 user nova-compute[75229]: DEBUG nova.compute.manager [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] [instance: 075ad651-31fd-4ee0-af86-fa8bef56d614] Updated the network info_cache for instance {{(pid=75229) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 10:17:09 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:17:13 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:17:14 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:17:16 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:17:16 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:17:17 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:17:17 user nova-compute[75229]: DEBUG nova.compute.manager [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75229) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 10:17:18 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:17:18 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:17:19 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:17:21 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:17:21 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:17:21 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:17:21 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:17:21 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Auditing locally available compute resources for user (node: user) {{(pid=75229) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 10:17:21 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/075ad651-31fd-4ee0-af86-fa8bef56d614/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:17:22 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/075ad651-31fd-4ee0-af86-fa8bef56d614/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:17:22 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/075ad651-31fd-4ee0-af86-fa8bef56d614/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:17:22 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/075ad651-31fd-4ee0-af86-fa8bef56d614/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:17:22 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68d9de39-cbd2-44b2-bda8-015c8482c240/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:17:22 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68d9de39-cbd2-44b2-bda8-015c8482c240/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:17:22 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68d9de39-cbd2-44b2-bda8-015c8482c240/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:17:22 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68d9de39-cbd2-44b2-bda8-015c8482c240/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:17:22 user nova-compute[75229]: WARNING nova.virt.libvirt.driver [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 10:17:22 user nova-compute[75229]: WARNING nova.virt.libvirt.driver [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 10:17:22 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Hypervisor/Node resource view: name=user free_ram=8823MB free_disk=25.13011932373047GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75229) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 10:17:22 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:17:22 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:17:23 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Instance 68d9de39-cbd2-44b2-bda8-015c8482c240 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 10:17:23 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Instance 075ad651-31fd-4ee0-af86-fa8bef56d614 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 10:17:23 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75229) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 10:17:23 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75229) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 10:17:23 user nova-compute[75229]: DEBUG nova.compute.provider_tree [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Inventory has not changed in ProviderTree for provider: d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 {{(pid=75229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 10:17:23 user nova-compute[75229]: DEBUG nova.scheduler.client.report [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Inventory has not changed for provider d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 10:17:23 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Compute_service record updated for user:user {{(pid=75229) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 10:17:23 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.296s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:17:23 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 10:17:25 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:17:26 user nova-compute[75229]: DEBUG nova.compute.manager [req-ff8788a7-8623-4456-94c0-3b04afcb8ff5 req-6c2e4969-cf86-434b-9452-38bc62a83593 service nova] [instance: 075ad651-31fd-4ee0-af86-fa8bef56d614] Received event network-changed-3d399542-6350-495b-9b54-13b21f7a99b8 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 10:17:26 user nova-compute[75229]: DEBUG nova.compute.manager [req-ff8788a7-8623-4456-94c0-3b04afcb8ff5 req-6c2e4969-cf86-434b-9452-38bc62a83593 service nova] [instance: 075ad651-31fd-4ee0-af86-fa8bef56d614] Refreshing instance network info cache due to event network-changed-3d399542-6350-495b-9b54-13b21f7a99b8. {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 10:17:26 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-ff8788a7-8623-4456-94c0-3b04afcb8ff5 req-6c2e4969-cf86-434b-9452-38bc62a83593 service nova] Acquiring lock "refresh_cache-075ad651-31fd-4ee0-af86-fa8bef56d614" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 10:17:26 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-ff8788a7-8623-4456-94c0-3b04afcb8ff5 req-6c2e4969-cf86-434b-9452-38bc62a83593 service nova] Acquired lock "refresh_cache-075ad651-31fd-4ee0-af86-fa8bef56d614" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 10:17:26 user nova-compute[75229]: DEBUG nova.network.neutron [req-ff8788a7-8623-4456-94c0-3b04afcb8ff5 req-6c2e4969-cf86-434b-9452-38bc62a83593 service nova] [instance: 075ad651-31fd-4ee0-af86-fa8bef56d614] Refreshing network info cache for port 3d399542-6350-495b-9b54-13b21f7a99b8 {{(pid=75229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 10:17:26 user nova-compute[75229]: DEBUG nova.network.neutron [req-ff8788a7-8623-4456-94c0-3b04afcb8ff5 req-6c2e4969-cf86-434b-9452-38bc62a83593 service nova] [instance: 075ad651-31fd-4ee0-af86-fa8bef56d614] Updated VIF entry in instance network info cache for port 3d399542-6350-495b-9b54-13b21f7a99b8. {{(pid=75229) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 10:17:26 user nova-compute[75229]: DEBUG nova.network.neutron [req-ff8788a7-8623-4456-94c0-3b04afcb8ff5 req-6c2e4969-cf86-434b-9452-38bc62a83593 service nova] [instance: 075ad651-31fd-4ee0-af86-fa8bef56d614] Updating instance_info_cache with network_info: [{"id": "3d399542-6350-495b-9b54-13b21f7a99b8", "address": "fa:16:3e:bc:2b:a6", "network": {"id": "9fe5fa8c-b7e9-4f4f-88f1-e68567b67c3f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1670467158-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.122", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e94e4e374fb4329a0d1dd4cc8e3a2fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d399542-63", "ovs_interfaceid": "3d399542-6350-495b-9b54-13b21f7a99b8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 10:17:26 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-ff8788a7-8623-4456-94c0-3b04afcb8ff5 req-6c2e4969-cf86-434b-9452-38bc62a83593 service nova] Releasing lock "refresh_cache-075ad651-31fd-4ee0-af86-fa8bef56d614" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 10:17:28 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 10:17:28 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:17:28 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75229) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 10:17:28 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75229) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 10:17:28 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75229) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 10:17:28 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:17:28 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-a2398320-3fc6-4b0e-8f7e-069a192ae96e tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] Acquiring lock "075ad651-31fd-4ee0-af86-fa8bef56d614" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:17:28 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-a2398320-3fc6-4b0e-8f7e-069a192ae96e tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] Lock "075ad651-31fd-4ee0-af86-fa8bef56d614" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:17:28 user nova-compute[75229]: DEBUG nova.objects.instance [None req-a2398320-3fc6-4b0e-8f7e-069a192ae96e tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] Lazy-loading 'flavor' on Instance uuid 075ad651-31fd-4ee0-af86-fa8bef56d614 {{(pid=75229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 10:17:29 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-a2398320-3fc6-4b0e-8f7e-069a192ae96e tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] Lock "075ad651-31fd-4ee0-af86-fa8bef56d614" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.087s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:17:29 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-a2398320-3fc6-4b0e-8f7e-069a192ae96e tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] Acquiring lock "075ad651-31fd-4ee0-af86-fa8bef56d614" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:17:29 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-a2398320-3fc6-4b0e-8f7e-069a192ae96e tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] Lock "075ad651-31fd-4ee0-af86-fa8bef56d614" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:17:29 user nova-compute[75229]: INFO nova.compute.manager [None req-a2398320-3fc6-4b0e-8f7e-069a192ae96e tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] [instance: 075ad651-31fd-4ee0-af86-fa8bef56d614] Attaching volume 29d83bee-4c66-4124-aa43-ddff60460b40 to /dev/vdb
Nov 14 10:17:29 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:17:29 user nova-compute[75229]: DEBUG os_brick.utils [None req-a2398320-3fc6-4b0e-8f7e-069a192ae96e tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 10:17:29 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:17:29 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:17:29 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[f927e787-093e-4c3f-a8cc-0e6dfd012508]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f1154031c835\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:17:29 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:17:29 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:17:29 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1ffac90-740c-4ea2-ad6d-75090711c552]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:17:29 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:17:29 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:17:29 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[65f7e6f0-cea4-4997-8b84-139f8114d2cc]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:17:29 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[459befcd-6009-434c-84e0-c7aad50cfe08]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:17:29 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-a2398320-3fc6-4b0e-8f7e-069a192ae96e tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] Running cmd (subprocess): nvme version {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:17:29 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-a2398320-3fc6-4b0e-8f7e-069a192ae96e tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] 'nvme version' failed. Not Retrying. {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 10:17:29 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a2398320-3fc6-4b0e-8f7e-069a192ae96e tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] nvme not present on system {{(pid=75229) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 10:17:29 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:17:29 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 10:17:29 user nova-compute[75229]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 10:17:29 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[4662ac17-52cf-4af4-9477-d1f1199e9b4f]: (4, '') {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:17:29 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.lightos [None req-a2398320-3fc6-4b0e-8f7e-069a192ae96e tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75229) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 10:17:29 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.lightos [None req-a2398320-3fc6-4b0e-8f7e-069a192ae96e tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75229) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 10:17:29 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.lightos [None req-a2398320-3fc6-4b0e-8f7e-069a192ae96e tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] LIGHTOS: no hostnqn found. {{(pid=75229) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 10:17:29 user nova-compute[75229]: DEBUG os_brick.utils [None req-a2398320-3fc6-4b0e-8f7e-069a192ae96e tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f1154031c835', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 10:17:29 user nova-compute[75229]: DEBUG nova.virt.block_device [None req-a2398320-3fc6-4b0e-8f7e-069a192ae96e tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] [instance: 075ad651-31fd-4ee0-af86-fa8bef56d614] Updating existing volume attachment record: a551ee9b-a3d8-497d-876f-f9eaa0abce1e {{(pid=75229) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 10:17:33 user nova-compute[75229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a2398320-3fc6-4b0e-8f7e-069a192ae96e tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] [instance: 075ad651-31fd-4ee0-af86-fa8bef56d614] Calling os-brick to attach iSCSI Volume {{(pid=75229) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 10:17:33 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2398320-3fc6-4b0e-8f7e-069a192ae96e tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f73f85151b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:29d83bee-4c66-4124-aa43-ddff60460b40', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xIMCOgtJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 10:17:33 user nova-compute[75229]: WARNING os_brick.initiator.connectors.base [None req-a2398320-3fc6-4b0e-8f7e-069a192ae96e tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 10:17:33 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-a2398320-3fc6-4b0e-8f7e-069a192ae96e tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 10:17:33 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-a2398320-3fc6-4b0e-8f7e-069a192ae96e tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 10:17:33 user nova-compute[75229]: WARNING os_brick.initiator.connectors.base [None req-a2398320-3fc6-4b0e-8f7e-069a192ae96e tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 10:17:33 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-a2398320-3fc6-4b0e-8f7e-069a192ae96e tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:29d83bee-4c66-4124-aa43-ddff60460b40" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 10:17:33 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-a2398320-3fc6-4b0e-8f7e-069a192ae96e tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:29d83bee-4c66-4124-aa43-ddff60460b40" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 10:17:33 user nova-compute[75229]: INFO os_brick.initiator.connectors.iscsi [None req-a2398320-3fc6-4b0e-8f7e-069a192ae96e tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 10:17:33 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:29d83bee-4c66-4124-aa43-ddff60460b40 -p 172.16.0.220:3260 {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:17:33 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:29d83bee-4c66-4124-aa43-ddff60460b40 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:17:33 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b121aac-7f40-416b-97f0-5f819176acb0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:17:33 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2398320-3fc6-4b0e-8f7e-069a192ae96e tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 10:17:33 user nova-compute[75229]:  {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 10:17:33 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:29d83bee-4c66-4124-aa43-ddff60460b40 -p 172.16.0.220:3260 --interface default --op new {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:17:33 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:29d83bee-4c66-4124-aa43-ddff60460b40 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:17:33 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[8aa5fc78-faf8-4e3f-8195-e5f05b434acb]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:29d83bee-4c66-4124-aa43-ddff60460b40] added\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:17:33 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2398320-3fc6-4b0e-8f7e-069a192ae96e tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:29d83bee-4c66-4124-aa43-ddff60460b40] added
Nov 14 10:17:33 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 10:17:33 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:29d83bee-4c66-4124-aa43-ddff60460b40 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:17:33 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:29d83bee-4c66-4124-aa43-ddff60460b40 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:17:33 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4f280cf-17be-499c-88b1-5d2831792997]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:17:33 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2398320-3fc6-4b0e-8f7e-069a192ae96e tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 10:17:33 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:29d83bee-4c66-4124-aa43-ddff60460b40 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:17:33 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:29d83bee-4c66-4124-aa43-ddff60460b40 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:17:33 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ec271e8-4ff5-4704-a38b-6dc6db1e4ffc]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:17:33 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2398320-3fc6-4b0e-8f7e-069a192ae96e tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 10:17:33 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:29d83bee-4c66-4124-aa43-ddff60460b40 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xIMCOgtJ {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:17:33 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:29d83bee-4c66-4124-aa43-ddff60460b40 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xIMCOgtJ" returned: 0 in 0.020s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:17:33 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d759873-c894-4af9-90e1-c8ad1c977b22]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:17:33 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2398320-3fc6-4b0e-8f7e-069a192ae96e tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xIMCOgtJ'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 10:17:33 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:29d83bee-4c66-4124-aa43-ddff60460b40 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:17:33 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:29d83bee-4c66-4124-aa43-ddff60460b40 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:17:33 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[66bee8e1-f4f9-4dcd-82da-c2fbd1401699]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:17:33 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2398320-3fc6-4b0e-8f7e-069a192ae96e tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 10:17:33 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:17:33 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:17:33 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[18f91d5a-7cfb-43dc-977e-ef3c6ac1be73]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:17:33 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2398320-3fc6-4b0e-8f7e-069a192ae96e tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 14 10:17:33 user nova-compute[75229]:  {{(pid=75229) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 10:17:33 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2398320-3fc6-4b0e-8f7e-069a192ae96e tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 14 10:17:33 user nova-compute[75229]:  {{(pid=75229) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 10:17:33 user nova-compute[75229]: WARNING os_brick.initiator.connectors.iscsi [None req-a2398320-3fc6-4b0e-8f7e-069a192ae96e tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 14 10:17:33 user nova-compute[75229]: 
Nov 14 10:17:33 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:29d83bee-4c66-4124-aa43-ddff60460b40 -p 172.16.0.220:3260 --login {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:17:33 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:29d83bee-4c66-4124-aa43-ddff60460b40 -p 172.16.0.220:3260 --login" returned: 0 in 0.043s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:17:33 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d1aac97-ef62-4baf-929d-33c4c8b19008]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:29d83bee-4c66-4124-aa43-ddff60460b40, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:29d83bee-4c66-4124-aa43-ddff60460b40, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:17:33 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2398320-3fc6-4b0e-8f7e-069a192ae96e tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:29d83bee-4c66-4124-aa43-ddff60460b40, portal: 172.16.0.220,3260]
Nov 14 10:17:33 user nova-compute[75229]: Login to [iface: default, target: iqn.2010-10.org.openstack:29d83bee-4c66-4124-aa43-ddff60460b40, portal: 172.16.0.220,3260] successful.
Nov 14 10:17:33 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 10:17:33 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:29d83bee-4c66-4124-aa43-ddff60460b40 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:17:33 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:29d83bee-4c66-4124-aa43-ddff60460b40 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:17:33 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[279c0fd4-6d19-4446-ae0a-f5c6bcbaf456]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:17:33 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2398320-3fc6-4b0e-8f7e-069a192ae96e tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 10:17:33 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:17:33 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:17:33 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:17:33 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[135abd30-6c0b-49cb-85ec-9b475493e9f0]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29d83bee-4c66-4124-aa43-ddff60460b40 (non-flash)\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:17:33 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2398320-3fc6-4b0e-8f7e-069a192ae96e tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29d83bee-4c66-4124-aa43-ddff60460b40 (non-flash)
Nov 14 10:17:33 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 10:17:33 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2398320-3fc6-4b0e-8f7e-069a192ae96e tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29d83bee-4c66-4124-aa43-ddff60460b40 (non-flash)
Nov 14 10:17:33 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 10:17:33 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-a2398320-3fc6-4b0e-8f7e-069a192ae96e tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:29d83bee-4c66-4124-aa43-ddff60460b40" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.257s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 10:17:33 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2398320-3fc6-4b0e-8f7e-069a192ae96e tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] Connected to 172.16.0.220:3260 {{(pid=75229) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 10:17:33 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-a2398320-3fc6-4b0e-8f7e-069a192ae96e tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] HCTL ('33', '-', '-', 0) found on session 58 with lun 0 {{(pid=75229) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 10:17:33 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-a2398320-3fc6-4b0e-8f7e-069a192ae96e tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75229) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 10:17:33 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:17:33 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:17:33 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[feb11bd0-414d-4faa-be4b-805b0f69e543]: (4, ('- - 0', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:17:33 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-a2398320-3fc6-4b0e-8f7e-069a192ae96e tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] Searching for a device in session 58 and hctl ['33', '*', '*', 0] yield: None {{(pid=75229) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 10:17:34 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:17:34 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-a2398320-3fc6-4b0e-8f7e-069a192ae96e tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] Searching for a device in session 58 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75229) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 10:17:34 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2398320-3fc6-4b0e-8f7e-069a192ae96e tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:29d83bee-4c66-4124-aa43-ddff60460b40', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xIMCOgtJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75229) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 10:17:34 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-a2398320-3fc6-4b0e-8f7e-069a192ae96e tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.292s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 10:17:34 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2398320-3fc6-4b0e-8f7e-069a192ae96e tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] <== connect_volume: return (1294ms) {'type': 'block', 'scsi_wwn': '23035326333616663', 'path': '/dev/sdb'} {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 10:17:34 user nova-compute[75229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a2398320-3fc6-4b0e-8f7e-069a192ae96e tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] [instance: 075ad651-31fd-4ee0-af86-fa8bef56d614] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23035326333616663', 'path': '/dev/sdb'} {{(pid=75229) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 10:17:34 user nova-compute[75229]: DEBUG nova.objects.instance [None req-a2398320-3fc6-4b0e-8f7e-069a192ae96e tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] Lazy-loading 'flavor' on Instance uuid 075ad651-31fd-4ee0-af86-fa8bef56d614 {{(pid=75229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 10:17:34 user nova-compute[75229]: DEBUG nova.virt.libvirt.guest [None req-a2398320-3fc6-4b0e-8f7e-069a192ae96e tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 10:17:34 user nova-compute[75229]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 10:17:34 user nova-compute[75229]:   <source dev="/dev/sdb"/>
Nov 14 10:17:34 user nova-compute[75229]:   <target dev="vdb" bus="virtio"/>
Nov 14 10:17:34 user nova-compute[75229]:   <serial>29d83bee-4c66-4124-aa43-ddff60460b40</serial>
Nov 14 10:17:34 user nova-compute[75229]: </disk>
Nov 14 10:17:34 user nova-compute[75229]:  {{(pid=75229) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 10:17:35 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-a2398320-3fc6-4b0e-8f7e-069a192ae96e tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] No BDM found with device name vda, not building metadata. {{(pid=75229) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 10:17:35 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-a2398320-3fc6-4b0e-8f7e-069a192ae96e tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75229) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 10:17:35 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-a2398320-3fc6-4b0e-8f7e-069a192ae96e tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] No VIF found with MAC fa:16:3e:bc:2b:a6, not building metadata {{(pid=75229) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 10:17:35 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-a2398320-3fc6-4b0e-8f7e-069a192ae96e tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] Lock "075ad651-31fd-4ee0-af86-fa8bef56d614" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.109s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:17:38 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:17:39 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:17:42 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-709c2432-8ffb-4342-90ca-bc83f3dc0f14 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] Acquiring lock "075ad651-31fd-4ee0-af86-fa8bef56d614" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:17:42 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-709c2432-8ffb-4342-90ca-bc83f3dc0f14 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] Lock "075ad651-31fd-4ee0-af86-fa8bef56d614" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:17:42 user nova-compute[75229]: INFO nova.compute.manager [None req-709c2432-8ffb-4342-90ca-bc83f3dc0f14 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] [instance: 075ad651-31fd-4ee0-af86-fa8bef56d614] Detaching volume 29d83bee-4c66-4124-aa43-ddff60460b40
Nov 14 10:17:42 user nova-compute[75229]: INFO nova.virt.block_device [None req-709c2432-8ffb-4342-90ca-bc83f3dc0f14 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] [instance: 075ad651-31fd-4ee0-af86-fa8bef56d614] Attempting to driver detach volume 29d83bee-4c66-4124-aa43-ddff60460b40 from mountpoint /dev/vdb
Nov 14 10:17:42 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-709c2432-8ffb-4342-90ca-bc83f3dc0f14 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] Attempting to detach device vdb from instance 075ad651-31fd-4ee0-af86-fa8bef56d614 from the persistent domain config. {{(pid=75229) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 10:17:42 user nova-compute[75229]: DEBUG nova.virt.libvirt.guest [None req-709c2432-8ffb-4342-90ca-bc83f3dc0f14 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 10:17:42 user nova-compute[75229]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 10:17:42 user nova-compute[75229]:   <source dev="/dev/sdb"/>
Nov 14 10:17:42 user nova-compute[75229]:   <target dev="vdb" bus="virtio"/>
Nov 14 10:17:42 user nova-compute[75229]:   <serial>29d83bee-4c66-4124-aa43-ddff60460b40</serial>
Nov 14 10:17:42 user nova-compute[75229]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 10:17:42 user nova-compute[75229]: </disk>
Nov 14 10:17:42 user nova-compute[75229]:  {{(pid=75229) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 10:17:42 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-709c2432-8ffb-4342-90ca-bc83f3dc0f14 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] Successfully detached device vdb from instance 075ad651-31fd-4ee0-af86-fa8bef56d614 from the persistent domain config.
Nov 14 10:17:42 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-709c2432-8ffb-4342-90ca-bc83f3dc0f14 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 075ad651-31fd-4ee0-af86-fa8bef56d614 from the live domain config. {{(pid=75229) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 10:17:42 user nova-compute[75229]: DEBUG nova.virt.libvirt.guest [None req-709c2432-8ffb-4342-90ca-bc83f3dc0f14 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 10:17:42 user nova-compute[75229]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 10:17:42 user nova-compute[75229]:   <source dev="/dev/sdb"/>
Nov 14 10:17:42 user nova-compute[75229]:   <target dev="vdb" bus="virtio"/>
Nov 14 10:17:42 user nova-compute[75229]:   <serial>29d83bee-4c66-4124-aa43-ddff60460b40</serial>
Nov 14 10:17:42 user nova-compute[75229]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 10:17:42 user nova-compute[75229]: </disk>
Nov 14 10:17:42 user nova-compute[75229]:  {{(pid=75229) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 10:17:43 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-709c2432-8ffb-4342-90ca-bc83f3dc0f14 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 075ad651-31fd-4ee0-af86-fa8bef56d614 {{(pid=75229) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 10:17:43 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:17:44 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:17:48 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:17:53 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 10:17:53 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 10:17:53 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75229) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 10:17:53 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75229) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 10:17:53 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75229) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 10:17:53 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:17:58 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 10:17:58 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 10:17:58 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75229) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 10:17:58 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75229) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 10:17:58 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:17:58 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75229) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 10:17:59 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:18:03 user nova-compute[75229]: WARNING nova.virt.libvirt.driver [None req-709c2432-8ffb-4342-90ca-bc83f3dc0f14 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 075ad651-31fd-4ee0-af86-fa8bef56d614 is timed out.
Nov 14 10:18:03 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-709c2432-8ffb-4342-90ca-bc83f3dc0f14 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] Successfully detached device vdb from instance 075ad651-31fd-4ee0-af86-fa8bef56d614 from the live domain config.
Nov 14 10:18:03 user nova-compute[75229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-709c2432-8ffb-4342-90ca-bc83f3dc0f14 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] [instance: 075ad651-31fd-4ee0-af86-fa8bef56d614] calling os-brick to detach iSCSI Volume {{(pid=75229) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 10:18:03 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-709c2432-8ffb-4342-90ca-bc83f3dc0f14 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f73f85151b0>, {'target_iqn': 'iqn.2010-10.org.openstack:29d83bee-4c66-4124-aa43-ddff60460b40', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xIMCOgtJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 10:18:03 user nova-compute[75229]: WARNING os_brick.initiator.connectors.base [None req-709c2432-8ffb-4342-90ca-bc83f3dc0f14 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 10:18:03 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-709c2432-8ffb-4342-90ca-bc83f3dc0f14 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 10:18:03 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-709c2432-8ffb-4342-90ca-bc83f3dc0f14 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 10:18:03 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:18:03 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:18:03 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[482c88f4-0682-4516-ba95-c98b33de5d93]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:29d83bee-4c66-4124-aa43-ddff60460b40\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:18:03 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-709c2432-8ffb-4342-90ca-bc83f3dc0f14 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 10:18:03 user nova-compute[75229]: No targets found.
Nov 14 10:18:03 user nova-compute[75229]: iSNS:
Nov 14 10:18:03 user nova-compute[75229]: No targets found.
Nov 14 10:18:03 user nova-compute[75229]: STATIC:
Nov 14 10:18:03 user nova-compute[75229]: Target: iqn.2010-10.org.openstack:29d83bee-4c66-4124-aa43-ddff60460b40
Nov 14 10:18:03 user nova-compute[75229]:         Portal: 172.16.0.220:3260,-1
Nov 14 10:18:03 user nova-compute[75229]:                 Iface Name: default
Nov 14 10:18:03 user nova-compute[75229]: FIRMWARE:
Nov 14 10:18:03 user nova-compute[75229]: No targets found.
Nov 14 10:18:03 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 10:18:03 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-709c2432-8ffb-4342-90ca-bc83f3dc0f14 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 10:18:03 user nova-compute[75229]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 10:18:03 user nova-compute[75229]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75229) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 10:18:03 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-709c2432-8ffb-4342-90ca-bc83f3dc0f14 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:29d83bee-4c66-4124-aa43-ddff60460b40', 0)] {{(pid=75229) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 10:18:03 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:18:03 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:18:03 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[d471bae5-160b-4916-bab8-75b6c21729f4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:29d83bee-4c66-4124-aa43-ddff60460b40\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:18:03 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:18:03 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:18:03 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc08afad-3897-4b0f-8a7b-556a1f7aca93]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29d83bee-4c66-4124-aa43-ddff60460b40 (non-flash)\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:18:03 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-709c2432-8ffb-4342-90ca-bc83f3dc0f14 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29d83bee-4c66-4124-aa43-ddff60460b40 (non-flash)
Nov 14 10:18:03 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 10:18:03 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-709c2432-8ffb-4342-90ca-bc83f3dc0f14 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29d83bee-4c66-4124-aa43-ddff60460b40 (non-flash)
Nov 14 10:18:03 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 10:18:03 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-709c2432-8ffb-4342-90ca-bc83f3dc0f14 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f73d4b38dc0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:29d83bee-4c66-4124-aa43-ddff60460b40'): ({'sdb'}, set())}) {{(pid=75229) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 10:18:03 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-709c2432-8ffb-4342-90ca-bc83f3dc0f14 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] Removing single pathed devices sdb {{(pid=75229) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 10:18:03 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:18:03 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:18:03 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[41efc738-f22a-4d5e-bf06-95c28b818069]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:18:03 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:18:03 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:18:03 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[2992b220-d645-4715-9bb5-6b457852b403]: (4, ('ok\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:18:03 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-709c2432-8ffb-4342-90ca-bc83f3dc0f14 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] Flushing IO for device /dev/sdb {{(pid=75229) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 10:18:03 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:18:03 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:18:03 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8471f0d-e132-439e-adf5-490a7bd9c05e]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:18:03 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-709c2432-8ffb-4342-90ca-bc83f3dc0f14 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75229) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 10:18:03 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:18:03 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.042s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:18:03 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fb49fdf-9dbd-4af8-b12a-7c8e7153b139]: (4, ('1', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:18:03 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-709c2432-8ffb-4342-90ca-bc83f3dc0f14 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75229) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 10:18:03 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-709c2432-8ffb-4342-90ca-bc83f3dc0f14 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] SCSI volumes sdb have been removed. {{(pid=75229) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 10:18:03 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-709c2432-8ffb-4342-90ca-bc83f3dc0f14 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:29d83bee-4c66-4124-aa43-ddff60460b40')] {{(pid=75229) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 10:18:03 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:29d83bee-4c66-4124-aa43-ddff60460b40 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:18:03 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:29d83bee-4c66-4124-aa43-ddff60460b40 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:18:03 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[26c38df0-1844-4f09-a916-5cdc36a9c710]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:18:03 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-709c2432-8ffb-4342-90ca-bc83f3dc0f14 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 10:18:03 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:29d83bee-4c66-4124-aa43-ddff60460b40 -p 172.16.0.220:3260 --logout {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:18:03 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:29d83bee-4c66-4124-aa43-ddff60460b40 -p 172.16.0.220:3260 --logout" returned: 0 in 0.044s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:18:03 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[000cd16f-df2b-4e29-aced-c49f64144e1d]: (4, ('Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:29d83bee-4c66-4124-aa43-ddff60460b40, portal: 172.16.0.220,3260]\nLogout of [sid: 58, target: iqn.2010-10.org.openstack:29d83bee-4c66-4124-aa43-ddff60460b40, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:18:03 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-709c2432-8ffb-4342-90ca-bc83f3dc0f14 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:29d83bee-4c66-4124-aa43-ddff60460b40, portal: 172.16.0.220,3260]
Nov 14 10:18:03 user nova-compute[75229]: Logout of [sid: 58, target: iqn.2010-10.org.openstack:29d83bee-4c66-4124-aa43-ddff60460b40, portal: 172.16.0.220,3260] successful.
Nov 14 10:18:03 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 10:18:03 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:29d83bee-4c66-4124-aa43-ddff60460b40 -p 172.16.0.220:3260 --op delete {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:18:03 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:29d83bee-4c66-4124-aa43-ddff60460b40 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:18:03 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d2879cd-faca-4699-bfad-c10db5f3a911]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:18:03 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-709c2432-8ffb-4342-90ca-bc83f3dc0f14 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 10:18:03 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-709c2432-8ffb-4342-90ca-bc83f3dc0f14 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.278s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 10:18:03 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-709c2432-8ffb-4342-90ca-bc83f3dc0f14 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] <== disconnect_volume: return (278ms) None {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 10:18:03 user nova-compute[75229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-709c2432-8ffb-4342-90ca-bc83f3dc0f14 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] [instance: 075ad651-31fd-4ee0-af86-fa8bef56d614] Disconnected iSCSI Volume {{(pid=75229) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 10:18:03 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:18:04 user nova-compute[75229]: DEBUG nova.objects.instance [None req-709c2432-8ffb-4342-90ca-bc83f3dc0f14 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] Lazy-loading 'flavor' on Instance uuid 075ad651-31fd-4ee0-af86-fa8bef56d614 {{(pid=75229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 10:18:04 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-709c2432-8ffb-4342-90ca-bc83f3dc0f14 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] Lock "075ad651-31fd-4ee0-af86-fa8bef56d614" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.627s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:18:08 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:18:09 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:18:09 user nova-compute[75229]: DEBUG nova.compute.manager [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Starting heal instance info cache {{(pid=75229) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 10:18:09 user nova-compute[75229]: DEBUG nova.compute.manager [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Rebuilding the list of instances to heal {{(pid=75229) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 10:18:09 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Acquiring lock "refresh_cache-68d9de39-cbd2-44b2-bda8-015c8482c240" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 10:18:09 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Acquired lock "refresh_cache-68d9de39-cbd2-44b2-bda8-015c8482c240" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 10:18:09 user nova-compute[75229]: DEBUG nova.network.neutron [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] [instance: 68d9de39-cbd2-44b2-bda8-015c8482c240] Forcefully refreshing network info cache for instance {{(pid=75229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 10:18:09 user nova-compute[75229]: DEBUG nova.objects.instance [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Lazy-loading 'info_cache' on Instance uuid 68d9de39-cbd2-44b2-bda8-015c8482c240 {{(pid=75229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 10:18:10 user nova-compute[75229]: DEBUG nova.network.neutron [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] [instance: 68d9de39-cbd2-44b2-bda8-015c8482c240] Updating instance_info_cache with network_info: [{"id": "e62b2a49-c9cc-4568-b887-1c7884830ac2", "address": "fa:16:3e:f6:c6:5e", "network": {"id": "13b12b7e-2548-4256-8fb8-fccc67b1e18b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-698342503-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.41", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be7eb95aea3e4897acbc9fe03aadb8e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape62b2a49-c9", "ovs_interfaceid": "e62b2a49-c9cc-4568-b887-1c7884830ac2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 10:18:10 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Releasing lock "refresh_cache-68d9de39-cbd2-44b2-bda8-015c8482c240" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 10:18:10 user nova-compute[75229]: DEBUG nova.compute.manager [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] [instance: 68d9de39-cbd2-44b2-bda8-015c8482c240] Updated the network info_cache for instance {{(pid=75229) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 10:18:10 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:18:13 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 10:18:16 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:18:17 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:18:17 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:18:17 user nova-compute[75229]: DEBUG nova.compute.manager [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75229) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 10:18:18 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 10:18:18 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:18:18 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75229) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 10:18:18 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75229) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 10:18:18 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75229) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 10:18:18 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:18:18 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:18:21 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:18:22 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:18:22 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:18:22 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:18:22 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:18:22 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Auditing locally available compute resources for user (node: user) {{(pid=75229) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 10:18:22 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/075ad651-31fd-4ee0-af86-fa8bef56d614/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:18:23 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/075ad651-31fd-4ee0-af86-fa8bef56d614/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:18:23 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/075ad651-31fd-4ee0-af86-fa8bef56d614/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:18:23 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/075ad651-31fd-4ee0-af86-fa8bef56d614/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:18:23 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68d9de39-cbd2-44b2-bda8-015c8482c240/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:18:23 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68d9de39-cbd2-44b2-bda8-015c8482c240/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:18:23 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68d9de39-cbd2-44b2-bda8-015c8482c240/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:18:23 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68d9de39-cbd2-44b2-bda8-015c8482c240/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:18:24 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:18:24 user nova-compute[75229]: WARNING nova.virt.libvirt.driver [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 10:18:24 user nova-compute[75229]: WARNING nova.virt.libvirt.driver [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 10:18:24 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Hypervisor/Node resource view: name=user free_ram=8908MB free_disk=25.128765106201172GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75229) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 10:18:24 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:18:24 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:18:24 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Instance 68d9de39-cbd2-44b2-bda8-015c8482c240 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 10:18:24 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Instance 075ad651-31fd-4ee0-af86-fa8bef56d614 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 10:18:24 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75229) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 10:18:24 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75229) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 10:18:24 user nova-compute[75229]: DEBUG nova.compute.provider_tree [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Inventory has not changed in ProviderTree for provider: d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 {{(pid=75229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 10:18:24 user nova-compute[75229]: DEBUG nova.scheduler.client.report [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Inventory has not changed for provider d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 10:18:24 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Compute_service record updated for user:user {{(pid=75229) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 10:18:24 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.188s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:18:27 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:18:29 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 10:18:29 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 10:18:29 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75229) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 10:18:29 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75229) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 10:18:29 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75229) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 10:18:29 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 10:18:33 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-8275eaa5-ddc0-4c69-be16-dec05b2f31d8 tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Acquiring lock "68d9de39-cbd2-44b2-bda8-015c8482c240" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:18:33 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-8275eaa5-ddc0-4c69-be16-dec05b2f31d8 tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Lock "68d9de39-cbd2-44b2-bda8-015c8482c240" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:18:33 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-8275eaa5-ddc0-4c69-be16-dec05b2f31d8 tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Acquiring lock "68d9de39-cbd2-44b2-bda8-015c8482c240-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:18:33 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-8275eaa5-ddc0-4c69-be16-dec05b2f31d8 tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Lock "68d9de39-cbd2-44b2-bda8-015c8482c240-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:18:33 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-8275eaa5-ddc0-4c69-be16-dec05b2f31d8 tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Lock "68d9de39-cbd2-44b2-bda8-015c8482c240-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:18:33 user nova-compute[75229]: INFO nova.compute.manager [None req-8275eaa5-ddc0-4c69-be16-dec05b2f31d8 tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] [instance: 68d9de39-cbd2-44b2-bda8-015c8482c240] Terminating instance
Nov 14 10:18:33 user nova-compute[75229]: DEBUG nova.compute.manager [None req-8275eaa5-ddc0-4c69-be16-dec05b2f31d8 tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] [instance: 68d9de39-cbd2-44b2-bda8-015c8482c240] Start destroying the instance on the hypervisor. {{(pid=75229) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 10:18:33 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:18:33 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:18:33 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:18:33 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:18:33 user nova-compute[75229]: DEBUG nova.compute.manager [req-127c1117-41bf-45ef-b3fb-30779f550d69 req-3a2fb0fb-7c14-4dd2-be89-53e24ad544a5 service nova] [instance: 68d9de39-cbd2-44b2-bda8-015c8482c240] Received event network-vif-unplugged-e62b2a49-c9cc-4568-b887-1c7884830ac2 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 10:18:33 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-127c1117-41bf-45ef-b3fb-30779f550d69 req-3a2fb0fb-7c14-4dd2-be89-53e24ad544a5 service nova] Acquiring lock "68d9de39-cbd2-44b2-bda8-015c8482c240-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:18:33 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-127c1117-41bf-45ef-b3fb-30779f550d69 req-3a2fb0fb-7c14-4dd2-be89-53e24ad544a5 service nova] Lock "68d9de39-cbd2-44b2-bda8-015c8482c240-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:18:33 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-127c1117-41bf-45ef-b3fb-30779f550d69 req-3a2fb0fb-7c14-4dd2-be89-53e24ad544a5 service nova] Lock "68d9de39-cbd2-44b2-bda8-015c8482c240-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:18:33 user nova-compute[75229]: DEBUG nova.compute.manager [req-127c1117-41bf-45ef-b3fb-30779f550d69 req-3a2fb0fb-7c14-4dd2-be89-53e24ad544a5 service nova] [instance: 68d9de39-cbd2-44b2-bda8-015c8482c240] No waiting events found dispatching network-vif-unplugged-e62b2a49-c9cc-4568-b887-1c7884830ac2 {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 10:18:33 user nova-compute[75229]: DEBUG nova.compute.manager [req-127c1117-41bf-45ef-b3fb-30779f550d69 req-3a2fb0fb-7c14-4dd2-be89-53e24ad544a5 service nova] [instance: 68d9de39-cbd2-44b2-bda8-015c8482c240] Received event network-vif-unplugged-e62b2a49-c9cc-4568-b887-1c7884830ac2 for instance with task_state deleting. {{(pid=75229) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 10:18:33 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:18:33 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:18:33 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:18:33 user nova-compute[75229]: INFO nova.virt.libvirt.driver [-] [instance: 68d9de39-cbd2-44b2-bda8-015c8482c240] Instance destroyed successfully.
Nov 14 10:18:33 user nova-compute[75229]: DEBUG nova.objects.instance [None req-8275eaa5-ddc0-4c69-be16-dec05b2f31d8 tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Lazy-loading 'resources' on Instance uuid 68d9de39-cbd2-44b2-bda8-015c8482c240 {{(pid=75229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 10:18:33 user nova-compute[75229]: DEBUG nova.virt.libvirt.vif [None req-8275eaa5-ddc0-4c69-be16-dec05b2f31d8 tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T10:08:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-83963923',display_name='tempest-AttachVolumeTestJSON-server-83963923',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-83963923',id=48,image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJXzPsBd7qGYyaZb6FflRdQkGeKTe15VJYOOicBN62pWfFwNeM5MDUu06fTurq1Q3swlWbSacoNNYmELLNWG6cLojtLhJVSsbh2TFSo9QcykLrjuhusRznBqFctWAQ+d2w==',key_name='tempest-keypair-580650650',keypairs=<?>,launch_index=0,launched_at=2023-11-14T10:08:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='be7eb95aea3e4897acbc9fe03aadb8e7',ramdisk_id='',reservation_id='r-mo2dg0yb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-775906619',owner_user_name='tempest-AttachVolumeTestJSON-775906619-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T10:16:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='707c03b04f664aab82260a037074de21',uuid=68d9de39-cbd2-44b2-bda8-015c8482c240,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e62b2a49-c9cc-4568-b887-1c7884830ac2", "address": "fa:16:3e:f6:c6:5e", "network": {"id": "13b12b7e-2548-4256-8fb8-fccc67b1e18b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-698342503-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.41", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be7eb95aea3e4897acbc9fe03aadb8e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape62b2a49-c9", "ovs_interfaceid": "e62b2a49-c9cc-4568-b887-1c7884830ac2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 10:18:33 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-8275eaa5-ddc0-4c69-be16-dec05b2f31d8 tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Converting VIF {"id": "e62b2a49-c9cc-4568-b887-1c7884830ac2", "address": "fa:16:3e:f6:c6:5e", "network": {"id": "13b12b7e-2548-4256-8fb8-fccc67b1e18b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-698342503-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.41", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be7eb95aea3e4897acbc9fe03aadb8e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape62b2a49-c9", "ovs_interfaceid": "e62b2a49-c9cc-4568-b887-1c7884830ac2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 10:18:33 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-8275eaa5-ddc0-4c69-be16-dec05b2f31d8 tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f6:c6:5e,bridge_name='br-int',has_traffic_filtering=True,id=e62b2a49-c9cc-4568-b887-1c7884830ac2,network=Network(13b12b7e-2548-4256-8fb8-fccc67b1e18b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape62b2a49-c9') {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 10:18:33 user nova-compute[75229]: DEBUG os_vif [None req-8275eaa5-ddc0-4c69-be16-dec05b2f31d8 tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f6:c6:5e,bridge_name='br-int',has_traffic_filtering=True,id=e62b2a49-c9cc-4568-b887-1c7884830ac2,network=Network(13b12b7e-2548-4256-8fb8-fccc67b1e18b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape62b2a49-c9') {{(pid=75229) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 10:18:33 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:18:33 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape62b2a49-c9, bridge=br-int, if_exists=True) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 10:18:33 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:18:33 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:18:33 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:18:33 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=51129e61-6972-4b46-8ef2-333a4685a13d) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 10:18:33 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:18:33 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 10:18:33 user nova-compute[75229]: INFO os_vif [None req-8275eaa5-ddc0-4c69-be16-dec05b2f31d8 tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f6:c6:5e,bridge_name='br-int',has_traffic_filtering=True,id=e62b2a49-c9cc-4568-b887-1c7884830ac2,network=Network(13b12b7e-2548-4256-8fb8-fccc67b1e18b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape62b2a49-c9')
Nov 14 10:18:33 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-8275eaa5-ddc0-4c69-be16-dec05b2f31d8 tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] [instance: 68d9de39-cbd2-44b2-bda8-015c8482c240] Deleting instance files /opt/stack/data/nova/instances/68d9de39-cbd2-44b2-bda8-015c8482c240_del
Nov 14 10:18:33 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-8275eaa5-ddc0-4c69-be16-dec05b2f31d8 tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] [instance: 68d9de39-cbd2-44b2-bda8-015c8482c240] Deletion of /opt/stack/data/nova/instances/68d9de39-cbd2-44b2-bda8-015c8482c240_del complete
Nov 14 10:18:34 user nova-compute[75229]: INFO nova.compute.manager [None req-8275eaa5-ddc0-4c69-be16-dec05b2f31d8 tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] [instance: 68d9de39-cbd2-44b2-bda8-015c8482c240] Took 0.66 seconds to destroy the instance on the hypervisor.
Nov 14 10:18:34 user nova-compute[75229]: DEBUG oslo.service.loopingcall [None req-8275eaa5-ddc0-4c69-be16-dec05b2f31d8 tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75229) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 10:18:34 user nova-compute[75229]: DEBUG nova.compute.manager [-] [instance: 68d9de39-cbd2-44b2-bda8-015c8482c240] Deallocating network for instance {{(pid=75229) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 10:18:34 user nova-compute[75229]: DEBUG nova.network.neutron [-] [instance: 68d9de39-cbd2-44b2-bda8-015c8482c240] deallocate_for_instance() {{(pid=75229) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 10:18:34 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:18:34 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-9ad3b8ae-4fc8-46de-a622-a851c930923d tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] Acquiring lock "075ad651-31fd-4ee0-af86-fa8bef56d614" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:18:34 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-9ad3b8ae-4fc8-46de-a622-a851c930923d tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] Lock "075ad651-31fd-4ee0-af86-fa8bef56d614" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:18:34 user nova-compute[75229]: DEBUG nova.objects.instance [None req-9ad3b8ae-4fc8-46de-a622-a851c930923d tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] Lazy-loading 'flavor' on Instance uuid 075ad651-31fd-4ee0-af86-fa8bef56d614 {{(pid=75229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 10:18:34 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-9ad3b8ae-4fc8-46de-a622-a851c930923d tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] Lock "075ad651-31fd-4ee0-af86-fa8bef56d614" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.047s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:18:34 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:18:34 user nova-compute[75229]: DEBUG nova.network.neutron [-] [instance: 68d9de39-cbd2-44b2-bda8-015c8482c240] Updating instance_info_cache with network_info: [] {{(pid=75229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 10:18:34 user nova-compute[75229]: INFO nova.compute.manager [-] [instance: 68d9de39-cbd2-44b2-bda8-015c8482c240] Took 0.78 seconds to deallocate network for instance.
Nov 14 10:18:34 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-9ad3b8ae-4fc8-46de-a622-a851c930923d tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] Acquiring lock "075ad651-31fd-4ee0-af86-fa8bef56d614" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:18:34 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-9ad3b8ae-4fc8-46de-a622-a851c930923d tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] Lock "075ad651-31fd-4ee0-af86-fa8bef56d614" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:18:34 user nova-compute[75229]: INFO nova.compute.manager [None req-9ad3b8ae-4fc8-46de-a622-a851c930923d tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] [instance: 075ad651-31fd-4ee0-af86-fa8bef56d614] Attaching volume c646146f-53a3-406d-a322-86cccd726699 to /dev/vdb
Nov 14 10:18:34 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-8275eaa5-ddc0-4c69-be16-dec05b2f31d8 tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:18:34 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-8275eaa5-ddc0-4c69-be16-dec05b2f31d8 tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:18:34 user nova-compute[75229]: DEBUG os_brick.utils [None req-9ad3b8ae-4fc8-46de-a622-a851c930923d tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 10:18:34 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:18:34 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:18:34 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee7f5949-78e3-4484-9682-7319056a308b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f1154031c835\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:18:34 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:18:34 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:18:34 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3fcd803-ebbb-4c80-9392-b11bdc1e7f0c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:18:34 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:18:34 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:18:34 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[851a61ab-9b69-4d25-811e-c354f2a0bfc5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:18:34 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[608791d2-039c-41f3-b741-3b6df18a0939]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:18:34 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-9ad3b8ae-4fc8-46de-a622-a851c930923d tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] Running cmd (subprocess): nvme version {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:18:34 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-9ad3b8ae-4fc8-46de-a622-a851c930923d tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] 'nvme version' failed. Not Retrying. {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 10:18:34 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9ad3b8ae-4fc8-46de-a622-a851c930923d tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] nvme not present on system {{(pid=75229) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 10:18:34 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:18:34 user nova-compute[75229]: DEBUG nova.compute.provider_tree [None req-8275eaa5-ddc0-4c69-be16-dec05b2f31d8 tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Inventory has not changed in ProviderTree for provider: d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 {{(pid=75229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 10:18:34 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 10:18:34 user nova-compute[75229]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 10:18:34 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cb883ad-c4f7-4e88-8410-8e0d1f251447]: (4, '') {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:18:34 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.lightos [None req-9ad3b8ae-4fc8-46de-a622-a851c930923d tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75229) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 10:18:34 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.lightos [None req-9ad3b8ae-4fc8-46de-a622-a851c930923d tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75229) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 10:18:34 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.lightos [None req-9ad3b8ae-4fc8-46de-a622-a851c930923d tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] LIGHTOS: no hostnqn found. {{(pid=75229) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 10:18:34 user nova-compute[75229]: DEBUG os_brick.utils [None req-9ad3b8ae-4fc8-46de-a622-a851c930923d tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f1154031c835', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 10:18:34 user nova-compute[75229]: DEBUG nova.virt.block_device [None req-9ad3b8ae-4fc8-46de-a622-a851c930923d tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] [instance: 075ad651-31fd-4ee0-af86-fa8bef56d614] Updating existing volume attachment record: cc23181d-4620-4352-9e2e-ba557e49a71b {{(pid=75229) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 10:18:35 user nova-compute[75229]: DEBUG nova.scheduler.client.report [None req-8275eaa5-ddc0-4c69-be16-dec05b2f31d8 tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Inventory has not changed for provider d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 10:18:35 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-8275eaa5-ddc0-4c69-be16-dec05b2f31d8 tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.226s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:18:35 user nova-compute[75229]: INFO nova.scheduler.client.report [None req-8275eaa5-ddc0-4c69-be16-dec05b2f31d8 tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Deleted allocations for instance 68d9de39-cbd2-44b2-bda8-015c8482c240
Nov 14 10:18:35 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-8275eaa5-ddc0-4c69-be16-dec05b2f31d8 tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Lock "68d9de39-cbd2-44b2-bda8-015c8482c240" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.855s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:18:35 user nova-compute[75229]: DEBUG nova.compute.manager [req-aaf65d07-70fb-4855-bdc8-8d1154f0b8a9 req-89fea4b9-545d-472d-839e-498b1942c809 service nova] [instance: 68d9de39-cbd2-44b2-bda8-015c8482c240] Received event network-vif-plugged-e62b2a49-c9cc-4568-b887-1c7884830ac2 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 10:18:35 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-aaf65d07-70fb-4855-bdc8-8d1154f0b8a9 req-89fea4b9-545d-472d-839e-498b1942c809 service nova] Acquiring lock "68d9de39-cbd2-44b2-bda8-015c8482c240-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:18:35 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-aaf65d07-70fb-4855-bdc8-8d1154f0b8a9 req-89fea4b9-545d-472d-839e-498b1942c809 service nova] Lock "68d9de39-cbd2-44b2-bda8-015c8482c240-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:18:35 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-aaf65d07-70fb-4855-bdc8-8d1154f0b8a9 req-89fea4b9-545d-472d-839e-498b1942c809 service nova] Lock "68d9de39-cbd2-44b2-bda8-015c8482c240-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:18:35 user nova-compute[75229]: DEBUG nova.compute.manager [req-aaf65d07-70fb-4855-bdc8-8d1154f0b8a9 req-89fea4b9-545d-472d-839e-498b1942c809 service nova] [instance: 68d9de39-cbd2-44b2-bda8-015c8482c240] No waiting events found dispatching network-vif-plugged-e62b2a49-c9cc-4568-b887-1c7884830ac2 {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 10:18:35 user nova-compute[75229]: WARNING nova.compute.manager [req-aaf65d07-70fb-4855-bdc8-8d1154f0b8a9 req-89fea4b9-545d-472d-839e-498b1942c809 service nova] [instance: 68d9de39-cbd2-44b2-bda8-015c8482c240] Received unexpected event network-vif-plugged-e62b2a49-c9cc-4568-b887-1c7884830ac2 for instance with vm_state deleted and task_state None.
Nov 14 10:18:35 user nova-compute[75229]: DEBUG nova.compute.manager [req-aaf65d07-70fb-4855-bdc8-8d1154f0b8a9 req-89fea4b9-545d-472d-839e-498b1942c809 service nova] [instance: 68d9de39-cbd2-44b2-bda8-015c8482c240] Received event network-vif-deleted-e62b2a49-c9cc-4568-b887-1c7884830ac2 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 10:18:38 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:18:39 user nova-compute[75229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9ad3b8ae-4fc8-46de-a622-a851c930923d tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] [instance: 075ad651-31fd-4ee0-af86-fa8bef56d614] Calling os-brick to attach iSCSI Volume {{(pid=75229) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 10:18:39 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ad3b8ae-4fc8-46de-a622-a851c930923d tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f73f85151b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c646146f-53a3-406d-a322-86cccd726699', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KrhNJAjW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 10:18:39 user nova-compute[75229]: WARNING os_brick.initiator.connectors.base [None req-9ad3b8ae-4fc8-46de-a622-a851c930923d tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 10:18:39 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-9ad3b8ae-4fc8-46de-a622-a851c930923d tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 10:18:39 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-9ad3b8ae-4fc8-46de-a622-a851c930923d tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 10:18:39 user nova-compute[75229]: WARNING os_brick.initiator.connectors.base [None req-9ad3b8ae-4fc8-46de-a622-a851c930923d tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 10:18:39 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-9ad3b8ae-4fc8-46de-a622-a851c930923d tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c646146f-53a3-406d-a322-86cccd726699" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 10:18:39 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-9ad3b8ae-4fc8-46de-a622-a851c930923d tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c646146f-53a3-406d-a322-86cccd726699" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 10:18:39 user nova-compute[75229]: INFO os_brick.initiator.connectors.iscsi [None req-9ad3b8ae-4fc8-46de-a622-a851c930923d tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 10:18:39 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c646146f-53a3-406d-a322-86cccd726699 -p 172.16.0.220:3260 {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:18:39 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c646146f-53a3-406d-a322-86cccd726699 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:18:39 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[01d6c7e1-87f4-4d37-b825-a5da51d75058]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:18:39 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ad3b8ae-4fc8-46de-a622-a851c930923d tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 10:18:39 user nova-compute[75229]:  {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 10:18:39 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c646146f-53a3-406d-a322-86cccd726699 -p 172.16.0.220:3260 --interface default --op new {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:18:39 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c646146f-53a3-406d-a322-86cccd726699 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:18:39 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[e79bfdf5-9550-4571-afd2-085f44c2fe11]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c646146f-53a3-406d-a322-86cccd726699] added\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:18:39 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ad3b8ae-4fc8-46de-a622-a851c930923d tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c646146f-53a3-406d-a322-86cccd726699] added
Nov 14 10:18:39 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 10:18:39 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c646146f-53a3-406d-a322-86cccd726699 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:18:39 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c646146f-53a3-406d-a322-86cccd726699 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.016s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:18:39 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc90c501-ea05-41b3-a721-b2d6b58b432e]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:18:39 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ad3b8ae-4fc8-46de-a622-a851c930923d tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 10:18:39 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c646146f-53a3-406d-a322-86cccd726699 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:18:39 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c646146f-53a3-406d-a322-86cccd726699 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:18:39 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad5557bb-1dbf-47d4-b2db-6ffb9ebd434a]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:18:39 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ad3b8ae-4fc8-46de-a622-a851c930923d tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 10:18:39 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c646146f-53a3-406d-a322-86cccd726699 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KrhNJAjW {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:18:39 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c646146f-53a3-406d-a322-86cccd726699 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KrhNJAjW" returned: 0 in 0.016s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:18:39 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[49ee73d0-3403-47c5-ba69-efea04d2be3f]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:18:39 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ad3b8ae-4fc8-46de-a622-a851c930923d tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'KrhNJAjW'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 10:18:39 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c646146f-53a3-406d-a322-86cccd726699 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:18:39 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c646146f-53a3-406d-a322-86cccd726699 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:18:39 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b28d2a7-e6e1-4718-b04b-9f889fdd3da5]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:18:39 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ad3b8ae-4fc8-46de-a622-a851c930923d tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 10:18:39 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:18:39 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.015s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:18:39 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6e22d1a-ff50-48db-8ad1-135047d49289]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:18:39 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ad3b8ae-4fc8-46de-a622-a851c930923d tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 14 10:18:39 user nova-compute[75229]:  {{(pid=75229) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 10:18:39 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ad3b8ae-4fc8-46de-a622-a851c930923d tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 14 10:18:39 user nova-compute[75229]:  {{(pid=75229) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 10:18:39 user nova-compute[75229]: WARNING os_brick.initiator.connectors.iscsi [None req-9ad3b8ae-4fc8-46de-a622-a851c930923d tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 14 10:18:39 user nova-compute[75229]: 
Nov 14 10:18:39 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c646146f-53a3-406d-a322-86cccd726699 -p 172.16.0.220:3260 --login {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:18:39 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c646146f-53a3-406d-a322-86cccd726699 -p 172.16.0.220:3260 --login" returned: 0 in 0.045s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:18:39 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[b49bebb7-5a9b-4724-976b-ed69bf9a5b9a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c646146f-53a3-406d-a322-86cccd726699, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c646146f-53a3-406d-a322-86cccd726699, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:18:39 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ad3b8ae-4fc8-46de-a622-a851c930923d tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c646146f-53a3-406d-a322-86cccd726699, portal: 172.16.0.220,3260]
Nov 14 10:18:39 user nova-compute[75229]: Login to [iface: default, target: iqn.2010-10.org.openstack:c646146f-53a3-406d-a322-86cccd726699, portal: 172.16.0.220,3260] successful.
Nov 14 10:18:39 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 10:18:39 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c646146f-53a3-406d-a322-86cccd726699 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:18:39 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:18:39 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c646146f-53a3-406d-a322-86cccd726699 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:18:39 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6e504d9-9bfb-49ae-82fb-197fffc64362]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:18:39 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ad3b8ae-4fc8-46de-a622-a851c930923d tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 10:18:39 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:18:39 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:18:39 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[acb8513c-1478-41eb-bae8-539cbb936389]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c646146f-53a3-406d-a322-86cccd726699 (non-flash)\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:18:39 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ad3b8ae-4fc8-46de-a622-a851c930923d tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c646146f-53a3-406d-a322-86cccd726699 (non-flash)
Nov 14 10:18:39 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 10:18:39 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ad3b8ae-4fc8-46de-a622-a851c930923d tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c646146f-53a3-406d-a322-86cccd726699 (non-flash)
Nov 14 10:18:39 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 10:18:39 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-9ad3b8ae-4fc8-46de-a622-a851c930923d tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c646146f-53a3-406d-a322-86cccd726699" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.230s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 10:18:39 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ad3b8ae-4fc8-46de-a622-a851c930923d tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] Connected to 172.16.0.220:3260 {{(pid=75229) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 10:18:39 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-9ad3b8ae-4fc8-46de-a622-a851c930923d tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] HCTL ('33', '-', '-', 0) found on session 59 with lun 0 {{(pid=75229) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 10:18:39 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-9ad3b8ae-4fc8-46de-a622-a851c930923d tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75229) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 10:18:39 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:18:39 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:18:39 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee994bf1-5b10-4122-88af-0461840b7684]: (4, ('- - 0', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:18:39 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-9ad3b8ae-4fc8-46de-a622-a851c930923d tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] Searching for a device in session 59 and hctl ['33', '*', '*', 0] yield: None {{(pid=75229) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 10:18:40 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-9ad3b8ae-4fc8-46de-a622-a851c930923d tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] Searching for a device in session 59 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75229) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 10:18:40 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ad3b8ae-4fc8-46de-a622-a851c930923d tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:c646146f-53a3-406d-a322-86cccd726699', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KrhNJAjW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75229) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 10:18:40 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-9ad3b8ae-4fc8-46de-a622-a851c930923d tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.262s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 10:18:40 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ad3b8ae-4fc8-46de-a622-a851c930923d tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] <== connect_volume: return (1263ms) {'type': 'block', 'scsi_wwn': '23536363165353038', 'path': '/dev/sdb'} {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 10:18:40 user nova-compute[75229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9ad3b8ae-4fc8-46de-a622-a851c930923d tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] [instance: 075ad651-31fd-4ee0-af86-fa8bef56d614] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23536363165353038', 'path': '/dev/sdb'} {{(pid=75229) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 10:18:40 user nova-compute[75229]: DEBUG nova.objects.instance [None req-9ad3b8ae-4fc8-46de-a622-a851c930923d tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] Lazy-loading 'flavor' on Instance uuid 075ad651-31fd-4ee0-af86-fa8bef56d614 {{(pid=75229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 10:18:40 user nova-compute[75229]: DEBUG nova.virt.libvirt.guest [None req-9ad3b8ae-4fc8-46de-a622-a851c930923d tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 10:18:40 user nova-compute[75229]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 10:18:40 user nova-compute[75229]:   <source dev="/dev/sdb"/>
Nov 14 10:18:40 user nova-compute[75229]:   <target dev="vdb" bus="virtio"/>
Nov 14 10:18:40 user nova-compute[75229]:   <serial>c646146f-53a3-406d-a322-86cccd726699</serial>
Nov 14 10:18:40 user nova-compute[75229]: </disk>
Nov 14 10:18:40 user nova-compute[75229]:  {{(pid=75229) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 10:18:40 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-9ad3b8ae-4fc8-46de-a622-a851c930923d tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] No BDM found with device name vda, not building metadata. {{(pid=75229) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 10:18:40 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-9ad3b8ae-4fc8-46de-a622-a851c930923d tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75229) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 10:18:40 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-9ad3b8ae-4fc8-46de-a622-a851c930923d tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] No VIF found with MAC fa:16:3e:bc:2b:a6, not building metadata {{(pid=75229) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 10:18:40 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-9ad3b8ae-4fc8-46de-a622-a851c930923d tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] Lock "075ad651-31fd-4ee0-af86-fa8bef56d614" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.093s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:18:42 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-d582385b-bbd3-4a1d-ad79-b1935e5b9522 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] Acquiring lock "075ad651-31fd-4ee0-af86-fa8bef56d614" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:18:42 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-d582385b-bbd3-4a1d-ad79-b1935e5b9522 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] Lock "075ad651-31fd-4ee0-af86-fa8bef56d614" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:18:42 user nova-compute[75229]: INFO nova.compute.manager [None req-d582385b-bbd3-4a1d-ad79-b1935e5b9522 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] [instance: 075ad651-31fd-4ee0-af86-fa8bef56d614] Detaching volume c646146f-53a3-406d-a322-86cccd726699
Nov 14 10:18:42 user nova-compute[75229]: INFO nova.virt.block_device [None req-d582385b-bbd3-4a1d-ad79-b1935e5b9522 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] [instance: 075ad651-31fd-4ee0-af86-fa8bef56d614] Attempting to driver detach volume c646146f-53a3-406d-a322-86cccd726699 from mountpoint /dev/vdb
Nov 14 10:18:42 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-d582385b-bbd3-4a1d-ad79-b1935e5b9522 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] Attempting to detach device vdb from instance 075ad651-31fd-4ee0-af86-fa8bef56d614 from the persistent domain config. {{(pid=75229) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 10:18:42 user nova-compute[75229]: DEBUG nova.virt.libvirt.guest [None req-d582385b-bbd3-4a1d-ad79-b1935e5b9522 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 10:18:42 user nova-compute[75229]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 10:18:42 user nova-compute[75229]:   <source dev="/dev/sdb"/>
Nov 14 10:18:42 user nova-compute[75229]:   <target dev="vdb" bus="virtio"/>
Nov 14 10:18:42 user nova-compute[75229]:   <serial>c646146f-53a3-406d-a322-86cccd726699</serial>
Nov 14 10:18:42 user nova-compute[75229]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 10:18:42 user nova-compute[75229]: </disk>
Nov 14 10:18:42 user nova-compute[75229]:  {{(pid=75229) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 10:18:42 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-d582385b-bbd3-4a1d-ad79-b1935e5b9522 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] Successfully detached device vdb from instance 075ad651-31fd-4ee0-af86-fa8bef56d614 from the persistent domain config.
Nov 14 10:18:42 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-d582385b-bbd3-4a1d-ad79-b1935e5b9522 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 075ad651-31fd-4ee0-af86-fa8bef56d614 from the live domain config. {{(pid=75229) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 10:18:42 user nova-compute[75229]: DEBUG nova.virt.libvirt.guest [None req-d582385b-bbd3-4a1d-ad79-b1935e5b9522 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 10:18:42 user nova-compute[75229]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 10:18:42 user nova-compute[75229]:   <source dev="/dev/sdb"/>
Nov 14 10:18:42 user nova-compute[75229]:   <target dev="vdb" bus="virtio"/>
Nov 14 10:18:42 user nova-compute[75229]:   <serial>c646146f-53a3-406d-a322-86cccd726699</serial>
Nov 14 10:18:42 user nova-compute[75229]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 10:18:42 user nova-compute[75229]: </disk>
Nov 14 10:18:42 user nova-compute[75229]:  {{(pid=75229) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 10:18:43 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-d582385b-bbd3-4a1d-ad79-b1935e5b9522 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 075ad651-31fd-4ee0-af86-fa8bef56d614 {{(pid=75229) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 10:18:43 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:18:44 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:18:48 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:18:53 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:18:58 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:19:03 user nova-compute[75229]: WARNING nova.virt.libvirt.driver [None req-d582385b-bbd3-4a1d-ad79-b1935e5b9522 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 075ad651-31fd-4ee0-af86-fa8bef56d614 is timed out.
Nov 14 10:19:03 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-d582385b-bbd3-4a1d-ad79-b1935e5b9522 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] Successfully detached device vdb from instance 075ad651-31fd-4ee0-af86-fa8bef56d614 from the live domain config.
Nov 14 10:19:03 user nova-compute[75229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d582385b-bbd3-4a1d-ad79-b1935e5b9522 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] [instance: 075ad651-31fd-4ee0-af86-fa8bef56d614] calling os-brick to detach iSCSI Volume {{(pid=75229) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 10:19:03 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-d582385b-bbd3-4a1d-ad79-b1935e5b9522 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f73f85151b0>, {'target_iqn': 'iqn.2010-10.org.openstack:c646146f-53a3-406d-a322-86cccd726699', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KrhNJAjW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 10:19:03 user nova-compute[75229]: WARNING os_brick.initiator.connectors.base [None req-d582385b-bbd3-4a1d-ad79-b1935e5b9522 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 10:19:03 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-d582385b-bbd3-4a1d-ad79-b1935e5b9522 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 10:19:03 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-d582385b-bbd3-4a1d-ad79-b1935e5b9522 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 10:19:03 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:19:03 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:19:03 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8e577fa-57d3-4a43-9282-ff003cc269be]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c646146f-53a3-406d-a322-86cccd726699\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:19:03 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-d582385b-bbd3-4a1d-ad79-b1935e5b9522 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 10:19:03 user nova-compute[75229]: No targets found.
Nov 14 10:19:03 user nova-compute[75229]: iSNS:
Nov 14 10:19:03 user nova-compute[75229]: No targets found.
Nov 14 10:19:03 user nova-compute[75229]: STATIC:
Nov 14 10:19:03 user nova-compute[75229]: Target: iqn.2010-10.org.openstack:c646146f-53a3-406d-a322-86cccd726699
Nov 14 10:19:03 user nova-compute[75229]:         Portal: 172.16.0.220:3260,-1
Nov 14 10:19:03 user nova-compute[75229]:                 Iface Name: default
Nov 14 10:19:03 user nova-compute[75229]: FIRMWARE:
Nov 14 10:19:03 user nova-compute[75229]: No targets found.
Nov 14 10:19:03 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 10:19:03 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-d582385b-bbd3-4a1d-ad79-b1935e5b9522 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 10:19:03 user nova-compute[75229]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 10:19:03 user nova-compute[75229]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75229) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 10:19:03 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-d582385b-bbd3-4a1d-ad79-b1935e5b9522 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c646146f-53a3-406d-a322-86cccd726699', 0)] {{(pid=75229) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 10:19:03 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:19:03 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:19:03 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a2e5e9c-bbbe-4f7c-942b-4f1a72e60b18]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c646146f-53a3-406d-a322-86cccd726699\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:19:03 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:19:03 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:19:03 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[7af851b4-9dd1-4457-85f9-0d056c46e41c]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c646146f-53a3-406d-a322-86cccd726699 (non-flash)\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:19:03 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-d582385b-bbd3-4a1d-ad79-b1935e5b9522 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c646146f-53a3-406d-a322-86cccd726699 (non-flash)
Nov 14 10:19:03 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 10:19:03 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-d582385b-bbd3-4a1d-ad79-b1935e5b9522 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c646146f-53a3-406d-a322-86cccd726699 (non-flash)
Nov 14 10:19:03 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 10:19:03 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-d582385b-bbd3-4a1d-ad79-b1935e5b9522 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f74182da440>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c646146f-53a3-406d-a322-86cccd726699'): ({'sdb'}, set())}) {{(pid=75229) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 10:19:03 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-d582385b-bbd3-4a1d-ad79-b1935e5b9522 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] Removing single pathed devices sdb {{(pid=75229) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 10:19:03 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:19:03 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:19:03 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0a00f6c-0398-450f-9347-515a251530ea]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:19:03 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:19:03 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.023s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:19:03 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[b556d5ce-b9cc-4568-addc-bb80882f11e6]: (4, ('ok\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:19:03 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-d582385b-bbd3-4a1d-ad79-b1935e5b9522 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] Flushing IO for device /dev/sdb {{(pid=75229) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 10:19:03 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:19:03 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:19:03 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1b2c13a-ed6e-4356-bc6e-f2eaff0e3afb]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:19:03 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-d582385b-bbd3-4a1d-ad79-b1935e5b9522 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75229) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 10:19:03 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:19:03 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.046s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:19:03 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[39d8fc7b-d48e-4ab7-b006-1ce37e4fc725]: (4, ('1', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:19:03 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-d582385b-bbd3-4a1d-ad79-b1935e5b9522 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75229) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 10:19:03 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-d582385b-bbd3-4a1d-ad79-b1935e5b9522 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] SCSI volumes sdb have been removed. {{(pid=75229) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 10:19:03 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-d582385b-bbd3-4a1d-ad79-b1935e5b9522 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c646146f-53a3-406d-a322-86cccd726699')] {{(pid=75229) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 10:19:03 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c646146f-53a3-406d-a322-86cccd726699 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:19:03 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c646146f-53a3-406d-a322-86cccd726699 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:19:03 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[209ea30a-57b7-43f0-bfbc-dc2f6bbc1227]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:19:03 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-d582385b-bbd3-4a1d-ad79-b1935e5b9522 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 10:19:03 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c646146f-53a3-406d-a322-86cccd726699 -p 172.16.0.220:3260 --logout {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:19:03 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c646146f-53a3-406d-a322-86cccd726699 -p 172.16.0.220:3260 --logout" returned: 0 in 0.049s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:19:03 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba498747-03fe-4824-b8b8-7f0d15f75225]: (4, ('Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:c646146f-53a3-406d-a322-86cccd726699, portal: 172.16.0.220,3260]\nLogout of [sid: 59, target: iqn.2010-10.org.openstack:c646146f-53a3-406d-a322-86cccd726699, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:19:03 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-d582385b-bbd3-4a1d-ad79-b1935e5b9522 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:c646146f-53a3-406d-a322-86cccd726699, portal: 172.16.0.220,3260]
Nov 14 10:19:03 user nova-compute[75229]: Logout of [sid: 59, target: iqn.2010-10.org.openstack:c646146f-53a3-406d-a322-86cccd726699, portal: 172.16.0.220,3260] successful.
Nov 14 10:19:03 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 10:19:03 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c646146f-53a3-406d-a322-86cccd726699 -p 172.16.0.220:3260 --op delete {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:19:03 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c646146f-53a3-406d-a322-86cccd726699 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:19:03 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[50b7bea1-d8b7-4b53-a555-e1a42cf8b507]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:19:03 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-d582385b-bbd3-4a1d-ad79-b1935e5b9522 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 10:19:03 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-d582385b-bbd3-4a1d-ad79-b1935e5b9522 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.310s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 10:19:03 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-d582385b-bbd3-4a1d-ad79-b1935e5b9522 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] <== disconnect_volume: return (312ms) None {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 10:19:03 user nova-compute[75229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d582385b-bbd3-4a1d-ad79-b1935e5b9522 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] [instance: 075ad651-31fd-4ee0-af86-fa8bef56d614] Disconnected iSCSI Volume {{(pid=75229) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 10:19:03 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 10:19:04 user nova-compute[75229]: DEBUG nova.objects.instance [None req-d582385b-bbd3-4a1d-ad79-b1935e5b9522 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] Lazy-loading 'flavor' on Instance uuid 075ad651-31fd-4ee0-af86-fa8bef56d614 {{(pid=75229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 10:19:04 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-d582385b-bbd3-4a1d-ad79-b1935e5b9522 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] Lock "075ad651-31fd-4ee0-af86-fa8bef56d614" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.869s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:19:08 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 10:19:08 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:19:08 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75229) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 10:19:08 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75229) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 10:19:08 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75229) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 10:19:08 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:19:09 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:19:09 user nova-compute[75229]: DEBUG nova.compute.manager [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Starting heal instance info cache {{(pid=75229) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 10:19:09 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Acquiring lock "refresh_cache-075ad651-31fd-4ee0-af86-fa8bef56d614" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 10:19:09 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Acquired lock "refresh_cache-075ad651-31fd-4ee0-af86-fa8bef56d614" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 10:19:09 user nova-compute[75229]: DEBUG nova.network.neutron [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] [instance: 075ad651-31fd-4ee0-af86-fa8bef56d614] Forcefully refreshing network info cache for instance {{(pid=75229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 10:19:10 user nova-compute[75229]: DEBUG nova.network.neutron [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] [instance: 075ad651-31fd-4ee0-af86-fa8bef56d614] Updating instance_info_cache with network_info: [{"id": "3d399542-6350-495b-9b54-13b21f7a99b8", "address": "fa:16:3e:bc:2b:a6", "network": {"id": "9fe5fa8c-b7e9-4f4f-88f1-e68567b67c3f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1670467158-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.122", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e94e4e374fb4329a0d1dd4cc8e3a2fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d399542-63", "ovs_interfaceid": "3d399542-6350-495b-9b54-13b21f7a99b8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 10:19:10 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Releasing lock "refresh_cache-075ad651-31fd-4ee0-af86-fa8bef56d614" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 10:19:10 user nova-compute[75229]: DEBUG nova.compute.manager [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] [instance: 075ad651-31fd-4ee0-af86-fa8bef56d614] Updated the network info_cache for instance {{(pid=75229) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 10:19:11 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:19:13 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:19:16 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:19:17 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:19:17 user nova-compute[75229]: DEBUG nova.compute.manager [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75229) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 10:19:18 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:19:18 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 10:19:19 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:19:21 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:19:22 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:19:22 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:19:22 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:19:22 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:19:22 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Auditing locally available compute resources for user (node: user) {{(pid=75229) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 10:19:22 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/075ad651-31fd-4ee0-af86-fa8bef56d614/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:19:23 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/075ad651-31fd-4ee0-af86-fa8bef56d614/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:19:23 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/075ad651-31fd-4ee0-af86-fa8bef56d614/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:19:23 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/075ad651-31fd-4ee0-af86-fa8bef56d614/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:19:23 user nova-compute[75229]: WARNING nova.virt.libvirt.driver [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 10:19:23 user nova-compute[75229]: WARNING nova.virt.libvirt.driver [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 10:19:23 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Hypervisor/Node resource view: name=user free_ram=8989MB free_disk=25.155818939208984GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75229) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 10:19:23 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:19:23 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:19:23 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Instance 075ad651-31fd-4ee0-af86-fa8bef56d614 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 10:19:23 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75229) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 10:19:23 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75229) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 10:19:23 user nova-compute[75229]: DEBUG nova.compute.provider_tree [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Inventory has not changed in ProviderTree for provider: d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 {{(pid=75229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 10:19:23 user nova-compute[75229]: DEBUG nova.scheduler.client.report [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Inventory has not changed for provider d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 10:19:23 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Compute_service record updated for user:user {{(pid=75229) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 10:19:23 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.222s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:19:23 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 10:19:24 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:19:26 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:19:26 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-e096f6c0-cec7-4aad-98c6-61315bfae62a tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Acquiring lock "88afc442-8973-4643-a0e2-54469417e57b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:19:26 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-e096f6c0-cec7-4aad-98c6-61315bfae62a tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Lock "88afc442-8973-4643-a0e2-54469417e57b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:19:27 user nova-compute[75229]: DEBUG nova.compute.manager [None req-e096f6c0-cec7-4aad-98c6-61315bfae62a tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] [instance: 88afc442-8973-4643-a0e2-54469417e57b] Starting instance... {{(pid=75229) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 10:19:27 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-e096f6c0-cec7-4aad-98c6-61315bfae62a tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:19:27 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-e096f6c0-cec7-4aad-98c6-61315bfae62a tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:19:27 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-e096f6c0-cec7-4aad-98c6-61315bfae62a tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75229) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 10:19:27 user nova-compute[75229]: INFO nova.compute.claims [None req-e096f6c0-cec7-4aad-98c6-61315bfae62a tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] [instance: 88afc442-8973-4643-a0e2-54469417e57b] Claim successful on node user
Nov 14 10:19:27 user nova-compute[75229]: DEBUG nova.compute.provider_tree [None req-e096f6c0-cec7-4aad-98c6-61315bfae62a tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Inventory has not changed in ProviderTree for provider: d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 {{(pid=75229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 10:19:27 user nova-compute[75229]: DEBUG nova.scheduler.client.report [None req-e096f6c0-cec7-4aad-98c6-61315bfae62a tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Inventory has not changed for provider d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 10:19:27 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-e096f6c0-cec7-4aad-98c6-61315bfae62a tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.229s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:19:27 user nova-compute[75229]: DEBUG nova.compute.manager [None req-e096f6c0-cec7-4aad-98c6-61315bfae62a tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] [instance: 88afc442-8973-4643-a0e2-54469417e57b] Start building networks asynchronously for instance. {{(pid=75229) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 10:19:27 user nova-compute[75229]: DEBUG nova.compute.manager [None req-e096f6c0-cec7-4aad-98c6-61315bfae62a tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] [instance: 88afc442-8973-4643-a0e2-54469417e57b] Allocating IP information in the background. {{(pid=75229) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 10:19:27 user nova-compute[75229]: DEBUG nova.network.neutron [None req-e096f6c0-cec7-4aad-98c6-61315bfae62a tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] [instance: 88afc442-8973-4643-a0e2-54469417e57b] allocate_for_instance() {{(pid=75229) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 10:19:27 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-e096f6c0-cec7-4aad-98c6-61315bfae62a tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] [instance: 88afc442-8973-4643-a0e2-54469417e57b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 10:19:27 user nova-compute[75229]: DEBUG nova.compute.manager [None req-e096f6c0-cec7-4aad-98c6-61315bfae62a tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] [instance: 88afc442-8973-4643-a0e2-54469417e57b] Start building block device mappings for instance. {{(pid=75229) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 10:19:27 user nova-compute[75229]: DEBUG nova.policy [None req-e096f6c0-cec7-4aad-98c6-61315bfae62a tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '707c03b04f664aab82260a037074de21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be7eb95aea3e4897acbc9fe03aadb8e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75229) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 10:19:27 user nova-compute[75229]: DEBUG nova.compute.manager [None req-e096f6c0-cec7-4aad-98c6-61315bfae62a tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] [instance: 88afc442-8973-4643-a0e2-54469417e57b] Start spawning the instance on the hypervisor. {{(pid=75229) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 10:19:27 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-e096f6c0-cec7-4aad-98c6-61315bfae62a tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] [instance: 88afc442-8973-4643-a0e2-54469417e57b] Creating instance directory {{(pid=75229) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 10:19:27 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-e096f6c0-cec7-4aad-98c6-61315bfae62a tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] [instance: 88afc442-8973-4643-a0e2-54469417e57b] Creating image(s)
Nov 14 10:19:27 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-e096f6c0-cec7-4aad-98c6-61315bfae62a tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Acquiring lock "/opt/stack/data/nova/instances/88afc442-8973-4643-a0e2-54469417e57b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:19:27 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-e096f6c0-cec7-4aad-98c6-61315bfae62a tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Lock "/opt/stack/data/nova/instances/88afc442-8973-4643-a0e2-54469417e57b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:19:27 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-e096f6c0-cec7-4aad-98c6-61315bfae62a tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Lock "/opt/stack/data/nova/instances/88afc442-8973-4643-a0e2-54469417e57b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:19:27 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-e096f6c0-cec7-4aad-98c6-61315bfae62a tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6 --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:19:27 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-e096f6c0-cec7-4aad-98c6-61315bfae62a tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6 --force-share --output=json" returned: 0 in 0.192s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:19:27 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-e096f6c0-cec7-4aad-98c6-61315bfae62a tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Acquiring lock "4f30e3fe703d2381679612a57b1fb80a467f60b6" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:19:27 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-e096f6c0-cec7-4aad-98c6-61315bfae62a tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Lock "4f30e3fe703d2381679612a57b1fb80a467f60b6" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:19:27 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-e096f6c0-cec7-4aad-98c6-61315bfae62a tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6 --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:19:27 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-e096f6c0-cec7-4aad-98c6-61315bfae62a tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6 --force-share --output=json" returned: 0 in 0.183s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:19:27 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-e096f6c0-cec7-4aad-98c6-61315bfae62a tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6,backing_fmt=raw /opt/stack/data/nova/instances/88afc442-8973-4643-a0e2-54469417e57b/disk 1073741824 {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:19:28 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-e096f6c0-cec7-4aad-98c6-61315bfae62a tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6,backing_fmt=raw /opt/stack/data/nova/instances/88afc442-8973-4643-a0e2-54469417e57b/disk 1073741824" returned: 0 in 0.058s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:19:28 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-e096f6c0-cec7-4aad-98c6-61315bfae62a tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Lock "4f30e3fe703d2381679612a57b1fb80a467f60b6" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.248s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:19:28 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-e096f6c0-cec7-4aad-98c6-61315bfae62a tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6 --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:19:28 user nova-compute[75229]: DEBUG nova.network.neutron [None req-e096f6c0-cec7-4aad-98c6-61315bfae62a tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] [instance: 88afc442-8973-4643-a0e2-54469417e57b] Successfully created port: f4e7267a-b500-4eab-b71d-4ac31c55ca29 {{(pid=75229) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 10:19:28 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-e096f6c0-cec7-4aad-98c6-61315bfae62a tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6 --force-share --output=json" returned: 0 in 0.187s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:19:28 user nova-compute[75229]: DEBUG nova.virt.disk.api [None req-e096f6c0-cec7-4aad-98c6-61315bfae62a tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Checking if we can resize image /opt/stack/data/nova/instances/88afc442-8973-4643-a0e2-54469417e57b/disk. size=1073741824 {{(pid=75229) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 10:19:28 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-e096f6c0-cec7-4aad-98c6-61315bfae62a tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88afc442-8973-4643-a0e2-54469417e57b/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:19:28 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-e096f6c0-cec7-4aad-98c6-61315bfae62a tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88afc442-8973-4643-a0e2-54469417e57b/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:19:28 user nova-compute[75229]: DEBUG nova.virt.disk.api [None req-e096f6c0-cec7-4aad-98c6-61315bfae62a tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Cannot resize image /opt/stack/data/nova/instances/88afc442-8973-4643-a0e2-54469417e57b/disk to a smaller size. {{(pid=75229) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 10:19:28 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-e096f6c0-cec7-4aad-98c6-61315bfae62a tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] [instance: 88afc442-8973-4643-a0e2-54469417e57b] Created local disks {{(pid=75229) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 10:19:28 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-e096f6c0-cec7-4aad-98c6-61315bfae62a tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] [instance: 88afc442-8973-4643-a0e2-54469417e57b] Ensure instance console log exists: /opt/stack/data/nova/instances/88afc442-8973-4643-a0e2-54469417e57b/console.log {{(pid=75229) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 10:19:28 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-e096f6c0-cec7-4aad-98c6-61315bfae62a tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:19:28 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-e096f6c0-cec7-4aad-98c6-61315bfae62a tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:19:28 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-e096f6c0-cec7-4aad-98c6-61315bfae62a tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:19:28 user nova-compute[75229]: DEBUG nova.network.neutron [None req-e096f6c0-cec7-4aad-98c6-61315bfae62a tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] [instance: 88afc442-8973-4643-a0e2-54469417e57b] Successfully updated port: f4e7267a-b500-4eab-b71d-4ac31c55ca29 {{(pid=75229) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 10:19:28 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-e096f6c0-cec7-4aad-98c6-61315bfae62a tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Acquiring lock "refresh_cache-88afc442-8973-4643-a0e2-54469417e57b" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 10:19:28 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-e096f6c0-cec7-4aad-98c6-61315bfae62a tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Acquired lock "refresh_cache-88afc442-8973-4643-a0e2-54469417e57b" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 10:19:28 user nova-compute[75229]: DEBUG nova.network.neutron [None req-e096f6c0-cec7-4aad-98c6-61315bfae62a tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] [instance: 88afc442-8973-4643-a0e2-54469417e57b] Building network info cache for instance {{(pid=75229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 10:19:28 user nova-compute[75229]: DEBUG nova.compute.manager [req-60f8673c-9ae8-4e2b-8121-06d6cb8f3d72 req-4e0cb145-1c99-4a31-8f0f-aefc1695b981 service nova] [instance: 88afc442-8973-4643-a0e2-54469417e57b] Received event network-changed-f4e7267a-b500-4eab-b71d-4ac31c55ca29 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 10:19:28 user nova-compute[75229]: DEBUG nova.compute.manager [req-60f8673c-9ae8-4e2b-8121-06d6cb8f3d72 req-4e0cb145-1c99-4a31-8f0f-aefc1695b981 service nova] [instance: 88afc442-8973-4643-a0e2-54469417e57b] Refreshing instance network info cache due to event network-changed-f4e7267a-b500-4eab-b71d-4ac31c55ca29. {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 10:19:28 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-60f8673c-9ae8-4e2b-8121-06d6cb8f3d72 req-4e0cb145-1c99-4a31-8f0f-aefc1695b981 service nova] Acquiring lock "refresh_cache-88afc442-8973-4643-a0e2-54469417e57b" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 10:19:28 user nova-compute[75229]: DEBUG nova.network.neutron [None req-e096f6c0-cec7-4aad-98c6-61315bfae62a tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] [instance: 88afc442-8973-4643-a0e2-54469417e57b] Instance cache missing network info. {{(pid=75229) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 10:19:28 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:19:29 user nova-compute[75229]: DEBUG nova.network.neutron [None req-e096f6c0-cec7-4aad-98c6-61315bfae62a tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] [instance: 88afc442-8973-4643-a0e2-54469417e57b] Updating instance_info_cache with network_info: [{"id": "f4e7267a-b500-4eab-b71d-4ac31c55ca29", "address": "fa:16:3e:46:4a:b8", "network": {"id": "13b12b7e-2548-4256-8fb8-fccc67b1e18b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-698342503-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be7eb95aea3e4897acbc9fe03aadb8e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4e7267a-b5", "ovs_interfaceid": "f4e7267a-b500-4eab-b71d-4ac31c55ca29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 10:19:29 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-e096f6c0-cec7-4aad-98c6-61315bfae62a tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Releasing lock "refresh_cache-88afc442-8973-4643-a0e2-54469417e57b" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 10:19:29 user nova-compute[75229]: DEBUG nova.compute.manager [None req-e096f6c0-cec7-4aad-98c6-61315bfae62a tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] [instance: 88afc442-8973-4643-a0e2-54469417e57b] Instance network_info: |[{"id": "f4e7267a-b500-4eab-b71d-4ac31c55ca29", "address": "fa:16:3e:46:4a:b8", "network": {"id": "13b12b7e-2548-4256-8fb8-fccc67b1e18b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-698342503-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be7eb95aea3e4897acbc9fe03aadb8e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4e7267a-b5", "ovs_interfaceid": "f4e7267a-b500-4eab-b71d-4ac31c55ca29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75229) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 10:19:29 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-60f8673c-9ae8-4e2b-8121-06d6cb8f3d72 req-4e0cb145-1c99-4a31-8f0f-aefc1695b981 service nova] Acquired lock "refresh_cache-88afc442-8973-4643-a0e2-54469417e57b" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 10:19:29 user nova-compute[75229]: DEBUG nova.network.neutron [req-60f8673c-9ae8-4e2b-8121-06d6cb8f3d72 req-4e0cb145-1c99-4a31-8f0f-aefc1695b981 service nova] [instance: 88afc442-8973-4643-a0e2-54469417e57b] Refreshing network info cache for port f4e7267a-b500-4eab-b71d-4ac31c55ca29 {{(pid=75229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 10:19:29 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-e096f6c0-cec7-4aad-98c6-61315bfae62a tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] [instance: 88afc442-8973-4643-a0e2-54469417e57b] Start _get_guest_xml network_info=[{"id": "f4e7267a-b500-4eab-b71d-4ac31c55ca29", "address": "fa:16:3e:46:4a:b8", "network": {"id": "13b12b7e-2548-4256-8fb8-fccc67b1e18b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-698342503-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be7eb95aea3e4897acbc9fe03aadb8e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4e7267a-b5", "ovs_interfaceid": "f4e7267a-b500-4eab-b71d-4ac31c55ca29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T09:40:10Z,direct_url=<?>,disk_format='qcow2',id=3bef8470-ecc7-40e3-95d4-9254348ea72d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='de5a91106b6948ed937a7178ff9464c4',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T09:40:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'disk_bus': 'virtio', 'guest_format': None, 'encryption_secret_uuid': None, 'size': 0, 'device_type': 'disk', 'image_id': '3bef8470-ecc7-40e3-95d4-9254348ea72d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75229) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 10:19:29 user nova-compute[75229]: WARNING nova.virt.libvirt.driver [None req-e096f6c0-cec7-4aad-98c6-61315bfae62a tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 10:19:29 user nova-compute[75229]: WARNING nova.virt.libvirt.driver [None req-e096f6c0-cec7-4aad-98c6-61315bfae62a tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 10:19:29 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-e096f6c0-cec7-4aad-98c6-61315bfae62a tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75229) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 10:19:29 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-e096f6c0-cec7-4aad-98c6-61315bfae62a tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] CPU controller missing on host. {{(pid=75229) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 10:19:29 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-e096f6c0-cec7-4aad-98c6-61315bfae62a tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75229) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 10:19:29 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-e096f6c0-cec7-4aad-98c6-61315bfae62a tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] CPU controller found on host. {{(pid=75229) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 10:19:29 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-e096f6c0-cec7-4aad-98c6-61315bfae62a tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75229) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 10:19:29 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-e096f6c0-cec7-4aad-98c6-61315bfae62a tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T09:39:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T09:40:10Z,direct_url=<?>,disk_format='qcow2',id=3bef8470-ecc7-40e3-95d4-9254348ea72d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='de5a91106b6948ed937a7178ff9464c4',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T09:40:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 10:19:29 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-e096f6c0-cec7-4aad-98c6-61315bfae62a tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Flavor limits 0:0:0 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 10:19:29 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-e096f6c0-cec7-4aad-98c6-61315bfae62a tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Image limits 0:0:0 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 10:19:29 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-e096f6c0-cec7-4aad-98c6-61315bfae62a tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Flavor pref 0:0:0 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 10:19:29 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-e096f6c0-cec7-4aad-98c6-61315bfae62a tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Image pref 0:0:0 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 10:19:29 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-e096f6c0-cec7-4aad-98c6-61315bfae62a tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 10:19:29 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-e096f6c0-cec7-4aad-98c6-61315bfae62a tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 10:19:29 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-e096f6c0-cec7-4aad-98c6-61315bfae62a tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75229) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 10:19:29 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-e096f6c0-cec7-4aad-98c6-61315bfae62a tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Got 1 possible topologies {{(pid=75229) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 10:19:29 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-e096f6c0-cec7-4aad-98c6-61315bfae62a tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 10:19:29 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-e096f6c0-cec7-4aad-98c6-61315bfae62a tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 10:19:29 user nova-compute[75229]: DEBUG nova.virt.libvirt.vif [None req-e096f6c0-cec7-4aad-98c6-61315bfae62a tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T10:19:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1811836888',display_name='tempest-AttachVolumeTestJSON-server-1811836888',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1811836888',id=52,image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGLgoY7aj90g617Dg6nYwB8uCiGWA050tTMb0XJDozOuTzOvQL00BQ4f262GJf2npqu29RFiKHXAbxMw1jW99hxai9kxNATtM+3naYRCfIIQQ3SRcy45stbVnPtc0ILuwA==',key_name='tempest-keypair-729095625',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='be7eb95aea3e4897acbc9fe03aadb8e7',ramdisk_id='',reservation_id='r-grlpr623',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-775906619',owner_user_name='tempest-AttachVolumeTestJSON-775906619-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T10:19:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='707c03b04f664aab82260a037074de21',uuid=88afc442-8973-4643-a0e2-54469417e57b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f4e7267a-b500-4eab-b71d-4ac31c55ca29", "address": "fa:16:3e:46:4a:b8", "network": {"id": "13b12b7e-2548-4256-8fb8-fccc67b1e18b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-698342503-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be7eb95aea3e4897acbc9fe03aadb8e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4e7267a-b5", "ovs_interfaceid": "f4e7267a-b500-4eab-b71d-4ac31c55ca29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75229) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 10:19:29 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-e096f6c0-cec7-4aad-98c6-61315bfae62a tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Converting VIF {"id": "f4e7267a-b500-4eab-b71d-4ac31c55ca29", "address": "fa:16:3e:46:4a:b8", "network": {"id": "13b12b7e-2548-4256-8fb8-fccc67b1e18b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-698342503-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be7eb95aea3e4897acbc9fe03aadb8e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4e7267a-b5", "ovs_interfaceid": "f4e7267a-b500-4eab-b71d-4ac31c55ca29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 10:19:29 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-e096f6c0-cec7-4aad-98c6-61315bfae62a tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:46:4a:b8,bridge_name='br-int',has_traffic_filtering=True,id=f4e7267a-b500-4eab-b71d-4ac31c55ca29,network=Network(13b12b7e-2548-4256-8fb8-fccc67b1e18b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4e7267a-b5') {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 10:19:29 user nova-compute[75229]: DEBUG nova.objects.instance [None req-e096f6c0-cec7-4aad-98c6-61315bfae62a tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Lazy-loading 'pci_devices' on Instance uuid 88afc442-8973-4643-a0e2-54469417e57b {{(pid=75229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 10:19:29 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-e096f6c0-cec7-4aad-98c6-61315bfae62a tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] [instance: 88afc442-8973-4643-a0e2-54469417e57b] End _get_guest_xml xml=<domain type="kvm">
Nov 14 10:19:29 user nova-compute[75229]:   <uuid>88afc442-8973-4643-a0e2-54469417e57b</uuid>
Nov 14 10:19:29 user nova-compute[75229]:   <name>instance-00000034</name>
Nov 14 10:19:29 user nova-compute[75229]:   <memory>524288</memory>
Nov 14 10:19:29 user nova-compute[75229]:   <vcpu>1</vcpu>
Nov 14 10:19:29 user nova-compute[75229]:   <metadata>
Nov 14 10:19:29 user nova-compute[75229]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 10:19:29 user nova-compute[75229]:       <nova:package version="0.0.0"/>
Nov 14 10:19:29 user nova-compute[75229]:       <nova:name>tempest-AttachVolumeTestJSON-server-1811836888</nova:name>
Nov 14 10:19:29 user nova-compute[75229]:       <nova:creationTime>2023-11-14 10:19:29</nova:creationTime>
Nov 14 10:19:29 user nova-compute[75229]:       <nova:flavor name="m1.tiny">
Nov 14 10:19:29 user nova-compute[75229]:         <nova:memory>512</nova:memory>
Nov 14 10:19:29 user nova-compute[75229]:         <nova:disk>1</nova:disk>
Nov 14 10:19:29 user nova-compute[75229]:         <nova:swap>0</nova:swap>
Nov 14 10:19:29 user nova-compute[75229]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 10:19:29 user nova-compute[75229]:         <nova:vcpus>1</nova:vcpus>
Nov 14 10:19:29 user nova-compute[75229]:       </nova:flavor>
Nov 14 10:19:29 user nova-compute[75229]:       <nova:owner>
Nov 14 10:19:29 user nova-compute[75229]:         <nova:user uuid="707c03b04f664aab82260a037074de21">tempest-AttachVolumeTestJSON-775906619-project-member</nova:user>
Nov 14 10:19:29 user nova-compute[75229]:         <nova:project uuid="be7eb95aea3e4897acbc9fe03aadb8e7">tempest-AttachVolumeTestJSON-775906619</nova:project>
Nov 14 10:19:29 user nova-compute[75229]:       </nova:owner>
Nov 14 10:19:29 user nova-compute[75229]:       <nova:root type="image" uuid="3bef8470-ecc7-40e3-95d4-9254348ea72d"/>
Nov 14 10:19:29 user nova-compute[75229]:       <nova:ports>
Nov 14 10:19:29 user nova-compute[75229]:         <nova:port uuid="f4e7267a-b500-4eab-b71d-4ac31c55ca29">
Nov 14 10:19:29 user nova-compute[75229]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 14 10:19:29 user nova-compute[75229]:         </nova:port>
Nov 14 10:19:29 user nova-compute[75229]:       </nova:ports>
Nov 14 10:19:29 user nova-compute[75229]:     </nova:instance>
Nov 14 10:19:29 user nova-compute[75229]:   </metadata>
Nov 14 10:19:29 user nova-compute[75229]:   <sysinfo type="smbios">
Nov 14 10:19:29 user nova-compute[75229]:     <system>
Nov 14 10:19:29 user nova-compute[75229]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 10:19:29 user nova-compute[75229]:       <entry name="product">OpenStack Nova</entry>
Nov 14 10:19:29 user nova-compute[75229]:       <entry name="version">0.0.0</entry>
Nov 14 10:19:29 user nova-compute[75229]:       <entry name="serial">88afc442-8973-4643-a0e2-54469417e57b</entry>
Nov 14 10:19:29 user nova-compute[75229]:       <entry name="uuid">88afc442-8973-4643-a0e2-54469417e57b</entry>
Nov 14 10:19:29 user nova-compute[75229]:       <entry name="family">Virtual Machine</entry>
Nov 14 10:19:29 user nova-compute[75229]:     </system>
Nov 14 10:19:29 user nova-compute[75229]:   </sysinfo>
Nov 14 10:19:29 user nova-compute[75229]:   <os>
Nov 14 10:19:29 user nova-compute[75229]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 10:19:29 user nova-compute[75229]:     <boot dev="hd"/>
Nov 14 10:19:29 user nova-compute[75229]:     <smbios mode="sysinfo"/>
Nov 14 10:19:29 user nova-compute[75229]:   </os>
Nov 14 10:19:29 user nova-compute[75229]:   <features>
Nov 14 10:19:29 user nova-compute[75229]:     <acpi/>
Nov 14 10:19:29 user nova-compute[75229]:     <apic/>
Nov 14 10:19:29 user nova-compute[75229]:     <vmcoreinfo/>
Nov 14 10:19:29 user nova-compute[75229]:   </features>
Nov 14 10:19:29 user nova-compute[75229]:   <clock offset="utc">
Nov 14 10:19:29 user nova-compute[75229]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 10:19:29 user nova-compute[75229]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 10:19:29 user nova-compute[75229]:     <timer name="hpet" present="no"/>
Nov 14 10:19:29 user nova-compute[75229]:   </clock>
Nov 14 10:19:29 user nova-compute[75229]:   <cpu mode="custom" match="exact">
Nov 14 10:19:29 user nova-compute[75229]:     <model>Nehalem</model>
Nov 14 10:19:29 user nova-compute[75229]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 10:19:29 user nova-compute[75229]:   </cpu>
Nov 14 10:19:29 user nova-compute[75229]:   <devices>
Nov 14 10:19:29 user nova-compute[75229]:     <disk type="file" device="disk">
Nov 14 10:19:29 user nova-compute[75229]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 10:19:29 user nova-compute[75229]:       <source file="/opt/stack/data/nova/instances/88afc442-8973-4643-a0e2-54469417e57b/disk"/>
Nov 14 10:19:29 user nova-compute[75229]:       <target dev="vda" bus="virtio"/>
Nov 14 10:19:29 user nova-compute[75229]:     </disk>
Nov 14 10:19:29 user nova-compute[75229]:     <interface type="ethernet">
Nov 14 10:19:29 user nova-compute[75229]:       <mac address="fa:16:3e:46:4a:b8"/>
Nov 14 10:19:29 user nova-compute[75229]:       <model type="virtio"/>
Nov 14 10:19:29 user nova-compute[75229]:       <mtu size="1442"/>
Nov 14 10:19:29 user nova-compute[75229]:       <target dev="tapf4e7267a-b5"/>
Nov 14 10:19:29 user nova-compute[75229]:     </interface>
Nov 14 10:19:29 user nova-compute[75229]:     <serial type="pty">
Nov 14 10:19:29 user nova-compute[75229]:       <log file="/opt/stack/data/nova/instances/88afc442-8973-4643-a0e2-54469417e57b/console.log" append="off"/>
Nov 14 10:19:29 user nova-compute[75229]:     </serial>
Nov 14 10:19:29 user nova-compute[75229]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 10:19:29 user nova-compute[75229]:     <video>
Nov 14 10:19:29 user nova-compute[75229]:       <model type="virtio"/>
Nov 14 10:19:29 user nova-compute[75229]:     </video>
Nov 14 10:19:29 user nova-compute[75229]:     <rng model="virtio">
Nov 14 10:19:29 user nova-compute[75229]:       <backend model="random">/dev/urandom</backend>
Nov 14 10:19:29 user nova-compute[75229]:     </rng>
Nov 14 10:19:29 user nova-compute[75229]:     <controller type="usb" index="0" model="none"/>
Nov 14 10:19:29 user nova-compute[75229]:     <memballoon model="virtio">
Nov 14 10:19:29 user nova-compute[75229]:       <stats period="10"/>
Nov 14 10:19:29 user nova-compute[75229]:     </memballoon>
Nov 14 10:19:29 user nova-compute[75229]:   </devices>
Nov 14 10:19:29 user nova-compute[75229]: </domain>
Nov 14 10:19:29 user nova-compute[75229]:  {{(pid=75229) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 10:19:29 user nova-compute[75229]: DEBUG nova.virt.libvirt.vif [None req-e096f6c0-cec7-4aad-98c6-61315bfae62a tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T10:19:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1811836888',display_name='tempest-AttachVolumeTestJSON-server-1811836888',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1811836888',id=52,image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGLgoY7aj90g617Dg6nYwB8uCiGWA050tTMb0XJDozOuTzOvQL00BQ4f262GJf2npqu29RFiKHXAbxMw1jW99hxai9kxNATtM+3naYRCfIIQQ3SRcy45stbVnPtc0ILuwA==',key_name='tempest-keypair-729095625',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='be7eb95aea3e4897acbc9fe03aadb8e7',ramdisk_id='',reservation_id='r-grlpr623',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-775906619',owner_user_name='tempest-AttachVolumeTestJSON-775906619-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T10:19:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='707c03b04f664aab82260a037074de21',uuid=88afc442-8973-4643-a0e2-54469417e57b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f4e7267a-b500-4eab-b71d-4ac31c55ca29", "address": "fa:16:3e:46:4a:b8", "network": {"id": "13b12b7e-2548-4256-8fb8-fccc67b1e18b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-698342503-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be7eb95aea3e4897acbc9fe03aadb8e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4e7267a-b5", "ovs_interfaceid": "f4e7267a-b500-4eab-b71d-4ac31c55ca29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 10:19:29 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-e096f6c0-cec7-4aad-98c6-61315bfae62a tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Converting VIF {"id": "f4e7267a-b500-4eab-b71d-4ac31c55ca29", "address": "fa:16:3e:46:4a:b8", "network": {"id": "13b12b7e-2548-4256-8fb8-fccc67b1e18b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-698342503-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be7eb95aea3e4897acbc9fe03aadb8e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4e7267a-b5", "ovs_interfaceid": "f4e7267a-b500-4eab-b71d-4ac31c55ca29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 10:19:29 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-e096f6c0-cec7-4aad-98c6-61315bfae62a tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:46:4a:b8,bridge_name='br-int',has_traffic_filtering=True,id=f4e7267a-b500-4eab-b71d-4ac31c55ca29,network=Network(13b12b7e-2548-4256-8fb8-fccc67b1e18b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4e7267a-b5') {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 10:19:29 user nova-compute[75229]: DEBUG os_vif [None req-e096f6c0-cec7-4aad-98c6-61315bfae62a tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:46:4a:b8,bridge_name='br-int',has_traffic_filtering=True,id=f4e7267a-b500-4eab-b71d-4ac31c55ca29,network=Network(13b12b7e-2548-4256-8fb8-fccc67b1e18b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4e7267a-b5') {{(pid=75229) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 10:19:29 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:19:29 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 10:19:29 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 10:19:29 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:19:29 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c5d038c0-2eda-5474-83d4-4a3a30b4e6c2', '_type': 'linux-noop'}}, row=False) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 10:19:29 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:19:29 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 10:19:29 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:19:29 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf4e7267a-b5, may_exist=True, interface_attrs={}) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 10:19:29 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf4e7267a-b5, col_values=(('qos', UUID('bb162c44-df13-4d8e-89cb-9823b3c55a25')),), if_exists=True) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 10:19:29 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf4e7267a-b5, col_values=(('external_ids', {'iface-id': 'f4e7267a-b500-4eab-b71d-4ac31c55ca29', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:46:4a:b8', 'vm-uuid': '88afc442-8973-4643-a0e2-54469417e57b'}),), if_exists=True) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 10:19:29 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:19:29 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 10:19:29 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:19:29 user nova-compute[75229]: INFO os_vif [None req-e096f6c0-cec7-4aad-98c6-61315bfae62a tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:46:4a:b8,bridge_name='br-int',has_traffic_filtering=True,id=f4e7267a-b500-4eab-b71d-4ac31c55ca29,network=Network(13b12b7e-2548-4256-8fb8-fccc67b1e18b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4e7267a-b5')
Nov 14 10:19:29 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-e096f6c0-cec7-4aad-98c6-61315bfae62a tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] No BDM found with device name vda, not building metadata. {{(pid=75229) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 10:19:29 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-e096f6c0-cec7-4aad-98c6-61315bfae62a tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] No VIF found with MAC fa:16:3e:46:4a:b8, not building metadata {{(pid=75229) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 10:19:29 user nova-compute[75229]: DEBUG nova.network.neutron [req-60f8673c-9ae8-4e2b-8121-06d6cb8f3d72 req-4e0cb145-1c99-4a31-8f0f-aefc1695b981 service nova] [instance: 88afc442-8973-4643-a0e2-54469417e57b] Updated VIF entry in instance network info cache for port f4e7267a-b500-4eab-b71d-4ac31c55ca29. {{(pid=75229) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 10:19:29 user nova-compute[75229]: DEBUG nova.network.neutron [req-60f8673c-9ae8-4e2b-8121-06d6cb8f3d72 req-4e0cb145-1c99-4a31-8f0f-aefc1695b981 service nova] [instance: 88afc442-8973-4643-a0e2-54469417e57b] Updating instance_info_cache with network_info: [{"id": "f4e7267a-b500-4eab-b71d-4ac31c55ca29", "address": "fa:16:3e:46:4a:b8", "network": {"id": "13b12b7e-2548-4256-8fb8-fccc67b1e18b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-698342503-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be7eb95aea3e4897acbc9fe03aadb8e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4e7267a-b5", "ovs_interfaceid": "f4e7267a-b500-4eab-b71d-4ac31c55ca29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 10:19:29 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-60f8673c-9ae8-4e2b-8121-06d6cb8f3d72 req-4e0cb145-1c99-4a31-8f0f-aefc1695b981 service nova] Releasing lock "refresh_cache-88afc442-8973-4643-a0e2-54469417e57b" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 10:19:30 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:19:30 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:19:30 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:19:31 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:19:31 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:19:31 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:19:31 user nova-compute[75229]: DEBUG nova.compute.manager [req-5f2e4051-89e7-4969-be26-3c01962ea1f6 req-3171d68c-bf8f-4af3-a7d5-491ed2c117b5 service nova] [instance: 88afc442-8973-4643-a0e2-54469417e57b] Received event network-vif-plugged-f4e7267a-b500-4eab-b71d-4ac31c55ca29 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 10:19:31 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-5f2e4051-89e7-4969-be26-3c01962ea1f6 req-3171d68c-bf8f-4af3-a7d5-491ed2c117b5 service nova] Acquiring lock "88afc442-8973-4643-a0e2-54469417e57b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:19:31 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-5f2e4051-89e7-4969-be26-3c01962ea1f6 req-3171d68c-bf8f-4af3-a7d5-491ed2c117b5 service nova] Lock "88afc442-8973-4643-a0e2-54469417e57b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:19:31 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-5f2e4051-89e7-4969-be26-3c01962ea1f6 req-3171d68c-bf8f-4af3-a7d5-491ed2c117b5 service nova] Lock "88afc442-8973-4643-a0e2-54469417e57b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:19:31 user nova-compute[75229]: DEBUG nova.compute.manager [req-5f2e4051-89e7-4969-be26-3c01962ea1f6 req-3171d68c-bf8f-4af3-a7d5-491ed2c117b5 service nova] [instance: 88afc442-8973-4643-a0e2-54469417e57b] No waiting events found dispatching network-vif-plugged-f4e7267a-b500-4eab-b71d-4ac31c55ca29 {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 10:19:31 user nova-compute[75229]: WARNING nova.compute.manager [req-5f2e4051-89e7-4969-be26-3c01962ea1f6 req-3171d68c-bf8f-4af3-a7d5-491ed2c117b5 service nova] [instance: 88afc442-8973-4643-a0e2-54469417e57b] Received unexpected event network-vif-plugged-f4e7267a-b500-4eab-b71d-4ac31c55ca29 for instance with vm_state building and task_state spawning.
Nov 14 10:19:32 user nova-compute[75229]: DEBUG nova.compute.manager [None req-e096f6c0-cec7-4aad-98c6-61315bfae62a tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] [instance: 88afc442-8973-4643-a0e2-54469417e57b] Instance event wait completed in 0 seconds for  {{(pid=75229) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 10:19:32 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-e096f6c0-cec7-4aad-98c6-61315bfae62a tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] [instance: 88afc442-8973-4643-a0e2-54469417e57b] Guest created on hypervisor {{(pid=75229) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 10:19:32 user nova-compute[75229]: INFO nova.virt.libvirt.driver [-] [instance: 88afc442-8973-4643-a0e2-54469417e57b] Instance spawned successfully.
Nov 14 10:19:32 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-e096f6c0-cec7-4aad-98c6-61315bfae62a tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] [instance: 88afc442-8973-4643-a0e2-54469417e57b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 10:19:32 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-e096f6c0-cec7-4aad-98c6-61315bfae62a tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] [instance: 88afc442-8973-4643-a0e2-54469417e57b] Found default for hw_cdrom_bus of ide {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 10:19:32 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-e096f6c0-cec7-4aad-98c6-61315bfae62a tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] [instance: 88afc442-8973-4643-a0e2-54469417e57b] Found default for hw_disk_bus of virtio {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 10:19:32 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-e096f6c0-cec7-4aad-98c6-61315bfae62a tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] [instance: 88afc442-8973-4643-a0e2-54469417e57b] Found default for hw_input_bus of None {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 10:19:32 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-e096f6c0-cec7-4aad-98c6-61315bfae62a tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] [instance: 88afc442-8973-4643-a0e2-54469417e57b] Found default for hw_pointer_model of None {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 10:19:32 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-e096f6c0-cec7-4aad-98c6-61315bfae62a tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] [instance: 88afc442-8973-4643-a0e2-54469417e57b] Found default for hw_video_model of virtio {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 10:19:32 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-e096f6c0-cec7-4aad-98c6-61315bfae62a tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] [instance: 88afc442-8973-4643-a0e2-54469417e57b] Found default for hw_vif_model of virtio {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 10:19:32 user nova-compute[75229]: INFO nova.compute.manager [None req-e096f6c0-cec7-4aad-98c6-61315bfae62a tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] [instance: 88afc442-8973-4643-a0e2-54469417e57b] Took 5.12 seconds to spawn the instance on the hypervisor.
Nov 14 10:19:32 user nova-compute[75229]: DEBUG nova.compute.manager [None req-e096f6c0-cec7-4aad-98c6-61315bfae62a tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] [instance: 88afc442-8973-4643-a0e2-54469417e57b] Checking state {{(pid=75229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 10:19:32 user nova-compute[75229]: INFO nova.compute.manager [None req-e096f6c0-cec7-4aad-98c6-61315bfae62a tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] [instance: 88afc442-8973-4643-a0e2-54469417e57b] Took 5.73 seconds to build instance.
Nov 14 10:19:32 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-e096f6c0-cec7-4aad-98c6-61315bfae62a tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Lock "88afc442-8973-4643-a0e2-54469417e57b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.854s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:19:33 user nova-compute[75229]: DEBUG nova.compute.manager [req-ff0a1d61-e62b-4359-954f-fccfb8b6616a req-370b56bc-bc9d-4b93-97a6-df2cba56a426 service nova] [instance: 88afc442-8973-4643-a0e2-54469417e57b] Received event network-vif-plugged-f4e7267a-b500-4eab-b71d-4ac31c55ca29 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 10:19:33 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-ff0a1d61-e62b-4359-954f-fccfb8b6616a req-370b56bc-bc9d-4b93-97a6-df2cba56a426 service nova] Acquiring lock "88afc442-8973-4643-a0e2-54469417e57b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:19:33 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-ff0a1d61-e62b-4359-954f-fccfb8b6616a req-370b56bc-bc9d-4b93-97a6-df2cba56a426 service nova] Lock "88afc442-8973-4643-a0e2-54469417e57b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:19:33 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-ff0a1d61-e62b-4359-954f-fccfb8b6616a req-370b56bc-bc9d-4b93-97a6-df2cba56a426 service nova] Lock "88afc442-8973-4643-a0e2-54469417e57b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:19:33 user nova-compute[75229]: DEBUG nova.compute.manager [req-ff0a1d61-e62b-4359-954f-fccfb8b6616a req-370b56bc-bc9d-4b93-97a6-df2cba56a426 service nova] [instance: 88afc442-8973-4643-a0e2-54469417e57b] No waiting events found dispatching network-vif-plugged-f4e7267a-b500-4eab-b71d-4ac31c55ca29 {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 10:19:33 user nova-compute[75229]: WARNING nova.compute.manager [req-ff0a1d61-e62b-4359-954f-fccfb8b6616a req-370b56bc-bc9d-4b93-97a6-df2cba56a426 service nova] [instance: 88afc442-8973-4643-a0e2-54469417e57b] Received unexpected event network-vif-plugged-f4e7267a-b500-4eab-b71d-4ac31c55ca29 for instance with vm_state active and task_state None.
Nov 14 10:19:34 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:19:34 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:19:34 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-526d2718-5190-42db-af54-2df18f0b4ec9 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] Acquiring lock "075ad651-31fd-4ee0-af86-fa8bef56d614" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:19:34 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-526d2718-5190-42db-af54-2df18f0b4ec9 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] Lock "075ad651-31fd-4ee0-af86-fa8bef56d614" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:19:34 user nova-compute[75229]: DEBUG nova.objects.instance [None req-526d2718-5190-42db-af54-2df18f0b4ec9 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] Lazy-loading 'flavor' on Instance uuid 075ad651-31fd-4ee0-af86-fa8bef56d614 {{(pid=75229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 10:19:34 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-526d2718-5190-42db-af54-2df18f0b4ec9 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] Lock "075ad651-31fd-4ee0-af86-fa8bef56d614" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:19:35 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-526d2718-5190-42db-af54-2df18f0b4ec9 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] Acquiring lock "075ad651-31fd-4ee0-af86-fa8bef56d614" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:19:35 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-526d2718-5190-42db-af54-2df18f0b4ec9 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] Lock "075ad651-31fd-4ee0-af86-fa8bef56d614" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:19:35 user nova-compute[75229]: INFO nova.compute.manager [None req-526d2718-5190-42db-af54-2df18f0b4ec9 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] [instance: 075ad651-31fd-4ee0-af86-fa8bef56d614] Attaching volume 52634d39-eace-4c0f-8ff0-e3bff4fa6506 to /dev/vdb
Nov 14 10:19:35 user nova-compute[75229]: DEBUG os_brick.utils [None req-526d2718-5190-42db-af54-2df18f0b4ec9 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 10:19:35 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:19:35 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:19:35 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[f633a9e1-a4c3-41ec-9beb-eb09b9b9f65e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f1154031c835\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:19:35 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:19:35 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:19:35 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce687b1d-09ac-43bc-be8b-096c45708752]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:19:35 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:19:35 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:19:35 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea43b27f-8095-45b9-9a4b-c1920a652809]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:19:35 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3f4562d-d284-4e82-8c2b-91ae85bddd6f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:19:35 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-526d2718-5190-42db-af54-2df18f0b4ec9 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] Running cmd (subprocess): nvme version {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:19:35 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-526d2718-5190-42db-af54-2df18f0b4ec9 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] 'nvme version' failed. Not Retrying. {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 10:19:35 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.nvmeof [None req-526d2718-5190-42db-af54-2df18f0b4ec9 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] nvme not present on system {{(pid=75229) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 10:19:35 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:19:35 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 10:19:35 user nova-compute[75229]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 10:19:35 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[53662329-3e13-4352-a773-b5978a3d2cd1]: (4, '') {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:19:35 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.lightos [None req-526d2718-5190-42db-af54-2df18f0b4ec9 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75229) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 10:19:35 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.lightos [None req-526d2718-5190-42db-af54-2df18f0b4ec9 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75229) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 10:19:35 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.lightos [None req-526d2718-5190-42db-af54-2df18f0b4ec9 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] LIGHTOS: no hostnqn found. {{(pid=75229) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 10:19:35 user nova-compute[75229]: DEBUG os_brick.utils [None req-526d2718-5190-42db-af54-2df18f0b4ec9 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f1154031c835', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 10:19:35 user nova-compute[75229]: DEBUG nova.virt.block_device [None req-526d2718-5190-42db-af54-2df18f0b4ec9 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] [instance: 075ad651-31fd-4ee0-af86-fa8bef56d614] Updating existing volume attachment record: e1fae160-56be-4b33-8141-9d701841dad4 {{(pid=75229) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 10:19:39 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:19:39 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:19:39 user nova-compute[75229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-526d2718-5190-42db-af54-2df18f0b4ec9 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] [instance: 075ad651-31fd-4ee0-af86-fa8bef56d614] Calling os-brick to attach iSCSI Volume {{(pid=75229) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 10:19:39 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-526d2718-5190-42db-af54-2df18f0b4ec9 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f73f85151b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:52634d39-eace-4c0f-8ff0-e3bff4fa6506', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LvqjVSZQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 10:19:39 user nova-compute[75229]: WARNING os_brick.initiator.connectors.base [None req-526d2718-5190-42db-af54-2df18f0b4ec9 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 10:19:39 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-526d2718-5190-42db-af54-2df18f0b4ec9 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 10:19:39 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-526d2718-5190-42db-af54-2df18f0b4ec9 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 10:19:39 user nova-compute[75229]: WARNING os_brick.initiator.connectors.base [None req-526d2718-5190-42db-af54-2df18f0b4ec9 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 10:19:39 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-526d2718-5190-42db-af54-2df18f0b4ec9 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:52634d39-eace-4c0f-8ff0-e3bff4fa6506" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 10:19:39 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-526d2718-5190-42db-af54-2df18f0b4ec9 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:52634d39-eace-4c0f-8ff0-e3bff4fa6506" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 10:19:39 user nova-compute[75229]: INFO os_brick.initiator.connectors.iscsi [None req-526d2718-5190-42db-af54-2df18f0b4ec9 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 10:19:39 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52634d39-eace-4c0f-8ff0-e3bff4fa6506 -p 172.16.0.220:3260 {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:19:39 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52634d39-eace-4c0f-8ff0-e3bff4fa6506 -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:19:39 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b9ac4a2-36e6-4790-9b26-322447d21745]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:19:39 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-526d2718-5190-42db-af54-2df18f0b4ec9 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 10:19:39 user nova-compute[75229]:  {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 10:19:39 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52634d39-eace-4c0f-8ff0-e3bff4fa6506 -p 172.16.0.220:3260 --interface default --op new {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:19:39 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52634d39-eace-4c0f-8ff0-e3bff4fa6506 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:19:39 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcc9e42a-0a2f-432e-9fcc-c9aed95f965c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:52634d39-eace-4c0f-8ff0-e3bff4fa6506] added\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:19:39 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-526d2718-5190-42db-af54-2df18f0b4ec9 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:52634d39-eace-4c0f-8ff0-e3bff4fa6506] added
Nov 14 10:19:39 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 10:19:39 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52634d39-eace-4c0f-8ff0-e3bff4fa6506 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:19:39 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52634d39-eace-4c0f-8ff0-e3bff4fa6506 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:19:39 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[19743315-6034-42eb-92a1-ea276b17676e]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:19:39 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-526d2718-5190-42db-af54-2df18f0b4ec9 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 10:19:39 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52634d39-eace-4c0f-8ff0-e3bff4fa6506 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:19:39 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52634d39-eace-4c0f-8ff0-e3bff4fa6506 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:19:39 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[14bec0fa-0d1a-46d4-9d4f-840757d5fd51]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:19:39 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-526d2718-5190-42db-af54-2df18f0b4ec9 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 10:19:39 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52634d39-eace-4c0f-8ff0-e3bff4fa6506 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LvqjVSZQ {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:19:39 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52634d39-eace-4c0f-8ff0-e3bff4fa6506 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LvqjVSZQ" returned: 0 in 0.017s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:19:39 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f88ae32-d53c-45b9-b629-ebbcf1553f1b]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:19:39 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-526d2718-5190-42db-af54-2df18f0b4ec9 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LvqjVSZQ'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 10:19:39 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52634d39-eace-4c0f-8ff0-e3bff4fa6506 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:19:39 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52634d39-eace-4c0f-8ff0-e3bff4fa6506 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:19:39 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a3cd8e9-2354-42ee-8464-b4983db91089]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:19:39 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-526d2718-5190-42db-af54-2df18f0b4ec9 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 10:19:39 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:19:39 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:19:39 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[50420486-6b3c-4594-a0d9-da9f2800c521]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:19:39 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-526d2718-5190-42db-af54-2df18f0b4ec9 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 14 10:19:39 user nova-compute[75229]:  {{(pid=75229) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 10:19:39 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-526d2718-5190-42db-af54-2df18f0b4ec9 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 14 10:19:39 user nova-compute[75229]:  {{(pid=75229) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 10:19:39 user nova-compute[75229]: WARNING os_brick.initiator.connectors.iscsi [None req-526d2718-5190-42db-af54-2df18f0b4ec9 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 14 10:19:39 user nova-compute[75229]: 
Nov 14 10:19:39 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52634d39-eace-4c0f-8ff0-e3bff4fa6506 -p 172.16.0.220:3260 --login {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:19:39 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52634d39-eace-4c0f-8ff0-e3bff4fa6506 -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:19:39 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d7b824a-1da3-4207-9283-10ce4a9747ec]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:52634d39-eace-4c0f-8ff0-e3bff4fa6506, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:52634d39-eace-4c0f-8ff0-e3bff4fa6506, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:19:39 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-526d2718-5190-42db-af54-2df18f0b4ec9 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:52634d39-eace-4c0f-8ff0-e3bff4fa6506, portal: 172.16.0.220,3260]
Nov 14 10:19:39 user nova-compute[75229]: Login to [iface: default, target: iqn.2010-10.org.openstack:52634d39-eace-4c0f-8ff0-e3bff4fa6506, portal: 172.16.0.220,3260] successful.
Nov 14 10:19:39 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 10:19:39 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52634d39-eace-4c0f-8ff0-e3bff4fa6506 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:19:39 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52634d39-eace-4c0f-8ff0-e3bff4fa6506 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:19:39 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[7458a20a-36b4-4d4a-b996-d2bc53a01396]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:19:39 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-526d2718-5190-42db-af54-2df18f0b4ec9 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 10:19:39 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:19:39 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:19:39 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fb30217-6aef-41d7-8b75-675a6f815b88]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52634d39-eace-4c0f-8ff0-e3bff4fa6506 (non-flash)\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:19:39 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-526d2718-5190-42db-af54-2df18f0b4ec9 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52634d39-eace-4c0f-8ff0-e3bff4fa6506 (non-flash)
Nov 14 10:19:39 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 10:19:39 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-526d2718-5190-42db-af54-2df18f0b4ec9 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52634d39-eace-4c0f-8ff0-e3bff4fa6506 (non-flash)
Nov 14 10:19:39 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 10:19:39 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-526d2718-5190-42db-af54-2df18f0b4ec9 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:52634d39-eace-4c0f-8ff0-e3bff4fa6506" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.269s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 10:19:39 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-526d2718-5190-42db-af54-2df18f0b4ec9 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] Connected to 172.16.0.220:3260 {{(pid=75229) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 10:19:39 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-526d2718-5190-42db-af54-2df18f0b4ec9 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] HCTL ('33', '-', '-', 0) found on session 60 with lun 0 {{(pid=75229) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 10:19:39 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-526d2718-5190-42db-af54-2df18f0b4ec9 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75229) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 10:19:39 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:19:39 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:19:39 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[70d1e13d-0684-40e1-af9d-a77648e5ddb5]: (4, ('- - 0', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:19:39 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-526d2718-5190-42db-af54-2df18f0b4ec9 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] Searching for a device in session 60 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75229) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 10:19:39 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-526d2718-5190-42db-af54-2df18f0b4ec9 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:52634d39-eace-4c0f-8ff0-e3bff4fa6506', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LvqjVSZQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75229) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 10:19:40 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-526d2718-5190-42db-af54-2df18f0b4ec9 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.296s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 10:19:40 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-526d2718-5190-42db-af54-2df18f0b4ec9 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] <== connect_volume: return (1298ms) {'type': 'block', 'scsi_wwn': '26335353963383539', 'path': '/dev/sdb'} {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 10:19:40 user nova-compute[75229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-526d2718-5190-42db-af54-2df18f0b4ec9 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] [instance: 075ad651-31fd-4ee0-af86-fa8bef56d614] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26335353963383539', 'path': '/dev/sdb'} {{(pid=75229) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 10:19:40 user nova-compute[75229]: DEBUG nova.objects.instance [None req-526d2718-5190-42db-af54-2df18f0b4ec9 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] Lazy-loading 'flavor' on Instance uuid 075ad651-31fd-4ee0-af86-fa8bef56d614 {{(pid=75229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 10:19:40 user nova-compute[75229]: DEBUG nova.virt.libvirt.guest [None req-526d2718-5190-42db-af54-2df18f0b4ec9 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 10:19:40 user nova-compute[75229]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 10:19:40 user nova-compute[75229]:   <source dev="/dev/sdb"/>
Nov 14 10:19:40 user nova-compute[75229]:   <target dev="vdb" bus="virtio"/>
Nov 14 10:19:40 user nova-compute[75229]:   <serial>52634d39-eace-4c0f-8ff0-e3bff4fa6506</serial>
Nov 14 10:19:40 user nova-compute[75229]: </disk>
Nov 14 10:19:40 user nova-compute[75229]:  {{(pid=75229) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 10:19:41 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-526d2718-5190-42db-af54-2df18f0b4ec9 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] No BDM found with device name vda, not building metadata. {{(pid=75229) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 10:19:41 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-526d2718-5190-42db-af54-2df18f0b4ec9 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75229) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 10:19:41 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-526d2718-5190-42db-af54-2df18f0b4ec9 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] No VIF found with MAC fa:16:3e:bc:2b:a6, not building metadata {{(pid=75229) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 10:19:41 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-526d2718-5190-42db-af54-2df18f0b4ec9 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] Lock "075ad651-31fd-4ee0-af86-fa8bef56d614" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.341s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:19:41 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._run_image_cache_manager_pass {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:19:41 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:19:41 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:19:41 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: held 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:19:41 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:19:41 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:19:41 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: held 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:19:41 user nova-compute[75229]: DEBUG nova.virt.libvirt.imagecache [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Verify base images {{(pid=75229) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:314}}
Nov 14 10:19:41 user nova-compute[75229]: DEBUG nova.virt.libvirt.imagecache [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Image id 3bef8470-ecc7-40e3-95d4-9254348ea72d yields fingerprint 4f30e3fe703d2381679612a57b1fb80a467f60b6 {{(pid=75229) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Nov 14 10:19:41 user nova-compute[75229]: INFO nova.virt.libvirt.imagecache [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] image 3bef8470-ecc7-40e3-95d4-9254348ea72d at (/opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6): checking
Nov 14 10:19:41 user nova-compute[75229]: DEBUG nova.virt.libvirt.imagecache [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] image 3bef8470-ecc7-40e3-95d4-9254348ea72d at (/opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6): image is in use {{(pid=75229) _mark_in_use /opt/stack/nova/nova/virt/libvirt/imagecache.py:279}}
Nov 14 10:19:41 user nova-compute[75229]: DEBUG nova.virt.libvirt.imagecache [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Image id  yields fingerprint da39a3ee5e6b4b0d3255bfef95601890afd80709 {{(pid=75229) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Nov 14 10:19:41 user nova-compute[75229]: DEBUG nova.virt.libvirt.imagecache [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] 075ad651-31fd-4ee0-af86-fa8bef56d614 is a valid instance name {{(pid=75229) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Nov 14 10:19:41 user nova-compute[75229]: DEBUG nova.virt.libvirt.imagecache [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] 075ad651-31fd-4ee0-af86-fa8bef56d614 has a disk file {{(pid=75229) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Nov 14 10:19:41 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/075ad651-31fd-4ee0-af86-fa8bef56d614/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:19:41 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/075ad651-31fd-4ee0-af86-fa8bef56d614/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:19:41 user nova-compute[75229]: DEBUG nova.virt.libvirt.imagecache [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Instance 075ad651-31fd-4ee0-af86-fa8bef56d614 is backed by 4f30e3fe703d2381679612a57b1fb80a467f60b6 {{(pid=75229) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Nov 14 10:19:41 user nova-compute[75229]: DEBUG nova.virt.libvirt.imagecache [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] 88afc442-8973-4643-a0e2-54469417e57b is a valid instance name {{(pid=75229) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Nov 14 10:19:41 user nova-compute[75229]: DEBUG nova.virt.libvirt.imagecache [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] 88afc442-8973-4643-a0e2-54469417e57b has a disk file {{(pid=75229) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Nov 14 10:19:41 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88afc442-8973-4643-a0e2-54469417e57b/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:19:42 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88afc442-8973-4643-a0e2-54469417e57b/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:19:42 user nova-compute[75229]: DEBUG nova.virt.libvirt.imagecache [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Instance 88afc442-8973-4643-a0e2-54469417e57b is backed by 4f30e3fe703d2381679612a57b1fb80a467f60b6 {{(pid=75229) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Nov 14 10:19:42 user nova-compute[75229]: WARNING nova.virt.libvirt.imagecache [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Unknown base file: /opt/stack/data/nova/instances/_base/11c08b0840a02e1ecc0c553970e3c961b9b03482
Nov 14 10:19:42 user nova-compute[75229]: WARNING nova.virt.libvirt.imagecache [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Unknown base file: /opt/stack/data/nova/instances/_base/f46cd2031cc9dbf9a98522f8247ea10806506aa8
Nov 14 10:19:42 user nova-compute[75229]: WARNING nova.virt.libvirt.imagecache [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Unknown base file: /opt/stack/data/nova/instances/_base/416b91d903087fa895f2161be55eed80e05b44b6
Nov 14 10:19:42 user nova-compute[75229]: WARNING nova.virt.libvirt.imagecache [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Unknown base file: /opt/stack/data/nova/instances/_base/d9970b2a3da011a0c3b2a5911c5bbe3e1973d4c7
Nov 14 10:19:42 user nova-compute[75229]: WARNING nova.virt.libvirt.imagecache [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Unknown base file: /opt/stack/data/nova/instances/_base/d94fe0cc9db796e88f461fae9d064442d41fccdf
Nov 14 10:19:42 user nova-compute[75229]: WARNING nova.virt.libvirt.imagecache [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Unknown base file: /opt/stack/data/nova/instances/_base/6d0c965a557e928b0a33b9a198a248850417ca09
Nov 14 10:19:42 user nova-compute[75229]: WARNING nova.virt.libvirt.imagecache [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Unknown base file: /opt/stack/data/nova/instances/_base/d8468a836873c93f733c22455de284c8041fbfd2
Nov 14 10:19:42 user nova-compute[75229]: WARNING nova.virt.libvirt.imagecache [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Unknown base file: /opt/stack/data/nova/instances/_base/6b044aeadd21f2b3d105ffe459475eb3e0be99fc
Nov 14 10:19:42 user nova-compute[75229]: WARNING nova.virt.libvirt.imagecache [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Unknown base file: /opt/stack/data/nova/instances/_base/4fef5d435559eee5483c7cb62e0076a8e2f37001
Nov 14 10:19:42 user nova-compute[75229]: INFO nova.virt.libvirt.imagecache [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Active base files: /opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6
Nov 14 10:19:42 user nova-compute[75229]: INFO nova.virt.libvirt.imagecache [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Removable base files: /opt/stack/data/nova/instances/_base/11c08b0840a02e1ecc0c553970e3c961b9b03482 /opt/stack/data/nova/instances/_base/f46cd2031cc9dbf9a98522f8247ea10806506aa8 /opt/stack/data/nova/instances/_base/416b91d903087fa895f2161be55eed80e05b44b6 /opt/stack/data/nova/instances/_base/d9970b2a3da011a0c3b2a5911c5bbe3e1973d4c7 /opt/stack/data/nova/instances/_base/d94fe0cc9db796e88f461fae9d064442d41fccdf /opt/stack/data/nova/instances/_base/6d0c965a557e928b0a33b9a198a248850417ca09 /opt/stack/data/nova/instances/_base/d8468a836873c93f733c22455de284c8041fbfd2 /opt/stack/data/nova/instances/_base/6b044aeadd21f2b3d105ffe459475eb3e0be99fc /opt/stack/data/nova/instances/_base/4fef5d435559eee5483c7cb62e0076a8e2f37001
Nov 14 10:19:42 user nova-compute[75229]: INFO nova.virt.libvirt.imagecache [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/11c08b0840a02e1ecc0c553970e3c961b9b03482
Nov 14 10:19:42 user nova-compute[75229]: INFO nova.virt.libvirt.imagecache [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/f46cd2031cc9dbf9a98522f8247ea10806506aa8
Nov 14 10:19:42 user nova-compute[75229]: INFO nova.virt.libvirt.imagecache [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/416b91d903087fa895f2161be55eed80e05b44b6
Nov 14 10:19:42 user nova-compute[75229]: INFO nova.virt.libvirt.imagecache [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/d9970b2a3da011a0c3b2a5911c5bbe3e1973d4c7
Nov 14 10:19:42 user nova-compute[75229]: INFO nova.virt.libvirt.imagecache [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/d94fe0cc9db796e88f461fae9d064442d41fccdf
Nov 14 10:19:42 user nova-compute[75229]: INFO nova.virt.libvirt.imagecache [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/6d0c965a557e928b0a33b9a198a248850417ca09
Nov 14 10:19:42 user nova-compute[75229]: INFO nova.virt.libvirt.imagecache [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/d8468a836873c93f733c22455de284c8041fbfd2
Nov 14 10:19:42 user nova-compute[75229]: INFO nova.virt.libvirt.imagecache [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/6b044aeadd21f2b3d105ffe459475eb3e0be99fc
Nov 14 10:19:42 user nova-compute[75229]: INFO nova.virt.libvirt.imagecache [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/4fef5d435559eee5483c7cb62e0076a8e2f37001
Nov 14 10:19:42 user nova-compute[75229]: DEBUG nova.virt.libvirt.imagecache [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Verification complete {{(pid=75229) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:350}}
Nov 14 10:19:42 user nova-compute[75229]: DEBUG nova.virt.libvirt.imagecache [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Verify swap images {{(pid=75229) _age_and_verify_swap_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:299}}
Nov 14 10:19:42 user nova-compute[75229]: DEBUG nova.virt.libvirt.imagecache [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Verify ephemeral images {{(pid=75229) _age_and_verify_ephemeral_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:284}}
Nov 14 10:19:43 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-a1df7aba-f00a-4108-b8a2-ca874bb4dac9 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] Acquiring lock "075ad651-31fd-4ee0-af86-fa8bef56d614" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:19:43 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-a1df7aba-f00a-4108-b8a2-ca874bb4dac9 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] Lock "075ad651-31fd-4ee0-af86-fa8bef56d614" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:19:43 user nova-compute[75229]: INFO nova.compute.manager [None req-a1df7aba-f00a-4108-b8a2-ca874bb4dac9 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] [instance: 075ad651-31fd-4ee0-af86-fa8bef56d614] Detaching volume 52634d39-eace-4c0f-8ff0-e3bff4fa6506
Nov 14 10:19:43 user nova-compute[75229]: INFO nova.virt.block_device [None req-a1df7aba-f00a-4108-b8a2-ca874bb4dac9 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] [instance: 075ad651-31fd-4ee0-af86-fa8bef56d614] Attempting to driver detach volume 52634d39-eace-4c0f-8ff0-e3bff4fa6506 from mountpoint /dev/vdb
Nov 14 10:19:43 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-a1df7aba-f00a-4108-b8a2-ca874bb4dac9 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] Attempting to detach device vdb from instance 075ad651-31fd-4ee0-af86-fa8bef56d614 from the persistent domain config. {{(pid=75229) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 10:19:43 user nova-compute[75229]: DEBUG nova.virt.libvirt.guest [None req-a1df7aba-f00a-4108-b8a2-ca874bb4dac9 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 10:19:43 user nova-compute[75229]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 10:19:43 user nova-compute[75229]:   <source dev="/dev/sdb"/>
Nov 14 10:19:43 user nova-compute[75229]:   <target dev="vdb" bus="virtio"/>
Nov 14 10:19:43 user nova-compute[75229]:   <serial>52634d39-eace-4c0f-8ff0-e3bff4fa6506</serial>
Nov 14 10:19:43 user nova-compute[75229]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 10:19:43 user nova-compute[75229]: </disk>
Nov 14 10:19:43 user nova-compute[75229]:  {{(pid=75229) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 10:19:43 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-a1df7aba-f00a-4108-b8a2-ca874bb4dac9 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] Successfully detached device vdb from instance 075ad651-31fd-4ee0-af86-fa8bef56d614 from the persistent domain config.
Nov 14 10:19:43 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-a1df7aba-f00a-4108-b8a2-ca874bb4dac9 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 075ad651-31fd-4ee0-af86-fa8bef56d614 from the live domain config. {{(pid=75229) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 10:19:43 user nova-compute[75229]: DEBUG nova.virt.libvirt.guest [None req-a1df7aba-f00a-4108-b8a2-ca874bb4dac9 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 10:19:43 user nova-compute[75229]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 10:19:43 user nova-compute[75229]:   <source dev="/dev/sdb"/>
Nov 14 10:19:43 user nova-compute[75229]:   <target dev="vdb" bus="virtio"/>
Nov 14 10:19:43 user nova-compute[75229]:   <serial>52634d39-eace-4c0f-8ff0-e3bff4fa6506</serial>
Nov 14 10:19:43 user nova-compute[75229]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 10:19:43 user nova-compute[75229]: </disk>
Nov 14 10:19:43 user nova-compute[75229]:  {{(pid=75229) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 10:19:43 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-a1df7aba-f00a-4108-b8a2-ca874bb4dac9 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 075ad651-31fd-4ee0-af86-fa8bef56d614 {{(pid=75229) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 10:19:44 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:19:44 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:19:49 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:19:49 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:19:54 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:19:54 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:19:59 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:19:59 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:20:03 user nova-compute[75229]: WARNING nova.virt.libvirt.driver [None req-a1df7aba-f00a-4108-b8a2-ca874bb4dac9 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 075ad651-31fd-4ee0-af86-fa8bef56d614 is timed out.
Nov 14 10:20:03 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-a1df7aba-f00a-4108-b8a2-ca874bb4dac9 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] Successfully detached device vdb from instance 075ad651-31fd-4ee0-af86-fa8bef56d614 from the live domain config.
Nov 14 10:20:03 user nova-compute[75229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a1df7aba-f00a-4108-b8a2-ca874bb4dac9 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] [instance: 075ad651-31fd-4ee0-af86-fa8bef56d614] calling os-brick to detach iSCSI Volume {{(pid=75229) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 10:20:03 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1df7aba-f00a-4108-b8a2-ca874bb4dac9 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f73f85151b0>, {'target_iqn': 'iqn.2010-10.org.openstack:52634d39-eace-4c0f-8ff0-e3bff4fa6506', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LvqjVSZQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 10:20:03 user nova-compute[75229]: WARNING os_brick.initiator.connectors.base [None req-a1df7aba-f00a-4108-b8a2-ca874bb4dac9 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 10:20:03 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-a1df7aba-f00a-4108-b8a2-ca874bb4dac9 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 10:20:03 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-a1df7aba-f00a-4108-b8a2-ca874bb4dac9 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 10:20:03 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:20:03 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:20:03 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[e82ded40-757b-4f10-b618-c80aa0dc2110]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:52634d39-eace-4c0f-8ff0-e3bff4fa6506\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:20:03 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1df7aba-f00a-4108-b8a2-ca874bb4dac9 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 10:20:03 user nova-compute[75229]: No targets found.
Nov 14 10:20:03 user nova-compute[75229]: iSNS:
Nov 14 10:20:03 user nova-compute[75229]: No targets found.
Nov 14 10:20:03 user nova-compute[75229]: STATIC:
Nov 14 10:20:03 user nova-compute[75229]: Target: iqn.2010-10.org.openstack:52634d39-eace-4c0f-8ff0-e3bff4fa6506
Nov 14 10:20:03 user nova-compute[75229]:         Portal: 172.16.0.220:3260,-1
Nov 14 10:20:03 user nova-compute[75229]:                 Iface Name: default
Nov 14 10:20:03 user nova-compute[75229]: FIRMWARE:
Nov 14 10:20:03 user nova-compute[75229]: No targets found.
Nov 14 10:20:03 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 10:20:03 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1df7aba-f00a-4108-b8a2-ca874bb4dac9 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 10:20:03 user nova-compute[75229]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 10:20:03 user nova-compute[75229]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75229) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 10:20:03 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1df7aba-f00a-4108-b8a2-ca874bb4dac9 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:52634d39-eace-4c0f-8ff0-e3bff4fa6506', 0)] {{(pid=75229) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 10:20:03 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:20:03 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:20:03 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[72a4d3da-d6da-4b86-adb0-4660d707fb69]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:52634d39-eace-4c0f-8ff0-e3bff4fa6506\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:20:03 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:20:03 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:20:03 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[0464f023-8684-4e03-a3d9-86eecb46a5c5]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52634d39-eace-4c0f-8ff0-e3bff4fa6506 (non-flash)\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:20:03 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1df7aba-f00a-4108-b8a2-ca874bb4dac9 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52634d39-eace-4c0f-8ff0-e3bff4fa6506 (non-flash)
Nov 14 10:20:03 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 10:20:03 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1df7aba-f00a-4108-b8a2-ca874bb4dac9 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52634d39-eace-4c0f-8ff0-e3bff4fa6506 (non-flash)
Nov 14 10:20:03 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 10:20:03 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1df7aba-f00a-4108-b8a2-ca874bb4dac9 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f73d4c9e290>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:52634d39-eace-4c0f-8ff0-e3bff4fa6506'): ({'sdb'}, set())}) {{(pid=75229) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 10:20:03 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-a1df7aba-f00a-4108-b8a2-ca874bb4dac9 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] Removing single pathed devices sdb {{(pid=75229) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 10:20:03 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:20:03 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:20:03 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[30618304-f608-48c5-a0e9-3d723cde6099]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:20:03 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:20:03 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.017s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:20:03 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0b24a59-4043-48b0-b1e6-dc1245571697]: (4, ('ok\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:20:03 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-a1df7aba-f00a-4108-b8a2-ca874bb4dac9 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] Flushing IO for device /dev/sdb {{(pid=75229) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 10:20:03 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:20:03 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:20:03 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[59959228-4f0c-454c-b0dc-3e8bf96fa3c2]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:20:03 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-a1df7aba-f00a-4108-b8a2-ca874bb4dac9 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75229) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 10:20:03 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:20:03 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.049s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:20:03 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[2794f1fd-6dd9-4f85-aa9f-bbbefc2a4cb1]: (4, ('1', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:20:03 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-a1df7aba-f00a-4108-b8a2-ca874bb4dac9 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75229) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 10:20:03 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-a1df7aba-f00a-4108-b8a2-ca874bb4dac9 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] SCSI volumes sdb have been removed. {{(pid=75229) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 10:20:03 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1df7aba-f00a-4108-b8a2-ca874bb4dac9 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:52634d39-eace-4c0f-8ff0-e3bff4fa6506')] {{(pid=75229) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 10:20:03 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52634d39-eace-4c0f-8ff0-e3bff4fa6506 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:20:03 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52634d39-eace-4c0f-8ff0-e3bff4fa6506 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:20:03 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[cadae5fe-f935-4b54-9991-36545ded72a1]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:20:03 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1df7aba-f00a-4108-b8a2-ca874bb4dac9 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 10:20:03 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52634d39-eace-4c0f-8ff0-e3bff4fa6506 -p 172.16.0.220:3260 --logout {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:20:03 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52634d39-eace-4c0f-8ff0-e3bff4fa6506 -p 172.16.0.220:3260 --logout" returned: 0 in 0.046s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:20:03 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[01faf0d6-53d6-40fb-8950-2d37f4fe9639]: (4, ('Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:52634d39-eace-4c0f-8ff0-e3bff4fa6506, portal: 172.16.0.220,3260]\nLogout of [sid: 60, target: iqn.2010-10.org.openstack:52634d39-eace-4c0f-8ff0-e3bff4fa6506, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:20:03 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1df7aba-f00a-4108-b8a2-ca874bb4dac9 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:52634d39-eace-4c0f-8ff0-e3bff4fa6506, portal: 172.16.0.220,3260]
Nov 14 10:20:03 user nova-compute[75229]: Logout of [sid: 60, target: iqn.2010-10.org.openstack:52634d39-eace-4c0f-8ff0-e3bff4fa6506, portal: 172.16.0.220,3260] successful.
Nov 14 10:20:03 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 10:20:03 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52634d39-eace-4c0f-8ff0-e3bff4fa6506 -p 172.16.0.220:3260 --op delete {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:20:03 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52634d39-eace-4c0f-8ff0-e3bff4fa6506 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:20:03 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[85a1e878-25f3-4e87-aaef-ddd43d9867d3]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:20:03 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1df7aba-f00a-4108-b8a2-ca874bb4dac9 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 10:20:03 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-a1df7aba-f00a-4108-b8a2-ca874bb4dac9 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.290s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 10:20:03 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1df7aba-f00a-4108-b8a2-ca874bb4dac9 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] <== disconnect_volume: return (291ms) None {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 10:20:03 user nova-compute[75229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a1df7aba-f00a-4108-b8a2-ca874bb4dac9 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] [instance: 075ad651-31fd-4ee0-af86-fa8bef56d614] Disconnected iSCSI Volume {{(pid=75229) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 10:20:04 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:20:04 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:20:04 user nova-compute[75229]: DEBUG nova.objects.instance [None req-a1df7aba-f00a-4108-b8a2-ca874bb4dac9 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] Lazy-loading 'flavor' on Instance uuid 075ad651-31fd-4ee0-af86-fa8bef56d614 {{(pid=75229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 10:20:04 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-a1df7aba-f00a-4108-b8a2-ca874bb4dac9 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] Lock "075ad651-31fd-4ee0-af86-fa8bef56d614" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.668s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:20:09 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:20:12 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:20:12 user nova-compute[75229]: DEBUG nova.compute.manager [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Starting heal instance info cache {{(pid=75229) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 10:20:12 user nova-compute[75229]: DEBUG nova.compute.manager [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Rebuilding the list of instances to heal {{(pid=75229) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 10:20:12 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Acquiring lock "refresh_cache-075ad651-31fd-4ee0-af86-fa8bef56d614" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 10:20:12 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Acquired lock "refresh_cache-075ad651-31fd-4ee0-af86-fa8bef56d614" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 10:20:12 user nova-compute[75229]: DEBUG nova.network.neutron [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] [instance: 075ad651-31fd-4ee0-af86-fa8bef56d614] Forcefully refreshing network info cache for instance {{(pid=75229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 10:20:12 user nova-compute[75229]: DEBUG nova.objects.instance [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Lazy-loading 'info_cache' on Instance uuid 075ad651-31fd-4ee0-af86-fa8bef56d614 {{(pid=75229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 10:20:12 user nova-compute[75229]: DEBUG nova.network.neutron [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] [instance: 075ad651-31fd-4ee0-af86-fa8bef56d614] Updating instance_info_cache with network_info: [{"id": "3d399542-6350-495b-9b54-13b21f7a99b8", "address": "fa:16:3e:bc:2b:a6", "network": {"id": "9fe5fa8c-b7e9-4f4f-88f1-e68567b67c3f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1670467158-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.122", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e94e4e374fb4329a0d1dd4cc8e3a2fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d399542-63", "ovs_interfaceid": "3d399542-6350-495b-9b54-13b21f7a99b8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 10:20:12 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Releasing lock "refresh_cache-075ad651-31fd-4ee0-af86-fa8bef56d614" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 10:20:12 user nova-compute[75229]: DEBUG nova.compute.manager [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] [instance: 075ad651-31fd-4ee0-af86-fa8bef56d614] Updated the network info_cache for instance {{(pid=75229) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 10:20:12 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:20:14 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 10:20:14 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 10:20:14 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75229) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 10:20:14 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75229) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 10:20:14 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75229) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 10:20:14 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:20:16 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:20:17 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:20:17 user nova-compute[75229]: DEBUG nova.compute.manager [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75229) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 10:20:17 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:20:17 user nova-compute[75229]: DEBUG nova.compute.manager [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Cleaning up deleted instances {{(pid=75229) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 14 10:20:17 user nova-compute[75229]: DEBUG nova.compute.manager [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] There are 0 instances to clean {{(pid=75229) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 14 10:20:18 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:20:19 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 10:20:20 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:20:22 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:20:22 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:20:22 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:20:22 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:20:22 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Auditing locally available compute resources for user (node: user) {{(pid=75229) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 10:20:22 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/075ad651-31fd-4ee0-af86-fa8bef56d614/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:20:23 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/075ad651-31fd-4ee0-af86-fa8bef56d614/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:20:23 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/075ad651-31fd-4ee0-af86-fa8bef56d614/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:20:23 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/075ad651-31fd-4ee0-af86-fa8bef56d614/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:20:23 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88afc442-8973-4643-a0e2-54469417e57b/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:20:23 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88afc442-8973-4643-a0e2-54469417e57b/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:20:23 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88afc442-8973-4643-a0e2-54469417e57b/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:20:23 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88afc442-8973-4643-a0e2-54469417e57b/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:20:24 user nova-compute[75229]: WARNING nova.virt.libvirt.driver [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 10:20:24 user nova-compute[75229]: WARNING nova.virt.libvirt.driver [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 10:20:24 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Hypervisor/Node resource view: name=user free_ram=8861MB free_disk=25.117752075195312GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75229) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 10:20:24 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:20:24 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:20:24 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Instance 075ad651-31fd-4ee0-af86-fa8bef56d614 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 10:20:24 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Instance 88afc442-8973-4643-a0e2-54469417e57b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 10:20:24 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75229) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 10:20:24 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75229) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 10:20:24 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 10:20:24 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:20:24 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75229) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 10:20:24 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75229) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 10:20:24 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75229) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 10:20:24 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:20:24 user nova-compute[75229]: DEBUG nova.scheduler.client.report [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Refreshing inventories for resource provider d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 {{(pid=75229) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 14 10:20:24 user nova-compute[75229]: DEBUG nova.scheduler.client.report [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Updating ProviderTree inventory for provider d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75229) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 14 10:20:24 user nova-compute[75229]: DEBUG nova.compute.provider_tree [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Updating inventory in ProviderTree for provider d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 14 10:20:24 user nova-compute[75229]: DEBUG nova.scheduler.client.report [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Refreshing aggregate associations for resource provider d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3, aggregates: None {{(pid=75229) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 14 10:20:24 user nova-compute[75229]: DEBUG nova.scheduler.client.report [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Refreshing trait associations for resource provider d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3, traits: COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_MMX,HW_CPU_X86_SSE42,HW_CPU_X86_SSSE3,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_TRUSTED_CERTS,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSE,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_USB,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_RESCUE_BFV {{(pid=75229) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 14 10:20:24 user nova-compute[75229]: DEBUG nova.compute.provider_tree [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Inventory has not changed in ProviderTree for provider: d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 {{(pid=75229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 10:20:24 user nova-compute[75229]: DEBUG nova.scheduler.client.report [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Inventory has not changed for provider d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 10:20:24 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Compute_service record updated for user:user {{(pid=75229) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 10:20:24 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.458s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:20:25 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:20:26 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:20:28 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:20:28 user nova-compute[75229]: DEBUG nova.compute.manager [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75229) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 14 10:20:29 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 10:20:29 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:20:29 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75229) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 10:20:29 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75229) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 10:20:29 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75229) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 10:20:29 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:20:33 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:20:34 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 10:20:34 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:20:34 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75229) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 10:20:34 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75229) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 10:20:34 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75229) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 10:20:34 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:20:35 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-30b04bcb-3bf4-4d20-a3a6-95789000a648 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] Acquiring lock "075ad651-31fd-4ee0-af86-fa8bef56d614" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:20:35 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-30b04bcb-3bf4-4d20-a3a6-95789000a648 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] Lock "075ad651-31fd-4ee0-af86-fa8bef56d614" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:20:35 user nova-compute[75229]: DEBUG nova.objects.instance [None req-30b04bcb-3bf4-4d20-a3a6-95789000a648 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] Lazy-loading 'flavor' on Instance uuid 075ad651-31fd-4ee0-af86-fa8bef56d614 {{(pid=75229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 10:20:35 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-30b04bcb-3bf4-4d20-a3a6-95789000a648 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] Lock "075ad651-31fd-4ee0-af86-fa8bef56d614" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:20:35 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-30b04bcb-3bf4-4d20-a3a6-95789000a648 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] Acquiring lock "075ad651-31fd-4ee0-af86-fa8bef56d614" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:20:35 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-30b04bcb-3bf4-4d20-a3a6-95789000a648 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] Lock "075ad651-31fd-4ee0-af86-fa8bef56d614" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:20:35 user nova-compute[75229]: INFO nova.compute.manager [None req-30b04bcb-3bf4-4d20-a3a6-95789000a648 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] [instance: 075ad651-31fd-4ee0-af86-fa8bef56d614] Attaching volume e3f2f153-173c-4fa3-8c09-2538c6839d5b to /dev/vdb
Nov 14 10:20:35 user nova-compute[75229]: DEBUG os_brick.utils [None req-30b04bcb-3bf4-4d20-a3a6-95789000a648 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 10:20:35 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:20:35 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:20:35 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e56f4c6-02a5-48da-b189-cc2e8c506195]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f1154031c835\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:20:35 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:20:35 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:20:35 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[405cfff1-b4b1-4614-ace8-b18523935414]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:20:35 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:20:35 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:20:35 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae9b80e7-594f-40c7-be7a-9ee86ae20feb]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:20:35 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d9086b0-3373-4364-b857-c998f76063e0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:20:35 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-30b04bcb-3bf4-4d20-a3a6-95789000a648 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] Running cmd (subprocess): nvme version {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:20:35 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-30b04bcb-3bf4-4d20-a3a6-95789000a648 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] 'nvme version' failed. Not Retrying. {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 10:20:35 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.nvmeof [None req-30b04bcb-3bf4-4d20-a3a6-95789000a648 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] nvme not present on system {{(pid=75229) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 10:20:35 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:20:35 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 10:20:35 user nova-compute[75229]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 10:20:35 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9a8394e-32da-4a51-918a-48fa382683a0]: (4, '') {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:20:35 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.lightos [None req-30b04bcb-3bf4-4d20-a3a6-95789000a648 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75229) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 10:20:35 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.lightos [None req-30b04bcb-3bf4-4d20-a3a6-95789000a648 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75229) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 10:20:35 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.lightos [None req-30b04bcb-3bf4-4d20-a3a6-95789000a648 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] LIGHTOS: no hostnqn found. {{(pid=75229) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 10:20:35 user nova-compute[75229]: DEBUG os_brick.utils [None req-30b04bcb-3bf4-4d20-a3a6-95789000a648 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f1154031c835', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 10:20:35 user nova-compute[75229]: DEBUG nova.virt.block_device [None req-30b04bcb-3bf4-4d20-a3a6-95789000a648 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] [instance: 075ad651-31fd-4ee0-af86-fa8bef56d614] Updating existing volume attachment record: 0c6c2d2b-b1be-4b37-8714-33f958e97310 {{(pid=75229) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 10:20:36 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:20:39 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 10:20:39 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:20:39 user nova-compute[75229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-30b04bcb-3bf4-4d20-a3a6-95789000a648 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] [instance: 075ad651-31fd-4ee0-af86-fa8bef56d614] Calling os-brick to attach iSCSI Volume {{(pid=75229) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 10:20:39 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-30b04bcb-3bf4-4d20-a3a6-95789000a648 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f73f85151b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e3f2f153-173c-4fa3-8c09-2538c6839d5b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zpJVqicv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 10:20:39 user nova-compute[75229]: WARNING os_brick.initiator.connectors.base [None req-30b04bcb-3bf4-4d20-a3a6-95789000a648 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 10:20:39 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-30b04bcb-3bf4-4d20-a3a6-95789000a648 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 10:20:39 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-30b04bcb-3bf4-4d20-a3a6-95789000a648 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 10:20:39 user nova-compute[75229]: WARNING os_brick.initiator.connectors.base [None req-30b04bcb-3bf4-4d20-a3a6-95789000a648 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 10:20:39 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-30b04bcb-3bf4-4d20-a3a6-95789000a648 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e3f2f153-173c-4fa3-8c09-2538c6839d5b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 10:20:39 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-30b04bcb-3bf4-4d20-a3a6-95789000a648 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e3f2f153-173c-4fa3-8c09-2538c6839d5b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 10:20:39 user nova-compute[75229]: INFO os_brick.initiator.connectors.iscsi [None req-30b04bcb-3bf4-4d20-a3a6-95789000a648 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 10:20:39 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3f2f153-173c-4fa3-8c09-2538c6839d5b -p 172.16.0.220:3260 {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:20:39 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3f2f153-173c-4fa3-8c09-2538c6839d5b -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:20:39 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a74054c-0063-4812-ae4b-7668fa4c32e8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:20:39 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-30b04bcb-3bf4-4d20-a3a6-95789000a648 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 10:20:39 user nova-compute[75229]:  {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 10:20:39 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3f2f153-173c-4fa3-8c09-2538c6839d5b -p 172.16.0.220:3260 --interface default --op new {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:20:39 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3f2f153-173c-4fa3-8c09-2538c6839d5b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:20:39 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[e907cdb3-b847-46df-95db-7a7038aa5fcc]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e3f2f153-173c-4fa3-8c09-2538c6839d5b] added\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:20:39 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-30b04bcb-3bf4-4d20-a3a6-95789000a648 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e3f2f153-173c-4fa3-8c09-2538c6839d5b] added
Nov 14 10:20:39 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 10:20:39 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3f2f153-173c-4fa3-8c09-2538c6839d5b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:20:39 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3f2f153-173c-4fa3-8c09-2538c6839d5b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:20:39 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d3a9a7a-eb09-4ca9-912a-6dae29141e4a]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:20:39 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-30b04bcb-3bf4-4d20-a3a6-95789000a648 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 10:20:39 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3f2f153-173c-4fa3-8c09-2538c6839d5b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:20:39 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3f2f153-173c-4fa3-8c09-2538c6839d5b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:20:39 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dac9850-544c-4c95-827f-72d9480ae0e6]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:20:39 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-30b04bcb-3bf4-4d20-a3a6-95789000a648 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 10:20:39 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3f2f153-173c-4fa3-8c09-2538c6839d5b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zpJVqicv {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:20:39 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3f2f153-173c-4fa3-8c09-2538c6839d5b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zpJVqicv" returned: 0 in 0.019s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:20:39 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[99f8cd99-6320-4f4f-8058-d23eea899a36]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:20:39 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-30b04bcb-3bf4-4d20-a3a6-95789000a648 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zpJVqicv'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 10:20:39 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3f2f153-173c-4fa3-8c09-2538c6839d5b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:20:39 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3f2f153-173c-4fa3-8c09-2538c6839d5b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:20:39 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb42f13c-4d96-4ef4-81b4-7f5aac013794]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:20:39 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-30b04bcb-3bf4-4d20-a3a6-95789000a648 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 10:20:39 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:20:39 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.015s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:20:39 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[99d76a66-2cf9-4740-bd3a-0f982462d806]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:20:39 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-30b04bcb-3bf4-4d20-a3a6-95789000a648 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 14 10:20:39 user nova-compute[75229]:  {{(pid=75229) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 10:20:39 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-30b04bcb-3bf4-4d20-a3a6-95789000a648 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 14 10:20:39 user nova-compute[75229]:  {{(pid=75229) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 10:20:39 user nova-compute[75229]: WARNING os_brick.initiator.connectors.iscsi [None req-30b04bcb-3bf4-4d20-a3a6-95789000a648 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 14 10:20:39 user nova-compute[75229]: 
Nov 14 10:20:39 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3f2f153-173c-4fa3-8c09-2538c6839d5b -p 172.16.0.220:3260 --login {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:20:39 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3f2f153-173c-4fa3-8c09-2538c6839d5b -p 172.16.0.220:3260 --login" returned: 0 in 0.049s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:20:39 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc5b9ec4-158f-41ed-bed7-b7d7bdbbbdf9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e3f2f153-173c-4fa3-8c09-2538c6839d5b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e3f2f153-173c-4fa3-8c09-2538c6839d5b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:20:39 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-30b04bcb-3bf4-4d20-a3a6-95789000a648 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e3f2f153-173c-4fa3-8c09-2538c6839d5b, portal: 172.16.0.220,3260]
Nov 14 10:20:39 user nova-compute[75229]: Login to [iface: default, target: iqn.2010-10.org.openstack:e3f2f153-173c-4fa3-8c09-2538c6839d5b, portal: 172.16.0.220,3260] successful.
Nov 14 10:20:39 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 10:20:39 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3f2f153-173c-4fa3-8c09-2538c6839d5b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:20:39 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3f2f153-173c-4fa3-8c09-2538c6839d5b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:20:39 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[320f992e-55d2-4a5c-87fd-0c7c0cb68093]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:20:39 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-30b04bcb-3bf4-4d20-a3a6-95789000a648 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 10:20:39 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:20:39 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:20:39 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[8700c99b-8469-44d1-a2ae-1d8a2e04ca9d]: (4, ('tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3f2f153-173c-4fa3-8c09-2538c6839d5b (non-flash)\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:20:39 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-30b04bcb-3bf4-4d20-a3a6-95789000a648 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3f2f153-173c-4fa3-8c09-2538c6839d5b (non-flash)
Nov 14 10:20:39 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 10:20:39 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-30b04bcb-3bf4-4d20-a3a6-95789000a648 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] iscsi session list stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3f2f153-173c-4fa3-8c09-2538c6839d5b (non-flash)
Nov 14 10:20:39 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 10:20:39 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-30b04bcb-3bf4-4d20-a3a6-95789000a648 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e3f2f153-173c-4fa3-8c09-2538c6839d5b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.260s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 10:20:39 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-30b04bcb-3bf4-4d20-a3a6-95789000a648 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] Connected to 172.16.0.220:3260 {{(pid=75229) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 10:20:39 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-30b04bcb-3bf4-4d20-a3a6-95789000a648 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] HCTL ('33', '-', '-', 0) found on session 61 with lun 0 {{(pid=75229) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 10:20:39 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-30b04bcb-3bf4-4d20-a3a6-95789000a648 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75229) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 10:20:39 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:20:39 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:20:39 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fe930e9-2798-4825-9d82-f35b515764c6]: (4, ('- - 0', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:20:39 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-30b04bcb-3bf4-4d20-a3a6-95789000a648 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] Searching for a device in session 61 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75229) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 10:20:39 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-30b04bcb-3bf4-4d20-a3a6-95789000a648 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:e3f2f153-173c-4fa3-8c09-2538c6839d5b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zpJVqicv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75229) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 10:20:40 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-30b04bcb-3bf4-4d20-a3a6-95789000a648 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.294s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 10:20:40 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-30b04bcb-3bf4-4d20-a3a6-95789000a648 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] <== connect_volume: return (1295ms) {'type': 'block', 'scsi_wwn': '26465306435386233', 'path': '/dev/sdb'} {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 10:20:40 user nova-compute[75229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-30b04bcb-3bf4-4d20-a3a6-95789000a648 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] [instance: 075ad651-31fd-4ee0-af86-fa8bef56d614] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26465306435386233', 'path': '/dev/sdb'} {{(pid=75229) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 10:20:40 user nova-compute[75229]: DEBUG nova.objects.instance [None req-30b04bcb-3bf4-4d20-a3a6-95789000a648 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] Lazy-loading 'flavor' on Instance uuid 075ad651-31fd-4ee0-af86-fa8bef56d614 {{(pid=75229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 10:20:40 user nova-compute[75229]: DEBUG nova.virt.libvirt.guest [None req-30b04bcb-3bf4-4d20-a3a6-95789000a648 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 10:20:40 user nova-compute[75229]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 10:20:40 user nova-compute[75229]:   <source dev="/dev/sdb"/>
Nov 14 10:20:40 user nova-compute[75229]:   <target dev="vdb" bus="virtio"/>
Nov 14 10:20:40 user nova-compute[75229]:   <serial>e3f2f153-173c-4fa3-8c09-2538c6839d5b</serial>
Nov 14 10:20:40 user nova-compute[75229]: </disk>
Nov 14 10:20:40 user nova-compute[75229]:  {{(pid=75229) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 10:20:41 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-30b04bcb-3bf4-4d20-a3a6-95789000a648 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] No BDM found with device name vda, not building metadata. {{(pid=75229) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 10:20:41 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-30b04bcb-3bf4-4d20-a3a6-95789000a648 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75229) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 10:20:41 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-30b04bcb-3bf4-4d20-a3a6-95789000a648 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] No VIF found with MAC fa:16:3e:bc:2b:a6, not building metadata {{(pid=75229) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 10:20:41 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-30b04bcb-3bf4-4d20-a3a6-95789000a648 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] Lock "075ad651-31fd-4ee0-af86-fa8bef56d614" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.056s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:20:43 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-341c4c8b-084f-4d8e-b903-c9882924c0a4 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] Acquiring lock "075ad651-31fd-4ee0-af86-fa8bef56d614" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:20:43 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-341c4c8b-084f-4d8e-b903-c9882924c0a4 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] Lock "075ad651-31fd-4ee0-af86-fa8bef56d614" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:20:43 user nova-compute[75229]: INFO nova.compute.manager [None req-341c4c8b-084f-4d8e-b903-c9882924c0a4 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] [instance: 075ad651-31fd-4ee0-af86-fa8bef56d614] Detaching volume e3f2f153-173c-4fa3-8c09-2538c6839d5b
Nov 14 10:20:43 user nova-compute[75229]: INFO nova.virt.block_device [None req-341c4c8b-084f-4d8e-b903-c9882924c0a4 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] [instance: 075ad651-31fd-4ee0-af86-fa8bef56d614] Attempting to driver detach volume e3f2f153-173c-4fa3-8c09-2538c6839d5b from mountpoint /dev/vdb
Nov 14 10:20:43 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-341c4c8b-084f-4d8e-b903-c9882924c0a4 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] Attempting to detach device vdb from instance 075ad651-31fd-4ee0-af86-fa8bef56d614 from the persistent domain config. {{(pid=75229) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 10:20:43 user nova-compute[75229]: DEBUG nova.virt.libvirt.guest [None req-341c4c8b-084f-4d8e-b903-c9882924c0a4 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 10:20:43 user nova-compute[75229]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 10:20:43 user nova-compute[75229]:   <source dev="/dev/sdb"/>
Nov 14 10:20:43 user nova-compute[75229]:   <target dev="vdb" bus="virtio"/>
Nov 14 10:20:43 user nova-compute[75229]:   <serial>e3f2f153-173c-4fa3-8c09-2538c6839d5b</serial>
Nov 14 10:20:43 user nova-compute[75229]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 10:20:43 user nova-compute[75229]: </disk>
Nov 14 10:20:43 user nova-compute[75229]:  {{(pid=75229) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 10:20:43 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-341c4c8b-084f-4d8e-b903-c9882924c0a4 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] Successfully detached device vdb from instance 075ad651-31fd-4ee0-af86-fa8bef56d614 from the persistent domain config.
Nov 14 10:20:43 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-341c4c8b-084f-4d8e-b903-c9882924c0a4 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 075ad651-31fd-4ee0-af86-fa8bef56d614 from the live domain config. {{(pid=75229) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 10:20:43 user nova-compute[75229]: DEBUG nova.virt.libvirt.guest [None req-341c4c8b-084f-4d8e-b903-c9882924c0a4 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 10:20:43 user nova-compute[75229]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 10:20:43 user nova-compute[75229]:   <source dev="/dev/sdb"/>
Nov 14 10:20:43 user nova-compute[75229]:   <target dev="vdb" bus="virtio"/>
Nov 14 10:20:43 user nova-compute[75229]:   <serial>e3f2f153-173c-4fa3-8c09-2538c6839d5b</serial>
Nov 14 10:20:43 user nova-compute[75229]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 10:20:43 user nova-compute[75229]: </disk>
Nov 14 10:20:43 user nova-compute[75229]:  {{(pid=75229) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 10:20:43 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-341c4c8b-084f-4d8e-b903-c9882924c0a4 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 075ad651-31fd-4ee0-af86-fa8bef56d614 {{(pid=75229) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 10:20:44 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:20:44 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:20:49 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:20:54 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 10:20:54 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:20:54 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=75229) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 10:20:54 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75229) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 10:20:54 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75229) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 10:20:54 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:20:59 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 10:20:59 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:20:59 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75229) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 10:20:59 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75229) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 10:20:59 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75229) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 10:20:59 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:21:03 user nova-compute[75229]: WARNING nova.virt.libvirt.driver [None req-341c4c8b-084f-4d8e-b903-c9882924c0a4 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 075ad651-31fd-4ee0-af86-fa8bef56d614 is timed out.
Nov 14 10:21:03 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-341c4c8b-084f-4d8e-b903-c9882924c0a4 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] Successfully detached device vdb from instance 075ad651-31fd-4ee0-af86-fa8bef56d614 from the live domain config.
Nov 14 10:21:03 user nova-compute[75229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-341c4c8b-084f-4d8e-b903-c9882924c0a4 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] [instance: 075ad651-31fd-4ee0-af86-fa8bef56d614] calling os-brick to detach iSCSI Volume {{(pid=75229) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 10:21:03 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-341c4c8b-084f-4d8e-b903-c9882924c0a4 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f73f85151b0>, {'target_iqn': 'iqn.2010-10.org.openstack:e3f2f153-173c-4fa3-8c09-2538c6839d5b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zpJVqicv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 10:21:03 user nova-compute[75229]: WARNING os_brick.initiator.connectors.base [None req-341c4c8b-084f-4d8e-b903-c9882924c0a4 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 10:21:03 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-341c4c8b-084f-4d8e-b903-c9882924c0a4 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 10:21:03 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-341c4c8b-084f-4d8e-b903-c9882924c0a4 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 10:21:03 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:21:03 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:21:03 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[e63aed96-25f7-4209-b080-917badd22dab]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e3f2f153-173c-4fa3-8c09-2538c6839d5b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:21:03 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-341c4c8b-084f-4d8e-b903-c9882924c0a4 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 10:21:03 user nova-compute[75229]: No targets found.
Nov 14 10:21:03 user nova-compute[75229]: iSNS:
Nov 14 10:21:03 user nova-compute[75229]: No targets found.
Nov 14 10:21:03 user nova-compute[75229]: STATIC:
Nov 14 10:21:03 user nova-compute[75229]: Target: iqn.2010-10.org.openstack:e3f2f153-173c-4fa3-8c09-2538c6839d5b
Nov 14 10:21:03 user nova-compute[75229]:         Portal: 172.16.0.220:3260,-1
Nov 14 10:21:03 user nova-compute[75229]:                 Iface Name: default
Nov 14 10:21:03 user nova-compute[75229]: FIRMWARE:
Nov 14 10:21:03 user nova-compute[75229]: No targets found.
Nov 14 10:21:03 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 10:21:03 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-341c4c8b-084f-4d8e-b903-c9882924c0a4 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 10:21:03 user nova-compute[75229]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 10:21:03 user nova-compute[75229]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75229) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 10:21:03 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-341c4c8b-084f-4d8e-b903-c9882924c0a4 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e3f2f153-173c-4fa3-8c09-2538c6839d5b', 0)] {{(pid=75229) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 10:21:03 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:21:03 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:21:03 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[951b0990-2a28-4d28-ad5d-ef866a4c52fd]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e3f2f153-173c-4fa3-8c09-2538c6839d5b\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:21:03 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:21:04 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:21:04 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[4abf44d1-2c62-45dd-b8ad-b5173facf20e]: (4, ('tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3f2f153-173c-4fa3-8c09-2538c6839d5b (non-flash)\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:21:04 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-341c4c8b-084f-4d8e-b903-c9882924c0a4 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3f2f153-173c-4fa3-8c09-2538c6839d5b (non-flash)
Nov 14 10:21:04 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 10:21:04 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-341c4c8b-084f-4d8e-b903-c9882924c0a4 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] iscsi session list stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3f2f153-173c-4fa3-8c09-2538c6839d5b (non-flash)
Nov 14 10:21:04 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 10:21:04 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-341c4c8b-084f-4d8e-b903-c9882924c0a4 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f73d4ec8310>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e3f2f153-173c-4fa3-8c09-2538c6839d5b'): ({'sdb'}, set())}) {{(pid=75229) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 10:21:04 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-341c4c8b-084f-4d8e-b903-c9882924c0a4 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] Removing single pathed devices sdb {{(pid=75229) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 10:21:04 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:21:04 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:21:04 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[21c1cdce-8f0f-4cca-a436-f307094846b6]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:21:04 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:21:04 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:21:04 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[bff7026f-0438-4410-839b-fd4e9f5ee56b]: (4, ('ok\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:21:04 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-341c4c8b-084f-4d8e-b903-c9882924c0a4 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] Flushing IO for device /dev/sdb {{(pid=75229) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 10:21:04 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:21:04 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:21:04 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea77dd44-ec1e-4ff5-a4ae-1215c2065161]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:21:04 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-341c4c8b-084f-4d8e-b903-c9882924c0a4 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75229) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 10:21:04 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:21:04 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.036s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:21:04 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed7140ae-d9ac-4ab0-90e6-bb19ecf7623c]: (4, ('1', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:21:04 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-341c4c8b-084f-4d8e-b903-c9882924c0a4 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75229) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 10:21:04 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-341c4c8b-084f-4d8e-b903-c9882924c0a4 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] SCSI volumes sdb have been removed. {{(pid=75229) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 10:21:04 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-341c4c8b-084f-4d8e-b903-c9882924c0a4 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e3f2f153-173c-4fa3-8c09-2538c6839d5b')] {{(pid=75229) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 10:21:04 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3f2f153-173c-4fa3-8c09-2538c6839d5b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:21:04 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3f2f153-173c-4fa3-8c09-2538c6839d5b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:21:04 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[c69b38a5-3bed-4ec2-a724-ee0c49655945]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:21:04 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-341c4c8b-084f-4d8e-b903-c9882924c0a4 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 10:21:04 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3f2f153-173c-4fa3-8c09-2538c6839d5b -p 172.16.0.220:3260 --logout {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:21:04 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3f2f153-173c-4fa3-8c09-2538c6839d5b -p 172.16.0.220:3260 --logout" returned: 0 in 0.046s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:21:04 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b3bdabe-3b8d-46b8-873f-3affee368c75]: (4, ('Logging out of session [sid: 61, target: iqn.2010-10.org.openstack:e3f2f153-173c-4fa3-8c09-2538c6839d5b, portal: 172.16.0.220,3260]\nLogout of [sid: 61, target: iqn.2010-10.org.openstack:e3f2f153-173c-4fa3-8c09-2538c6839d5b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:21:04 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-341c4c8b-084f-4d8e-b903-c9882924c0a4 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 61, target: iqn.2010-10.org.openstack:e3f2f153-173c-4fa3-8c09-2538c6839d5b, portal: 172.16.0.220,3260]
Nov 14 10:21:04 user nova-compute[75229]: Logout of [sid: 61, target: iqn.2010-10.org.openstack:e3f2f153-173c-4fa3-8c09-2538c6839d5b, portal: 172.16.0.220,3260] successful.
Nov 14 10:21:04 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 10:21:04 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3f2f153-173c-4fa3-8c09-2538c6839d5b -p 172.16.0.220:3260 --op delete {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:21:04 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3f2f153-173c-4fa3-8c09-2538c6839d5b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:21:04 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[930558c9-ed5e-425d-b4d4-55f04ebebce2]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:21:04 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-341c4c8b-084f-4d8e-b903-c9882924c0a4 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 10:21:04 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-341c4c8b-084f-4d8e-b903-c9882924c0a4 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.296s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 10:21:04 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-341c4c8b-084f-4d8e-b903-c9882924c0a4 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] <== disconnect_volume: return (297ms) None {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 10:21:04 user nova-compute[75229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-341c4c8b-084f-4d8e-b903-c9882924c0a4 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] [instance: 075ad651-31fd-4ee0-af86-fa8bef56d614] Disconnected iSCSI Volume {{(pid=75229) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 10:21:04 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 10:21:04 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 10:21:04 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75229) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 10:21:04 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75229) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 10:21:04 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75229) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 10:21:04 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:21:04 user nova-compute[75229]: DEBUG nova.objects.instance [None req-341c4c8b-084f-4d8e-b903-c9882924c0a4 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] Lazy-loading 'flavor' on Instance uuid 075ad651-31fd-4ee0-af86-fa8bef56d614 {{(pid=75229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 10:21:05 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-341c4c8b-084f-4d8e-b903-c9882924c0a4 tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] Lock "075ad651-31fd-4ee0-af86-fa8bef56d614" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.690s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:21:09 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 10:21:09 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:21:09 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75229) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 10:21:09 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75229) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 10:21:09 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75229) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 10:21:09 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:21:13 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:21:13 user nova-compute[75229]: DEBUG nova.compute.manager [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Starting heal instance info cache {{(pid=75229) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 10:21:13 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Acquiring lock "refresh_cache-88afc442-8973-4643-a0e2-54469417e57b" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 10:21:13 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Acquired lock "refresh_cache-88afc442-8973-4643-a0e2-54469417e57b" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 10:21:13 user nova-compute[75229]: DEBUG nova.network.neutron [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] [instance: 88afc442-8973-4643-a0e2-54469417e57b] Forcefully refreshing network info cache for instance {{(pid=75229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 10:21:14 user nova-compute[75229]: DEBUG nova.network.neutron [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] [instance: 88afc442-8973-4643-a0e2-54469417e57b] Updating instance_info_cache with network_info: [{"id": "f4e7267a-b500-4eab-b71d-4ac31c55ca29", "address": "fa:16:3e:46:4a:b8", "network": {"id": "13b12b7e-2548-4256-8fb8-fccc67b1e18b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-698342503-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be7eb95aea3e4897acbc9fe03aadb8e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4e7267a-b5", "ovs_interfaceid": "f4e7267a-b500-4eab-b71d-4ac31c55ca29", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 10:21:14 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Releasing lock "refresh_cache-88afc442-8973-4643-a0e2-54469417e57b" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 10:21:14 user nova-compute[75229]: DEBUG nova.compute.manager [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] [instance: 88afc442-8973-4643-a0e2-54469417e57b] Updated the network info_cache for instance {{(pid=75229) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 10:21:14 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:21:14 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 10:21:14 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:21:14 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75229) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 10:21:14 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75229) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 10:21:14 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75229) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 10:21:14 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:21:17 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:21:17 user nova-compute[75229]: DEBUG nova.compute.manager [req-882bfc90-c28c-45e1-a0b5-efe7c5ed0aa3 req-dbc16cb6-c70c-4ffb-82e3-d6abcef1880f service nova] [instance: 88afc442-8973-4643-a0e2-54469417e57b] Received event network-changed-f4e7267a-b500-4eab-b71d-4ac31c55ca29 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 10:21:17 user nova-compute[75229]: DEBUG nova.compute.manager [req-882bfc90-c28c-45e1-a0b5-efe7c5ed0aa3 req-dbc16cb6-c70c-4ffb-82e3-d6abcef1880f service nova] [instance: 88afc442-8973-4643-a0e2-54469417e57b] Refreshing instance network info cache due to event network-changed-f4e7267a-b500-4eab-b71d-4ac31c55ca29. {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 10:21:17 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-882bfc90-c28c-45e1-a0b5-efe7c5ed0aa3 req-dbc16cb6-c70c-4ffb-82e3-d6abcef1880f service nova] Acquiring lock "refresh_cache-88afc442-8973-4643-a0e2-54469417e57b" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 10:21:17 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-882bfc90-c28c-45e1-a0b5-efe7c5ed0aa3 req-dbc16cb6-c70c-4ffb-82e3-d6abcef1880f service nova] Acquired lock "refresh_cache-88afc442-8973-4643-a0e2-54469417e57b" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 10:21:17 user nova-compute[75229]: DEBUG nova.network.neutron [req-882bfc90-c28c-45e1-a0b5-efe7c5ed0aa3 req-dbc16cb6-c70c-4ffb-82e3-d6abcef1880f service nova] [instance: 88afc442-8973-4643-a0e2-54469417e57b] Refreshing network info cache for port f4e7267a-b500-4eab-b71d-4ac31c55ca29 {{(pid=75229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 10:21:18 user nova-compute[75229]: DEBUG nova.network.neutron [req-882bfc90-c28c-45e1-a0b5-efe7c5ed0aa3 req-dbc16cb6-c70c-4ffb-82e3-d6abcef1880f service nova] [instance: 88afc442-8973-4643-a0e2-54469417e57b] Updated VIF entry in instance network info cache for port f4e7267a-b500-4eab-b71d-4ac31c55ca29. {{(pid=75229) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 10:21:18 user nova-compute[75229]: DEBUG nova.network.neutron [req-882bfc90-c28c-45e1-a0b5-efe7c5ed0aa3 req-dbc16cb6-c70c-4ffb-82e3-d6abcef1880f service nova] [instance: 88afc442-8973-4643-a0e2-54469417e57b] Updating instance_info_cache with network_info: [{"id": "f4e7267a-b500-4eab-b71d-4ac31c55ca29", "address": "fa:16:3e:46:4a:b8", "network": {"id": "13b12b7e-2548-4256-8fb8-fccc67b1e18b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-698342503-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be7eb95aea3e4897acbc9fe03aadb8e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4e7267a-b5", "ovs_interfaceid": "f4e7267a-b500-4eab-b71d-4ac31c55ca29", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 10:21:18 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-882bfc90-c28c-45e1-a0b5-efe7c5ed0aa3 req-dbc16cb6-c70c-4ffb-82e3-d6abcef1880f service nova] Releasing lock "refresh_cache-88afc442-8973-4643-a0e2-54469417e57b" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 10:21:18 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:21:18 user nova-compute[75229]: DEBUG nova.compute.manager [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75229) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 10:21:19 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 10:21:19 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:21:19 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:21:20 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:21:20 user nova-compute[75229]: DEBUG nova.compute.manager [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Triggering sync for uuid 075ad651-31fd-4ee0-af86-fa8bef56d614 {{(pid=75229) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 10:21:20 user nova-compute[75229]: DEBUG nova.compute.manager [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Triggering sync for uuid 88afc442-8973-4643-a0e2-54469417e57b {{(pid=75229) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 10:21:20 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Acquiring lock "075ad651-31fd-4ee0-af86-fa8bef56d614" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:21:20 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Lock "075ad651-31fd-4ee0-af86-fa8bef56d614" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:21:20 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Acquiring lock "88afc442-8973-4643-a0e2-54469417e57b" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:21:20 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Lock "88afc442-8973-4643-a0e2-54469417e57b" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:21:20 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Lock "075ad651-31fd-4ee0-af86-fa8bef56d614" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.025s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:21:20 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Lock "88afc442-8973-4643-a0e2-54469417e57b" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.029s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:21:20 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-dfca5ccb-79bb-4146-a9c8-c966b91154a1 tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Acquiring lock "88afc442-8973-4643-a0e2-54469417e57b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:21:20 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-dfca5ccb-79bb-4146-a9c8-c966b91154a1 tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Lock "88afc442-8973-4643-a0e2-54469417e57b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:21:20 user nova-compute[75229]: DEBUG nova.objects.instance [None req-dfca5ccb-79bb-4146-a9c8-c966b91154a1 tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Lazy-loading 'flavor' on Instance uuid 88afc442-8973-4643-a0e2-54469417e57b {{(pid=75229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 10:21:20 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-dfca5ccb-79bb-4146-a9c8-c966b91154a1 tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Lock "88afc442-8973-4643-a0e2-54469417e57b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.050s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:21:20 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-dfca5ccb-79bb-4146-a9c8-c966b91154a1 tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Acquiring lock "88afc442-8973-4643-a0e2-54469417e57b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:21:20 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-dfca5ccb-79bb-4146-a9c8-c966b91154a1 tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Lock "88afc442-8973-4643-a0e2-54469417e57b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:21:20 user nova-compute[75229]: INFO nova.compute.manager [None req-dfca5ccb-79bb-4146-a9c8-c966b91154a1 tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] [instance: 88afc442-8973-4643-a0e2-54469417e57b] Attaching volume b5b49370-fbd2-4375-8ca3-e3afbbf9d7d6 to /dev/vdb
Nov 14 10:21:20 user nova-compute[75229]: DEBUG os_brick.utils [None req-dfca5ccb-79bb-4146-a9c8-c966b91154a1 tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 10:21:20 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:21:20 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:21:20 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[a22c85fc-b496-4f92-b466-27bd3c44a1e1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f1154031c835\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:21:20 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:21:20 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:21:20 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3a248b5-dea4-46a3-a18c-870a2c523827]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:21:20 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:21:20 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:21:20 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dc8736c-56a4-4368-a62e-e8c68698c580]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:21:20 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3919d39-dc7f-48f9-9763-48d8578c3e71]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:21:20 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-dfca5ccb-79bb-4146-a9c8-c966b91154a1 tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Running cmd (subprocess): nvme version {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:21:20 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-dfca5ccb-79bb-4146-a9c8-c966b91154a1 tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] 'nvme version' failed. Not Retrying. {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 10:21:20 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.nvmeof [None req-dfca5ccb-79bb-4146-a9c8-c966b91154a1 tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] nvme not present on system {{(pid=75229) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 10:21:20 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:21:20 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 10:21:20 user nova-compute[75229]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 10:21:20 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[471778ba-65c9-4e5a-aaf1-5e1e671f8460]: (4, '') {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:21:20 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.lightos [None req-dfca5ccb-79bb-4146-a9c8-c966b91154a1 tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75229) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 10:21:20 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.lightos [None req-dfca5ccb-79bb-4146-a9c8-c966b91154a1 tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75229) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 10:21:20 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.lightos [None req-dfca5ccb-79bb-4146-a9c8-c966b91154a1 tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] LIGHTOS: no hostnqn found. {{(pid=75229) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 10:21:20 user nova-compute[75229]: DEBUG os_brick.utils [None req-dfca5ccb-79bb-4146-a9c8-c966b91154a1 tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f1154031c835', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 10:21:20 user nova-compute[75229]: DEBUG nova.virt.block_device [None req-dfca5ccb-79bb-4146-a9c8-c966b91154a1 tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] [instance: 88afc442-8973-4643-a0e2-54469417e57b] Updating existing volume attachment record: f5ff2702-60dc-4e5f-a274-37aa5f40362b {{(pid=75229) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 10:21:21 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:21:23 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:21:23 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:21:23 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:21:23 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:21:23 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:21:23 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Auditing locally available compute resources for user (node: user) {{(pid=75229) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 10:21:23 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/075ad651-31fd-4ee0-af86-fa8bef56d614/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:21:24 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/075ad651-31fd-4ee0-af86-fa8bef56d614/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:21:24 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/075ad651-31fd-4ee0-af86-fa8bef56d614/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:21:24 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/075ad651-31fd-4ee0-af86-fa8bef56d614/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:21:24 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88afc442-8973-4643-a0e2-54469417e57b/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:21:24 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:21:24 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:21:24 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88afc442-8973-4643-a0e2-54469417e57b/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:21:24 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88afc442-8973-4643-a0e2-54469417e57b/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:21:24 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88afc442-8973-4643-a0e2-54469417e57b/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:21:24 user nova-compute[75229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dfca5ccb-79bb-4146-a9c8-c966b91154a1 tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] [instance: 88afc442-8973-4643-a0e2-54469417e57b] Calling os-brick to attach iSCSI Volume {{(pid=75229) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 10:21:24 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfca5ccb-79bb-4146-a9c8-c966b91154a1 tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f73f85151b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b5b49370-fbd2-4375-8ca3-e3afbbf9d7d6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jgKnEyYt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 10:21:24 user nova-compute[75229]: WARNING os_brick.initiator.connectors.base [None req-dfca5ccb-79bb-4146-a9c8-c966b91154a1 tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 10:21:24 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-dfca5ccb-79bb-4146-a9c8-c966b91154a1 tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 10:21:24 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-dfca5ccb-79bb-4146-a9c8-c966b91154a1 tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 10:21:24 user nova-compute[75229]: WARNING os_brick.initiator.connectors.base [None req-dfca5ccb-79bb-4146-a9c8-c966b91154a1 tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 10:21:24 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-dfca5ccb-79bb-4146-a9c8-c966b91154a1 tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b5b49370-fbd2-4375-8ca3-e3afbbf9d7d6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 10:21:24 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-dfca5ccb-79bb-4146-a9c8-c966b91154a1 tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b5b49370-fbd2-4375-8ca3-e3afbbf9d7d6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 10:21:24 user nova-compute[75229]: INFO os_brick.initiator.connectors.iscsi [None req-dfca5ccb-79bb-4146-a9c8-c966b91154a1 tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 10:21:24 user nova-compute[75229]: WARNING nova.virt.libvirt.driver [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 10:21:24 user nova-compute[75229]: WARNING nova.virt.libvirt.driver [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 10:21:24 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Hypervisor/Node resource view: name=user free_ram=8870MB free_disk=25.1165771484375GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75229) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 10:21:24 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:21:24 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:21:24 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5b49370-fbd2-4375-8ca3-e3afbbf9d7d6 -p 172.16.0.220:3260 {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:21:24 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5b49370-fbd2-4375-8ca3-e3afbbf9d7d6 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:21:24 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[f570c8d7-8c13-4ae6-b2b9-a1fffc622efa]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:21:24 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfca5ccb-79bb-4146-a9c8-c966b91154a1 tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 10:21:24 user nova-compute[75229]:  {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 10:21:24 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5b49370-fbd2-4375-8ca3-e3afbbf9d7d6 -p 172.16.0.220:3260 --interface default --op new {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:21:24 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5b49370-fbd2-4375-8ca3-e3afbbf9d7d6 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:21:24 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5961c11-9332-4ac8-9c5b-804840348371]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b5b49370-fbd2-4375-8ca3-e3afbbf9d7d6] added\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:21:24 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfca5ccb-79bb-4146-a9c8-c966b91154a1 tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b5b49370-fbd2-4375-8ca3-e3afbbf9d7d6] added
Nov 14 10:21:24 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 10:21:25 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5b49370-fbd2-4375-8ca3-e3afbbf9d7d6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:21:25 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5b49370-fbd2-4375-8ca3-e3afbbf9d7d6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:21:25 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ab78f2d-de1d-4486-995b-7b06ae0f5a58]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:21:25 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfca5ccb-79bb-4146-a9c8-c966b91154a1 tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 10:21:25 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5b49370-fbd2-4375-8ca3-e3afbbf9d7d6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:21:25 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5b49370-fbd2-4375-8ca3-e3afbbf9d7d6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:21:25 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[334fff40-5274-4866-a86c-93c7eb645c2b]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:21:25 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfca5ccb-79bb-4146-a9c8-c966b91154a1 tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 10:21:25 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5b49370-fbd2-4375-8ca3-e3afbbf9d7d6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jgKnEyYt {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:21:25 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Instance 075ad651-31fd-4ee0-af86-fa8bef56d614 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 10:21:25 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Instance 88afc442-8973-4643-a0e2-54469417e57b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 10:21:25 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75229) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 10:21:25 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75229) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 10:21:25 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5b49370-fbd2-4375-8ca3-e3afbbf9d7d6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jgKnEyYt" returned: 0 in 0.019s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:21:25 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[21c82a94-6656-4d83-b508-c943419f92ac]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:21:25 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfca5ccb-79bb-4146-a9c8-c966b91154a1 tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jgKnEyYt'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 10:21:25 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5b49370-fbd2-4375-8ca3-e3afbbf9d7d6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:21:25 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5b49370-fbd2-4375-8ca3-e3afbbf9d7d6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:21:25 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[235e3891-6ab5-4bd1-bbca-170bb4f27a17]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:21:25 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfca5ccb-79bb-4146-a9c8-c966b91154a1 tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 10:21:25 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:21:25 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:21:25 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[543ea58e-9752-4e64-a7d1-6b2345b47832]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:21:25 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfca5ccb-79bb-4146-a9c8-c966b91154a1 tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 14 10:21:25 user nova-compute[75229]:  {{(pid=75229) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 10:21:25 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfca5ccb-79bb-4146-a9c8-c966b91154a1 tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 14 10:21:25 user nova-compute[75229]:  {{(pid=75229) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 10:21:25 user nova-compute[75229]: WARNING os_brick.initiator.connectors.iscsi [None req-dfca5ccb-79bb-4146-a9c8-c966b91154a1 tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 14 10:21:25 user nova-compute[75229]: 
Nov 14 10:21:25 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5b49370-fbd2-4375-8ca3-e3afbbf9d7d6 -p 172.16.0.220:3260 --login {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:21:25 user nova-compute[75229]: DEBUG nova.compute.provider_tree [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Inventory has not changed in ProviderTree for provider: d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 {{(pid=75229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 10:21:25 user nova-compute[75229]: DEBUG nova.scheduler.client.report [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Inventory has not changed for provider d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 10:21:25 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Compute_service record updated for user:user {{(pid=75229) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 10:21:25 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.201s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:21:25 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5b49370-fbd2-4375-8ca3-e3afbbf9d7d6 -p 172.16.0.220:3260 --login" returned: 0 in 0.044s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:21:25 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[a944e91d-e50c-4c91-b48d-4b1e44dbab76]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b5b49370-fbd2-4375-8ca3-e3afbbf9d7d6, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b5b49370-fbd2-4375-8ca3-e3afbbf9d7d6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:21:25 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfca5ccb-79bb-4146-a9c8-c966b91154a1 tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b5b49370-fbd2-4375-8ca3-e3afbbf9d7d6, portal: 172.16.0.220,3260]
Nov 14 10:21:25 user nova-compute[75229]: Login to [iface: default, target: iqn.2010-10.org.openstack:b5b49370-fbd2-4375-8ca3-e3afbbf9d7d6, portal: 172.16.0.220,3260] successful.
Nov 14 10:21:25 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 10:21:25 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5b49370-fbd2-4375-8ca3-e3afbbf9d7d6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:21:25 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5b49370-fbd2-4375-8ca3-e3afbbf9d7d6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:21:25 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[04ec0320-a9de-4bce-98c3-dabfc5d4ce59]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:21:25 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfca5ccb-79bb-4146-a9c8-c966b91154a1 tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 10:21:25 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:21:25 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:21:25 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ca07049-e8a2-4beb-b147-9b3176cec6d4]: (4, ('tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5b49370-fbd2-4375-8ca3-e3afbbf9d7d6 (non-flash)\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:21:25 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfca5ccb-79bb-4146-a9c8-c966b91154a1 tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5b49370-fbd2-4375-8ca3-e3afbbf9d7d6 (non-flash)
Nov 14 10:21:25 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 10:21:25 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfca5ccb-79bb-4146-a9c8-c966b91154a1 tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] iscsi session list stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5b49370-fbd2-4375-8ca3-e3afbbf9d7d6 (non-flash)
Nov 14 10:21:25 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 10:21:25 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-dfca5ccb-79bb-4146-a9c8-c966b91154a1 tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b5b49370-fbd2-4375-8ca3-e3afbbf9d7d6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.256s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 10:21:25 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfca5ccb-79bb-4146-a9c8-c966b91154a1 tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Connected to 172.16.0.220:3260 {{(pid=75229) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 10:21:25 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-dfca5ccb-79bb-4146-a9c8-c966b91154a1 tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] HCTL ('33', '-', '-', 0) found on session 62 with lun 0 {{(pid=75229) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 10:21:25 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-dfca5ccb-79bb-4146-a9c8-c966b91154a1 tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75229) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 10:21:25 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:21:25 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:21:25 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c6da7f9-9ebf-4ba5-b8b3-7dd797b1327e]: (4, ('- - 0', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:21:25 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-dfca5ccb-79bb-4146-a9c8-c966b91154a1 tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Searching for a device in session 62 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75229) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 10:21:25 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfca5ccb-79bb-4146-a9c8-c966b91154a1 tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:b5b49370-fbd2-4375-8ca3-e3afbbf9d7d6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jgKnEyYt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75229) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 10:21:26 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-dfca5ccb-79bb-4146-a9c8-c966b91154a1 tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.289s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 10:21:26 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfca5ccb-79bb-4146-a9c8-c966b91154a1 tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] <== connect_volume: return (1291ms) {'type': 'block', 'scsi_wwn': '23662323730346438', 'path': '/dev/sdb'} {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 10:21:26 user nova-compute[75229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dfca5ccb-79bb-4146-a9c8-c966b91154a1 tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] [instance: 88afc442-8973-4643-a0e2-54469417e57b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23662323730346438', 'path': '/dev/sdb'} {{(pid=75229) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 10:21:26 user nova-compute[75229]: DEBUG nova.objects.instance [None req-dfca5ccb-79bb-4146-a9c8-c966b91154a1 tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Lazy-loading 'flavor' on Instance uuid 88afc442-8973-4643-a0e2-54469417e57b {{(pid=75229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 10:21:26 user nova-compute[75229]: DEBUG nova.virt.libvirt.guest [None req-dfca5ccb-79bb-4146-a9c8-c966b91154a1 tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 10:21:26 user nova-compute[75229]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 10:21:26 user nova-compute[75229]:   <source dev="/dev/sdb"/>
Nov 14 10:21:26 user nova-compute[75229]:   <target dev="vdb" bus="virtio"/>
Nov 14 10:21:26 user nova-compute[75229]:   <serial>b5b49370-fbd2-4375-8ca3-e3afbbf9d7d6</serial>
Nov 14 10:21:26 user nova-compute[75229]: </disk>
Nov 14 10:21:26 user nova-compute[75229]:  {{(pid=75229) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 10:21:26 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-dfca5ccb-79bb-4146-a9c8-c966b91154a1 tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] No BDM found with device name vda, not building metadata. {{(pid=75229) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 10:21:26 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-dfca5ccb-79bb-4146-a9c8-c966b91154a1 tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75229) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 10:21:26 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-dfca5ccb-79bb-4146-a9c8-c966b91154a1 tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] No VIF found with MAC fa:16:3e:46:4a:b8, not building metadata {{(pid=75229) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 10:21:26 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-dfca5ccb-79bb-4146-a9c8-c966b91154a1 tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Lock "88afc442-8973-4643-a0e2-54469417e57b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.061s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:21:28 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-47c07709-6aa1-4606-ba15-d8aad31e25f6 tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Acquiring lock "88afc442-8973-4643-a0e2-54469417e57b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:21:28 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-47c07709-6aa1-4606-ba15-d8aad31e25f6 tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Lock "88afc442-8973-4643-a0e2-54469417e57b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:21:28 user nova-compute[75229]: DEBUG nova.objects.instance [None req-47c07709-6aa1-4606-ba15-d8aad31e25f6 tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Lazy-loading 'flavor' on Instance uuid 88afc442-8973-4643-a0e2-54469417e57b {{(pid=75229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 10:21:28 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-47c07709-6aa1-4606-ba15-d8aad31e25f6 tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Lock "88afc442-8973-4643-a0e2-54469417e57b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:21:29 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-47c07709-6aa1-4606-ba15-d8aad31e25f6 tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Acquiring lock "88afc442-8973-4643-a0e2-54469417e57b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:21:29 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-47c07709-6aa1-4606-ba15-d8aad31e25f6 tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Lock "88afc442-8973-4643-a0e2-54469417e57b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:21:29 user nova-compute[75229]: INFO nova.compute.manager [None req-47c07709-6aa1-4606-ba15-d8aad31e25f6 tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] [instance: 88afc442-8973-4643-a0e2-54469417e57b] Attaching volume 0f9158c9-ad2f-4420-9776-d86bd95f0e0c to /dev/vdc
Nov 14 10:21:29 user nova-compute[75229]: DEBUG os_brick.utils [None req-47c07709-6aa1-4606-ba15-d8aad31e25f6 tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 10:21:29 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:21:29 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:21:29 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[41e88255-3cd7-4467-b6c5-3bd37604969d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f1154031c835\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:21:29 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:21:29 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:21:29 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb194408-d9f7-4a08-a4a4-19de51f29833]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:21:29 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:21:29 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:21:29 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac2a775d-2eb0-44ed-942a-8d57bdc4b0d4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:21:29 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:21:29 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[cccd1857-9577-40f4-bbb9-d8d13ac13fd5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:21:29 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-47c07709-6aa1-4606-ba15-d8aad31e25f6 tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Running cmd (subprocess): nvme version {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:21:29 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-47c07709-6aa1-4606-ba15-d8aad31e25f6 tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] 'nvme version' failed. Not Retrying. {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 10:21:29 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.nvmeof [None req-47c07709-6aa1-4606-ba15-d8aad31e25f6 tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] nvme not present on system {{(pid=75229) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 10:21:29 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:21:29 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 10:21:29 user nova-compute[75229]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 10:21:29 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e6aa946-d100-453c-98fd-25ee37ac572f]: (4, '') {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:21:29 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.lightos [None req-47c07709-6aa1-4606-ba15-d8aad31e25f6 tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75229) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 10:21:29 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.lightos [None req-47c07709-6aa1-4606-ba15-d8aad31e25f6 tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75229) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 10:21:29 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.lightos [None req-47c07709-6aa1-4606-ba15-d8aad31e25f6 tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] LIGHTOS: no hostnqn found. {{(pid=75229) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 10:21:29 user nova-compute[75229]: DEBUG os_brick.utils [None req-47c07709-6aa1-4606-ba15-d8aad31e25f6 tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f1154031c835', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 10:21:29 user nova-compute[75229]: DEBUG nova.virt.block_device [None req-47c07709-6aa1-4606-ba15-d8aad31e25f6 tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] [instance: 88afc442-8973-4643-a0e2-54469417e57b] Updating existing volume attachment record: f0f4028d-b759-40df-8374-2470399cb337 {{(pid=75229) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 10:21:29 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:21:29 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:21:33 user nova-compute[75229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-47c07709-6aa1-4606-ba15-d8aad31e25f6 tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] [instance: 88afc442-8973-4643-a0e2-54469417e57b] Calling os-brick to attach iSCSI Volume {{(pid=75229) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 10:21:33 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-47c07709-6aa1-4606-ba15-d8aad31e25f6 tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f73f85151b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0f9158c9-ad2f-4420-9776-d86bd95f0e0c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'joGJPpfw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 10:21:33 user nova-compute[75229]: WARNING os_brick.initiator.connectors.base [None req-47c07709-6aa1-4606-ba15-d8aad31e25f6 tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 10:21:33 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-47c07709-6aa1-4606-ba15-d8aad31e25f6 tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 10:21:33 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-47c07709-6aa1-4606-ba15-d8aad31e25f6 tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 10:21:33 user nova-compute[75229]: WARNING os_brick.initiator.connectors.base [None req-47c07709-6aa1-4606-ba15-d8aad31e25f6 tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 10:21:33 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-47c07709-6aa1-4606-ba15-d8aad31e25f6 tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0f9158c9-ad2f-4420-9776-d86bd95f0e0c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 10:21:33 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-47c07709-6aa1-4606-ba15-d8aad31e25f6 tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0f9158c9-ad2f-4420-9776-d86bd95f0e0c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 10:21:33 user nova-compute[75229]: INFO os_brick.initiator.connectors.iscsi [None req-47c07709-6aa1-4606-ba15-d8aad31e25f6 tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 10:21:33 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f9158c9-ad2f-4420-9776-d86bd95f0e0c -p 172.16.0.220:3260 {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:21:33 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f9158c9-ad2f-4420-9776-d86bd95f0e0c -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:21:33 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9b65bb8-04d2-4c33-bd17-eb3f2a9cc66f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:21:33 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-47c07709-6aa1-4606-ba15-d8aad31e25f6 tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 10:21:33 user nova-compute[75229]:  {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 10:21:33 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f9158c9-ad2f-4420-9776-d86bd95f0e0c -p 172.16.0.220:3260 --interface default --op new {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:21:33 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f9158c9-ad2f-4420-9776-d86bd95f0e0c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:21:33 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bc97bfe-3b6c-4ecd-916c-f8c1a94a5228]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0f9158c9-ad2f-4420-9776-d86bd95f0e0c] added\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:21:33 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-47c07709-6aa1-4606-ba15-d8aad31e25f6 tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0f9158c9-ad2f-4420-9776-d86bd95f0e0c] added
Nov 14 10:21:33 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 10:21:33 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f9158c9-ad2f-4420-9776-d86bd95f0e0c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:21:33 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f9158c9-ad2f-4420-9776-d86bd95f0e0c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:21:33 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[7382b974-ce21-47fa-9902-d45563579c8d]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:21:33 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-47c07709-6aa1-4606-ba15-d8aad31e25f6 tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 10:21:33 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f9158c9-ad2f-4420-9776-d86bd95f0e0c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:21:33 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f9158c9-ad2f-4420-9776-d86bd95f0e0c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:21:33 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[c963324c-0460-434f-9b93-c8269787e262]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:21:33 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-47c07709-6aa1-4606-ba15-d8aad31e25f6 tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 10:21:33 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f9158c9-ad2f-4420-9776-d86bd95f0e0c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v joGJPpfw {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:21:33 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f9158c9-ad2f-4420-9776-d86bd95f0e0c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v joGJPpfw" returned: 0 in 0.018s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:21:33 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[b21fae42-6074-430d-959d-5fff67f0c90d]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:21:33 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-47c07709-6aa1-4606-ba15-d8aad31e25f6 tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'joGJPpfw'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 10:21:33 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f9158c9-ad2f-4420-9776-d86bd95f0e0c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:21:33 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f9158c9-ad2f-4420-9776-d86bd95f0e0c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:21:33 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[77527b06-6343-40be-8950-bba58ef05bec]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:21:33 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-47c07709-6aa1-4606-ba15-d8aad31e25f6 tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 10:21:33 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:21:33 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:21:33 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7576e8a-189b-46c6-8096-8e206103445b]: (4, ('tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5b49370-fbd2-4375-8ca3-e3afbbf9d7d6 (non-flash)\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:21:33 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-47c07709-6aa1-4606-ba15-d8aad31e25f6 tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5b49370-fbd2-4375-8ca3-e3afbbf9d7d6 (non-flash)
Nov 14 10:21:33 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 10:21:33 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-47c07709-6aa1-4606-ba15-d8aad31e25f6 tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] iscsi session list stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5b49370-fbd2-4375-8ca3-e3afbbf9d7d6 (non-flash)
Nov 14 10:21:33 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 10:21:33 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f9158c9-ad2f-4420-9776-d86bd95f0e0c -p 172.16.0.220:3260 --login {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:21:33 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f9158c9-ad2f-4420-9776-d86bd95f0e0c -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:21:33 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[307a5841-71ef-4ab8-954b-fbbd93bbc443]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0f9158c9-ad2f-4420-9776-d86bd95f0e0c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0f9158c9-ad2f-4420-9776-d86bd95f0e0c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:21:33 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-47c07709-6aa1-4606-ba15-d8aad31e25f6 tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0f9158c9-ad2f-4420-9776-d86bd95f0e0c, portal: 172.16.0.220,3260]
Nov 14 10:21:33 user nova-compute[75229]: Login to [iface: default, target: iqn.2010-10.org.openstack:0f9158c9-ad2f-4420-9776-d86bd95f0e0c, portal: 172.16.0.220,3260] successful.
Nov 14 10:21:33 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 10:21:33 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f9158c9-ad2f-4420-9776-d86bd95f0e0c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:21:33 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f9158c9-ad2f-4420-9776-d86bd95f0e0c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:21:33 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[61a6227d-5c74-48f5-a877-64086509fc01]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:21:33 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-47c07709-6aa1-4606-ba15-d8aad31e25f6 tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 10:21:33 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:21:33 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:21:33 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[210d5446-7649-447f-920d-cc7f31eca982]: (4, ('tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5b49370-fbd2-4375-8ca3-e3afbbf9d7d6 (non-flash)\ntcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f9158c9-ad2f-4420-9776-d86bd95f0e0c (non-flash)\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:21:33 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-47c07709-6aa1-4606-ba15-d8aad31e25f6 tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5b49370-fbd2-4375-8ca3-e3afbbf9d7d6 (non-flash)
Nov 14 10:21:33 user nova-compute[75229]: tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f9158c9-ad2f-4420-9776-d86bd95f0e0c (non-flash)
Nov 14 10:21:33 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 10:21:33 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-47c07709-6aa1-4606-ba15-d8aad31e25f6 tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] iscsi session list stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5b49370-fbd2-4375-8ca3-e3afbbf9d7d6 (non-flash)
Nov 14 10:21:33 user nova-compute[75229]: tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f9158c9-ad2f-4420-9776-d86bd95f0e0c (non-flash)
Nov 14 10:21:33 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 10:21:33 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-47c07709-6aa1-4606-ba15-d8aad31e25f6 tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0f9158c9-ad2f-4420-9776-d86bd95f0e0c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.268s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 10:21:33 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-47c07709-6aa1-4606-ba15-d8aad31e25f6 tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Connected to 172.16.0.220:3260 {{(pid=75229) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 10:21:33 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-47c07709-6aa1-4606-ba15-d8aad31e25f6 tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] HCTL ('34', '-', '-', 0) found on session 63 with lun 0 {{(pid=75229) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 10:21:33 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-47c07709-6aa1-4606-ba15-d8aad31e25f6 tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75229) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 10:21:33 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:21:33 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:21:33 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[454e3c36-3a00-4e36-a2d7-e1ecdd44a485]: (4, ('- - 0', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:21:33 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-47c07709-6aa1-4606-ba15-d8aad31e25f6 tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Searching for a device in session 63 and hctl ['34', '*', '*', 0] yield: None {{(pid=75229) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 10:21:34 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:21:34 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:21:34 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-47c07709-6aa1-4606-ba15-d8aad31e25f6 tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Searching for a device in session 63 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75229) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 10:21:34 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-47c07709-6aa1-4606-ba15-d8aad31e25f6 tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:0f9158c9-ad2f-4420-9776-d86bd95f0e0c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'joGJPpfw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75229) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 10:21:34 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-47c07709-6aa1-4606-ba15-d8aad31e25f6 tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.298s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 10:21:34 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-47c07709-6aa1-4606-ba15-d8aad31e25f6 tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] <== connect_volume: return (1300ms) {'type': 'block', 'scsi_wwn': '23462363332626430', 'path': '/dev/sdc'} {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 10:21:34 user nova-compute[75229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-47c07709-6aa1-4606-ba15-d8aad31e25f6 tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] [instance: 88afc442-8973-4643-a0e2-54469417e57b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23462363332626430', 'path': '/dev/sdc'} {{(pid=75229) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 10:21:34 user nova-compute[75229]: DEBUG nova.objects.instance [None req-47c07709-6aa1-4606-ba15-d8aad31e25f6 tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Lazy-loading 'flavor' on Instance uuid 88afc442-8973-4643-a0e2-54469417e57b {{(pid=75229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 10:21:34 user nova-compute[75229]: DEBUG nova.virt.libvirt.guest [None req-47c07709-6aa1-4606-ba15-d8aad31e25f6 tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 10:21:34 user nova-compute[75229]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 10:21:34 user nova-compute[75229]:   <source dev="/dev/sdc"/>
Nov 14 10:21:34 user nova-compute[75229]:   <target dev="vdc" bus="virtio"/>
Nov 14 10:21:34 user nova-compute[75229]:   <serial>0f9158c9-ad2f-4420-9776-d86bd95f0e0c</serial>
Nov 14 10:21:34 user nova-compute[75229]: </disk>
Nov 14 10:21:34 user nova-compute[75229]:  {{(pid=75229) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 10:21:35 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-47c07709-6aa1-4606-ba15-d8aad31e25f6 tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] No BDM found with device name vda, not building metadata. {{(pid=75229) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 10:21:35 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-47c07709-6aa1-4606-ba15-d8aad31e25f6 tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75229) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 10:21:35 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-47c07709-6aa1-4606-ba15-d8aad31e25f6 tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75229) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 10:21:35 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-47c07709-6aa1-4606-ba15-d8aad31e25f6 tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] No VIF found with MAC fa:16:3e:46:4a:b8, not building metadata {{(pid=75229) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 10:21:35 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-47c07709-6aa1-4606-ba15-d8aad31e25f6 tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Lock "88afc442-8973-4643-a0e2-54469417e57b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.140s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:21:35 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-4645b49f-fb82-4900-9e5c-e3cff001bf1e tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Acquiring lock "88afc442-8973-4643-a0e2-54469417e57b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:21:35 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-4645b49f-fb82-4900-9e5c-e3cff001bf1e tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Lock "88afc442-8973-4643-a0e2-54469417e57b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:21:35 user nova-compute[75229]: INFO nova.compute.manager [None req-4645b49f-fb82-4900-9e5c-e3cff001bf1e tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] [instance: 88afc442-8973-4643-a0e2-54469417e57b] Detaching volume b5b49370-fbd2-4375-8ca3-e3afbbf9d7d6
Nov 14 10:21:36 user nova-compute[75229]: INFO nova.virt.block_device [None req-4645b49f-fb82-4900-9e5c-e3cff001bf1e tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] [instance: 88afc442-8973-4643-a0e2-54469417e57b] Attempting to driver detach volume b5b49370-fbd2-4375-8ca3-e3afbbf9d7d6 from mountpoint /dev/vdb
Nov 14 10:21:36 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-4645b49f-fb82-4900-9e5c-e3cff001bf1e tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Attempting to detach device vdb from instance 88afc442-8973-4643-a0e2-54469417e57b from the persistent domain config. {{(pid=75229) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 10:21:36 user nova-compute[75229]: DEBUG nova.virt.libvirt.guest [None req-4645b49f-fb82-4900-9e5c-e3cff001bf1e tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 10:21:36 user nova-compute[75229]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 10:21:36 user nova-compute[75229]:   <source dev="/dev/sdb"/>
Nov 14 10:21:36 user nova-compute[75229]:   <target dev="vdb" bus="virtio"/>
Nov 14 10:21:36 user nova-compute[75229]:   <serial>b5b49370-fbd2-4375-8ca3-e3afbbf9d7d6</serial>
Nov 14 10:21:36 user nova-compute[75229]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 10:21:36 user nova-compute[75229]: </disk>
Nov 14 10:21:36 user nova-compute[75229]:  {{(pid=75229) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 10:21:36 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-4645b49f-fb82-4900-9e5c-e3cff001bf1e tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Successfully detached device vdb from instance 88afc442-8973-4643-a0e2-54469417e57b from the persistent domain config.
Nov 14 10:21:36 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-4645b49f-fb82-4900-9e5c-e3cff001bf1e tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 88afc442-8973-4643-a0e2-54469417e57b from the live domain config. {{(pid=75229) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 10:21:36 user nova-compute[75229]: DEBUG nova.virt.libvirt.guest [None req-4645b49f-fb82-4900-9e5c-e3cff001bf1e tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 10:21:36 user nova-compute[75229]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 10:21:36 user nova-compute[75229]:   <source dev="/dev/sdb"/>
Nov 14 10:21:36 user nova-compute[75229]:   <target dev="vdb" bus="virtio"/>
Nov 14 10:21:36 user nova-compute[75229]:   <serial>b5b49370-fbd2-4375-8ca3-e3afbbf9d7d6</serial>
Nov 14 10:21:36 user nova-compute[75229]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 10:21:36 user nova-compute[75229]: </disk>
Nov 14 10:21:36 user nova-compute[75229]:  {{(pid=75229) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 10:21:36 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-4645b49f-fb82-4900-9e5c-e3cff001bf1e tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 88afc442-8973-4643-a0e2-54469417e57b {{(pid=75229) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 10:21:39 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:21:39 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:21:44 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:21:46 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-e5d3b75d-998f-47ef-8a12-6798eac41def tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] Acquiring lock "075ad651-31fd-4ee0-af86-fa8bef56d614" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:21:46 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-e5d3b75d-998f-47ef-8a12-6798eac41def tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] Lock "075ad651-31fd-4ee0-af86-fa8bef56d614" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:21:46 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-e5d3b75d-998f-47ef-8a12-6798eac41def tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] Acquiring lock "075ad651-31fd-4ee0-af86-fa8bef56d614-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:21:46 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-e5d3b75d-998f-47ef-8a12-6798eac41def tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] Lock "075ad651-31fd-4ee0-af86-fa8bef56d614-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:21:46 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-e5d3b75d-998f-47ef-8a12-6798eac41def tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] Lock "075ad651-31fd-4ee0-af86-fa8bef56d614-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:21:46 user nova-compute[75229]: INFO nova.compute.manager [None req-e5d3b75d-998f-47ef-8a12-6798eac41def tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] [instance: 075ad651-31fd-4ee0-af86-fa8bef56d614] Terminating instance
Nov 14 10:21:46 user nova-compute[75229]: DEBUG nova.compute.manager [None req-e5d3b75d-998f-47ef-8a12-6798eac41def tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] [instance: 075ad651-31fd-4ee0-af86-fa8bef56d614] Start destroying the instance on the hypervisor. {{(pid=75229) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 10:21:46 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:21:46 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:21:46 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:21:46 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:21:46 user nova-compute[75229]: DEBUG nova.compute.manager [req-eb783273-3aca-4e8a-9160-1511096acffa req-847ee371-73df-4cf1-ae37-651e5a2f8957 service nova] [instance: 075ad651-31fd-4ee0-af86-fa8bef56d614] Received event network-vif-unplugged-3d399542-6350-495b-9b54-13b21f7a99b8 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 10:21:46 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-eb783273-3aca-4e8a-9160-1511096acffa req-847ee371-73df-4cf1-ae37-651e5a2f8957 service nova] Acquiring lock "075ad651-31fd-4ee0-af86-fa8bef56d614-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:21:46 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-eb783273-3aca-4e8a-9160-1511096acffa req-847ee371-73df-4cf1-ae37-651e5a2f8957 service nova] Lock "075ad651-31fd-4ee0-af86-fa8bef56d614-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:21:46 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-eb783273-3aca-4e8a-9160-1511096acffa req-847ee371-73df-4cf1-ae37-651e5a2f8957 service nova] Lock "075ad651-31fd-4ee0-af86-fa8bef56d614-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:21:46 user nova-compute[75229]: DEBUG nova.compute.manager [req-eb783273-3aca-4e8a-9160-1511096acffa req-847ee371-73df-4cf1-ae37-651e5a2f8957 service nova] [instance: 075ad651-31fd-4ee0-af86-fa8bef56d614] No waiting events found dispatching network-vif-unplugged-3d399542-6350-495b-9b54-13b21f7a99b8 {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 10:21:46 user nova-compute[75229]: DEBUG nova.compute.manager [req-eb783273-3aca-4e8a-9160-1511096acffa req-847ee371-73df-4cf1-ae37-651e5a2f8957 service nova] [instance: 075ad651-31fd-4ee0-af86-fa8bef56d614] Received event network-vif-unplugged-3d399542-6350-495b-9b54-13b21f7a99b8 for instance with task_state deleting. {{(pid=75229) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 10:21:46 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:21:46 user nova-compute[75229]: INFO nova.virt.libvirt.driver [-] [instance: 075ad651-31fd-4ee0-af86-fa8bef56d614] Instance destroyed successfully.
Nov 14 10:21:46 user nova-compute[75229]: DEBUG nova.objects.instance [None req-e5d3b75d-998f-47ef-8a12-6798eac41def tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] Lazy-loading 'resources' on Instance uuid 075ad651-31fd-4ee0-af86-fa8bef56d614 {{(pid=75229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 10:21:46 user nova-compute[75229]: DEBUG nova.virt.libvirt.vif [None req-e5d3b75d-998f-47ef-8a12-6798eac41def tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T10:15:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1063792137',display_name='tempest-SnapshotDataIntegrityTests-server-1063792137',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1063792137',id=51,image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGaxqpq4Yu3mFWjxak2wgxiVreoKLRpmvy3DxUCDKSRKXXKjjOycBP0k421WDpGJowPROvGcLwE/1ivuhinb48H2BL1yi+r0PpqDMkXS/3z9g5bVptL6MQyqJv5tPCfZng==',key_name='tempest-keypair-606469431',keypairs=<?>,launch_index=0,launched_at=2023-11-14T10:15:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6e94e4e374fb4329a0d1dd4cc8e3a2fd',ramdisk_id='',reservation_id='r-l9wo42nl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-435544806',owner_user_name='tempest-SnapshotDataIntegrityTests-435544806-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T10:15:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='98854bec259444e7ae2078565451769a',uuid=075ad651-31fd-4ee0-af86-fa8bef56d614,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3d399542-6350-495b-9b54-13b21f7a99b8", "address": "fa:16:3e:bc:2b:a6", "network": {"id": "9fe5fa8c-b7e9-4f4f-88f1-e68567b67c3f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1670467158-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.122", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e94e4e374fb4329a0d1dd4cc8e3a2fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d399542-63", "ovs_interfaceid": "3d399542-6350-495b-9b54-13b21f7a99b8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 10:21:46 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-e5d3b75d-998f-47ef-8a12-6798eac41def tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] Converting VIF {"id": "3d399542-6350-495b-9b54-13b21f7a99b8", "address": "fa:16:3e:bc:2b:a6", "network": {"id": "9fe5fa8c-b7e9-4f4f-88f1-e68567b67c3f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1670467158-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.122", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e94e4e374fb4329a0d1dd4cc8e3a2fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d399542-63", "ovs_interfaceid": "3d399542-6350-495b-9b54-13b21f7a99b8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 10:21:46 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-e5d3b75d-998f-47ef-8a12-6798eac41def tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:bc:2b:a6,bridge_name='br-int',has_traffic_filtering=True,id=3d399542-6350-495b-9b54-13b21f7a99b8,network=Network(9fe5fa8c-b7e9-4f4f-88f1-e68567b67c3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d399542-63') {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 10:21:46 user nova-compute[75229]: DEBUG os_vif [None req-e5d3b75d-998f-47ef-8a12-6798eac41def tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:bc:2b:a6,bridge_name='br-int',has_traffic_filtering=True,id=3d399542-6350-495b-9b54-13b21f7a99b8,network=Network(9fe5fa8c-b7e9-4f4f-88f1-e68567b67c3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d399542-63') {{(pid=75229) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 10:21:47 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:21:47 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3d399542-63, bridge=br-int, if_exists=True) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 10:21:47 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:21:47 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 10:21:47 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:21:47 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f2858e29-c299-44a9-bb87-0d495de2333b) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 10:21:47 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:21:47 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:21:47 user nova-compute[75229]: INFO os_vif [None req-e5d3b75d-998f-47ef-8a12-6798eac41def tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:bc:2b:a6,bridge_name='br-int',has_traffic_filtering=True,id=3d399542-6350-495b-9b54-13b21f7a99b8,network=Network(9fe5fa8c-b7e9-4f4f-88f1-e68567b67c3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d399542-63')
Nov 14 10:21:47 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-e5d3b75d-998f-47ef-8a12-6798eac41def tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] [instance: 075ad651-31fd-4ee0-af86-fa8bef56d614] Deleting instance files /opt/stack/data/nova/instances/075ad651-31fd-4ee0-af86-fa8bef56d614_del
Nov 14 10:21:47 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-e5d3b75d-998f-47ef-8a12-6798eac41def tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] [instance: 075ad651-31fd-4ee0-af86-fa8bef56d614] Deletion of /opt/stack/data/nova/instances/075ad651-31fd-4ee0-af86-fa8bef56d614_del complete
Nov 14 10:21:47 user nova-compute[75229]: INFO nova.compute.manager [None req-e5d3b75d-998f-47ef-8a12-6798eac41def tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] [instance: 075ad651-31fd-4ee0-af86-fa8bef56d614] Took 0.86 seconds to destroy the instance on the hypervisor.
Nov 14 10:21:47 user nova-compute[75229]: DEBUG oslo.service.loopingcall [None req-e5d3b75d-998f-47ef-8a12-6798eac41def tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75229) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 10:21:47 user nova-compute[75229]: DEBUG nova.compute.manager [-] [instance: 075ad651-31fd-4ee0-af86-fa8bef56d614] Deallocating network for instance {{(pid=75229) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 10:21:47 user nova-compute[75229]: DEBUG nova.network.neutron [-] [instance: 075ad651-31fd-4ee0-af86-fa8bef56d614] deallocate_for_instance() {{(pid=75229) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 10:21:47 user nova-compute[75229]: DEBUG nova.network.neutron [-] [instance: 075ad651-31fd-4ee0-af86-fa8bef56d614] Updating instance_info_cache with network_info: [] {{(pid=75229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 10:21:47 user nova-compute[75229]: INFO nova.compute.manager [-] [instance: 075ad651-31fd-4ee0-af86-fa8bef56d614] Took 0.66 seconds to deallocate network for instance.
Nov 14 10:21:47 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-e5d3b75d-998f-47ef-8a12-6798eac41def tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:21:47 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-e5d3b75d-998f-47ef-8a12-6798eac41def tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:21:47 user nova-compute[75229]: DEBUG nova.compute.provider_tree [None req-e5d3b75d-998f-47ef-8a12-6798eac41def tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] Inventory has not changed in ProviderTree for provider: d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 {{(pid=75229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 10:21:47 user nova-compute[75229]: DEBUG nova.scheduler.client.report [None req-e5d3b75d-998f-47ef-8a12-6798eac41def tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] Inventory has not changed for provider d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 10:21:47 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-e5d3b75d-998f-47ef-8a12-6798eac41def tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.144s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:21:48 user nova-compute[75229]: INFO nova.scheduler.client.report [None req-e5d3b75d-998f-47ef-8a12-6798eac41def tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] Deleted allocations for instance 075ad651-31fd-4ee0-af86-fa8bef56d614
Nov 14 10:21:48 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-e5d3b75d-998f-47ef-8a12-6798eac41def tempest-SnapshotDataIntegrityTests-435544806 tempest-SnapshotDataIntegrityTests-435544806-project-member] Lock "075ad651-31fd-4ee0-af86-fa8bef56d614" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.986s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:21:48 user nova-compute[75229]: DEBUG nova.compute.manager [req-8b54df47-303b-4fd9-aa58-fb55e2a2792c req-30c31224-b9fc-452d-8dd1-33255b63cddb service nova] [instance: 075ad651-31fd-4ee0-af86-fa8bef56d614] Received event network-vif-plugged-3d399542-6350-495b-9b54-13b21f7a99b8 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 10:21:48 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-8b54df47-303b-4fd9-aa58-fb55e2a2792c req-30c31224-b9fc-452d-8dd1-33255b63cddb service nova] Acquiring lock "075ad651-31fd-4ee0-af86-fa8bef56d614-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:21:48 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-8b54df47-303b-4fd9-aa58-fb55e2a2792c req-30c31224-b9fc-452d-8dd1-33255b63cddb service nova] Lock "075ad651-31fd-4ee0-af86-fa8bef56d614-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:21:48 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-8b54df47-303b-4fd9-aa58-fb55e2a2792c req-30c31224-b9fc-452d-8dd1-33255b63cddb service nova] Lock "075ad651-31fd-4ee0-af86-fa8bef56d614-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:21:48 user nova-compute[75229]: DEBUG nova.compute.manager [req-8b54df47-303b-4fd9-aa58-fb55e2a2792c req-30c31224-b9fc-452d-8dd1-33255b63cddb service nova] [instance: 075ad651-31fd-4ee0-af86-fa8bef56d614] No waiting events found dispatching network-vif-plugged-3d399542-6350-495b-9b54-13b21f7a99b8 {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 10:21:48 user nova-compute[75229]: WARNING nova.compute.manager [req-8b54df47-303b-4fd9-aa58-fb55e2a2792c req-30c31224-b9fc-452d-8dd1-33255b63cddb service nova] [instance: 075ad651-31fd-4ee0-af86-fa8bef56d614] Received unexpected event network-vif-plugged-3d399542-6350-495b-9b54-13b21f7a99b8 for instance with vm_state deleted and task_state None.
Nov 14 10:21:48 user nova-compute[75229]: DEBUG nova.compute.manager [req-8b54df47-303b-4fd9-aa58-fb55e2a2792c req-30c31224-b9fc-452d-8dd1-33255b63cddb service nova] [instance: 075ad651-31fd-4ee0-af86-fa8bef56d614] Received event network-vif-deleted-3d399542-6350-495b-9b54-13b21f7a99b8 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 10:21:49 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:21:52 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:21:56 user nova-compute[75229]: WARNING nova.virt.libvirt.driver [None req-4645b49f-fb82-4900-9e5c-e3cff001bf1e tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 88afc442-8973-4643-a0e2-54469417e57b is timed out.
Nov 14 10:21:56 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-4645b49f-fb82-4900-9e5c-e3cff001bf1e tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Successfully detached device vdb from instance 88afc442-8973-4643-a0e2-54469417e57b from the live domain config.
Nov 14 10:21:56 user nova-compute[75229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4645b49f-fb82-4900-9e5c-e3cff001bf1e tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] [instance: 88afc442-8973-4643-a0e2-54469417e57b] calling os-brick to detach iSCSI Volume {{(pid=75229) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 10:21:56 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-4645b49f-fb82-4900-9e5c-e3cff001bf1e tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f73f85151b0>, {'target_iqn': 'iqn.2010-10.org.openstack:b5b49370-fbd2-4375-8ca3-e3afbbf9d7d6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jgKnEyYt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 10:21:56 user nova-compute[75229]: WARNING os_brick.initiator.connectors.base [None req-4645b49f-fb82-4900-9e5c-e3cff001bf1e tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 10:21:56 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-4645b49f-fb82-4900-9e5c-e3cff001bf1e tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 10:21:56 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-4645b49f-fb82-4900-9e5c-e3cff001bf1e tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 10:21:56 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:21:56 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:21:56 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[25dd39a7-daf5-4503-8a88-82d4993b2432]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b5b49370-fbd2-4375-8ca3-e3afbbf9d7d6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0f9158c9-ad2f-4420-9776-d86bd95f0e0c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:21:56 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-4645b49f-fb82-4900-9e5c-e3cff001bf1e tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 10:21:56 user nova-compute[75229]: No targets found.
Nov 14 10:21:56 user nova-compute[75229]: iSNS:
Nov 14 10:21:56 user nova-compute[75229]: No targets found.
Nov 14 10:21:56 user nova-compute[75229]: STATIC:
Nov 14 10:21:56 user nova-compute[75229]: Target: iqn.2010-10.org.openstack:b5b49370-fbd2-4375-8ca3-e3afbbf9d7d6
Nov 14 10:21:56 user nova-compute[75229]:         Portal: 172.16.0.220:3260,-1
Nov 14 10:21:56 user nova-compute[75229]:                 Iface Name: default
Nov 14 10:21:56 user nova-compute[75229]: Target: iqn.2010-10.org.openstack:0f9158c9-ad2f-4420-9776-d86bd95f0e0c
Nov 14 10:21:56 user nova-compute[75229]:         Portal: 172.16.0.220:3260,-1
Nov 14 10:21:56 user nova-compute[75229]:                 Iface Name: default
Nov 14 10:21:56 user nova-compute[75229]: FIRMWARE:
Nov 14 10:21:56 user nova-compute[75229]: No targets found.
Nov 14 10:21:56 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 10:21:56 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-4645b49f-fb82-4900-9e5c-e3cff001bf1e tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 10:21:56 user nova-compute[75229]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 10:21:56 user nova-compute[75229]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75229) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 10:21:56 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-4645b49f-fb82-4900-9e5c-e3cff001bf1e tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b5b49370-fbd2-4375-8ca3-e3afbbf9d7d6', 0)] {{(pid=75229) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 10:21:56 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:21:56 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:21:56 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9d18e14-6116-4002-8fe6-ea56a5eeb4c0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0f9158c9-ad2f-4420-9776-d86bd95f0e0c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b5b49370-fbd2-4375-8ca3-e3afbbf9d7d6\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:21:56 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:21:56 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:21:56 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee9c0327-3cc9-4ce7-ab2e-e82470eb801a]: (4, ('tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5b49370-fbd2-4375-8ca3-e3afbbf9d7d6 (non-flash)\ntcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f9158c9-ad2f-4420-9776-d86bd95f0e0c (non-flash)\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:21:56 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-4645b49f-fb82-4900-9e5c-e3cff001bf1e tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5b49370-fbd2-4375-8ca3-e3afbbf9d7d6 (non-flash)
Nov 14 10:21:56 user nova-compute[75229]: tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f9158c9-ad2f-4420-9776-d86bd95f0e0c (non-flash)
Nov 14 10:21:56 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 10:21:56 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-4645b49f-fb82-4900-9e5c-e3cff001bf1e tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] iscsi session list stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5b49370-fbd2-4375-8ca3-e3afbbf9d7d6 (non-flash)
Nov 14 10:21:56 user nova-compute[75229]: tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f9158c9-ad2f-4420-9776-d86bd95f0e0c (non-flash)
Nov 14 10:21:56 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 10:21:56 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-4645b49f-fb82-4900-9e5c-e3cff001bf1e tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f73d4bbd900>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b5b49370-fbd2-4375-8ca3-e3afbbf9d7d6'): ({'sdb'}, set())}) {{(pid=75229) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 10:21:56 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-4645b49f-fb82-4900-9e5c-e3cff001bf1e tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Removing single pathed devices sdb {{(pid=75229) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 10:21:56 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:21:56 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:21:56 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[44f05d26-ca1b-4e59-8043-d7812d86e4ce]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:21:56 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:21:56 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:21:56 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[e64978cd-d002-4604-a193-46394368dd49]: (4, ('ok\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:21:56 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-4645b49f-fb82-4900-9e5c-e3cff001bf1e tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Flushing IO for device /dev/sdb {{(pid=75229) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 10:21:56 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:21:56 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:21:56 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[43df69a5-680c-4a5f-8630-a9cfdd9a9b2a]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:21:56 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-4645b49f-fb82-4900-9e5c-e3cff001bf1e tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75229) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 10:21:56 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:21:56 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.038s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:21:56 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[876f176a-024d-4df9-9e2d-e4fee64c6f70]: (4, ('1', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:21:56 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-4645b49f-fb82-4900-9e5c-e3cff001bf1e tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75229) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 10:21:56 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-4645b49f-fb82-4900-9e5c-e3cff001bf1e tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] SCSI volumes sdb have been removed. {{(pid=75229) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 10:21:56 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-4645b49f-fb82-4900-9e5c-e3cff001bf1e tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b5b49370-fbd2-4375-8ca3-e3afbbf9d7d6')] {{(pid=75229) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 10:21:56 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5b49370-fbd2-4375-8ca3-e3afbbf9d7d6 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:21:56 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5b49370-fbd2-4375-8ca3-e3afbbf9d7d6 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:21:56 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[9965fe9d-ce64-45fa-af1e-5328652f1a76]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:21:56 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-4645b49f-fb82-4900-9e5c-e3cff001bf1e tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 10:21:56 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5b49370-fbd2-4375-8ca3-e3afbbf9d7d6 -p 172.16.0.220:3260 --logout {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:21:56 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5b49370-fbd2-4375-8ca3-e3afbbf9d7d6 -p 172.16.0.220:3260 --logout" returned: 0 in 0.046s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:21:56 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[f25015f1-d723-4ffd-a59f-054027877574]: (4, ('Logging out of session [sid: 62, target: iqn.2010-10.org.openstack:b5b49370-fbd2-4375-8ca3-e3afbbf9d7d6, portal: 172.16.0.220,3260]\nLogout of [sid: 62, target: iqn.2010-10.org.openstack:b5b49370-fbd2-4375-8ca3-e3afbbf9d7d6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:21:56 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-4645b49f-fb82-4900-9e5c-e3cff001bf1e tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 62, target: iqn.2010-10.org.openstack:b5b49370-fbd2-4375-8ca3-e3afbbf9d7d6, portal: 172.16.0.220,3260]
Nov 14 10:21:56 user nova-compute[75229]: Logout of [sid: 62, target: iqn.2010-10.org.openstack:b5b49370-fbd2-4375-8ca3-e3afbbf9d7d6, portal: 172.16.0.220,3260] successful.
Nov 14 10:21:56 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 10:21:56 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5b49370-fbd2-4375-8ca3-e3afbbf9d7d6 -p 172.16.0.220:3260 --op delete {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:21:56 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5b49370-fbd2-4375-8ca3-e3afbbf9d7d6 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:21:56 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad43b173-83b5-4307-80ee-1bcd0ba0c25d]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:21:56 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-4645b49f-fb82-4900-9e5c-e3cff001bf1e tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 10:21:56 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-4645b49f-fb82-4900-9e5c-e3cff001bf1e tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.277s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 10:21:56 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-4645b49f-fb82-4900-9e5c-e3cff001bf1e tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] <== disconnect_volume: return (278ms) None {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 10:21:56 user nova-compute[75229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4645b49f-fb82-4900-9e5c-e3cff001bf1e tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] [instance: 88afc442-8973-4643-a0e2-54469417e57b] Disconnected iSCSI Volume {{(pid=75229) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 10:21:57 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:21:57 user nova-compute[75229]: DEBUG nova.objects.instance [None req-4645b49f-fb82-4900-9e5c-e3cff001bf1e tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Lazy-loading 'flavor' on Instance uuid 88afc442-8973-4643-a0e2-54469417e57b {{(pid=75229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 10:21:57 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-4645b49f-fb82-4900-9e5c-e3cff001bf1e tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Lock "88afc442-8973-4643-a0e2-54469417e57b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.666s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:21:58 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-5a8bf9f5-eaa9-4dce-a6a6-85ccd99415b8 tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Acquiring lock "88afc442-8973-4643-a0e2-54469417e57b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:21:58 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-5a8bf9f5-eaa9-4dce-a6a6-85ccd99415b8 tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Lock "88afc442-8973-4643-a0e2-54469417e57b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:21:58 user nova-compute[75229]: INFO nova.compute.manager [None req-5a8bf9f5-eaa9-4dce-a6a6-85ccd99415b8 tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] [instance: 88afc442-8973-4643-a0e2-54469417e57b] Detaching volume 0f9158c9-ad2f-4420-9776-d86bd95f0e0c
Nov 14 10:21:58 user nova-compute[75229]: INFO nova.virt.block_device [None req-5a8bf9f5-eaa9-4dce-a6a6-85ccd99415b8 tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] [instance: 88afc442-8973-4643-a0e2-54469417e57b] Attempting to driver detach volume 0f9158c9-ad2f-4420-9776-d86bd95f0e0c from mountpoint /dev/vdc
Nov 14 10:21:58 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-5a8bf9f5-eaa9-4dce-a6a6-85ccd99415b8 tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Attempting to detach device vdc from instance 88afc442-8973-4643-a0e2-54469417e57b from the persistent domain config. {{(pid=75229) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 10:21:58 user nova-compute[75229]: DEBUG nova.virt.libvirt.guest [None req-5a8bf9f5-eaa9-4dce-a6a6-85ccd99415b8 tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 10:21:58 user nova-compute[75229]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 10:21:58 user nova-compute[75229]:   <source dev="/dev/sdc"/>
Nov 14 10:21:58 user nova-compute[75229]:   <target dev="vdc" bus="virtio"/>
Nov 14 10:21:58 user nova-compute[75229]:   <serial>0f9158c9-ad2f-4420-9776-d86bd95f0e0c</serial>
Nov 14 10:21:58 user nova-compute[75229]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 14 10:21:58 user nova-compute[75229]: </disk>
Nov 14 10:21:58 user nova-compute[75229]:  {{(pid=75229) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 10:21:58 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-5a8bf9f5-eaa9-4dce-a6a6-85ccd99415b8 tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Successfully detached device vdc from instance 88afc442-8973-4643-a0e2-54469417e57b from the persistent domain config.
Nov 14 10:21:58 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-5a8bf9f5-eaa9-4dce-a6a6-85ccd99415b8 tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 88afc442-8973-4643-a0e2-54469417e57b from the live domain config. {{(pid=75229) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 10:21:58 user nova-compute[75229]: DEBUG nova.virt.libvirt.guest [None req-5a8bf9f5-eaa9-4dce-a6a6-85ccd99415b8 tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 10:21:58 user nova-compute[75229]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 10:21:58 user nova-compute[75229]:   <source dev="/dev/sdc"/>
Nov 14 10:21:58 user nova-compute[75229]:   <target dev="vdc" bus="virtio"/>
Nov 14 10:21:58 user nova-compute[75229]:   <serial>0f9158c9-ad2f-4420-9776-d86bd95f0e0c</serial>
Nov 14 10:21:58 user nova-compute[75229]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 14 10:21:58 user nova-compute[75229]: </disk>
Nov 14 10:21:58 user nova-compute[75229]:  {{(pid=75229) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 10:21:59 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-5a8bf9f5-eaa9-4dce-a6a6-85ccd99415b8 tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 88afc442-8973-4643-a0e2-54469417e57b {{(pid=75229) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 10:22:02 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 10:22:07 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 10:22:07 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:22:07 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75229) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 10:22:07 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75229) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 10:22:07 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75229) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 10:22:07 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:22:12 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 10:22:14 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:22:14 user nova-compute[75229]: DEBUG nova.compute.manager [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Starting heal instance info cache {{(pid=75229) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 10:22:14 user nova-compute[75229]: DEBUG nova.compute.manager [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Rebuilding the list of instances to heal {{(pid=75229) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 10:22:14 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Acquiring lock "refresh_cache-88afc442-8973-4643-a0e2-54469417e57b" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 10:22:14 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Acquired lock "refresh_cache-88afc442-8973-4643-a0e2-54469417e57b" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 10:22:14 user nova-compute[75229]: DEBUG nova.network.neutron [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] [instance: 88afc442-8973-4643-a0e2-54469417e57b] Forcefully refreshing network info cache for instance {{(pid=75229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 10:22:14 user nova-compute[75229]: DEBUG nova.objects.instance [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Lazy-loading 'info_cache' on Instance uuid 88afc442-8973-4643-a0e2-54469417e57b {{(pid=75229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 10:22:15 user nova-compute[75229]: DEBUG nova.network.neutron [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] [instance: 88afc442-8973-4643-a0e2-54469417e57b] Updating instance_info_cache with network_info: [{"id": "f4e7267a-b500-4eab-b71d-4ac31c55ca29", "address": "fa:16:3e:46:4a:b8", "network": {"id": "13b12b7e-2548-4256-8fb8-fccc67b1e18b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-698342503-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be7eb95aea3e4897acbc9fe03aadb8e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4e7267a-b5", "ovs_interfaceid": "f4e7267a-b500-4eab-b71d-4ac31c55ca29", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 10:22:15 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Releasing lock "refresh_cache-88afc442-8973-4643-a0e2-54469417e57b" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 10:22:15 user nova-compute[75229]: DEBUG nova.compute.manager [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] [instance: 88afc442-8973-4643-a0e2-54469417e57b] Updated the network info_cache for instance {{(pid=75229) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 10:22:15 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:22:17 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 10:22:19 user nova-compute[75229]: WARNING nova.virt.libvirt.driver [None req-5a8bf9f5-eaa9-4dce-a6a6-85ccd99415b8 tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance 88afc442-8973-4643-a0e2-54469417e57b is timed out.
Nov 14 10:22:19 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-5a8bf9f5-eaa9-4dce-a6a6-85ccd99415b8 tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Successfully detached device vdc from instance 88afc442-8973-4643-a0e2-54469417e57b from the live domain config.
Nov 14 10:22:19 user nova-compute[75229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5a8bf9f5-eaa9-4dce-a6a6-85ccd99415b8 tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] [instance: 88afc442-8973-4643-a0e2-54469417e57b] calling os-brick to detach iSCSI Volume {{(pid=75229) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 10:22:19 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a8bf9f5-eaa9-4dce-a6a6-85ccd99415b8 tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f73f85151b0>, {'target_iqn': 'iqn.2010-10.org.openstack:0f9158c9-ad2f-4420-9776-d86bd95f0e0c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'joGJPpfw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 10:22:19 user nova-compute[75229]: WARNING os_brick.initiator.connectors.base [None req-5a8bf9f5-eaa9-4dce-a6a6-85ccd99415b8 tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 10:22:19 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-5a8bf9f5-eaa9-4dce-a6a6-85ccd99415b8 tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 10:22:19 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-5a8bf9f5-eaa9-4dce-a6a6-85ccd99415b8 tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 10:22:19 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:22:19 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:22:19 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[26522690-11be-4927-85c2-506908cbe0b1]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:0f9158c9-ad2f-4420-9776-d86bd95f0e0c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:22:19 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a8bf9f5-eaa9-4dce-a6a6-85ccd99415b8 tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 10:22:19 user nova-compute[75229]: No targets found.
Nov 14 10:22:19 user nova-compute[75229]: iSNS:
Nov 14 10:22:19 user nova-compute[75229]: No targets found.
Nov 14 10:22:19 user nova-compute[75229]: STATIC:
Nov 14 10:22:19 user nova-compute[75229]: Target: iqn.2010-10.org.openstack:0f9158c9-ad2f-4420-9776-d86bd95f0e0c
Nov 14 10:22:19 user nova-compute[75229]:         Portal: 172.16.0.220:3260,-1
Nov 14 10:22:19 user nova-compute[75229]:                 Iface Name: default
Nov 14 10:22:19 user nova-compute[75229]: FIRMWARE:
Nov 14 10:22:19 user nova-compute[75229]: No targets found.
Nov 14 10:22:19 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 10:22:19 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a8bf9f5-eaa9-4dce-a6a6-85ccd99415b8 tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 10:22:19 user nova-compute[75229]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 10:22:19 user nova-compute[75229]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75229) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 10:22:19 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a8bf9f5-eaa9-4dce-a6a6-85ccd99415b8 tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0f9158c9-ad2f-4420-9776-d86bd95f0e0c', 0)] {{(pid=75229) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 10:22:19 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:22:19 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:22:19 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3e671f4-9d93-4eae-af92-9bd44cb7b7da]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0f9158c9-ad2f-4420-9776-d86bd95f0e0c\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:22:19 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:22:19 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:22:19 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[00f3bfb4-a99a-4003-a5ca-02edd9cfd68b]: (4, ('tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f9158c9-ad2f-4420-9776-d86bd95f0e0c (non-flash)\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:22:19 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a8bf9f5-eaa9-4dce-a6a6-85ccd99415b8 tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f9158c9-ad2f-4420-9776-d86bd95f0e0c (non-flash)
Nov 14 10:22:19 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 10:22:19 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a8bf9f5-eaa9-4dce-a6a6-85ccd99415b8 tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] iscsi session list stdout=tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f9158c9-ad2f-4420-9776-d86bd95f0e0c (non-flash)
Nov 14 10:22:19 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 10:22:19 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a8bf9f5-eaa9-4dce-a6a6-85ccd99415b8 tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f73d4ccedd0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0f9158c9-ad2f-4420-9776-d86bd95f0e0c'): ({'sdc'}, set())}) {{(pid=75229) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 10:22:19 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-5a8bf9f5-eaa9-4dce-a6a6-85ccd99415b8 tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Removing single pathed devices sdc {{(pid=75229) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 10:22:19 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:22:19 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:22:19 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3a3b286-34b1-4f59-ba54-d0450409036e]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:22:19 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:22:19 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:22:19 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[4eb63589-6443-45cb-9178-4327feedfba7]: (4, ('ok\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:22:19 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-5a8bf9f5-eaa9-4dce-a6a6-85ccd99415b8 tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Flushing IO for device /dev/sdc {{(pid=75229) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 10:22:19 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:22:19 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:22:19 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[110bcdc2-2156-450b-bfd4-3b406ac3f8bc]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:22:19 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-5a8bf9f5-eaa9-4dce-a6a6-85ccd99415b8 tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75229) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 10:22:19 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:22:19 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.042s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:22:19 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[83cbe2c2-5749-4176-94dd-ec6bc49f91d8]: (4, ('1', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:22:19 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-5a8bf9f5-eaa9-4dce-a6a6-85ccd99415b8 tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75229) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 10:22:19 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-5a8bf9f5-eaa9-4dce-a6a6-85ccd99415b8 tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] SCSI volumes sdc have been removed. {{(pid=75229) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 10:22:19 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a8bf9f5-eaa9-4dce-a6a6-85ccd99415b8 tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0f9158c9-ad2f-4420-9776-d86bd95f0e0c')] {{(pid=75229) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 10:22:19 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f9158c9-ad2f-4420-9776-d86bd95f0e0c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:22:19 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f9158c9-ad2f-4420-9776-d86bd95f0e0c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:22:19 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6e466c4-6dc9-4e81-b768-5d8409a32170]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:22:19 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a8bf9f5-eaa9-4dce-a6a6-85ccd99415b8 tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 10:22:19 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f9158c9-ad2f-4420-9776-d86bd95f0e0c -p 172.16.0.220:3260 --logout {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:22:19 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f9158c9-ad2f-4420-9776-d86bd95f0e0c -p 172.16.0.220:3260 --logout" returned: 0 in 0.043s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:22:19 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[ceeb98c2-39da-4e17-9bb8-b26d6b90a396]: (4, ('Logging out of session [sid: 63, target: iqn.2010-10.org.openstack:0f9158c9-ad2f-4420-9776-d86bd95f0e0c, portal: 172.16.0.220,3260]\nLogout of [sid: 63, target: iqn.2010-10.org.openstack:0f9158c9-ad2f-4420-9776-d86bd95f0e0c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:22:19 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a8bf9f5-eaa9-4dce-a6a6-85ccd99415b8 tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 63, target: iqn.2010-10.org.openstack:0f9158c9-ad2f-4420-9776-d86bd95f0e0c, portal: 172.16.0.220,3260]
Nov 14 10:22:19 user nova-compute[75229]: Logout of [sid: 63, target: iqn.2010-10.org.openstack:0f9158c9-ad2f-4420-9776-d86bd95f0e0c, portal: 172.16.0.220,3260] successful.
Nov 14 10:22:19 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 10:22:19 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f9158c9-ad2f-4420-9776-d86bd95f0e0c -p 172.16.0.220:3260 --op delete {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:22:19 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f9158c9-ad2f-4420-9776-d86bd95f0e0c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:22:19 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cebfdd0-1e70-4151-98ba-8ca8d6d2e988]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:22:19 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a8bf9f5-eaa9-4dce-a6a6-85ccd99415b8 tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 10:22:19 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-5a8bf9f5-eaa9-4dce-a6a6-85ccd99415b8 tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.265s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 10:22:19 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a8bf9f5-eaa9-4dce-a6a6-85ccd99415b8 tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] <== disconnect_volume: return (266ms) None {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 10:22:19 user nova-compute[75229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5a8bf9f5-eaa9-4dce-a6a6-85ccd99415b8 tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] [instance: 88afc442-8973-4643-a0e2-54469417e57b] Disconnected iSCSI Volume {{(pid=75229) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 10:22:19 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:22:19 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:22:19 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:22:19 user nova-compute[75229]: DEBUG nova.compute.manager [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75229) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 10:22:20 user nova-compute[75229]: DEBUG nova.objects.instance [None req-5a8bf9f5-eaa9-4dce-a6a6-85ccd99415b8 tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Lazy-loading 'flavor' on Instance uuid 88afc442-8973-4643-a0e2-54469417e57b {{(pid=75229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 10:22:20 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-5a8bf9f5-eaa9-4dce-a6a6-85ccd99415b8 tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Lock "88afc442-8973-4643-a0e2-54469417e57b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.843s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:22:21 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-5f22ac20-af13-48a1-bc81-4960cffbee2a tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Acquiring lock "88afc442-8973-4643-a0e2-54469417e57b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:22:21 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-5f22ac20-af13-48a1-bc81-4960cffbee2a tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Lock "88afc442-8973-4643-a0e2-54469417e57b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:22:21 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-5f22ac20-af13-48a1-bc81-4960cffbee2a tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Acquiring lock "88afc442-8973-4643-a0e2-54469417e57b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:22:21 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-5f22ac20-af13-48a1-bc81-4960cffbee2a tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Lock "88afc442-8973-4643-a0e2-54469417e57b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:22:21 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-5f22ac20-af13-48a1-bc81-4960cffbee2a tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Lock "88afc442-8973-4643-a0e2-54469417e57b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:22:21 user nova-compute[75229]: INFO nova.compute.manager [None req-5f22ac20-af13-48a1-bc81-4960cffbee2a tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] [instance: 88afc442-8973-4643-a0e2-54469417e57b] Terminating instance
Nov 14 10:22:21 user nova-compute[75229]: DEBUG nova.compute.manager [None req-5f22ac20-af13-48a1-bc81-4960cffbee2a tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] [instance: 88afc442-8973-4643-a0e2-54469417e57b] Start destroying the instance on the hypervisor. {{(pid=75229) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 10:22:21 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:22:21 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:22:21 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:22:21 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:22:21 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:22:21 user nova-compute[75229]: DEBUG nova.compute.manager [req-37a09a6a-2854-4beb-a1e1-b7f1c633bdaa req-4ca37d01-1bd3-4a8b-bc5e-3527f62f3e4e service nova] [instance: 88afc442-8973-4643-a0e2-54469417e57b] Received event network-vif-unplugged-f4e7267a-b500-4eab-b71d-4ac31c55ca29 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 10:22:21 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-37a09a6a-2854-4beb-a1e1-b7f1c633bdaa req-4ca37d01-1bd3-4a8b-bc5e-3527f62f3e4e service nova] Acquiring lock "88afc442-8973-4643-a0e2-54469417e57b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:22:21 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-37a09a6a-2854-4beb-a1e1-b7f1c633bdaa req-4ca37d01-1bd3-4a8b-bc5e-3527f62f3e4e service nova] Lock "88afc442-8973-4643-a0e2-54469417e57b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:22:21 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-37a09a6a-2854-4beb-a1e1-b7f1c633bdaa req-4ca37d01-1bd3-4a8b-bc5e-3527f62f3e4e service nova] Lock "88afc442-8973-4643-a0e2-54469417e57b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:22:21 user nova-compute[75229]: DEBUG nova.compute.manager [req-37a09a6a-2854-4beb-a1e1-b7f1c633bdaa req-4ca37d01-1bd3-4a8b-bc5e-3527f62f3e4e service nova] [instance: 88afc442-8973-4643-a0e2-54469417e57b] No waiting events found dispatching network-vif-unplugged-f4e7267a-b500-4eab-b71d-4ac31c55ca29 {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 10:22:21 user nova-compute[75229]: DEBUG nova.compute.manager [req-37a09a6a-2854-4beb-a1e1-b7f1c633bdaa req-4ca37d01-1bd3-4a8b-bc5e-3527f62f3e4e service nova] [instance: 88afc442-8973-4643-a0e2-54469417e57b] Received event network-vif-unplugged-f4e7267a-b500-4eab-b71d-4ac31c55ca29 for instance with task_state deleting. {{(pid=75229) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 10:22:22 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:22:22 user nova-compute[75229]: INFO nova.virt.libvirt.driver [-] [instance: 88afc442-8973-4643-a0e2-54469417e57b] Instance destroyed successfully.
Nov 14 10:22:22 user nova-compute[75229]: DEBUG nova.objects.instance [None req-5f22ac20-af13-48a1-bc81-4960cffbee2a tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Lazy-loading 'resources' on Instance uuid 88afc442-8973-4643-a0e2-54469417e57b {{(pid=75229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 10:22:22 user nova-compute[75229]: DEBUG nova.virt.libvirt.vif [None req-5f22ac20-af13-48a1-bc81-4960cffbee2a tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T10:19:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1811836888',display_name='tempest-AttachVolumeTestJSON-server-1811836888',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1811836888',id=52,image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGLgoY7aj90g617Dg6nYwB8uCiGWA050tTMb0XJDozOuTzOvQL00BQ4f262GJf2npqu29RFiKHXAbxMw1jW99hxai9kxNATtM+3naYRCfIIQQ3SRcy45stbVnPtc0ILuwA==',key_name='tempest-keypair-729095625',keypairs=<?>,launch_index=0,launched_at=2023-11-14T10:19:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='be7eb95aea3e4897acbc9fe03aadb8e7',ramdisk_id='',reservation_id='r-grlpr623',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-775906619',owner_user_name='tempest-AttachVolumeTestJSON-775906619-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T10:19:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='707c03b04f664aab82260a037074de21',uuid=88afc442-8973-4643-a0e2-54469417e57b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f4e7267a-b500-4eab-b71d-4ac31c55ca29", "address": "fa:16:3e:46:4a:b8", "network": {"id": "13b12b7e-2548-4256-8fb8-fccc67b1e18b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-698342503-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be7eb95aea3e4897acbc9fe03aadb8e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4e7267a-b5", "ovs_interfaceid": "f4e7267a-b500-4eab-b71d-4ac31c55ca29", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 10:22:22 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-5f22ac20-af13-48a1-bc81-4960cffbee2a tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Converting VIF {"id": "f4e7267a-b500-4eab-b71d-4ac31c55ca29", "address": "fa:16:3e:46:4a:b8", "network": {"id": "13b12b7e-2548-4256-8fb8-fccc67b1e18b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-698342503-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be7eb95aea3e4897acbc9fe03aadb8e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4e7267a-b5", "ovs_interfaceid": "f4e7267a-b500-4eab-b71d-4ac31c55ca29", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 10:22:22 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-5f22ac20-af13-48a1-bc81-4960cffbee2a tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:46:4a:b8,bridge_name='br-int',has_traffic_filtering=True,id=f4e7267a-b500-4eab-b71d-4ac31c55ca29,network=Network(13b12b7e-2548-4256-8fb8-fccc67b1e18b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4e7267a-b5') {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 10:22:22 user nova-compute[75229]: DEBUG os_vif [None req-5f22ac20-af13-48a1-bc81-4960cffbee2a tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:46:4a:b8,bridge_name='br-int',has_traffic_filtering=True,id=f4e7267a-b500-4eab-b71d-4ac31c55ca29,network=Network(13b12b7e-2548-4256-8fb8-fccc67b1e18b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4e7267a-b5') {{(pid=75229) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 10:22:22 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:22:22 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf4e7267a-b5, bridge=br-int, if_exists=True) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 10:22:22 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:22:22 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 10:22:22 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:22:22 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=bb162c44-df13-4d8e-89cb-9823b3c55a25) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 10:22:22 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:22:22 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:22:22 user nova-compute[75229]: INFO os_vif [None req-5f22ac20-af13-48a1-bc81-4960cffbee2a tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:46:4a:b8,bridge_name='br-int',has_traffic_filtering=True,id=f4e7267a-b500-4eab-b71d-4ac31c55ca29,network=Network(13b12b7e-2548-4256-8fb8-fccc67b1e18b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4e7267a-b5')
Nov 14 10:22:22 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-5f22ac20-af13-48a1-bc81-4960cffbee2a tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] [instance: 88afc442-8973-4643-a0e2-54469417e57b] Deleting instance files /opt/stack/data/nova/instances/88afc442-8973-4643-a0e2-54469417e57b_del
Nov 14 10:22:22 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-5f22ac20-af13-48a1-bc81-4960cffbee2a tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] [instance: 88afc442-8973-4643-a0e2-54469417e57b] Deletion of /opt/stack/data/nova/instances/88afc442-8973-4643-a0e2-54469417e57b_del complete
Nov 14 10:22:22 user nova-compute[75229]: INFO nova.compute.manager [None req-5f22ac20-af13-48a1-bc81-4960cffbee2a tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] [instance: 88afc442-8973-4643-a0e2-54469417e57b] Took 0.86 seconds to destroy the instance on the hypervisor.
Nov 14 10:22:22 user nova-compute[75229]: DEBUG oslo.service.loopingcall [None req-5f22ac20-af13-48a1-bc81-4960cffbee2a tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75229) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 10:22:22 user nova-compute[75229]: DEBUG nova.compute.manager [-] [instance: 88afc442-8973-4643-a0e2-54469417e57b] Deallocating network for instance {{(pid=75229) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 10:22:22 user nova-compute[75229]: DEBUG nova.network.neutron [-] [instance: 88afc442-8973-4643-a0e2-54469417e57b] deallocate_for_instance() {{(pid=75229) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 10:22:22 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:22:23 user nova-compute[75229]: DEBUG nova.network.neutron [-] [instance: 88afc442-8973-4643-a0e2-54469417e57b] Updating instance_info_cache with network_info: [] {{(pid=75229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 10:22:23 user nova-compute[75229]: INFO nova.compute.manager [-] [instance: 88afc442-8973-4643-a0e2-54469417e57b] Took 0.79 seconds to deallocate network for instance.
Nov 14 10:22:23 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-5f22ac20-af13-48a1-bc81-4960cffbee2a tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:22:23 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-5f22ac20-af13-48a1-bc81-4960cffbee2a tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:22:23 user nova-compute[75229]: DEBUG nova.compute.provider_tree [None req-5f22ac20-af13-48a1-bc81-4960cffbee2a tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Inventory has not changed in ProviderTree for provider: d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 {{(pid=75229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 10:22:23 user nova-compute[75229]: DEBUG nova.scheduler.client.report [None req-5f22ac20-af13-48a1-bc81-4960cffbee2a tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Inventory has not changed for provider d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 10:22:23 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-5f22ac20-af13-48a1-bc81-4960cffbee2a tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.147s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:22:23 user nova-compute[75229]: INFO nova.scheduler.client.report [None req-5f22ac20-af13-48a1-bc81-4960cffbee2a tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Deleted allocations for instance 88afc442-8973-4643-a0e2-54469417e57b
Nov 14 10:22:23 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-5f22ac20-af13-48a1-bc81-4960cffbee2a tempest-AttachVolumeTestJSON-775906619 tempest-AttachVolumeTestJSON-775906619-project-member] Lock "88afc442-8973-4643-a0e2-54469417e57b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.096s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:22:23 user nova-compute[75229]: DEBUG nova.compute.manager [req-055c946d-f516-4b5d-b09b-8cd8d0dea57b req-88bd0f7f-041f-46a6-80fe-816404eff9f4 service nova] [instance: 88afc442-8973-4643-a0e2-54469417e57b] Received event network-vif-plugged-f4e7267a-b500-4eab-b71d-4ac31c55ca29 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 10:22:23 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-055c946d-f516-4b5d-b09b-8cd8d0dea57b req-88bd0f7f-041f-46a6-80fe-816404eff9f4 service nova] Acquiring lock "88afc442-8973-4643-a0e2-54469417e57b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:22:23 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-055c946d-f516-4b5d-b09b-8cd8d0dea57b req-88bd0f7f-041f-46a6-80fe-816404eff9f4 service nova] Lock "88afc442-8973-4643-a0e2-54469417e57b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:22:23 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-055c946d-f516-4b5d-b09b-8cd8d0dea57b req-88bd0f7f-041f-46a6-80fe-816404eff9f4 service nova] Lock "88afc442-8973-4643-a0e2-54469417e57b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:22:23 user nova-compute[75229]: DEBUG nova.compute.manager [req-055c946d-f516-4b5d-b09b-8cd8d0dea57b req-88bd0f7f-041f-46a6-80fe-816404eff9f4 service nova] [instance: 88afc442-8973-4643-a0e2-54469417e57b] No waiting events found dispatching network-vif-plugged-f4e7267a-b500-4eab-b71d-4ac31c55ca29 {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 10:22:23 user nova-compute[75229]: WARNING nova.compute.manager [req-055c946d-f516-4b5d-b09b-8cd8d0dea57b req-88bd0f7f-041f-46a6-80fe-816404eff9f4 service nova] [instance: 88afc442-8973-4643-a0e2-54469417e57b] Received unexpected event network-vif-plugged-f4e7267a-b500-4eab-b71d-4ac31c55ca29 for instance with vm_state deleted and task_state None.
Nov 14 10:22:23 user nova-compute[75229]: DEBUG nova.compute.manager [req-055c946d-f516-4b5d-b09b-8cd8d0dea57b req-88bd0f7f-041f-46a6-80fe-816404eff9f4 service nova] [instance: 88afc442-8973-4643-a0e2-54469417e57b] Received event network-vif-deleted-f4e7267a-b500-4eab-b71d-4ac31c55ca29 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 10:22:25 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:22:25 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:22:25 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:22:25 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:22:25 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:22:25 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Auditing locally available compute resources for user (node: user) {{(pid=75229) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 10:22:26 user nova-compute[75229]: WARNING nova.virt.libvirt.driver [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 10:22:26 user nova-compute[75229]: WARNING nova.virt.libvirt.driver [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 10:22:26 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Hypervisor/Node resource view: name=user free_ram=9111MB free_disk=25.170589447021484GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75229) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 10:22:26 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:22:26 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:22:26 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75229) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 10:22:26 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75229) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 10:22:26 user nova-compute[75229]: DEBUG nova.compute.provider_tree [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Inventory has not changed in ProviderTree for provider: d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 {{(pid=75229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 10:22:26 user nova-compute[75229]: DEBUG nova.scheduler.client.report [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Inventory has not changed for provider d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 10:22:26 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Compute_service record updated for user:user {{(pid=75229) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 10:22:26 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.134s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:22:27 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:22:28 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:22:32 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:22:37 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:22:37 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:22:39 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:22:40 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:22:42 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:22:43 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:22:47 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:22:52 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:22:57 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:23:02 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:23:07 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:23:12 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:23:14 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:23:14 user nova-compute[75229]: DEBUG nova.compute.manager [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Starting heal instance info cache {{(pid=75229) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 10:23:14 user nova-compute[75229]: DEBUG nova.compute.manager [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Rebuilding the list of instances to heal {{(pid=75229) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 10:23:14 user nova-compute[75229]: DEBUG nova.compute.manager [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Didn't find any instances for network info cache update. {{(pid=75229) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 14 10:23:16 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:23:17 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:23:19 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:23:20 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:23:20 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:23:20 user nova-compute[75229]: DEBUG nova.compute.manager [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75229) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 10:23:21 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:23:22 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:23:23 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:23:25 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:23:27 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:23:27 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:23:27 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:23:27 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:23:27 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:23:27 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:23:27 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Auditing locally available compute resources for user (node: user) {{(pid=75229) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 10:23:28 user nova-compute[75229]: WARNING nova.virt.libvirt.driver [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 10:23:28 user nova-compute[75229]: WARNING nova.virt.libvirt.driver [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 10:23:28 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Hypervisor/Node resource view: name=user free_ram=9185MB free_disk=25.168563842773438GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75229) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 10:23:28 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:23:28 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:23:28 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75229) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 10:23:28 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75229) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 10:23:28 user nova-compute[75229]: DEBUG nova.compute.provider_tree [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Inventory has not changed in ProviderTree for provider: d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 {{(pid=75229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 10:23:28 user nova-compute[75229]: DEBUG nova.scheduler.client.report [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Inventory has not changed for provider d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 10:23:28 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Compute_service record updated for user:user {{(pid=75229) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 10:23:28 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.117s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:23:32 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:23:37 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 10:23:38 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:23:42 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:23:47 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 10:23:47 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:23:47 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75229) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 10:23:47 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75229) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 10:23:47 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75229) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 10:23:47 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:23:52 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 10:23:57 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 10:24:02 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:24:07 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:24:12 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:24:16 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:24:16 user nova-compute[75229]: DEBUG nova.compute.manager [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Starting heal instance info cache {{(pid=75229) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 10:24:16 user nova-compute[75229]: DEBUG nova.compute.manager [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Rebuilding the list of instances to heal {{(pid=75229) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 10:24:16 user nova-compute[75229]: DEBUG nova.compute.manager [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Didn't find any instances for network info cache update. {{(pid=75229) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 14 10:24:17 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 10:24:17 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:24:17 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75229) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 10:24:17 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75229) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 10:24:17 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75229) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 10:24:17 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:24:18 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:24:20 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:24:22 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:24:22 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:24:22 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:24:22 user nova-compute[75229]: DEBUG nova.compute.manager [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75229) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 10:24:25 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:24:27 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:24:27 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:24:27 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:24:28 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:24:28 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:24:28 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:24:28 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:24:28 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Auditing locally available compute resources for user (node: user) {{(pid=75229) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 10:24:29 user nova-compute[75229]: WARNING nova.virt.libvirt.driver [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 10:24:29 user nova-compute[75229]: WARNING nova.virt.libvirt.driver [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 10:24:29 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Hypervisor/Node resource view: name=user free_ram=9302MB free_disk=25.15727996826172GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75229) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 10:24:29 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:24:29 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:24:29 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75229) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 10:24:29 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75229) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 10:24:29 user nova-compute[75229]: DEBUG nova.compute.provider_tree [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Inventory has not changed in ProviderTree for provider: d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 {{(pid=75229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 10:24:29 user nova-compute[75229]: DEBUG nova.scheduler.client.report [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Inventory has not changed for provider d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 10:24:29 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Compute_service record updated for user:user {{(pid=75229) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 10:24:29 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.113s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:24:32 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 10:24:37 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:24:41 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:24:42 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:24:45 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:24:47 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:24:49 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:24:52 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:24:52 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:24:54 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:24:56 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:24:57 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:24:59 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:25:00 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:25:02 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:25:04 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:25:05 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-2fcf96e1-edcc-41ae-8e7c-32649f8202e1 tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] Acquiring lock "b09bd69f-531c-4e44-a955-c56f0f8ada85" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:25:05 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-2fcf96e1-edcc-41ae-8e7c-32649f8202e1 tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] Lock "b09bd69f-531c-4e44-a955-c56f0f8ada85" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:25:05 user nova-compute[75229]: DEBUG nova.compute.manager [None req-2fcf96e1-edcc-41ae-8e7c-32649f8202e1 tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] [instance: b09bd69f-531c-4e44-a955-c56f0f8ada85] Starting instance... {{(pid=75229) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 10:25:05 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-2fcf96e1-edcc-41ae-8e7c-32649f8202e1 tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:25:05 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-2fcf96e1-edcc-41ae-8e7c-32649f8202e1 tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:25:05 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-2fcf96e1-edcc-41ae-8e7c-32649f8202e1 tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75229) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 10:25:05 user nova-compute[75229]: INFO nova.compute.claims [None req-2fcf96e1-edcc-41ae-8e7c-32649f8202e1 tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] [instance: b09bd69f-531c-4e44-a955-c56f0f8ada85] Claim successful on node user
Nov 14 10:25:06 user nova-compute[75229]: DEBUG nova.compute.provider_tree [None req-2fcf96e1-edcc-41ae-8e7c-32649f8202e1 tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] Inventory has not changed in ProviderTree for provider: d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 {{(pid=75229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 10:25:06 user nova-compute[75229]: DEBUG nova.scheduler.client.report [None req-2fcf96e1-edcc-41ae-8e7c-32649f8202e1 tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] Inventory has not changed for provider d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 10:25:06 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-2fcf96e1-edcc-41ae-8e7c-32649f8202e1 tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.226s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:25:06 user nova-compute[75229]: DEBUG nova.compute.manager [None req-2fcf96e1-edcc-41ae-8e7c-32649f8202e1 tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] [instance: b09bd69f-531c-4e44-a955-c56f0f8ada85] Start building networks asynchronously for instance. {{(pid=75229) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 10:25:06 user nova-compute[75229]: DEBUG nova.compute.manager [None req-2fcf96e1-edcc-41ae-8e7c-32649f8202e1 tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] [instance: b09bd69f-531c-4e44-a955-c56f0f8ada85] Allocating IP information in the background. {{(pid=75229) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 10:25:06 user nova-compute[75229]: DEBUG nova.network.neutron [None req-2fcf96e1-edcc-41ae-8e7c-32649f8202e1 tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] [instance: b09bd69f-531c-4e44-a955-c56f0f8ada85] allocate_for_instance() {{(pid=75229) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 10:25:06 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-2fcf96e1-edcc-41ae-8e7c-32649f8202e1 tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] [instance: b09bd69f-531c-4e44-a955-c56f0f8ada85] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 10:25:06 user nova-compute[75229]: DEBUG nova.compute.manager [None req-2fcf96e1-edcc-41ae-8e7c-32649f8202e1 tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] [instance: b09bd69f-531c-4e44-a955-c56f0f8ada85] Start building block device mappings for instance. {{(pid=75229) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 10:25:06 user nova-compute[75229]: DEBUG nova.compute.manager [None req-2fcf96e1-edcc-41ae-8e7c-32649f8202e1 tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] [instance: b09bd69f-531c-4e44-a955-c56f0f8ada85] Start spawning the instance on the hypervisor. {{(pid=75229) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 10:25:06 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-2fcf96e1-edcc-41ae-8e7c-32649f8202e1 tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] [instance: b09bd69f-531c-4e44-a955-c56f0f8ada85] Creating instance directory {{(pid=75229) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 10:25:06 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-2fcf96e1-edcc-41ae-8e7c-32649f8202e1 tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] [instance: b09bd69f-531c-4e44-a955-c56f0f8ada85] Creating image(s)
Nov 14 10:25:06 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-2fcf96e1-edcc-41ae-8e7c-32649f8202e1 tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] Acquiring lock "/opt/stack/data/nova/instances/b09bd69f-531c-4e44-a955-c56f0f8ada85/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:25:06 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-2fcf96e1-edcc-41ae-8e7c-32649f8202e1 tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] Lock "/opt/stack/data/nova/instances/b09bd69f-531c-4e44-a955-c56f0f8ada85/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:25:06 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-2fcf96e1-edcc-41ae-8e7c-32649f8202e1 tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] Lock "/opt/stack/data/nova/instances/b09bd69f-531c-4e44-a955-c56f0f8ada85/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:25:06 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-2fcf96e1-edcc-41ae-8e7c-32649f8202e1 tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6 --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:25:06 user nova-compute[75229]: DEBUG nova.policy [None req-2fcf96e1-edcc-41ae-8e7c-32649f8202e1 tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1b57ea954ff54894bf9e327b80142003', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91aa3be89afe4855b8918caa5fc35e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75229) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 10:25:06 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-2fcf96e1-edcc-41ae-8e7c-32649f8202e1 tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6 --force-share --output=json" returned: 0 in 0.182s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:25:06 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-2fcf96e1-edcc-41ae-8e7c-32649f8202e1 tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] Acquiring lock "4f30e3fe703d2381679612a57b1fb80a467f60b6" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:25:06 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-2fcf96e1-edcc-41ae-8e7c-32649f8202e1 tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] Lock "4f30e3fe703d2381679612a57b1fb80a467f60b6" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:25:06 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-2fcf96e1-edcc-41ae-8e7c-32649f8202e1 tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6 --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:25:06 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-2fcf96e1-edcc-41ae-8e7c-32649f8202e1 tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6 --force-share --output=json" returned: 0 in 0.219s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:25:06 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-2fcf96e1-edcc-41ae-8e7c-32649f8202e1 tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6,backing_fmt=raw /opt/stack/data/nova/instances/b09bd69f-531c-4e44-a955-c56f0f8ada85/disk 1073741824 {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:25:06 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-2fcf96e1-edcc-41ae-8e7c-32649f8202e1 tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6,backing_fmt=raw /opt/stack/data/nova/instances/b09bd69f-531c-4e44-a955-c56f0f8ada85/disk 1073741824" returned: 0 in 0.051s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:25:06 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-2fcf96e1-edcc-41ae-8e7c-32649f8202e1 tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] Lock "4f30e3fe703d2381679612a57b1fb80a467f60b6" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.276s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:25:06 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-2fcf96e1-edcc-41ae-8e7c-32649f8202e1 tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6 --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:25:07 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-2fcf96e1-edcc-41ae-8e7c-32649f8202e1 tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f30e3fe703d2381679612a57b1fb80a467f60b6 --force-share --output=json" returned: 0 in 0.230s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:25:07 user nova-compute[75229]: DEBUG nova.virt.disk.api [None req-2fcf96e1-edcc-41ae-8e7c-32649f8202e1 tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b09bd69f-531c-4e44-a955-c56f0f8ada85/disk. size=1073741824 {{(pid=75229) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 10:25:07 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-2fcf96e1-edcc-41ae-8e7c-32649f8202e1 tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b09bd69f-531c-4e44-a955-c56f0f8ada85/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:25:07 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-2fcf96e1-edcc-41ae-8e7c-32649f8202e1 tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b09bd69f-531c-4e44-a955-c56f0f8ada85/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:25:07 user nova-compute[75229]: DEBUG nova.virt.disk.api [None req-2fcf96e1-edcc-41ae-8e7c-32649f8202e1 tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] Cannot resize image /opt/stack/data/nova/instances/b09bd69f-531c-4e44-a955-c56f0f8ada85/disk to a smaller size. {{(pid=75229) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 10:25:07 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-2fcf96e1-edcc-41ae-8e7c-32649f8202e1 tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] [instance: b09bd69f-531c-4e44-a955-c56f0f8ada85] Created local disks {{(pid=75229) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 10:25:07 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-2fcf96e1-edcc-41ae-8e7c-32649f8202e1 tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] [instance: b09bd69f-531c-4e44-a955-c56f0f8ada85] Ensure instance console log exists: /opt/stack/data/nova/instances/b09bd69f-531c-4e44-a955-c56f0f8ada85/console.log {{(pid=75229) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 10:25:07 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-2fcf96e1-edcc-41ae-8e7c-32649f8202e1 tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:25:07 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-2fcf96e1-edcc-41ae-8e7c-32649f8202e1 tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:25:07 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-2fcf96e1-edcc-41ae-8e7c-32649f8202e1 tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:25:07 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:25:07 user nova-compute[75229]: DEBUG nova.network.neutron [None req-2fcf96e1-edcc-41ae-8e7c-32649f8202e1 tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] [instance: b09bd69f-531c-4e44-a955-c56f0f8ada85] Successfully created port: a47c7541-2bcf-4288-a237-90e2b1439d20 {{(pid=75229) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 10:25:08 user nova-compute[75229]: DEBUG nova.network.neutron [None req-2fcf96e1-edcc-41ae-8e7c-32649f8202e1 tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] [instance: b09bd69f-531c-4e44-a955-c56f0f8ada85] Successfully updated port: a47c7541-2bcf-4288-a237-90e2b1439d20 {{(pid=75229) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 10:25:08 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-2fcf96e1-edcc-41ae-8e7c-32649f8202e1 tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] Acquiring lock "refresh_cache-b09bd69f-531c-4e44-a955-c56f0f8ada85" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 10:25:08 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-2fcf96e1-edcc-41ae-8e7c-32649f8202e1 tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] Acquired lock "refresh_cache-b09bd69f-531c-4e44-a955-c56f0f8ada85" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 10:25:08 user nova-compute[75229]: DEBUG nova.network.neutron [None req-2fcf96e1-edcc-41ae-8e7c-32649f8202e1 tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] [instance: b09bd69f-531c-4e44-a955-c56f0f8ada85] Building network info cache for instance {{(pid=75229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 10:25:08 user nova-compute[75229]: DEBUG nova.compute.manager [req-f593221a-5461-4ec1-b49b-b96738668974 req-cc7646e2-f341-42a3-b542-7ba4e13a7fa6 service nova] [instance: b09bd69f-531c-4e44-a955-c56f0f8ada85] Received event network-changed-a47c7541-2bcf-4288-a237-90e2b1439d20 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 10:25:08 user nova-compute[75229]: DEBUG nova.compute.manager [req-f593221a-5461-4ec1-b49b-b96738668974 req-cc7646e2-f341-42a3-b542-7ba4e13a7fa6 service nova] [instance: b09bd69f-531c-4e44-a955-c56f0f8ada85] Refreshing instance network info cache due to event network-changed-a47c7541-2bcf-4288-a237-90e2b1439d20. {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 10:25:08 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-f593221a-5461-4ec1-b49b-b96738668974 req-cc7646e2-f341-42a3-b542-7ba4e13a7fa6 service nova] Acquiring lock "refresh_cache-b09bd69f-531c-4e44-a955-c56f0f8ada85" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 10:25:08 user nova-compute[75229]: DEBUG nova.network.neutron [None req-2fcf96e1-edcc-41ae-8e7c-32649f8202e1 tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] [instance: b09bd69f-531c-4e44-a955-c56f0f8ada85] Instance cache missing network info. {{(pid=75229) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 10:25:08 user nova-compute[75229]: DEBUG nova.network.neutron [None req-2fcf96e1-edcc-41ae-8e7c-32649f8202e1 tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] [instance: b09bd69f-531c-4e44-a955-c56f0f8ada85] Updating instance_info_cache with network_info: [{"id": "a47c7541-2bcf-4288-a237-90e2b1439d20", "address": "fa:16:3e:8a:62:dc", "network": {"id": "faebf0c9-ac3b-4877-b8c0-683ac8c6952d", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1933420959-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "91aa3be89afe4855b8918caa5fc35e47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa47c7541-2b", "ovs_interfaceid": "a47c7541-2bcf-4288-a237-90e2b1439d20", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 10:25:08 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-2fcf96e1-edcc-41ae-8e7c-32649f8202e1 tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] Releasing lock "refresh_cache-b09bd69f-531c-4e44-a955-c56f0f8ada85" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 10:25:08 user nova-compute[75229]: DEBUG nova.compute.manager [None req-2fcf96e1-edcc-41ae-8e7c-32649f8202e1 tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] [instance: b09bd69f-531c-4e44-a955-c56f0f8ada85] Instance network_info: |[{"id": "a47c7541-2bcf-4288-a237-90e2b1439d20", "address": "fa:16:3e:8a:62:dc", "network": {"id": "faebf0c9-ac3b-4877-b8c0-683ac8c6952d", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1933420959-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "91aa3be89afe4855b8918caa5fc35e47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa47c7541-2b", "ovs_interfaceid": "a47c7541-2bcf-4288-a237-90e2b1439d20", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75229) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 10:25:08 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-f593221a-5461-4ec1-b49b-b96738668974 req-cc7646e2-f341-42a3-b542-7ba4e13a7fa6 service nova] Acquired lock "refresh_cache-b09bd69f-531c-4e44-a955-c56f0f8ada85" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 10:25:08 user nova-compute[75229]: DEBUG nova.network.neutron [req-f593221a-5461-4ec1-b49b-b96738668974 req-cc7646e2-f341-42a3-b542-7ba4e13a7fa6 service nova] [instance: b09bd69f-531c-4e44-a955-c56f0f8ada85] Refreshing network info cache for port a47c7541-2bcf-4288-a237-90e2b1439d20 {{(pid=75229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 10:25:08 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-2fcf96e1-edcc-41ae-8e7c-32649f8202e1 tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] [instance: b09bd69f-531c-4e44-a955-c56f0f8ada85] Start _get_guest_xml network_info=[{"id": "a47c7541-2bcf-4288-a237-90e2b1439d20", "address": "fa:16:3e:8a:62:dc", "network": {"id": "faebf0c9-ac3b-4877-b8c0-683ac8c6952d", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1933420959-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "91aa3be89afe4855b8918caa5fc35e47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa47c7541-2b", "ovs_interfaceid": "a47c7541-2bcf-4288-a237-90e2b1439d20", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T09:40:10Z,direct_url=<?>,disk_format='qcow2',id=3bef8470-ecc7-40e3-95d4-9254348ea72d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='de5a91106b6948ed937a7178ff9464c4',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T09:40:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'disk_bus': 'virtio', 'guest_format': None, 'encryption_secret_uuid': None, 'size': 0, 'device_type': 'disk', 'image_id': '3bef8470-ecc7-40e3-95d4-9254348ea72d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75229) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 10:25:08 user nova-compute[75229]: WARNING nova.virt.libvirt.driver [None req-2fcf96e1-edcc-41ae-8e7c-32649f8202e1 tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 10:25:08 user nova-compute[75229]: WARNING nova.virt.libvirt.driver [None req-2fcf96e1-edcc-41ae-8e7c-32649f8202e1 tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 10:25:08 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-2fcf96e1-edcc-41ae-8e7c-32649f8202e1 tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75229) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 10:25:08 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-2fcf96e1-edcc-41ae-8e7c-32649f8202e1 tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] CPU controller missing on host. {{(pid=75229) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 10:25:08 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-2fcf96e1-edcc-41ae-8e7c-32649f8202e1 tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75229) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 10:25:08 user nova-compute[75229]: DEBUG nova.virt.libvirt.host [None req-2fcf96e1-edcc-41ae-8e7c-32649f8202e1 tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] CPU controller found on host. {{(pid=75229) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 10:25:08 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-2fcf96e1-edcc-41ae-8e7c-32649f8202e1 tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75229) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 10:25:08 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-2fcf96e1-edcc-41ae-8e7c-32649f8202e1 tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T09:39:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T09:40:10Z,direct_url=<?>,disk_format='qcow2',id=3bef8470-ecc7-40e3-95d4-9254348ea72d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='de5a91106b6948ed937a7178ff9464c4',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T09:40:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 10:25:08 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-2fcf96e1-edcc-41ae-8e7c-32649f8202e1 tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] Flavor limits 0:0:0 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 10:25:08 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-2fcf96e1-edcc-41ae-8e7c-32649f8202e1 tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] Image limits 0:0:0 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 10:25:08 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-2fcf96e1-edcc-41ae-8e7c-32649f8202e1 tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] Flavor pref 0:0:0 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 10:25:08 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-2fcf96e1-edcc-41ae-8e7c-32649f8202e1 tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] Image pref 0:0:0 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 10:25:08 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-2fcf96e1-edcc-41ae-8e7c-32649f8202e1 tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 10:25:08 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-2fcf96e1-edcc-41ae-8e7c-32649f8202e1 tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 10:25:08 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-2fcf96e1-edcc-41ae-8e7c-32649f8202e1 tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75229) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 10:25:08 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-2fcf96e1-edcc-41ae-8e7c-32649f8202e1 tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] Got 1 possible topologies {{(pid=75229) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 10:25:08 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-2fcf96e1-edcc-41ae-8e7c-32649f8202e1 tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 10:25:08 user nova-compute[75229]: DEBUG nova.virt.hardware [None req-2fcf96e1-edcc-41ae-8e7c-32649f8202e1 tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 10:25:08 user nova-compute[75229]: DEBUG nova.virt.libvirt.vif [None req-2fcf96e1-edcc-41ae-8e7c-32649f8202e1 tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T10:25:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-2088060708',display_name='tempest-SnapshotDataIntegrityTests-server-2088060708',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-2088060708',id=53,image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCSqI4lJeBv3ZeLKxCO/TS3GXep/rRFs2aGUWTjWKXcekDooFqbCccD9ZrbS95+X1fObChqL3N8b2rtBuiF4BvEgLeOMj4oxIg8FHWdTMJcvj6YhEHnZbrdpm6PWbbjJBw==',key_name='tempest-keypair-780290131',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='91aa3be89afe4855b8918caa5fc35e47',ramdisk_id='',reservation_id='r-ka8rfhq5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1621425388',owner_user_name='tempest-SnapshotDataIntegrityTests-1621425388-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T10:25:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1b57ea954ff54894bf9e327b80142003',uuid=b09bd69f-531c-4e44-a955-c56f0f8ada85,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a47c7541-2bcf-4288-a237-90e2b1439d20", "address": "fa:16:3e:8a:62:dc", "network": {"id": "faebf0c9-ac3b-4877-b8c0-683ac8c6952d", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1933420959-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "91aa3be89afe4855b8918caa5fc35e47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa47c7541-2b", "ovs_interfaceid": "a47c7541-2bcf-4288-a237-90e2b1439d20", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75229) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 10:25:08 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-2fcf96e1-edcc-41ae-8e7c-32649f8202e1 tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] Converting VIF {"id": "a47c7541-2bcf-4288-a237-90e2b1439d20", "address": "fa:16:3e:8a:62:dc", "network": {"id": "faebf0c9-ac3b-4877-b8c0-683ac8c6952d", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1933420959-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "91aa3be89afe4855b8918caa5fc35e47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa47c7541-2b", "ovs_interfaceid": "a47c7541-2bcf-4288-a237-90e2b1439d20", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 10:25:08 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-2fcf96e1-edcc-41ae-8e7c-32649f8202e1 tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8a:62:dc,bridge_name='br-int',has_traffic_filtering=True,id=a47c7541-2bcf-4288-a237-90e2b1439d20,network=Network(faebf0c9-ac3b-4877-b8c0-683ac8c6952d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa47c7541-2b') {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 10:25:08 user nova-compute[75229]: DEBUG nova.objects.instance [None req-2fcf96e1-edcc-41ae-8e7c-32649f8202e1 tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] Lazy-loading 'pci_devices' on Instance uuid b09bd69f-531c-4e44-a955-c56f0f8ada85 {{(pid=75229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 10:25:08 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-2fcf96e1-edcc-41ae-8e7c-32649f8202e1 tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] [instance: b09bd69f-531c-4e44-a955-c56f0f8ada85] End _get_guest_xml xml=<domain type="kvm">
Nov 14 10:25:08 user nova-compute[75229]:   <uuid>b09bd69f-531c-4e44-a955-c56f0f8ada85</uuid>
Nov 14 10:25:08 user nova-compute[75229]:   <name>instance-00000035</name>
Nov 14 10:25:08 user nova-compute[75229]:   <memory>524288</memory>
Nov 14 10:25:08 user nova-compute[75229]:   <vcpu>1</vcpu>
Nov 14 10:25:08 user nova-compute[75229]:   <metadata>
Nov 14 10:25:08 user nova-compute[75229]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 10:25:08 user nova-compute[75229]:       <nova:package version="0.0.0"/>
Nov 14 10:25:08 user nova-compute[75229]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-2088060708</nova:name>
Nov 14 10:25:08 user nova-compute[75229]:       <nova:creationTime>2023-11-14 10:25:08</nova:creationTime>
Nov 14 10:25:08 user nova-compute[75229]:       <nova:flavor name="m1.tiny">
Nov 14 10:25:08 user nova-compute[75229]:         <nova:memory>512</nova:memory>
Nov 14 10:25:08 user nova-compute[75229]:         <nova:disk>1</nova:disk>
Nov 14 10:25:08 user nova-compute[75229]:         <nova:swap>0</nova:swap>
Nov 14 10:25:08 user nova-compute[75229]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 10:25:08 user nova-compute[75229]:         <nova:vcpus>1</nova:vcpus>
Nov 14 10:25:08 user nova-compute[75229]:       </nova:flavor>
Nov 14 10:25:08 user nova-compute[75229]:       <nova:owner>
Nov 14 10:25:08 user nova-compute[75229]:         <nova:user uuid="1b57ea954ff54894bf9e327b80142003">tempest-SnapshotDataIntegrityTests-1621425388-project-member</nova:user>
Nov 14 10:25:08 user nova-compute[75229]:         <nova:project uuid="91aa3be89afe4855b8918caa5fc35e47">tempest-SnapshotDataIntegrityTests-1621425388</nova:project>
Nov 14 10:25:08 user nova-compute[75229]:       </nova:owner>
Nov 14 10:25:08 user nova-compute[75229]:       <nova:root type="image" uuid="3bef8470-ecc7-40e3-95d4-9254348ea72d"/>
Nov 14 10:25:08 user nova-compute[75229]:       <nova:ports>
Nov 14 10:25:08 user nova-compute[75229]:         <nova:port uuid="a47c7541-2bcf-4288-a237-90e2b1439d20">
Nov 14 10:25:08 user nova-compute[75229]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 14 10:25:08 user nova-compute[75229]:         </nova:port>
Nov 14 10:25:08 user nova-compute[75229]:       </nova:ports>
Nov 14 10:25:08 user nova-compute[75229]:     </nova:instance>
Nov 14 10:25:08 user nova-compute[75229]:   </metadata>
Nov 14 10:25:08 user nova-compute[75229]:   <sysinfo type="smbios">
Nov 14 10:25:08 user nova-compute[75229]:     <system>
Nov 14 10:25:08 user nova-compute[75229]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 10:25:08 user nova-compute[75229]:       <entry name="product">OpenStack Nova</entry>
Nov 14 10:25:08 user nova-compute[75229]:       <entry name="version">0.0.0</entry>
Nov 14 10:25:08 user nova-compute[75229]:       <entry name="serial">b09bd69f-531c-4e44-a955-c56f0f8ada85</entry>
Nov 14 10:25:08 user nova-compute[75229]:       <entry name="uuid">b09bd69f-531c-4e44-a955-c56f0f8ada85</entry>
Nov 14 10:25:08 user nova-compute[75229]:       <entry name="family">Virtual Machine</entry>
Nov 14 10:25:08 user nova-compute[75229]:     </system>
Nov 14 10:25:08 user nova-compute[75229]:   </sysinfo>
Nov 14 10:25:08 user nova-compute[75229]:   <os>
Nov 14 10:25:08 user nova-compute[75229]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 10:25:08 user nova-compute[75229]:     <boot dev="hd"/>
Nov 14 10:25:08 user nova-compute[75229]:     <smbios mode="sysinfo"/>
Nov 14 10:25:08 user nova-compute[75229]:   </os>
Nov 14 10:25:08 user nova-compute[75229]:   <features>
Nov 14 10:25:08 user nova-compute[75229]:     <acpi/>
Nov 14 10:25:08 user nova-compute[75229]:     <apic/>
Nov 14 10:25:08 user nova-compute[75229]:     <vmcoreinfo/>
Nov 14 10:25:08 user nova-compute[75229]:   </features>
Nov 14 10:25:08 user nova-compute[75229]:   <clock offset="utc">
Nov 14 10:25:08 user nova-compute[75229]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 10:25:08 user nova-compute[75229]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 10:25:08 user nova-compute[75229]:     <timer name="hpet" present="no"/>
Nov 14 10:25:08 user nova-compute[75229]:   </clock>
Nov 14 10:25:08 user nova-compute[75229]:   <cpu mode="custom" match="exact">
Nov 14 10:25:08 user nova-compute[75229]:     <model>Nehalem</model>
Nov 14 10:25:08 user nova-compute[75229]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 10:25:08 user nova-compute[75229]:   </cpu>
Nov 14 10:25:08 user nova-compute[75229]:   <devices>
Nov 14 10:25:08 user nova-compute[75229]:     <disk type="file" device="disk">
Nov 14 10:25:08 user nova-compute[75229]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 10:25:08 user nova-compute[75229]:       <source file="/opt/stack/data/nova/instances/b09bd69f-531c-4e44-a955-c56f0f8ada85/disk"/>
Nov 14 10:25:08 user nova-compute[75229]:       <target dev="vda" bus="virtio"/>
Nov 14 10:25:08 user nova-compute[75229]:     </disk>
Nov 14 10:25:08 user nova-compute[75229]:     <interface type="ethernet">
Nov 14 10:25:08 user nova-compute[75229]:       <mac address="fa:16:3e:8a:62:dc"/>
Nov 14 10:25:08 user nova-compute[75229]:       <model type="virtio"/>
Nov 14 10:25:08 user nova-compute[75229]:       <mtu size="1442"/>
Nov 14 10:25:08 user nova-compute[75229]:       <target dev="tapa47c7541-2b"/>
Nov 14 10:25:08 user nova-compute[75229]:     </interface>
Nov 14 10:25:08 user nova-compute[75229]:     <serial type="pty">
Nov 14 10:25:08 user nova-compute[75229]:       <log file="/opt/stack/data/nova/instances/b09bd69f-531c-4e44-a955-c56f0f8ada85/console.log" append="off"/>
Nov 14 10:25:08 user nova-compute[75229]:     </serial>
Nov 14 10:25:08 user nova-compute[75229]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 10:25:08 user nova-compute[75229]:     <video>
Nov 14 10:25:08 user nova-compute[75229]:       <model type="virtio"/>
Nov 14 10:25:08 user nova-compute[75229]:     </video>
Nov 14 10:25:08 user nova-compute[75229]:     <rng model="virtio">
Nov 14 10:25:08 user nova-compute[75229]:       <backend model="random">/dev/urandom</backend>
Nov 14 10:25:08 user nova-compute[75229]:     </rng>
Nov 14 10:25:08 user nova-compute[75229]:     <controller type="usb" index="0" model="none"/>
Nov 14 10:25:08 user nova-compute[75229]:     <memballoon model="virtio">
Nov 14 10:25:08 user nova-compute[75229]:       <stats period="10"/>
Nov 14 10:25:08 user nova-compute[75229]:     </memballoon>
Nov 14 10:25:08 user nova-compute[75229]:   </devices>
Nov 14 10:25:08 user nova-compute[75229]: </domain>
Nov 14 10:25:08 user nova-compute[75229]:  {{(pid=75229) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 10:25:08 user nova-compute[75229]: DEBUG nova.virt.libvirt.vif [None req-2fcf96e1-edcc-41ae-8e7c-32649f8202e1 tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T10:25:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-2088060708',display_name='tempest-SnapshotDataIntegrityTests-server-2088060708',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-2088060708',id=53,image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCSqI4lJeBv3ZeLKxCO/TS3GXep/rRFs2aGUWTjWKXcekDooFqbCccD9ZrbS95+X1fObChqL3N8b2rtBuiF4BvEgLeOMj4oxIg8FHWdTMJcvj6YhEHnZbrdpm6PWbbjJBw==',key_name='tempest-keypair-780290131',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='91aa3be89afe4855b8918caa5fc35e47',ramdisk_id='',reservation_id='r-ka8rfhq5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1621425388',owner_user_name='tempest-SnapshotDataIntegrityTests-1621425388-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T10:25:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1b57ea954ff54894bf9e327b80142003',uuid=b09bd69f-531c-4e44-a955-c56f0f8ada85,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a47c7541-2bcf-4288-a237-90e2b1439d20", "address": "fa:16:3e:8a:62:dc", "network": {"id": "faebf0c9-ac3b-4877-b8c0-683ac8c6952d", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1933420959-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "91aa3be89afe4855b8918caa5fc35e47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa47c7541-2b", "ovs_interfaceid": "a47c7541-2bcf-4288-a237-90e2b1439d20", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 10:25:08 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-2fcf96e1-edcc-41ae-8e7c-32649f8202e1 tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] Converting VIF {"id": "a47c7541-2bcf-4288-a237-90e2b1439d20", "address": "fa:16:3e:8a:62:dc", "network": {"id": "faebf0c9-ac3b-4877-b8c0-683ac8c6952d", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1933420959-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "91aa3be89afe4855b8918caa5fc35e47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa47c7541-2b", "ovs_interfaceid": "a47c7541-2bcf-4288-a237-90e2b1439d20", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 10:25:08 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-2fcf96e1-edcc-41ae-8e7c-32649f8202e1 tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8a:62:dc,bridge_name='br-int',has_traffic_filtering=True,id=a47c7541-2bcf-4288-a237-90e2b1439d20,network=Network(faebf0c9-ac3b-4877-b8c0-683ac8c6952d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa47c7541-2b') {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 10:25:08 user nova-compute[75229]: DEBUG os_vif [None req-2fcf96e1-edcc-41ae-8e7c-32649f8202e1 tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8a:62:dc,bridge_name='br-int',has_traffic_filtering=True,id=a47c7541-2bcf-4288-a237-90e2b1439d20,network=Network(faebf0c9-ac3b-4877-b8c0-683ac8c6952d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa47c7541-2b') {{(pid=75229) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 10:25:08 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:25:08 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 10:25:08 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 10:25:08 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:25:08 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6724a45d-c38c-5a2d-bb17-f4c357f46051', '_type': 'linux-noop'}}, row=False) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 10:25:08 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:25:08 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 10:25:08 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:25:08 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa47c7541-2b, may_exist=True, interface_attrs={}) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 10:25:08 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa47c7541-2b, col_values=(('qos', UUID('7d02a4ce-0a2a-4744-9846-e9c1c72723ab')),), if_exists=True) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 10:25:08 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa47c7541-2b, col_values=(('external_ids', {'iface-id': 'a47c7541-2bcf-4288-a237-90e2b1439d20', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8a:62:dc', 'vm-uuid': 'b09bd69f-531c-4e44-a955-c56f0f8ada85'}),), if_exists=True) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 10:25:08 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:25:08 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 10:25:08 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:25:08 user nova-compute[75229]: INFO os_vif [None req-2fcf96e1-edcc-41ae-8e7c-32649f8202e1 tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8a:62:dc,bridge_name='br-int',has_traffic_filtering=True,id=a47c7541-2bcf-4288-a237-90e2b1439d20,network=Network(faebf0c9-ac3b-4877-b8c0-683ac8c6952d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa47c7541-2b')
Nov 14 10:25:08 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-2fcf96e1-edcc-41ae-8e7c-32649f8202e1 tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] No BDM found with device name vda, not building metadata. {{(pid=75229) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 10:25:08 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-2fcf96e1-edcc-41ae-8e7c-32649f8202e1 tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] No VIF found with MAC fa:16:3e:8a:62:dc, not building metadata {{(pid=75229) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 10:25:09 user nova-compute[75229]: DEBUG nova.network.neutron [req-f593221a-5461-4ec1-b49b-b96738668974 req-cc7646e2-f341-42a3-b542-7ba4e13a7fa6 service nova] [instance: b09bd69f-531c-4e44-a955-c56f0f8ada85] Updated VIF entry in instance network info cache for port a47c7541-2bcf-4288-a237-90e2b1439d20. {{(pid=75229) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 10:25:09 user nova-compute[75229]: DEBUG nova.network.neutron [req-f593221a-5461-4ec1-b49b-b96738668974 req-cc7646e2-f341-42a3-b542-7ba4e13a7fa6 service nova] [instance: b09bd69f-531c-4e44-a955-c56f0f8ada85] Updating instance_info_cache with network_info: [{"id": "a47c7541-2bcf-4288-a237-90e2b1439d20", "address": "fa:16:3e:8a:62:dc", "network": {"id": "faebf0c9-ac3b-4877-b8c0-683ac8c6952d", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1933420959-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "91aa3be89afe4855b8918caa5fc35e47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa47c7541-2b", "ovs_interfaceid": "a47c7541-2bcf-4288-a237-90e2b1439d20", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 10:25:09 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-f593221a-5461-4ec1-b49b-b96738668974 req-cc7646e2-f341-42a3-b542-7ba4e13a7fa6 service nova] Releasing lock "refresh_cache-b09bd69f-531c-4e44-a955-c56f0f8ada85" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 10:25:09 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:25:10 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:25:10 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:25:10 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:25:10 user nova-compute[75229]: DEBUG nova.compute.manager [req-cd926477-10bb-44a1-b318-e62bdadaddb6 req-d4e2e366-2fb0-4f52-a46c-cd34c9ea513b service nova] [instance: b09bd69f-531c-4e44-a955-c56f0f8ada85] Received event network-vif-plugged-a47c7541-2bcf-4288-a237-90e2b1439d20 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 10:25:10 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-cd926477-10bb-44a1-b318-e62bdadaddb6 req-d4e2e366-2fb0-4f52-a46c-cd34c9ea513b service nova] Acquiring lock "b09bd69f-531c-4e44-a955-c56f0f8ada85-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:25:10 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-cd926477-10bb-44a1-b318-e62bdadaddb6 req-d4e2e366-2fb0-4f52-a46c-cd34c9ea513b service nova] Lock "b09bd69f-531c-4e44-a955-c56f0f8ada85-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:25:10 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-cd926477-10bb-44a1-b318-e62bdadaddb6 req-d4e2e366-2fb0-4f52-a46c-cd34c9ea513b service nova] Lock "b09bd69f-531c-4e44-a955-c56f0f8ada85-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:25:10 user nova-compute[75229]: DEBUG nova.compute.manager [req-cd926477-10bb-44a1-b318-e62bdadaddb6 req-d4e2e366-2fb0-4f52-a46c-cd34c9ea513b service nova] [instance: b09bd69f-531c-4e44-a955-c56f0f8ada85] No waiting events found dispatching network-vif-plugged-a47c7541-2bcf-4288-a237-90e2b1439d20 {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 10:25:10 user nova-compute[75229]: WARNING nova.compute.manager [req-cd926477-10bb-44a1-b318-e62bdadaddb6 req-d4e2e366-2fb0-4f52-a46c-cd34c9ea513b service nova] [instance: b09bd69f-531c-4e44-a955-c56f0f8ada85] Received unexpected event network-vif-plugged-a47c7541-2bcf-4288-a237-90e2b1439d20 for instance with vm_state building and task_state spawning.
Nov 14 10:25:11 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:25:11 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:25:11 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:25:11 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:25:12 user nova-compute[75229]: DEBUG nova.compute.manager [None req-2fcf96e1-edcc-41ae-8e7c-32649f8202e1 tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] [instance: b09bd69f-531c-4e44-a955-c56f0f8ada85] Instance event wait completed in 0 seconds for  {{(pid=75229) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 10:25:12 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-2fcf96e1-edcc-41ae-8e7c-32649f8202e1 tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] [instance: b09bd69f-531c-4e44-a955-c56f0f8ada85] Guest created on hypervisor {{(pid=75229) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 10:25:12 user nova-compute[75229]: INFO nova.virt.libvirt.driver [-] [instance: b09bd69f-531c-4e44-a955-c56f0f8ada85] Instance spawned successfully.
Nov 14 10:25:12 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-2fcf96e1-edcc-41ae-8e7c-32649f8202e1 tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] [instance: b09bd69f-531c-4e44-a955-c56f0f8ada85] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 10:25:12 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-2fcf96e1-edcc-41ae-8e7c-32649f8202e1 tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] [instance: b09bd69f-531c-4e44-a955-c56f0f8ada85] Found default for hw_cdrom_bus of ide {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 10:25:12 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-2fcf96e1-edcc-41ae-8e7c-32649f8202e1 tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] [instance: b09bd69f-531c-4e44-a955-c56f0f8ada85] Found default for hw_disk_bus of virtio {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 10:25:12 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-2fcf96e1-edcc-41ae-8e7c-32649f8202e1 tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] [instance: b09bd69f-531c-4e44-a955-c56f0f8ada85] Found default for hw_input_bus of None {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 10:25:12 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-2fcf96e1-edcc-41ae-8e7c-32649f8202e1 tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] [instance: b09bd69f-531c-4e44-a955-c56f0f8ada85] Found default for hw_pointer_model of None {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 10:25:12 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-2fcf96e1-edcc-41ae-8e7c-32649f8202e1 tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] [instance: b09bd69f-531c-4e44-a955-c56f0f8ada85] Found default for hw_video_model of virtio {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 10:25:12 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-2fcf96e1-edcc-41ae-8e7c-32649f8202e1 tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] [instance: b09bd69f-531c-4e44-a955-c56f0f8ada85] Found default for hw_vif_model of virtio {{(pid=75229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 10:25:12 user nova-compute[75229]: INFO nova.compute.manager [None req-2fcf96e1-edcc-41ae-8e7c-32649f8202e1 tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] [instance: b09bd69f-531c-4e44-a955-c56f0f8ada85] Took 6.31 seconds to spawn the instance on the hypervisor.
Nov 14 10:25:12 user nova-compute[75229]: DEBUG nova.compute.manager [None req-2fcf96e1-edcc-41ae-8e7c-32649f8202e1 tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] [instance: b09bd69f-531c-4e44-a955-c56f0f8ada85] Checking state {{(pid=75229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 10:25:12 user nova-compute[75229]: DEBUG nova.compute.manager [req-0b3cc4c3-60a2-4282-b486-a12b336eaacf req-5e4549be-9b2c-45d4-a367-50f1032f9231 service nova] [instance: b09bd69f-531c-4e44-a955-c56f0f8ada85] Received event network-vif-plugged-a47c7541-2bcf-4288-a237-90e2b1439d20 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 10:25:12 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-0b3cc4c3-60a2-4282-b486-a12b336eaacf req-5e4549be-9b2c-45d4-a367-50f1032f9231 service nova] Acquiring lock "b09bd69f-531c-4e44-a955-c56f0f8ada85-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:25:12 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-0b3cc4c3-60a2-4282-b486-a12b336eaacf req-5e4549be-9b2c-45d4-a367-50f1032f9231 service nova] Lock "b09bd69f-531c-4e44-a955-c56f0f8ada85-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:25:12 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-0b3cc4c3-60a2-4282-b486-a12b336eaacf req-5e4549be-9b2c-45d4-a367-50f1032f9231 service nova] Lock "b09bd69f-531c-4e44-a955-c56f0f8ada85-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:25:12 user nova-compute[75229]: DEBUG nova.compute.manager [req-0b3cc4c3-60a2-4282-b486-a12b336eaacf req-5e4549be-9b2c-45d4-a367-50f1032f9231 service nova] [instance: b09bd69f-531c-4e44-a955-c56f0f8ada85] No waiting events found dispatching network-vif-plugged-a47c7541-2bcf-4288-a237-90e2b1439d20 {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 10:25:12 user nova-compute[75229]: WARNING nova.compute.manager [req-0b3cc4c3-60a2-4282-b486-a12b336eaacf req-5e4549be-9b2c-45d4-a367-50f1032f9231 service nova] [instance: b09bd69f-531c-4e44-a955-c56f0f8ada85] Received unexpected event network-vif-plugged-a47c7541-2bcf-4288-a237-90e2b1439d20 for instance with vm_state building and task_state spawning.
Nov 14 10:25:12 user nova-compute[75229]: INFO nova.compute.manager [None req-2fcf96e1-edcc-41ae-8e7c-32649f8202e1 tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] [instance: b09bd69f-531c-4e44-a955-c56f0f8ada85] Took 6.91 seconds to build instance.
Nov 14 10:25:12 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-2fcf96e1-edcc-41ae-8e7c-32649f8202e1 tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] Lock "b09bd69f-531c-4e44-a955-c56f0f8ada85" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.056s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:25:13 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:25:14 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:25:17 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:25:17 user nova-compute[75229]: DEBUG nova.compute.manager [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Starting heal instance info cache {{(pid=75229) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 10:25:17 user nova-compute[75229]: DEBUG nova.compute.manager [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Rebuilding the list of instances to heal {{(pid=75229) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 10:25:17 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Acquiring lock "refresh_cache-b09bd69f-531c-4e44-a955-c56f0f8ada85" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 10:25:17 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Acquired lock "refresh_cache-b09bd69f-531c-4e44-a955-c56f0f8ada85" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 10:25:17 user nova-compute[75229]: DEBUG nova.network.neutron [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] [instance: b09bd69f-531c-4e44-a955-c56f0f8ada85] Forcefully refreshing network info cache for instance {{(pid=75229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 10:25:17 user nova-compute[75229]: DEBUG nova.objects.instance [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Lazy-loading 'info_cache' on Instance uuid b09bd69f-531c-4e44-a955-c56f0f8ada85 {{(pid=75229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 10:25:18 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:25:18 user nova-compute[75229]: DEBUG nova.network.neutron [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] [instance: b09bd69f-531c-4e44-a955-c56f0f8ada85] Updating instance_info_cache with network_info: [{"id": "a47c7541-2bcf-4288-a237-90e2b1439d20", "address": "fa:16:3e:8a:62:dc", "network": {"id": "faebf0c9-ac3b-4877-b8c0-683ac8c6952d", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1933420959-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "91aa3be89afe4855b8918caa5fc35e47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa47c7541-2b", "ovs_interfaceid": "a47c7541-2bcf-4288-a237-90e2b1439d20", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 10:25:18 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Releasing lock "refresh_cache-b09bd69f-531c-4e44-a955-c56f0f8ada85" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 10:25:18 user nova-compute[75229]: DEBUG nova.compute.manager [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] [instance: b09bd69f-531c-4e44-a955-c56f0f8ada85] Updated the network info_cache for instance {{(pid=75229) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 10:25:19 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:25:20 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:25:23 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:25:23 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:25:23 user nova-compute[75229]: DEBUG nova.compute.manager [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75229) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 10:25:23 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 10:25:23 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:25:23 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75229) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 10:25:23 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75229) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 10:25:23 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75229) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 10:25:23 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:25:24 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:25:26 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:25:26 user nova-compute[75229]: DEBUG nova.compute.manager [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Cleaning up deleted instances {{(pid=75229) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 14 10:25:26 user nova-compute[75229]: DEBUG nova.compute.manager [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] There are 0 instances to clean {{(pid=75229) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 14 10:25:27 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:25:28 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:25:28 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:25:28 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:25:28 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:25:28 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:25:28 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Auditing locally available compute resources for user (node: user) {{(pid=75229) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 10:25:28 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:25:28 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b09bd69f-531c-4e44-a955-c56f0f8ada85/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:25:29 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b09bd69f-531c-4e44-a955-c56f0f8ada85/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:25:29 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b09bd69f-531c-4e44-a955-c56f0f8ada85/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:25:29 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b09bd69f-531c-4e44-a955-c56f0f8ada85/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:25:29 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:25:29 user nova-compute[75229]: WARNING nova.virt.libvirt.driver [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 10:25:29 user nova-compute[75229]: WARNING nova.virt.libvirt.driver [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 10:25:29 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Hypervisor/Node resource view: name=user free_ram=8914MB free_disk=25.115142822265625GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75229) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 10:25:29 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:25:29 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:25:29 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Instance b09bd69f-531c-4e44-a955-c56f0f8ada85 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 10:25:29 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75229) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 10:25:29 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75229) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 10:25:29 user nova-compute[75229]: DEBUG nova.scheduler.client.report [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Refreshing inventories for resource provider d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 {{(pid=75229) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 14 10:25:29 user nova-compute[75229]: DEBUG nova.scheduler.client.report [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Updating ProviderTree inventory for provider d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75229) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 14 10:25:29 user nova-compute[75229]: DEBUG nova.compute.provider_tree [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Updating inventory in ProviderTree for provider d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 14 10:25:29 user nova-compute[75229]: DEBUG nova.scheduler.client.report [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Refreshing aggregate associations for resource provider d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3, aggregates: None {{(pid=75229) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 14 10:25:30 user nova-compute[75229]: DEBUG nova.scheduler.client.report [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Refreshing trait associations for resource provider d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3, traits: COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_MMX,HW_CPU_X86_SSE42,HW_CPU_X86_SSSE3,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_TRUSTED_CERTS,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSE,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_USB,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_RESCUE_BFV {{(pid=75229) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 14 10:25:30 user nova-compute[75229]: DEBUG nova.compute.provider_tree [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Inventory has not changed in ProviderTree for provider: d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 {{(pid=75229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 10:25:30 user nova-compute[75229]: DEBUG nova.scheduler.client.report [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Inventory has not changed for provider d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 10:25:30 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Compute_service record updated for user:user {{(pid=75229) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 10:25:30 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.540s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:25:31 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:25:33 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:25:33 user nova-compute[75229]: DEBUG nova.compute.manager [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75229) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 14 10:25:33 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:25:34 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:25:38 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:25:39 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:25:42 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:25:43 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:25:44 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:25:48 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:25:53 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 10:25:58 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:26:03 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 10:26:08 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 10:26:08 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:26:08 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75229) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 10:26:08 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75229) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 10:26:08 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75229) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 10:26:08 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:26:13 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 10:26:13 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:26:13 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75229) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 10:26:13 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75229) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 10:26:13 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75229) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 10:26:13 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:26:18 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:26:18 user nova-compute[75229]: DEBUG nova.compute.manager [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Starting heal instance info cache {{(pid=75229) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 10:26:18 user nova-compute[75229]: DEBUG nova.compute.manager [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Rebuilding the list of instances to heal {{(pid=75229) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 10:26:18 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Acquiring lock "refresh_cache-b09bd69f-531c-4e44-a955-c56f0f8ada85" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 10:26:18 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Acquired lock "refresh_cache-b09bd69f-531c-4e44-a955-c56f0f8ada85" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 10:26:18 user nova-compute[75229]: DEBUG nova.network.neutron [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] [instance: b09bd69f-531c-4e44-a955-c56f0f8ada85] Forcefully refreshing network info cache for instance {{(pid=75229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 10:26:18 user nova-compute[75229]: DEBUG nova.objects.instance [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Lazy-loading 'info_cache' on Instance uuid b09bd69f-531c-4e44-a955-c56f0f8ada85 {{(pid=75229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 10:26:18 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 10:26:18 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:26:18 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75229) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 10:26:18 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75229) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 10:26:18 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75229) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 10:26:18 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:26:19 user nova-compute[75229]: DEBUG nova.network.neutron [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] [instance: b09bd69f-531c-4e44-a955-c56f0f8ada85] Updating instance_info_cache with network_info: [{"id": "a47c7541-2bcf-4288-a237-90e2b1439d20", "address": "fa:16:3e:8a:62:dc", "network": {"id": "faebf0c9-ac3b-4877-b8c0-683ac8c6952d", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1933420959-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "91aa3be89afe4855b8918caa5fc35e47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa47c7541-2b", "ovs_interfaceid": "a47c7541-2bcf-4288-a237-90e2b1439d20", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 10:26:19 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Releasing lock "refresh_cache-b09bd69f-531c-4e44-a955-c56f0f8ada85" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 10:26:19 user nova-compute[75229]: DEBUG nova.compute.manager [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] [instance: b09bd69f-531c-4e44-a955-c56f0f8ada85] Updated the network info_cache for instance {{(pid=75229) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 10:26:19 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:26:21 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:26:23 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:26:24 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:26:24 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:26:24 user nova-compute[75229]: DEBUG nova.compute.manager [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75229) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 10:26:28 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:26:28 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:26:28 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:26:28 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:26:28 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Auditing locally available compute resources for user (node: user) {{(pid=75229) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 10:26:28 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b09bd69f-531c-4e44-a955-c56f0f8ada85/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:26:28 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:26:28 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b09bd69f-531c-4e44-a955-c56f0f8ada85/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:26:28 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b09bd69f-531c-4e44-a955-c56f0f8ada85/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:26:29 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b09bd69f-531c-4e44-a955-c56f0f8ada85/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:26:29 user nova-compute[75229]: WARNING nova.virt.libvirt.driver [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 10:26:29 user nova-compute[75229]: WARNING nova.virt.libvirt.driver [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 10:26:29 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Hypervisor/Node resource view: name=user free_ram=9047MB free_disk=25.112689971923828GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75229) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 10:26:29 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:26:29 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:26:29 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Instance b09bd69f-531c-4e44-a955-c56f0f8ada85 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 10:26:29 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75229) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 10:26:29 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75229) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 10:26:29 user nova-compute[75229]: DEBUG nova.compute.provider_tree [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Inventory has not changed in ProviderTree for provider: d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 {{(pid=75229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 10:26:29 user nova-compute[75229]: DEBUG nova.scheduler.client.report [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Inventory has not changed for provider d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 10:26:29 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Compute_service record updated for user:user {{(pid=75229) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 10:26:29 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.174s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:26:30 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:26:30 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:26:31 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:26:33 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 10:26:33 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:26:33 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75229) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 10:26:33 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75229) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 10:26:33 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75229) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 10:26:33 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:26:38 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 10:26:42 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:26:43 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 10:26:48 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 10:26:53 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 10:26:56 user nova-compute[75229]: DEBUG nova.compute.manager [req-e3a5e1fe-2413-41e4-8362-5c5595789dca req-2c2465d3-8cd4-467b-b8b3-97e199fdc774 service nova] [instance: b09bd69f-531c-4e44-a955-c56f0f8ada85] Received event network-changed-a47c7541-2bcf-4288-a237-90e2b1439d20 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 10:26:56 user nova-compute[75229]: DEBUG nova.compute.manager [req-e3a5e1fe-2413-41e4-8362-5c5595789dca req-2c2465d3-8cd4-467b-b8b3-97e199fdc774 service nova] [instance: b09bd69f-531c-4e44-a955-c56f0f8ada85] Refreshing instance network info cache due to event network-changed-a47c7541-2bcf-4288-a237-90e2b1439d20. {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 10:26:56 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-e3a5e1fe-2413-41e4-8362-5c5595789dca req-2c2465d3-8cd4-467b-b8b3-97e199fdc774 service nova] Acquiring lock "refresh_cache-b09bd69f-531c-4e44-a955-c56f0f8ada85" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 10:26:56 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-e3a5e1fe-2413-41e4-8362-5c5595789dca req-2c2465d3-8cd4-467b-b8b3-97e199fdc774 service nova] Acquired lock "refresh_cache-b09bd69f-531c-4e44-a955-c56f0f8ada85" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 10:26:56 user nova-compute[75229]: DEBUG nova.network.neutron [req-e3a5e1fe-2413-41e4-8362-5c5595789dca req-2c2465d3-8cd4-467b-b8b3-97e199fdc774 service nova] [instance: b09bd69f-531c-4e44-a955-c56f0f8ada85] Refreshing network info cache for port a47c7541-2bcf-4288-a237-90e2b1439d20 {{(pid=75229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 10:26:57 user nova-compute[75229]: DEBUG nova.network.neutron [req-e3a5e1fe-2413-41e4-8362-5c5595789dca req-2c2465d3-8cd4-467b-b8b3-97e199fdc774 service nova] [instance: b09bd69f-531c-4e44-a955-c56f0f8ada85] Updated VIF entry in instance network info cache for port a47c7541-2bcf-4288-a237-90e2b1439d20. {{(pid=75229) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 10:26:57 user nova-compute[75229]: DEBUG nova.network.neutron [req-e3a5e1fe-2413-41e4-8362-5c5595789dca req-2c2465d3-8cd4-467b-b8b3-97e199fdc774 service nova] [instance: b09bd69f-531c-4e44-a955-c56f0f8ada85] Updating instance_info_cache with network_info: [{"id": "a47c7541-2bcf-4288-a237-90e2b1439d20", "address": "fa:16:3e:8a:62:dc", "network": {"id": "faebf0c9-ac3b-4877-b8c0-683ac8c6952d", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1933420959-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "91aa3be89afe4855b8918caa5fc35e47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa47c7541-2b", "ovs_interfaceid": "a47c7541-2bcf-4288-a237-90e2b1439d20", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 10:26:57 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-e3a5e1fe-2413-41e4-8362-5c5595789dca req-2c2465d3-8cd4-467b-b8b3-97e199fdc774 service nova] Releasing lock "refresh_cache-b09bd69f-531c-4e44-a955-c56f0f8ada85" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 10:26:58 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 10:26:58 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:26:58 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75229) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 10:26:58 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75229) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 10:26:58 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75229) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 10:26:58 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:26:59 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-ae001ea1-80cf-4000-86ed-1604c3fce50c tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] Acquiring lock "b09bd69f-531c-4e44-a955-c56f0f8ada85" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:26:59 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-ae001ea1-80cf-4000-86ed-1604c3fce50c tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] Lock "b09bd69f-531c-4e44-a955-c56f0f8ada85" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:26:59 user nova-compute[75229]: DEBUG nova.objects.instance [None req-ae001ea1-80cf-4000-86ed-1604c3fce50c tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] Lazy-loading 'flavor' on Instance uuid b09bd69f-531c-4e44-a955-c56f0f8ada85 {{(pid=75229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 10:26:59 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-ae001ea1-80cf-4000-86ed-1604c3fce50c tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] Lock "b09bd69f-531c-4e44-a955-c56f0f8ada85" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:26:59 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:26:59 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-ae001ea1-80cf-4000-86ed-1604c3fce50c tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] Acquiring lock "b09bd69f-531c-4e44-a955-c56f0f8ada85" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:26:59 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-ae001ea1-80cf-4000-86ed-1604c3fce50c tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] Lock "b09bd69f-531c-4e44-a955-c56f0f8ada85" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:26:59 user nova-compute[75229]: INFO nova.compute.manager [None req-ae001ea1-80cf-4000-86ed-1604c3fce50c tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] [instance: b09bd69f-531c-4e44-a955-c56f0f8ada85] Attaching volume 43e75e20-7b7e-4e6f-85e2-77367b69c5a3 to /dev/vdb
Nov 14 10:26:59 user nova-compute[75229]: DEBUG os_brick.utils [None req-ae001ea1-80cf-4000-86ed-1604c3fce50c tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 10:26:59 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:26:59 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:26:59 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d446547-bcfb-4019-99e3-7691c401dc4a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f1154031c835\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:26:59 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:26:59 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:26:59 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[1686e866-05fe-4285-83a9-627f3653446e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:26:59 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:26:59 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:26:59 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[3af0e473-d5a2-4235-aca7-61a5d8a9361c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:26:59 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[8de0f990-55e1-4724-950d-105d7a2f7759]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:26:59 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-ae001ea1-80cf-4000-86ed-1604c3fce50c tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] Running cmd (subprocess): nvme version {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:26:59 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-ae001ea1-80cf-4000-86ed-1604c3fce50c tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] 'nvme version' failed. Not Retrying. {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 10:26:59 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ae001ea1-80cf-4000-86ed-1604c3fce50c tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] nvme not present on system {{(pid=75229) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 10:26:59 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:26:59 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 10:26:59 user nova-compute[75229]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 10:26:59 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[361cc564-9c4f-41c4-aef7-7db938bb0824]: (4, '') {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:26:59 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.lightos [None req-ae001ea1-80cf-4000-86ed-1604c3fce50c tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75229) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 10:26:59 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.lightos [None req-ae001ea1-80cf-4000-86ed-1604c3fce50c tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75229) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 10:26:59 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.lightos [None req-ae001ea1-80cf-4000-86ed-1604c3fce50c tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] LIGHTOS: no hostnqn found. {{(pid=75229) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 10:26:59 user nova-compute[75229]: DEBUG os_brick.utils [None req-ae001ea1-80cf-4000-86ed-1604c3fce50c tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f1154031c835', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 10:26:59 user nova-compute[75229]: DEBUG nova.virt.block_device [None req-ae001ea1-80cf-4000-86ed-1604c3fce50c tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] [instance: b09bd69f-531c-4e44-a955-c56f0f8ada85] Updating existing volume attachment record: ba6ea5dc-50bb-48e1-b570-27b43d44495e {{(pid=75229) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 10:27:03 user nova-compute[75229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ae001ea1-80cf-4000-86ed-1604c3fce50c tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] [instance: b09bd69f-531c-4e44-a955-c56f0f8ada85] Calling os-brick to attach iSCSI Volume {{(pid=75229) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 10:27:03 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae001ea1-80cf-4000-86ed-1604c3fce50c tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f73f85151b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:43e75e20-7b7e-4e6f-85e2-77367b69c5a3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LAYWlSNm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 10:27:03 user nova-compute[75229]: WARNING os_brick.initiator.connectors.base [None req-ae001ea1-80cf-4000-86ed-1604c3fce50c tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 10:27:03 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-ae001ea1-80cf-4000-86ed-1604c3fce50c tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 10:27:03 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-ae001ea1-80cf-4000-86ed-1604c3fce50c tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 10:27:03 user nova-compute[75229]: WARNING os_brick.initiator.connectors.base [None req-ae001ea1-80cf-4000-86ed-1604c3fce50c tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 10:27:03 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-ae001ea1-80cf-4000-86ed-1604c3fce50c tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:43e75e20-7b7e-4e6f-85e2-77367b69c5a3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 10:27:03 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-ae001ea1-80cf-4000-86ed-1604c3fce50c tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:43e75e20-7b7e-4e6f-85e2-77367b69c5a3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 10:27:03 user nova-compute[75229]: INFO os_brick.initiator.connectors.iscsi [None req-ae001ea1-80cf-4000-86ed-1604c3fce50c tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 10:27:03 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43e75e20-7b7e-4e6f-85e2-77367b69c5a3 -p 172.16.0.220:3260 {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:27:03 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43e75e20-7b7e-4e6f-85e2-77367b69c5a3 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:27:03 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e3d0cfc-d5b1-49b7-908e-f713b61be883]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:27:03 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae001ea1-80cf-4000-86ed-1604c3fce50c tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 10:27:03 user nova-compute[75229]:  {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 10:27:03 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43e75e20-7b7e-4e6f-85e2-77367b69c5a3 -p 172.16.0.220:3260 --interface default --op new {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:27:03 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43e75e20-7b7e-4e6f-85e2-77367b69c5a3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:27:03 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f6ca1fb-baa1-417e-93be-54403be7d9d1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:43e75e20-7b7e-4e6f-85e2-77367b69c5a3] added\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:27:03 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae001ea1-80cf-4000-86ed-1604c3fce50c tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:43e75e20-7b7e-4e6f-85e2-77367b69c5a3] added
Nov 14 10:27:03 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 10:27:03 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43e75e20-7b7e-4e6f-85e2-77367b69c5a3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:27:03 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43e75e20-7b7e-4e6f-85e2-77367b69c5a3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:27:03 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf24a47e-78ab-444a-83cf-2f9e196d14da]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:27:03 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae001ea1-80cf-4000-86ed-1604c3fce50c tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 10:27:03 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43e75e20-7b7e-4e6f-85e2-77367b69c5a3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:27:03 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43e75e20-7b7e-4e6f-85e2-77367b69c5a3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:27:03 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[a779eed2-58a5-4fed-8a54-19db031a12db]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:27:03 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae001ea1-80cf-4000-86ed-1604c3fce50c tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 10:27:03 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43e75e20-7b7e-4e6f-85e2-77367b69c5a3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LAYWlSNm {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:27:03 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43e75e20-7b7e-4e6f-85e2-77367b69c5a3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LAYWlSNm" returned: 0 in 0.025s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:27:03 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[67044ef5-1f1f-4e45-b5ee-0f767962bade]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:27:03 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae001ea1-80cf-4000-86ed-1604c3fce50c tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LAYWlSNm'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 10:27:03 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43e75e20-7b7e-4e6f-85e2-77367b69c5a3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:27:03 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43e75e20-7b7e-4e6f-85e2-77367b69c5a3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:27:03 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e9a117d-cc6a-4483-9354-bf600f32d608]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:27:03 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae001ea1-80cf-4000-86ed-1604c3fce50c tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 10:27:03 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:27:03 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:27:03 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a088b1b-b919-468e-a5b3-dbfa6da2c5e0]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:27:03 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae001ea1-80cf-4000-86ed-1604c3fce50c tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 14 10:27:03 user nova-compute[75229]:  {{(pid=75229) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 10:27:03 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae001ea1-80cf-4000-86ed-1604c3fce50c tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 14 10:27:03 user nova-compute[75229]:  {{(pid=75229) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 10:27:03 user nova-compute[75229]: WARNING os_brick.initiator.connectors.iscsi [None req-ae001ea1-80cf-4000-86ed-1604c3fce50c tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 14 10:27:03 user nova-compute[75229]: 
Nov 14 10:27:03 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43e75e20-7b7e-4e6f-85e2-77367b69c5a3 -p 172.16.0.220:3260 --login {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:27:03 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:27:03 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43e75e20-7b7e-4e6f-85e2-77367b69c5a3 -p 172.16.0.220:3260 --login" returned: 0 in 0.046s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:27:03 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7739245-a9e2-4dd3-9cf8-55e1b11264d8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:43e75e20-7b7e-4e6f-85e2-77367b69c5a3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:43e75e20-7b7e-4e6f-85e2-77367b69c5a3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:27:03 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae001ea1-80cf-4000-86ed-1604c3fce50c tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:43e75e20-7b7e-4e6f-85e2-77367b69c5a3, portal: 172.16.0.220,3260]
Nov 14 10:27:03 user nova-compute[75229]: Login to [iface: default, target: iqn.2010-10.org.openstack:43e75e20-7b7e-4e6f-85e2-77367b69c5a3, portal: 172.16.0.220,3260] successful.
Nov 14 10:27:03 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 10:27:03 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43e75e20-7b7e-4e6f-85e2-77367b69c5a3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:27:03 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43e75e20-7b7e-4e6f-85e2-77367b69c5a3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:27:03 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9fc718d-b7f8-4bfc-b1c9-24eea31df8bf]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:27:03 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae001ea1-80cf-4000-86ed-1604c3fce50c tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 10:27:03 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:27:03 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:27:03 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f796d6e-4e85-4886-bb5d-b1ed44257ba7]: (4, ('tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43e75e20-7b7e-4e6f-85e2-77367b69c5a3 (non-flash)\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:27:03 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae001ea1-80cf-4000-86ed-1604c3fce50c tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43e75e20-7b7e-4e6f-85e2-77367b69c5a3 (non-flash)
Nov 14 10:27:03 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 10:27:03 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae001ea1-80cf-4000-86ed-1604c3fce50c tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] iscsi session list stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43e75e20-7b7e-4e6f-85e2-77367b69c5a3 (non-flash)
Nov 14 10:27:03 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 10:27:03 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-ae001ea1-80cf-4000-86ed-1604c3fce50c tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:43e75e20-7b7e-4e6f-85e2-77367b69c5a3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.263s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 10:27:03 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae001ea1-80cf-4000-86ed-1604c3fce50c tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] Connected to 172.16.0.220:3260 {{(pid=75229) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 10:27:03 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-ae001ea1-80cf-4000-86ed-1604c3fce50c tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] HCTL ('33', '-', '-', 0) found on session 67 with lun 0 {{(pid=75229) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 10:27:03 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-ae001ea1-80cf-4000-86ed-1604c3fce50c tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75229) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 10:27:03 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:27:03 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.024s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:27:03 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d187ad2-e06d-4598-8b1d-0cd0b6595774]: (4, ('- - 0', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:27:03 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-ae001ea1-80cf-4000-86ed-1604c3fce50c tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] Searching for a device in session 67 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75229) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 10:27:03 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae001ea1-80cf-4000-86ed-1604c3fce50c tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:43e75e20-7b7e-4e6f-85e2-77367b69c5a3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LAYWlSNm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75229) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 10:27:04 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:27:04 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-ae001ea1-80cf-4000-86ed-1604c3fce50c tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.301s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 10:27:04 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae001ea1-80cf-4000-86ed-1604c3fce50c tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] <== connect_volume: return (1304ms) {'type': 'block', 'scsi_wwn': '26530303438666564', 'path': '/dev/sdb'} {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 10:27:04 user nova-compute[75229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ae001ea1-80cf-4000-86ed-1604c3fce50c tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] [instance: b09bd69f-531c-4e44-a955-c56f0f8ada85] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26530303438666564', 'path': '/dev/sdb'} {{(pid=75229) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 10:27:04 user nova-compute[75229]: DEBUG nova.objects.instance [None req-ae001ea1-80cf-4000-86ed-1604c3fce50c tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] Lazy-loading 'flavor' on Instance uuid b09bd69f-531c-4e44-a955-c56f0f8ada85 {{(pid=75229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 10:27:04 user nova-compute[75229]: DEBUG nova.virt.libvirt.guest [None req-ae001ea1-80cf-4000-86ed-1604c3fce50c tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 10:27:04 user nova-compute[75229]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 10:27:04 user nova-compute[75229]:   <source dev="/dev/sdb"/>
Nov 14 10:27:04 user nova-compute[75229]:   <target dev="vdb" bus="virtio"/>
Nov 14 10:27:04 user nova-compute[75229]:   <serial>43e75e20-7b7e-4e6f-85e2-77367b69c5a3</serial>
Nov 14 10:27:04 user nova-compute[75229]: </disk>
Nov 14 10:27:04 user nova-compute[75229]:  {{(pid=75229) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 10:27:05 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-ae001ea1-80cf-4000-86ed-1604c3fce50c tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] No BDM found with device name vda, not building metadata. {{(pid=75229) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 10:27:05 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-ae001ea1-80cf-4000-86ed-1604c3fce50c tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75229) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 10:27:05 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-ae001ea1-80cf-4000-86ed-1604c3fce50c tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] No VIF found with MAC fa:16:3e:8a:62:dc, not building metadata {{(pid=75229) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 10:27:05 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-ae001ea1-80cf-4000-86ed-1604c3fce50c tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] Lock "b09bd69f-531c-4e44-a955-c56f0f8ada85" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.056s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:27:08 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:27:09 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:27:13 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-e1f2d749-77d8-46f3-abe6-6a70bbbe553b tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] Acquiring lock "b09bd69f-531c-4e44-a955-c56f0f8ada85" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:27:13 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-e1f2d749-77d8-46f3-abe6-6a70bbbe553b tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] Lock "b09bd69f-531c-4e44-a955-c56f0f8ada85" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:27:13 user nova-compute[75229]: INFO nova.compute.manager [None req-e1f2d749-77d8-46f3-abe6-6a70bbbe553b tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] [instance: b09bd69f-531c-4e44-a955-c56f0f8ada85] Detaching volume 43e75e20-7b7e-4e6f-85e2-77367b69c5a3
Nov 14 10:27:13 user nova-compute[75229]: INFO nova.virt.block_device [None req-e1f2d749-77d8-46f3-abe6-6a70bbbe553b tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] [instance: b09bd69f-531c-4e44-a955-c56f0f8ada85] Attempting to driver detach volume 43e75e20-7b7e-4e6f-85e2-77367b69c5a3 from mountpoint /dev/vdb
Nov 14 10:27:13 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-e1f2d749-77d8-46f3-abe6-6a70bbbe553b tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] Attempting to detach device vdb from instance b09bd69f-531c-4e44-a955-c56f0f8ada85 from the persistent domain config. {{(pid=75229) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 10:27:13 user nova-compute[75229]: DEBUG nova.virt.libvirt.guest [None req-e1f2d749-77d8-46f3-abe6-6a70bbbe553b tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 10:27:13 user nova-compute[75229]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 10:27:13 user nova-compute[75229]:   <source dev="/dev/sdb"/>
Nov 14 10:27:13 user nova-compute[75229]:   <target dev="vdb" bus="virtio"/>
Nov 14 10:27:13 user nova-compute[75229]:   <serial>43e75e20-7b7e-4e6f-85e2-77367b69c5a3</serial>
Nov 14 10:27:13 user nova-compute[75229]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 10:27:13 user nova-compute[75229]: </disk>
Nov 14 10:27:13 user nova-compute[75229]:  {{(pid=75229) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 10:27:13 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-e1f2d749-77d8-46f3-abe6-6a70bbbe553b tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] Successfully detached device vdb from instance b09bd69f-531c-4e44-a955-c56f0f8ada85 from the persistent domain config.
Nov 14 10:27:13 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-e1f2d749-77d8-46f3-abe6-6a70bbbe553b tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance b09bd69f-531c-4e44-a955-c56f0f8ada85 from the live domain config. {{(pid=75229) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 10:27:13 user nova-compute[75229]: DEBUG nova.virt.libvirt.guest [None req-e1f2d749-77d8-46f3-abe6-6a70bbbe553b tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 10:27:13 user nova-compute[75229]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 10:27:13 user nova-compute[75229]:   <source dev="/dev/sdb"/>
Nov 14 10:27:13 user nova-compute[75229]:   <target dev="vdb" bus="virtio"/>
Nov 14 10:27:13 user nova-compute[75229]:   <serial>43e75e20-7b7e-4e6f-85e2-77367b69c5a3</serial>
Nov 14 10:27:13 user nova-compute[75229]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 10:27:13 user nova-compute[75229]: </disk>
Nov 14 10:27:13 user nova-compute[75229]:  {{(pid=75229) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 10:27:13 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-e1f2d749-77d8-46f3-abe6-6a70bbbe553b tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance b09bd69f-531c-4e44-a955-c56f0f8ada85 {{(pid=75229) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 10:27:13 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:27:14 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:27:18 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:27:18 user nova-compute[75229]: DEBUG nova.compute.manager [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Starting heal instance info cache {{(pid=75229) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 10:27:18 user nova-compute[75229]: DEBUG nova.compute.manager [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Rebuilding the list of instances to heal {{(pid=75229) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 10:27:18 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Acquiring lock "refresh_cache-b09bd69f-531c-4e44-a955-c56f0f8ada85" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 10:27:18 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Acquired lock "refresh_cache-b09bd69f-531c-4e44-a955-c56f0f8ada85" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 10:27:18 user nova-compute[75229]: DEBUG nova.network.neutron [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] [instance: b09bd69f-531c-4e44-a955-c56f0f8ada85] Forcefully refreshing network info cache for instance {{(pid=75229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 10:27:18 user nova-compute[75229]: DEBUG nova.objects.instance [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Lazy-loading 'info_cache' on Instance uuid b09bd69f-531c-4e44-a955-c56f0f8ada85 {{(pid=75229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 10:27:18 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:27:19 user nova-compute[75229]: DEBUG nova.network.neutron [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] [instance: b09bd69f-531c-4e44-a955-c56f0f8ada85] Updating instance_info_cache with network_info: [{"id": "a47c7541-2bcf-4288-a237-90e2b1439d20", "address": "fa:16:3e:8a:62:dc", "network": {"id": "faebf0c9-ac3b-4877-b8c0-683ac8c6952d", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1933420959-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "91aa3be89afe4855b8918caa5fc35e47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa47c7541-2b", "ovs_interfaceid": "a47c7541-2bcf-4288-a237-90e2b1439d20", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 10:27:19 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Releasing lock "refresh_cache-b09bd69f-531c-4e44-a955-c56f0f8ada85" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 10:27:19 user nova-compute[75229]: DEBUG nova.compute.manager [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] [instance: b09bd69f-531c-4e44-a955-c56f0f8ada85] Updated the network info_cache for instance {{(pid=75229) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 10:27:21 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:27:22 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:27:23 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 10:27:24 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:27:24 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:27:24 user nova-compute[75229]: DEBUG nova.compute.manager [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75229) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 10:27:28 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:27:28 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:27:28 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:27:28 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:27:28 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Auditing locally available compute resources for user (node: user) {{(pid=75229) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 10:27:28 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b09bd69f-531c-4e44-a955-c56f0f8ada85/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:27:28 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 10:27:28 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b09bd69f-531c-4e44-a955-c56f0f8ada85/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:27:28 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b09bd69f-531c-4e44-a955-c56f0f8ada85/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:27:29 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b09bd69f-531c-4e44-a955-c56f0f8ada85/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:27:29 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:27:29 user nova-compute[75229]: WARNING nova.virt.libvirt.driver [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 10:27:29 user nova-compute[75229]: WARNING nova.virt.libvirt.driver [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 10:27:29 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Hypervisor/Node resource view: name=user free_ram=9022MB free_disk=25.111446380615234GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75229) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 10:27:29 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:27:29 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:27:29 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Instance b09bd69f-531c-4e44-a955-c56f0f8ada85 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 10:27:29 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75229) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 10:27:29 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75229) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 10:27:29 user nova-compute[75229]: DEBUG nova.compute.provider_tree [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Inventory has not changed in ProviderTree for provider: d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 {{(pid=75229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 10:27:29 user nova-compute[75229]: DEBUG nova.scheduler.client.report [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Inventory has not changed for provider d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 10:27:29 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Compute_service record updated for user:user {{(pid=75229) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 10:27:29 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.191s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:27:31 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:27:31 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:27:32 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:27:33 user nova-compute[75229]: WARNING nova.virt.libvirt.driver [None req-e1f2d749-77d8-46f3-abe6-6a70bbbe553b tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance b09bd69f-531c-4e44-a955-c56f0f8ada85 is timed out.
Nov 14 10:27:33 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-e1f2d749-77d8-46f3-abe6-6a70bbbe553b tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] Successfully detached device vdb from instance b09bd69f-531c-4e44-a955-c56f0f8ada85 from the live domain config.
Nov 14 10:27:33 user nova-compute[75229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e1f2d749-77d8-46f3-abe6-6a70bbbe553b tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] [instance: b09bd69f-531c-4e44-a955-c56f0f8ada85] calling os-brick to detach iSCSI Volume {{(pid=75229) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 10:27:33 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1f2d749-77d8-46f3-abe6-6a70bbbe553b tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f73f85151b0>, {'target_iqn': 'iqn.2010-10.org.openstack:43e75e20-7b7e-4e6f-85e2-77367b69c5a3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LAYWlSNm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 10:27:33 user nova-compute[75229]: WARNING os_brick.initiator.connectors.base [None req-e1f2d749-77d8-46f3-abe6-6a70bbbe553b tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 10:27:33 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-e1f2d749-77d8-46f3-abe6-6a70bbbe553b tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 10:27:33 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-e1f2d749-77d8-46f3-abe6-6a70bbbe553b tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 10:27:33 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:27:33 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:27:33 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bf32aee-0f9e-4f22-8108-3c52f0fe7a9c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:43e75e20-7b7e-4e6f-85e2-77367b69c5a3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:27:33 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1f2d749-77d8-46f3-abe6-6a70bbbe553b tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 10:27:33 user nova-compute[75229]: No targets found.
Nov 14 10:27:33 user nova-compute[75229]: iSNS:
Nov 14 10:27:33 user nova-compute[75229]: No targets found.
Nov 14 10:27:33 user nova-compute[75229]: STATIC:
Nov 14 10:27:33 user nova-compute[75229]: Target: iqn.2010-10.org.openstack:43e75e20-7b7e-4e6f-85e2-77367b69c5a3
Nov 14 10:27:33 user nova-compute[75229]:         Portal: 172.16.0.220:3260,-1
Nov 14 10:27:33 user nova-compute[75229]:                 Iface Name: default
Nov 14 10:27:33 user nova-compute[75229]: FIRMWARE:
Nov 14 10:27:33 user nova-compute[75229]: No targets found.
Nov 14 10:27:33 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 10:27:33 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1f2d749-77d8-46f3-abe6-6a70bbbe553b tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 10:27:33 user nova-compute[75229]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 10:27:33 user nova-compute[75229]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75229) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 10:27:33 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1f2d749-77d8-46f3-abe6-6a70bbbe553b tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:43e75e20-7b7e-4e6f-85e2-77367b69c5a3', 0)] {{(pid=75229) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 10:27:33 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:27:33 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:27:33 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[be368f6f-2a35-4987-810c-220dfab5ffa4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:43e75e20-7b7e-4e6f-85e2-77367b69c5a3\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:27:33 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:27:33 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:27:33 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[90ad1100-0758-4a6d-b722-db243083875c]: (4, ('tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43e75e20-7b7e-4e6f-85e2-77367b69c5a3 (non-flash)\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:27:33 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1f2d749-77d8-46f3-abe6-6a70bbbe553b tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43e75e20-7b7e-4e6f-85e2-77367b69c5a3 (non-flash)
Nov 14 10:27:33 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 10:27:33 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1f2d749-77d8-46f3-abe6-6a70bbbe553b tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] iscsi session list stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43e75e20-7b7e-4e6f-85e2-77367b69c5a3 (non-flash)
Nov 14 10:27:33 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 10:27:33 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1f2d749-77d8-46f3-abe6-6a70bbbe553b tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f73f8299990>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:43e75e20-7b7e-4e6f-85e2-77367b69c5a3'): ({'sdb'}, set())}) {{(pid=75229) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 10:27:33 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-e1f2d749-77d8-46f3-abe6-6a70bbbe553b tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] Removing single pathed devices sdb {{(pid=75229) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 10:27:33 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:27:33 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:27:33 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[e269b43d-d3fc-44c8-9c0b-f43f8ae38310]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:27:33 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:27:33 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:27:33 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[9220c2c6-b3c5-4556-99aa-b541aa639a24]: (4, ('ok\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:27:33 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-e1f2d749-77d8-46f3-abe6-6a70bbbe553b tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] Flushing IO for device /dev/sdb {{(pid=75229) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 10:27:33 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:27:33 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.026s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:27:33 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bd360b9-e81b-4819-800d-34c689b9ed52]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:27:33 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-e1f2d749-77d8-46f3-abe6-6a70bbbe553b tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75229) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 10:27:33 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:27:33 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:27:33 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.048s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:27:33 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3d85ccf-1696-40f1-9e09-99c2ae5833a0]: (4, ('1', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:27:33 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-e1f2d749-77d8-46f3-abe6-6a70bbbe553b tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75229) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 10:27:33 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-e1f2d749-77d8-46f3-abe6-6a70bbbe553b tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] SCSI volumes sdb have been removed. {{(pid=75229) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 10:27:33 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1f2d749-77d8-46f3-abe6-6a70bbbe553b tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:43e75e20-7b7e-4e6f-85e2-77367b69c5a3')] {{(pid=75229) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 10:27:33 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43e75e20-7b7e-4e6f-85e2-77367b69c5a3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:27:33 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43e75e20-7b7e-4e6f-85e2-77367b69c5a3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:27:33 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[5986852f-9551-4ec1-b7a4-41fbdc58f059]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:27:33 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1f2d749-77d8-46f3-abe6-6a70bbbe553b tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 10:27:33 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43e75e20-7b7e-4e6f-85e2-77367b69c5a3 -p 172.16.0.220:3260 --logout {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:27:33 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43e75e20-7b7e-4e6f-85e2-77367b69c5a3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:27:33 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[868bdddd-5de5-47aa-8bc4-b8344368e881]: (4, ('Logging out of session [sid: 67, target: iqn.2010-10.org.openstack:43e75e20-7b7e-4e6f-85e2-77367b69c5a3, portal: 172.16.0.220,3260]\nLogout of [sid: 67, target: iqn.2010-10.org.openstack:43e75e20-7b7e-4e6f-85e2-77367b69c5a3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:27:33 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1f2d749-77d8-46f3-abe6-6a70bbbe553b tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 67, target: iqn.2010-10.org.openstack:43e75e20-7b7e-4e6f-85e2-77367b69c5a3, portal: 172.16.0.220,3260]
Nov 14 10:27:33 user nova-compute[75229]: Logout of [sid: 67, target: iqn.2010-10.org.openstack:43e75e20-7b7e-4e6f-85e2-77367b69c5a3, portal: 172.16.0.220,3260] successful.
Nov 14 10:27:33 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 10:27:33 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43e75e20-7b7e-4e6f-85e2-77367b69c5a3 -p 172.16.0.220:3260 --op delete {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:27:33 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43e75e20-7b7e-4e6f-85e2-77367b69c5a3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:27:33 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[367a6a0a-c82d-4445-9580-9a69e1c15187]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:27:33 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1f2d749-77d8-46f3-abe6-6a70bbbe553b tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 10:27:34 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-e1f2d749-77d8-46f3-abe6-6a70bbbe553b tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.300s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 10:27:34 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1f2d749-77d8-46f3-abe6-6a70bbbe553b tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] <== disconnect_volume: return (301ms) None {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 10:27:34 user nova-compute[75229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e1f2d749-77d8-46f3-abe6-6a70bbbe553b tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] [instance: b09bd69f-531c-4e44-a955-c56f0f8ada85] Disconnected iSCSI Volume {{(pid=75229) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 10:27:34 user nova-compute[75229]: DEBUG nova.objects.instance [None req-e1f2d749-77d8-46f3-abe6-6a70bbbe553b tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] Lazy-loading 'flavor' on Instance uuid b09bd69f-531c-4e44-a955-c56f0f8ada85 {{(pid=75229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 10:27:34 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-e1f2d749-77d8-46f3-abe6-6a70bbbe553b tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] Lock "b09bd69f-531c-4e44-a955-c56f0f8ada85" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.568s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:27:38 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 10:27:43 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 10:27:43 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:27:43 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75229) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 10:27:43 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75229) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 10:27:43 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75229) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 10:27:43 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 10:27:48 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 10:27:53 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 10:27:53 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:27:53 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75229) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 10:27:53 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75229) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 10:27:53 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75229) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 10:27:53 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:27:58 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 10:27:58 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:27:58 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75229) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 10:27:58 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75229) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 10:27:58 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75229) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 10:27:58 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:28:03 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:28:05 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-e9402c65-cd9c-4420-b6b7-97b3d494d135 tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] Acquiring lock "b09bd69f-531c-4e44-a955-c56f0f8ada85" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:28:05 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-e9402c65-cd9c-4420-b6b7-97b3d494d135 tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] Lock "b09bd69f-531c-4e44-a955-c56f0f8ada85" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:28:05 user nova-compute[75229]: DEBUG nova.objects.instance [None req-e9402c65-cd9c-4420-b6b7-97b3d494d135 tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] Lazy-loading 'flavor' on Instance uuid b09bd69f-531c-4e44-a955-c56f0f8ada85 {{(pid=75229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 10:28:05 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-e9402c65-cd9c-4420-b6b7-97b3d494d135 tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] Lock "b09bd69f-531c-4e44-a955-c56f0f8ada85" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.062s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:28:05 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-e9402c65-cd9c-4420-b6b7-97b3d494d135 tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] Acquiring lock "b09bd69f-531c-4e44-a955-c56f0f8ada85" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:28:05 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-e9402c65-cd9c-4420-b6b7-97b3d494d135 tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] Lock "b09bd69f-531c-4e44-a955-c56f0f8ada85" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:28:05 user nova-compute[75229]: INFO nova.compute.manager [None req-e9402c65-cd9c-4420-b6b7-97b3d494d135 tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] [instance: b09bd69f-531c-4e44-a955-c56f0f8ada85] Attaching volume e1828f03-8de0-4e40-b91f-5b681cfb9e94 to /dev/vdb
Nov 14 10:28:05 user nova-compute[75229]: DEBUG os_brick.utils [None req-e9402c65-cd9c-4420-b6b7-97b3d494d135 tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 10:28:05 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:28:05 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:28:05 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[da28e974-e147-4a0b-ad85-b29ceebc26a3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f1154031c835\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:28:05 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:28:05 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:28:05 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd721fc6-414f-4a3d-ba51-d749bb74fd72]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:28:05 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:28:05 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:28:05 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c8c3f0b-258f-47fb-8059-eb31612a261b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:28:05 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd077648-147c-478e-97c2-81d1af1bdd35]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:28:05 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-e9402c65-cd9c-4420-b6b7-97b3d494d135 tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] Running cmd (subprocess): nvme version {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:28:05 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-e9402c65-cd9c-4420-b6b7-97b3d494d135 tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] 'nvme version' failed. Not Retrying. {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 10:28:05 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e9402c65-cd9c-4420-b6b7-97b3d494d135 tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] nvme not present on system {{(pid=75229) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 10:28:05 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:28:05 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 10:28:05 user nova-compute[75229]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 10:28:05 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[16815f19-75d2-4b94-a36e-e87c9a04c8d6]: (4, '') {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:28:05 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.lightos [None req-e9402c65-cd9c-4420-b6b7-97b3d494d135 tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75229) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 10:28:05 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.lightos [None req-e9402c65-cd9c-4420-b6b7-97b3d494d135 tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75229) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 10:28:05 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.lightos [None req-e9402c65-cd9c-4420-b6b7-97b3d494d135 tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] LIGHTOS: no hostnqn found. {{(pid=75229) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 10:28:05 user nova-compute[75229]: DEBUG os_brick.utils [None req-e9402c65-cd9c-4420-b6b7-97b3d494d135 tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] <== get_connector_properties: return (115ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f1154031c835', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 10:28:05 user nova-compute[75229]: DEBUG nova.virt.block_device [None req-e9402c65-cd9c-4420-b6b7-97b3d494d135 tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] [instance: b09bd69f-531c-4e44-a955-c56f0f8ada85] Updating existing volume attachment record: e3f0ac59-2dcf-4874-9337-a064f867415a {{(pid=75229) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 10:28:08 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 10:28:09 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:28:09 user nova-compute[75229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e9402c65-cd9c-4420-b6b7-97b3d494d135 tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] [instance: b09bd69f-531c-4e44-a955-c56f0f8ada85] Calling os-brick to attach iSCSI Volume {{(pid=75229) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 10:28:09 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9402c65-cd9c-4420-b6b7-97b3d494d135 tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f73f85151b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e1828f03-8de0-4e40-b91f-5b681cfb9e94', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'szbgdemW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 10:28:09 user nova-compute[75229]: WARNING os_brick.initiator.connectors.base [None req-e9402c65-cd9c-4420-b6b7-97b3d494d135 tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 10:28:09 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-e9402c65-cd9c-4420-b6b7-97b3d494d135 tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 10:28:09 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-e9402c65-cd9c-4420-b6b7-97b3d494d135 tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 10:28:09 user nova-compute[75229]: WARNING os_brick.initiator.connectors.base [None req-e9402c65-cd9c-4420-b6b7-97b3d494d135 tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 10:28:09 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-e9402c65-cd9c-4420-b6b7-97b3d494d135 tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e1828f03-8de0-4e40-b91f-5b681cfb9e94" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 10:28:09 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-e9402c65-cd9c-4420-b6b7-97b3d494d135 tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e1828f03-8de0-4e40-b91f-5b681cfb9e94" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 10:28:09 user nova-compute[75229]: INFO os_brick.initiator.connectors.iscsi [None req-e9402c65-cd9c-4420-b6b7-97b3d494d135 tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 10:28:09 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e1828f03-8de0-4e40-b91f-5b681cfb9e94 -p 172.16.0.220:3260 {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:28:09 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e1828f03-8de0-4e40-b91f-5b681cfb9e94 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:28:09 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[9468bded-feb6-46b8-ae43-da6a018c7597]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:28:09 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9402c65-cd9c-4420-b6b7-97b3d494d135 tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 10:28:09 user nova-compute[75229]:  {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 10:28:09 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e1828f03-8de0-4e40-b91f-5b681cfb9e94 -p 172.16.0.220:3260 --interface default --op new {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:28:09 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e1828f03-8de0-4e40-b91f-5b681cfb9e94 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:28:09 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[f88a9d84-ba82-4e03-a9aa-ebf863e76ada]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e1828f03-8de0-4e40-b91f-5b681cfb9e94] added\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:28:09 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9402c65-cd9c-4420-b6b7-97b3d494d135 tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e1828f03-8de0-4e40-b91f-5b681cfb9e94] added
Nov 14 10:28:09 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 10:28:09 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e1828f03-8de0-4e40-b91f-5b681cfb9e94 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:28:09 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e1828f03-8de0-4e40-b91f-5b681cfb9e94 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:28:09 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a8664f9-72ae-402c-95ad-fa1c06a659f0]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:28:09 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9402c65-cd9c-4420-b6b7-97b3d494d135 tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 10:28:09 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e1828f03-8de0-4e40-b91f-5b681cfb9e94 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:28:09 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e1828f03-8de0-4e40-b91f-5b681cfb9e94 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:28:09 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[af026e76-5a03-4caa-8399-ac5dc2a8e4b8]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:28:09 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9402c65-cd9c-4420-b6b7-97b3d494d135 tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 10:28:09 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e1828f03-8de0-4e40-b91f-5b681cfb9e94 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v szbgdemW {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:28:09 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e1828f03-8de0-4e40-b91f-5b681cfb9e94 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v szbgdemW" returned: 0 in 0.017s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:28:09 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[00645a91-7c68-4474-a4cc-5cc2ba319c0d]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:28:09 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9402c65-cd9c-4420-b6b7-97b3d494d135 tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'szbgdemW'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 10:28:09 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e1828f03-8de0-4e40-b91f-5b681cfb9e94 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:28:09 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e1828f03-8de0-4e40-b91f-5b681cfb9e94 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:28:09 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[916d0bbd-5393-43d2-b8c9-e2ad31000131]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:28:09 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9402c65-cd9c-4420-b6b7-97b3d494d135 tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 10:28:09 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:28:09 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:28:09 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[e78de7f0-7296-4db3-871d-a6f16231b430]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:28:09 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9402c65-cd9c-4420-b6b7-97b3d494d135 tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 14 10:28:09 user nova-compute[75229]:  {{(pid=75229) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 10:28:09 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9402c65-cd9c-4420-b6b7-97b3d494d135 tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 14 10:28:09 user nova-compute[75229]:  {{(pid=75229) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 10:28:09 user nova-compute[75229]: WARNING os_brick.initiator.connectors.iscsi [None req-e9402c65-cd9c-4420-b6b7-97b3d494d135 tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 14 10:28:09 user nova-compute[75229]: 
Nov 14 10:28:09 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e1828f03-8de0-4e40-b91f-5b681cfb9e94 -p 172.16.0.220:3260 --login {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:28:09 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e1828f03-8de0-4e40-b91f-5b681cfb9e94 -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:28:09 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f3e1ce5-b876-43b9-b979-d2b70d08f5d6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e1828f03-8de0-4e40-b91f-5b681cfb9e94, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e1828f03-8de0-4e40-b91f-5b681cfb9e94, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:28:09 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9402c65-cd9c-4420-b6b7-97b3d494d135 tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e1828f03-8de0-4e40-b91f-5b681cfb9e94, portal: 172.16.0.220,3260]
Nov 14 10:28:09 user nova-compute[75229]: Login to [iface: default, target: iqn.2010-10.org.openstack:e1828f03-8de0-4e40-b91f-5b681cfb9e94, portal: 172.16.0.220,3260] successful.
Nov 14 10:28:09 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 10:28:09 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e1828f03-8de0-4e40-b91f-5b681cfb9e94 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:28:10 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e1828f03-8de0-4e40-b91f-5b681cfb9e94 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:28:10 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef8030af-4e91-455f-a116-8180ff2a7c2b]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:28:10 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9402c65-cd9c-4420-b6b7-97b3d494d135 tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 10:28:10 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:28:10 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:28:10 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0ec7e6b-8fac-465b-86b4-0ebb407a88bd]: (4, ('tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1828f03-8de0-4e40-b91f-5b681cfb9e94 (non-flash)\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:28:10 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9402c65-cd9c-4420-b6b7-97b3d494d135 tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1828f03-8de0-4e40-b91f-5b681cfb9e94 (non-flash)
Nov 14 10:28:10 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 10:28:10 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9402c65-cd9c-4420-b6b7-97b3d494d135 tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] iscsi session list stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1828f03-8de0-4e40-b91f-5b681cfb9e94 (non-flash)
Nov 14 10:28:10 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 10:28:10 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-e9402c65-cd9c-4420-b6b7-97b3d494d135 tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e1828f03-8de0-4e40-b91f-5b681cfb9e94" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.259s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 10:28:10 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9402c65-cd9c-4420-b6b7-97b3d494d135 tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] Connected to 172.16.0.220:3260 {{(pid=75229) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 10:28:10 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-e9402c65-cd9c-4420-b6b7-97b3d494d135 tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] HCTL ('33', '-', '-', 0) found on session 68 with lun 0 {{(pid=75229) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 10:28:10 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-e9402c65-cd9c-4420-b6b7-97b3d494d135 tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75229) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 10:28:10 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:28:10 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:28:10 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[79b9c2c2-4cfd-433b-a4cc-07f5cfd9c57c]: (4, ('- - 0', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:28:10 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-e9402c65-cd9c-4420-b6b7-97b3d494d135 tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] Searching for a device in session 68 and hctl ['33', '*', '*', 0] yield: None {{(pid=75229) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 10:28:11 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-e9402c65-cd9c-4420-b6b7-97b3d494d135 tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] Searching for a device in session 68 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75229) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 10:28:11 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9402c65-cd9c-4420-b6b7-97b3d494d135 tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:e1828f03-8de0-4e40-b91f-5b681cfb9e94', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'szbgdemW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75229) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 10:28:11 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-e9402c65-cd9c-4420-b6b7-97b3d494d135 tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.288s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 10:28:11 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9402c65-cd9c-4420-b6b7-97b3d494d135 tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] <== connect_volume: return (1290ms) {'type': 'block', 'scsi_wwn': '26233333930643266', 'path': '/dev/sdb'} {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 10:28:11 user nova-compute[75229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e9402c65-cd9c-4420-b6b7-97b3d494d135 tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] [instance: b09bd69f-531c-4e44-a955-c56f0f8ada85] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26233333930643266', 'path': '/dev/sdb'} {{(pid=75229) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 10:28:11 user nova-compute[75229]: DEBUG nova.objects.instance [None req-e9402c65-cd9c-4420-b6b7-97b3d494d135 tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] Lazy-loading 'flavor' on Instance uuid b09bd69f-531c-4e44-a955-c56f0f8ada85 {{(pid=75229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 10:28:11 user nova-compute[75229]: DEBUG nova.virt.libvirt.guest [None req-e9402c65-cd9c-4420-b6b7-97b3d494d135 tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 10:28:11 user nova-compute[75229]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 10:28:11 user nova-compute[75229]:   <source dev="/dev/sdb"/>
Nov 14 10:28:11 user nova-compute[75229]:   <target dev="vdb" bus="virtio"/>
Nov 14 10:28:11 user nova-compute[75229]:   <serial>e1828f03-8de0-4e40-b91f-5b681cfb9e94</serial>
Nov 14 10:28:11 user nova-compute[75229]: </disk>
Nov 14 10:28:11 user nova-compute[75229]:  {{(pid=75229) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 10:28:11 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-e9402c65-cd9c-4420-b6b7-97b3d494d135 tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] No BDM found with device name vda, not building metadata. {{(pid=75229) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 10:28:11 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-e9402c65-cd9c-4420-b6b7-97b3d494d135 tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75229) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 10:28:11 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-e9402c65-cd9c-4420-b6b7-97b3d494d135 tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] No VIF found with MAC fa:16:3e:8a:62:dc, not building metadata {{(pid=75229) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 10:28:11 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-e9402c65-cd9c-4420-b6b7-97b3d494d135 tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] Lock "b09bd69f-531c-4e44-a955-c56f0f8ada85" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.088s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:28:13 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-0daf84b0-d01f-49a2-bb3c-5304c7ffb0eb tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] Acquiring lock "b09bd69f-531c-4e44-a955-c56f0f8ada85" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:28:13 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-0daf84b0-d01f-49a2-bb3c-5304c7ffb0eb tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] Lock "b09bd69f-531c-4e44-a955-c56f0f8ada85" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:28:13 user nova-compute[75229]: INFO nova.compute.manager [None req-0daf84b0-d01f-49a2-bb3c-5304c7ffb0eb tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] [instance: b09bd69f-531c-4e44-a955-c56f0f8ada85] Detaching volume e1828f03-8de0-4e40-b91f-5b681cfb9e94
Nov 14 10:28:13 user nova-compute[75229]: INFO nova.virt.block_device [None req-0daf84b0-d01f-49a2-bb3c-5304c7ffb0eb tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] [instance: b09bd69f-531c-4e44-a955-c56f0f8ada85] Attempting to driver detach volume e1828f03-8de0-4e40-b91f-5b681cfb9e94 from mountpoint /dev/vdb
Nov 14 10:28:13 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-0daf84b0-d01f-49a2-bb3c-5304c7ffb0eb tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] Attempting to detach device vdb from instance b09bd69f-531c-4e44-a955-c56f0f8ada85 from the persistent domain config. {{(pid=75229) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 10:28:13 user nova-compute[75229]: DEBUG nova.virt.libvirt.guest [None req-0daf84b0-d01f-49a2-bb3c-5304c7ffb0eb tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 10:28:13 user nova-compute[75229]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 10:28:13 user nova-compute[75229]:   <source dev="/dev/sdb"/>
Nov 14 10:28:13 user nova-compute[75229]:   <target dev="vdb" bus="virtio"/>
Nov 14 10:28:13 user nova-compute[75229]:   <serial>e1828f03-8de0-4e40-b91f-5b681cfb9e94</serial>
Nov 14 10:28:13 user nova-compute[75229]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 10:28:13 user nova-compute[75229]: </disk>
Nov 14 10:28:13 user nova-compute[75229]:  {{(pid=75229) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 10:28:13 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-0daf84b0-d01f-49a2-bb3c-5304c7ffb0eb tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] Successfully detached device vdb from instance b09bd69f-531c-4e44-a955-c56f0f8ada85 from the persistent domain config.
Nov 14 10:28:13 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-0daf84b0-d01f-49a2-bb3c-5304c7ffb0eb tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance b09bd69f-531c-4e44-a955-c56f0f8ada85 from the live domain config. {{(pid=75229) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 10:28:13 user nova-compute[75229]: DEBUG nova.virt.libvirt.guest [None req-0daf84b0-d01f-49a2-bb3c-5304c7ffb0eb tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 10:28:13 user nova-compute[75229]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 10:28:13 user nova-compute[75229]:   <source dev="/dev/sdb"/>
Nov 14 10:28:13 user nova-compute[75229]:   <target dev="vdb" bus="virtio"/>
Nov 14 10:28:13 user nova-compute[75229]:   <serial>e1828f03-8de0-4e40-b91f-5b681cfb9e94</serial>
Nov 14 10:28:13 user nova-compute[75229]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 10:28:13 user nova-compute[75229]: </disk>
Nov 14 10:28:13 user nova-compute[75229]:  {{(pid=75229) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 10:28:13 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:28:14 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-0daf84b0-d01f-49a2-bb3c-5304c7ffb0eb tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance b09bd69f-531c-4e44-a955-c56f0f8ada85 {{(pid=75229) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 10:28:14 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:28:18 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:28:20 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:28:20 user nova-compute[75229]: DEBUG nova.compute.manager [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Starting heal instance info cache {{(pid=75229) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 10:28:20 user nova-compute[75229]: DEBUG nova.compute.manager [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Rebuilding the list of instances to heal {{(pid=75229) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 10:28:20 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Acquiring lock "refresh_cache-b09bd69f-531c-4e44-a955-c56f0f8ada85" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 10:28:20 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Acquired lock "refresh_cache-b09bd69f-531c-4e44-a955-c56f0f8ada85" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 10:28:20 user nova-compute[75229]: DEBUG nova.network.neutron [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] [instance: b09bd69f-531c-4e44-a955-c56f0f8ada85] Forcefully refreshing network info cache for instance {{(pid=75229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 10:28:20 user nova-compute[75229]: DEBUG nova.objects.instance [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Lazy-loading 'info_cache' on Instance uuid b09bd69f-531c-4e44-a955-c56f0f8ada85 {{(pid=75229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 10:28:21 user nova-compute[75229]: DEBUG nova.network.neutron [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] [instance: b09bd69f-531c-4e44-a955-c56f0f8ada85] Updating instance_info_cache with network_info: [{"id": "a47c7541-2bcf-4288-a237-90e2b1439d20", "address": "fa:16:3e:8a:62:dc", "network": {"id": "faebf0c9-ac3b-4877-b8c0-683ac8c6952d", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1933420959-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "91aa3be89afe4855b8918caa5fc35e47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa47c7541-2b", "ovs_interfaceid": "a47c7541-2bcf-4288-a237-90e2b1439d20", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 10:28:21 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Releasing lock "refresh_cache-b09bd69f-531c-4e44-a955-c56f0f8ada85" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 10:28:21 user nova-compute[75229]: DEBUG nova.compute.manager [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] [instance: b09bd69f-531c-4e44-a955-c56f0f8ada85] Updated the network info_cache for instance {{(pid=75229) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 10:28:22 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:28:23 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:28:23 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 10:28:23 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:28:23 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75229) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 10:28:23 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75229) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 10:28:23 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75229) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 10:28:23 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:28:25 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:28:26 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:28:26 user nova-compute[75229]: DEBUG nova.compute.manager [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75229) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 10:28:28 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:28:29 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:28:29 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:28:29 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:28:29 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:28:29 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Auditing locally available compute resources for user (node: user) {{(pid=75229) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 10:28:29 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b09bd69f-531c-4e44-a955-c56f0f8ada85/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:28:29 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b09bd69f-531c-4e44-a955-c56f0f8ada85/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:28:29 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b09bd69f-531c-4e44-a955-c56f0f8ada85/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:28:30 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b09bd69f-531c-4e44-a955-c56f0f8ada85/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:28:30 user nova-compute[75229]: WARNING nova.virt.libvirt.driver [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 10:28:30 user nova-compute[75229]: WARNING nova.virt.libvirt.driver [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 10:28:30 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Hypervisor/Node resource view: name=user free_ram=9037MB free_disk=25.11050033569336GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75229) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 10:28:30 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:28:30 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:28:30 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Instance b09bd69f-531c-4e44-a955-c56f0f8ada85 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 10:28:30 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75229) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 10:28:30 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75229) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 10:28:30 user nova-compute[75229]: DEBUG nova.compute.provider_tree [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Inventory has not changed in ProviderTree for provider: d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 {{(pid=75229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 10:28:30 user nova-compute[75229]: DEBUG nova.scheduler.client.report [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Inventory has not changed for provider d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 10:28:30 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Compute_service record updated for user:user {{(pid=75229) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 10:28:30 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.174s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:28:32 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:28:32 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:28:33 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:28:33 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 10:28:33 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:28:33 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75229) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 10:28:33 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75229) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 10:28:33 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75229) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 10:28:33 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:28:34 user nova-compute[75229]: WARNING nova.virt.libvirt.driver [None req-0daf84b0-d01f-49a2-bb3c-5304c7ffb0eb tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance b09bd69f-531c-4e44-a955-c56f0f8ada85 is timed out.
Nov 14 10:28:34 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-0daf84b0-d01f-49a2-bb3c-5304c7ffb0eb tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] Successfully detached device vdb from instance b09bd69f-531c-4e44-a955-c56f0f8ada85 from the live domain config.
Nov 14 10:28:34 user nova-compute[75229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0daf84b0-d01f-49a2-bb3c-5304c7ffb0eb tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] [instance: b09bd69f-531c-4e44-a955-c56f0f8ada85] calling os-brick to detach iSCSI Volume {{(pid=75229) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 10:28:34 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-0daf84b0-d01f-49a2-bb3c-5304c7ffb0eb tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f73f85151b0>, {'target_iqn': 'iqn.2010-10.org.openstack:e1828f03-8de0-4e40-b91f-5b681cfb9e94', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'szbgdemW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 10:28:34 user nova-compute[75229]: WARNING os_brick.initiator.connectors.base [None req-0daf84b0-d01f-49a2-bb3c-5304c7ffb0eb tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 10:28:34 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-0daf84b0-d01f-49a2-bb3c-5304c7ffb0eb tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 10:28:34 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-0daf84b0-d01f-49a2-bb3c-5304c7ffb0eb tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 10:28:34 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:28:34 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:28:34 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed71a5ba-8a98-4591-abd2-61d4fb32755a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e1828f03-8de0-4e40-b91f-5b681cfb9e94\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:28:34 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-0daf84b0-d01f-49a2-bb3c-5304c7ffb0eb tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 10:28:34 user nova-compute[75229]: No targets found.
Nov 14 10:28:34 user nova-compute[75229]: iSNS:
Nov 14 10:28:34 user nova-compute[75229]: No targets found.
Nov 14 10:28:34 user nova-compute[75229]: STATIC:
Nov 14 10:28:34 user nova-compute[75229]: Target: iqn.2010-10.org.openstack:e1828f03-8de0-4e40-b91f-5b681cfb9e94
Nov 14 10:28:34 user nova-compute[75229]:         Portal: 172.16.0.220:3260,-1
Nov 14 10:28:34 user nova-compute[75229]:                 Iface Name: default
Nov 14 10:28:34 user nova-compute[75229]: FIRMWARE:
Nov 14 10:28:34 user nova-compute[75229]: No targets found.
Nov 14 10:28:34 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 10:28:34 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-0daf84b0-d01f-49a2-bb3c-5304c7ffb0eb tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 10:28:34 user nova-compute[75229]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 10:28:34 user nova-compute[75229]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75229) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 10:28:34 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-0daf84b0-d01f-49a2-bb3c-5304c7ffb0eb tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e1828f03-8de0-4e40-b91f-5b681cfb9e94', 0)] {{(pid=75229) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 10:28:34 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:28:34 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:28:34 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[1363d80e-78f3-4f10-a3bd-47aa687898af]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e1828f03-8de0-4e40-b91f-5b681cfb9e94\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:28:34 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:28:34 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:28:34 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbc245dc-5797-40ad-afad-1421f55cadaf]: (4, ('tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1828f03-8de0-4e40-b91f-5b681cfb9e94 (non-flash)\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:28:34 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-0daf84b0-d01f-49a2-bb3c-5304c7ffb0eb tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1828f03-8de0-4e40-b91f-5b681cfb9e94 (non-flash)
Nov 14 10:28:34 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 10:28:34 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-0daf84b0-d01f-49a2-bb3c-5304c7ffb0eb tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] iscsi session list stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1828f03-8de0-4e40-b91f-5b681cfb9e94 (non-flash)
Nov 14 10:28:34 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 10:28:34 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-0daf84b0-d01f-49a2-bb3c-5304c7ffb0eb tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f73f83d9870>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e1828f03-8de0-4e40-b91f-5b681cfb9e94'): ({'sdb'}, set())}) {{(pid=75229) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 10:28:34 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-0daf84b0-d01f-49a2-bb3c-5304c7ffb0eb tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] Removing single pathed devices sdb {{(pid=75229) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 10:28:34 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:28:34 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:28:34 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[3faa3717-24a3-475c-9fd0-f024b278036a]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:28:34 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:28:34 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.024s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:28:34 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac12204a-5c44-4c94-bea1-2603a7bb2d03]: (4, ('ok\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:28:34 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-0daf84b0-d01f-49a2-bb3c-5304c7ffb0eb tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] Flushing IO for device /dev/sdb {{(pid=75229) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 10:28:34 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:28:34 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:28:34 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[4133f88c-203e-4909-8302-ed9f5b78bd1d]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:28:34 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-0daf84b0-d01f-49a2-bb3c-5304c7ffb0eb tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75229) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 10:28:34 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:28:34 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.030s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:28:34 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[c31f17c3-6c52-4629-b44a-a0d14a1b5acf]: (4, ('1', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:28:34 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-0daf84b0-d01f-49a2-bb3c-5304c7ffb0eb tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75229) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 10:28:34 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-0daf84b0-d01f-49a2-bb3c-5304c7ffb0eb tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] SCSI volumes sdb have been removed. {{(pid=75229) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 10:28:34 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-0daf84b0-d01f-49a2-bb3c-5304c7ffb0eb tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e1828f03-8de0-4e40-b91f-5b681cfb9e94')] {{(pid=75229) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 10:28:34 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e1828f03-8de0-4e40-b91f-5b681cfb9e94 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:28:34 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e1828f03-8de0-4e40-b91f-5b681cfb9e94 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:28:34 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[161a2940-3f9b-429d-95c6-d4a9dba9b7d4]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:28:34 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-0daf84b0-d01f-49a2-bb3c-5304c7ffb0eb tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 10:28:34 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e1828f03-8de0-4e40-b91f-5b681cfb9e94 -p 172.16.0.220:3260 --logout {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:28:34 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e1828f03-8de0-4e40-b91f-5b681cfb9e94 -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:28:34 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[12e94d94-5b32-485a-a7fe-c5c692cb526e]: (4, ('Logging out of session [sid: 68, target: iqn.2010-10.org.openstack:e1828f03-8de0-4e40-b91f-5b681cfb9e94, portal: 172.16.0.220,3260]\nLogout of [sid: 68, target: iqn.2010-10.org.openstack:e1828f03-8de0-4e40-b91f-5b681cfb9e94, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:28:34 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-0daf84b0-d01f-49a2-bb3c-5304c7ffb0eb tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 68, target: iqn.2010-10.org.openstack:e1828f03-8de0-4e40-b91f-5b681cfb9e94, portal: 172.16.0.220,3260]
Nov 14 10:28:34 user nova-compute[75229]: Logout of [sid: 68, target: iqn.2010-10.org.openstack:e1828f03-8de0-4e40-b91f-5b681cfb9e94, portal: 172.16.0.220,3260] successful.
Nov 14 10:28:34 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 10:28:34 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e1828f03-8de0-4e40-b91f-5b681cfb9e94 -p 172.16.0.220:3260 --op delete {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:28:34 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e1828f03-8de0-4e40-b91f-5b681cfb9e94 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:28:34 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d9fba8a-ae2f-45df-8f15-818acab9bc7b]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:28:34 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-0daf84b0-d01f-49a2-bb3c-5304c7ffb0eb tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 10:28:34 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-0daf84b0-d01f-49a2-bb3c-5304c7ffb0eb tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.271s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 10:28:34 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-0daf84b0-d01f-49a2-bb3c-5304c7ffb0eb tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] <== disconnect_volume: return (272ms) None {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 10:28:34 user nova-compute[75229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0daf84b0-d01f-49a2-bb3c-5304c7ffb0eb tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] [instance: b09bd69f-531c-4e44-a955-c56f0f8ada85] Disconnected iSCSI Volume {{(pid=75229) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 10:28:35 user nova-compute[75229]: DEBUG nova.objects.instance [None req-0daf84b0-d01f-49a2-bb3c-5304c7ffb0eb tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] Lazy-loading 'flavor' on Instance uuid b09bd69f-531c-4e44-a955-c56f0f8ada85 {{(pid=75229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 10:28:35 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-0daf84b0-d01f-49a2-bb3c-5304c7ffb0eb tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] Lock "b09bd69f-531c-4e44-a955-c56f0f8ada85" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.583s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:28:38 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:28:43 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 10:28:46 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:28:48 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 10:28:53 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 10:28:53 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:28:53 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75229) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 10:28:53 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75229) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 10:28:53 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75229) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 10:28:53 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:28:58 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 10:28:58 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:28:58 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75229) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 10:28:58 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75229) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 10:28:58 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75229) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 10:28:58 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:29:03 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 10:29:03 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:29:03 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75229) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 10:29:03 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75229) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 10:29:03 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75229) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 10:29:03 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:29:05 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-8994ae5d-f5a8-4172-a3c3-5e399c8fdf95 tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] Acquiring lock "b09bd69f-531c-4e44-a955-c56f0f8ada85" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:29:05 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-8994ae5d-f5a8-4172-a3c3-5e399c8fdf95 tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] Lock "b09bd69f-531c-4e44-a955-c56f0f8ada85" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:29:05 user nova-compute[75229]: DEBUG nova.objects.instance [None req-8994ae5d-f5a8-4172-a3c3-5e399c8fdf95 tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] Lazy-loading 'flavor' on Instance uuid b09bd69f-531c-4e44-a955-c56f0f8ada85 {{(pid=75229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 10:29:05 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-8994ae5d-f5a8-4172-a3c3-5e399c8fdf95 tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] Lock "b09bd69f-531c-4e44-a955-c56f0f8ada85" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:29:05 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-8994ae5d-f5a8-4172-a3c3-5e399c8fdf95 tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] Acquiring lock "b09bd69f-531c-4e44-a955-c56f0f8ada85" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:29:05 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-8994ae5d-f5a8-4172-a3c3-5e399c8fdf95 tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] Lock "b09bd69f-531c-4e44-a955-c56f0f8ada85" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:29:05 user nova-compute[75229]: INFO nova.compute.manager [None req-8994ae5d-f5a8-4172-a3c3-5e399c8fdf95 tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] [instance: b09bd69f-531c-4e44-a955-c56f0f8ada85] Attaching volume 3b82d9ea-e726-4a0e-babf-c644b50beb84 to /dev/vdb
Nov 14 10:29:05 user nova-compute[75229]: DEBUG os_brick.utils [None req-8994ae5d-f5a8-4172-a3c3-5e399c8fdf95 tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 10:29:05 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:29:05 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:29:05 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[26ec6fcc-7897-454e-9dc3-f1d85fc76285]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f1154031c835\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:29:05 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:29:05 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:29:05 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[583d3b43-fb48-483c-aaa8-72bbcdcacbaa]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:29:05 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:29:05 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:29:05 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[97e8223d-69fd-4ab0-b148-7a866fb44c3c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:29:05 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[e172b9fa-b105-44be-94ef-e97e5f2c6b16]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:29:05 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-8994ae5d-f5a8-4172-a3c3-5e399c8fdf95 tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] Running cmd (subprocess): nvme version {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:29:05 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-8994ae5d-f5a8-4172-a3c3-5e399c8fdf95 tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] 'nvme version' failed. Not Retrying. {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 10:29:05 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8994ae5d-f5a8-4172-a3c3-5e399c8fdf95 tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] nvme not present on system {{(pid=75229) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 10:29:05 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:29:05 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 10:29:05 user nova-compute[75229]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 10:29:05 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[3caefb5e-9e43-4fb5-94b7-9d820aba6c0e]: (4, '') {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:29:05 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.lightos [None req-8994ae5d-f5a8-4172-a3c3-5e399c8fdf95 tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75229) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 10:29:05 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.lightos [None req-8994ae5d-f5a8-4172-a3c3-5e399c8fdf95 tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75229) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 10:29:05 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.lightos [None req-8994ae5d-f5a8-4172-a3c3-5e399c8fdf95 tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] LIGHTOS: no hostnqn found. {{(pid=75229) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 10:29:05 user nova-compute[75229]: DEBUG os_brick.utils [None req-8994ae5d-f5a8-4172-a3c3-5e399c8fdf95 tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f1154031c835', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 10:29:05 user nova-compute[75229]: DEBUG nova.virt.block_device [None req-8994ae5d-f5a8-4172-a3c3-5e399c8fdf95 tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] [instance: b09bd69f-531c-4e44-a955-c56f0f8ada85] Updating existing volume attachment record: 11653d37-fb9e-48a3-a0bd-ae9b5b0dafb5 {{(pid=75229) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 10:29:08 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 10:29:09 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:29:10 user nova-compute[75229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8994ae5d-f5a8-4172-a3c3-5e399c8fdf95 tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] [instance: b09bd69f-531c-4e44-a955-c56f0f8ada85] Calling os-brick to attach iSCSI Volume {{(pid=75229) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 10:29:10 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-8994ae5d-f5a8-4172-a3c3-5e399c8fdf95 tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f73f85151b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3b82d9ea-e726-4a0e-babf-c644b50beb84', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XnLlUgco', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 10:29:10 user nova-compute[75229]: WARNING os_brick.initiator.connectors.base [None req-8994ae5d-f5a8-4172-a3c3-5e399c8fdf95 tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 10:29:10 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-8994ae5d-f5a8-4172-a3c3-5e399c8fdf95 tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 10:29:10 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-8994ae5d-f5a8-4172-a3c3-5e399c8fdf95 tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 10:29:10 user nova-compute[75229]: WARNING os_brick.initiator.connectors.base [None req-8994ae5d-f5a8-4172-a3c3-5e399c8fdf95 tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 10:29:10 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-8994ae5d-f5a8-4172-a3c3-5e399c8fdf95 tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3b82d9ea-e726-4a0e-babf-c644b50beb84" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 10:29:10 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-8994ae5d-f5a8-4172-a3c3-5e399c8fdf95 tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3b82d9ea-e726-4a0e-babf-c644b50beb84" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 10:29:10 user nova-compute[75229]: INFO os_brick.initiator.connectors.iscsi [None req-8994ae5d-f5a8-4172-a3c3-5e399c8fdf95 tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 10:29:10 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b82d9ea-e726-4a0e-babf-c644b50beb84 -p 172.16.0.220:3260 {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:29:10 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b82d9ea-e726-4a0e-babf-c644b50beb84 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:29:10 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[143a0853-6f65-4f26-8e23-bd7b06649d8e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:29:10 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-8994ae5d-f5a8-4172-a3c3-5e399c8fdf95 tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 10:29:10 user nova-compute[75229]:  {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 10:29:10 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b82d9ea-e726-4a0e-babf-c644b50beb84 -p 172.16.0.220:3260 --interface default --op new {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:29:10 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b82d9ea-e726-4a0e-babf-c644b50beb84 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:29:10 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bc5e200-9849-417e-a900-55daa4e2c4e2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3b82d9ea-e726-4a0e-babf-c644b50beb84] added\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:29:10 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-8994ae5d-f5a8-4172-a3c3-5e399c8fdf95 tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3b82d9ea-e726-4a0e-babf-c644b50beb84] added
Nov 14 10:29:10 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 10:29:10 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b82d9ea-e726-4a0e-babf-c644b50beb84 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:29:10 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b82d9ea-e726-4a0e-babf-c644b50beb84 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:29:10 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[c067c525-ac8a-46f8-9ef1-84624a751724]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:29:10 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-8994ae5d-f5a8-4172-a3c3-5e399c8fdf95 tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 10:29:10 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b82d9ea-e726-4a0e-babf-c644b50beb84 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:29:10 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b82d9ea-e726-4a0e-babf-c644b50beb84 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:29:10 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[03e1107c-794e-4326-9649-75a2afde3ce2]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:29:10 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-8994ae5d-f5a8-4172-a3c3-5e399c8fdf95 tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 10:29:10 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b82d9ea-e726-4a0e-babf-c644b50beb84 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XnLlUgco {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:29:10 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b82d9ea-e726-4a0e-babf-c644b50beb84 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XnLlUgco" returned: 0 in 0.018s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:29:10 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[de8d93c2-9321-4529-9292-e00455f5e1d7]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:29:10 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-8994ae5d-f5a8-4172-a3c3-5e399c8fdf95 tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XnLlUgco'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 10:29:10 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b82d9ea-e726-4a0e-babf-c644b50beb84 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:29:10 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b82d9ea-e726-4a0e-babf-c644b50beb84 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:29:10 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[576ad57c-6389-4d80-82a8-79ef7c925696]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:29:10 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-8994ae5d-f5a8-4172-a3c3-5e399c8fdf95 tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 10:29:10 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:29:10 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:29:10 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[66537132-9307-496e-9e45-80ebfda24c9a]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:29:10 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-8994ae5d-f5a8-4172-a3c3-5e399c8fdf95 tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 14 10:29:10 user nova-compute[75229]:  {{(pid=75229) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 10:29:10 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-8994ae5d-f5a8-4172-a3c3-5e399c8fdf95 tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 14 10:29:10 user nova-compute[75229]:  {{(pid=75229) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 10:29:10 user nova-compute[75229]: WARNING os_brick.initiator.connectors.iscsi [None req-8994ae5d-f5a8-4172-a3c3-5e399c8fdf95 tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 14 10:29:10 user nova-compute[75229]: 
Nov 14 10:29:10 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b82d9ea-e726-4a0e-babf-c644b50beb84 -p 172.16.0.220:3260 --login {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:29:10 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b82d9ea-e726-4a0e-babf-c644b50beb84 -p 172.16.0.220:3260 --login" returned: 0 in 0.047s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:29:10 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4ab5503-14a4-438b-a700-51221a187b01]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3b82d9ea-e726-4a0e-babf-c644b50beb84, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3b82d9ea-e726-4a0e-babf-c644b50beb84, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:29:10 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-8994ae5d-f5a8-4172-a3c3-5e399c8fdf95 tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3b82d9ea-e726-4a0e-babf-c644b50beb84, portal: 172.16.0.220,3260]
Nov 14 10:29:10 user nova-compute[75229]: Login to [iface: default, target: iqn.2010-10.org.openstack:3b82d9ea-e726-4a0e-babf-c644b50beb84, portal: 172.16.0.220,3260] successful.
Nov 14 10:29:10 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 10:29:10 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b82d9ea-e726-4a0e-babf-c644b50beb84 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:29:10 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b82d9ea-e726-4a0e-babf-c644b50beb84 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:29:10 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b5c6270-19ad-4604-b66f-a22279bd06b0]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:29:10 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-8994ae5d-f5a8-4172-a3c3-5e399c8fdf95 tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 10:29:10 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:29:10 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:29:10 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[21912d9a-b361-4c99-846a-bc1041631bdc]: (4, ('tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b82d9ea-e726-4a0e-babf-c644b50beb84 (non-flash)\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:29:10 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-8994ae5d-f5a8-4172-a3c3-5e399c8fdf95 tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b82d9ea-e726-4a0e-babf-c644b50beb84 (non-flash)
Nov 14 10:29:10 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 10:29:10 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-8994ae5d-f5a8-4172-a3c3-5e399c8fdf95 tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] iscsi session list stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b82d9ea-e726-4a0e-babf-c644b50beb84 (non-flash)
Nov 14 10:29:10 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 10:29:10 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-8994ae5d-f5a8-4172-a3c3-5e399c8fdf95 tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3b82d9ea-e726-4a0e-babf-c644b50beb84" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.254s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 10:29:10 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-8994ae5d-f5a8-4172-a3c3-5e399c8fdf95 tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] Connected to 172.16.0.220:3260 {{(pid=75229) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 10:29:10 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-8994ae5d-f5a8-4172-a3c3-5e399c8fdf95 tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] HCTL ('33', '-', '-', 0) found on session 69 with lun 0 {{(pid=75229) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 10:29:10 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-8994ae5d-f5a8-4172-a3c3-5e399c8fdf95 tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75229) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 10:29:10 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:29:10 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:29:10 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5c4c64b-1947-4bf2-87e9-e8da1ee986d1]: (4, ('- - 0', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:29:10 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-8994ae5d-f5a8-4172-a3c3-5e399c8fdf95 tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] Searching for a device in session 69 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75229) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 10:29:10 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-8994ae5d-f5a8-4172-a3c3-5e399c8fdf95 tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:3b82d9ea-e726-4a0e-babf-c644b50beb84', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XnLlUgco', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75229) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 10:29:11 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-8994ae5d-f5a8-4172-a3c3-5e399c8fdf95 tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.283s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 10:29:11 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-8994ae5d-f5a8-4172-a3c3-5e399c8fdf95 tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] <== connect_volume: return (1285ms) {'type': 'block', 'scsi_wwn': '26133643139363065', 'path': '/dev/sdb'} {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 10:29:11 user nova-compute[75229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8994ae5d-f5a8-4172-a3c3-5e399c8fdf95 tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] [instance: b09bd69f-531c-4e44-a955-c56f0f8ada85] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26133643139363065', 'path': '/dev/sdb'} {{(pid=75229) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 10:29:11 user nova-compute[75229]: DEBUG nova.objects.instance [None req-8994ae5d-f5a8-4172-a3c3-5e399c8fdf95 tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] Lazy-loading 'flavor' on Instance uuid b09bd69f-531c-4e44-a955-c56f0f8ada85 {{(pid=75229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 10:29:11 user nova-compute[75229]: DEBUG nova.virt.libvirt.guest [None req-8994ae5d-f5a8-4172-a3c3-5e399c8fdf95 tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 10:29:11 user nova-compute[75229]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 10:29:11 user nova-compute[75229]:   <source dev="/dev/sdb"/>
Nov 14 10:29:11 user nova-compute[75229]:   <target dev="vdb" bus="virtio"/>
Nov 14 10:29:11 user nova-compute[75229]:   <serial>3b82d9ea-e726-4a0e-babf-c644b50beb84</serial>
Nov 14 10:29:11 user nova-compute[75229]: </disk>
Nov 14 10:29:11 user nova-compute[75229]:  {{(pid=75229) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 10:29:12 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-8994ae5d-f5a8-4172-a3c3-5e399c8fdf95 tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] No BDM found with device name vda, not building metadata. {{(pid=75229) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 10:29:12 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-8994ae5d-f5a8-4172-a3c3-5e399c8fdf95 tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75229) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 10:29:12 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-8994ae5d-f5a8-4172-a3c3-5e399c8fdf95 tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] No VIF found with MAC fa:16:3e:8a:62:dc, not building metadata {{(pid=75229) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 10:29:12 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-8994ae5d-f5a8-4172-a3c3-5e399c8fdf95 tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] Lock "b09bd69f-531c-4e44-a955-c56f0f8ada85" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.769s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:29:13 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:29:14 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:29:14 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-fdf80ddb-2705-4d1d-b318-638d6a10cda1 tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] Acquiring lock "b09bd69f-531c-4e44-a955-c56f0f8ada85" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:29:14 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-fdf80ddb-2705-4d1d-b318-638d6a10cda1 tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] Lock "b09bd69f-531c-4e44-a955-c56f0f8ada85" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:29:14 user nova-compute[75229]: INFO nova.compute.manager [None req-fdf80ddb-2705-4d1d-b318-638d6a10cda1 tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] [instance: b09bd69f-531c-4e44-a955-c56f0f8ada85] Detaching volume 3b82d9ea-e726-4a0e-babf-c644b50beb84
Nov 14 10:29:14 user nova-compute[75229]: INFO nova.virt.block_device [None req-fdf80ddb-2705-4d1d-b318-638d6a10cda1 tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] [instance: b09bd69f-531c-4e44-a955-c56f0f8ada85] Attempting to driver detach volume 3b82d9ea-e726-4a0e-babf-c644b50beb84 from mountpoint /dev/vdb
Nov 14 10:29:14 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-fdf80ddb-2705-4d1d-b318-638d6a10cda1 tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] Attempting to detach device vdb from instance b09bd69f-531c-4e44-a955-c56f0f8ada85 from the persistent domain config. {{(pid=75229) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 10:29:14 user nova-compute[75229]: DEBUG nova.virt.libvirt.guest [None req-fdf80ddb-2705-4d1d-b318-638d6a10cda1 tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 10:29:14 user nova-compute[75229]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 10:29:14 user nova-compute[75229]:   <source dev="/dev/sdb"/>
Nov 14 10:29:14 user nova-compute[75229]:   <target dev="vdb" bus="virtio"/>
Nov 14 10:29:14 user nova-compute[75229]:   <serial>3b82d9ea-e726-4a0e-babf-c644b50beb84</serial>
Nov 14 10:29:14 user nova-compute[75229]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 10:29:14 user nova-compute[75229]: </disk>
Nov 14 10:29:14 user nova-compute[75229]:  {{(pid=75229) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 10:29:14 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-fdf80ddb-2705-4d1d-b318-638d6a10cda1 tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] Successfully detached device vdb from instance b09bd69f-531c-4e44-a955-c56f0f8ada85 from the persistent domain config.
Nov 14 10:29:14 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-fdf80ddb-2705-4d1d-b318-638d6a10cda1 tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance b09bd69f-531c-4e44-a955-c56f0f8ada85 from the live domain config. {{(pid=75229) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 10:29:14 user nova-compute[75229]: DEBUG nova.virt.libvirt.guest [None req-fdf80ddb-2705-4d1d-b318-638d6a10cda1 tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 10:29:14 user nova-compute[75229]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 10:29:14 user nova-compute[75229]:   <source dev="/dev/sdb"/>
Nov 14 10:29:14 user nova-compute[75229]:   <target dev="vdb" bus="virtio"/>
Nov 14 10:29:14 user nova-compute[75229]:   <serial>3b82d9ea-e726-4a0e-babf-c644b50beb84</serial>
Nov 14 10:29:14 user nova-compute[75229]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 10:29:14 user nova-compute[75229]: </disk>
Nov 14 10:29:14 user nova-compute[75229]:  {{(pid=75229) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 10:29:15 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-fdf80ddb-2705-4d1d-b318-638d6a10cda1 tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance b09bd69f-531c-4e44-a955-c56f0f8ada85 {{(pid=75229) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 10:29:18 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:29:19 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:29:20 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:29:20 user nova-compute[75229]: DEBUG nova.compute.manager [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Starting heal instance info cache {{(pid=75229) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 10:29:20 user nova-compute[75229]: DEBUG nova.compute.manager [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Rebuilding the list of instances to heal {{(pid=75229) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 10:29:20 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Acquiring lock "refresh_cache-b09bd69f-531c-4e44-a955-c56f0f8ada85" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 10:29:20 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Acquired lock "refresh_cache-b09bd69f-531c-4e44-a955-c56f0f8ada85" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 10:29:20 user nova-compute[75229]: DEBUG nova.network.neutron [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] [instance: b09bd69f-531c-4e44-a955-c56f0f8ada85] Forcefully refreshing network info cache for instance {{(pid=75229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 10:29:20 user nova-compute[75229]: DEBUG nova.objects.instance [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Lazy-loading 'info_cache' on Instance uuid b09bd69f-531c-4e44-a955-c56f0f8ada85 {{(pid=75229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 10:29:21 user nova-compute[75229]: DEBUG nova.network.neutron [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] [instance: b09bd69f-531c-4e44-a955-c56f0f8ada85] Updating instance_info_cache with network_info: [{"id": "a47c7541-2bcf-4288-a237-90e2b1439d20", "address": "fa:16:3e:8a:62:dc", "network": {"id": "faebf0c9-ac3b-4877-b8c0-683ac8c6952d", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1933420959-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "91aa3be89afe4855b8918caa5fc35e47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa47c7541-2b", "ovs_interfaceid": "a47c7541-2bcf-4288-a237-90e2b1439d20", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 10:29:21 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Releasing lock "refresh_cache-b09bd69f-531c-4e44-a955-c56f0f8ada85" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 10:29:21 user nova-compute[75229]: DEBUG nova.compute.manager [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] [instance: b09bd69f-531c-4e44-a955-c56f0f8ada85] Updated the network info_cache for instance {{(pid=75229) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 10:29:23 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:29:24 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:29:24 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:29:27 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:29:28 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:29:28 user nova-compute[75229]: DEBUG nova.compute.manager [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75229) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 10:29:28 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 10:29:31 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:29:31 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:29:31 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:29:31 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:29:31 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Auditing locally available compute resources for user (node: user) {{(pid=75229) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 10:29:31 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b09bd69f-531c-4e44-a955-c56f0f8ada85/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:29:32 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b09bd69f-531c-4e44-a955-c56f0f8ada85/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:29:32 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b09bd69f-531c-4e44-a955-c56f0f8ada85/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:29:32 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b09bd69f-531c-4e44-a955-c56f0f8ada85/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:29:32 user nova-compute[75229]: WARNING nova.virt.libvirt.driver [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 10:29:32 user nova-compute[75229]: WARNING nova.virt.libvirt.driver [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 10:29:32 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Hypervisor/Node resource view: name=user free_ram=9040MB free_disk=25.109493255615234GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75229) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 10:29:32 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:29:32 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:29:32 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Instance b09bd69f-531c-4e44-a955-c56f0f8ada85 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 10:29:32 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75229) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 10:29:32 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75229) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 10:29:32 user nova-compute[75229]: DEBUG nova.compute.provider_tree [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Inventory has not changed in ProviderTree for provider: d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 {{(pid=75229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 10:29:32 user nova-compute[75229]: DEBUG nova.scheduler.client.report [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Inventory has not changed for provider d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 10:29:32 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Compute_service record updated for user:user {{(pid=75229) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 10:29:32 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.164s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:29:33 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 10:29:34 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:29:34 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:29:35 user nova-compute[75229]: WARNING nova.virt.libvirt.driver [None req-fdf80ddb-2705-4d1d-b318-638d6a10cda1 tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance b09bd69f-531c-4e44-a955-c56f0f8ada85 is timed out.
Nov 14 10:29:35 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-fdf80ddb-2705-4d1d-b318-638d6a10cda1 tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] Successfully detached device vdb from instance b09bd69f-531c-4e44-a955-c56f0f8ada85 from the live domain config.
Nov 14 10:29:35 user nova-compute[75229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fdf80ddb-2705-4d1d-b318-638d6a10cda1 tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] [instance: b09bd69f-531c-4e44-a955-c56f0f8ada85] calling os-brick to detach iSCSI Volume {{(pid=75229) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 10:29:35 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdf80ddb-2705-4d1d-b318-638d6a10cda1 tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f73f85151b0>, {'target_iqn': 'iqn.2010-10.org.openstack:3b82d9ea-e726-4a0e-babf-c644b50beb84', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XnLlUgco', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 10:29:35 user nova-compute[75229]: WARNING os_brick.initiator.connectors.base [None req-fdf80ddb-2705-4d1d-b318-638d6a10cda1 tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 10:29:35 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-fdf80ddb-2705-4d1d-b318-638d6a10cda1 tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 10:29:35 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-fdf80ddb-2705-4d1d-b318-638d6a10cda1 tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 10:29:35 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:29:35 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:29:35 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[2893fb64-a5ae-40d4-9407-cbceea474cb7]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3b82d9ea-e726-4a0e-babf-c644b50beb84\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:29:35 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdf80ddb-2705-4d1d-b318-638d6a10cda1 tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 10:29:35 user nova-compute[75229]: No targets found.
Nov 14 10:29:35 user nova-compute[75229]: iSNS:
Nov 14 10:29:35 user nova-compute[75229]: No targets found.
Nov 14 10:29:35 user nova-compute[75229]: STATIC:
Nov 14 10:29:35 user nova-compute[75229]: Target: iqn.2010-10.org.openstack:3b82d9ea-e726-4a0e-babf-c644b50beb84
Nov 14 10:29:35 user nova-compute[75229]:         Portal: 172.16.0.220:3260,-1
Nov 14 10:29:35 user nova-compute[75229]:                 Iface Name: default
Nov 14 10:29:35 user nova-compute[75229]: FIRMWARE:
Nov 14 10:29:35 user nova-compute[75229]: No targets found.
Nov 14 10:29:35 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 10:29:35 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdf80ddb-2705-4d1d-b318-638d6a10cda1 tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 10:29:35 user nova-compute[75229]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 10:29:35 user nova-compute[75229]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75229) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 10:29:35 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdf80ddb-2705-4d1d-b318-638d6a10cda1 tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3b82d9ea-e726-4a0e-babf-c644b50beb84', 0)] {{(pid=75229) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 10:29:35 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:29:35 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:29:35 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a351eaa-6bad-4417-99c5-f69ef2e32439]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3b82d9ea-e726-4a0e-babf-c644b50beb84\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:29:35 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:29:35 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:29:35 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[68d782bf-49eb-45df-98e1-0366bab35125]: (4, ('tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b82d9ea-e726-4a0e-babf-c644b50beb84 (non-flash)\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:29:35 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdf80ddb-2705-4d1d-b318-638d6a10cda1 tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b82d9ea-e726-4a0e-babf-c644b50beb84 (non-flash)
Nov 14 10:29:35 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 10:29:35 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdf80ddb-2705-4d1d-b318-638d6a10cda1 tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] iscsi session list stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b82d9ea-e726-4a0e-babf-c644b50beb84 (non-flash)
Nov 14 10:29:35 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 10:29:35 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdf80ddb-2705-4d1d-b318-638d6a10cda1 tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f73d4c51d80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3b82d9ea-e726-4a0e-babf-c644b50beb84'): ({'sdb'}, set())}) {{(pid=75229) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 10:29:35 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-fdf80ddb-2705-4d1d-b318-638d6a10cda1 tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] Removing single pathed devices sdb {{(pid=75229) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 10:29:35 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:29:35 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:29:35 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e5953ec-c79e-4fdb-a3ec-8044f9e8f9b5]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:29:35 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:29:35 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:29:35 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[19d31232-0621-4403-8e1c-b1d1f1587e06]: (4, ('ok\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:29:35 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-fdf80ddb-2705-4d1d-b318-638d6a10cda1 tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] Flushing IO for device /dev/sdb {{(pid=75229) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 10:29:35 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:29:35 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:29:35 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[badba03a-b349-4726-bb17-f41999326e1a]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:29:35 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-fdf80ddb-2705-4d1d-b318-638d6a10cda1 tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75229) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 10:29:35 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:29:35 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.042s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:29:35 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca050e31-e7de-4c4d-b266-b4d6d2cc9697]: (4, ('1', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:29:35 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-fdf80ddb-2705-4d1d-b318-638d6a10cda1 tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75229) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 10:29:35 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-fdf80ddb-2705-4d1d-b318-638d6a10cda1 tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] SCSI volumes sdb have been removed. {{(pid=75229) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 10:29:35 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdf80ddb-2705-4d1d-b318-638d6a10cda1 tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3b82d9ea-e726-4a0e-babf-c644b50beb84')] {{(pid=75229) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 10:29:35 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b82d9ea-e726-4a0e-babf-c644b50beb84 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:29:35 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b82d9ea-e726-4a0e-babf-c644b50beb84 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:29:35 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[30229cad-1ceb-4dc3-9e10-55578f16c18e]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:29:35 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdf80ddb-2705-4d1d-b318-638d6a10cda1 tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 10:29:35 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b82d9ea-e726-4a0e-babf-c644b50beb84 -p 172.16.0.220:3260 --logout {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:29:35 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b82d9ea-e726-4a0e-babf-c644b50beb84 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:29:35 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd90c3f4-dab5-487a-8599-ccc1bd69cb39]: (4, ('Logging out of session [sid: 69, target: iqn.2010-10.org.openstack:3b82d9ea-e726-4a0e-babf-c644b50beb84, portal: 172.16.0.220,3260]\nLogout of [sid: 69, target: iqn.2010-10.org.openstack:3b82d9ea-e726-4a0e-babf-c644b50beb84, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:29:35 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdf80ddb-2705-4d1d-b318-638d6a10cda1 tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 69, target: iqn.2010-10.org.openstack:3b82d9ea-e726-4a0e-babf-c644b50beb84, portal: 172.16.0.220,3260]
Nov 14 10:29:35 user nova-compute[75229]: Logout of [sid: 69, target: iqn.2010-10.org.openstack:3b82d9ea-e726-4a0e-babf-c644b50beb84, portal: 172.16.0.220,3260] successful.
Nov 14 10:29:35 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 10:29:35 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b82d9ea-e726-4a0e-babf-c644b50beb84 -p 172.16.0.220:3260 --op delete {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:29:35 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b82d9ea-e726-4a0e-babf-c644b50beb84 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:29:35 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a0289da-d69b-4bb3-964d-0b78cd857eaa]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:29:35 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdf80ddb-2705-4d1d-b318-638d6a10cda1 tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 10:29:35 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-fdf80ddb-2705-4d1d-b318-638d6a10cda1 tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.292s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 10:29:35 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdf80ddb-2705-4d1d-b318-638d6a10cda1 tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] <== disconnect_volume: return (293ms) None {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 10:29:35 user nova-compute[75229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fdf80ddb-2705-4d1d-b318-638d6a10cda1 tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] [instance: b09bd69f-531c-4e44-a955-c56f0f8ada85] Disconnected iSCSI Volume {{(pid=75229) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 10:29:35 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:29:36 user nova-compute[75229]: DEBUG nova.objects.instance [None req-fdf80ddb-2705-4d1d-b318-638d6a10cda1 tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] Lazy-loading 'flavor' on Instance uuid b09bd69f-531c-4e44-a955-c56f0f8ada85 {{(pid=75229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 10:29:36 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-fdf80ddb-2705-4d1d-b318-638d6a10cda1 tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] Lock "b09bd69f-531c-4e44-a955-c56f0f8ada85" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.621s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:29:38 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:29:43 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 10:29:48 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 10:29:48 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:29:48 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75229) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 10:29:48 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75229) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 10:29:48 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75229) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 10:29:48 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:29:53 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:29:58 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 10:30:03 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:30:06 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-9c5a4641-eda7-4eff-9e91-ae13788309a0 tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] Acquiring lock "b09bd69f-531c-4e44-a955-c56f0f8ada85" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:30:06 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-9c5a4641-eda7-4eff-9e91-ae13788309a0 tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] Lock "b09bd69f-531c-4e44-a955-c56f0f8ada85" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:30:06 user nova-compute[75229]: DEBUG nova.objects.instance [None req-9c5a4641-eda7-4eff-9e91-ae13788309a0 tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] Lazy-loading 'flavor' on Instance uuid b09bd69f-531c-4e44-a955-c56f0f8ada85 {{(pid=75229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 10:30:06 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-9c5a4641-eda7-4eff-9e91-ae13788309a0 tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] Lock "b09bd69f-531c-4e44-a955-c56f0f8ada85" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:30:06 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-9c5a4641-eda7-4eff-9e91-ae13788309a0 tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] Acquiring lock "b09bd69f-531c-4e44-a955-c56f0f8ada85" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:30:06 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-9c5a4641-eda7-4eff-9e91-ae13788309a0 tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] Lock "b09bd69f-531c-4e44-a955-c56f0f8ada85" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:30:06 user nova-compute[75229]: INFO nova.compute.manager [None req-9c5a4641-eda7-4eff-9e91-ae13788309a0 tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] [instance: b09bd69f-531c-4e44-a955-c56f0f8ada85] Attaching volume f4339b91-9f4d-40ae-9dd0-c54e2bf5c2b4 to /dev/vdb
Nov 14 10:30:07 user nova-compute[75229]: DEBUG os_brick.utils [None req-9c5a4641-eda7-4eff-9e91-ae13788309a0 tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 10:30:07 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:30:07 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:30:07 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9d90d5c-9862-40c2-a81d-125569a1fee3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f1154031c835\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:30:07 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:30:07 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:30:07 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2c91db7-b6cb-44e5-ba8f-05000d94e735]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:30:07 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:30:07 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:30:07 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d774150-63eb-42a5-9b40-f90b298e9c14]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:30:07 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[82c86e56-8fd2-4f31-9ccf-cb3e9dbf368a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:30:07 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-9c5a4641-eda7-4eff-9e91-ae13788309a0 tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] Running cmd (subprocess): nvme version {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:30:07 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-9c5a4641-eda7-4eff-9e91-ae13788309a0 tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] 'nvme version' failed. Not Retrying. {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 10:30:07 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9c5a4641-eda7-4eff-9e91-ae13788309a0 tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] nvme not present on system {{(pid=75229) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 10:30:07 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:30:07 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 10:30:07 user nova-compute[75229]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 10:30:07 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3a3ab2a-fff8-444f-9bf3-188f21a0c655]: (4, '') {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:30:07 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.lightos [None req-9c5a4641-eda7-4eff-9e91-ae13788309a0 tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75229) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 10:30:07 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.lightos [None req-9c5a4641-eda7-4eff-9e91-ae13788309a0 tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75229) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 10:30:07 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.lightos [None req-9c5a4641-eda7-4eff-9e91-ae13788309a0 tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] LIGHTOS: no hostnqn found. {{(pid=75229) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 10:30:07 user nova-compute[75229]: DEBUG os_brick.utils [None req-9c5a4641-eda7-4eff-9e91-ae13788309a0 tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f1154031c835', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 10:30:07 user nova-compute[75229]: DEBUG nova.virt.block_device [None req-9c5a4641-eda7-4eff-9e91-ae13788309a0 tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] [instance: b09bd69f-531c-4e44-a955-c56f0f8ada85] Updating existing volume attachment record: eb660387-eb64-4140-b262-86fde1ebcc11 {{(pid=75229) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 10:30:08 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 10:30:08 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:30:08 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75229) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 10:30:08 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75229) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 10:30:08 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75229) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 10:30:08 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:30:09 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:30:11 user nova-compute[75229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9c5a4641-eda7-4eff-9e91-ae13788309a0 tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] [instance: b09bd69f-531c-4e44-a955-c56f0f8ada85] Calling os-brick to attach iSCSI Volume {{(pid=75229) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 10:30:11 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c5a4641-eda7-4eff-9e91-ae13788309a0 tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f73f85151b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f4339b91-9f4d-40ae-9dd0-c54e2bf5c2b4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kwmHTEQo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 10:30:11 user nova-compute[75229]: WARNING os_brick.initiator.connectors.base [None req-9c5a4641-eda7-4eff-9e91-ae13788309a0 tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 10:30:11 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-9c5a4641-eda7-4eff-9e91-ae13788309a0 tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 10:30:11 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-9c5a4641-eda7-4eff-9e91-ae13788309a0 tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 10:30:11 user nova-compute[75229]: WARNING os_brick.initiator.connectors.base [None req-9c5a4641-eda7-4eff-9e91-ae13788309a0 tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 10:30:11 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-9c5a4641-eda7-4eff-9e91-ae13788309a0 tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f4339b91-9f4d-40ae-9dd0-c54e2bf5c2b4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 10:30:11 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-9c5a4641-eda7-4eff-9e91-ae13788309a0 tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f4339b91-9f4d-40ae-9dd0-c54e2bf5c2b4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 10:30:11 user nova-compute[75229]: INFO os_brick.initiator.connectors.iscsi [None req-9c5a4641-eda7-4eff-9e91-ae13788309a0 tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 10:30:11 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4339b91-9f4d-40ae-9dd0-c54e2bf5c2b4 -p 172.16.0.220:3260 {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:30:11 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4339b91-9f4d-40ae-9dd0-c54e2bf5c2b4 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:30:11 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdab5756-671d-4eea-b350-8cbc44aabf12]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:30:11 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c5a4641-eda7-4eff-9e91-ae13788309a0 tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 10:30:11 user nova-compute[75229]:  {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 10:30:11 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4339b91-9f4d-40ae-9dd0-c54e2bf5c2b4 -p 172.16.0.220:3260 --interface default --op new {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:30:11 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4339b91-9f4d-40ae-9dd0-c54e2bf5c2b4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:30:11 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c6dd160-7f9c-47f9-a0dd-c953734a44b6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f4339b91-9f4d-40ae-9dd0-c54e2bf5c2b4] added\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:30:11 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c5a4641-eda7-4eff-9e91-ae13788309a0 tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f4339b91-9f4d-40ae-9dd0-c54e2bf5c2b4] added
Nov 14 10:30:11 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 10:30:11 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4339b91-9f4d-40ae-9dd0-c54e2bf5c2b4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:30:11 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4339b91-9f4d-40ae-9dd0-c54e2bf5c2b4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:30:11 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3486fdc-af0e-4686-a23b-b4c3305a9219]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:30:11 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c5a4641-eda7-4eff-9e91-ae13788309a0 tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 10:30:11 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4339b91-9f4d-40ae-9dd0-c54e2bf5c2b4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:30:11 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4339b91-9f4d-40ae-9dd0-c54e2bf5c2b4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:30:11 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[919c9421-4797-4429-8463-f6fa55caf9d2]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:30:11 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c5a4641-eda7-4eff-9e91-ae13788309a0 tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 10:30:11 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4339b91-9f4d-40ae-9dd0-c54e2bf5c2b4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kwmHTEQo {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:30:11 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4339b91-9f4d-40ae-9dd0-c54e2bf5c2b4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kwmHTEQo" returned: 0 in 0.024s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:30:11 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b63f555-4b89-4137-9776-09d110f4b39e]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:30:11 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c5a4641-eda7-4eff-9e91-ae13788309a0 tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'kwmHTEQo'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 10:30:11 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4339b91-9f4d-40ae-9dd0-c54e2bf5c2b4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:30:11 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4339b91-9f4d-40ae-9dd0-c54e2bf5c2b4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:30:11 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2400b18-5815-4aab-b735-aa02711e2713]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:30:11 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c5a4641-eda7-4eff-9e91-ae13788309a0 tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 10:30:11 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:30:11 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.015s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:30:11 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[7796ec75-f7ab-4914-bf59-9ca3b2999f5b]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:30:11 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c5a4641-eda7-4eff-9e91-ae13788309a0 tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 14 10:30:11 user nova-compute[75229]:  {{(pid=75229) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 10:30:11 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c5a4641-eda7-4eff-9e91-ae13788309a0 tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 14 10:30:11 user nova-compute[75229]:  {{(pid=75229) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 10:30:11 user nova-compute[75229]: WARNING os_brick.initiator.connectors.iscsi [None req-9c5a4641-eda7-4eff-9e91-ae13788309a0 tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 14 10:30:11 user nova-compute[75229]: 
Nov 14 10:30:11 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4339b91-9f4d-40ae-9dd0-c54e2bf5c2b4 -p 172.16.0.220:3260 --login {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:30:11 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4339b91-9f4d-40ae-9dd0-c54e2bf5c2b4 -p 172.16.0.220:3260 --login" returned: 0 in 0.047s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:30:11 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e851974-e7f7-4638-870e-aac20e91b86d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f4339b91-9f4d-40ae-9dd0-c54e2bf5c2b4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f4339b91-9f4d-40ae-9dd0-c54e2bf5c2b4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:30:11 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c5a4641-eda7-4eff-9e91-ae13788309a0 tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f4339b91-9f4d-40ae-9dd0-c54e2bf5c2b4, portal: 172.16.0.220,3260]
Nov 14 10:30:11 user nova-compute[75229]: Login to [iface: default, target: iqn.2010-10.org.openstack:f4339b91-9f4d-40ae-9dd0-c54e2bf5c2b4, portal: 172.16.0.220,3260] successful.
Nov 14 10:30:11 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 10:30:11 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4339b91-9f4d-40ae-9dd0-c54e2bf5c2b4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:30:11 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4339b91-9f4d-40ae-9dd0-c54e2bf5c2b4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.061s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:30:11 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[dde1e093-dc1e-49ac-aa4c-8b841cc8faee]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:30:11 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c5a4641-eda7-4eff-9e91-ae13788309a0 tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 10:30:11 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:30:11 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:30:11 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[36f0c4b9-37e2-489a-80f8-ac062701ff4a]: (4, ('tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4339b91-9f4d-40ae-9dd0-c54e2bf5c2b4 (non-flash)\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:30:11 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c5a4641-eda7-4eff-9e91-ae13788309a0 tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4339b91-9f4d-40ae-9dd0-c54e2bf5c2b4 (non-flash)
Nov 14 10:30:11 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 10:30:11 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c5a4641-eda7-4eff-9e91-ae13788309a0 tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] iscsi session list stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4339b91-9f4d-40ae-9dd0-c54e2bf5c2b4 (non-flash)
Nov 14 10:30:11 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 10:30:11 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-9c5a4641-eda7-4eff-9e91-ae13788309a0 tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f4339b91-9f4d-40ae-9dd0-c54e2bf5c2b4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.293s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 10:30:11 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c5a4641-eda7-4eff-9e91-ae13788309a0 tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] Connected to 172.16.0.220:3260 {{(pid=75229) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 10:30:11 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-9c5a4641-eda7-4eff-9e91-ae13788309a0 tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] HCTL ('33', '-', '-', 0) found on session 70 with lun 0 {{(pid=75229) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 10:30:11 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-9c5a4641-eda7-4eff-9e91-ae13788309a0 tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75229) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 10:30:11 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:30:11 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:30:11 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[14a308ad-5359-4fce-a7e1-08dc9b599b21]: (4, ('- - 0', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:30:11 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-9c5a4641-eda7-4eff-9e91-ae13788309a0 tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] Searching for a device in session 70 and hctl ['33', '*', '*', 0] yield: None {{(pid=75229) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 10:30:12 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-9c5a4641-eda7-4eff-9e91-ae13788309a0 tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] Searching for a device in session 70 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75229) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 10:30:12 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c5a4641-eda7-4eff-9e91-ae13788309a0 tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:f4339b91-9f4d-40ae-9dd0-c54e2bf5c2b4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kwmHTEQo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75229) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 10:30:12 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-9c5a4641-eda7-4eff-9e91-ae13788309a0 tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.323s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 10:30:12 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c5a4641-eda7-4eff-9e91-ae13788309a0 tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] <== connect_volume: return (1324ms) {'type': 'block', 'scsi_wwn': '26263643434623436', 'path': '/dev/sdb'} {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 10:30:12 user nova-compute[75229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9c5a4641-eda7-4eff-9e91-ae13788309a0 tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] [instance: b09bd69f-531c-4e44-a955-c56f0f8ada85] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26263643434623436', 'path': '/dev/sdb'} {{(pid=75229) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 10:30:12 user nova-compute[75229]: DEBUG nova.objects.instance [None req-9c5a4641-eda7-4eff-9e91-ae13788309a0 tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] Lazy-loading 'flavor' on Instance uuid b09bd69f-531c-4e44-a955-c56f0f8ada85 {{(pid=75229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 10:30:12 user nova-compute[75229]: DEBUG nova.virt.libvirt.guest [None req-9c5a4641-eda7-4eff-9e91-ae13788309a0 tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 10:30:12 user nova-compute[75229]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 10:30:12 user nova-compute[75229]:   <source dev="/dev/sdb"/>
Nov 14 10:30:12 user nova-compute[75229]:   <target dev="vdb" bus="virtio"/>
Nov 14 10:30:12 user nova-compute[75229]:   <serial>f4339b91-9f4d-40ae-9dd0-c54e2bf5c2b4</serial>
Nov 14 10:30:12 user nova-compute[75229]: </disk>
Nov 14 10:30:12 user nova-compute[75229]:  {{(pid=75229) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 10:30:13 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-9c5a4641-eda7-4eff-9e91-ae13788309a0 tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] No BDM found with device name vda, not building metadata. {{(pid=75229) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 10:30:13 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-9c5a4641-eda7-4eff-9e91-ae13788309a0 tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75229) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 10:30:13 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-9c5a4641-eda7-4eff-9e91-ae13788309a0 tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] No VIF found with MAC fa:16:3e:8a:62:dc, not building metadata {{(pid=75229) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 10:30:13 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-9c5a4641-eda7-4eff-9e91-ae13788309a0 tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] Lock "b09bd69f-531c-4e44-a955-c56f0f8ada85" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.345s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:30:13 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:30:14 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:30:14 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-3935c497-8431-4a16-91fd-f7a6fe78f38b tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] Acquiring lock "b09bd69f-531c-4e44-a955-c56f0f8ada85" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:30:14 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-3935c497-8431-4a16-91fd-f7a6fe78f38b tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] Lock "b09bd69f-531c-4e44-a955-c56f0f8ada85" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:30:14 user nova-compute[75229]: INFO nova.compute.manager [None req-3935c497-8431-4a16-91fd-f7a6fe78f38b tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] [instance: b09bd69f-531c-4e44-a955-c56f0f8ada85] Detaching volume f4339b91-9f4d-40ae-9dd0-c54e2bf5c2b4
Nov 14 10:30:15 user nova-compute[75229]: INFO nova.virt.block_device [None req-3935c497-8431-4a16-91fd-f7a6fe78f38b tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] [instance: b09bd69f-531c-4e44-a955-c56f0f8ada85] Attempting to driver detach volume f4339b91-9f4d-40ae-9dd0-c54e2bf5c2b4 from mountpoint /dev/vdb
Nov 14 10:30:15 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-3935c497-8431-4a16-91fd-f7a6fe78f38b tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] Attempting to detach device vdb from instance b09bd69f-531c-4e44-a955-c56f0f8ada85 from the persistent domain config. {{(pid=75229) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 10:30:15 user nova-compute[75229]: DEBUG nova.virt.libvirt.guest [None req-3935c497-8431-4a16-91fd-f7a6fe78f38b tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 10:30:15 user nova-compute[75229]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 10:30:15 user nova-compute[75229]:   <source dev="/dev/sdb"/>
Nov 14 10:30:15 user nova-compute[75229]:   <target dev="vdb" bus="virtio"/>
Nov 14 10:30:15 user nova-compute[75229]:   <serial>f4339b91-9f4d-40ae-9dd0-c54e2bf5c2b4</serial>
Nov 14 10:30:15 user nova-compute[75229]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 10:30:15 user nova-compute[75229]: </disk>
Nov 14 10:30:15 user nova-compute[75229]:  {{(pid=75229) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 10:30:15 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-3935c497-8431-4a16-91fd-f7a6fe78f38b tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] Successfully detached device vdb from instance b09bd69f-531c-4e44-a955-c56f0f8ada85 from the persistent domain config.
Nov 14 10:30:15 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-3935c497-8431-4a16-91fd-f7a6fe78f38b tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance b09bd69f-531c-4e44-a955-c56f0f8ada85 from the live domain config. {{(pid=75229) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 10:30:15 user nova-compute[75229]: DEBUG nova.virt.libvirt.guest [None req-3935c497-8431-4a16-91fd-f7a6fe78f38b tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 10:30:15 user nova-compute[75229]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 10:30:15 user nova-compute[75229]:   <source dev="/dev/sdb"/>
Nov 14 10:30:15 user nova-compute[75229]:   <target dev="vdb" bus="virtio"/>
Nov 14 10:30:15 user nova-compute[75229]:   <serial>f4339b91-9f4d-40ae-9dd0-c54e2bf5c2b4</serial>
Nov 14 10:30:15 user nova-compute[75229]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 10:30:15 user nova-compute[75229]: </disk>
Nov 14 10:30:15 user nova-compute[75229]:  {{(pid=75229) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 10:30:15 user nova-compute[75229]: DEBUG nova.virt.libvirt.driver [None req-3935c497-8431-4a16-91fd-f7a6fe78f38b tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance b09bd69f-531c-4e44-a955-c56f0f8ada85 {{(pid=75229) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 10:30:19 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:30:19 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:30:20 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:30:20 user nova-compute[75229]: DEBUG nova.compute.manager [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Starting heal instance info cache {{(pid=75229) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 10:30:20 user nova-compute[75229]: DEBUG nova.compute.manager [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Rebuilding the list of instances to heal {{(pid=75229) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 10:30:20 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Acquiring lock "refresh_cache-b09bd69f-531c-4e44-a955-c56f0f8ada85" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 10:30:20 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Acquired lock "refresh_cache-b09bd69f-531c-4e44-a955-c56f0f8ada85" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 10:30:20 user nova-compute[75229]: DEBUG nova.network.neutron [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] [instance: b09bd69f-531c-4e44-a955-c56f0f8ada85] Forcefully refreshing network info cache for instance {{(pid=75229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 10:30:20 user nova-compute[75229]: DEBUG nova.objects.instance [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Lazy-loading 'info_cache' on Instance uuid b09bd69f-531c-4e44-a955-c56f0f8ada85 {{(pid=75229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 10:30:21 user nova-compute[75229]: DEBUG nova.network.neutron [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] [instance: b09bd69f-531c-4e44-a955-c56f0f8ada85] Updating instance_info_cache with network_info: [{"id": "a47c7541-2bcf-4288-a237-90e2b1439d20", "address": "fa:16:3e:8a:62:dc", "network": {"id": "faebf0c9-ac3b-4877-b8c0-683ac8c6952d", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1933420959-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "91aa3be89afe4855b8918caa5fc35e47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa47c7541-2b", "ovs_interfaceid": "a47c7541-2bcf-4288-a237-90e2b1439d20", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 10:30:21 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Releasing lock "refresh_cache-b09bd69f-531c-4e44-a955-c56f0f8ada85" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 10:30:21 user nova-compute[75229]: DEBUG nova.compute.manager [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] [instance: b09bd69f-531c-4e44-a955-c56f0f8ada85] Updated the network info_cache for instance {{(pid=75229) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 10:30:24 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:30:24 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:30:24 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:30:28 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:30:29 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 10:30:29 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:30:29 user nova-compute[75229]: DEBUG nova.compute.manager [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75229) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 10:30:33 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:30:33 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:30:33 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:30:33 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:30:33 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:30:33 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Auditing locally available compute resources for user (node: user) {{(pid=75229) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 10:30:33 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b09bd69f-531c-4e44-a955-c56f0f8ada85/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:30:33 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b09bd69f-531c-4e44-a955-c56f0f8ada85/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:30:34 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b09bd69f-531c-4e44-a955-c56f0f8ada85/disk --force-share --output=json {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:30:34 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:30:34 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b09bd69f-531c-4e44-a955-c56f0f8ada85/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:30:34 user nova-compute[75229]: WARNING nova.virt.libvirt.driver [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 10:30:34 user nova-compute[75229]: WARNING nova.virt.libvirt.driver [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 10:30:34 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Hypervisor/Node resource view: name=user free_ram=9013MB free_disk=25.108562469482422GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75229) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 10:30:34 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:30:34 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:30:34 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Instance b09bd69f-531c-4e44-a955-c56f0f8ada85 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 10:30:34 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75229) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 10:30:34 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75229) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 10:30:34 user nova-compute[75229]: DEBUG nova.scheduler.client.report [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Refreshing inventories for resource provider d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 {{(pid=75229) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 14 10:30:34 user nova-compute[75229]: DEBUG nova.scheduler.client.report [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Updating ProviderTree inventory for provider d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75229) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 14 10:30:34 user nova-compute[75229]: DEBUG nova.compute.provider_tree [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Updating inventory in ProviderTree for provider d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 14 10:30:34 user nova-compute[75229]: DEBUG nova.scheduler.client.report [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Refreshing aggregate associations for resource provider d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3, aggregates: None {{(pid=75229) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 14 10:30:34 user nova-compute[75229]: DEBUG nova.scheduler.client.report [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Refreshing trait associations for resource provider d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3, traits: COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_MMX,HW_CPU_X86_SSE42,HW_CPU_X86_SSSE3,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_TRUSTED_CERTS,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSE,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_USB,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_RESCUE_BFV {{(pid=75229) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 14 10:30:35 user nova-compute[75229]: DEBUG nova.compute.provider_tree [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Inventory has not changed in ProviderTree for provider: d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 {{(pid=75229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 10:30:35 user nova-compute[75229]: DEBUG nova.scheduler.client.report [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Inventory has not changed for provider d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 10:30:35 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Compute_service record updated for user:user {{(pid=75229) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 10:30:35 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.497s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:30:35 user nova-compute[75229]: WARNING nova.virt.libvirt.driver [None req-3935c497-8431-4a16-91fd-f7a6fe78f38b tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance b09bd69f-531c-4e44-a955-c56f0f8ada85 is timed out.
Nov 14 10:30:35 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-3935c497-8431-4a16-91fd-f7a6fe78f38b tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] Successfully detached device vdb from instance b09bd69f-531c-4e44-a955-c56f0f8ada85 from the live domain config.
Nov 14 10:30:35 user nova-compute[75229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3935c497-8431-4a16-91fd-f7a6fe78f38b tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] [instance: b09bd69f-531c-4e44-a955-c56f0f8ada85] calling os-brick to detach iSCSI Volume {{(pid=75229) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 10:30:35 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-3935c497-8431-4a16-91fd-f7a6fe78f38b tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f73f85151b0>, {'target_iqn': 'iqn.2010-10.org.openstack:f4339b91-9f4d-40ae-9dd0-c54e2bf5c2b4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kwmHTEQo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 10:30:35 user nova-compute[75229]: WARNING os_brick.initiator.connectors.base [None req-3935c497-8431-4a16-91fd-f7a6fe78f38b tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 10:30:35 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-3935c497-8431-4a16-91fd-f7a6fe78f38b tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 10:30:35 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-3935c497-8431-4a16-91fd-f7a6fe78f38b tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 10:30:35 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:30:35 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:30:35 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c2573a7-cd96-4a7e-9901-486ced996f9d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f4339b91-9f4d-40ae-9dd0-c54e2bf5c2b4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:30:35 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-3935c497-8431-4a16-91fd-f7a6fe78f38b tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 10:30:35 user nova-compute[75229]: No targets found.
Nov 14 10:30:35 user nova-compute[75229]: iSNS:
Nov 14 10:30:35 user nova-compute[75229]: No targets found.
Nov 14 10:30:35 user nova-compute[75229]: STATIC:
Nov 14 10:30:35 user nova-compute[75229]: Target: iqn.2010-10.org.openstack:f4339b91-9f4d-40ae-9dd0-c54e2bf5c2b4
Nov 14 10:30:35 user nova-compute[75229]:         Portal: 172.16.0.220:3260,-1
Nov 14 10:30:35 user nova-compute[75229]:                 Iface Name: default
Nov 14 10:30:35 user nova-compute[75229]: FIRMWARE:
Nov 14 10:30:35 user nova-compute[75229]: No targets found.
Nov 14 10:30:35 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 10:30:35 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-3935c497-8431-4a16-91fd-f7a6fe78f38b tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 10:30:35 user nova-compute[75229]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 10:30:35 user nova-compute[75229]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75229) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 10:30:35 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-3935c497-8431-4a16-91fd-f7a6fe78f38b tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f4339b91-9f4d-40ae-9dd0-c54e2bf5c2b4', 0)] {{(pid=75229) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 10:30:35 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:30:35 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:30:35 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[5991d858-af60-427c-97d0-cc52b0b34f81]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f4339b91-9f4d-40ae-9dd0-c54e2bf5c2b4\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:30:35 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:30:35 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:30:35 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[164426dc-5439-46e5-a2b2-c7426b538519]: (4, ('tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4339b91-9f4d-40ae-9dd0-c54e2bf5c2b4 (non-flash)\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:30:35 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-3935c497-8431-4a16-91fd-f7a6fe78f38b tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4339b91-9f4d-40ae-9dd0-c54e2bf5c2b4 (non-flash)
Nov 14 10:30:35 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 10:30:35 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-3935c497-8431-4a16-91fd-f7a6fe78f38b tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] iscsi session list stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4339b91-9f4d-40ae-9dd0-c54e2bf5c2b4 (non-flash)
Nov 14 10:30:35 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 10:30:35 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-3935c497-8431-4a16-91fd-f7a6fe78f38b tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f73d4c52200>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f4339b91-9f4d-40ae-9dd0-c54e2bf5c2b4'): ({'sdb'}, set())}) {{(pid=75229) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 10:30:35 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-3935c497-8431-4a16-91fd-f7a6fe78f38b tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] Removing single pathed devices sdb {{(pid=75229) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 10:30:35 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:30:35 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:30:35 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[65cdffe7-fa39-4e5e-9171-39bf71e02ca1]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:30:35 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:30:35 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:30:35 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c38216f-d9f5-4759-9cf8-8ff8f9510e2b]: (4, ('ok\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:30:35 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-3935c497-8431-4a16-91fd-f7a6fe78f38b tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] Flushing IO for device /dev/sdb {{(pid=75229) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 10:30:35 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:30:35 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.018s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:30:35 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dc63e74-a0fe-4db6-bb1a-2d8e3d698fd8]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:30:35 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-3935c497-8431-4a16-91fd-f7a6fe78f38b tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75229) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 10:30:35 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:30:35 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.046s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:30:35 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[73e3aabd-f56a-4600-9400-8fa51b1a9568]: (4, ('1', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:30:35 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-3935c497-8431-4a16-91fd-f7a6fe78f38b tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75229) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 10:30:35 user nova-compute[75229]: DEBUG os_brick.initiator.linuxscsi [None req-3935c497-8431-4a16-91fd-f7a6fe78f38b tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] SCSI volumes sdb have been removed. {{(pid=75229) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 10:30:35 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-3935c497-8431-4a16-91fd-f7a6fe78f38b tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f4339b91-9f4d-40ae-9dd0-c54e2bf5c2b4')] {{(pid=75229) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 10:30:35 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4339b91-9f4d-40ae-9dd0-c54e2bf5c2b4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:30:35 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4339b91-9f4d-40ae-9dd0-c54e2bf5c2b4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:30:35 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[150dcd29-02bc-4c6b-9d1e-2088f42d4b16]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:30:35 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-3935c497-8431-4a16-91fd-f7a6fe78f38b tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 10:30:35 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4339b91-9f4d-40ae-9dd0-c54e2bf5c2b4 -p 172.16.0.220:3260 --logout {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:30:35 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4339b91-9f4d-40ae-9dd0-c54e2bf5c2b4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:30:35 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e1aaf94-fad4-43fa-8a2a-ba0d09473480]: (4, ('Logging out of session [sid: 70, target: iqn.2010-10.org.openstack:f4339b91-9f4d-40ae-9dd0-c54e2bf5c2b4, portal: 172.16.0.220,3260]\nLogout of [sid: 70, target: iqn.2010-10.org.openstack:f4339b91-9f4d-40ae-9dd0-c54e2bf5c2b4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:30:35 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-3935c497-8431-4a16-91fd-f7a6fe78f38b tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 70, target: iqn.2010-10.org.openstack:f4339b91-9f4d-40ae-9dd0-c54e2bf5c2b4, portal: 172.16.0.220,3260]
Nov 14 10:30:35 user nova-compute[75229]: Logout of [sid: 70, target: iqn.2010-10.org.openstack:f4339b91-9f4d-40ae-9dd0-c54e2bf5c2b4, portal: 172.16.0.220,3260] successful.
Nov 14 10:30:35 user nova-compute[75229]:  stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 10:30:35 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4339b91-9f4d-40ae-9dd0-c54e2bf5c2b4 -p 172.16.0.220:3260 --op delete {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 10:30:35 user nova-compute[75229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4339b91-9f4d-40ae-9dd0-c54e2bf5c2b4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 10:30:35 user nova-compute[75229]: DEBUG oslo.privsep.daemon [-] privsep: reply[d22a7b2c-21a6-4a35-9ef8-8b4b141b1527]: (4, ('', '')) {{(pid=86458) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 10:30:35 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-3935c497-8431-4a16-91fd-f7a6fe78f38b tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75229) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 10:30:35 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.base [None req-3935c497-8431-4a16-91fd-f7a6fe78f38b tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.295s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 10:30:35 user nova-compute[75229]: DEBUG os_brick.initiator.connectors.iscsi [None req-3935c497-8431-4a16-91fd-f7a6fe78f38b tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] <== disconnect_volume: return (296ms) None {{(pid=75229) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 10:30:35 user nova-compute[75229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3935c497-8431-4a16-91fd-f7a6fe78f38b tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] [instance: b09bd69f-531c-4e44-a955-c56f0f8ada85] Disconnected iSCSI Volume {{(pid=75229) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 10:30:36 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:30:36 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:30:36 user nova-compute[75229]: DEBUG nova.objects.instance [None req-3935c497-8431-4a16-91fd-f7a6fe78f38b tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] Lazy-loading 'flavor' on Instance uuid b09bd69f-531c-4e44-a955-c56f0f8ada85 {{(pid=75229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 10:30:36 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-3935c497-8431-4a16-91fd-f7a6fe78f38b tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] Lock "b09bd69f-531c-4e44-a955-c56f0f8ada85" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.647s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:30:39 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 10:30:39 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:30:39 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75229) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 10:30:39 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75229) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 10:30:39 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75229) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 10:30:39 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:30:40 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:30:40 user nova-compute[75229]: DEBUG nova.compute.manager [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Cleaning up deleted instances {{(pid=75229) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 14 10:30:40 user nova-compute[75229]: DEBUG nova.compute.manager [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] There are 0 instances to clean {{(pid=75229) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 14 10:30:44 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 10:30:44 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:30:44 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75229) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 10:30:44 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75229) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 10:30:44 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75229) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 10:30:44 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:30:46 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:30:46 user nova-compute[75229]: DEBUG nova.compute.manager [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75229) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 14 10:30:48 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:30:49 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:30:51 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:30:54 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 10:30:54 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:30:54 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75229) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 10:30:54 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75229) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 10:30:54 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75229) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 10:30:54 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:30:59 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 10:31:04 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:31:09 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 10:31:14 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 10:31:14 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:31:14 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75229) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 10:31:14 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75229) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 10:31:14 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75229) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 10:31:14 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:31:17 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-d913be1d-8fa8-4996-b14a-a1fe84554378 tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] Acquiring lock "b09bd69f-531c-4e44-a955-c56f0f8ada85" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:31:17 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-d913be1d-8fa8-4996-b14a-a1fe84554378 tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] Lock "b09bd69f-531c-4e44-a955-c56f0f8ada85" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:31:17 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-d913be1d-8fa8-4996-b14a-a1fe84554378 tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] Acquiring lock "b09bd69f-531c-4e44-a955-c56f0f8ada85-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:31:17 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-d913be1d-8fa8-4996-b14a-a1fe84554378 tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] Lock "b09bd69f-531c-4e44-a955-c56f0f8ada85-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:31:17 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-d913be1d-8fa8-4996-b14a-a1fe84554378 tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] Lock "b09bd69f-531c-4e44-a955-c56f0f8ada85-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:31:17 user nova-compute[75229]: INFO nova.compute.manager [None req-d913be1d-8fa8-4996-b14a-a1fe84554378 tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] [instance: b09bd69f-531c-4e44-a955-c56f0f8ada85] Terminating instance
Nov 14 10:31:17 user nova-compute[75229]: DEBUG nova.compute.manager [None req-d913be1d-8fa8-4996-b14a-a1fe84554378 tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] [instance: b09bd69f-531c-4e44-a955-c56f0f8ada85] Start destroying the instance on the hypervisor. {{(pid=75229) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 10:31:17 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:31:18 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:31:18 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:31:18 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:31:18 user nova-compute[75229]: DEBUG nova.compute.manager [req-de21dcc1-3af4-45e5-a92e-08ceeab3aae2 req-e9271332-75b8-426a-91f4-ab3bcec6fcf0 service nova] [instance: b09bd69f-531c-4e44-a955-c56f0f8ada85] Received event network-vif-unplugged-a47c7541-2bcf-4288-a237-90e2b1439d20 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 10:31:18 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-de21dcc1-3af4-45e5-a92e-08ceeab3aae2 req-e9271332-75b8-426a-91f4-ab3bcec6fcf0 service nova] Acquiring lock "b09bd69f-531c-4e44-a955-c56f0f8ada85-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:31:18 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-de21dcc1-3af4-45e5-a92e-08ceeab3aae2 req-e9271332-75b8-426a-91f4-ab3bcec6fcf0 service nova] Lock "b09bd69f-531c-4e44-a955-c56f0f8ada85-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:31:18 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-de21dcc1-3af4-45e5-a92e-08ceeab3aae2 req-e9271332-75b8-426a-91f4-ab3bcec6fcf0 service nova] Lock "b09bd69f-531c-4e44-a955-c56f0f8ada85-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:31:18 user nova-compute[75229]: DEBUG nova.compute.manager [req-de21dcc1-3af4-45e5-a92e-08ceeab3aae2 req-e9271332-75b8-426a-91f4-ab3bcec6fcf0 service nova] [instance: b09bd69f-531c-4e44-a955-c56f0f8ada85] No waiting events found dispatching network-vif-unplugged-a47c7541-2bcf-4288-a237-90e2b1439d20 {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 10:31:18 user nova-compute[75229]: DEBUG nova.compute.manager [req-de21dcc1-3af4-45e5-a92e-08ceeab3aae2 req-e9271332-75b8-426a-91f4-ab3bcec6fcf0 service nova] [instance: b09bd69f-531c-4e44-a955-c56f0f8ada85] Received event network-vif-unplugged-a47c7541-2bcf-4288-a237-90e2b1439d20 for instance with task_state deleting. {{(pid=75229) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 10:31:18 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:31:18 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:31:18 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:31:18 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:31:18 user nova-compute[75229]: INFO nova.virt.libvirt.driver [-] [instance: b09bd69f-531c-4e44-a955-c56f0f8ada85] Instance destroyed successfully.
Nov 14 10:31:18 user nova-compute[75229]: DEBUG nova.objects.instance [None req-d913be1d-8fa8-4996-b14a-a1fe84554378 tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] Lazy-loading 'resources' on Instance uuid b09bd69f-531c-4e44-a955-c56f0f8ada85 {{(pid=75229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 10:31:18 user nova-compute[75229]: DEBUG nova.virt.libvirt.vif [None req-d913be1d-8fa8-4996-b14a-a1fe84554378 tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T10:25:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-2088060708',display_name='tempest-SnapshotDataIntegrityTests-server-2088060708',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-2088060708',id=53,image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCSqI4lJeBv3ZeLKxCO/TS3GXep/rRFs2aGUWTjWKXcekDooFqbCccD9ZrbS95+X1fObChqL3N8b2rtBuiF4BvEgLeOMj4oxIg8FHWdTMJcvj6YhEHnZbrdpm6PWbbjJBw==',key_name='tempest-keypair-780290131',keypairs=<?>,launch_index=0,launched_at=2023-11-14T10:25:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='91aa3be89afe4855b8918caa5fc35e47',ramdisk_id='',reservation_id='r-ka8rfhq5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3bef8470-ecc7-40e3-95d4-9254348ea72d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-1621425388',owner_user_name='tempest-SnapshotDataIntegrityTests-1621425388-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T10:25:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1b57ea954ff54894bf9e327b80142003',uuid=b09bd69f-531c-4e44-a955-c56f0f8ada85,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a47c7541-2bcf-4288-a237-90e2b1439d20", "address": "fa:16:3e:8a:62:dc", "network": {"id": "faebf0c9-ac3b-4877-b8c0-683ac8c6952d", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1933420959-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "91aa3be89afe4855b8918caa5fc35e47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa47c7541-2b", "ovs_interfaceid": "a47c7541-2bcf-4288-a237-90e2b1439d20", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 10:31:18 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-d913be1d-8fa8-4996-b14a-a1fe84554378 tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] Converting VIF {"id": "a47c7541-2bcf-4288-a237-90e2b1439d20", "address": "fa:16:3e:8a:62:dc", "network": {"id": "faebf0c9-ac3b-4877-b8c0-683ac8c6952d", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1933420959-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "91aa3be89afe4855b8918caa5fc35e47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa47c7541-2b", "ovs_interfaceid": "a47c7541-2bcf-4288-a237-90e2b1439d20", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 10:31:18 user nova-compute[75229]: DEBUG nova.network.os_vif_util [None req-d913be1d-8fa8-4996-b14a-a1fe84554378 tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8a:62:dc,bridge_name='br-int',has_traffic_filtering=True,id=a47c7541-2bcf-4288-a237-90e2b1439d20,network=Network(faebf0c9-ac3b-4877-b8c0-683ac8c6952d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa47c7541-2b') {{(pid=75229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 10:31:18 user nova-compute[75229]: DEBUG os_vif [None req-d913be1d-8fa8-4996-b14a-a1fe84554378 tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8a:62:dc,bridge_name='br-int',has_traffic_filtering=True,id=a47c7541-2bcf-4288-a237-90e2b1439d20,network=Network(faebf0c9-ac3b-4877-b8c0-683ac8c6952d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa47c7541-2b') {{(pid=75229) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 10:31:18 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:31:18 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:31:18 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa47c7541-2b, bridge=br-int, if_exists=True) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 10:31:18 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:31:18 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 10:31:18 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:31:18 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7d02a4ce-0a2a-4744-9846-e9c1c72723ab) {{(pid=75229) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 10:31:18 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:31:18 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 10:31:18 user nova-compute[75229]: INFO os_vif [None req-d913be1d-8fa8-4996-b14a-a1fe84554378 tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8a:62:dc,bridge_name='br-int',has_traffic_filtering=True,id=a47c7541-2bcf-4288-a237-90e2b1439d20,network=Network(faebf0c9-ac3b-4877-b8c0-683ac8c6952d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa47c7541-2b')
Nov 14 10:31:18 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-d913be1d-8fa8-4996-b14a-a1fe84554378 tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] [instance: b09bd69f-531c-4e44-a955-c56f0f8ada85] Deleting instance files /opt/stack/data/nova/instances/b09bd69f-531c-4e44-a955-c56f0f8ada85_del
Nov 14 10:31:18 user nova-compute[75229]: INFO nova.virt.libvirt.driver [None req-d913be1d-8fa8-4996-b14a-a1fe84554378 tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] [instance: b09bd69f-531c-4e44-a955-c56f0f8ada85] Deletion of /opt/stack/data/nova/instances/b09bd69f-531c-4e44-a955-c56f0f8ada85_del complete
Nov 14 10:31:18 user nova-compute[75229]: INFO nova.compute.manager [None req-d913be1d-8fa8-4996-b14a-a1fe84554378 tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] [instance: b09bd69f-531c-4e44-a955-c56f0f8ada85] Took 0.89 seconds to destroy the instance on the hypervisor.
Nov 14 10:31:18 user nova-compute[75229]: DEBUG oslo.service.loopingcall [None req-d913be1d-8fa8-4996-b14a-a1fe84554378 tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75229) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 10:31:18 user nova-compute[75229]: DEBUG nova.compute.manager [-] [instance: b09bd69f-531c-4e44-a955-c56f0f8ada85] Deallocating network for instance {{(pid=75229) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 10:31:18 user nova-compute[75229]: DEBUG nova.network.neutron [-] [instance: b09bd69f-531c-4e44-a955-c56f0f8ada85] deallocate_for_instance() {{(pid=75229) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 10:31:19 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:31:19 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:31:19 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:31:19 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:31:19 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:31:19 user nova-compute[75229]: DEBUG nova.network.neutron [-] [instance: b09bd69f-531c-4e44-a955-c56f0f8ada85] Updating instance_info_cache with network_info: [] {{(pid=75229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 10:31:19 user nova-compute[75229]: INFO nova.compute.manager [-] [instance: b09bd69f-531c-4e44-a955-c56f0f8ada85] Took 0.85 seconds to deallocate network for instance.
Nov 14 10:31:19 user nova-compute[75229]: DEBUG nova.compute.manager [req-87945d2d-c4e7-4b58-af30-e86208465212 req-e26a198d-c9b7-45fa-9c1b-eabae58f2ec2 service nova] [instance: b09bd69f-531c-4e44-a955-c56f0f8ada85] Received event network-vif-deleted-a47c7541-2bcf-4288-a237-90e2b1439d20 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 10:31:19 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-d913be1d-8fa8-4996-b14a-a1fe84554378 tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:31:19 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-d913be1d-8fa8-4996-b14a-a1fe84554378 tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:31:19 user nova-compute[75229]: DEBUG nova.compute.provider_tree [None req-d913be1d-8fa8-4996-b14a-a1fe84554378 tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] Inventory has not changed in ProviderTree for provider: d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 {{(pid=75229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 10:31:19 user nova-compute[75229]: DEBUG nova.scheduler.client.report [None req-d913be1d-8fa8-4996-b14a-a1fe84554378 tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] Inventory has not changed for provider d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 10:31:19 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-d913be1d-8fa8-4996-b14a-a1fe84554378 tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.120s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:31:19 user nova-compute[75229]: INFO nova.scheduler.client.report [None req-d913be1d-8fa8-4996-b14a-a1fe84554378 tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] Deleted allocations for instance b09bd69f-531c-4e44-a955-c56f0f8ada85
Nov 14 10:31:19 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-d913be1d-8fa8-4996-b14a-a1fe84554378 tempest-SnapshotDataIntegrityTests-1621425388 tempest-SnapshotDataIntegrityTests-1621425388-project-member] Lock "b09bd69f-531c-4e44-a955-c56f0f8ada85" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.063s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:31:20 user nova-compute[75229]: DEBUG nova.compute.manager [req-16305fc9-0b53-427d-8aa9-fdacc3b2fe91 req-f7e85ebb-58d4-422f-945f-e4579283fec1 service nova] [instance: b09bd69f-531c-4e44-a955-c56f0f8ada85] Received event network-vif-plugged-a47c7541-2bcf-4288-a237-90e2b1439d20 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 10:31:20 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-16305fc9-0b53-427d-8aa9-fdacc3b2fe91 req-f7e85ebb-58d4-422f-945f-e4579283fec1 service nova] Acquiring lock "b09bd69f-531c-4e44-a955-c56f0f8ada85-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:31:20 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-16305fc9-0b53-427d-8aa9-fdacc3b2fe91 req-f7e85ebb-58d4-422f-945f-e4579283fec1 service nova] Lock "b09bd69f-531c-4e44-a955-c56f0f8ada85-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:31:20 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-16305fc9-0b53-427d-8aa9-fdacc3b2fe91 req-f7e85ebb-58d4-422f-945f-e4579283fec1 service nova] Lock "b09bd69f-531c-4e44-a955-c56f0f8ada85-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:31:20 user nova-compute[75229]: DEBUG nova.compute.manager [req-16305fc9-0b53-427d-8aa9-fdacc3b2fe91 req-f7e85ebb-58d4-422f-945f-e4579283fec1 service nova] [instance: b09bd69f-531c-4e44-a955-c56f0f8ada85] No waiting events found dispatching network-vif-plugged-a47c7541-2bcf-4288-a237-90e2b1439d20 {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 10:31:20 user nova-compute[75229]: WARNING nova.compute.manager [req-16305fc9-0b53-427d-8aa9-fdacc3b2fe91 req-f7e85ebb-58d4-422f-945f-e4579283fec1 service nova] [instance: b09bd69f-531c-4e44-a955-c56f0f8ada85] Received unexpected event network-vif-plugged-a47c7541-2bcf-4288-a237-90e2b1439d20 for instance with vm_state deleted and task_state None.
Nov 14 10:31:20 user nova-compute[75229]: DEBUG nova.compute.manager [req-16305fc9-0b53-427d-8aa9-fdacc3b2fe91 req-f7e85ebb-58d4-422f-945f-e4579283fec1 service nova] [instance: b09bd69f-531c-4e44-a955-c56f0f8ada85] Received event network-vif-plugged-a47c7541-2bcf-4288-a237-90e2b1439d20 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 10:31:20 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-16305fc9-0b53-427d-8aa9-fdacc3b2fe91 req-f7e85ebb-58d4-422f-945f-e4579283fec1 service nova] Acquiring lock "b09bd69f-531c-4e44-a955-c56f0f8ada85-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:31:20 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-16305fc9-0b53-427d-8aa9-fdacc3b2fe91 req-f7e85ebb-58d4-422f-945f-e4579283fec1 service nova] Lock "b09bd69f-531c-4e44-a955-c56f0f8ada85-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:31:20 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-16305fc9-0b53-427d-8aa9-fdacc3b2fe91 req-f7e85ebb-58d4-422f-945f-e4579283fec1 service nova] Lock "b09bd69f-531c-4e44-a955-c56f0f8ada85-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:31:20 user nova-compute[75229]: DEBUG nova.compute.manager [req-16305fc9-0b53-427d-8aa9-fdacc3b2fe91 req-f7e85ebb-58d4-422f-945f-e4579283fec1 service nova] [instance: b09bd69f-531c-4e44-a955-c56f0f8ada85] No waiting events found dispatching network-vif-plugged-a47c7541-2bcf-4288-a237-90e2b1439d20 {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 10:31:20 user nova-compute[75229]: WARNING nova.compute.manager [req-16305fc9-0b53-427d-8aa9-fdacc3b2fe91 req-f7e85ebb-58d4-422f-945f-e4579283fec1 service nova] [instance: b09bd69f-531c-4e44-a955-c56f0f8ada85] Received unexpected event network-vif-plugged-a47c7541-2bcf-4288-a237-90e2b1439d20 for instance with vm_state deleted and task_state None.
Nov 14 10:31:20 user nova-compute[75229]: DEBUG nova.compute.manager [req-16305fc9-0b53-427d-8aa9-fdacc3b2fe91 req-f7e85ebb-58d4-422f-945f-e4579283fec1 service nova] [instance: b09bd69f-531c-4e44-a955-c56f0f8ada85] Received event network-vif-plugged-a47c7541-2bcf-4288-a237-90e2b1439d20 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 10:31:20 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-16305fc9-0b53-427d-8aa9-fdacc3b2fe91 req-f7e85ebb-58d4-422f-945f-e4579283fec1 service nova] Acquiring lock "b09bd69f-531c-4e44-a955-c56f0f8ada85-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:31:20 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-16305fc9-0b53-427d-8aa9-fdacc3b2fe91 req-f7e85ebb-58d4-422f-945f-e4579283fec1 service nova] Lock "b09bd69f-531c-4e44-a955-c56f0f8ada85-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:31:20 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-16305fc9-0b53-427d-8aa9-fdacc3b2fe91 req-f7e85ebb-58d4-422f-945f-e4579283fec1 service nova] Lock "b09bd69f-531c-4e44-a955-c56f0f8ada85-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:31:20 user nova-compute[75229]: DEBUG nova.compute.manager [req-16305fc9-0b53-427d-8aa9-fdacc3b2fe91 req-f7e85ebb-58d4-422f-945f-e4579283fec1 service nova] [instance: b09bd69f-531c-4e44-a955-c56f0f8ada85] No waiting events found dispatching network-vif-plugged-a47c7541-2bcf-4288-a237-90e2b1439d20 {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 10:31:20 user nova-compute[75229]: WARNING nova.compute.manager [req-16305fc9-0b53-427d-8aa9-fdacc3b2fe91 req-f7e85ebb-58d4-422f-945f-e4579283fec1 service nova] [instance: b09bd69f-531c-4e44-a955-c56f0f8ada85] Received unexpected event network-vif-plugged-a47c7541-2bcf-4288-a237-90e2b1439d20 for instance with vm_state deleted and task_state None.
Nov 14 10:31:20 user nova-compute[75229]: DEBUG nova.compute.manager [req-16305fc9-0b53-427d-8aa9-fdacc3b2fe91 req-f7e85ebb-58d4-422f-945f-e4579283fec1 service nova] [instance: b09bd69f-531c-4e44-a955-c56f0f8ada85] Received event network-vif-unplugged-a47c7541-2bcf-4288-a237-90e2b1439d20 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 10:31:20 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-16305fc9-0b53-427d-8aa9-fdacc3b2fe91 req-f7e85ebb-58d4-422f-945f-e4579283fec1 service nova] Acquiring lock "b09bd69f-531c-4e44-a955-c56f0f8ada85-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:31:20 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-16305fc9-0b53-427d-8aa9-fdacc3b2fe91 req-f7e85ebb-58d4-422f-945f-e4579283fec1 service nova] Lock "b09bd69f-531c-4e44-a955-c56f0f8ada85-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:31:20 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-16305fc9-0b53-427d-8aa9-fdacc3b2fe91 req-f7e85ebb-58d4-422f-945f-e4579283fec1 service nova] Lock "b09bd69f-531c-4e44-a955-c56f0f8ada85-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:31:20 user nova-compute[75229]: DEBUG nova.compute.manager [req-16305fc9-0b53-427d-8aa9-fdacc3b2fe91 req-f7e85ebb-58d4-422f-945f-e4579283fec1 service nova] [instance: b09bd69f-531c-4e44-a955-c56f0f8ada85] No waiting events found dispatching network-vif-unplugged-a47c7541-2bcf-4288-a237-90e2b1439d20 {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 10:31:20 user nova-compute[75229]: WARNING nova.compute.manager [req-16305fc9-0b53-427d-8aa9-fdacc3b2fe91 req-f7e85ebb-58d4-422f-945f-e4579283fec1 service nova] [instance: b09bd69f-531c-4e44-a955-c56f0f8ada85] Received unexpected event network-vif-unplugged-a47c7541-2bcf-4288-a237-90e2b1439d20 for instance with vm_state deleted and task_state None.
Nov 14 10:31:20 user nova-compute[75229]: DEBUG nova.compute.manager [req-16305fc9-0b53-427d-8aa9-fdacc3b2fe91 req-f7e85ebb-58d4-422f-945f-e4579283fec1 service nova] [instance: b09bd69f-531c-4e44-a955-c56f0f8ada85] Received event network-vif-plugged-a47c7541-2bcf-4288-a237-90e2b1439d20 {{(pid=75229) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 10:31:20 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-16305fc9-0b53-427d-8aa9-fdacc3b2fe91 req-f7e85ebb-58d4-422f-945f-e4579283fec1 service nova] Acquiring lock "b09bd69f-531c-4e44-a955-c56f0f8ada85-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:31:20 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-16305fc9-0b53-427d-8aa9-fdacc3b2fe91 req-f7e85ebb-58d4-422f-945f-e4579283fec1 service nova] Lock "b09bd69f-531c-4e44-a955-c56f0f8ada85-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:31:20 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [req-16305fc9-0b53-427d-8aa9-fdacc3b2fe91 req-f7e85ebb-58d4-422f-945f-e4579283fec1 service nova] Lock "b09bd69f-531c-4e44-a955-c56f0f8ada85-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:31:20 user nova-compute[75229]: DEBUG nova.compute.manager [req-16305fc9-0b53-427d-8aa9-fdacc3b2fe91 req-f7e85ebb-58d4-422f-945f-e4579283fec1 service nova] [instance: b09bd69f-531c-4e44-a955-c56f0f8ada85] No waiting events found dispatching network-vif-plugged-a47c7541-2bcf-4288-a237-90e2b1439d20 {{(pid=75229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 10:31:20 user nova-compute[75229]: WARNING nova.compute.manager [req-16305fc9-0b53-427d-8aa9-fdacc3b2fe91 req-f7e85ebb-58d4-422f-945f-e4579283fec1 service nova] [instance: b09bd69f-531c-4e44-a955-c56f0f8ada85] Received unexpected event network-vif-plugged-a47c7541-2bcf-4288-a237-90e2b1439d20 for instance with vm_state deleted and task_state None.
Nov 14 10:31:21 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:31:21 user nova-compute[75229]: DEBUG nova.compute.manager [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Starting heal instance info cache {{(pid=75229) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 10:31:21 user nova-compute[75229]: DEBUG nova.compute.manager [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Rebuilding the list of instances to heal {{(pid=75229) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 10:31:21 user nova-compute[75229]: DEBUG nova.compute.manager [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Didn't find any instances for network info cache update. {{(pid=75229) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 14 10:31:23 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:31:24 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:31:25 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:31:26 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:31:28 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:31:28 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 10:31:29 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:31:29 user nova-compute[75229]: DEBUG nova.compute.manager [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75229) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 10:31:33 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 10:31:33 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:31:33 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75229) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 10:31:33 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75229) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 10:31:33 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75229) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 10:31:33 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:31:34 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:31:35 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:31:35 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:31:35 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:31:35 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:31:35 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:31:35 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Auditing locally available compute resources for user (node: user) {{(pid=75229) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 10:31:36 user nova-compute[75229]: WARNING nova.virt.libvirt.driver [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 10:31:36 user nova-compute[75229]: WARNING nova.virt.libvirt.driver [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 10:31:36 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Hypervisor/Node resource view: name=user free_ram=9151MB free_disk=25.135536193847656GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75229) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 10:31:36 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:31:36 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:31:36 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75229) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 10:31:36 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75229) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 10:31:36 user nova-compute[75229]: DEBUG nova.compute.provider_tree [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Inventory has not changed in ProviderTree for provider: d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 {{(pid=75229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 10:31:36 user nova-compute[75229]: DEBUG nova.scheduler.client.report [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Inventory has not changed for provider d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 10:31:36 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Compute_service record updated for user:user {{(pid=75229) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 10:31:36 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.151s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:31:38 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:31:38 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 10:31:43 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 10:31:43 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 10:31:43 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75229) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 10:31:43 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75229) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 10:31:43 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75229) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 10:31:43 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:31:48 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 10:31:53 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 10:31:58 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 10:32:03 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:32:08 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:32:08 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:32:12 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:32:13 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:32:15 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:32:18 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:32:21 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:32:21 user nova-compute[75229]: DEBUG nova.compute.manager [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Starting heal instance info cache {{(pid=75229) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 10:32:21 user nova-compute[75229]: DEBUG nova.compute.manager [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Rebuilding the list of instances to heal {{(pid=75229) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 10:32:21 user nova-compute[75229]: DEBUG nova.compute.manager [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Didn't find any instances for network info cache update. {{(pid=75229) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 14 10:32:23 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 10:32:24 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:32:28 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:32:28 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:32:30 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:32:30 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:32:30 user nova-compute[75229]: DEBUG nova.compute.manager [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75229) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 10:32:33 user nova-compute[75229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75229) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 10:32:36 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:32:36 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:32:36 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:32:36 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:32:36 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:32:36 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Auditing locally available compute resources for user (node: user) {{(pid=75229) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 10:32:37 user nova-compute[75229]: WARNING nova.virt.libvirt.driver [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 10:32:37 user nova-compute[75229]: WARNING nova.virt.libvirt.driver [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 10:32:37 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Hypervisor/Node resource view: name=user free_ram=9289MB free_disk=25.086116790771484GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75229) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 10:32:37 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 10:32:37 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 10:32:37 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75229) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 10:32:37 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75229) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 10:32:37 user nova-compute[75229]: DEBUG nova.compute.provider_tree [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Inventory has not changed in ProviderTree for provider: d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 {{(pid=75229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 10:32:37 user nova-compute[75229]: DEBUG nova.scheduler.client.report [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Inventory has not changed for provider d4c50b17-26ae-43ca-86ed-ed20eb5b2dc3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 10:32:37 user nova-compute[75229]: DEBUG nova.compute.resource_tracker [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Compute_service record updated for user:user {{(pid=75229) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 10:32:37 user nova-compute[75229]: DEBUG oslo_concurrency.lockutils [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.107s {{(pid=75229) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 10:32:38 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 10:32:38 user nova-compute[75229]: DEBUG oslo_service.periodic_task [None req-bc4d92ba-86d3-4d15-a157-3a5517eae431 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}